big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,448 Commits 2 Branches 2 Tags 264 MiB
8d3c0f601d
Commit Graph

10448 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Myers
ee39160ab4 HADOOP-7111. Several TFile tests failing when native libraries are present. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148933 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-20 20:42:15 +00:00
Eli Collins
cda43d71be HDFS-1774. Small optimization to FSDataset. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148894 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-20 18:52:57 +00:00
Tsz-wo Sze
54c5bf2b8c Correct way to temporarily disable TestBlockPlacementPolicyRaid for MAPREDUCE-2711. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148421 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 16:02:45 +00:00
Tsz-wo Sze
cabec474e0 Revert r1148400 for MAPREDUCE-2711. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148416 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 15:54:10 +00:00
Tsz-wo Sze
2614f6e66b Temporarily disable TestBlockPlacementPolicyRaid for MAPREDUCE-2711. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148400 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 15:33:36 +00:00
Tsz-wo Sze
f5690f57ed MAPREDUCE-2710. Update JobSubmitter.printTokens(..) for HDFS-2161. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148367 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 14:43:45 +00:00
Tsz-wo Sze
710e5a960e HDFS-2161. Move createNamenode(..), createClientDatanodeProtocolProxy(..) and Random object creation to DFSUtil; move DFSClient.stringifyToken(..) to DelegationTokenIdentifier. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148348 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 14:23:50 +00:00
Suresh Srinivas
6c0cb4d151 HDFS-2141. Remove NameNode roles Active and Standby (they become states of the namenode). Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148125 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 01:32:59 +00:00
Tsz-wo Sze
c3f6575ca4 HDFS-2147. Move cluster network topology to block management and fix some javac warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1148112 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-19 00:26:21 +00:00
Eli Collins
2a49e1a3a4 MAPREDUCE-2623. Update ClusterMapReduceTestCase to use MiniDFSCluster.Builder. Contributed by Harsh J Chouraria 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147981 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 17:27:37 +00:00
Eli Collins
81001b87c1 HDFS-2157. Improve header comment in o.a.h.hdfs.server.namenode.NameNode. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147980 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 17:23:25 +00:00
Eli Collins
d3b2f68050 HADOOP-2081. Configuration getInt, getLong, and getFloat replace invalid numbers with the default value. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147971 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 17:03:20 +00:00
Eli Collins
845889384b HADOOP-7471. The saveVersion.sh script sometimes fails to extract SVN URL. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147967 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 16:54:57 +00:00
Eli Collins
0a84abfed0 HADOOP-7434. Display error when using "daemonlog -setlevel" with illegal level. Contributed by yanjinshuang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147966 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 16:49:00 +00:00
Suresh Srinivas
8a77d0b289 HDFS-2143. Federation: In cluster web console, add link to namenode page that displays live and dead datanodes. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147964 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 16:45:28 +00:00
Eli Collins
341b4a444e HADOOP-7465. A several tiny improvements for the LOG format. Contributed by Xie Xianshan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147952 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 16:24:45 +00:00
Aaron Myers
eaa0638c12 HDFS-2152. TestWriteConfigurationToDFS causing the random failures. (Uma Maheswara Rao G via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147762 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-18 07:07:58 +00:00
Tsz-wo Sze
c163455df4 HDFS-2159. Deprecate DistributedFileSystem.getClient() and fixed the deprecated warnings in DFSAdmin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147359 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-16 05:12:40 +00:00
Tsz-wo Sze
c093580824 HDFS-2153. Move DFSClientAdapter to test and fix some javac warnings in OfflineEditsViewerHelper. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147340 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-15 22:46:43 +00:00
Jitendra Nath Pandey
31f1a674e5 HADOOP-7314. Add support for throwing UnknownHostException when a host doesn't resolve. Contributed by Jeffrey Naisbitt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147317 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-15 20:58:00 +00:00
Tsz-wo Sze
f582aa4492 HDFS-2154. In TestDFSShell, use TEST_ROOT_DIR and fix some deprecated warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1147184 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-15 15:09:43 +00:00
Eli Collins
4f0dba4142 HADOOP-7305. Eclipse project files are incomplete. Contributed by Niels Basjes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146912 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-14 22:27:15 +00:00
Arun Murthy
4ea4eeca75 MAPREDUCE-2365. Adding newer files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146517 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 23:50:30 +00:00
Aaron Myers
c54c117407 HDFS-2120. on reconnect, DN can connect to NN even with different source versions. (John George via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146516 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 23:44:42 +00:00
Arun Murthy
4796e1adcb MAPREDUCE-2365. Add counters to track bytes (read,written) via File(Input,Output)Format. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146515 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 23:36:02 +00:00
Tsz-wo Sze
8327e70be8 HDFS-2140. Move Host2NodesMap to the blockmanagement package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146514 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 23:24:36 +00:00
Eli Collins
422608d53e MAPREDUCE-2670. Fixing spelling mistake in FairSchedulerServlet.java. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146485 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 21:17:26 +00:00
Todd Lipcon
d62523b4ad HADOOP-7443. Add CRC32C as another DataChecksum implementation. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146300 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 19:41:46 +00:00
Todd Lipcon
22fa0e43e3 HADOOP-7444. Add Checksum API to verify and calculate checksums "in bulk". Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1146111 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 16:12:42 +00:00
Arun Murthy
654705b882 MAPREDUCE-2682. Add "mapred classpath" command to print classpath for MR applications. Contributed by vinodkv. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145889 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 07:17:53 +00:00
Arun Murthy
e2a53a37dd MAPREDUCE-2680. Display queue name in job client CLI. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145871 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 06:04:04 +00:00
Arun Murthy
f57eaf3989 MAPREDUCE-2679. Minor changes to sync trunk with MR-279 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145870 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 06:03:00 +00:00
Tsz-wo Sze
13a26379ed HDFS-2131. Add new tests for the -overwrite/-f option in put and copyFromLocal by HADOOP-7361. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145843 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 03:01:25 +00:00
Eli Collins
bf1b1b4ef7 HADOOP-7457. Remove out-of-date Chinese language documentation. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145839 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 02:15:31 +00:00
Jitendra Nath Pandey
2c5dd549e3 HDFS-1977. Stop using StringUtils.stringifyException(). Contributed by Bharath Mundlapudi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145834 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 01:11:01 +00:00
Matthew Foley
faf8747e3e HADOOP-7430. Improve error message when moving to trash fails due to quota issue. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145832 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-13 00:35:56 +00:00
Michael Stack
94f3b578ef HDFS-2054 BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() -- moved the change notice into 0.22 section (i'd originally committed it in trunk section) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145753 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 20:28:36 +00:00
Michael Stack
714edd65ac HDFS-2054 BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145751 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 20:23:39 +00:00
Arun Murthy
fd5a762df0 MAPREDUCE-2400. Remove Cluster's dependency on JobTracker via a ServiceProvider for the actual implementation. Contributed by Tom White. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145679 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 17:10:59 +00:00
Luke Lu
224972e055 HADOOP-7324. Ganglia plugins for metrics v2. (Priyo Mustafi via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145525 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 10:23:32 +00:00
Aaron Myers
1ba3ddbe6d HDFS-2132. Potential resource leak in EditLogFileOutputStream.close. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145428 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 02:18:30 +00:00
Eli Collins
12b8d9823d Fix missing close paragraph tag in previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145424 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 01:35:56 +00:00
Eli Collins
ad7cf36d5f MAPREDUCE-2606. Remove IsolationRunner. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145413 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-12 00:54:48 +00:00
Tsz-wo Sze
9e7e69e666 Add .launches to svn:ignore. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145394 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-11 23:12:31 +00:00
Tsz-wo Sze
b9189f7b15 HDFS-2134. Move DecommissionManager to the blockmanagement package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145393 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-11 23:06:36 +00:00
Tsz-wo Sze
e8eed98feb HADOOP-7361. Provide an option, -overwrite/-f, in put and copyFromLocal shell commands. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144858 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-10 13:28:01 +00:00
Tsz-wo Sze
6ec9b178c6 HDFS-2034. Length in DFSInputStream.getBlockRange(..) becomes -ve when reading only from a currently being written block. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144480 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 20:13:26 +00:00
Amar Kamat
787dcfb8cd MAPREDUCE-2596. [Gridmix] Summarize Gridmix runs. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144403 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 17:53:36 +00:00
Todd Lipcon
209fd3f9fc HDFS-2111. Add tests for ensuring that the DN will start with a few bad data directories. Contributed by Harsh J Chouraria. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144100 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 00:16:07 +00:00
Todd Lipcon
86236dd6c4 MAPREDUCE-2249. Check the reflexive property of Counters objects when comparing equality. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144097 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 00:01:00 +00:00