big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9,988 Commits 2 Branches 2 Tags 264 MiB
ac8d52bf50
Commit Graph

9988 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Harsh J
67f25b0a1b HDFS-2572. Remove Unnecessary double-check in DN#getHostName (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204177 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 15:18:14 +00:00
Eli Collins
5573b691d5 HDFS-2567. When 0 DNs are available, show a proper error when trying to browse DFS via web UI. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204131 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 06:28:37 +00:00
Eli Collins
8686a00c7a HDFS-2570. Add descriptions for dfs.*.https.address in hdfs-default.xml. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204129 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 06:22:44 +00:00
Eli Collins
8e8bb50afd HDFS-2454. Move maxXceiverCount check to before starting the thread in dataXceiver. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204124 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 04:27:59 +00:00
Eli Collins
513718f92d HDFS-2568. Use a set to manage child sockets in XceiverServer. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204122 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 04:13:32 +00:00
Eli Collins
b2313021fd HDFS-2536. Remove unused imports. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204120 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:58:50 +00:00
Eli Collins
0e5c1a45bf HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204119 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:38:51 +00:00
Eli Collins
84f0c0f180 HDFS-2502. hdfs-default.xml should include dfs.name.dir.restore. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204117 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 03:29:20 +00:00
Eli Collins
7a8015c0e2 HDFS-2541. For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204114 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-20 02:51:50 +00:00
Eli Collins
b7cd8c0f86 HDFS-2564. Cleanup unnecessary exceptions thrown and unnecessary casts. Contributed by Hari Mankude 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203950 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 02:34:25 +00:00
Todd Lipcon
1f92266516 HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203943 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 01:31:59 +00:00
Alejandro Abdelnur
26447229ba HADOOP-7590. Mavenize streaming and MR examples. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203941 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 01:24:32 +00:00
Aaron Myers
67c372991c Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1203781 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 18:29:26 +00:00
Todd Lipcon
905a127850 HDFS-2562. Refactor DN configuration variables out of DataNode class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203543 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 09:04:20 +00:00
Thomas White
bd0fbbb942 MAPREDUCE-3372. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203488 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 05:14:15 +00:00
Thomas White
6a01c22755 HDFS-2543. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203486 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 05:10:40 +00:00
Thomas White
bd2e2aaf99 MAPREDUCE-3373. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203455 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:57:08 +00:00
Thomas White
dc5a0ab245 HDFS-2544. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203452 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:53:46 +00:00
Thomas White
41cfb68419 HADOOP-7802. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203449 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:48:54 +00:00
Todd Lipcon
0864ef1908 HDFS-2560. Refactor BPOfferService to be a static inner class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203444 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:45:31 +00:00
Thomas White
7edfff5795 HADOOP-7787. Make source tarball use conventional name. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203437 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:19:53 +00:00
Alejandro Abdelnur
ed45ad0fcc MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203411 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 22:58:44 +00:00
Alejandro Abdelnur
302e3dfe2c MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2. (Ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203371 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 21:13:29 +00:00
Aaron Myers
6c710f5f80 Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1203320 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 18:46:25 +00:00
Aaron Myers
61f77396fa Merge trunk into HA branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1202940 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 23:46:19 +00:00
Vinod Kumar Vavilapalli
9d7402e0af MAPREDUCE-3407. Fixed pom files to refer to the correct MR app-jar needed by the integration tests. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202766 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 16:30:05 +00:00
Vinod Kumar Vavilapalli
00b50a5c94 MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202744 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 15:37:27 +00:00
Mahadev Konar
649080131c HADOOP-7811. TestUserGroupInformation#testGetServerSideGroups test fails in chroot. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202540 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 06:29:09 +00:00
Vinod Kumar Vavilapalli
c56e051961 MAPREDUCE-3102. Changed NodeManager to fail fast when LinuxContainerExecutor has wrong configuration or permissions. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202117 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 10:30:26 +00:00
Aaron Myers
0d171f6513 Merge trunk into HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1202013 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 02:39:13 +00:00
Mahadev Konar
3491205b0a MAPREDUCE-3331. Improvement to single node cluster setup documentation for 0.23 (Anupam Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202002 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 02:05:25 +00:00
Amar Kamat
116b91cdfb MAPREDUCE-3375. [Gridmix] Memory Emulation system tests. (Vinay Thota via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201997 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 01:48:42 +00:00
Todd Lipcon
9a3f147fdd HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201991 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 01:13:58 +00:00
Todd Lipcon
51ce383112 HDFS-2532. Add timeout to TestDfsOverAvroRpc 
This test is timing out on trunk, causing tests below it to
fail spuriously. This patch doesn't fix the issue -- just adds
a JUnit timeout so that the failure is properly attributed
to this test.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201963 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 23:34:21 +00:00
Mahadev Konar
4cdcf7b867 MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201951 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 22:44:44 +00:00
Mahadev Konar
58bfa24ae4 MAPREDUCE-3341. Enhance logging of initalized queue limit values. (Anupam Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201947 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 22:38:56 +00:00
Mahadev Konar
503593af1e MAPREDUCE-3325. Improvements to CapacityScheduler doc. (Thomas Graves via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201925 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 21:59:56 +00:00
Mahadev Konar
ac320f5046 MAPREDUCE-3324. Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI servers (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201914 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 21:30:10 +00:00
Todd Lipcon
3cedc5f83f HADOOP-7813. Fix test-patch to use proper numerical comparison when checking javadoc and findbugs warning counts. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201056 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 21:16:27 +00:00
Vinod Kumar Vavilapalli
27c9b8833b MAPREDUCE-3370. More changes accidentally missed from the previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200775 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 08:51:21 +00:00
Vinod Kumar Vavilapalli
9c17410c50 MAPREDUCE-3370. Fixed MiniMRYarnCluster and related tests to not use a hard-coded path for the mr-app jar. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200768 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 08:44:52 +00:00
Vinod Kumar Vavilapalli
dbc82dbdfb MAPREDUCE-3379. Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200747 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 06:30:27 +00:00
Tsz-wo Sze
09a156fcce HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200731 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 04:19:45 +00:00
Vinod Kumar Vavilapalli
200bb27557 MAPREDUCE-3392. Fixed Cluster's getDelegationToken's API to return null when there isn't a supported token. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200484 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 19:19:25 +00:00
Vinod Kumar Vavilapalli
15150cd997 MAPREDUCE-3280. Removed the unnecessary job user-name configuration in mapred-site.xml. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200441 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 17:28:16 +00:00
Vinod Kumar Vavilapalli
2df83e5b4d MAPREDUCE-3333. Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199751 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 13:41:19 +00:00
Vinod Kumar Vavilapalli
3853d112ea MAPREDUCE-3336. Replaced guice internal.Preconditions api usage with the public Preconditions API. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199714 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 12:40:41 +00:00
Amar Kamat
cec9f82344 MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests. (Vinay Thota via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199678 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 09:47:50 +00:00
Tsz-wo Sze
94c631af1f HDFS-2540. Webhdfs: change "Expect: 100-continue" to two-step write; change "HdfsFileStatus" and "localName" respectively to "FileStatus" and "pathSuffix" in JSON response. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199396 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 19:25:57 +00:00
Vinod Kumar Vavilapalli
80cc8e9486 MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199144 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 07:55:51 +00:00