big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,962 Commits 2 Branches 2 Tags 264 MiB
783124488c
Commit Graph

3962 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Suresh Srinivas
783124488c Merging changes from trunk to pick HDFS-4124 changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403306 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:17:28 +00:00
Suresh Srinivas
1b3b09d947 HDFS-4124. Refactor INodeDirectory#getExistingPathINodes() to enable returningmore than INode array. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403304 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:11:04 +00:00
Suresh Srinivas
564adec5b5 Merging trunk to HDFS-2802 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403301 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:09:47 +00:00
Suresh Srinivas
4bcf516d0e HDFS-3920. libwebdhfs string processing and using strerror consistently to handle all errors. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403173 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 05:10:29 +00:00
Suresh Srinivas
cea7bbc630 HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403120 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 23:10:53 +00:00
Tsz-wo Sze
f60a844e7a HDFS-4119. Complete the allowSnapshot code and add a test for it. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403087 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 20:02:54 +00:00
Suresh Srinivas
fd7de4c4eb HDFS-4106. BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be volatile. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403075 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 19:03:57 +00:00
Suresh Srinivas
abe3676e50 HDFS-4115. TestHDFSCLI.testAll fails one test due to number format. Contributed by Trevor Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403074 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 18:59:11 +00:00
Suresh Srinivas
22377ebae5 HADOOP-8985. Add namespace declarations in .proto files for languages other than java. Thank you Binglin Chan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402845 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-27 18:44:15 +00:00
Suresh Srinivas
b6d09f67ab Moving HDFS-4121 from trunk to Release 2.0.3 section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402843 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-27 18:41:43 +00:00
Suresh Srinivas
cd2e9d2fce HDFS-4121. Add namespace declarations in hdfs .proto files for languages other than java. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402836 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-27 18:25:02 +00:00
Suresh Srinivas
9e26fdcda7 HDFS-4111. Support snapshot of subtrees. Contributed by Tsz Wo (Nicholas), Sze. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402684 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 22:02:30 +00:00
Thomas Graves
a577f757f7 HADOOP-8713. TestRPCCompatibility fails intermittently with JDK7 Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402660 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 21:03:29 +00:00
Jason Darrell Lowe
286c171987 MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402658 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 21:02:52 +00:00
Thomas White
b54e794fb0 YARN-145. Add a Web UI to the fair share scheduler. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402657 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 20:55:57 +00:00
Tsz-wo Sze
3335e50244 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402608 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:22:49 +00:00
Tsz-wo Sze
b5355e5050 Merge r1402274 through r1402603 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402605 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:17:03 +00:00
Tsz-wo Sze
0e796b61e8 HDFS-4112. A few improvements on INodeDirectory include adding a utility method for casting; avoiding creation of new empty lists; cleaning up some code and rewriting some javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402599 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:08:38 +00:00
Tsz-wo Sze
719279ea8a HDFS-4092. Update file deletion logic for snapshot so that the current inode is removed from the circular linked list; and if some blocks at the end of the block list no longer belong to any other inode, collect them and update the block list. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402287 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 19:32:26 +00:00
Tsz-wo Sze
40d2b6f308 Merge r1401869 through r1402273 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402278 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 19:09:34 +00:00
Tsz-wo Sze
2d74f68054 HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402270 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:53:25 +00:00
Tsz-wo Sze
ba2ee1d7fb HDFS-4107. Add utility methods for casting INode to INodeFile and INodeFileUnderConstruction. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402265 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:44:46 +00:00
Suresh Srinivas
163577f905 HDFS-4067. TestUnderReplicatedBlocks intermittently fails due to ReplicaAlreadyExistsException. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402261 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:32:41 +00:00
Suresh Srinivas
611684e2e5 HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402203 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 16:15:59 +00:00
Suresh Srinivas
2d5334931e HDFS-4097. Provide CLI support for createSnapshot. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401971 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 04:08:36 +00:00
Vinod Kumar Vavilapalli
895029b2f2 MAPREDUCE-4730. Fix Reducer's EventFetcher to scale the map-completion requests slowly to avoid HADOOP-8942. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401941 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 01:26:30 +00:00
Tsz-wo Sze
14d8d0a670 Merge r1400738 through r1401868 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401869 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 20:42:03 +00:00
Tsz-wo Sze
b897bb8992 HDFS-4091. Add snapshot quota to limit the number of snapshots allowed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401868 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 20:39:26 +00:00
Jason Darrell Lowe
1e45b1f1fd MAPREDUCE-4741. WARN and ERROR messages logged during normal AM shutdown. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401738 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 15:45:35 +00:00
Jason Darrell Lowe
614a743fea YARN-139. Interrupted Exception within AsyncDispatcher leads to user confusion. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401726 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 15:20:58 +00:00
Robert Joseph Evans
90ba993bc7 YARN-180. Capacity scheduler - containers that get reserved create container token to early (acmurthy and bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401703 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 14:16:49 +00:00
Robert Joseph Evans
244ec4a5d1 YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401698 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 14:07:16 +00:00
Thomas Graves
cc523683cf YARN-177. CapacityScheduler - adding a queue while the RM is running has wacky results (acmurthy vai tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401668 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 13:21:09 +00:00
Vinod Kumar Vavilapalli
ca4bc1a417 YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via YARN-140. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401504 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 22:48:49 +00:00
Daryn Sharp
aaa07fc01b Updating credits for MAPREDUCE-4229. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401493 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:23:21 +00:00
Siddharth Seth
88d326f0a4 YARN-179. Fix some unit test failures. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401481 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:06:36 +00:00
Siddharth Seth
382b565e8c MAPREDUCE-4637. Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. (Contributed by Mayank Bansal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401474 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:02:22 +00:00
Daryn Sharp
61ffa3adb9 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401473 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 21:01:03 +00:00
Daryn Sharp
def0b949d4 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401467 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:57:36 +00:00
Suresh Srinivas
464edf2439 Moving HDFS-2434 from Release 2.0.3 section to trunk section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401446 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:27:16 +00:00
Suresh Srinivas
4fde5c0190 HDFS-4084. Provide CLI support to allow and disallow snapshot on a directory. Contributed by Brondon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401444 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:26:08 +00:00
Suresh Srinivas
aa42e2161d HDFS-2434. TestNameNodeMetrics.testCorruptBlock fails intermittently. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401423 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:02:09 +00:00
Robert Joseph Evans
b73903f6a7 HADOOP-8962. RawLocalFileSystem.listStatus fails when a child filename contains a colon (jlowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401325 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:47:26 +00:00
Robert Joseph Evans
13422461f3 HADOOP-8811. Compile hadoop native library in FreeBSD (Radim Kolar via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401321 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:32:25 +00:00
Daryn Sharp
a92313f7bd HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401309 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:03:53 +00:00
Suresh Srinivas
a4a01c9883 HADOOP-8900. I had mistakenly not credited the patch to the right person. Changing the contributor to Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401144 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 02:40:04 +00:00
Vinod Kumar Vavilapalli
4da8e2613e YARN-174. Modify NodeManager to pass the user's configuration even when rebooting. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401086 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 21:25:12 +00:00
Jason Darrell Lowe
49beea562a MAPREDUCE-4740. only .jars can be added to the Distributed Cache classpath. Contributed by Robert Joseph Evans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401054 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 19:50:23 +00:00
Tsz-wo Sze
75cdb5bb49 HDFS-4099. Clean up replication code and add more javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400986 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 18:30:16 +00:00
Suresh Srinivas
b69605eff5 Moved HADOOP-8951 from trunk to release 2.0.3 section in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400929 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 16:03:02 +00:00