big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,791 Commits 2 Branches 2 Tags 264 MiB
14f1f76bf6
Commit Graph

6791 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vinod Kumar Vavilapalli
5a1b33507b YARN-1145. Fixed a potential file-handle leak in the web interface for displaying aggregated logs. Contributed by Rohith Sharma. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551326 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 19:27:48 +00:00
Vinod Kumar Vavilapalli
d38fb71d00 YARN-1505. Fixed Webapplication proxy server to not hardcode its bind address. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551314 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 19:09:44 +00:00
Colin McCabe
8e32e6aff1 HDFS-5666. Fix inconsistent synchronization in BPOfferService (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551301 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 18:35:40 +00:00
Arpit Agarwal
89a374afcb HDFS-5454. DataNode UUID should be assigned prior to FsDataset initialization. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551296 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 18:16:56 +00:00
Jason Darrell Lowe
fc77ed153e MAPREDUCE-5623. TestJobCleanup fails because of RejectedExecutionException and NPE. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551285 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 17:44:49 +00:00
Andrew Wang
6c641339d1 HDFS-5665. Remove the unnecessary writeLock while initializing CacheManager in FsNameSystem Ctor. (Uma Maheswara Rao G via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551270 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 17:12:55 +00:00
Uma Maheswara Rao G
1dabd42999 HDFS-5592. statechangeLog of completeFile should be logged only in case of success. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551145 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 09:53:57 +00:00
Arpit Agarwal
121137789c HDFS-5406. Add file missed in previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551110 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 04:05:53 +00:00
Arpit Agarwal
938565925a HDFS-5406. Send incremental block reports for all storages in a single call. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551093 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 00:58:40 +00:00
Tsz-wo Sze
44a6560b5d HDFS-5632. Flatten INodeDirectory hierarchy: Replace INodeDirectoryWithSnapshot with DirectoryWithSnapshotFeature. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550917 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-14 10:13:30 +00:00
Zhijie Shen
d63cfdbf1a YARN-1435. Modified Distributed Shell to accept either the command or the custom script. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550867 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-14 02:00:41 +00:00
Vinod Kumar Vavilapalli
1182ca04d4 YARN-1485. Modified RM HA configuration validation to also ensure that service-address configuration are configured for every RM. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550854 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-13 23:54:44 +00:00
Chris Nauroth
f24e0c1563 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550774 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-13 17:28:14 +00:00
Junping Du
a31a3a68ea HDFS-5652. Refactor invalid block token exception handling in DFSInputStream. (Liang Xie via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550620 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-13 02:47:04 +00:00
Jian He
8008929bf7 Updated CHANGES.txt for YARN-1311. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550615 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-13 01:59:30 +00:00
Jian He
28db28d491 YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550613 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-13 01:44:16 +00:00
Jian He
791e43c53b Reverting YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550594 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 23:45:01 +00:00
Jian He
38c32ed239 YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550579 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 23:07:17 +00:00
Hitesh Shah
288506022f HADOOP-8753. LocalDirAllocator throws ArithmeticException: divide by zero when there is no available space on configured local dir. Contributed by Benoy Antony. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550570 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 22:55:06 +00:00
Chris Nauroth
9263f3bb14 HDFS-5596. Implement RPC stubs. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550544 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 21:47:46 +00:00
Vinod Kumar Vavilapalli
8a79be36bd YARN-1325. Modified RM HA configuration validation to also ensure that multiple RMs are configured. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550524 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 20:50:11 +00:00
Sanjay Radia
a4819e70db HADOOP-10044 Improve the javadoc of rpc code (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550486 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 18:56:45 +00:00
Chris Nauroth
ee0530ee0e MAPREDUCE-5674. Missing start and finish time in mapred.JobStatus. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550472 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 18:30:12 +00:00
Jing Zhao
5fd7230671 HDFS-5647. Merge INodeDirectory.Feature and INodeFile.Feature. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550469 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 18:26:40 +00:00
Arpit Agarwal
329093ae1b HDFS-2832: Update binary file editsStored for TestOfflineEditsViewer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550364 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 07:47:09 +00:00
Arpit Agarwal
d887c6a286 svn merge --reintegrate https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832 for merging Heterogeneous Storage feature branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550363 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 07:17:51 +00:00
Arpit Agarwal
93511259ba Update CHANGES.txt in preparation for merging branch HDFS-2832 to trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1550361 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 07:07:05 +00:00
Arpit Agarwal
fba994ffe2 HDFS-5648. Get rid of FsDatasetImpl#perVolumeReplicaMap. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1550357 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 07:01:24 +00:00
Arpit Agarwal
c656562556 Merging r1550313 through r1550355 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1550356 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 06:51:54 +00:00
Junping Du
8373c4134a HDFS-5637. Try to refeatchToken while local read InvalidToken occurred. (Liang Xie via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550335 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 03:04:43 +00:00
Arpit Agarwal
cd083aa807 Merging r1549949 through r1550312 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1550313 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 23:18:29 +00:00
Colin McCabe
9678020e59 HDFS-4201. NPE in BPServiceActor#sendHeartBeat (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550269 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 21:30:16 +00:00
Jonathan Turner Eagles
ed4d318d68 HDFS-5023. TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7 (Mit Desai via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550261 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 21:16:48 +00:00
Chris Nauroth
709040c52e HDFS-5650. Remove AclReadFlag and AclWriteFlag in FileSystem API. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550256 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 20:54:46 +00:00
Vinod Kumar Vavilapalli
4ff1a8203b YARN-408. Change CapacityScheduler to not disable delay-scheduling by default. Contributed by Mayank Bansal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550245 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 20:14:30 +00:00
Colin McCabe
002840f605 HADOOP-10087. UserGroupInformation.getGroupNames() fails to return primary group first when JniBasedUnixGroupsMappingWithFallback is used (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550229 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 18:58:30 +00:00
Jonathan Turner Eagles
f3db30ccd8 YARN-1491. Upgrade JUnit3 TestCase to JUnit 4 (Chen He via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550204 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 17:50:26 +00:00
Karthik Kambatla
94e2e78ab7 YARN-1481. Move internal services logic from AdminService to ResourceManager. (vinodkv via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550167 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 15:13:46 +00:00
Junping Du
327a995561 HDFS-5580. Fix infinite loop in Balancer.waitForMoveCompletion. (Binglin Chang via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550074 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 08:51:12 +00:00
Jing Zhao
732975be82 Move HDFS-5283 to section branch-2.3.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550032 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 02:31:57 +00:00
Aaron Myers
e408ef35e9 Move entry for HDFS-5074 to correct section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550027 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 02:01:54 +00:00
Aaron Myers
512a18a8d9 HDFS-5074. Allow starting up from an fsimage checkpoint in the middle of a segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550016 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 01:32:22 +00:00
Jing Zhao
87734ec939 Move HDFS-5257,HDFS-5427,HDFS-5443,HDFS-5476,HDFS-5425,HDFS-5474,HDFS-5504,HDFS-5428 into branch-2.3 section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550011 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 01:09:13 +00:00
Arpit Agarwal
f3cef1c673 Merging r1549626 through r1549948 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1549949 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-10 19:50:02 +00:00
Chris Nauroth
b4d8aabe6b HDFS-5594. FileSystem API for ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1549910 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-10 17:56:30 +00:00
Chris Nauroth
aff5be250a Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1549906 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-10 17:35:17 +00:00
Jonathan Turner Eagles
ee5351bf22 MAPREDUCE-5052. Job History UI and web services confusing job start time and job submit time (Chen He via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1549896 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-10 17:17:47 +00:00
Andrew Wang
a0c911a7f9 Move HDFS-4983 to 2.3 in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1549747 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-10 02:37:20 +00:00
Jason Darrell Lowe
18d99c12c3 MAPREDUCE-5656. bzip2 codec can drop records when reading data in splits. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1549705 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-09 23:31:30 +00:00
Chris Nauroth
a6313b1523 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1549699 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-09 22:52:02 +00:00