big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13,363 Commits 2 Branches 2 Tags 264 MiB
4b1dcbbe0c
Commit Graph

13363 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vinayakumar B
39581e3be2 HDFS-9139. Enable parallel JUnit tests for HDFS Pre-commit (Contributed by Chris Nauroth and Vinayakumar B) 2015-10-13 19:00:08 +05:30
Vinayakumar B
caa711b660 HDFS-9160. [OIV-Doc] : Missing details of 'delimited' for processor options (Contributed by nijel) 2015-10-13 18:13:01 +05:30
Varun Vasudev
5b6bae0094 YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana 2015-10-13 12:48:30 +05:30
Vinayakumar B
69b025dbba HDFS-9224. TestFileTruncate fails intermittently with BindException (Contributed by Brahma Reddy Battula) 2015-10-13 11:42:12 +05:30
Lei Xu
0f5f9846ed HDFS-9006. Provide BlockPlacementPolicy that supports upgrade domain. (Ming Ma via lei) 2015-10-12 16:24:16 -07:00
Haohui Mai
c60a16fcea Addendum patch for HDFS-9215. 2015-10-12 15:52:10 -07:00
Jian He
9849c8b386 YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding 2015-10-12 11:51:33 -07:00
yliu
e617cf6dd1 HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) 2015-10-12 16:09:14 +08:00
Zhihai Xu
049c6e8dc0 YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong. 2015-10-12 00:14:25 -07:00
yliu
73b86a5046 HDFS-8988. Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap. (yliu) 2015-10-12 14:40:14 +08:00
yliu
0ff1216100 HDFS-9221. HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array. (Staffan Friberg via yliu) 2015-10-12 14:28:15 +08:00
Devaraj K
db93047881 YARN-3964. Support NodeLabelsProvider at Resource Manager side. 
Contributed by Dian Fu.
 2015-10-11 11:21:29 +05:30
Haohui Mai
7e2c971fed Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu." 
This reverts commit fa5a54cac7.
 2015-10-10 03:24:59 -07:00
Haohui Mai
fa5a54cac7 HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu. 2015-10-09 22:38:06 -07:00
Haohui Mai
18950c0a55 HDFS-9222. Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client. Contributed by Mingliang Liu. 2015-10-09 22:31:16 -07:00
Haohui Mai
d0c1e5fec4 HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. Contributed by Haohui Mai. 2015-10-09 21:12:44 -07:00
Wangda Tan
def374e666 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) 2015-10-09 16:38:59 -07:00
cnauroth
4f6e842ba9 HDFS-9085. Show renewer information in DelegationTokenIdentifier#toString. Contributed by Zhihai Xu. 2015-10-09 14:27:13 -07:00
Andrew Wang
c32614f410 HDFS-8941. DistributedFileSystem listCorruptFileBlocks API should resolve relative path. Contributed by Rakesh R. 2015-10-09 11:57:03 -07:00
Andrew Wang
357b1fd082 HDFS-9110. Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency. Contributed by Charlie Helin. 2015-10-09 11:49:16 -07:00
Ming Ma
de8efc65a4 HDFS-9142. Separating Configuration object for namenode(s) in MiniDFSCluster. (Siqi Li via mingma) 2015-10-09 11:10:46 -07:00
Yongjun Zhang
c11fc8a1be HDFS-9181. Better handling of exceptions thrown during upgrade shutdown. Contributed by Wei-Chiu Chuang. 2015-10-09 09:21:29 -07:00
Karthik Kambatla
4aa9b3e75c MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 2015-10-09 07:37:39 -07:00
Jason Lowe
a0bca2b5ad YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S 2015-10-09 14:17:38 +00:00
Rohith Sharma K S
8f195387a4 YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks) 2015-10-09 10:09:26 +05:30
Akira Ajisaka
e1bf8b3df6 HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 2015-10-09 11:10:29 +09:00
Akira Ajisaka
584cf3bb35 MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel. 2015-10-09 10:54:12 +09:00
Akira Ajisaka
b4390d5ab8 HDFS-9217. Fix broken findbugsExcludeFile.xml for hadoop-hdfs-client module. Contributed by Mingliang Liu. 2015-10-09 10:23:07 +09:00
Jason Lowe
8d226225d0 YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu 2015-10-08 22:25:34 +00:00
Jing Zhao
118a35bc2e HDFS-9204. DatanodeDescriptor#PendingReplicationWithoutTargets is wrongly calculated. Contributed by Mingliang Liu. 2015-10-08 14:11:02 -07:00
Jason Lowe
0841940a21 Fixup CHANGES.txt to reflect recent commits to 2.7.2 and 2.6.2 2015-10-08 16:45:29 +00:00
Yongjun Zhang
1107bd399c HDFS-8164. cTime is 0 in VERSION file for newly formatted NameNode. Contributed by Xiao Chen. 2015-10-07 23:20:10 -07:00
yliu
35affec38e HDFS-9137. DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded. (Uma Maheswara Rao G via yliu) 2015-10-08 10:27:47 +08:00
Andrew Wang
66e2cfa1a0 HDFS-8632. Add InterfaceAudience annotation to the erasure coding classes. Contributed by Rakesh R. 2015-10-07 18:12:26 -07:00
Jing Zhao
fde729feeb HDFS-9209. Erasure coding: Add apache license header in TestFileStatusWithECPolicy.java. Contributed by Surendra Singh Lilhore. 2015-10-07 15:17:50 -07:00
Lei Xu
6dd47d754c HDFS-9176. Fix TestDirectoryScanner#testThrottling often fails. (Daniel Templeton via lei) 2015-10-07 14:33:43 -07:00
Akira Ajisaka
7fbf69bf47 HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 2015-10-08 06:08:28 +09:00
Kihwal Lee
99e5204ff5 HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee. 2015-10-07 10:17:17 -05:00
Vinayakumar B
61b3547c46 HDFS-9159. [OIV] : return value of the command is not correct if invalid value specified in '-p (processor)' option (Contributed by nijel) 2015-10-07 14:29:34 +05:30
Haohui Mai
3112f26368 HDFS-9170. Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client. Contributed by Haohui Mai. 2015-10-07 00:06:33 -07:00
Jing Zhao
239d119c67 HDFS-9196. Fix TestWebHdfsContentLength. Contributed by Masatake Iwasaki. 2015-10-06 23:54:49 -07:00
Jing Zhao
8e53311ca2 HDFS-9206. Inconsistent default value of dfs.datanode.stripedread.buffer.size. Contributed by Walter Su. 2015-10-06 23:44:05 -07:00
Uma Mahesh
8b7339312c HDFS-9182. Cleanup the findbugs and other issues after HDFS EC merged to trunk. Contributed by Uma Maheswara Rao G. 2015-10-06 22:22:32 -07:00
Rohith Sharma K S
3793cbe4c3 YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks) 2015-10-07 10:12:14 +05:30
Rohith Sharma K S
9156fc60c6 YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks) 2015-10-07 09:34:59 +05:30
Robert Kanter
1bca1bb517 MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter) 2015-10-06 16:49:50 -07:00
Steve Loughran
6d5713a8a8 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:53 +01:00
Wangda Tan
29a582ada0 YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda) 2015-10-06 11:56:04 -07:00
Jing Zhao
a8b4d0ff28 HDFS-9180. Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers. Contributed by Jing Zhao. 2015-10-06 10:56:10 -07:00
Vinayakumar B
874c8ed239 HDFS-7899. Improve EOF error message (Contributed by Jagadesh Kiran N) 2015-10-06 15:42:36 +05:30