big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,297 Commits 2 Branches 2 Tags 264 MiB
6f9c346e57
Commit Graph

14297 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Nauroth
6f9c346e57 HADOOP-13446. Support running isolated unit tests separate from AWS integration tests. Contributed by Chris Nauroth. 2016-08-23 07:18:49 -07:00
Wei-Chiu Chuang
f0efea490e HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-23 04:14:24 -07:00
Jian He
dd76238a3b HADOOP-13524. mvn eclipse:eclipse generates .gitignore'able files. Contributed by Vinod Kumar Vavilapalli 2016-08-23 19:13:14 +08:00
Akira Ajisaka
e90f3359de HDFS-10783. The option '-maxSize' and '-step' fail in OfflineImageViewer. Contributed by Yiqun Lin. 2016-08-23 19:57:23 +09:00
Rohith Sharma K S
0d5997d2b9 YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G. 2016-08-23 14:37:39 +05:30
Akira Ajisaka
8cc4a67059 MAPREDUCE-6587. Remove unused params in connection-related methods of Fetcher. Contributed by Yiqun Lin. 2016-08-23 17:04:55 +09:00
Eric Yang
c49333becf HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang) 2016-08-22 18:29:56 -07:00
Xiao Chen
4070caad70 HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya. 2016-08-22 18:09:35 -07:00
Kihwal Lee
3ca4d6ddfd Revert "HDFS-10762. Pass IIP for file status related methods. Contributed by Daryn Sharp." 
This reverts commit 22fc46d765.
 2016-08-22 16:57:45 -05:00
Xiao Chen
f4d4d3474c HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen. 2016-08-22 14:42:13 -07:00
Kihwal Lee
22fc46d765 HDFS-10762. Pass IIP for file status related methods. Contributed by Daryn Sharp. 2016-08-22 15:37:02 -05:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
dc7a1c54f4 HDFS-10692. Update JDiff report's base version for HDFS from 2.6.0 to 2.7.2. Contributed by Wangda Tan. 2016-08-22 11:35:18 -07:00
Mingliang Liu
115ecb52a8 HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang) 2016-08-21 09:40:29 -07:00
Varun Saxena
d37b45d613 MAPREDUCE-6762. ControlledJob#toString failed with NPE when job status is not successfully updated (Weiwei Yang via Varun Saxena) 2016-08-21 21:46:17 +05:30
Jing Zhao
0faee62a0c HDFS-10764. Fix INodeFile#getBlocks to not return null. Contributed by Arpit Agarwal. 2016-08-19 22:13:36 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
99603e9022 HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan. 2016-08-19 19:08:53 -07:00
Wangda Tan
2da32a6ef9 YARN-4685. Disable AM blacklisting by default to mitigate situations that application get hanged. (Rohith Sharma K S via wangda) 2016-08-19 16:31:16 -07:00
Wangda Tan
444b2ea7af YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda) 2016-08-19 16:28:32 -07:00
Wangda Tan
3d937457ee MAPREDUCE-6310. Add jdiff support to MapReduce. (Li Lu/vinodkv via wangda) 2016-08-19 16:26:29 -07:00
Varun Saxena
723facfa40 MAPREDUCE-6763. Shuffle server listen queue is too small (Jason Lowe via Varun Saxena) 2016-08-20 03:58:16 +05:30
Chris Nauroth
763f0497bb HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran. 2016-08-19 10:48:10 -07:00
Wei-Chiu Chuang
03a9343d57 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. 2016-08-19 09:22:49 -07:00
Kihwal Lee
2550371f66 HDFS-10711. Optimize FSPermissionChecker group membership check. Contributed by Daryn Sharp. 2016-08-19 09:12:17 -05:00
Varun Saxena
091dd19e86 YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena) 2016-08-19 17:30:17 +05:30
Varun Saxena
8aed374182 Revert "YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)" 
This reverts commit 59557e85a4.
 2016-08-19 16:14:16 +05:30
Varun Saxena
59557e85a4 YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena) 2016-08-19 15:01:48 +05:30
Akira Ajisaka
8179f9a493 HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu. 2016-08-19 16:15:00 +09:00
Kai Zheng
dbcaf999d9 HADOOP-13504. Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010. Contributed by Sammi Chen 2016-08-19 11:18:15 +08:00
Jing Zhao
c5c3e81b49 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou. 2016-08-18 14:55:26 -07:00
Mingliang Liu
0f51eae0c0 HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu) 2016-08-18 14:10:37 -07:00
Chris Nauroth
ae4db25443 HADOOP-13513. Java 1.7 support for org.apache.hadoop.fs.azure testcases. Contributed by Tibor Kiss. 2016-08-18 10:44:36 -07:00
Junping Du
0da69c324d YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi. 
(cherry picked from commit d464483bf7f0b3e3be3ba32cd6c3eee546747ab5)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
 2016-08-18 07:27:23 -07:00
Steve Loughran
040c185d62 HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie 2016-08-18 14:36:55 +01:00
Varun Saxena
913a895136 YARN=5526. DrainDispacher#serviceStop blocked if setDrainEventsOnStop invoked (sandflee via Varun Saxena) 2016-08-18 11:38:13 +05:30
Karthik Kambatla
20f0eb871c YARN-4702. FairScheduler: Allow setting maxResources for ad hoc queues. (Daniel Templeton via kasha) 2016-08-17 17:40:20 -07:00
Arpit Agarwal
ca13e7971d HDFS-10773. BlockSender should not synchronize on the dataset object. (Contributed by Chen Liang) 2016-08-17 16:29:08 -07:00
Xiao Chen
2aa5e2c403 HDFS-10549. Correctly revoke file leases when closing files. Contributed by Yiqun Lin. 2016-08-17 15:52:38 -07:00
Anu Engineer
c57523163f HADOOP-11786. Fix Javadoc typos in org.apache.hadoop.fs.FileSystem. Contributed by Andras Bokor. 2016-08-17 15:00:14 -07:00
Chris Nauroth
822d661b8f HADOOP-13208. S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories. Contributed by Steve Loughran. 2016-08-17 14:54:54 -07:00
Kihwal Lee
869393643d HDFS-10745. Directly resolve paths into INodesInPath. Contributed by Daryn Sharp. 2016-08-17 15:53:03 -05:00
Varun Saxena
e3037c5641 YARN-5523. Yarn running container log fetching causes OutOfMemoryError (Xuan Gong via Varun Saxena) 2016-08-18 01:45:33 +05:30
Jason Lowe
f80a729832 MAPREDUCE-6690. Limit the number of resources a single map reduce job can submit for localization. Contributed by Chris Trezzo 2016-08-17 16:22:31 +00:00
Varun Vasudev
7f05ff7a4e YARN-5455. Update Javadocs for LinuxContainerExecutor. Contributed by Daniel Templeton. 2016-08-17 15:34:58 +05:30
Mingliang Liu
23532716fc HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-16 17:33:04 -07:00
Chris Nauroth
3808876c73 HADOOP-13324. s3a tests don't authenticate with S3 frankfurt (or other V4 auth only endpoints). Contributed by Steve Loughran. 2016-08-16 17:05:52 -07:00
Mingliang Liu
27a6e09c4e Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)" 
This reverts commit 9336a0495f.
 2016-08-16 16:25:37 -07:00
Andrew Wang
4b689e7a75 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 2016-08-16 15:01:18 -07:00
Ray Chiang
6c154abd33 MAPREDUCE-6751. Add debug log message when splitting is not possible due to unsplittable compression. (Peter Vary via rchiang) 2016-08-16 12:13:22 -07:00
Anu Engineer
b047bc7270 HDFS-10560. DiskBalancer: Reuse ObjectMapper instance to improve the performance. Contributed by Yiqun Lin. 2016-08-16 10:20:08 -07:00
Varun Saxena
b427ce12bc YARN-5475. Fix test failure of TestAggregatedLogFormat#testReadAcontainerLogs1 (Jun Gong via Varun Saxena) 2016-08-16 20:24:53 +05:30