big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
16,818 Commits 2 Branches 2 Tags 264 MiB
a92ef030a2
Commit Graph

16818 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Steve Loughran
2d2d97fa7d
HADOOP-14553. Add (parallelized) integration tests to hadoop-azure 
Contributed by Steve Loughran
 2017-09-15 17:03:01 +01:00
Steve Loughran
11390c2d11
MAPREDUCE-6956 FileOutputCommitter to gain abstract superclass PathOutputCommitter. 
Contributed by Steve Loughran
 2017-09-15 16:59:04 +01:00
Kihwal Lee
78bdf10ae4 HDFS-12424. Datatable sorting on the Datanode Information page in the Namenode UI is broken. Contributed by Shawna Martell. 2017-09-15 09:28:31 -05:00
Kai Zheng
08b98149e1 HADOOP-14869. Upgrade Apache Kerby version to v1.0.1. Contributed by Wei Zhou 2017-09-15 19:49:58 +08:00
Arpit Agarwal
50764ef3e4 HDFS-12456. TestNamenodeMetrics.testSyncAndBlockReportMetric fails. Contributed by Bharat Viswanadham. 2017-09-14 22:23:36 -07:00
Kai Zheng
08d996d3e9 HDFS-12395. Support erasure coding policy operations in namenode edit log. Contributed by Sammi Chen 2017-09-15 09:43:39 +08:00
Kai Zheng
ae8f55b932 HDFS-7859. Erasure Coding: Persist erasure coding policies in NameNode. Contributed by Sammi Chen 2017-09-15 09:08:18 +08:00
Lei Xu
61cee3a0b9 HDFS-12378. TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk. (Lei (Eddy) Xu) 2017-09-14 17:03:25 -07:00
Andrew Wang
390c2b5df0 Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang." 
This reverts commit 7fcc73fc0d.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
 2017-09-14 15:12:26 -07:00
Andrew Wang
2f867115a8 Revert "HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS. Contributed by Weiwei Yang" 
This reverts commit 931a49800e.

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/client/HttpFSFileSystem.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/main/java/org/apache/hadoop/fs/http/server/FSOperations.java
	hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
 2017-09-14 15:02:27 -07:00
Aaron Fabbri
49467165a5
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran. 2017-09-14 14:10:48 -07:00
John Zhuge
7ee02d1065 HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham. 2017-09-14 11:26:49 -07:00
Yufei Gu
09b476e6da YARN-6612. Update fair scheduler policies to be aware of resource types. (Contributed by Daniel Templeton via Yufei Gu) 2017-09-14 11:23:37 -07:00
Arpit Agarwal
65a941008d Revert "HDFS-10391. Always enable NameNode service RPC port. Contributed by Gergely Novak." 
This reverts commit aa4b6fbe75.
 2017-09-14 11:17:08 -07:00
Arun Suresh
66ca0a6540 YARN-6059. Update paused container state in the NM state store. (Hitesh Sharma via asuresh) 2017-09-14 08:51:26 -07:00
Arun Suresh
4f8194430f YARN-5216. Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM. (Hitesh Sharma via asuresh) 2017-09-14 08:51:26 -07:00
Arun Suresh
864fbacd45 YARN-5292. NM Container lifecycle and state transitions to support for PAUSED container state. (Hitesh Sharma via asuresh) 2017-09-14 08:48:39 -07:00
Steve Loughran
b9465bb876
Revert "HADOOP-14654. Update httpclient version to 4.5.3. (rchiang)" 
This reverts commit 1118ca9b07.
 2017-09-14 13:31:30 +01:00
Kai Zheng
e12f3e85bd HDFS-12438. Rename dfs.datanode.ec.reconstruction.stripedblock.threads.size to dfs.datanode.ec.reconstruction.threads. Contributed by Andrew Wang 2017-09-14 15:39:10 +08:00
Junping Du
c92c1d521e YARN-7194. Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat. Contributed by Xuan Gong. 2017-09-13 22:16:06 -07:00
ChenSammi
e0b3c644e1 HDFS-12414. Ensure to use CLI command to enable/disable erasure coding policy. Contributed by Sammi Chen 2017-09-14 09:15:29 +08:00
Lei Xu
73aed34dff HDFS-12409. Add metrics of execution time of different stages in EC recovery task. (Lei (Eddy) Xu) 2017-09-13 17:14:13 -07:00
Andrew Wang
c3f35c422b HADOOP-14089. Automated checking for malformed client. Contributed by Sean Busbey. 2017-09-13 16:57:50 -07:00
Robert Kanter
bb34ae9554 YARN-7146. Many RM unit tests failing with FairScheduler (rkanter) 2017-09-13 15:44:54 -07:00
Jason Lowe
4d98936eec MAPREDUCE-6957. shuffle hangs after a node manager connection timeout. Contributed by Jooseong Kim 2017-09-13 17:21:13 -05:00
Arpit Agarwal
f153e60576 HADOOP-14867. Update HDFS Federation setup document, for incorrect property name for secondary name node http address. Contributed by Bharat Viswanadham. 2017-09-13 12:54:02 -07:00
Eric Payne
3860be7961 YARN-4727. Unable to override the $HADOOP_CONF_DIR env variable for container. Contributed by Jason Lowe. 2017-09-13 14:41:55 -05:00
Eric Payne
a3c44195be Revert 'YARN-4727. Unable to override the $HADOOP_CONF_DIR env variable for container. Contributed by Jason Lowe.' 
This reverts commit 729d05f529.
 2017-09-13 14:38:58 -05:00
Eric Payne
729d05f529 YARN-4727. Unable to override the /home/ericp/run/conf/ env variable for container. Contributed by Jason Lowe. 2017-09-13 14:29:08 -05:00
Rohith Sharma K S
5324388cf2 YARN-7157. Add admin configuration to filter per-user's apps in secure cluster. Contributed by Sunil G. 2017-09-13 23:36:47 +05:30
Andrew Wang
8277fab2be HADOOP-14857. Fix downstream shaded client integration test. Contributed by Sean Busbey. 2017-09-13 10:59:04 -07:00
Chen Liang
10b2cfa96c HADOOP-14804. correct wrong parameters format order in core-default.xml. Contributed by Chen Hongfei. 2017-09-13 10:49:34 -07:00
Xiao Chen
fa6cc43edd Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah." 
This reverts commit 0a6d5c0cf1.
 2017-09-12 19:53:07 -07:00
Lei Xu
123342cd07 HDFS-12412. Change ErasureCodingWorker.stripedReadPool to cached thread pool. (Lei (Eddy) Xu) 2017-09-12 18:12:07 -07:00
Andrew Wang
f4b6267465 HDFS-12222. Document and test BlockLocation for erasure-coded files. Contributed by Huafeng Wang. 2017-09-12 17:35:30 -07:00
Arun Suresh
a1c398e0dc YARN-7185. [Addendum patch] Minor javadoc and checkstyle fix. 2017-09-12 17:03:32 -07:00
Arpit Agarwal
68282c8eac HDFS-12407. Journal node fails to shutdown cleanly if JournalNodeHttpServer or JournalNodeRpcServer fails to start. Contributed by Ajay Kumar. 2017-09-12 16:18:41 -07:00
Yufei Gu
82c5dd1d50 YARN-7057. FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption. (Contributed by Karthik via Yufei Gu) 2017-09-12 16:13:39 -07:00
Arun Suresh
2ae72692fc YARN-7185. ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled. (Wangda Tan via asuresh) 2017-09-12 16:10:08 -07:00
Jason Lowe
86f4d1c66c HADOOP-14843. Improve FsPermission symbolic parsing unit test coverage. Contributed by Bharat Viswanadham 2017-09-12 16:51:08 -05:00
Ray Chiang
2ffe93ab60 HADOOP-14856. Fix AWS, Jetty, HBase, Ehcache entries for NOTICE.txt. (rchiang) 2017-09-12 13:37:38 -07:00
Ray Chiang
f1d751bd05 HADOOP-14797. Update re2j version to 1.1. (rchiang) 2017-09-12 11:35:21 -07:00
Andrew Wang
80ee89b287 HDFS-12417. Disable flaky TestDFSStripedOutputStreamWithFailure. 2017-09-12 11:20:56 -07:00
Ray Chiang
a6432ba5a1 HADOOP-14653. Update joda-time version to 2.9.9. (rchiang) 2017-09-12 11:12:44 -07:00
Ray Chiang
39818259c3 HADOOP-14648. Bump commons-configuration2 to 2.1.1. (rchiang) 2017-09-12 10:53:48 -07:00
Ray Chiang
af45cd1be6 HADOOP-14796. Update json-simple version to 1.1.1. (rchiang) 2017-09-12 10:36:04 -07:00
Ray Chiang
556812c179 HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang) 2017-09-12 10:19:34 -07:00
Ray Chiang
ad74691807 HADOOP-14798. Update sshd-core and related mina-core library versions. (rchiang) 2017-09-12 10:04:22 -07:00
Sunil G
da0b6a354b YARN-7137. [YARN-3926] Move newly added APIs to unstable in YARN-3926 branch. Contributed by Wangda Tan. 2017-09-12 09:19:12 -07:00
Daniel Templeton
bf2b687412 YARN-7136. Additional Performance Improvement for Resource Profile Feature 
(Contributed by Wangda Tan via Daniel Templeton)
 2017-09-12 09:19:12 -07:00