Commit Graph

17824 Commits

Author SHA1 Message Date
Subru Krishnan
ad0fff2b41 YARN-7432. Fix DominantResourceFairnessPolicy serializable findbugs issues. (Daniel Templeton via Subru). 2017-11-02 17:39:23 -07:00
Arun Suresh
53c0fb7efe HADOOP-15013. Fix ResourceEstimator findbugs issues. (asuresh) 2017-11-02 17:15:33 -07:00
Eric Payne
e6ec02001f YARN-7370: Preemption properties should be refreshable. Contrubted by Gergely Novák. 2017-11-02 12:37:33 -05:00
Wangda Tan
04c604cf1d YARN-7364. Queue dash board in new YARN UI has incorrect values. (Sunil G via wangda)
Change-Id: Ia5336f407147d2985a61b5f9f1e69b5b35f398a4
(cherry picked from commit 752f000e0f521ca7be173d6ca338da4585284fd0)
2017-11-02 09:51:28 -07:00
Jason Lowe
d00b6f7c1f YARN-7286. Add support for docker to have no capabilities. Contributed by Eric Badger 2017-11-02 09:37:17 -05:00
Akira Ajisaka
cc3f3eca40
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi. 2017-11-02 18:32:24 +09:00
Sammi Chen
cde56b9cef HADOOP-14997. Add hadoop-aliyun as dependency of hadoop-cloud-storage. Contributed by Genmao Yu 2017-11-02 17:12:04 +08:00
Akira Ajisaka
178751ed8c
MAPREDUCE-6983. Moving logging APIs over to slf4j in hadoop-mapreduce-client-core. Contributed by Jinjiang Ling. 2017-11-02 17:43:08 +09:00
Rohith Sharma K S
940ffe3f9c addendum patch for YARN-7289. 2017-11-02 13:55:19 +05:30
Jian He
0cc98ae0ec YARN-7396. NPE when accessing container logs due to null dirsHandler. Contributed by Jonathan Hung 2017-11-01 17:00:32 -07:00
Eric Yang
7a49ddfdde YARN-7412. Fix unit test for docker mount check on ubuntu. (Contributed by Eric Badger) 2017-11-01 18:39:56 -04:00
Junping Du
d57dba9942 YARN-7400. Incorrect log preview displayed in jobhistory server ui. Contributed by Xuan Gong. 2017-11-01 14:48:16 -07:00
Inigo Goiri
70f1a9470c YARN-7276 addendum to add timeline service depencies. Contributed by Inigo Goiri. 2017-11-01 13:26:37 -07:00
Weiwei Yang
56b88b0670 HDFS-12744. More logs when short-circuit read is failed and disabled. Contributed by Weiwei Yang. 2017-11-01 16:41:45 +08:00
Yiqun Lin
20304b91cc HDFS-12219. Javadoc for FSNamesystem#getMaxObjects is incorrect. Contributed by Erik Krogen. 2017-11-01 14:37:08 +08:00
John Zhuge
b8c8b5bc27 HDFS-12714. Hadoop 3 missing fix for HDFS-5169. Contributed by Joe McDonnell. 2017-10-31 22:44:16 -07:00
Lei Xu
9367c25dbd HDFS-12482. Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery. (lei) 2017-10-31 21:58:14 -07:00
Subru Krishnan
ed24da3dd7 YARN-6413. FileSystem based Yarn Registry implementation. (Ellen Hui via Subru). 2017-10-31 12:05:43 -07:00
Andrew Wang
5f681fa821 Revert "HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham."
This reverts commit b922ba7393.
2017-10-31 10:46:10 -07:00
Arpit Agarwal
b922ba7393 HDFS-12499. dfs.namenode.shared.edits.dir property is currently namenode specific key. Contributed by Bharat Viswanadham. 2017-10-31 10:23:00 -07:00
Inigo Goiri
982bd2a5bf HDFS-12699. TestMountTable fails with Java 7. Contributed by Inigo Goiri. 2017-10-31 10:21:42 -07:00
Chris Douglas
d015e0bbd5 HDFS-7878. API - expose a unique file identifier. 2017-10-31 09:44:01 -07:00
Sean Mackrory
81225430d0 HDFS-206. Support for head in FSShell. Contributed by Gabor Bota. 2017-10-31 08:34:01 -06:00
Jason Lowe
2fae63aa60 HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 2017-10-31 09:30:13 -05:00
Akira Ajisaka
c02d2ba50d
YARN-7379. Moving logging APIs over to slf4j in hadoop-yarn-client. Contributed by Yeliang Cang. 2017-10-31 17:09:45 +09:00
Akira Ajisaka
785f1b0d11
YARN-7407. Moving logging APIs over to slf4j in hadoop-yarn-applications. Contributed by Yeliang Cang. 2017-10-31 16:36:02 +09:00
Akira Ajisaka
fad22d8ab4
HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. Contributed by ligongyi. 2017-10-31 13:51:26 +09:00
Akira Ajisaka
60503f9d4f
Revert "HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. Contributed by liyunzhang."
This reverts commit b59e92551d.
2017-10-31 13:50:28 +09:00
Akira Ajisaka
b59e92551d
HADOOP-14980. [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1. Contributed by liyunzhang. 2017-10-31 13:49:15 +09:00
Junping Du
a8083aaa6f HADOOP-14990. Clean up jdiff xml files added for 2.8.2 release. 2017-10-30 15:16:51 -07:00
Daniel Templeton
d64736d589 YARN-7336. Unsafe cast from long to int Resource.hashCode() method
(Contributed by Miklos Szegedi via Daniel Templeton)
2017-10-30 12:41:28 -07:00
Daniel Templeton
9a7e810838 YARN-6927. Add support for individual resource types requests in MapReduce
(Contributed by Gergo Repas via Daniel Templeton)
2017-10-30 11:04:22 -07:00
Chris Douglas
e4878a59b3 HADOOP-14992. Upgrade Avro patch version. Contributed by Bharat Viswanadham 2017-10-30 09:49:22 -07:00
Daniel Templeton
9711b78998 YARN-7374. Improve performance of DRF comparisons for resource types in fair scheduler 2017-10-29 18:54:33 -07:00
Yufei Gu
d4811c8cfa YARN-6747. TestFSAppStarvation.testPreemptionEnable fails intermittently. (Contributed by Miklos Szegedi) 2017-10-29 16:44:16 -07:00
Sunil G
9114d7a5a0 YARN-7224. Support GPU isolation for docker container. Contributed by Wangda Tan. 2017-10-29 11:08:44 +05:30
Daniel Templeton
e62bbbca7a YARN-7397. Reduce lock contention in FairScheduler#getAppWeight() 2017-10-28 09:13:13 -07:00
Arun Suresh
9c5c68745e YARN-7299. Fix TestDistributedScheduler. (asuresh) 2017-10-27 23:08:18 -07:00
Arun Suresh
24f8c5cce3 YARN-7178. Add documentation for Container Update API. (asuresh) 2017-10-27 22:56:41 -07:00
Chris Douglas
139cc752d2 HADOOP-14991. Add missing figures to Resource Estimator tool. Contributed by Rui Li 2017-10-27 21:59:27 -07:00
Chris Douglas
b50def3697 HADOOP-14986. Enforce JDK limitations. 2017-10-27 18:47:45 -07:00
Inigo Goiri
8be5707067 YARN-7276. Federation Router Web Service fixes. Contributed by Inigo Goiri. 2017-10-27 16:46:05 -07:00
Chris Douglas
d55a84951a HDFS-12582. Replace HdfsFileStatus constructor with a builder pattern. Contributed by Bharat Viswanadham 2017-10-27 15:36:03 -07:00
Jason Lowe
665bb147aa YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla 2017-10-27 16:56:05 -05:00
Yufei Gu
99880d0a16 YARN-6505. Define the strings used in SLS JSON input file format. (Contributed by Gergely Novak) 2017-10-27 14:41:37 -07:00
Rohith Sharma K S
5c799ecf09 YARN-7289. Application lifetime does not work with FairScheduler. Contributed by Miklos Szegedi. 2017-10-27 22:46:38 +05:30
Sunil G
792388e1c0 YARN-7375. Possible NPE in RMWebapp when HA is enabled and the active RM fails. Contributed by Chandni Singh. 2017-10-27 20:53:57 +05:30
Arpit Agarwal
cd2a1dd063 HDFS-9914. Fix configurable WebhDFS connect/read timeout. Contributed by Xiaoyu Yao. 2017-10-27 07:43:54 -07:00
Steve Loughran
de09716fb8 MAPREDUCE-6977 Move logging APIs over to slf4j in hadoop-mapreduce-client-common.
Contributed by Jinjiang Ling.
2017-10-27 10:45:03 +01:00
Wangda Tan
36e158ae98 YARN-7307. Allow client/AM update supported resource types via YARN APIs. (Sunil G via wangda)
Change-Id: I14c5ea7252b7c17e86ab38f692b5f9d43196dbe0
2017-10-26 20:15:19 -07:00