Commit Graph

18544 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze
346caa2095 HDFS-13227. Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList. Contributed by Shashikant Banerjee 2018-03-06 13:35:03 -08:00
Tsz-Wo Nicholas Sze
871d0d39fa HDFS-13223. Reduce DiffListBySkipList memory usage. Contributed by Shashikant Banerjee 2018-03-06 12:23:03 -08:00
Xiao Chen
9276ef0665 HDFS-13170. Port webhdfs unmaskedpermission parameter to HTTPFS. Contributed by Stephen O'Donnell. 2018-03-06 09:57:35 -08:00
Inigo Goiri
7060725662 HDFS-13188. Disk Balancer: Support multiple block pools during block move. Contributed by Bharat Viswanadham. 2018-03-06 09:09:32 -08:00
Takanobu Asanuma
e6f99e205b
HADOOP-15291. TestMiniKdc fails on Java 9
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-06 06:01:33 -08:00
Steve Loughran
12ecb55ffe HADOOP-15289. FileStatus.readFields() assertion incorrect.
Contributed by Steve Loughran.
2018-03-06 10:05:12 +00:00
Rohith Sharma K S
55ba49dd07 YARN-7346. Add a profile to allow optional compilation for ATSv2 with HBase-2.0. Contributed by Haibo Chen and Rohith. 2018-03-06 11:55:21 +05:30
Takanobu Asanuma
745190ecdc
HADOOP-15287. JDK9 JavaDoc build fails due to one-character underscore identifiers in hadoop-yarn-common
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-05 18:15:53 -08:00
Takanobu Asanuma
4971276631
HADOOP-15271. Remove unicode multibyte characters from JavaDoc
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-05 15:07:58 -08:00
Sen Zhao
245751ffdc
YARN-7736. Fix itemization in YARN federation document
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-05 11:54:24 -08:00
Arun Suresh
1054b48c27 YARN-7972. Support inter-app placement constraints for allocation tags by application ID. (Weiwei Yang via asuresh) 2018-03-05 11:24:17 -08:00
Steve Loughran
2e1e049bd0 HADOOP-15288. TestSwiftFileSystemBlockLocation doesn't compile.
Contributed by Steve Loughran.
2018-03-05 18:12:38 +00:00
Billie Rinaldi
628be58a4c YARN-7915. Trusted image log message repeated multiple times. Contributed by Shane Kumpf 2018-03-05 09:08:44 -08:00
Steve Loughran
8110d6a0d5 HADOOP-13761. S3Guard: implement retries for DDB failures and throttling; translate exceptions.
Contributed by Aaron Fabbri.
2018-03-05 14:06:20 +00:00
Weiwei Yang
e8c5be63f0 YARN-7995. Remove unnecessary boxings and unboxings from PlacementConstraintParser.java. Contributed by Sen Zhao. 2018-03-05 11:49:43 +08:00
Robert Kanter
21176a8ba7
HADOOP-15282. HADOOP-15235 broke TestHttpFSServerWebServer
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-04 07:33:47 -08:00
Ajay Kumar
3dc30bc24e
HADOOP-15286. Remove unused imports from TestKMSWithZK.java
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-04 07:12:52 -08:00
Arpit Agarwal
a3c304c5dd HDFS-13178. Disk Balancer: Add a force option to DiskBalancer Execute command. Contributed by Bharat Viswanadham. 2018-03-03 15:42:16 -08:00
Tsz-Wo Nicholas Sze
ba82e5c488 HDFS-13173. Replace ArrayList with DirectoryDiffList(SnapshotSkipList) to store DirectoryDiffs. Contributed by Shashikant Banerjee 2018-03-02 17:47:48 -08:00
Andras Bokor
90d2bdcb75
HADOOP-15252. Checkstyle version is not compatible with IDEA's checkstyle plugin
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-02 17:08:55 -08:00
Xiao Chen
c75105f07b HDFS-13040. Kerberized inotify client fails despite kinit properly. Contributed by Istvan Fajth, Wei-Chiu Chuang, Xiao Chen. 2018-03-02 16:46:04 -08:00
Gergely Novák
e99a1e7767
MAPREDUCE-7023. TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-02 16:15:04 -08:00
Akira Ajisaka
432cd74c72
HADOOP-15261. Upgrade commons-io from 2.4 to 2.5. Contributed by PandaMonkey. 2018-03-02 15:47:43 -08:00
Tsz-Wo Nicholas Sze
60080fbfcf HDFS-13171. Handle Deletion of nodes in SnasphotSkipList. Contributed by Shashikant Banerjee 2018-03-02 10:51:05 -08:00
Tsz-Wo Nicholas Sze
850b2f2567 HDFS-1686. Federation: Add more Balancer tests with federation setting. Contributed by Bharat Viswanadham 2018-03-02 10:42:39 -08:00
Jason Lowe
83798f15f8 YARN-7511. NPE in ContainerLocalizer when localization failed for running container. Contributed by Tao Yang 2018-03-02 09:59:46 -06:00
Yiqun Lin
55669515f6 HDFS-13210. Fix the typo in MiniDFSCluster class. Contributed by fang zhenyi. 2018-03-02 11:49:12 +08:00
Ray Chiang
923e1773e1 HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang) 2018-03-01 15:36:10 -08:00
Allen Wittenauer
d4cc50f622 HADOOP-15279. increase maven heap size recommendations
Signed-off-by: Jason Lowe <jlowe@apache.org>
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2018-03-01 15:32:43 -08:00
fang zhenyi
29233c3c4a
HADOOP-15274. Move hadoop-openstack to slf4j
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-01 15:08:30 -08:00
Tsz-Wo Nicholas Sze
96e8f260ab HDFS-13211. Fix a bug in DirectoryDiffList.getMinListForRange. Contributed by Shashikant Banerjee 2018-03-01 14:12:15 -08:00
Sunil G
22928c0c60 YARN-7637. GPU volume creation command fails when work preserving is disabled at NM. Contributed by Zian Chen. 2018-03-01 22:39:32 +05:30
Yufei Gu
6ca4e3017b YARN-5028. RMStateStore should trim down app state for completed applications(addendum). Contributed by Rohith Sharma K S. 2018-03-01 08:38:53 -08:00
Billie Rinaldi
5ed689e33a YARN-7958. ServiceMaster should only wait for recovery of containers with id that match the current application id. Contributed by Chandni Singh 2018-03-01 08:00:13 -08:00
Nanda kumar
55d04a6db1
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-01 19:03:47 +09:00
Yiqun Lin
ececeea8f2 HDFS-13202. Fix the outdated javadocs in HAUtil. Contributed by Chao Sun. 2018-03-01 17:51:43 +08:00
Haibo Chen
10663b78c8 Revert "yarn-7346.07.patch"
This reverts commit 5e37ca5bb4.
2018-02-28 21:11:36 -08:00
Haibo Chen
d1274c3b71 YARN-7835. Race condition in NM while publishing events if second attempt is launched on the same node. (Rohith Sharma K S via Haibo Chen) 2018-02-28 21:10:42 -08:00
Haibo Chen
5e37ca5bb4 yarn-7346.07.patch 2018-02-28 21:04:54 -08:00
Weiwei Yang
6e6945cd78 MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang. 2018-03-01 10:18:53 +08:00
Eric Yang
17f387e3c2 YARN-7985. Removed duplicate service name validation in Yarn Service.
Contributed by Chandni Singh
2018-02-28 20:48:55 -05:00
Billie Rinaldi
315f48e791 YARN-7955. Improve result of calling stop on an already stopped service. Contributed by Gour Saha 2018-02-28 15:01:56 -08:00
Tsz-Wo Nicholas Sze
81d9446a92 HDFS-13102. Implement SnapshotSkipList class to store Multi level DirectoryDiffs. Contributed by Shashikant Banerjee 2018-02-28 13:42:58 -08:00
Billie Rinaldi
31009034bd YARN-7954. Set component status to STOPPED when YARN service is stopped. Contributed by Gour Saha 2018-02-28 11:57:24 -08:00
Xiaoyu Yao
f20e10b2dd HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar. 2018-02-28 09:44:39 -08:00
Xiaoyu Yao
2574375bf5 HDFS-13114. CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path. Contributed by Hanisha Koneru. 2018-02-28 08:37:01 -08:00
Steve Loughran
edc9f1451b HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake.
Contributed by Steve Loughran
2018-02-28 14:42:25 +00:00
Steve Loughran
e015e00989 HADOOP-15264. AWS "shaded" SDK 1.271 is pulling in netty 4.1.17.
Contributed by Steve Loughran.

(cherry picked from commit b580196a16dcafe26d6069267a5e2242917aad84)
2018-02-28 13:11:07 +00:00
Weiwei Yang
7af4f34de5 YARN-7929. Support to set container execution type in SLS. (Jiandan Yang via Weiwei Yang) 2018-02-28 17:58:09 +08:00
Yiqun Lin
a9c14b1119 HDFS-13194. CachePool permissions incorrectly checked. Contributed by Jianfei Jiang. 2018-02-28 10:17:43 +08:00