big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,673 Commits 2 Branches 2 Tags 264 MiB
b2cdf809bc
Commit Graph

21673 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wangda Tan
579ef4be06 YARN-8882. [YARN-8851] Add a shared device mapping manager (scheduler) for device plugins. (Zhankun Tang via wangda) 
Change-Id: I9435136642c3d556971a357bf687f69df90bb45e
 2018-11-28 14:09:52 -08:00
Wangda Tan
9de8e8d049 YARN-9030. Log aggregation changes to handle filesystems which do not support setting permissions. (Suma Shivaprasad via wangda) 
Change-Id: I80f1e8196b8624e24d74494719fdedfd7061dced
 2018-11-28 13:36:21 -08:00
Jason Lowe
4d8de7ab69 MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla 2018-11-28 14:54:59 -06:00
Giovanni Matteo Fumarola
300f560fcc HDFS-14102. Performance improvement in BlockPlacementPolicyDefault. Contributed by Beluga Behr. 2018-11-28 11:33:22 -08:00
Giovanni Matteo Fumarola
4ca3a6b21a HDFS-14108. Performance improvement in BlockManager Data Structures. Contributed by Beluga Behr. 2018-11-28 11:25:47 -08:00
Hanisha Koneru
64a4b6b08b HDDS-284. Checksum for ChunksData. 2018-11-28 10:53:12 -08:00
Sean Mackrory
085f10e75d HADOOP-15947. Fix ITestDynamoDBMetadataStore test error issues. Contributed by Gabor Bota. 2018-11-28 10:45:09 -07:00
Sean Mackrory
e148c3ff09 HADOOP-15798. LocalMetadataStore put() does not retain isDeleted in parent listing. Contributed by Gabor Bota. 2018-11-28 10:45:09 -07:00
Sean Mackrory
5d96b74f33 HADOOP-15370. S3A log message on rm s3a://bucket/ not intuitive. Contributed by Gabor Bota. 2018-11-28 10:45:09 -07:00
Jason Lowe
3ce99e32f7 YARN-8812. Containers fail during creating a symlink which started with hyphen for a resource file. Contributed by Oleksandr Shevchenko 2018-11-28 08:46:11 -06:00
Akira Ajisaka
13a21f6607
MAPREDUCE-6190. If a task stucks before its first heartbeat, it never timeouts and the MR job becomes stuck. Contributed by Zhaohui Xin. 2018-11-28 17:57:42 +09:00
Suma Shivaprasad
b3a052d199 YARN-9044. LogsCLI should contact ATSv2 for -am option. Contributed by Rohith Sharma K S 2018-11-28 00:46:53 -08:00
Suma Shivaprasad
7dc272199f YARN-9034. ApplicationCLI should have option to take clusterId. Contributed by Rohith Sharma K S. 2018-11-28 00:42:14 -08:00
Anu Engineer
34a914be03 HDDS-846. Exports ozone metrics to prometheus. 
Contributed by Elek, Marton.
 2018-11-27 15:57:24 -08:00
Eric Yang
f657a2a661 YARN-9056. Improved YARN service upgrade state logic for readiness check. 
Contributed by Chandni Singh
 2018-11-27 18:36:59 -05:00
Steve Loughran
4c106fca0c
HADOOP-15932. Oozie unable to create sharelib in s3a filesystem. 
Contributed by Steve Loughran.
 2018-11-27 20:39:54 +00:00
Da Zhou
300f772c36
HADOOP-15940. ABFS: For HNS account, avoid unnecessary get call when doing Rename. 
Contributed by Da Zhou <da.zhou@microsoft.com>

(cherry picked from commit 1a3a4960d91aa594283e447963fb2e407d4c6af5)
 2018-11-27 18:13:07 +00:00
Márton Elek
96c104d365 HDDS-766. Ozone shell create volume fails if volume name does not have a leading slash. Contributed by chencan. 2018-11-27 12:32:54 +01:00
Akira Ajisaka
1aad99a718
MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin. 2018-11-27 20:01:11 +09:00
Sunil G
2730ead6b1 YARN-9058. [CSI] YARN service fail to launch due to CSI changes. Contributed by Weiwei Yang. 2018-11-27 14:33:38 +05:30
Nanda kumar
099e723406 HDDS-868. Handle quasi closed container replicas in SCM. 
Contributed by Nanda kumar.
 2018-11-27 13:01:22 +05:30
Eric Yang
33e0df4b35 YARN-8986. Added port publish for Docker container running with bridge network. 
Contributed by Charo Zhang
 2018-11-26 19:45:05 -05:00
Giovanni Matteo Fumarola
0d8406135f YARN-9054. Fix FederationStateStoreFacade#buildGetSubClustersCacheRequest. Contributed by Bibin A Chundatt. 2018-11-26 10:57:38 -08:00
Eric Yang
a9d96948ed HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter. 
Contributed by He Xiaoqiao
 2018-11-26 13:49:19 -05:00
Vinayakumar B
b098281454 HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B. 2018-11-26 18:22:32 +05:30
Vinayakumar B
23b441c225 HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena. 2018-11-26 18:11:01 +05:30
Da Zhou
a8302e398c
HADOOP-15872. ABFS: Update to target 2018-11-09 REST version for ADLS Gen 2. 
Contributed by Junhua Gu and Da Zhou.
 2018-11-23 14:17:36 +00:00
Márton Elek
753f421350 HDDS-820. Use more strict data format for the Last-Modified headers of s3 gateway. Contributed by Elek, Marton. 2018-11-23 10:05:12 +01:00
Márton Elek
6934a65402 HADOOP-15358. SFTPConnectionPool connections leakage. Contributed by Mikhail Pryakhin. 2018-11-23 09:48:26 +01:00
Weiwei Yang
5ff0cf86a9 HADOOP-15943. AliyunOSS: add missing owner & group attributes for oss FileStatus. Contributed by wujinhu. 2018-11-23 13:56:54 +08:00
Rohith Sharma K S
e223a790a7 YARN-9042. Fix javadoc error in deviceplugin package. Contributed by Zhankun Tang. 2018-11-22 20:04:30 +05:30
Shashikant Banerjee
95d526a270 HDDS-869. Fix log message in XceiverClientRatis#sendCommandAsync. Contributed by Lokesh Jain. 2018-11-22 18:39:14 +05:30
Márton Elek
ff2484906c HDDS-841. [JDK11] Fix Javadoc errors in hadoop-hdds-container-service module. Contributed by Dinesh Chitlangia. 2018-11-22 12:04:29 +01:00
Shashikant Banerjee
ee44b069c6 HDDS-866. Handle RaftRetryFailureException in OzoneClient. Contributed by Shashikant Banerjee. 2018-11-22 15:02:07 +05:30
Weiwei Yang
176bb3f812 YARN-8984. AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty. Contributed by Yang Wang. 2018-11-22 16:52:29 +08:00
Mukul Kumar Singh
f207e30142 HDDS-814. dfs.ratis.leader.election.minimum.timeout.duration should not be read by client. Contributed by chencan. 2018-11-22 10:46:10 +05:30
Sunil G
5fe1dbf195 YARN-8964. [UI2] YARN ui2 should use clusters/{cluster name} for all ATSv2 REST APIs. Contributed by Akhil PB. 2018-11-22 10:25:22 +05:30
Ajay Kumar
8d2789c5eb HDDS-795. RocksDb specific classes leak from DBStore/Table interfaces. Contributed by Márton Elek. 2018-11-21 12:25:41 -08:00
Xiaoyu Yao
919a6e4310 HDDS-861. SCMNodeManager unit tests are broken. Contributed by Xiaoyu Yao. 2018-11-21 11:46:53 -08:00
Nanda kumar
ebb9245366 HDDS-853. Option to force close a container in Datanode. 
Contributed by Nanda kumar.
 2018-11-22 00:50:27 +05:30
Brahma Reddy Battula
892b33e054 HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena. 2018-11-22 00:13:56 +05:30
Bharat Viswanadham
c4d0ef6946 HDDS-816. Create OM metrics for bucket, volume, keys. Contributed by Bharat Viswanadham. 2018-11-21 10:35:39 -08:00
Shashikant Banerjee
f42b2dfdf1 HDDS-865. GrpcXceiverService is added twice to GRPC netty server. Contributed by Xiaoyu Yao. 2018-11-21 23:43:01 +05:30
Márton Elek
34b6fa7d6b HDDS-732. Add read method which takes offset and length in SignedChunkInputStream. Contributed by chencan. 2018-11-21 17:59:36 +01:00
Márton Elek
22867deffa HDDS-791. Support Range header for ozone s3 object download. Contributed by Bharat Viswanadham. 2018-11-21 17:04:53 +01:00
Rohith Sharma K S
f63e4e4f2e YARN-8936. Bump up Atsv2 hbase versions. Contributed by Vrushali C. 2018-11-21 15:02:22 +05:30
Shashikant Banerjee
c8b3dfa625 HDDS-860. Fix TestDataValidate unit tests. Contributed by Shashikant Banerjee. 2018-11-21 11:28:20 +05:30
Shashikant Banerjee
14e1a0a3d6 HDDS-835. Use storageSize instead of Long for buffer size configs in Ozone Client. Contributed by Shashikant Banerjee. 2018-11-21 10:51:50 +05:30
Xiaoyu Yao
f994b526a0 HDDS-855. Move OMMetadataManager from hadoop-ozone/ozone-manager to hadoop-ozone/common. Contributed by Ajay Kumar. 2018-11-20 20:31:07 -08:00
Haibo Chen
a41b648e98 YARN-8992. Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue. (Contributed by Wilfred Spiegelenburg) 2018-11-20 14:12:37 -08:00