big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,810 Commits 2 Branches 2 Tags 264 MiB
ea724181d6
Commit Graph

20810 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mukul Kumar Singh
b5d7b292c9 HDDS-718. Introduce new SCM Commands to list and close Pipelines. Contributed by Lokesh Jain. 2018-11-19 22:59:30 +05:30
Nanda kumar
e7438a1b38 HDDS-849. Fix NPE in TestKeyValueHandler because of audit log write. 
Contributed by Dinesh Chitlangia.
 2018-11-19 22:47:43 +05:30
Wangda Tan
8b23814415 YARN-8960. [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment. (Zac Zhou via wangda) 
Change-Id: I21b1addc9c32817650ea744a8f2e6b5602f2f4d4
 2018-11-19 08:55:30 -08:00
Wangda Tan
6357803645 YARN-8881. [YARN-8851] Add basic pluggable device plugin framework. (Zhankun Tang via wangda) 
Change-Id: If9a2f68cd4713b4ec932cdeda68106f17437c3d3
 2018-11-19 08:54:31 -08:00
Nanda kumar
93666087bc HDDS-847. TestBlockDeletion is failing. 
Contributed by Lokesh Jain.
 2018-11-19 17:04:18 +05:30
Nanda kumar
5a7ca6ac3e HDDS-837. Persist originNodeId as part of .container file in datanode. 
Contributed by Nanda kumar.
 2018-11-19 14:39:55 +05:30
Shashikant Banerjee
10cf5773ba HDDS-845. Create a new raftClient instance for every watch request for Ratis. Contributed by Shashikant Banerjee. 2018-11-19 14:38:51 +05:30
Mukul Kumar Singh
cfb915f3df HDDS-844. Add logic for pipeline teardown after timeout. Contributed by Lokesh Jain. 2018-11-19 12:11:05 +05:30
Weiwei Yang
be0708c6eb HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed by wujinhu. 2018-11-19 14:00:54 +08:00
Weiwei Yang
d027a24f03 YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun. 2018-11-18 23:18:26 +08:00
Daniel Templeton
e56d9f2618 HDFS-14015. Improve error handling in hdfsThreadDestructor in native thread local storage 
Change-Id: Ida1e888c9231b9e46081338e3a206d8f6faabd36
 2018-11-16 16:24:40 -08:00
Xiaoyu Yao
29374999b6 HDDS-120. Adding HDDS datanode Audit Log. Contributed by Dinesh Chitlangia. 2018-11-16 14:59:59 -08:00
Giovanni Matteo Fumarola
abd6d48c46 YARN-8860. Federation client intercepter class contains unwanted character. Contributed by Abhishek Modi. 2018-11-16 10:23:06 -08:00
Giovanni Matteo Fumarola
3420ddd0f8 HDDS-840. [JDK11] Fix Javadoc errors in hadoop-hdds-client module. Contributed by Dinesh Chitlangia. 2018-11-16 10:13:41 -08:00
Nanda kumar
c4d9640028 HDDS-801. Quasi close the container when close is not executed via Ratis. 
Contributed by Nanda kumar.
 2018-11-16 23:11:33 +05:30
Weiwei Yang
ad5256e44d HDFS-14063. Support noredirect param for CREATE/APPEND/OPEN/GETFILECHECKSUM in HttpFS. Contributed by Íñigo Goiri. 2018-11-17 01:12:22 +08:00
Vinayakumar B
68d5dfdc78 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena. 2018-11-16 18:05:10 +05:30
Rohith Sharma K S
ee3355be3c YARN-8303. YarnClient should contact TimelineReader for application/attempt/container report. 2018-11-16 17:58:19 +05:30
Vinayakumar B
8571507efa HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena. 2018-11-16 17:26:36 +05:30
Akira Ajisaka
af5958f7b6
HADOOP-15925. The config and log of gpg-agent are removed in create-release script. Contributed by Dinesh Chitlangia. 2018-11-16 13:16:59 +09:00
Anu Engineer
a16aa2f60b HDDS-825. Code cleanup based on messages from ErrorProne. 
Contributed by Anu Engineer.
 2018-11-15 17:36:09 -08:00
Giovanni Matteo Fumarola
fcd94eeab8 HDDS-842. [JDK11] Fix Javadoc errors in hadoop-hdds-common module. Contributed by Dinesh Chitlangia. 2018-11-15 14:59:31 -08:00
Giovanni Matteo Fumarola
d8ec017a8d HDDS-843. [JDK11] Fix Javadoc errors in hadoop-hdds-server-scm module. Contributed by Dinesh Chitlangia. 2018-11-15 14:54:41 -08:00
Bharat Viswanadham
57866b366f HDDS-821. Handle empty x-amz-storage-class header in Ozone S3 gateway. Contributed by Elek Marton. 2018-11-15 14:21:42 -08:00
Arpit Agarwal
914b0cf15f HADOOP-12558. distcp documentation is woefully out of date. Contributed by Dinesh Chitlangia. 2018-11-15 13:58:13 -08:00
Arpit Agarwal
1e15c7e855 HADOOP-15936. [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier. Contributed by Zsolt Venczel. 2018-11-15 12:42:31 -08:00
Inigo Goiri
460a94a10f HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang. 2018-11-15 10:58:57 -08:00
Inigo Goiri
993c2140cc HDFS-14054. TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky. Contributed by Zsolt Venczel. 2018-11-15 09:29:14 -08:00
Inigo Goiri
eeaf8edaa7 YARN-8856. TestTimelineReaderWebServicesHBaseStorage tests failing with NoClassDefFoundError. Contributed by Sushil Ks. 2018-11-15 09:25:25 -08:00
Márton Elek
d40912b1bd HDDS-223. Create acceptance test for using datanode plugin. Contributed by Sandeep Nemuri. 2018-11-15 15:18:07 +01:00
Márton Elek
0a8b1efbfb HDDS-827. TestStorageContainerManagerHttpServer should use dynamic port. Contributed by Sandeep Nemuri. 2018-11-15 14:23:24 +01:00
Márton Elek
2718f7534d HDDS-828. Fix deprecation log generated by getting value of the setting ozone.scm.heartbeat.rpc-timeout. Contributed by Yiqun Lin. 2018-11-15 14:04:55 +01:00
Márton Elek
fb1e8bb0cc HDDS-528. add cli command to checkChill mode status and exit chill mode. Contributed by chencan. 2018-11-15 13:59:56 +01:00
Márton Elek
b12e69475b HDDS-658. Implement s3 bucket list backend call and use it from rest endpoint. Contributed by Bharat Viswanadham. 2018-11-15 12:22:16 +01:00
Anu Engineer
9b01f039eb HDDS-832. Docs folder is missing from the Ozone distribution package. Contributed by Elek, Marton. 2018-11-15 11:08:48 +01:00
Akira Ajisaka
66b1335bb3
HADOOP-15926. Document upgrading the section in NOTICE.txt when upgrading the version of AWS SDK. Contributed by Dinesh Chitlangia. 2018-11-15 16:30:24 +09:00
Akira Ajisaka
df5e863fee
HADOOP-15930. Exclude MD5 checksum files from release artifact. 2018-11-15 10:45:34 +09:00
Arpit Agarwal
bac8807c8b HDDS-819. Match OzoneFileSystem behavior with S3AFileSystem. Contributed by Hanisha Koneru. 2018-11-14 16:12:06 -08:00
Eric Yang
21ec4bdaef YARN-8672. Improve token filename management for localization. 
Contributed by Chandni Singh
 2018-11-14 15:22:01 -05:00
Shashikant Banerjee
b57cc73f83 HDDS-774. Remove OpenContainerBlockMap from datanode. Contributed by Shashikant Banerjee. 2018-11-14 20:05:56 +05:30
Shashikant Banerjee
a948281706 HDDS-834. Datanode goes OOM based because of segment size. Contributed by Mukul Kumar Singh. 2018-11-14 15:53:22 +05:30
Sammi Chen
3fade865ce HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps in statistics. Contributed by Jinhu Wu. 2018-11-14 12:58:57 +08:00
Da Zhou
a13be203b7
HADOOP-15876. Use keySet().removeAll() to remove multiple keys from Map in AzureBlobFileSystemStore 
Contributed by Da Zhou.
 2018-11-13 21:46:18 +00:00
Wangda Tan
fcbd205cc3 YARN-9001. [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs. (Zac Zhou via wangda) 
Change-Id: Ic3d6c1e439df9cdf74448b345b925343224efe51
 2018-11-13 13:13:27 -08:00
Xiao Chen
9da6054ca4 Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel." 
This reverts commit 7dc79a8b5b.
 2018-11-13 12:44:25 -08:00
Wangda Tan
762a56cc64 MAPREDUCE-7158. Inefficient Flush Logic in JobHistory EventWriter. (Zichen Sun via wangda) 
Change-Id: I99ace87980da03bb35a8012cea7218d602a8817a
 2018-11-13 11:25:41 -08:00
Wangda Tan
076b795b2e YARN-8918. [Submarine] Correct method usage of str.subString in CliUtils. (Zhankun Tang via wangda) 
Change-Id: Id1f11dbab3aa838dee3a0ec8b8fd5dc32f5dd946
 2018-11-13 11:24:15 -08:00
Shashikant Banerjee
671fd6524b HDDS-675. Add blocking buffer and use watchApi for flush/close in OzoneClient. Contributed by Shashikant Banerjee. 2018-11-13 23:39:14 +05:30
Surendra Singh Lilhore
75291e6d53 HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore 2018-11-13 20:22:58 +05:30
Brahma Reddy Battula
e7b63baca1 HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota 2018-11-13 12:45:44 +05:30