big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,652 Commits 2 Branches 2 Tags 264 MiB
33e0df4b35
Commit Graph

20652 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nanda kumar
18fe65d756 HDDS-576. Move ContainerWithPipeline creation to RPC endpoint. 
Contributed by Nanda kumar.
 2018-11-12 23:33:11 +05:30
Sunil G
42f3a7082a YARN-8877. [CSI] Extend service spec to allow setting resource attributes. Contributed by Weiwei Yang. 2018-11-12 21:09:30 +05:30
Steve Loughran
3c9d97b8f7
HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds. 
Contributed by LiXin Ge.
 2018-11-12 12:58:05 +00:00
Weiwei Yang
c741109522 YARN-8987. Usability improvements node-attributes CLI. Contributed by Bibin A Chundatt. 2018-11-12 18:18:23 +08:00
Márton Elek
9c32b50d61 HDDS-767. OM should not search for STDOUT root logger for audit logging. Contributed by Dinesh Chitlangia. 2018-11-12 10:54:41 +01:00
Sunil G
4e7284443e YARN-8902. [CSI] Add volume manager that manages CSI volume lifecycle. Contributed by Weiwei Yang. 2018-11-12 11:57:02 +05:30
Botong Huang
b5ec85d966 YARN-8933. [AMRMProxy] Fix potential empty fields in allocation response, move SubClusterTimeout to FederationInterceptor. Contributed by Botong Huang. 2018-11-11 11:12:53 -08:00
Eric Yang
2664248797 YARN-9002. Improve keytab loading for YARN Service. 
Contributed by Gour Saha
 2018-11-10 01:52:19 -05:00
Tsz Wo Nicholas Sze
298d2502b0 HDDS-826. Update Ratis to 0.3.0-6f3419a-SNAPSHOT. 2018-11-09 18:35:40 -08:00
Nanda kumar
9fe50b4991 HDDS-733. Create container if not exist, as part of chunk write. 
Contributed by Lokesh Jain.
 2018-11-10 00:08:17 +05:30
Akira Ajisaka
a736b5da15
HADOOP-15916. Upgrade Maven Surefire plugin to 3.0.0-M1. 2018-11-10 00:24:56 +09:00
Da Zhou
9dbb2b67c6
HADOOP-15812. ABFS: Improve AbfsRestOperationException format to ensure full msg can be displayed on console. 
Author:    Da Zhou <da.zhou@microsoft.com>
 2018-11-09 11:06:23 +00:00
Bharat Viswanadham
47194fefdd HDDS-823. OzoneRestClient is failing with NPE on getKeyDetails call. Contributed by Bharat Viswanadham. 2018-11-08 21:28:04 -08:00
Bharat Viswanadham
66bf62404a HDDS-812. TestEndPoint#testCheckVersionResponse is failing. Contributed by Hanisha Koneru. 2018-11-08 17:52:09 -08:00
Haibo Chen
524a7523c4 YARN-8990. Fix fair scheduler race condition in app submit and queue cleanup. (Contributed by Wilfred Spiegelenburg) 2018-11-08 16:02:48 -08:00
Giovanni Matteo Fumarola
89b49167a5 HADOOP-15903. Allow HttpServer2 to discover resources in /static when symlinks are used. Contributed by Inigo Goiri. 2018-11-08 14:52:24 -08:00
Shashikant Banerjee
31614bcc7c HDDS-806. Update Ratis to latest snapshot version in ozone. Contributed by Tsz Wo Nicholas Sze and Mukul Kumar Singh. 2018-11-09 00:05:45 +05:30
Kitti Nanasi
8d99648c20 HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi. 
Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-11-08 10:01:19 -08:00
Junhua Gu
724c15007b
HADOOP-15846. ABFS: fix mask related bugs in setAcl, modifyAclEntries and removeAclEntries. 
Contributed by Junhua Gu.

(cherry picked from commit 66715005f9e8f4f25faa352a06d142b75a029f0e)
 2018-11-08 17:21:40 +00:00
Yiqun Lin
9317a61f3c HDDS-802. Container State Manager should get open pipelines for allocating container. Contributed by Lokesh Jain. 2018-11-08 23:41:43 +08:00
Nanda kumar
c80f753b0e HDDS-737. Introduce Incremental Container Report. 
Contributed by Nanda kumar.
 2018-11-08 18:33:38 +05:30
Weiwei Yang
e1bbf7dcdf YARN-8988. Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled. Contributed by Tao Yang. 2018-11-08 17:47:18 +08:00
Weiwei Yang
f8c72d7b3a YARN-8880. Add configurations for pluggable plugin framework. Contributed by Zhankun Tang. 2018-11-08 12:23:00 +08:00
Weiwei Yang
c96cbe8659 YARN-8977. Remove unnecessary type casting when calling AbstractYarnScheduler#getSchedulerNode. Contributed by Wanqiang Ji. 2018-11-07 22:42:22 +08:00
Jason Lowe
0b6625a973 MAPREDUCE-7148. Fast fail jobs when exceeds dfs quota limitation. Contributed by Wang Yan 2018-11-07 08:20:49 -06:00
Takanobu Asanuma
8dc1f6dbf7 YARN-8866. Fix a parsing error for crossdomain.xml. 2018-11-07 18:26:07 +09:00
Weiwei Yang
e6444f1c64 HADOOP-15907. Add missing maven modules in BUILDING.txt. Contributed Wanqiang Ji. 2018-11-07 16:45:16 +08:00
Yiqun Lin
addec29297 HDDS-809. Refactor SCMChillModeManager. 2018-11-07 13:54:08 +08:00
Weiwei Yang
482716e5a4 YARN-8976. Remove redundant modifiers in interface ApplicationConstants. Contributed by Zhankun Tang. 2018-11-07 10:48:07 +08:00
Akira Ajisaka
951c98f890
YARN-8233. NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null. Contributed by Tao Yang. 2018-11-07 11:17:35 +09:00
Jason Lowe
ba1f9d66d9 MAPREDUCE-7156. NullPointerException when reaching max shuffle connections. Contributed by Peter Bacsko 2018-11-06 17:55:51 -06:00
Eric Yang
08d69d91f2 YARN-8957. Add Serializable interface to ComponentContainers. 
Contributed by Zhankun Tang
 2018-11-06 14:46:05 -05:00
Inigo Goiri
887244de4a HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen. 2018-11-06 11:18:15 -08:00
Anu Engineer
00a67f770e HDDS-810. Move the "\r\n" at the chunk end in TestSignedChunksInputStream#singlechunkwithoutend. 
Contributed by Chencan.
 2018-11-06 10:42:19 -08:00
Inigo Goiri
f0ce072934 HDFS-14051. Refactor NameNodeHttpServer#initWebHdfs to specify local keytab. Contributed by CR Hota. 2018-11-06 10:05:58 -08:00
Márton Elek
3d5cc1138a HDDS-798. Storage-class is showing incorrectly. Contributed by Bharat Viswanadham. 2018-11-06 18:28:54 +01:00
Daniel Templeton
349168c4b3 HDFS-14047. [libhdfs++] Fix hdfsGetLastExceptionRootCause bug in test_libhdfs_threaded.c 
(Contributed by Antoli Shein via Daniel Templeton)

Change-Id: Ia5546fd5f8270f285c373b9023a9bd9835059845
 2018-11-06 09:22:27 -08:00
Jason Lowe
ab6aa4c726 YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg 2018-11-06 08:40:59 -06:00
Akira Ajisaka
49412a1289
HDDS-811. [JDK 11] Fix compilation failures with jdk 11. Contributed by Lokesh Jain. 2018-11-06 21:26:43 +09:00
Akira Ajisaka
78e43bccf6
HADOOP-15902. [JDK 11] Specify the HTML version of Javadoc to 4.01. Contributed by Takanobu Asanuma. 2018-11-06 20:44:05 +09:00
Akira Ajisaka
6430c9890a
HADOOP-15904. [JDK 11] Javadoc build failed due to bad use of '>' in hadoop-hdfs. 2018-11-06 18:42:38 +09:00
Weiwei Yang
5d6554c722 YARN-8970. Improve the debug message in CS#allocateContainerOnSingleNode. Contributed by Zhankun Tang. 2018-11-06 14:50:09 +08:00
Xiao Chen
ffc9c50e07 HDFS-14053. Provide ability for NN to re-replicate based on topology changes. Contributed by Hrishikesh Gadre. 2018-11-05 21:38:39 -08:00
Weiwei Yang
c7fcca0d7e YARN-8969. AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting. Contributed by Wanqiang Ji. 2018-11-06 13:14:57 +08:00
Inigo Goiri
f3296501e0 HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak. 2018-11-05 16:48:37 -08:00
Giovanni Matteo Fumarola
f3f5e7ad00 HDFS-14042. Fix NPE when PROVIDED storage is missing. Contributed by Virajith Jalaparti. 2018-11-05 11:02:31 -08:00
Shashikant Banerjee
50f40e0536 HDDS-794. addendum patch to fix compilation failure. Contributed by Shashikant Banerjee. 2018-11-06 00:20:57 +05:30
Arpit Agarwal
5ddefdd507 HDDS-794. Add configs to set StateMachineData write timeout in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-11-05 10:41:28 -08:00
Shashikant Banerjee
942693bddd HDDS-799. Avoid ByteString to byte array conversion cost by using ByteBuffer in Datanode. Contributed by Mukul Kumar Singh. 2018-11-05 23:43:22 +05:30
Arpit Agarwal
c8ca1747c0 HDDS-797. If DN is started before SCM, it does not register. Contributed by Hanisha Koneru. 2018-11-05 09:40:00 -08:00