big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,487 Commits 2 Branches 2 Tags 264 MiB
5d8bd0e5cb
Commit Graph

21487 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wei-Chiu Chuang
6192c1fe3b Revert "HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar." 
This reverts commit f5a4b43a49.
 2019-03-06 15:02:18 -08:00
Sahil Takiar
f5a4b43a49 HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-03-06 14:58:45 -08:00
Eric Yang
01ada40ea4 YARN-9348. Application catalog build system bug fixes. 
Contributed by Eric Yang
 2019-03-06 17:55:48 -05:00
Márton Elek
45f976fdcf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton. 
Closes #490
 2019-03-06 18:22:22 +01:00
Mukul Kumar Singh
2c3ec37738 HDDS-1210. Ratis pipeline creation doesn't check raft client reply status during initialization. Contributed by Mukul Kumar Singh. 2019-03-06 21:38:21 +05:30
Ajay Kumar
9d87247af3
HDDS-1216. Change name of ozoneManager service in docker compose files to om. 
Closes #553
 2019-03-06 15:18:39 +01:00
Lokesh Jain
129fd5dd18 HDDS-1208. ContainerStateMachine should set chunk data as state machine data for ratis. Contributed by Lokesh Jain. 2019-03-06 17:00:37 +05:30
Sunil G
c79f139519 YARN-8803. [UI2] Show flow runs in the order of recently created time in graph widgets. Contributed by Akhil PB. 2019-03-06 16:49:08 +05:30
Sunil G
46045c5cb3 YARN-9138. Improve test coverage for nvidia-smi binary execution of GpuDiscoverer. Contributed by Szilard Nemeth. 2019-03-06 16:01:08 +05:30
Shashikant Banerjee
62e89dc275 HDDS-1184. Parallelization of write chunks in datanodes is broken. Contributed by Shashikant Banerjee. 2019-03-06 10:00:16 +05:30
Inigo Goiri
945b504c25 HDFS-14326. Add CorruptFilesCount to JMX. Contributed by Danny Becker. 2019-03-05 17:39:52 -08:00
Arpit Agarwal
1ad5bfc53f
HDDS-1188. Implement a skeleton patch for Recon server with initial set of interfaces. Contributed by Siddharth Wagle. 2019-03-05 15:54:29 -08:00
Elek, Márton
7f636b47b5 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502) 
Pull request from Elek, Márton. (#502)
 2019-03-05 12:04:57 -08:00
Bharat Viswanadham
313e8b9f13 HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule. (#534) 
* HDDS-1193. Refactor ContainerChillModeRule and DatanodeChillMode rule.
 2019-03-05 11:46:36 -08:00
Anu Engineer
7fd890116a HDDS-1171. Add benchmark for OM and OM client in Genesis. 
Contributed by Lokesh Jain.
 2019-03-05 11:31:09 -08:00
Eric Yang
3c5b7136e2 HADOOP-16150. Added concat method to ChecksumFS as unsupported operation. 
Contributed by Steve Loughran

(cherry picked from commit 8b517e7ad670aa8ee0b73ce5a572f36ce63eabee)
 2019-03-05 13:32:00 -05:00
Arpit Agarwal
3ef1235215
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek. 2019-03-05 10:25:31 -08:00
Arpit Agarwal
df99137310
Merge pull request #555 from elek/HDDS-1219 
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure
 2019-03-05 10:19:05 -08:00
Arpit Agarwal
549d54f9a3
Merge pull request #556 from elek/HDDS-1222 
HDDS-1222. Remove TestContainerSQLCli unit test stub
 2019-03-05 10:15:55 -08:00
Hanisha Koneru
12402b7a74 HDDS-1072. Implement RetryProxy and FailoverProxy for OM client. 2019-03-05 09:24:22 -08:00
Eric Yang
7b42e0e32a YARN-7266. Fixed deadlock in Timeline Server thread initialization. 
Contributed by Prabhu Joseph
 2019-03-05 12:17:01 -05:00
Shashikant Banerjee
5fcea54a50 HDDS-935. Avoid creating an already created container on a datanode in case of disk removal followed by datanode restart. Contributed by Shashikant Banerjee. 2019-03-05 22:09:46 +05:30
Ajay Yadav
353b90d59e HDDS-1156. testDelegationToken is failing in TestSecureOzoneCluster. Contributed by Ajay Kumar. 2019-03-05 08:37:10 -08:00
Márton Elek
02da06dd9f
HDDS-1222. Remove TestContainerSQLCli unit test stub. Contributed by Elek, Marton. 2019-03-05 16:35:04 +01:00
Billie Rinaldi
2576401928 YARN-7129. Application Catalog for YARN applications. Contributed by Eric Yang 2019-03-05 06:14:14 -08:00
Stephen O'Donnell
686c0141ef
HADOOP-16140. hadoop fs expunge to add -immediate option to purge trash immediately. 
Contributed by Stephen O'Donnell.

Signed-off-by: Steve Loughran <stevel@apache.org>
 2019-03-05 14:09:00 +00:00
Da Zhou
05df151d09
HADOOP-16163. NPE in setup/teardown of ITestAbfsDelegationTokens. 
Contributed by Da Zhou.

Signed-off-by: Steve Loughran <stevel@apache.org>
 2019-03-05 14:02:34 +00:00
Vinayakumar B
f940ab242d HDFS-7663. Erasure Coding: Append on striped file. Contributed by Ayush Saxena. 2019-03-05 19:26:42 +05:30
Márton Elek
296259e9b3
HDDS-1219. TestContainerActionsHandler.testCloseContainerAction has an intermittent failure. Contributed by Elek, Marton. 2019-03-05 13:45:47 +01:00
Yufei Gu
0aefe2846f YARN-9298. Implement FS placement rules using PlacementRule interface. Contributed by Wilfred Spiegelenburg. 2019-03-04 23:49:07 -08:00
Inigo Goiri
4b7313e640 HDFS-14336. Fix checkstyle for NameNodeMXBean. Contributed by Danny Becker. 2019-03-04 23:03:32 -08:00
Prabhu Joseph
e40e2d6ad5
YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager. 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-03-05 14:10:08 +09:00
coder-chenzhi
fe7551f21b
HADOOP-16162. Remove unused Job Summary Appender configurations from log4j.properties 
This closes #551

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-03-05 13:41:33 +09:00
David Mollitor
9fcd89ab93
HADOOP-16148. Cleanup LineReader Unit Test. 
Contributed by David Mollitor.

Signed-off-by: Steve Loughran <stevel@apache.org>
 2019-03-04 23:08:12 +00:00
Elek, Márton
90c37ac40d HDDS-623. On SCM UI, Node Manager info is empty (#523) 
* HDDS-623. On SCM UI, Node Manager info is empty. Contributed by Elek, Marton.
 2019-03-04 14:35:00 -08:00
Sahil Takiar
cb0fa0ce3f HDFS-14321. Fix -Xcheck:jni issues in libhdfs, run ctest with -Xcheck:jni enabled. Contributed by Sahil Takiar. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-03-04 12:37:57 -08:00
Anu Engineer
10b802b84b HDDS-1136 : Add metric counters to capture the RocksDB checkpointing statistics. 
Contributed by Aravindan Vijayan.
 2019-03-04 12:00:16 -08:00
Wei-Chiu Chuang
387dbe587a HDFS-14314. fullBlockReportLeaseId should be reset after registering to NN. Contributed by star. 2019-03-04 10:43:44 -08:00
Xiaoyu Yao
eed8b794d8 HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. (#545) 2019-03-04 10:37:26 -08:00
bibinchundatt
15098df744 Revert "YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph." 
This reverts commit a63c358b78.
 2019-03-04 16:57:31 +05:30
Yiqun Lin
18ea0c1493 HDFS-14182. Datanode usage histogram is clicked to show ip list. Contributed by fengchuang. 2019-03-04 17:34:24 +08:00
Akira Ajisaka
bd8d299ded
YARN-7477. Moving logging APIs over to slf4j in hadoop-yarn-common. Contributed by Prabhu Joseph. 2019-03-04 16:59:20 +09:00
Wei-Chiu Chuang
6c4d566955
Revert "HDFS-14261. Kerberize JournalNodeSyncer unit test. Contributed by Siyao Meng." 
This reverts commit 5c10630ad8.
 2019-03-04 16:59:20 +09:00
Weiwei Yang
e20b5ef52c
YARN-9332. RackResolver tool should accept multiple hosts. Contributed by Lantao Jin. 2019-03-04 16:59:20 +09:00
Hanisha Koneru
b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client." 
This reverts commit 8e1225991d.
 2019-03-04 16:58:59 +09:00
Erik Krogen
fc17ba172b
HDFS-14272. [SBN read] Make ObserverReadProxyProvider initialize its state ID against the active NN on startup. Contributed by Erik Krogen. 2019-03-04 16:52:04 +09:00
Ajay Yadav
9e53088493 Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" (#544) 
* Revert "Fix checkstyle issue"

This reverts commit 78c8a3323e.

* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."

This reverts commit 6fef6fc5ee.
 2019-03-01 16:19:43 -08:00
Xiaoyu Yao
78c8a3323e Fix checkstyle issue 2019-03-01 16:15:20 -08:00
Xiaoyu Yao
6fef6fc5ee HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. 2019-03-01 16:15:20 -08:00
Ajay Kumar
4a3cddea70 HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar. 2019-03-01 15:41:09 -08:00