big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,001 Commits 2 Branches 2 Tags 264 MiB
d1ddba60e5
Commit Graph

23001 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Bharat Viswanadham
217e74816c
HDDS-1973. Implement OM RenewDelegationToken request to use Cache and DoubleBuffer. (#1316) 2019-08-21 12:01:27 -07:00
Inigo Goiri
93595febaa HDFS-14756. RBF: getQuotaUsage may ignore some folders. Contributed by Chen Zhang. 2019-08-21 09:39:57 -07:00
Inigo Goiri
5eeb6da2d4 HDFS-14714. RBF: implement getReplicatedBlockStats interface. Contributed by Chen Zhang. 2019-08-21 09:38:17 -07:00
Wei-Chiu Chuang
57f7370174 Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow." 
This reverts commit b58a35f374.
 2019-08-21 08:59:49 -07:00
Abhishek Modi
3ad1fcfc8b YARN-9752. Add support for allocation id in SLS. Contributed by Abhishek Modi 2019-08-21 20:39:51 +05:30
Szilard Nemeth
7ab88dbfa6 YARN-7291. Better input parsing for resource in allocation file. Contributed by Zoltan Siegl 2019-08-21 17:01:18 +02:00
Szilard Nemeth
e8fa192f07 YARN-9217. Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing. Contributed by Peter Bacsko 2019-08-21 16:44:22 +02:00
bibinchundatt
e684b17e6f YARN-5857. TestLogAggregationService.testFixedSizeThreadPool fails intermittently on trunk. Contributed by Bilwa S T. 2019-08-21 17:14:42 +05:30
bibinchundatt
10ec31d20e YARN-9765. SLS runner crashes when run with metrics turned off. Contributed by Abhishek Modi. 2019-08-21 13:48:21 +05:30
Anu Engineer
8aaf5e1a14 HDFS-14759. HDFS cat logs an info message. 
Contributed by Eric Badger.
 2019-08-20 20:24:19 -07:00
Akira Ajisaka
30ce8546f1
HADOOP-16496. Apply HDDS-1870 (ConcurrentModification at PrometheusMetricsSink) to Hadoop common. 
This closes #1317

Reviewed-by: Bharat Viswanadham <bharat@apache.org>
 2019-08-21 10:10:11 +09:00
Xiaoyu Yao
10b4997b42
HDDS-1965. Compile error due to leftover ScmBlockLocationTestIngClient file. (fix build) 2019-08-20 16:46:53 -07:00
Xiaoyu Yao
7653ebdbb2
Revert "HDDS-1965. Compile error due to leftover ScmBlockLocationTestIngClient file (#1293)" 
This reverts commit 83e452ecea.
 2019-08-20 16:46:52 -07:00
Surendra Singh Lilhore
3a145e2918 HDFS-14582. Failed to start DN with ArithmeticException when NULL checksum used. Contributed by Surendra Singh Lilhore. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-20 15:55:26 -07:00
Sandeep Kumar
269b543367 HADOOP-16523. Minor spell mistake in comment : Line number 101 (#388) 2019-08-20 13:36:23 -07:00
Wei-Chiu Chuang
4cb22cd867 HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai. 2019-08-20 10:37:11 -07:00
Wei-Chiu Chuang
aa6995fde2 HDFS-13201. Fix prompt message in testPolicyAndStateCantBeNull. Contributed by chencan. 2019-08-20 10:32:55 -07:00
Sunil G
094d73608f YARN-9758. Upgrade JQuery to latest version for YARN UI. Contributed by Akhil PB. 2019-08-20 18:47:44 +05:30
Sunil G
bd92462321 HDFS-14729. Upgrade Bootstrap and jQuery versions used in HDFS UIs. Contributed by Vivek Ratnavel Subramanian. This closes #1297 2019-08-20 18:42:19 +05:30
Shashikant Banerjee
62445021d5 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee. 2019-08-20 14:37:01 +05:30
Bharat Viswanadham
4f925afa82
HDDS-1972. Provide example ha proxy with multiple s3 servers back end. (#1304) 2019-08-19 13:59:58 -07:00
Wei-Chiu Chuang
360a96f342 HDFS-13709. Report bad block to NN when transfer block encounter EIO exception. Contributed by Chen Zhang. 2019-08-19 13:08:55 -07:00
HUAN-PING SU
abae6ff2a2 HDFS-14746. Trivial test code update after HDFS-14687. Contributed by kevin su. 
Reviewed-by: Surendra Singh Lilhore <surendralilhore@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-19 11:14:51 -07:00
Wei-Chiu Chuang
51b65370b9 HADOOP-14784. [KMS] Improve KeyAuthorizationKeyProvider#toString(). Contributed by Yeliang Cang. 
Reviewed-by: Dinesh Chitlangia <dchitlangia@cloudera.com>
 2019-08-19 11:12:09 -07:00
avijayanhwx
d69a1a0aa4 HDDS-1105 : Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager (#1259) 2019-08-19 10:47:49 -07:00
KAI XIE
c765584eb2 HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919) 
* DistCp to support checksum validation when copy blocks in parallel

* address review comments

* add checksums comparison test for combine mode
 2019-08-18 18:46:31 -07:00
David Mollitor
a707bb7c1b HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-18 18:44:35 -07:00
Siyao Meng
12c7084be3 HDDS-1971. Update document for HDDS-1891: Ozone fs shell command should work with default port when port number is not specified (#1306) 2019-08-18 18:29:52 -07:00
Surendra Singh Lilhore
b8db5b9a98 HDFS-14687. Standby Namenode never come out of safemode when EC files are being written. Contributed by Surendra Singh Lilhore. 
Reviewed-by: Siyao Meng <smeng@cloudera.com>
Reviewed-by: Wei-Chiu CHuang <weichiu@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-18 18:13:35 -07:00
Wei-Chiu Chuang
b58a35f374 HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow. 2019-08-18 17:46:00 -07:00
avijayanhwx
e32f52c75f HDDS-1903 : Use dynamic ports for SCM in TestSCMClientProtocolServer … (#1303) 2019-08-18 10:08:38 -07:00
Bharat Viswanadham
b83eae7bdb
HDDS-1974. Implement OM CancelDelegationToken request to use Cache and DoubleBuffer. (#1308) 2019-08-18 10:06:00 -07:00
Siyao Meng
3bba8086e0 HDDS-1938. Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter (#1305) 2019-08-17 21:54:48 -07:00
Vivek Ratnavel Subramanian
e61825682a HDDS-1979. Fix checkstyle errors (#1312) 2019-08-17 21:53:12 -07:00
Wei-Chiu Chuang
d873ddd656 HDFS-14127. Add a description about the observer read configuration. Contributed by xiangheng. 2019-08-17 04:39:22 -07:00
Wei-Chiu Chuang
528378784f HDFS-12012. Fix spelling mistakes in BPServiceActor.java. Contributed by chencan. 2019-08-17 04:37:05 -07:00
HUAN-PING SU
02015e3ed8 HDDS-1959. Decrement purge interval for Ratis logs in datanode (#1301) 2019-08-17 16:54:33 +05:30
Sunil G
0e0ddfaf24 YARN-2599. Standby RM should expose jmx endpoint. Contributed by Rohith Sharma K S. 2019-08-17 15:43:19 +05:30
HUAN-PING SU
8d754c2c39 HADOOP-16351. Change ":" to ApplicationConstants.CLASS_PATH_SEPARATOR. Contributed by kevin su. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-16 17:26:09 -07:00
Wei-Chiu Chuang
971a4c8e83 HDFS-14523. Remove excess read lock for NetworkToplogy. Contributed by Wu Weiwei. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Chen Liang <cliang@apache.org>
 2019-08-16 17:19:58 -07:00
Bharat Viswanadham
a46ba03d15
HDDS-1913. Fix OzoneBucket and RpcClient APIS for acl. (#1257) 2019-08-16 16:39:49 -07:00
Bharat Viswanadham
c8675ec42e
HDDS-1911. Support Prefix ACL operations for OM HA. (#1275) 2019-08-16 15:11:11 -07:00
hunshenshi
a38b9e137e HDFS-14456:HAState#prepareToEnterState neednt a lock (#770) Contributed by hunshenshi. 2019-08-16 14:53:06 -07:00
Bharat Viswanadham
8943e1340d
HDDS-1969. Implement OM GetDelegationToken request to use Cache and DoubleBuffer. (#1296) 2019-08-16 13:22:03 -07:00
Erik Krogen
e356e4f4b7 HADOOP-16391 Add a prefix to the metric names for MutableRatesWithAggregation used for deferred RPC metrics to avoid collision with non-deferred metrics. Contributed by Bilwa S T. 2019-08-16 09:01:44 -07:00
LeonGao91
9a1d8cfaf5 HDFS-14678. Allow triggerBlockReport to a specific namenode. (#1252). Contributed by Leon Gao. 2019-08-16 08:00:51 -07:00
Szilard Nemeth
9b8359bb08 YARN-9461. TestRMWebServicesDelegationTokenAuthentication.testCancelledDelegationToken fails with HTTP 400. Contributed by Peter Bacsko 2019-08-16 12:31:58 +02:00
Szilard Nemeth
4456ea67b9 YARN-8586. Extract log aggregation related fields and methods from RMAppImpl. Contributed by Peter Bacsko 2019-08-16 11:36:14 +02:00
Szilard Nemeth
2216ec54e5 YARN-9100. Add tests for GpuResourceAllocator and do minor code cleanup. Contributed by Peter Bacsko 2019-08-16 09:13:20 +02:00
Szilard Nemeth
2a05e0ff3b YARN-9749. TestAppLogAggregatorImpl#testDFSQuotaExceeded fails on trunk. Contributed by Adam Antal 2019-08-16 08:52:09 +02:00