big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,253 Commits 2 Branches 2 Tags 264 MiB
b25e94ce29
Commit Graph

23253 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Malcolm Taylor
56248f9d87
HADOOP-16556. Fix some alerts raised by LGTM. 
Contributed by Malcolm Taylor.

Change-Id: Ic60c3f4681dd9d48b3afcba7520bd1e4d3cc4231
 2019-09-19 16:00:05 +01:00
Kihwal Lee
d4205dce17 HADOOP-16582. LocalFileSystem's mkdirs() does not work as expected under viewfs. Contributed by Kihwal Lee 2019-09-19 08:23:35 -05:00
Doroszlai, Attila
c9900a01d1
HDDS-2141. Missing total number of operations 
Closes #1462
 2019-09-19 14:11:44 +02:00
dchitlangia
28913f733e
HDDS-2148. Remove redundant code in CreateBucketHandler.java 
Closes #1471
 2019-09-19 12:26:53 +02:00
Nanda kumar
e78848fc3c
HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation 
Closes #1435
 2019-09-19 11:59:43 +02:00
dchitlangia
5c963a75d6
HDDS-2016. Add option to enforce GDPR in Bucket Create command 
Closes #1458
 2019-09-19 11:18:16 +02:00
Doroszlai, Attila
1029060e61
HDDS-2147. Include dumpstream in test report 
Closes #1470
 2019-09-19 10:41:00 +02:00
cxorm
ef478fe73e
HDDS-730. ozone fs cli prints hadoop fs in usage 
Closes #1464
 2019-09-19 09:16:12 +02:00
Chen Liang
4ed0aefe9f HDFS-14822. [SBN read] Revisit GlobalStateIdContext locking when getting server state id. Contributed by Chen Liang. 2019-09-18 16:47:46 -07:00
Bharat Viswanadham
f16eb093f7
HDDS-2144. MR job failing on secure Ozone cluster. (#1466) 2019-09-18 13:27:08 -07:00
Elek, Márton
53b57fdfa4 HDDS-2121. Create a shaded ozone filesystem (client) jar (#1452) 2019-09-18 13:25:15 -07:00
Steve Loughran
5db32b8ced HADOOP-16547. make sure that s3guard prune sets up the FS (#1402). Contributed by Steve Loughran. 
Change-Id: Iaf71561cef6c797a3c66fed110faf08da6cac361
 2019-09-18 19:22:15 +02:00
bshashikant
2c52d00a27
HDDS-2032. Ozone client should retry writes in case of any ratis/stateMachine exceptions. Contributed by Shashikant Banerjee (#1420). 2019-09-18 22:30:41 +05:30
Wei-Chiu Chuang
5dd859a8a0 HDFS-14836. FileIoProvider should not increase FileIoErrors metric in datanode volume metric. Contributed by Aiphago. 
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
 2019-09-18 09:34:01 -07:00
Siyao Meng
8d9e9ec3e5
HDDS-2065. Implement OMNodeDetails#toString 
Closes #1387
 2019-09-18 17:10:26 +02:00
Márton Elek
c28e731156
Wrong commit message: Revert second "HDDS-2143. Rename classes under package org.apache.hadoop.utils" 
This reverts commit 111b08a330.
 2019-09-18 17:09:33 +02:00
Siyao Meng
111b08a330
HDDS-2143. Rename classes under package org.apache.hadoop.utils 
Closes #1465
 2019-09-18 17:00:26 +02:00
Bharat Viswanadham
6d4b20c047
HDDS-2143. Rename classes under package org.apache.hadoop.utils 
Closes #1465
 2019-09-18 16:51:39 +02:00
Viraj Jasani
285ed0a849
HDDS-2137. HddsClientUtils and OzoneUtils have duplicate verifyResourceName() 
Closes #1455
 2019-09-18 16:43:24 +02:00
Doroszlai, Attila
087ed86bcc
HDDS-2138. OM bucket operations do not add up 
Closes #1468
 2019-09-18 15:23:27 +02:00
Doroszlai, Attila
419dd0faf6
HDDS-2134. OM Metrics graphs include empty request type 
Closes #1451
 2019-09-18 14:09:15 +02:00
Márton Elek
15fded2788
HDDS-2022. Add additional freon tests 
Closes #1341
 2019-09-18 13:28:43 +02:00
Gabor Bota
e97f0f1ed9
HADOOP-16565. Region must be provided when requesting session credentials or SdkClientException will be thrown (#1454). Contributed by Gabor Bota. 2019-09-18 10:51:08 +02:00
Sunil G
01d7924473 YARN-9814. JobHistoryServer can't delete aggregated files, if remote app root directory is created by NodeManager. Contributed by Adam Antal. 2019-09-18 09:27:41 +05:30
Weiwei Yang
f8c14326ee YARN-2255. YARN Audit logging not added to log4j.properties. Contributed by Aihua Xu. 2019-09-18 09:12:28 +08:00
Hanisha Koneru
0dbfc4d9f2 HDDS-2139. Update BeanUtils and Jackson Databind dependency versions (#1456) 2019-09-17 17:39:30 -07:00
Doroszlai, Attila
b88b6826c9 HDDS-2136. OM block allocation metric not paired with its failures (#1460) 2019-09-17 17:31:08 -07:00
Doroszlai, Attila
a9ba2b6710 HDDS-2142. OM metrics mismatch (abort multipart request) (#1461) 2019-09-17 17:27:08 -07:00
Sahil Takiar
3cf6e4272f HDFS-14846: libhdfs tests are failing on trunk due to jni usage bugs 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-17 15:51:39 -07:00
Inigo Goiri
f580a87079 HDFS-14795. Add Throttler for writing block. Contributed by Lisheng Sun. 2019-09-17 14:55:34 -07:00
Eric Yang
eefe9bc85c YARN-9837. Fixed reading YARN Service JSON spec file larger than 128k. 
Contributed by Tarun Parimi
 2019-09-17 13:13:35 -04:00
Sunil G
c474e24c0b YARN-9833. Race condition when DirectoryCollection.checkDirs() runs during container launch. Contributed by Peter Bacsko. 2019-09-17 19:41:38 +05:30
bshashikant
7f9073132d HDDS-2117. ContainerStateMachine#writeStateMachineData times out. (#1430) 2019-09-17 16:49:25 +05:30
Doroszlai, Attila
f3de141787
HDDS-2135. OM Metric mismatch (MultipartUpload failures) 
Closes #1453
 2019-09-17 12:41:23 +02:00
Sahil Takiar
55ce454ce4
HADOOP-16371: Option to disable GCM for SSL connections when running on Java 8. 
Contributed by Sahil Takiar.

This moves the SSLSocketFactoryEx class from hadoop-azure into hadoop-common
as the DelegatingSSLSocketFactory and binds the S3A connector to it so that
it can avoid using those HTTPS algorithms which are underperformant on Java 8.

Change-Id: Ie9e6ac24deac1aa05e136e08899620efa7d22abd
 2019-09-17 11:32:03 +01:00
Márton Elek
3a549cea19
HDDS-2120. Remove hadoop classes from ozonefs-current jar 
Closes #1434
 2019-09-17 12:28:40 +02:00
Doroszlai, Attila
e54977f888 HDDS-2132. TestKeyValueContainer is failing (#1457). 2019-09-17 14:31:33 +05:30
avijayanhwx
4f67081038 HDDS-2098 : Ozone shell command prints out ERROR when the log4j file … (#1411) 2019-09-16 22:36:53 -07:00
Mukul Kumar Singh
292bce7908 HDDS-2114. Rename does not preserve non-explicitly created interim directories. Contributed by Lokesh Jain & Istvan Fajth. 2019-09-17 10:47:12 +05:30
Márton Elek
2358e53e9c HDDS-2111. XSS fragments can be injected to the S3g landing page 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-16 15:48:09 -07:00
Vivek Ratnavel Subramanian
66bd1681f8 HDDS-2107. Datanodes should retry forever to connect to SCM in an unsecure environment (#1424) 2019-09-16 12:58:16 -07:00
Sammi Chen
4222b62f2b HDDS-1879. Support multiple excluded scopes when choosing datanodes in NetworkTopology (#1194) 2019-09-16 12:57:41 -07:00
Márton Elek
c8d61ffef6 HDDS-2030. Generate simplifed reports by the dev-support/checks/*.sh scripts 
Signed-off-by: Anu Engineer <aengineer@apache.org>
Co-Authored-By: Doroszlai, Attila <6454655+adoroszlai@users.noreply.github.com>
 2019-09-16 12:17:33 -07:00
Xiaoyu Yao
56f042c48f
HDDS-2078. Get/Renew DelegationToken NPE after HDDS-1909 
Closes #1444
 2019-09-16 16:58:10 +02:00
Doroszlai, Attila
363373e0ef
HDDS-2124. Random next links 
Closes #1443
 2019-09-16 15:41:17 +02:00
Doroszlai, Attila
e952ecf807
HDDS-2109. Refactor scm.container.client config 
Closes #1426
 2019-09-16 15:22:11 +02:00
Xiaoyu Yao
b6334381df
HDDS-2096. Ozone ACL document missing AddAcl API 
Closes #1427
 2019-09-16 14:55:06 +02:00
shwetayakkali@cloudera.com
1e13fe6310
HDDS-2044.Remove 'ozone' from the recon module names. 2019-09-16 14:18:01 +02:00
Elek, Márton
85b1c728e4 HDDS-2129. Using dist profile fails with pom.ozone.xml as parent pom (#1449) 2019-09-15 08:22:17 -07:00
Abhishek Modi
da2b4fe204 YARN-9794. RM crashes due to runtime errors in TimelineServiceV2Publisher. Contributed by Tarun Parimi. 2019-09-15 14:16:18 +05:30