big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,047 Commits 2 Branches 2 Tags 264 MiB
aa24add8f0
Commit Graph

471 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze
531cc938fe
HDDS-2222. Add a method to update ByteBuffer in PureJavaCrc32/PureJavaCrc32C. (#1595) 2019-10-04 21:16:28 +08:00
Tsz-Wo Nicholas Sze
a9849f65ba
Revert "HDDS-2222 (#1578)" (#1594) 
This reverts commit 4cf0b3660f.
 2019-10-04 19:19:45 +08:00
Tsz-Wo Nicholas Sze
4cf0b3660f
HDDS-2222 (#1578) 
Thanks @jnp  for reviewing this.  Merging now.
 2019-10-04 17:50:21 +08:00
Nanda kumar
9700e2003a
HDDS-2223. Support ReadWrite lock in LockManager. (#1564) 2019-10-04 08:32:43 +05:30
Aravindan Vijayan
76605f17dd HDDS-1720 : Add ability to configure RocksDB logs for Ozone Manager. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-10-03 15:17:09 -07:00
Anu Engineer
4c24f2434d HDDS-2072. Make StorageContainerLocationProtocolService message based 
Contributed by Elek, Marton.
 2019-10-02 17:00:53 -07:00
Bharat Viswanadham
53ed78bcdb
HDDS-2224. Fix loadup cache for cache cleanup policy NEVER. (#1567) 2019-10-02 15:18:43 -07:00
Anu Engineer
ffd4e52725 HDDS-2073. Make SCMSecurityProtocol message based. 
Contributed by Elek, Marton.
 2019-10-02 12:19:58 -07:00
Shashikant Banerjee
a530ac3f50
HDDS-2153. Add a config to tune max pending requests in Ratis leader 
Closes #1474
 2019-09-30 15:42:04 +02:00
Doroszlai, Attila
9bf7a6e5b2 HDDS-2149. Replace findbugs with spotbugs 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-26 22:56:05 -07:00
Márton Elek
f647185905 HDDS-2067. Create generic service facade with tracing/metrics/logging support 
Signed-off-by: Anu Engineer <aengineer@apache.org>
Co-Authored-By: Doroszlai, Attila <6454655+adoroszlai@users.noreply.github.com>
 2019-09-25 17:19:22 -07:00
Anu Engineer
f16cf877e5
HDDS-2170. Add Object IDs and Update ID to Volume Object (#1510) 2019-09-24 11:01:05 -07:00
Hanisha Koneru
a94aa1ff46 HDDS-2150. Update dependency versions to avoid security vulnerabilities. (#1472) 2019-09-20 23:21:53 -07:00
Xiaoyu Yao
d072d3304c HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-19 22:43:00 -07:00
Elek, Márton
126ef77a81 HDDS-2154. Fix Checkstyle issues (#1475) 2019-09-19 11:30:33 -07:00
Elek, Márton
da1c67e0c2 HDDS-1054. List Multipart uploads in a bucket (#1277) 2019-09-19 11:06:02 -07:00
Bharat Viswanadham
6d4b20c047
HDDS-2143. Rename classes under package org.apache.hadoop.utils 
Closes #1465
 2019-09-18 16:51:39 +02:00
Sammi Chen
4222b62f2b HDDS-1879. Support multiple excluded scopes when choosing datanodes in NetworkTopology (#1194) 2019-09-16 12:57:41 -07:00
Doroszlai, Attila
e952ecf807
HDDS-2109. Refactor scm.container.client config 
Closes #1426
 2019-09-16 15:22:11 +02:00
Shashikant Banerjee
469165e6f2 HDDS-1843. Undetectable corruption after restart of a datanode. Contributed by Shashikant Banerjee(#1364). 2019-09-09 22:43:20 +05:30
Vivek Ratnavel Subramanian
3b9584d12b HDDS-2087. Remove the hard coded config key in ChunkManager (#1409) 2019-09-08 20:44:07 -07:00
dchitlangia
b15c116c1e HDDS-2015. Encrypt/decrypt key using symmetric key while writing/reading 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-06 11:35:00 -07:00
Hrishikesh Gadre
f347c348d8 Add support for checksum verification in data scrubber 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-04 20:31:49 -07:00
Bharat Viswanadham
f25fe92743
HDDS-1909. Use new HA code for Non-HA in OM. (#1225) 2019-09-03 13:24:32 -07:00
Sammi Chen
0f549ec02a HDDS-2069. Default values of properties hdds.datanode.storage.utilization.{critical | warning}.threshold are not reasonable. (#1393) 2019-09-03 17:58:48 +05:30
Nanda kumar
0b9704f610
HDDS-1810. SCM command to Activate and Deactivate pipelines. (#1224) 2019-09-03 16:50:57 +05:30
dineshchitlangia
46696bd9b0 HDDS-2014. Create Symmetric Key for GDPR (#1362) 2019-08-30 09:55:36 -07:00
Xiaoyu Yao
ec34cee5e3
HDDS-2047. Datanodes fail to come up after 10 retries in a secure env… (#1379) 2019-08-30 09:27:37 -07:00
Nanda kumar
22a58615a2
HDDS-2058. Remove hadoop dependencies in ozone build 
Closes #1376
 2019-08-30 10:21:04 +02:00
Elek, Márton
4f5f46eb4a HDDS-1935. Improve the visibility with Ozone Insight tool (#1255) 2019-08-29 17:07:55 -07:00
Márton Elek
371c9eb6a6
Revert "HDDS-1596. Create service endpoint to download configuration from SCM." 
This reverts commit c0499bd704.
 2019-08-29 09:25:03 +02:00
supratimdeka
1407414a52 HDDS-1094. Performance test infrastructure : skip writing user data on Datanode. Contributed by Supratim Deka (#1323) 2019-08-28 10:05:20 -07:00
Anu Engineer
dc72782008 HDDS-738. Removing REST protocol support from OzoneClient. 
Contributed by Elek, Marton.
 2019-08-28 09:53:31 -07:00
Márton Elek
c0499bd704 HDDS-1596. Create service endpoint to download configuration from SCM. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-28 09:13:46 -07:00
bshashikant
5d31a4eff7 HDDS-1753. Datanode unable to find chunk while replication data using ratis. (#1318) 2019-08-28 10:54:44 +05:30
Vivek Ratnavel Subramanian
b1eee8b52e HDDS-1946. CertificateClient should not persist keys/certs to ozone.m… (#1311) 2019-08-27 17:29:27 -07:00
Lokesh Jain
4379370fb1
HDDS-1981: Datanode should sync db when container is moved to CLOSED or QUASI_CLOSED state (#1319) 2019-08-27 10:22:03 +05:30
Vivek Ratnavel Subramanian
e2a55482ee
HDDS-2023. Fix rat check failures in trunk 
Closes #1342
 2019-08-23 12:02:45 +02:00
Bharat Viswanadham
4028cac56d
HDDS-1347. In OM HA getS3Secret call Should happen only leader OM. (#670) 2019-08-22 15:00:17 -07:00
avijayanhwx
28fb4b527a HDDS-2008 : Wrong package for RatisHelper class in hadoop-hdds/common module. (#1333) 2019-08-22 10:57:22 -07:00
avijayanhwx
d69a1a0aa4 HDDS-1105 : Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager (#1259) 2019-08-19 10:47:49 -07:00
HUAN-PING SU
02015e3ed8 HDDS-1959. Decrement purge interval for Ratis logs in datanode (#1301) 2019-08-17 16:54:33 +05:30
Doroszlai, Attila
77d102ceba HDDS-1910. Cannot build hadoop-hdds-config from scratch in IDEA 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-15 11:03:41 -07:00
dineshchitlangia
c801f7a26c HDDS-1768. Audit xxxAcl methods in OzoneManager (#1204) 2019-08-15 08:43:47 -07:00
Siyao Meng
bf457797f6 HDDS-1920. Place ozone.om.address config key default value in ozone-site.xml 
Change-Id: Ic5970b383357147b74a01680aedf40bed4d3e176
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 20:27:37 -07:00
Nanda kumar
69b74e9016 HDDS-1488. Scm cli command to start/stop replication manager. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 14:57:05 -07:00
dchitlangia
689a80d3ce HDDS-1886. Use ArrayList#clear to address audit failure scenario 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 14:37:32 -07:00
Siyao Meng
14a4ce3cee HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. Contributed by Siyao Meng. 2019-08-08 13:38:10 -07:00
Sammi Chen
8f9245bc2d HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (#1184) 2019-08-07 16:59:13 -07:00
Xiaoyu Yao
a63023f261
HDDS-1901. Fix Ozone HTTP WebConsole Authentication. Contributed by Xiaoyu Yao. (#1228) 2019-08-06 12:07:53 -07:00