big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,153 Commits 2 Branches 2 Tags 264 MiB
bd498bac86
Commit Graph

313 Commits

Author SHA1 Message Date
Siddharth
15a9beed1b HDDS-2260. Avoid evaluation of LOG.trace and LOG.debug statement in the read/write path (HDDS). (#1612) 2019-10-08 11:13:53 -07:00
S O'Donnell
6171a41b4c
HDDS-2199. In SCMNodeManager dnsToUuidMap cannot track multiple DNs on the same host 
Closes #1551
 2019-10-04 14:00:06 +02:00
Nanda kumar
cdaa480dbf
HDDS-2198. SCM should not consider containers in CLOSING state to come out of safemode. (#1540) 2019-10-04 08:20:58 +05:30
Anu Engineer
4c24f2434d HDDS-2072. Make StorageContainerLocationProtocolService message based 
Contributed by Elek, Marton.
 2019-10-02 17:00:53 -07:00
Anu Engineer
ffd4e52725 HDDS-2073. Make SCMSecurityProtocol message based. 
Contributed by Elek, Marton.
 2019-10-02 12:19:58 -07:00
Márton Elek
e8ae632d4c HDDS-2068. Make StorageContainerDatanodeProtocolService message based 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-10-02 11:18:41 -07:00
Bharat Viswanadham
14b4fbc019
HDDS-1146. Adding container related metrics in SCM. (#1541) 2019-09-27 15:24:30 -07:00
Doroszlai, Attila
9bf7a6e5b2 HDDS-2149. Replace findbugs with spotbugs 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-26 22:56:05 -07:00
Bharat Viswanadham
b6ef8cc120 HDD-2193. Adding container related metrics in SCM. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-26 21:42:20 -07:00
Márton Elek
f647185905 HDDS-2067. Create generic service facade with tracing/metrics/logging support 
Signed-off-by: Anu Engineer <aengineer@apache.org>
Co-Authored-By: Doroszlai, Attila <6454655+adoroszlai@users.noreply.github.com>
 2019-09-25 17:19:22 -07:00
Xiaoyu Yao
d072d3304c HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-19 22:43:00 -07:00
Bharat Viswanadham
6d4b20c047
HDDS-2143. Rename classes under package org.apache.hadoop.utils 
Closes #1465
 2019-09-18 16:51:39 +02:00
Sammi Chen
4222b62f2b HDDS-1879. Support multiple excluded scopes when choosing datanodes in NetworkTopology (#1194) 2019-09-16 12:57:41 -07:00
Sammi Chen
c46d43ab13 HDDS-1553. Add metrics in rack aware container placement policy. (#1361) 2019-09-06 17:11:54 -07:00
Nanda kumar
0b9704f610
HDDS-1810. SCM command to Activate and Deactivate pipelines. (#1224) 2019-09-03 16:50:57 +05:30
Elek, Márton
4f5f46eb4a HDDS-1935. Improve the visibility with Ozone Insight tool (#1255) 2019-08-29 17:07:55 -07:00
Márton Elek
371c9eb6a6
Revert "HDDS-1596. Create service endpoint to download configuration from SCM." 
This reverts commit c0499bd704.
 2019-08-29 09:25:03 +02:00
Márton Elek
c0499bd704 HDDS-1596. Create service endpoint to download configuration from SCM. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-28 09:13:46 -07:00
Nanda kumar
2b9cc7eb95 HDDS-2037. Fix hadoop version in pom.ozone.xml. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-27 16:14:01 -07:00
avijayanhwx
28fb4b527a HDDS-2008 : Wrong package for RatisHelper class in hadoop-hdds/common module. (#1333) 2019-08-22 10:57:22 -07:00
Doroszlai, Attila
2ae7f444bd HDDS-1999. Basic acceptance test and SCM/OM web UI broken by Bootstrap upgrade (#1327) 2019-08-21 12:16:14 -07:00
avijayanhwx
e32f52c75f HDDS-1903 : Use dynamic ports for SCM in TestSCMClientProtocolServer … (#1303) 2019-08-18 10:08:38 -07:00
Aravindan Vijayan
fc229b6490 HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (Change to Error logging) 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 22:04:31 -07:00
Nanda kumar
69b74e9016 HDDS-1488. Scm cli command to start/stop replication manager. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 14:57:05 -07:00
Nanda kumar
397a5633af
HDDS-1888. Add containers to node2container map in SCM as part of ICR processing. 
Signed-off-by: Nanda kumar <nanda@apache.org>
 2019-08-08 15:22:03 +05:30
Sammi Chen
8f9245bc2d HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (#1184) 2019-08-07 16:59:13 -07:00
Nanda kumar
2662e20580
HDDS-1905. PipelineActionHandler is not closing the pipeline when close action is received. (#1227) 2019-08-06 14:36:04 +05:30
avijayanhwx
6e8c8413ee HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (#1200) 2019-08-02 22:31:00 +05:30
Sammi Chen
e111789aeb HDDS-1882. TestReplicationManager failed with NPE. (#1197) 2019-08-02 01:03:57 +05:30
Nanda kumar
2b1d8aedbb HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-25 14:25:39 -07:00
Nanda kumar
2546e6ece2 HDDS-1817. GetKey fails with IllegalArgumentException. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-24 15:59:30 -07:00
Doroszlai, Attila
278390f5bf HDDS-1710. Fix checkstyle errors 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-23 07:56:30 -07:00
Márton Elek
c533b79c32 HDDS-1710. Publish JVM metrics via Hadoop metrics 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 16:27:50 -07:00
Sammi Chen
69a46a95bb HDDS-1713. ReplicationManager fail to find proper node topology based… (#1112) 2019-07-19 15:45:26 -07:00
Doroszlai, Attila
d5ef38b093 HDDS-1822. NPE in SCMCommonPolicy.chooseDatanodes (#1120) 2019-07-18 13:28:03 -07:00
Xiaoyu Yao
eb0849b547 HDDS-1801. Make Topology Aware Replication/Read non-default for ozone 0.4.1. Contributed by Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-17 10:32:59 -07:00
Sammi Chen
493b0b5760 HDDS-1787. NPE thrown while trying to find DN closest to client. Contributed by Sammi Chen. (#1094) 2019-07-16 12:52:29 -07:00
Hrishikesh Gadre
14c43f85de HDDS-1752. ConcurrentModificationException while handling DeadNodeHandler event. (#1080) 2019-07-12 14:15:48 +05:30
supratimdeka
738fab3bff HDDS-1754. getContainerWithPipeline fails with PipelineNotFoundException. Contributed by Supratim Deka (#1081) 2019-07-12 10:31:48 +05:30
Nanda kumar
0f399b0d57
HDDS-1784. Missing HostName and IpAddress in the response of register command. 2019-07-11 19:01:06 +05:30
Hrishikesh Gadre
acef5e0cec HDDS-1201. Reporting corrupted containers info to SCM (#1032) 2019-07-11 14:49:58 +05:30
Xiaoyu Yao
030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen. 2019-07-09 14:43:55 -07:00
Mukul Kumar Singh
e5ffb88257 HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. (#1050) 
* HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.
 2019-07-08 20:24:12 -07:00
Lokesh Jain
b5d30e4914 HDDS-1750. Add block allocation metrics for pipelines in SCM. Contributed by Lokesh Jain. (#1047) 2019-07-09 08:42:55 +05:30
Mukul Kumar Singh
8b0d1adf31 HDDS-1616. ManagedChannel references are being leaked in while removing RaftGroup. Contributed by Mukul Kumar Singh. (#1039) 2019-07-02 14:34:49 -07:00
Elek, Márton
004207996c HDDS-1597. Remove hdds-server-scm dependency from ozone-common (#969) 
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.

* checkstyle fixes

* revert the import reorder of HddsUtil

* add javadoc

* switch back to the commons-lang2

* fix typo

* fix metrics core classpath problem (+rebase fix)
 2019-06-24 11:56:04 -07:00
Nanda kumar
b28ddb22a5 HDDS-1706. Replication Manager thread running too frequently. Contributed by Nilotpal Nandi. 2019-06-22 16:15:45 +05:30
supratimdeka
9d6842501c HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka (#852) 2019-06-19 20:11:16 +05:30
Márton Elek
e188bb12b0
HDDS-1694. TestNodeReportHandler is failing with NPE 
Closes #978
 2019-06-18 08:55:38 +02:00
Sammi Chen
1732312f45 HDDS-1663. Add datanode to network topology cluster during node regis… (#937) 2019-06-12 12:16:42 -07:00