big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,601 Commits 2 Branches 2 Tags 264 MiB
bf3751521b
Commit Graph

291 Commits

Author SHA1 Message Date
Aravindan Vijayan
fc229b6490 HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (Change to Error logging) 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 22:04:31 -07:00
Nanda kumar
69b74e9016 HDDS-1488. Scm cli command to start/stop replication manager. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 14:57:05 -07:00
Nanda kumar
397a5633af
HDDS-1888. Add containers to node2container map in SCM as part of ICR processing. 
Signed-off-by: Nanda kumar <nanda@apache.org>
 2019-08-08 15:22:03 +05:30
Sammi Chen
8f9245bc2d HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (#1184) 2019-08-07 16:59:13 -07:00
Nanda kumar
2662e20580
HDDS-1905. PipelineActionHandler is not closing the pipeline when close action is received. (#1227) 2019-08-06 14:36:04 +05:30
avijayanhwx
6e8c8413ee HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (#1200) 2019-08-02 22:31:00 +05:30
Sammi Chen
e111789aeb HDDS-1882. TestReplicationManager failed with NPE. (#1197) 2019-08-02 01:03:57 +05:30
Nanda kumar
2b1d8aedbb HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-25 14:25:39 -07:00
Nanda kumar
2546e6ece2 HDDS-1817. GetKey fails with IllegalArgumentException. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-24 15:59:30 -07:00
Doroszlai, Attila
278390f5bf HDDS-1710. Fix checkstyle errors 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-23 07:56:30 -07:00
Márton Elek
c533b79c32 HDDS-1710. Publish JVM metrics via Hadoop metrics 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 16:27:50 -07:00
Sammi Chen
69a46a95bb HDDS-1713. ReplicationManager fail to find proper node topology based… (#1112) 2019-07-19 15:45:26 -07:00
Doroszlai, Attila
d5ef38b093 HDDS-1822. NPE in SCMCommonPolicy.chooseDatanodes (#1120) 2019-07-18 13:28:03 -07:00
Xiaoyu Yao
eb0849b547 HDDS-1801. Make Topology Aware Replication/Read non-default for ozone 0.4.1. Contributed by Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-17 10:32:59 -07:00
Sammi Chen
493b0b5760 HDDS-1787. NPE thrown while trying to find DN closest to client. Contributed by Sammi Chen. (#1094) 2019-07-16 12:52:29 -07:00
Hrishikesh Gadre
14c43f85de HDDS-1752. ConcurrentModificationException while handling DeadNodeHandler event. (#1080) 2019-07-12 14:15:48 +05:30
supratimdeka
738fab3bff HDDS-1754. getContainerWithPipeline fails with PipelineNotFoundException. Contributed by Supratim Deka (#1081) 2019-07-12 10:31:48 +05:30
Nanda kumar
0f399b0d57
HDDS-1784. Missing HostName and IpAddress in the response of register command. 2019-07-11 19:01:06 +05:30
Hrishikesh Gadre
acef5e0cec HDDS-1201. Reporting corrupted containers info to SCM (#1032) 2019-07-11 14:49:58 +05:30
Xiaoyu Yao
030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen. 2019-07-09 14:43:55 -07:00
Mukul Kumar Singh
e5ffb88257 HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. (#1050) 
* HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.
 2019-07-08 20:24:12 -07:00
Lokesh Jain
b5d30e4914 HDDS-1750. Add block allocation metrics for pipelines in SCM. Contributed by Lokesh Jain. (#1047) 2019-07-09 08:42:55 +05:30
Mukul Kumar Singh
8b0d1adf31 HDDS-1616. ManagedChannel references are being leaked in while removing RaftGroup. Contributed by Mukul Kumar Singh. (#1039) 2019-07-02 14:34:49 -07:00
Elek, Márton
004207996c HDDS-1597. Remove hdds-server-scm dependency from ozone-common (#969) 
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.

* checkstyle fixes

* revert the import reorder of HddsUtil

* add javadoc

* switch back to the commons-lang2

* fix typo

* fix metrics core classpath problem (+rebase fix)
 2019-06-24 11:56:04 -07:00
Nanda kumar
b28ddb22a5 HDDS-1706. Replication Manager thread running too frequently. Contributed by Nilotpal Nandi. 2019-06-22 16:15:45 +05:30
supratimdeka
9d6842501c HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka (#852) 2019-06-19 20:11:16 +05:30
Márton Elek
e188bb12b0
HDDS-1694. TestNodeReportHandler is failing with NPE 
Closes #978
 2019-06-18 08:55:38 +02:00
Sammi Chen
1732312f45 HDDS-1663. Add datanode to network topology cluster during node regis… (#937) 2019-06-12 12:16:42 -07:00
S O'Donnell
85479577da
HDDS-1622. Use picocli for StorageContainerManager 
Closes #918
 2019-06-07 17:50:57 +02:00
Sammi Chen
8ca58efeec HDDS-1490. Support configurable container placement policy through 'o… (#903) 2019-06-06 12:14:47 -07:00
ChenSammi
0b1e288deb HDDS-1637. Fix random test failure TestSCMContainerPlacementRackAware. Contributed by Sammi Chen. (#904) 2019-06-05 09:09:36 -07:00
avijayanhwx
1a78794227 HDDS-1624 : Refactor operations inside the bucket lock in OM key write. (#882) 2019-06-04 15:41:37 -07:00
avijayanhwx
21de9af903 HDDS-1625 : ConcurrentModificationException when SCM has containers of different owners. (#883) 2019-06-04 01:15:04 +05:30
Márton Elek
2a97a37d9e
Revert "HDDS-1597. Remove hdds-server-scm dependency from ozone-common. (#860)" 
This reverts commit baee71551d.
 2019-06-03 08:34:19 +02:00
Elek, Márton
baee71551d HDDS-1597. Remove hdds-server-scm dependency from ozone-common. (#860) 2019-05-30 09:20:16 -07:00
Bharat Viswanadham
751f0df710 HDDS-1231. Add ChillMode metrics. Contributed by Bharat Viswanadham. 2019-05-29 20:55:44 +02:00
Akira Ajisaka
afd844059c HADOOP-16331. Fix ASF License check in pom.xml 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
 2019-05-29 17:25:13 +09:00
Bharat Viswanadham
b70d1be685 HDDS-1559. Fix TestReplicationManager. Contributed by Bharat Viswanadham. (#856) 2019-05-27 17:52:09 -07:00
Elek, Márton
ec92ca6575 HDDS-1598. Fix Ozone checkstyle issues on trunk. Contributed by Elek, Marton. (#854) 2019-05-27 14:40:51 -07:00
Akira Ajisaka
9f933e6446
HADOOP-16323. https everywhere in Maven settings. 2019-05-27 15:24:59 +09:00
Xiaoyu Yao
20a4ec351c HDDS-700. Support rack awared node placement policy based on network topology. Contributed by Sammi Chen. 2019-05-23 10:40:15 -07:00
Shashikant Banerjee
a315913c48 HDDS-1517. AllocateBlock call fails with ContainerNotFoundException (#826). Contributed by Shashikant Banerjee. 2019-05-22 17:24:27 +05:30
Bharat Viswanadham
77c49f2963
HDDS-1406. Avoid usage of commonPool in RatisPipelineUtils. (#714) 2019-05-21 18:41:30 -07:00
avijayanhwx
f63300228e HDDS-1451 : SCMBlockManager findPipeline and createPipeline are not lock protected. (#799) 
* HDDS-1451 : SCMBlockManager findPipeline and createPipeline are not lock protected.

* HDDS-1451 : Address review comments.
 2019-05-20 22:02:56 +02:00
Márton Elek
03ea8ea92e
HDDS-1297. Fix IllegalArgumentException thrown with MiniOzoneCluster Initialization. Contributed by Yiqun Lin. 2019-05-16 17:04:46 +02:00
avijayanhwx
f194540520 HDDS-1448 : RatisPipelineProvider should only consider open pipeline while excluding dn for pipeline allocation. (#786) 2019-05-04 00:19:00 +05:30
Márton Elek
e2f0f72677
HDDS-1469. Generate default configuration fragments based on annotations 
Closes #773
 2019-05-02 12:14:43 +02:00
Márton Elek
a2887f5c23
HDDS-1468. Inject configuration values to Java objects 
Closes #772
 2019-05-02 11:35:01 +02:00
Bharat Viswanadham
43b2a4b77b
HDDS-1456. Stop the datanode, when any datanode statemachine state is… (#769) 2019-04-26 14:25:34 -07:00
Siddharth
59ded7641f HDDS-1411. Add unit test to check if SCM correctly sends close commands for containers in closing state after a restart. (#755) 2019-04-23 21:04:14 +05:30