big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,302 Commits 2 Branches 2 Tags 264 MiB
3c1fe073d2
Commit Graph

124 Commits

Author SHA1 Message Date
Nandakumar
5c8e023ba3 HDDS-587. Add new classes for pipeline management. Contributed by Lokesh Jain. 2018-10-13 03:22:20 +05:30
Bharat Viswanadham
74db993a61 HDDS-609. On restart, SCM does not exit chill mode as it expects DNs to report containers in ALLOCATED state. Contributed by Hanisha Koneru. 2018-10-11 21:03:01 -07:00
Hanisha Koneru
eb34b5f8af HDDS-601. On restart, SCM throws 'No such datanode' exception. 2018-10-11 13:20:32 -07:00
Nanda kumar
90552b1ea8 HDDS-608. Access denied exception for user hdfs while making getContainerWithPipeline call. Contributed by Mukul Kumar Singh. 2018-10-10 20:50:49 +05:30
Akira Ajisaka
6fa3feb577
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter. 2018-10-10 10:16:57 +09:00
Bharat Viswanadham
6a39739316 HDDS-583. SCM returns zero as the return code, even when invalid options are passed. Contributed by Namit Maheshwari. 2018-10-09 15:21:19 -07:00
Márton Elek
600438bcde HDDS-602. Bump Ozone version to 0.4.0-SNAPSHOT after ozone-0.3 branch cut. 2018-10-09 19:04:25 +02:00
Ajay Kumar
cdf5d58364 HDDS-571. Update SCM chill mode exit criteria to optionally wait for n datanodes. Contributed by Ajay Kumar. 2018-10-05 14:07:16 -07:00
Nanda kumar
f362037527 HDDS-575. LoadExistingContainers should be moved to SCMContainerManager from ContainerStateManager. Contributed by Mukul Kumar Singh. 2018-10-05 16:47:01 +05:30
Nanda kumar
095c269620 HDDS-567. Rename Mapping to ContainerManager in SCM. Contributed by Nanda kumar. 2018-10-03 16:00:39 +05:30
Nanda kumar
7b374482d2 HDDS-526. Clean previous chill mode code from NodeManager. Contributed by Ajay Kumar. 2018-10-03 15:15:43 +05:30
Nanda kumar
a39296260f HDDS-561. Move Node2ContainerMap and Node2PipelineMap to NodeManager. Contributed by Lokesh Jain. 2018-10-02 19:47:44 +05:30
Ajay Kumar
cc80ac2315 HDDS-557. DeadNodeHandler should handle exception from removeContainerHandler api. Contributed by Ajay Kumar. 2018-10-01 11:21:26 -07:00
Nanda kumar
f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Ajay Kumar
3c798c1e3c HDDS-448. Move NodeStat to NodeStatemanager from SCMNodeManager. Contributed by LiXin Ge. 2018-09-28 10:33:17 -07:00
Ajay Kumar
184544eff8 HDDS-401. Update storage statistics on dead node. Contributed by LiXin Ge. 2018-09-27 09:56:30 -07:00
Ajay Kumar
3928af983e HDDS-370. Add and implement following functions in SCMClientProtocolServer. Contributed by Ajay Kumar. 2018-09-25 13:08:44 -07:00
Bharat Viswanadham
62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00
Nanda kumar
236d16e3a5 HDDS-507. EventQueue should be shutdown on SCM shutdown. Contributed by Xiaoyu Yao. 2018-09-20 01:22:18 +05:30
Nanda kumar
61a4b07bda HDDS-461. Container remains in CLOSING state in SCM forever. Contributed by Shashikant Banerjee. 2018-09-19 21:43:44 +05:30
Márton Elek
b3c5221f30 HDDS-458. numberofKeys is 0 for all containers even when keys are present. Contributed by LiXin Ge. 
(cherry picked from commit 8600b049af184af04dfb93b6bc353740e3e821d3)
 2018-09-19 17:11:05 +02:00
Nanda kumar
15ed74fa24 HDDS-502. Exception in OM startup when running unit tests. Contributed by Arpit Agarwal. 2018-09-19 19:46:25 +05:30
Nanda kumar
c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart. 
Contributed by Mukul Kumar Singh.
 2018-09-19 18:52:08 +05:30
Xiaoyu Yao
e435e12f1f HDDS-506. Fields in AllocateScmBlockResponseProto should be optional. Contributed by Arpit Agarwal. 2018-09-18 23:21:29 -07:00
Xiaoyu Yao
295cce39ed HDDS-366. Update functions impacted by SCM chill mode in StorageContainerLocationProtocol. Contributed by Ajay Kumar. 2018-09-18 13:32:48 -07:00
Anu Engineer
23a6137a40 HDDS-475. Block Allocation returns same BlockID on different keys creation. 
Contributed by Nanda Kumar.
 2018-09-17 14:41:17 -07:00
Nanda kumar
846936698b HDDS-399. Persist open pipeline information across SCM restart. Contributed by Mukul Kumar Singh. 2018-09-17 21:51:54 +05:30
Xiaoyu Yao
95231f1749 HDDS-362. Modify functions impacted by SCM chill mode in ScmBlockLocationProtocol. Contributed by Ajay Kumar. 2018-09-16 17:55:46 -07:00
Nanda kumar
c9fa081897 HDDS-462. Optimize ContainerStateMap#getMatchingContainerIDs in SCM. Contributed by Nanda kumar. 2018-09-15 23:11:39 +05:30
Márton Elek
a65c3ea91c HDDS-449. Add a NULL check to protect DeadNodeHandler#onMessage. Contributed by LiXin Ge. 2018-09-15 13:35:21 +02:00
Nanda kumar
b0a659c8c0 HDDS-466. Handle null in argv of StorageContainerManager#createSCM. Contributed by Nanda kumar 2018-09-15 02:34:33 +05:30
Jitendra Pandey
446cb8301e HDDS-452. 'ozone scm' with incorrect argument first logs all the STARTUP_MSG. Contributed by Namit Maheshwari. 2018-09-14 11:39:36 -07:00
Anu Engineer
0c8a43b9ec HDDS-429. StorageContainerManager lock optimization. 
Contributed by Nanda Kumar.
 2018-09-14 10:08:06 -07:00
Mukul Kumar Singh
c6e19db197 HDDS-420. putKey failing with KEY_ALLOCATION_ERROR. Contributed by Shashikant Banerjee. 2018-09-13 11:29:40 +05:30
Anu Engineer
64c7a12b57 HDDS-436. Allow SCM chill mode to be disabled by configuration. 
Contributed by Ajay Kumar.
 2018-09-12 11:40:24 -07:00
Anu Engineer
9c238ffc30 HDDS-432. Replication of closed containers is not working. 
Contributed by Elek, Marton.
 2018-09-11 17:00:04 -07:00
Anu Engineer
8ffbbf51c9 HDDS-431. LeaseManager of CommandWatcher is not started. 
Contributed by Elek, Marton.
 2018-09-11 10:44:47 -07:00
Anu Engineer
7b5886bf78 HDDS-222. Remove hdfs command line from ozone distribution. 
Contributed by Elek, Marton.
 2018-09-11 10:19:50 -07:00
Hanisha Koneru
ab90248b30 HDDS-400. Check global replication state for containers of dead node. Contributed by Elek, Marton. 2018-09-07 11:20:25 -07:00
Anu Engineer
ff64d35716 HDDS-351. Add chill mode state to SCM. 
Contributed by Ajay Kumar.
 2018-09-07 10:54:35 -07:00
Márton Elek
94ed5cffd7 HDDS-214. Bump ozone/hdds version after the release branch cut 2018-09-07 17:45:26 +02:00
Tsz Wo Nicholas Sze
b3161c4dd9 HDDS-297. Add pipeline actions in Ozone. Contributed by Mukul Kumar Singh and Shashikant Banerjee 2018-09-06 14:35:07 -07:00
Xiaoyu Yao
8286bf2d1f HDDS-303. Removing logic to identify containers to be closed from SCM. Contributed by Nanda kumar. 2018-09-05 12:26:37 -07:00
Xiaoyu Yao
85c3fe341a HDDS-268. Add SCM close container watcher. Contributed by Ajay Kumar. 2018-09-04 22:56:57 -07:00
Hanisha Koneru
9964e33e8d HDDS-369. Remove the containers of a dead node from the container state map. Contributed by Elek, Marton 2018-09-04 14:57:54 -07:00
Nanda kumar
567b5558d5 HDDS-343. Containers are stuck in closing state in scm. Contributed by Elek, Marton. 2018-09-03 20:14:45 +05:30
Anu Engineer
c5629d546d HDDS-382. Remove RatisTestHelper#RatisTestSuite constructor argument and fix checkstyle in ContainerTestHelper, GenericTestUtils 
Contributed by Nandakumar.
 2018-08-28 14:06:19 -07:00
Xiaoyu Yao
c9b63956d9 HDSS-375. ContainerReportHandler should not send replication events for open containers. Contributed by Ajay Kumar. 2018-08-27 10:40:33 -07:00
Márton Elek
a5eba25506 HDDS-364. Update open container replica information in SCM during DN register. Contributed by Ajay Kumar. 2018-08-24 22:42:51 +02:00
Márton Elek
138b0c1443 HDDS-363. Faster datanode registration during the first startup. Contributed by Elek, Marton. 2018-08-24 15:36:10 +02:00