big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
19,565 Commits 2 Branches 2 Tags 264 MiB
b507f83e15
Commit Graph

95 Commits

Author SHA1 Message Date
Nanda kumar
b507f83e15 HDDS-266. Integrate checksum into .container file. Contributed by Hanisha Koneru. 2018-07-25 18:55:26 +05:30
Mukul Kumar Singh
955f795101 HDDS-203. Add getCommittedBlockLength API in datanode. Contributed by Shashikant Banerjee. 2018-07-25 14:15:54 +05:30
Xiaoyu Yao
cd0b9f1380 HDDS-282. Consolidate logging in scm/container-service. Contributed by Elek Marton. 2018-07-24 10:17:03 -07:00
Mukul Kumar Singh
773d312f74 HDDS-272. TestBlockDeletingService is failing with DiskOutOfSpaceException. Contributed by Lokesh Jain. 2018-07-24 21:23:20 +05:30
Nanda kumar
16f9aee5f5 HDDS-262. Send SCM healthy and failed volumes in the heartbeat. Contributed by Bharat Viswanadham. 2018-07-24 12:09:15 +05:30
Xiaoyu Yao
3a9e25edf5 HDDS-199. Implement ReplicationManager to handle underreplication of closed containers. Contributed by Elek Marton. 2018-07-23 10:28:33 -07:00
Mukul Kumar Singh
bbe2f6225e HDDS-181. CloseContainer should commit all pending open Keys on a datanode. Contributed by Shashikant Banerjee. 2018-07-23 09:13:03 +05:30
Nanda kumar
9fa9e301b0 HDDS-249. Fail if multiple SCM IDs on the DataNode and add SCM ID check after version request. Contributed by Bharat Viswanadham. 2018-07-21 18:46:31 +05:30
Xiaoyu Yao
347c955013 HDDS-260. Support in Datanode for sending ContainerActions to SCM. Contributed by Nanda kumar. 2018-07-20 14:37:13 -07:00
Xiaoyu Yao
d2acf8d560 Revert "HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh." 
This reverts commit 6837121a43231f854b0b22ad20330012439313ce.(Mixed with HDDS-260)
 2018-07-20 14:20:18 -07:00
Xiaoyu Yao
6837121a43 HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh. 2018-07-20 13:03:35 -07:00
Bharat Viswanadham
ba25d27ddb HDDS-257. Hook up VolumeSet#shutdown from HddsDispatcher#shutdown. Contributed by Hanisha Koneru 2018-07-20 12:41:52 -07:00
Hanisha Koneru
de894d34f6 HDDS-250. Cleanup ContainerData. 2018-07-20 11:36:42 -07:00
Xiaoyu Yao
68b57ad32c HDDS-259. Implement ContainerReportPublisher and NodeReportPublisher. Contributed by Nanda kumar. 2018-07-20 09:12:48 -07:00
Nanda kumar
e9c44ecfc6 HDDS-269. Refactor IdentifiableEventPayload to use a long ID. Contributed by Ajay Kumar. 2018-07-20 21:39:45 +05:30
Xiaoyu Yao
d5d444732b HDDS-241. Handle Volume in inconsistent state. Contributed by Hanisha Koneru. 2018-07-18 09:38:43 -07:00
Bharat Viswanadham
0927bc4f76 HDDS-251. Integrate BlockDeletingService in KeyValueHandler. Contributed by Lokesh Jain 2018-07-15 10:34:00 -07:00
Nanda kumar
d18507209e HDDS-232. Parallel unit test execution for HDDS/Ozone. Contributed by Arpit Agarwal. 2018-07-13 19:50:52 +05:30
Anu Engineer
f89e265905 HDDS-187. Command status publisher for datanode. 
Contributed by Ajay Kumar.
 2018-07-12 21:35:12 -07:00
Bharat Viswanadham
c275a9a6a0 Merge trunk into HDDS-48 2018-07-09 12:13:03 -07:00
Hanisha Koneru
44e19fc7f7 HDDS-213. Single lock to synchronize KeyValueContainer#update. 2018-07-09 09:33:09 -07:00
Bharat Viswanadham
cb9574a337 HDDS-237. Add updateDeleteTransactionId. Contributed by Bharat Viswanadham and Lokesh Jain 2018-07-06 16:26:40 -07:00
Bharat Viswanadham
e899c4cc01 HDDS-211. Add a create container Lock. Contributed by Bharat Viswanadham 2018-07-06 15:02:40 -07:00
Bharat Viswanadham
7dcf5878a4 HDDS-204. Modify Integration tests for new ContainerIO classes. Contributed by Bharat Viswanadham 2018-07-06 11:01:33 -07:00
Bharat Viswanadham
2c2351e87b HDDS-182:CleanUp Reimplemented classes. Contributed by Hansiha Koneru 2018-07-05 15:23:39 -07:00
Bharat Viswanadham
a404164939 HDDS-229:Remove singleton for Handler. Contributed by Bharat Viswanadham 2018-07-05 11:26:00 -07:00
Nanda kumar
71df8c27c9 HDDS-212. Introduce NodeStateManager to manage the state of Datanodes in SCM. Contributed by Nanda kumar. 2018-07-05 02:11:10 +05:30
Hanisha Koneru
e1f4b3b560 HDDS-176. Add keyCount and container maximum size to ContainerData. Contributed by Bharat Viswanadham. 2018-07-03 09:53:41 -07:00
Hanisha Koneru
44b091a8d7 HDDS-205. Add metrics to HddsDispatcher. Contributed by Bharat Viswanadham. 2018-07-03 09:50:25 -07:00
Bharat Viswanadham
23ebe0f4f0 HDDS-169:Add Volume IO Stats. Contributed by Bharat Viswanadham 2018-06-28 17:10:10 -07:00
Nanda kumar
e4d7227aad HDDS-178: DN should update transactionId on block delete. Contributed by Lokesh Jain. 2018-06-29 04:37:16 +05:30
Bharat Viswanadham
c104525168 Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48 2018-06-28 14:28:23 -07:00
Bharat Viswanadham
52d1d9603e HDDS-183:Integrate Volumeset, ContainerSet and HddsDispatcher. Contributed by Bharat Viswanadham 2018-06-28 14:07:52 -07:00
Hanisha Koneru
13579f9296 HDDS-173. Refactor Dispatcher and implement Handler for new ContainerIO design. 2018-06-28 10:13:30 -07:00
Anu Engineer
18932717c4 HDDS-94. Change ozone datanode command to start the standalone datanode plugin. 
Contributed by  Sandeep Nemuri.
 2018-06-27 14:15:15 -07:00
Xiaoyu Yao
1e30547642 HDDS-170. Fix TestBlockDeletingService#testBlockDeletionTimeout. Contributed by Lokesh Jain. 2018-06-27 13:56:45 -07:00
Xiaoyu Yao
e9ec3d78f5 HDDS-186. Create under replicated queue. Contributed by Ajay Kumar. 2018-06-27 13:35:30 -07:00
Xiaoyu Yao
0d6fe5f36b Revert "HDDS-194. Remove NodePoolManager and node pool handling from SCM. Contributed by Elek Marton" 
This reverts commit aaf03cc459.
 2018-06-27 13:25:45 -07:00
Xiaoyu Yao
aaf03cc459 HDDS-194. Remove NodePoolManager and node pool handling from SCM. Contributed by Elek Marton 2018-06-27 12:39:15 -07:00
Bharat Viswanadham
238fe00ad2 HDDS-192:Create new SCMCommand to request a replication of a container. Contributed by Elek Marton 2018-06-25 21:12:05 -07:00
Anu Engineer
a55d6bba71 HDDS-191. Queue SCMCommands via EventQueue in SCM. 
Contributed by Elek, Marton.
 2018-06-25 13:05:22 -07:00
Bharat Viswanadham
ca192cb7c9 HDDS-160:Refactor KeyManager, ChunkManager. Contributed by Bharat Viswanadham 2018-06-15 14:35:33 -07:00
Bharat Viswanadham
998e2850a3 HDDS-155:Implement KeyValueContainer and adopt new disk layout for the containers. Contributed by Bharat Viswanadham 2018-06-14 20:54:54 -07:00
Hanisha Koneru
9a5552bf76 HDDS-156. Implement HDDSVolume to manage volume state 2018-06-14 13:28:41 -07:00
Arpit Agarwal
418cff4820 Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48 2018-06-14 09:38:20 -07:00
Anu Engineer
ddd09d59f3 HDDS-163. Add Datanode heartbeat dispatcher in SCM. 
Contributed by Nandakumar.
 2018-06-13 20:18:22 -07:00
Anu Engineer
7547740e5c HDDS-161. Add functionality to queue ContainerClose command from SCM Heartbeat Response to Ratis. 
Contributed by Shashikant Banerjee.
 2018-06-13 18:48:59 -07:00
Mukul Kumar Singh
aa7614c5f3 HDDS-158. DatanodeStateMachine endPoint task throws NullPointerException. Contributed by Nanda Kumar. 2018-06-12 20:36:23 +05:30
Xiaoyu Yao
23bfd9f7e4 HDDS-72. Add deleteTransactionId field in ContainerInfo. Contributed by Lokesh Jain. 2018-06-11 16:02:32 -07:00
Bharat Viswanadham
7e228e54c5 HDDS-136:Rename dbPath,containerFilePath. Contributed by Bharat Viswanadham 2018-06-11 13:14:03 -07:00