big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,623 Commits 2 Branches 2 Tags 264 MiB
1734ace35f
Commit Graph

88 Commits

Author SHA1 Message Date
Márton Elek
0123e5197b HDDS-164. Add unit test for HddsDatanodeService. Contributed by Yiqun Lin. 2018-11-20 15:49:48 +01:00
Nanda kumar
e7438a1b38 HDDS-849. Fix NPE in TestKeyValueHandler because of audit log write. 
Contributed by Dinesh Chitlangia.
 2018-11-19 22:47:43 +05:30
Nanda kumar
5a7ca6ac3e HDDS-837. Persist originNodeId as part of .container file in datanode. 
Contributed by Nanda kumar.
 2018-11-19 14:39:55 +05:30
Nanda kumar
c4d9640028 HDDS-801. Quasi close the container when close is not executed via Ratis. 
Contributed by Nanda kumar.
 2018-11-16 23:11:33 +05:30
Anu Engineer
a16aa2f60b HDDS-825. Code cleanup based on messages from ErrorProne. 
Contributed by Anu Engineer.
 2018-11-15 17:36:09 -08:00
Nanda kumar
9fe50b4991 HDDS-733. Create container if not exist, as part of chunk write. 
Contributed by Lokesh Jain.
 2018-11-10 00:08:17 +05:30
Shashikant Banerjee
942693bddd HDDS-799. Avoid ByteString to byte array conversion cost by using ByteBuffer in Datanode. Contributed by Mukul Kumar Singh. 2018-11-05 23:43:22 +05:30
Arpit Agarwal
08bb0362e0 HDDS-759. Create config settings for SCM and OM DB directories. Contributed by Arpit Agarwal. 2018-10-31 11:23:15 -07:00
Nanda kumar
e4f22b08e0 HDDS-755. ContainerInfo and ContainerReplica protobuf changes. 
Contributed by Nanda kumar.
 2018-10-31 10:29:35 +05:30
Anu Engineer
773f0d1519 HDDS-754. VolumeInfo#getScmUsed throws NPE. 
Contributed by Hanisha Koneru.
 2018-10-30 19:17:57 -07:00
Shashikant Banerjee
7757331dbc HDDS-749. Restructure BlockId class in Ozone. Contributed by Shashikant Banerjee. 2018-10-30 14:15:27 +05:30
Shashikant Banerjee
b61846392e HDDS-708. Validate BCSID while reading blocks from containers in datanodes. Contributed by Shashikant Banerjee. 2018-10-23 16:52:17 +05:30
Nanda kumar
c696419f3e Revert "HDDS-705. OS3Exception resource name should be the actual resource name." 
This reverts commit 977c6f6470.

There was spurious edit in this commit.
 2018-10-22 15:37:40 +05:30
Anu Engineer
7db3bb3ac1 HDDS-544. Unconditional wait findbug warning from ReplicationSupervisor. 
Contributed by Arpit Agarwal.
 2018-10-21 23:18:38 -07:00
Anu Engineer
977c6f6470 HDDS-705. OS3Exception resource name should be the actual resource name. 
Contributed by Bharat Viswanadham.
 2018-10-21 22:49:16 -07:00
Nandakumar
50715c0699 HDDS-662. Introduce ContainerReplicaState in StorageContainerManager. Contributed by Nanda kumar. 2018-10-17 17:45:35 +05:30
Jitendra Pandey
0bc6d0484a HDDS-550. Serialize ApplyTransaction calls per Container in ContainerStateMachine. Contributed by Shashikant Banerjee. 2018-10-11 17:12:47 -07:00
Nanda kumar
f7ff8c051e HDDS-325. Add event watcher for delete blocks command. Contributed by Lokesh Jain. 2018-10-01 13:50:17 +05:30
Anu Engineer
096a716080 HDDS-394. Rename *Key Apis in DatanodeContainerProtocol to *Block apis. 
Contributed Dinesh Chitlangia.
 2018-09-20 11:51:49 -07:00
Nanda kumar
042bf74d5e HDDS-460. Replication manager failed to import container data. Contributed by Elek, Marton. 2018-09-19 23:51:50 +05:30
Nanda kumar
c0956ee2a8 HDDS-476. Add Pipeline reports to make pipeline active on SCM restart. 
Contributed by Mukul Kumar Singh.
 2018-09-19 18:52:08 +05:30
Anu Engineer
a968ea4897 HDDS-440. Datanode loops forever if it cannot create directories. 
Contributed by Bharat Viswanadham.
 2018-09-18 14:31:50 -07:00
Anu Engineer
9c238ffc30 HDDS-432. Replication of closed containers is not working. 
Contributed by Elek, Marton.
 2018-09-11 17:00:04 -07:00
Nanda kumar
b9932162e9 HDDS-75. Support for CopyContainer. Contributed by Elek, Marton. 2018-09-04 23:41:50 +05:30
Anu Engineer
c5629d546d HDDS-382. Remove RatisTestHelper#RatisTestSuite constructor argument and fix checkstyle in ContainerTestHelper, GenericTestUtils 
Contributed by Nandakumar.
 2018-08-28 14:06:19 -07:00
Nanda kumar
12b2f362cc HDDS-374. Support to configure container size in units lesser than GB. Contributed by Nanda kumar. 2018-08-27 18:29:32 +05:30
Xiaoyu Yao
ca29fb754e HDDS-328. Support export and import of the KeyValueContainer. Contributed by Elek Marton. 2018-08-23 11:30:28 -07:00
Hanisha Koneru
5aa15cfaff HDDS-265. Move numPendingDeletionBlocks and deleteTransactionId from ContainerData to KeyValueContainerData. Contributed by LiXin Ge. 2018-08-22 10:04:15 -07:00
Hanisha Koneru
d81cd3611a HDDS-267. Handle consistency issues during container update/close. 2018-08-08 16:47:25 -07:00
Nanda kumar
db465afb5c HDDS-300. Create a config for volume choosing policy. Contributed by Bharat Viswanadham. 2018-08-03 14:53:04 +05:30
Xiaoyu Yao
40ab8ee597 HDDS-312. Add blockIterator to Container. Contributed by Bharat Viswanadham. 2018-08-02 16:48:21 -07:00
Bharat Viswanadham
c835fc08ad HDDS-271. Create a block iterator to iterate blocks in a container. Contributed by Bharat Viswanadham. 2018-07-31 16:26:09 -07:00
Nanda kumar
7631e0adae HDDS-305. Datanode StateContext#addContainerActionIfAbsent will add container action even if there already is a ContainerAction. Contributed by Nanda kumar. 2018-07-31 17:27:51 +05:30
Nanda kumar
3517a47897 HDDS-287. Add Close ContainerAction to Datanode#StateContext when the container gets full. Contributed by Nanda kumar. 2018-07-30 21:18:42 +05:30
Bharat Viswanadham
007e6f5113 HDDS-248. Refactor DatanodeContainerProtocol.proto Contributed by Hanisha Koneru. 2018-07-28 14:57:11 -07:00
Anu Engineer
3cc7ce816e HDDS-270. Move generic container util functions to ContianerUtils. 
Contributed by Hanisha Koneru.
 2018-07-27 07:12:21 -07:00
Nanda kumar
b507f83e15 HDDS-266. Integrate checksum into .container file. Contributed by Hanisha Koneru. 2018-07-25 18:55:26 +05:30
Mukul Kumar Singh
773d312f74 HDDS-272. TestBlockDeletingService is failing with DiskOutOfSpaceException. Contributed by Lokesh Jain. 2018-07-24 21:23:20 +05:30
Nanda kumar
16f9aee5f5 HDDS-262. Send SCM healthy and failed volumes in the heartbeat. Contributed by Bharat Viswanadham. 2018-07-24 12:09:15 +05:30
Xiaoyu Yao
3a9e25edf5 HDDS-199. Implement ReplicationManager to handle underreplication of closed containers. Contributed by Elek Marton. 2018-07-23 10:28:33 -07:00
Nanda kumar
9fa9e301b0 HDDS-249. Fail if multiple SCM IDs on the DataNode and add SCM ID check after version request. Contributed by Bharat Viswanadham. 2018-07-21 18:46:31 +05:30
Xiaoyu Yao
347c955013 HDDS-260. Support in Datanode for sending ContainerActions to SCM. Contributed by Nanda kumar. 2018-07-20 14:37:13 -07:00
Xiaoyu Yao
d2acf8d560 Revert "HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh." 
This reverts commit 6837121a43231f854b0b22ad20330012439313ce.(Mixed with HDDS-260)
 2018-07-20 14:20:18 -07:00
Xiaoyu Yao
6837121a43 HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh. 2018-07-20 13:03:35 -07:00
Bharat Viswanadham
ba25d27ddb HDDS-257. Hook up VolumeSet#shutdown from HddsDispatcher#shutdown. Contributed by Hanisha Koneru 2018-07-20 12:41:52 -07:00
Hanisha Koneru
de894d34f6 HDDS-250. Cleanup ContainerData. 2018-07-20 11:36:42 -07:00
Xiaoyu Yao
68b57ad32c HDDS-259. Implement ContainerReportPublisher and NodeReportPublisher. Contributed by Nanda kumar. 2018-07-20 09:12:48 -07:00
Xiaoyu Yao
d5d444732b HDDS-241. Handle Volume in inconsistent state. Contributed by Hanisha Koneru. 2018-07-18 09:38:43 -07:00
Nanda kumar
d18507209e HDDS-232. Parallel unit test execution for HDDS/Ozone. Contributed by Arpit Agarwal. 2018-07-13 19:50:52 +05:30
Anu Engineer
f89e265905 HDDS-187. Command status publisher for datanode. 
Contributed by Ajay Kumar.
 2018-07-12 21:35:12 -07:00