big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
19,796 Commits 2 Branches 2 Tags 264 MiB
e3d73bbc24
Commit Graph

155 Commits

Author SHA1 Message Date
Mukul Kumar Singh
e3d73bbc24 HDDS-353. Multiple delete Blocks tests are failing consistently. Contributed by Lokesh Jain. 2018-08-20 13:37:58 +05:30
Anu Engineer
ab37423ad8 HDDS-355. Disable OpenKeyDeleteService and DeleteKeysService. 
Contributed by Anu Engineer.
 2018-08-17 11:50:46 -07:00
Xiaoyu Yao
9dd5d5ba71 HDDS-218. add existing docker-compose files to the ozone release artifact. Contributed by Elek Marton. 2018-08-17 07:58:24 -07:00
Xiaoyu Yao
2d13e410d8 HDDS-119. Skip Apache license header check for some ozone doc scripts. Contributed by Ajay Kumar. 2018-08-16 22:18:52 -07:00
Mukul Kumar Singh
5ef29087ad HDDS-179. CloseContainer/PutKey command should be syncronized with write operations. Contributed by Shashikant Banerjee. 2018-08-16 23:35:19 +05:30
Anu Engineer
d951af22b4 HADOOP-15552. Addendum patch to fix the build break in Ozone File system. 
Contributed by Anu Engineer.
 2018-08-15 10:58:29 -07:00
Anu Engineer
c918d88a9b Revert "HDDS-119:Skip Apache license header check for some ozone doc scripts. Contributed by Ajay Kumar" 
This reverts commit c4bbcd5634.
 2018-08-15 10:06:17 -07:00
Xiaoyu Yao
f2315f2e9c HDDS-347. TestCloseContainerByPipeline#testCloseContainerViaStandaAlone sometimes fails. Contributed by Lixin Ge. 2018-08-15 08:11:17 -07:00
Xiaoyu Yao
b4031a8f1b HDDS-324. Use pipeline name as Ratis groupID to allow datanode to report pipeline info. Contributed by Mukul Kumar Singh. 2018-08-13 12:47:49 -07:00
Anu Engineer
11daa010d2 HDDS-346. ozoneShell show the new volume info after updateVolume command like updateBucket command. 
Contributed by chencan.
 2018-08-13 10:08:58 -07:00
Mukul Kumar Singh
a8dae0047c HDDS-308. SCM should identify a container with pending deletes using container reports. Contributed by Lokesh Jain. 2018-08-13 12:47:52 +05:30
Mukul Kumar Singh
398d895543 HDDS-339. Add block length and blockId in PutKeyResponse. Contributed by Shashikant Banerjee. 2018-08-10 23:45:56 +05:30
Márton Elek
3d96bc6e5f HDDS-219. Genearate version-info.properties for hadoop and ozone. Contributed by Sandeep Nemuri. 2018-08-09 11:06:03 +02:00
Hanisha Koneru
d81cd3611a HDDS-267. Handle consistency issues during container update/close. 2018-08-08 16:47:25 -07:00
Mukul Kumar Singh
6ed8593d18 HDDS-301. ozone command shell does not contain subcommand to run ozoneFS commands. Contributed by Nilotpal Nandi. 2018-08-07 16:09:53 +05:30
Mukul Kumar Singh
900c0e114f HDDS-230. ContainerStateMachine should implement readStateMachineData api to read data from Containers if required during replication. Contributed by Mukul Kumar Singh. 2018-08-07 15:03:14 +05:30
Nanda kumar
e83719c830 HDDS-290. putKey is failing with KEY_ALLOCATION_ERROR. Contributed by Xiaoyu Yao. 2018-08-02 19:02:25 +05:30
Mukul Kumar Singh
f4db753bb6 HDDS-226. Client should update block length in OM while committing the key. Contributed by Shashikant Banerjee. 2018-08-01 09:03:00 +05:30
Mukul Kumar Singh
b28bdc7e8b HDDS-279. DeleteBlocks command should not be sent for open containers. Contributed by Lokesh Jain. 2018-07-31 19:50:40 +05:30
Tsz Wo Nicholas Sze
ee53602a81 HDDS-293. Reduce memory usage and object creation in KeyData. 2018-07-30 15:00:29 -07:00
Nanda kumar
3517a47897 HDDS-287. Add Close ContainerAction to Datanode#StateContext when the container gets full. Contributed by Nanda kumar. 2018-07-30 21:18:42 +05:30
Bharat Viswanadham
007e6f5113 HDDS-248. Refactor DatanodeContainerProtocol.proto Contributed by Hanisha Koneru. 2018-07-28 14:57:11 -07:00
Mukul Kumar Singh
6b038f82da HDDS-246. Datanode should throw BlockNotCommittedException for uncommitted blocks to Ozone Client. Contributed by Shashikant Banerjee. 2018-07-28 22:04:11 +05:30
Anu Engineer
3cc7ce816e HDDS-270. Move generic container util functions to ContianerUtils. 
Contributed by Hanisha Koneru.
 2018-07-27 07:12:21 -07:00
Xiaoyu Yao
fd31cb6cfe HDDS-277. PipelineStateMachine should handle closure of pipelines in SCM. Contributed by Mukul Kumar Singh. 2018-07-26 13:15:55 -07:00
Nanda kumar
3c4fbc635e HDDS-288. Fix bugs in OpenContainerBlockMap. Contributed by Tsz Wo Nicholas Sze. 2018-07-25 20:27:03 +05:30
Nanda kumar
b507f83e15 HDDS-266. Integrate checksum into .container file. Contributed by Hanisha Koneru. 2018-07-25 18:55:26 +05:30
Mukul Kumar Singh
955f795101 HDDS-203. Add getCommittedBlockLength API in datanode. Contributed by Shashikant Banerjee. 2018-07-25 14:15:54 +05:30
Mukul Kumar Singh
773d312f74 HDDS-272. TestBlockDeletingService is failing with DiskOutOfSpaceException. Contributed by Lokesh Jain. 2018-07-24 21:23:20 +05:30
Xiaoyu Yao
2ced3efe94 HDDS-258. Helper methods to generate NodeReport and ContainerReport for testing. Contributed by Nanda Kumar. 2018-07-23 22:04:20 -07:00
Mukul Kumar Singh
bbe2f6225e HDDS-181. CloseContainer should commit all pending open Keys on a datanode. Contributed by Shashikant Banerjee. 2018-07-23 09:13:03 +05:30
Xiaoyu Yao
9be25e3476 HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh. 2018-07-20 14:22:02 -07:00
Xiaoyu Yao
d2acf8d560 Revert "HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh." 
This reverts commit 6837121a43231f854b0b22ad20330012439313ce.(Mixed with HDDS-260)
 2018-07-20 14:20:18 -07:00
Xiaoyu Yao
c7ae55675e HDDS-275. Add message output for succeeded -deleteVolume CLI. Contributed by Nilotpal Nandi. 2018-07-20 13:12:53 -07:00
Xiaoyu Yao
6837121a43 HDDS-239. Add PipelineStateManager to track pipeline state transition. Contributed by Mukul Kumar Singh. 2018-07-20 13:03:35 -07:00
Hanisha Koneru
de894d34f6 HDDS-250. Cleanup ContainerData. 2018-07-20 11:36:42 -07:00
Mukul Kumar Singh
5c19ee3994 HDDS-264. 'oz' subcommand reference is not present in 'ozone' command help. Contributed by Sandeep Nemuri. 2018-07-20 22:13:09 +05:30
Xiaoyu Yao
68b57ad32c HDDS-259. Implement ContainerReportPublisher and NodeReportPublisher. Contributed by Nanda kumar. 2018-07-20 09:12:48 -07:00
Xiaoyu Yao
c492eaccc2 HDDS-255. Fix TestOzoneConfigurationFields for missing hdds.command.status.report.interval in config classes. Contributed by Sandeep Nemuri. 2018-07-18 11:46:26 -07:00
Xiaoyu Yao
129269f989 HDDS-207. ozone listVolume command accepts random values as argument. Contributed by Lokesh Jain. 2018-07-18 11:05:42 -07:00
Bharat Viswanadham
5074ca93af HDDS-254. Fix TestStorageContainerManager#testBlockDeletingThrottling. Contributed by Lokesh Jain 2018-07-15 10:47:20 -07:00
Bharat Viswanadham
0927bc4f76 HDDS-251. Integrate BlockDeletingService in KeyValueHandler. Contributed by Lokesh Jain 2018-07-15 10:34:00 -07:00
Xiaoyu Yao
103f2eeb57 HDDS-210. Make "-file" argument optional for ozone getKey command. Contributed by Lokesh Jain. 2018-07-13 11:45:02 -07:00
Nanda kumar
d18507209e HDDS-232. Parallel unit test execution for HDDS/Ozone. Contributed by Arpit Agarwal. 2018-07-13 19:50:52 +05:30
Nanda kumar
1fe5b93843 HDDS-253. SCMBlockDeletingService should publish events for delete blocks to EventQueue. Contributed by Lokesh Jain. 2018-07-13 17:18:42 +05:30
Xiaoyu Yao
3f3f72221f HDDS-238. Add Node2Pipeline Map in SCM to track ratis/standalone pipelines. Contributed by Mukul Kumar Singh. 2018-07-12 22:14:03 -07:00
Anu Engineer
5ee90efed3 HDDS-228. Add the ReplicaMaps to ContainerStateManager. 
Contributed by Ajay Kumar.
 2018-07-12 10:43:24 -07:00
Anu Engineer
b56785873a Revert "HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event" 
This reverts commit a47ec5dac4.
There was a spurious file in this commit. Revert to clean it.
 2018-07-11 12:03:42 -07:00
Anu Engineer
a47ec5dac4 HDDS-242. Introduce NEW_NODE, STALE_NODE and DEAD_NODE event 
and corresponding event handlers in SCM.
Contributed by Nanda Kumar.
 2018-07-10 15:58:47 -07:00
Xiaoyu Yao
4e59b92784 HDDS-208. ozone createVolume command ignores the first character of the volume name argument. Contributed by Lokesh Jain. 2018-07-10 14:07:23 -07:00