big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,074 Commits 2 Branches 2 Tags 264 MiB
d1714c20e9
Commit Graph

274 Commits

Author SHA1 Message Date
Bharat Viswanadham
0927bc4f76 HDDS-251. Integrate BlockDeletingService in KeyValueHandler. Contributed by Lokesh Jain 2018-07-15 10:34:00 -07:00
Xiaoyu Yao
103f2eeb57 HDDS-210. Make "-file" argument optional for ozone getKey command. Contributed by Lokesh Jain. 2018-07-13 11:45:02 -07:00
Nanda kumar
1fe5b93843 HDDS-253. SCMBlockDeletingService should publish events for delete blocks to EventQueue. Contributed by Lokesh Jain. 2018-07-13 17:18:42 +05:30
Xiaoyu Yao
3f3f72221f HDDS-238. Add Node2Pipeline Map in SCM to track ratis/standalone pipelines. Contributed by Mukul Kumar Singh. 2018-07-12 22:14:03 -07:00
Anu Engineer
5ee90efed3 HDDS-228. Add the ReplicaMaps to ContainerStateManager. 
Contributed by Ajay Kumar.
 2018-07-12 10:43:24 -07:00
Xiaoyu Yao
4e59b92784 HDDS-208. ozone createVolume command ignores the first character of the volume name argument. Contributed by Lokesh Jain. 2018-07-10 14:07:23 -07:00
Bharat Viswanadham
3584baf264 HDDS-48. Fix branch after merging from trunk. 2018-07-09 13:22:30 -07:00
Bharat Viswanadham
c275a9a6a0 Merge trunk into HDDS-48 2018-07-09 12:13:03 -07:00
Arpit Agarwal
061b168529 HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal. 2018-07-06 12:09:05 -07:00
Bharat Viswanadham
7dcf5878a4 HDDS-204. Modify Integration tests for new ContainerIO classes. Contributed by Bharat Viswanadham 2018-07-06 11:01:33 -07:00
Bharat Viswanadham
2c2351e87b HDDS-182:CleanUp Reimplemented classes. Contributed by Hansiha Koneru 2018-07-05 15:23:39 -07:00
Nanda kumar
71df8c27c9 HDDS-212. Introduce NodeStateManager to manage the state of Datanodes in SCM. Contributed by Nanda kumar. 2018-07-05 02:11:10 +05:30
Anu Engineer
7ca4f0cefa HDDS-175. Refactor ContainerInfo to remove Pipeline object from it. 
Contributed by Ajay Kumar.
 2018-07-03 14:11:52 -07:00
Hanisha Koneru
44b091a8d7 HDDS-205. Add metrics to HddsDispatcher. Contributed by Bharat Viswanadham. 2018-07-03 09:50:25 -07:00
Nanda kumar
e4d7227aad HDDS-178: DN should update transactionId on block delete. Contributed by Lokesh Jain. 2018-06-29 04:37:16 +05:30
Nanda kumar
852ca6b432 HDDS-185: TestCloseContainerByPipeline#testCloseContainerViaRatis fail intermittently. Contributed by Shashikant Banerjee. 2018-06-29 04:11:39 +05:30
Bharat Viswanadham
c104525168 Merge remote-tracking branch 'apache-commit/trunk' into HDDS-48 2018-06-28 14:28:23 -07:00
Bharat Viswanadham
52d1d9603e HDDS-183:Integrate Volumeset, ContainerSet and HddsDispatcher. Contributed by Bharat Viswanadham 2018-06-28 14:07:52 -07:00
Hanisha Koneru
13579f9296 HDDS-173. Refactor Dispatcher and implement Handler for new ContainerIO design. 2018-06-28 10:13:30 -07:00
Anu Engineer
8752a48564 HDDS-193. Make Datanode heartbeat dispatcher in SCM event based. 
Contributed by Elek, Marton.
 2018-06-27 14:18:25 -07:00
Xiaoyu Yao
1e30547642 HDDS-170. Fix TestBlockDeletingService#testBlockDeletionTimeout. Contributed by Lokesh Jain. 2018-06-27 13:56:45 -07:00
Xiaoyu Yao
56a4cdb980 HDDS-194. Remove NodePoolManager and node pool handling from SCM. Contributed by Elek Marton. 2018-06-27 13:28:00 -07:00
Xiaoyu Yao
0d6fe5f36b Revert "HDDS-194. Remove NodePoolManager and node pool handling from SCM. Contributed by Elek Marton" 
This reverts commit aaf03cc459.
 2018-06-27 13:25:45 -07:00
Xiaoyu Yao
aaf03cc459 HDDS-194. Remove NodePoolManager and node pool handling from SCM. Contributed by Elek Marton 2018-06-27 12:39:15 -07:00
Bharat Viswanadham
238fe00ad2 HDDS-192:Create new SCMCommand to request a replication of a container. Contributed by Elek Marton 2018-06-25 21:12:05 -07:00
Anu Engineer
ca14fec02f HDDS-184. Upgrade common-langs version to 3.7 in hadoop-tools/hadoop-ozone. 
Contributed by Takanobu Asanuma.
 2018-06-23 15:49:44 -07:00
Mukul Kumar Singh
2a4632d3d7 HDDS-141. Remove PipeLine Class from SCM and move the data field in the Pipeline to ContainerInfo. Contributed by Shashikant Banerjee. 2018-06-17 23:48:49 -07:00
Anu Engineer
ddd09d59f3 HDDS-163. Add Datanode heartbeat dispatcher in SCM. 
Contributed by Nandakumar.
 2018-06-13 20:18:22 -07:00
Anu Engineer
7547740e5c HDDS-161. Add functionality to queue ContainerClose command from SCM Heartbeat Response to Ratis. 
Contributed by Shashikant Banerjee.
 2018-06-13 18:48:59 -07:00
Xiaoyu Yao
7566e0ec5f HDDS-159. RestClient: Implement list operations for volume, bucket and keys. Contributed by Lokesh Jain. 2018-06-13 11:43:18 -07:00
Anu Engineer
43baa036ae HDDS-109. Add reconnect logic for XceiverClientGrpc. 
Contributed by Lokesh Jain.
 2018-06-13 09:50:10 -07:00
Xiaoyu Yao
e9ea902299 HDDS-130. TestGenerateOzoneRequiredConfigurations should use GenericTestUtils#getTempPath to set output directory. Contributed by Sandeep Nemuri. 2018-06-12 09:03:55 -07:00
Anu Engineer
5c7ad52573 HDDS-111. Include tests for Rest Client in TestVolume and TestBucket. 
Contributed by Lokesh Jain.
 2018-06-12 08:25:18 -07:00
Xiaoyu Yao
23bfd9f7e4 HDDS-72. Add deleteTransactionId field in ContainerInfo. Contributed by Lokesh Jain. 2018-06-11 16:02:32 -07:00
Anu Engineer
a1272448bf HDDS-157. Upgrade common-langs version to 3.7 in HDDS and Ozone. 
Contributed by Takanobu Asanuma.
 2018-06-08 10:27:01 -07:00
Anu Engineer
30f0582f2b HDDS-107. TestOzoneConfigurationFields is failing. 
Contributed by LiXin Ge & Mukul Kumar Singh.
 2018-06-06 08:39:18 -07:00
Anu Engineer
3b34148c4f HDDS-88. Create separate message structure to represent ports in DatanodeDetails. 
Contributed by Nanda Kumar.
 2018-05-30 08:52:07 -07:00
Anu Engineer
201440b987 HDDS-81. Moving ContainerReport inside Datanode heartbeat. 
Contributed by Nanda Kumar.
 2018-05-29 12:48:50 -07:00
Anu Engineer
8733012ae3 HDDS-96. Add an option in ozone script to generate a site file with minimally required ozone configs. 
Contributed by Dinesh Chitlangia.
 2018-05-25 13:06:14 -07:00
Mukul Kumar Singh
774daa8d53 HDDS-45. Removal of old OzoneRestClient. Contributed by Lokesh Jain. 2018-05-24 15:53:42 +05:30
Mukul Kumar Singh
fed2bef647 HDDS-85. Send Container State Info while sending the container report from Datanode to SCM. Contributed by Shashikant Banerjee. 2018-05-23 14:15:35 +05:30
Anu Engineer
5a9140690a HDDS-49. Standalone protocol should use grpc in place of netty. 
Contributed by Mukul Kumar Singh.
 2018-05-22 19:56:15 -07:00
Xiaoyu Yao
68c7fd8e60 HDDS-79. Remove ReportState from SCMHeartbeatRequestProto. Contributed by Nanda kumar. 2018-05-22 15:46:59 -07:00
Xiaoyu Yao
5e88126776 HDDS-82. Merge ContainerData and ContainerStatus classes. Contributed by Bharat Viswanadham. 2018-05-21 16:09:24 -07:00
Xiaoyu Yao
fc5d49c202 HDDS-29. Fix TestStorageContainerManager#testRpcPermission. Contributed by Mukul Kumar Singh. 2018-05-14 09:10:03 -07:00
Anu Engineer
53c8ebcd02 HDDS-32. Fix TestContainerDeletionChoosingPolicy#testTopNOrderedChoosingPolicy. 
Contributed by Mukul Kumar Singh.
 2018-05-12 10:24:06 -07:00
Anu Engineer
cd8b9e913e HDDS-53. Fix TestKey#testPutAndGetKeyWithDnRestart. 
Contributed by Mukul Kumar Singh.
 2018-05-12 10:24:05 -07:00
Anu Engineer
7e26e1f216 HDDS-52. Fix TestSCMCli#testInfoContainer. 
Contributed by Mukul Kumar Singh.
 2018-05-12 10:24:05 -07:00
Mukul Kumar Singh
413285569a HDDS-21. Add support for rename key within a bucket for rest client. Contributed by Lokesh Jain. 2018-05-12 17:40:29 +05:30
Anu Engineer
c1d64d60f6 HDDS-39. Ozone: Compile Ozone/HDFS/Cblock protobuf files with proto3 compiler using maven protoc plugin. 
Contributed by Mukul Kumar Singh.
 2018-05-11 11:08:45 -07:00
Anu Engineer
30293f6065 HDDS-34. Remove .meta file during creation of container 
Contributed by Bharat Viswanadham.
 2018-05-10 17:08:26 -07:00
Xiaoyu Yao
7369f41020 HDDS-16. Remove Pipeline from Datanode Container Protocol protobuf definition. Contributed by Mukul Kumar Singh. 2018-05-10 14:49:58 -07:00
Anu Engineer
48d0b54849 HDDS-31. Fix TestSCMCli. Contributed by Lokesh Jain. 2018-05-10 12:43:13 -07:00
Anu Engineer
f8b540049d HDDS-42. Inconsistent module names and descriptions. Contributed by Tsz Wo Nicholas Sze. 2018-05-10 11:44:14 -07:00
Anu Engineer
7482963f1a HDDS-30. Fix TestContainerSQLCli. Contributed by Shashikant Banerjee. 2018-05-10 11:36:25 -07:00
Anu Engineer
46e0f27862 HDDS-18. Ozone Shell should use RestClient and RpcClient. Contributed by Lokesh Jain. 2018-05-09 23:00:13 -07:00
Mukul Kumar Singh
208b97e969 HDDS-20. Ozone: Add support for rename key within a bucket for rpc client. Contributed by Lokesh Jain. 2018-05-09 19:06:07 +05:30
Mukul Kumar Singh
809135082a HDDS-33. Ozone : Fix the test logic in TestKeySpaceManager#testDeleteKey. Contributed by Shashikant Banerjee. 2018-05-09 10:21:41 +05:30
Xiaoyu Yao
08ea90e1e4 HDDS-27. Fix TestStorageContainerManager#testBlockDeletionTra;nsactions. Contributed by Xiaoyu Yao. 2018-05-07 18:29:50 -07:00
Anu Engineer
3a43ac2851 HDDS-1. Remove SCM Block DB. Contributed by Xiaoyu Yao. 2018-05-07 14:58:52 -07:00
Anu Engineer
f0c3dc4cf4 HDDS-13. Refactor StorageContainerManager into seperate RPC endpoints. Contributed by Anu Engineer. 2018-04-30 21:41:10 -07:00
Ewan Higgs
84ecfe3ceb
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-04-27 19:21:37 +09:00
Owen O'Malley
2adda92de1
HDFS-7240 git commit fixup 
Signed-off-by: Owen O'Malley <omalley@apache.org>
 2018-04-26 13:52:17 -07:00
Xiaoyu Yao
20dab05564 HDFS-13407. Ozone: Use separated version schema for Hdds/Ozone projects. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Nanda kumar
17974ba3a6 HDFS-13444. Ozone: Fix checkstyle issues in HDFS-7240. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
ae8ac7f082 HDFS-13424. Ozone: Refactor MiniOzoneClassicCluster. Contributed by Nanda Kumar. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
979bbb4019 HDFS-13423. Ozone: Clean-up of ozone related change from hadoop-hdfs-project. Contributed by Nanda Kumar. 2018-04-26 05:36:04 -07:00
Nanda kumar
3779fadc5c HDFS-13324. Ozone: Remove InfoPort and InfoSecurePort from DatanodeDetails. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
25f2398bbd HDFS-13395. Ozone: Plugins support in HDSL Datanode Service. Contributed by Nanda Kumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
8b832f3c35 HDFS-13405. Ozone: Rename HDSL to HDDS. 
Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.
 2018-04-26 05:36:04 -07:00
Nanda kumar
6cc765fbb6 HDFS-13320. Ozone: Support for MicrobenchMarking Tool. Contributed by Shashikant Banerjee 2018-04-26 05:36:04 -07:00
Nanda kumar
7ae9543a57 HDFS-13391. Ozone: Make dependency of internal sub-module scope as provided in maven. Contributed by Nanda kumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
498b84155f HDFS-13300. Ozone: Remove DatanodeID dependency from HDSL and Ozone. 
Contributed by Nanda kumar.
 2018-04-26 05:36:04 -07:00
Anu Engineer
4e61bc431e HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects. 
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
 2018-04-26 05:36:04 -07:00