Commit Graph

18900 Commits

Author SHA1 Message Date
Mukul Kumar Singh
979bbb4019 HDFS-13423. Ozone: Clean-up of ozone related change from hadoop-hdfs-project. Contributed by Nanda Kumar. 2018-04-26 05:36:04 -07:00
Nanda kumar
d5a8e60256 HDFS-13413. Ozone: ClusterId and DatanodeUuid should be marked mandatory fields in SCMRegisteredCmdResponseProto. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
51459d4351 HDFS-13414. Ozone: Update existing Ozone documentation according to the recent changes. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
8cc13ff962 HDFS-13425. Ozone: Clean-up of ozone related change from hadoop-common-project. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
ec6c8742e5 HDFS-13415. Ozone: Remove cblock code from HDFS-7240. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Nanda kumar
aae3ba24ca HDFS-13348. Ozone: Update IP and hostname in Datanode from SCM's response to the register call. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Nanda kumar
12d80f8cae HDFS-13416. Ozone: TestNodeManager tests fail. Contributed by Bharat Viswanadham. 2018-04-26 05:36:04 -07:00
Nanda kumar
3779fadc5c HDFS-13324. Ozone: Remove InfoPort and InfoSecurePort from DatanodeDetails. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
25f2398bbd HDFS-13395. Ozone: Plugins support in HDSL Datanode Service. Contributed by Nanda Kumar. 2018-04-26 05:36:04 -07:00
Nanda kumar
0ec88ea42b HDFS-13301. Ozone: Remove containerPort, ratisPort and ozoneRestPort from DatanodeID and DatanodeIDProto. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
82eb5da2b6 HDFS-13342. Ozone: Rename and fix ozone CLI scripts. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Anu Engineer
e1470c8e9a HDFS-13405. Addendum: Ozone: Rename HDSL to HDDS.
Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
Anu Engineer
8b832f3c35 HDFS-13405. Ozone: Rename HDSL to HDDS.
Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.
2018-04-26 05:36:04 -07:00
Nanda kumar
792ac4d08b HDFS-13309. Ozone: Improve error message in case of missing nodes. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Nanda kumar
43f7307829 HDFS-13316. Ozone: Update the ksm/scm CLI usage info. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Nanda kumar
6cc765fbb6 HDFS-13320. Ozone: Support for MicrobenchMarking Tool. Contributed by Shashikant Banerjee 2018-04-26 05:36:04 -07:00
Nanda kumar
7ae9543a57 HDFS-13391. Ozone: Make dependency of internal sub-module scope as provided in maven. Contributed by Nanda kumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
4f37ff7616 HDFS-13341. Ozone: Move ozone specific ServiceRuntimeInfo utility to the framework. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Nanda kumar
12c3e4ef98 HDFS-13368. Ozone:TestEndPoint tests are failing consistently. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Anu Engineer
498b84155f HDFS-13300. Ozone: Remove DatanodeID dependency from HDSL and Ozone.
Contributed by Nanda kumar.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao
70216e7978 HDFS-13340. Ozone: Fix false positive RAT warning when project built without hds/cblock. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
6d9f069ede HDFS-13343. Ozone: Provide docker based acceptance testing on pseudo cluster.
Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Anu Engineer
4981716ab5 HDFS-13335. Ozone: remove hdsl/cblock/ozone source code from the official apache source release artifact.
Contributed by  Elek, Marton.
2018-04-26 05:36:04 -07:00
Anu Engineer
6eb1dc9e8c HDFS-13319. Ozone: start-ozone.sh/stop-ozone.sh fail because of unresolved path.
Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Xiaoyu Yao
2078884b36 HDFS-13317. Ozone: docker-compose should only be copied to hadoop-dist if Phdsl is enabled. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer
155051fbb6 HDFS-13298. Addendum: Ozone: Make ozone/hdsl/cblock modules turned off by default. Contributed by Elek, Marton.
While committing the original patch, some files were missed. This patch addresses that issue.
2018-04-26 05:36:04 -07:00
Anu Engineer
1f9a7ae12f HDFS-13304. Document: update the new ozone docker file location. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer
04e1287771 HDFS-13298. Ozone: Make ozone/hdsl/cblock modules turned off by default. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
4e61bc431e HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
2018-04-26 05:36:04 -07:00
Anu Engineer
5e7164c614 HDFS-13137. Ozone: Ozonefs read fails because ChunkGroupInputStream#read does not iterate through all the blocks in the key.
Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Anu Engineer
61651dcf5c HDFS-13108. Ozone: OzoneFileSystem: Simplified url schema for Ozone File System. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Nanda kumar
9a914126a7 HDFS-13008. Ozone: Add DN container open/close state to container report. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer
bf206f014a HDFS-13196. Ozone: dozone: make example docker-compose files version independent. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Nanda kumar
f4466402ae HDFS-12965. Ozone: Documentation : Add ksm -createObjectStore command documentation. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Nanda kumar
1094af072c HDFS-11699. Ozone:SCM: Add support for close containers in SCM. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Nanda kumar
b4a3cf1476 HDFS-13070. Ozone: SCM: Support for container replica reconciliation - 1. Contributed by Nanda kumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
4c10a849e8 HDFS-13078. Ozone: Update Ratis on Ozone to 0.1.1-alpha-8fd74ed-SNAPSHOT.
To fix large chunk reads (>4M) from Datanodes. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Anu Engineer
254cbe2589 HDFS-12983. Block Storage: provide docker-compose file for cblock clusters. Contributed by Elek,Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
136b419594 HDFS-13149. Ozone: Rename Corona to Freon. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
cd807c9890 HDFS-13133. Ozone: OzoneFileSystem: Calling delete with non-existing path shouldn't be logged on ERROR level. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
9272e1021d HDFS-12636. Ozone: OzoneFileSystem: Implement seek functionality for rpc client. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
377b31ffa1 HDFS-13022. Block Storage: Kubernetes dynamic persistent volume provisioner. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
ee5495456e HDFS-13116. Ozone: Refactor Pipeline to have transport and container specific information. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer
3cf07b43bc HDFS-13127. Fix TestContainerStateManager and TestOzoneConfigurationFields. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer
443425a5d9 HDFS-12522. Ozone: Remove the Priority Queues used in the Container State Manager. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Nanda kumar
32245c78e2 HDFS-13080. Ozone: Make finalhash in ContainerInfo of StorageContainerDatanodeProtocol.proto optional. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
150c4e1d0b HDFS-12879. Ozone : add scm init command to document. Contributed by Rahul Pathak. 2018-04-26 05:36:04 -07:00
Nanda kumar
7b3179f551 HDFS-13072. Ozone: DatanodeStateMachine: Handling Uncaught Exception in command handler thread. Contributed by Nanda kumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
10e1e2c2f5 HDFS-12812. Ozone: dozone: initialize scm and ksm directory on cluster startup. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
6b03fca37d HDFS-12868. Ozone: Service Discovery API. Contributed by Nanda Kumar. 2018-04-26 05:36:04 -07:00