Commit Graph

5035 Commits

Author SHA1 Message Date
Weiwei Yang
fec04f1158 HDFS-12370. Ozone: Implement TopN container choosing policy for BlockDeletionService. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang
743be0d7c0 HDFS-12235. Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions. Contributed by Weiwei Yang and Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Weiwei Yang
3aa846412d HDFS-12397. Ozone: KSM: multiple delete methods in KSMMetadataManager. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Chen Liang
e06a9a5bb1 HDFS-12391. Ozone: TestKSMSQLCli is not working as expected. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer
1a21136322 HDFS-12382. Ozone: SCM: BlockManager creates a new container for each allocateBlock call. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
2e2e30373c HDFS-12333. Ozone: Extend Datanode web interface with SCM information. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
ca72c2342c HDFS-12366. Ozone: Refactor KSM metadata class names to avoid confusion. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang
7b3e7eb565 HDFS-12354. Ozone: Shuffle container list for datanode BlockDeletingService. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang
eef437d5e2 HDFS-12282. Ozone: DeleteKey-4: Block delete via HB between SCM and DN. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer
2f4dfbc8fb HDFS-12275. Ozone: Corona: Support for random validation of writes. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang
4d3b8d332d HDFS-12283. Ozone: DeleteKey-5: Implement SCM DeletedBlockLog. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
02f8c2224f HDFS-11888. Ozone: SCM: use state machine for open containers allocated for key/blocks. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer
f352b104f7 HDFS-12337. Ozone: Concurrent RocksDB open calls fail because of "No locks available". Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang
9e733215a8 HDFS-12327. Ozone: support setting timeout in background service. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
38bc1d1097 HDFS-12216. Ozone: TestKeys is failing consistently. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer
bd33038bf4 HDFS-12159. Ozone: SCM: Add create replication pipeline RPC. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Chen Liang
f9bce29dcc HDFS-12290. Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Chen Liang
6a16d7c7ab HDFS-12255. Block Storage: Cblock should generated unique trace ID for the ops. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang
e61530f5d9 HDFS-12298. Ozone: Block deletion service floods the log when deleting large number of block files. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang
25586607a1 HDFS-12230. Ozone: KSM: Add creation time field in bucket info. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
dcc21a4f93 HDFS-12005. Ozone: Web interface for SCM. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
c9ea431267 HDFS-12281. Ozone: Ozone-default.xml has 3 properties that do not match the default Config value. Contributed by Ajay Yadav. 2018-04-26 05:36:04 -07:00
Weiwei Yang
639b4fb8a9 HDFS-12196. Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang
285d61cd8d HDFS-12274. Ozone: Corona: move corona from test to tools package. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
bb9a4793d3 HDFS-12259. Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
b4aecc1009 HDFS-12262. Ozone: KSM: Reduce default handler thread count from 200. Contributed by Ajay Yadav. 2018-04-26 05:36:04 -07:00
Anu Engineer
bb5f1c4228 HDFS-12231. Ozone: KSM: Add creation time field in volume info. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
89d8d20c73 HDFS-12246. Ozone: potential thread leaks. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer
23dee0f123 HDFS-11935. Ozone: TestStorageContainerManager#testRpcPermission fails when ipv6 address used. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
ccc1607424 HDFS-12178. Ozone: OzoneClient: Handling SCM container creationFlag at client side. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
37a0ab5ca3 HDFS-12247. Ozone: KeySpaceManager should unregister KSMMetrics upon stop. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang
1ad95cf2a9 HDFS-11984. Ozone: Ensures listKey lists all required key fields. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
acfae2716a HDFS-12034. Ozone: Web interface for KSM. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Chen Liang
070f7e2e59 HDFS-11920. Ozone : add key partition. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Anu Engineer
bc413a69cc HDFS-12195. Ozone: DeleteKey-1: KSM replies delete key request asynchronously. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Anu Engineer
86b42907cf HDFS-12183. Ozone: KSM : Use proper defaults for block client address. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Chen Liang
7907fe1c80 HDFS-12059. Ozone: OzoneClient: OzoneClientImpl Add setBucketProperty and delete calls. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
fcd4537e63 HDFS-12180. Ozone: Corona: Add stats and progress bar to corona. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang
a4b3160efb HDFS-12145. Ozone: OzoneFileSystem: Ozone & KSM should support / delimited key names. Contributed by Mukul Kumar Singh.
(cherry picked from commit fe0a957e92d506330ba005abba18f665eb5ac1cc)
2018-04-26 05:36:04 -07:00
Yiqun Lin
8cf0c864c4 HDFS-12170. Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang
d50a743015 HDFS-12155. Ozone : add RocksDB support to DEBUG CLI. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Anu Engineer
0cc166c053 HDFS-12115. Ozone: SCM: Add queryNode RPC Call. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Weiwei Yang
539842ed8b HDFS-12187. Ozone : add support to DEBUG CLI for ksm.db. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
eda559ffd2 HDFS-12181. Ozone: Fix TestContainerReplicationManager by setting proper log level for LogCapturer. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang
f1e2592bf8 HDFS-12127. Ozone: Ozone shell: Add more testing for key shell commands. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
bbbfc885e7 HDFS-12149. Ozone: RocksDB implementation of ozone metadata store. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer
6225622dee HDFS-12071. Ozone: Corona: Implementation of Corona. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang
d2ef3e40bc HDFS-12126. Ozone: Ozone shell: Add more testing for bucket shell commands. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
4d333f8db1 HDFS-12058. Ozone: OzoneClient: OzoneClientImpl add getDetails calls. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Chen Liang
27262d8889 HDFS-12118. Ozone: Ozone shell: Add more testing for volume shell commands. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00