big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
18,709 Commits 2 Branches 2 Tags 264 MiB
607d1fcd31
Commit Graph

7437 Commits

Author SHA1 Message Date
Xiaoyu Yao
607d1fcd31 HDFS-12256. Ozone : handle inactive containers on DataNode. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
77d4b18700 HDFS-12385. Ozone: OzoneClient: Refactoring OzoneClient API. Contributed by Nadakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
b984e903f3 HDFS-12481. Ozone: Corona: Support for variable key length in offline mode. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
d9c3d9a5ef HDFS-11873. Ozone: Object store handler supports reusing http client for multiple requests. Contributed by Xiaoyu Yao and Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer
fe4139bdc3 HDFS-11612. Ozone: Cleanup Checkstyle issues. Contributed by Shashikant Banerjee. 2018-04-26 05:36:04 -07:00
Chen Liang
b127ecd1ba Revert "HDFS-12268. Ozone: Add metrics for pending storage container requests. Contributed by Yiqun Lin." as it uses class not part of JRE. 
This reverts commit c29aff44cfc78a2839f15e8cde3b80f0a31c80dd.
 2018-04-26 05:36:04 -07:00
Weiwei Yang
eaf3732217 HDFS-12465. Ozone: fix a KeySpaceManager startup message typo. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Weiwei Yang
c551025ed6 HDFS-12468. Ozone: fix hard coded version in the Ozone GettingStarted guide. Contributed by Elek Marton. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
cf841286b8 HDFS-12426. Ozone: BlockManager MBean unregister failure upon shutdown. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Chen Liang
f66a522695 HDFS-12268. Ozone: Add metrics for pending storage container requests. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang
efa25373d7 HDFS-12019. Ozone: Misc : Make sure that ozone-site.xml is in etc/hadoop in tarball created from mvn package. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang
80c50a1eac HDFS-12423. Ozone: TopN container choosing policy should ignore containers that has no pending deletion blocks. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang
1087ce4cd2 HDFS-11676. Ozone: SCM CLI: Implement close container command. Contributed by Chen Liang. 2018-04-26 05:36:04 -07:00
Weiwei Yang
0c17776646 HDFS-12389. Ozone: oz commandline list calls should return valid JSON format output. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang
fec04f1158 HDFS-12370. Ozone: Implement TopN container choosing policy for BlockDeletionService. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang
743be0d7c0 HDFS-12235. Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions. Contributed by Weiwei Yang and Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Weiwei Yang
3aa846412d HDFS-12397. Ozone: KSM: multiple delete methods in KSMMetadataManager. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Chen Liang
e06a9a5bb1 HDFS-12391. Ozone: TestKSMSQLCli is not working as expected. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer
1a21136322 HDFS-12382. Ozone: SCM: BlockManager creates a new container for each allocateBlock call. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
91a8f134b7 HDFS-11834. Ozone: Fix TestArchive#testArchive. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer
2e2e30373c HDFS-12333. Ozone: Extend Datanode web interface with SCM information. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
ca72c2342c HDFS-12366. Ozone: Refactor KSM metadata class names to avoid confusion. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang
7b3e7eb565 HDFS-12354. Ozone: Shuffle container list for datanode BlockDeletingService. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Chen Liang
8654698d74 HDFS-12365. Ozone: ListVolume displays incorrect createdOn time when the volume was created by OzoneRpcClient. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang
eef437d5e2 HDFS-12282. Ozone: DeleteKey-4: Block delete via HB between SCM and DN. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Anu Engineer
2f4dfbc8fb HDFS-12275. Ozone: Corona: Support for random validation of writes. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Anu Engineer
2dfd0a2f4f HDFS-12341. Ozone: maven dist compilation fails with "Duplicate classes found" error. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer
532ced18fc HDFS-12280. Ozone: TestOzoneContainer#testCreateOzoneContainer fails. Contributed by Lokesh Jain. 2018-04-26 05:36:04 -07:00
Weiwei Yang
4d3b8d332d HDFS-12283. Ozone: DeleteKey-5: Implement SCM DeletedBlockLog. Contributed by Yuanbo Liu. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
f51189e2bb HDFS-12324. Ozone: TestQueryNode#testStaleNodesCount is failing. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
02f8c2224f HDFS-11888. Ozone: SCM: use state machine for open containers allocated for key/blocks. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer
f352b104f7 HDFS-12337. Ozone: Concurrent RocksDB open calls fail because of "No locks available". Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang
9e733215a8 HDFS-12327. Ozone: support setting timeout in background service. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
38bc1d1097 HDFS-12216. Ozone: TestKeys is failing consistently. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Anu Engineer
bd33038bf4 HDFS-12159. Ozone: SCM: Add create replication pipeline RPC. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
795ba1b3b7 HDFS-12313. Ozone: SCM: move container/pipeline StateMachine to the right package. Contributed by Xiaoyu Yao. 2018-04-26 05:36:04 -07:00
Anu Engineer
3a661b7f82 HDFS-12238. Ozone: Add valid trace ID check in sendCommandAsync. Contributed by Ajay Kumar. 2018-04-26 05:36:04 -07:00
Chen Liang
f9bce29dcc HDFS-12290. Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Chen Liang
6a16d7c7ab HDFS-12255. Block Storage: Cblock should generated unique trace ID for the ops. Contributed by Mukul Kumar Singh. 2018-04-26 05:36:04 -07:00
Weiwei Yang
e61530f5d9 HDFS-12298. Ozone: Block deletion service floods the log when deleting large number of block files. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Weiwei Yang
25586607a1 HDFS-12230. Ozone: KSM: Add creation time field in bucket info. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
dcc21a4f93 HDFS-12005. Ozone: Web interface for SCM. Contributed by Elek, Marton. 2018-04-26 05:36:04 -07:00
Anu Engineer
c9ea431267 HDFS-12281. Ozone: Ozone-default.xml has 3 properties that do not match the default Config value. Contributed by Ajay Yadav. 2018-04-26 05:36:04 -07:00
Weiwei Yang
639b4fb8a9 HDFS-12196. Ozone: DeleteKey-2: Implement block deleting service to delete stale blocks at background. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Weiwei Yang
285d61cd8d HDFS-12274. Ozone: Corona: move corona from test to tools package. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
bb9a4793d3 HDFS-12259. Ozone: OzoneClient: Refactor move ozone client from hadoop-hdfs to hadoop-hdfs-client. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
7290324fc8 HDFS-12267. Ozone: XceiverClientManager should not close the connection if client holds the reference. Contributed by Nandakumar. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
b4aecc1009 HDFS-12262. Ozone: KSM: Reduce default handler thread count from 200. Contributed by Ajay Yadav. 2018-04-26 05:36:04 -07:00
Anu Engineer
bb5f1c4228 HDFS-12231. Ozone: KSM: Add creation time field in volume info. Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Xiaoyu Yao
6f83e9c51e HDFS-12163. Ozone: Reduce MiniOzoneCluster handler thread count. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00