big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
19,973 Commits 2 Branches 2 Tags 264 MiB
64c7a12b57
Commit Graph

230 Commits

Author SHA1 Message Date
Anu Engineer
64c7a12b57 HDDS-436. Allow SCM chill mode to be disabled by configuration. 
Contributed by Ajay Kumar.
 2018-09-12 11:40:24 -07:00
Anu Engineer
6e2129cf4e HDDS-428. OzoneManager lock optimization. 
Contributed by Nanda Kumar.
 2018-09-12 10:38:36 -07:00
Mukul Kumar Singh
47299ce23f HDDS-433. ContainerStateMachine#readStateMachineData should properly build LogEntryProto. Contributed by Lokesh Jain. 2018-09-12 18:31:03 +05:30
Anu Engineer
9c238ffc30 HDDS-432. Replication of closed containers is not working. 
Contributed by Elek, Marton.
 2018-09-11 17:00:04 -07:00
Anu Engineer
a406f6f60e HDDS-424. Consolidate ozone oz parameters to use GNU convention. 
Contributed by Elek, Marton.
 2018-09-11 16:47:33 -07:00
Anu Engineer
8ffbbf51c9 HDDS-431. LeaseManager of CommandWatcher is not started. 
Contributed by Elek, Marton.
 2018-09-11 10:44:47 -07:00
Anu Engineer
7b5886bf78 HDDS-222. Remove hdfs command line from ozone distribution. 
Contributed by Elek, Marton.
 2018-09-11 10:19:50 -07:00
Márton Elek
317f317d4b HDDS-421. Resilient DNS resolution in datanode-service. Contributed by Elek, Marton. 2018-09-10 20:52:52 +02:00
Xiaoyu Yao
8fe4062bfc HDDS-403. Fix createdOn and modifiedOn timestamp for volume, bucket, key. Contributed by Dinesh Chitlangia. 2018-09-10 08:45:49 -07:00
Mukul Kumar Singh
d924ca2e1a HDDS-410. ozone scmcli list is not working properly. Contributed by Hanisha Koneru. 2018-09-09 10:37:30 +05:30
Anu Engineer
73fcbdd296 HDDS-190. Improve shell error message for unrecognized option. 
Contributed by Elek, Marton.
 2018-09-07 12:54:32 -07:00
Hanisha Koneru
ab90248b30 HDDS-400. Check global replication state for containers of dead node. Contributed by Elek, Marton. 2018-09-07 11:20:25 -07:00
Anu Engineer
ff64d35716 HDDS-351. Add chill mode state to SCM. 
Contributed by Ajay Kumar.
 2018-09-07 10:54:35 -07:00
Márton Elek
94ed5cffd7 HDDS-214. Bump ozone/hdds version after the release branch cut 2018-09-07 17:45:26 +02:00
Tsz Wo Nicholas Sze
b3161c4dd9 HDDS-297. Add pipeline actions in Ozone. Contributed by Mukul Kumar Singh and Shashikant Banerjee 2018-09-06 14:35:07 -07:00
Xiaoyu Yao
8286bf2d1f HDDS-303. Removing logic to identify containers to be closed from SCM. Contributed by Nanda kumar. 2018-09-05 12:26:37 -07:00
Xiaoyu Yao
85c3fe341a HDDS-268. Add SCM close container watcher. Contributed by Ajay Kumar. 2018-09-04 22:56:57 -07:00
Anu Engineer
6e4c731471 HDDS-396. Remove openContainers.db from SCM. 
Contributed by Dinesh Chitlangia.
 2018-09-04 16:27:31 -07:00
Hanisha Koneru
9964e33e8d HDDS-369. Remove the containers of a dead node from the container state map. Contributed by Elek, Marton 2018-09-04 14:57:54 -07:00
Nanda kumar
6bbd249011 HDDS-98. Adding Ozone Manager Audit Log. Contributed by Dinesh Chitlangia. 2018-09-05 00:11:07 +05:30
Nanda kumar
b9932162e9 HDDS-75. Support for CopyContainer. Contributed by Elek, Marton. 2018-09-04 23:41:50 +05:30
Nanda kumar
567b5558d5 HDDS-343. Containers are stuck in closing state in scm. Contributed by Elek, Marton. 2018-09-03 20:14:45 +05:30
Mukul Kumar Singh
873ef8ae81 HDDS-263. Add retries in Ozone Client to handle BlockNotCommitted Exception. Contributed by Shashikant Banerjee. 2018-09-03 12:26:34 +05:30
Anu Engineer
ff036e49ff HDDS-357. Use DBStore and TableStore for OzoneManager non-background service. 
Contributed by Nandakumar.
 2018-09-02 11:47:32 -07:00
Nanda kumar
6edf3d2ea3 Revert "HDDS-98. Adding Ozone Manager Audit Log." 
This reverts commit 630b64ec7e.
 2018-09-02 00:18:13 +05:30
Anu Engineer
19abaacdad HDDS-392. Incomplete description about auditMap#key in AuditLogging Framework. 
Contributed by  Dinesh Chitlangia.
 2018-08-31 22:24:30 -07:00
Anu Engineer
76bae4ccb1 HDDS-379. Simplify and improve the cli arg parsing of ozone scmcli. 
Contributed by Elek, Marton.
 2018-08-31 18:11:01 -07:00
Anu Engineer
50d2e3ec41 HDDS-388. Fix the name of the db profile configuration key. 
Contributed by Elek, Marton.
 2018-08-31 14:30:29 -07:00
Anu Engineer
630b64ec7e HDDS-98. Adding Ozone Manager Audit Log. 
Contributed by Dinesh Chitlangia.
 2018-08-31 14:20:56 -07:00
Nanda kumar
0bd4217194 HDDS-380. Remove synchronization from ChunkGroupOutputStream and ChunkOutputStream. Contributed by Shashikant Banerjee. 2018-08-29 13:31:19 +05:30
Mukul Kumar Singh
2651e2c43d HDDS-365. Implement flushStateMachineData for containerStateMachine. Contributed by Shashikant Banerjee. 2018-08-29 07:58:30 +05:30
Anu Engineer
c5629d546d HDDS-382. Remove RatisTestHelper#RatisTestSuite constructor argument and fix checkstyle in ContainerTestHelper, GenericTestUtils 
Contributed by Nandakumar.
 2018-08-28 14:06:19 -07:00
Anu Engineer
ac515d22d8 HDDS-376. Create custom message structure for use in AuditLogging 
Contributed by Dinesh Chitlangia.
 2018-08-28 12:59:08 -07:00
Márton Elek
c61824a189 HDDS-359. RocksDB Profiles support. Contributed by Anu Engineer. 2018-08-28 19:33:13 +02:00
Anu Engineer
df21e1b1dd HDDS-332. Remove the ability to configure ozone.handler.type 
Contributed by Nandakumar and Anu Engineer.
 2018-08-28 09:56:02 -07:00
Nanda kumar
2172399c55 HDDS-381. Fix TestKeys#testPutAndGetKeyWithDnRestart. Contributed by Mukul Kumar Singh. 2018-08-28 22:19:52 +05:30
Mukul Kumar Singh
3974427f67 HDDS-247. Handle CLOSED_CONTAINER_IO exception in ozoneClient. Contributed by Shashikant Banerjee. 2018-08-28 07:12:07 +05:30
Xiaoyu Yao
c9b63956d9 HDSS-375. ContainerReportHandler should not send replication events for open containers. Contributed by Ajay Kumar. 2018-08-27 10:40:33 -07:00
Xiaoyu Yao
6eecd251d8 HDDS-377. Make the ScmClient closable and stop the started threads. Contributed by Elek Marton. 2018-08-27 08:19:38 -07:00
Márton Elek
a813fd0215 HDDS-227. Use Grpc as the default transport protocol for Standalone pipeline. Contributed by chencan. 2018-08-27 16:07:55 +02:00
Márton Elek
744ce200d2 HDDS-313. Add metrics to containerState Machine. Contributed by chencan. 2018-08-27 15:51:34 +02:00
Nanda kumar
12b2f362cc HDDS-374. Support to configure container size in units lesser than GB. Contributed by Nanda kumar. 2018-08-27 18:29:32 +05:30
Márton Elek
a5eba25506 HDDS-364. Update open container replica information in SCM during DN register. Contributed by Ajay Kumar. 2018-08-24 22:42:51 +02:00
Márton Elek
138b0c1443 HDDS-363. Faster datanode registration during the first startup. Contributed by Elek, Marton. 2018-08-24 15:36:10 +02:00
Márton Elek
55b6931059 HDDS-317. Use new StorageSize API for reading ozone.scm.container.size.gb. Contributed by Junjie Chen. 2018-08-24 13:56:30 +02:00
Xiaoyu Yao
ca29fb754e HDDS-328. Support export and import of the KeyValueContainer. Contributed by Elek Marton. 2018-08-23 11:30:28 -07:00
Anu Engineer
b021249ac8 HDDS-356. Support ColumnFamily based RockDBStore and TableStore. 
Contributed by Anu Engineer.
 2018-08-22 18:55:14 -07:00
Xiaoyu Yao
4c25f37c6c HDDS-350. ContainerMapping#flushContainerInfo doesn't set containerId. Contributed by Ajay Kumar. 2018-08-22 10:54:10 -07:00
Hanisha Koneru
5aa15cfaff HDDS-265. Move numPendingDeletionBlocks and deleteTransactionId from ContainerData to KeyValueContainerData. Contributed by LiXin Ge. 2018-08-22 10:04:15 -07:00
Mukul Kumar Singh
e3d73bbc24 HDDS-353. Multiple delete Blocks tests are failing consistently. Contributed by Lokesh Jain. 2018-08-20 13:37:58 +05:30