Hanisha Koneru
cdc36fe286
HDDS-1649. On installSnapshot notification from OM leader, download checkpoint and reload OM state ( #948 )
2019-07-22 12:06:55 -07:00
Bharat Viswanadham
4aa76e327d
HDDS-1805. Implement S3 Initiate MPU request to use Cache and DoubleBuffer. ( #1108 )
2019-07-20 08:11:36 -07:00
Bharat Viswanadham
f5b2f7538c
HDDS-1795. Implement S3 Delete Bucket request to use Cache and DoubleBuffer. ( #1097 )
2019-07-19 17:43:23 -07:00
Bharat Viswanadham
3dc256ef81
HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. ( #1088 )
2019-07-17 21:46:27 -07:00
Bharat Viswanadham
0541322c9a
HDDS-1675. Cleanup Volume Request 2 phase old code. ( #964 )
2019-07-17 14:13:06 -07:00
Hanisha Koneru
7adc4a327a
HDDS-1775. Make OM KeyDeletingService compatible with HA model ( #1063 )
2019-07-16 16:59:57 -07:00
Xiaoyu Yao
d429d742f0
HDDS-1544. Support default Acls for volume, bucket, keys and prefix. Contributed by Ajay Kumar, Xiaoyu Yao.
...
Signed-off-by: Anu Engineer <aengineer@apache.org>
2019-07-16 12:58:59 -07:00
Bharat Viswanadham
395cb3cfd7
HDDS-1736. Cleanup 2phase old HA code for Key requests. ( #1038 )
2019-07-15 21:51:59 -07:00
Ajay Yadav
cdb20adfcc
HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. ( #973 )
2019-07-10 11:03:58 -07:00
Xiaoyu Yao
030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen.
2019-07-09 14:43:55 -07:00
Hanisha Koneru
8861573e8c
HDDS-1717. MR Job fails as OMFailoverProxyProvider has dependency hadoop-3.2
...
Closes #1056
2019-07-09 13:22:00 +02:00
Bharat Viswanadham
8965ddcf59
HDDS-1731. Implement File CreateFile Request to use Cache and DoubleBuffer. ( #1044 )
2019-07-03 13:15:04 -07:00
Bharat Viswanadham
1e727cf2a1
HDDS-1730. Implement File CreateDirectory Request to use Cache and Do… ( #1026 )
2019-06-30 22:38:53 -07:00
Bharat Viswanadham
49c5e8ac24
HDDS-1672. Improve locking in OzoneManager. ( #1016 )
2019-06-28 14:05:19 -07:00
Bharat Viswanadham
4848280437
HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. ( #956 )
2019-06-26 18:04:12 -07:00
Bharat Viswanadham
a79bdf760e
HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. ( #1014 )
2019-06-25 17:12:45 -07:00
Bharat Viswanadham
049bb42760
HDDS-1723. Create new OzoneManagerLock class. ( #1006 )
...
* HDDS-1723. Create new OzoneManagerLock class.
* add logs
* fix exception message
* add license
* fix findbug
* throw exception when acquiring 2nd lock failed.
* fix review comments
* fix missed review comment
* fix checkstyle
* fix review comments
2019-06-25 08:48:03 -07:00
Elek, Márton
004207996c
HDDS-1597. Remove hdds-server-scm dependency from ozone-common ( #969 )
...
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.
* checkstyle fixes
* revert the import reorder of HddsUtil
* add javadoc
* switch back to the commons-lang2
* fix typo
* fix metrics core classpath problem (+rebase fix)
2019-06-24 11:56:04 -07:00
S O'Donnell
22b36dd311
HDDS-1660. Use Picocli for Ozone Manager
...
Closes #925
2019-06-17 14:13:50 +02:00
Chen, Junjie
940bcf01cd
HDDS-1587. Support dynamically adding delegated classes from to isolated class loader. Contributed by Junjie Chen. ( #942 )
2019-06-12 20:08:15 -07:00
Bharat Viswanadham
88c53d516c
HDDS-1620. Implement Volume Write Requests to use Cache and DoubleBuffer. ( #884 )
2019-06-12 17:45:42 -07:00
Xiaoyu Yao
a43f4440f7
HDDS-1543. Implement addAcl,removeAcl,setAcl,getAcl for Prefix. Contr… ( #927 )
2019-06-12 16:25:31 -07:00
Ajay Yadav
3b31694c35
HDDS-1545. Cli to add,remove,get and delete acls for Ozone objects. Contributed by Ajay Kumar. ( #920 )
2019-06-12 06:51:34 -07:00
Ajay Yadav
9deac3b6bf
HDDS-1657. Fix parallelStream usage in volume and key native acl. Contributed by Ajay Kumar. ( #926 )
2019-06-07 21:47:14 -07:00
S O'Donnell
85479577da
HDDS-1622. Use picocli for StorageContainerManager
...
Closes #918
2019-06-07 17:50:57 +02:00
Hanisha Koneru
0b115b60b0
HDDS-1371. OMSnapshotProvider to download DB checkpoint from leader OM. ( #703 )
2019-06-06 19:42:34 -07:00
Ajay Yadav
3b1c2577d7
HDDS-1541. Implement addAcl,removeAcl,setAcl,getAcl for Key. Contributed by Ajay Kumat. ( #885 )
2019-06-05 14:42:10 -07:00
Bharat Viswanadham
580b639908
HDDS-1600. Add userName and IPAddress as part of OMRequest. ( #857 )
2019-06-04 12:31:44 -07:00
Márton Elek
2a97a37d9e
Revert "HDDS-1597. Remove hdds-server-scm dependency from ozone-common. ( #860 )"
...
This reverts commit baee71551d
.
2019-06-03 08:34:19 +02:00
Márton Elek
1ae062c818
HDDS-1382. Create customized CSI server for Ozone
...
Closes #693
2019-05-31 13:35:58 +02:00
Xiaoyu Yao
219e286722
HDDS-1608. Support Ozone Prefix ACLs in OM metadata table. Contributed by Xiaoyu Yao. ( #875 )
2019-05-30 16:44:38 -07:00
Bharat Viswanadham
c965f7f499
HDDS-1551. Implement Bucket Write Requests to use Cache and DoubleBuffer. ( #850 )
2019-05-30 15:28:15 -07:00
Elek, Márton
baee71551d
HDDS-1597. Remove hdds-server-scm dependency from ozone-common. ( #860 )
2019-05-30 09:20:16 -07:00
Ajay Yadav
12be6ff2ff
HDDS-1539. Implement addAcl,removeAcl,setAcl,getAcl for Volume. Contributed Ajay Kumar. ( #847 )
2019-05-29 23:18:06 -07:00
Xiaoyu Yao
0ead2090a6
HDDS-1542. Create Radix tree to support ozone prefix ACLs. Contributed by Xiaoyu Yao.
2019-05-29 22:39:27 +02:00
Akira Ajisaka
afd844059c
HADOOP-16331. Fix ASF License check in pom.xml
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:25:13 +09:00
Akira Ajisaka
9f933e6446
HADOOP-16323. https everywhere in Maven settings.
2019-05-27 15:24:59 +09:00
Ajay Yadav
ef1cc725b8
HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar. ( #828 )
2019-05-21 15:53:40 -07:00
Lokesh Jain
c1d7d68c78
HDDS-1461. Optimize listStatus api in OzoneFileSystem ( #782 )
2019-05-21 14:47:48 +05:30
Lokesh Jain
6bcc1dce52
HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server ( #813 )
2019-05-14 14:49:50 +05:30
Bharat Viswanadham
4605db369e
HDDS-1482. Use strongly typed codec implementations for the S3Table
...
Closes #789
2019-05-02 13:56:30 +02:00
Márton Elek
2ab318b603
HDDS-1412. Provide example k8s deployment files as part of the release package
...
Closes #719
2019-05-02 11:18:54 +02:00
dineshchitlangia
f682a171f5
HDDS-1483. Fix getMultipartKey javadoc. ( #790 )
2019-05-01 21:51:11 -07:00
Hanisha Koneru
37582705fa
HDDS-1403. KeyOutputStream writes fails after max retries while writing to a closed container ( #753 )
2019-04-26 10:39:03 -07:00
Arpit Agarwal
ebbda181e4
HDDS-1198. Rename chill mode to safe mode. Contributed by Siddharth Wagle. ( #737 )
2019-04-13 07:27:03 -07:00
Doroszlai, Attila
3b08ac4659
HDDS-1363. ozone.metadata.dirs doesn't pick multiple dirs ( #691 )
2019-04-12 15:00:08 +05:30
Bharat Viswanadham
25c421bcc0
HDDS-1393. Convert all OM Bucket related operations to HA model. ( #704 )
2019-04-09 14:57:32 -07:00
Márton Elek
8ef3bc8113
HDDS-1383. Create project skeleton with CLI interface for In-place upgrade.
...
Closes #694
2019-04-09 17:35:14 +02:00
Ajay Kumar
0356b3699d
HDDS-1333. OzoneFileSystem can't work with spark/hadoop2.7 because incompatible security classes. Contributed by Elek, Marton. ( #653 )
...
(cherry picked from commit 7ec6a31eb314b9ecc1c2affbcc7d63c07bd33523)
2019-04-05 09:29:21 -07:00
Bharat Viswanadham
77fe51e136
HDDS-1379. Convert all OM Volume related operations to HA model. ( #689 )
2019-04-04 21:09:50 -07:00
Hanisha Koneru
f09a78f73f
HDDS-1339. Implement ratis snapshots on OM ( #651 )
2019-04-03 22:50:28 -07:00
Kitti Nanasi
aeb43dfba3
HDDS-1153. Make tracing instrumentation configurable
...
Closes #673
2019-04-02 14:21:47 +02:00
Vivek Ratnavel Subramanian
04f1db8936
HDDS-1260. Create Recon Server lifecyle integration with Ozone. ( #643 )
2019-04-01 09:59:32 -07:00
Elek, Márton
ec82e4cab2
HDDS-1357. ozone s3 shell command has confusing subcommands ( #663 )
2019-03-30 10:13:29 -07:00
Lokesh Jain
6186ed94b9
HDDS-1300. Optimize non-recursive ozone filesystem apis. Contributed by Lokesh Jain.
2019-03-29 19:27:29 +05:30
Bharat Viswanadham
eef8cae7cf
HDDS-1262. In OM HA OpenKey call Should happen only leader OM. ( #626 )
2019-03-26 21:48:01 -07:00
Ajay Yadav
82d477293c
HDDS-939. Add S3 access check to Ozone manager. Contributed by Ajay Kumar. ( #634 )
2019-03-26 08:59:59 -07:00
Mukul Kumar Singh
67dd45fc25
HDDS-1185. Optimize GetFileStatus in OzoneFileSystem by reducing the number of rpc call to OM. Contributed by Mukul Kumar Singh.
2019-03-25 17:03:30 +05:30
Xiaoyu Yao
6a34c9bb29
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao.
...
This closes #627 .
2019-03-23 09:22:34 -07:00
Ajay Yadav
f10d493325
HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. ( #601 )
2019-03-18 23:08:17 -07:00
Bharat Viswanadham
93db5da4d9
HDDS-1250. In OM HA AllocateBlock call where connecting to SCM from OM should not happen on Ratis.
2019-03-18 13:51:44 -07:00
Xiaoyu Yao
66a104bc57
HDDS-1296. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. ( #616 )
2019-03-18 08:38:55 -07:00
Xiaoyu Yao
5cfb88a225
HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. ( #594 )
2019-03-15 16:08:30 -07:00
Xiaoyu Yao
d1afa03804
HDDS-1138. Ozone Client should avoid talking to SCM directly. Contributed by Xiaoyu Yao and Mukul Kumar Singh.
...
Closes #585
2019-03-15 10:41:06 -07:00
Vivek Ratnavel Subramanian
9001508485
HDDS-761. Create S3 subcommand to run S3 related operations.
...
Closes #579
2019-03-14 21:16:59 -07:00
Márton Elek
3d140a537a
HDDS-1247. Bump trunk ozone version to 0.5.0. Contributed by Elek, Marton.
...
Closes #588
2019-03-14 12:01:25 +01:00
Ajay Yadav
dcb0de848d
HDDS-1043. Enable token based authentication for S3 api
...
Closes #561
2019-03-12 18:47:06 +01:00
Xiaoyu Yao
c7307867f0
HDDS-1245. OM delegation expiration time should use Time.now instead … ( #587 )
...
Closes #587 .
2019-03-11 21:15:40 -07:00
Hanisha Koneru
bb12e81ec8
HDDS-1175. Serve read requests directly from RocksDB. ( #557 )
...
HDDS-1175. Serve read requests directly from RocksDB.
2019-03-06 19:44:55 -08:00
Márton Elek
45f976fdcf
HDDS-1113. Remove default dependencies from hadoop-ozone project. Contributed by Elek, Marton.
...
Closes #490
2019-03-06 18:22:22 +01:00
Hanisha Koneru
12402b7a74
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
2019-03-05 09:24:22 -08:00
Xiaoyu Yao
eed8b794d8
HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao. ( #545 )
2019-03-04 10:37:26 -08:00
Hanisha Koneru
b18c1c22ea
Revert "HDDS-1072. Implement RetryProxy and FailoverProxy for OM client."
...
This reverts commit 8e1225991d
.
2019-03-04 16:58:59 +09:00
Ajay Yadav
9e53088493
Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contr…" ( #544 )
...
* Revert "Fix checkstyle issue"
This reverts commit 78c8a3323e
.
* Revert "HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao."
This reverts commit 6fef6fc5ee
.
2019-03-01 16:19:43 -08:00
Xiaoyu Yao
78c8a3323e
Fix checkstyle issue
2019-03-01 16:15:20 -08:00
Xiaoyu Yao
6fef6fc5ee
HDDS-1183. Override getDelegationToken API for OzoneFileSystem. Contributed by Xiaoyu Yao.
2019-03-01 16:15:20 -08:00
Ajay Kumar
4a3cddea70
HDDS-134. SCM CA: OM sends CSR and uses certificate issued by SCM. Contributed by Ajay Kumar.
2019-03-01 15:41:09 -08:00
Shashikant Banerjee
de1dae64f2
HDDS-726. Ozone Client should update SCM to move the container out of allocation path in case a write transaction fails. Contributed by Shashikant Banerjee.
2019-03-01 23:30:28 +05:30
Hanisha Koneru
8e1225991d
HDDS-1072. Implement RetryProxy and FailoverProxy for OM client.
2019-03-01 00:27:39 -08:00
Ajay Kumar
cbf82fabf0
HDDS-1061. DelegationToken: Add certificate serial id to Ozone Delegation Token Identifier. Contributed by Ajay Kumar.
2019-02-27 17:00:42 -08:00
Xiaoyu Yao
9e0f3d1c52
HDDS-1038. Support Service Level Authorization for Ozone. Contributed by Xiaoyu Yao and Ajay Kumar.
2019-02-26 06:02:10 -08:00
Anu Engineer
8387bbdfb5
HDDS-1154. Add tracing to the client side of StorageContainerLocationProtocol and OzoneManagerProtocol.
...
Contributed by Elek, Marton.
2019-02-24 13:13:37 -08:00
Anu Engineer
c1e5b19212
HDDS-1147. Fix failing unit tests in TestOzoneManager.
...
Contributed by Nandakumar.
2019-02-23 20:56:24 -08:00
Bharat Viswanadham
d33f0666f6
HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint.
...
* HDDS-1141.Update DBCheckpointSnapshot to DBCheckpoint.
* fix test failures in TestOzoneConfigurationFields
2019-02-21 13:29:10 -08:00
avijayanhwx
e8d7e3b4e6
HDDS-1139 : Fix findbugs issues caused by HDDS-1085. Contributed by Aravindan Vijayan.
2019-02-19 16:32:47 -08:00
Xiaoyu Yao
cf1a66d0da
HDDS-1101. SCM CA: Write Certificate information to SCM Metadata. Contributed by Anu Engineer.
2019-02-19 10:42:56 -08:00
Anu Engineer
588b4c4d78
HDDS-1085. Create an OM API to serve snapshots to Recon server.
...
Contributed by Aravindan Vijayan.
2019-02-18 22:35:36 -08:00
Anu Engineer
7ea91494ce
HDDS-1041. Support TDE(Transparent Data Encryption) for Ozone.
...
Contributed by Xiaoyu Yao.
2019-02-16 10:23:10 -08:00
Elek, Márton
afe126d71f
HDDS-1114. Fix findbugs/checkstyle/accepteance errors in Ozone. Contributed by Marton Elek.
2019-02-15 11:49:52 -08:00
Anu Engineer
217bdbd940
HDDS-1116.Add java profiler servlet to the Ozone web servers.
...
Contributed by Elek, Marton.
2019-02-15 11:32:06 -08:00
Anu Engineer
75e15cc0c4
HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects.
...
Contributed by Elek, Marton.
2019-02-14 23:33:25 -08:00
Anu Engineer
0395f22145
HDDS-1068. Improve the error propagation for ozone sh.
...
Contributed by Elek, Marton.
2019-02-14 22:51:46 -08:00
Márton Elek
7a57974f1f
HDDS-1096. OzoneManager#loadOMHAConfigs should use default ports in case port is not defined. Contributed by Hanisha Koneru.
2019-02-14 14:02:16 +01:00
Bharat Viswanadham
917ac9f108
HDDS-972. Add support for configuring multiple OMs. Contributed by Hanisha Koneru.
2019-02-12 22:07:27 -08:00
Nanda kumar
a536eb5c41
HDDS-360. Use RocksDBStore and TableStore for SCM Metadata.
...
Contributed by Anu Engineer.
2019-02-12 14:26:19 +05:30
Márton Elek
e7d1ae52d2
HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton.
2019-02-11 12:18:26 +01:00
Márton Elek
194f0b49fb
HDDS-631. Ozone classpath shell command is not working. Contributed by Elek, Marton.
2019-02-05 16:20:30 +01:00
Márton Elek
033d97abac
HDDS-956. MultipartUpload: List Parts for a Multipart upload key. Contributed by Bharat Viswanadham.
2019-01-31 14:51:31 +01:00
Yiqun Lin
8326450bca
HDDS-974. Add getServiceAddress method to ServiceInfo and use it in TestOzoneShell. Contributed by Doroszlai, Attila.
2019-01-28 17:03:12 +08:00
Bharat Viswanadham
fb69519e68
HDDS-1011. Fix NPE BucketManagerImpl.setBucketProperty. Contributed by Xiaoyu Yao.
2019-01-25 14:46:17 -08:00