big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,373 Commits 2 Branches 2 Tags 264 MiB
278390f5bf
Commit Graph

149 Commits

Author SHA1 Message Date
Elek, Márton
0c1fec34f4 HDDS-1425. Ozone compose files are not compatible with the latest docker-compose. (#727) 2019-04-12 09:45:36 -07:00
Márton Elek
8ef3bc8113
HDDS-1383. Create project skeleton with CLI interface for In-place upgrade. 
Closes #694
 2019-04-09 17:35:14 +02:00
Elek, Márton
89f9c8604b HDDS-1385. Make the ozonesecure-mr environment definition version independent. Contributed by Elek, Marton. (#695) 
(cherry picked from commit d758c978735fc9c0adb232527b2c3c0bdce1bafa)
 2019-04-05 09:30:40 -07:00
Ajay Kumar
0356b3699d HDDS-1333. OzoneFileSystem can't work with spark/hadoop2.7 because incompatible security classes. Contributed by Elek, Marton. (#653) 
(cherry picked from commit 7ec6a31eb314b9ecc1c2affbcc7d63c07bd33523)
 2019-04-05 09:29:21 -07:00
avijayanhwx
59022b28b7 HDDS-1330 : Add a docker compose for Ozone deployment with Recon. (#669) 2019-04-03 13:20:51 -07:00
Shashikant Banerjee
7cd7045eea HDDS-1164. Add New blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi. 2019-04-03 22:19:10 +05:30
Vivek Ratnavel Subramanian
04f1db8936 HDDS-1260. Create Recon Server lifecyle integration with Ozone. (#643) 2019-04-01 09:59:32 -07:00
Ajay Kumar
5f951ea2e3
HDDS-1255. Refactor ozone acceptance test to allow run in secure mode 2019-04-01 17:04:28 +02:00
Shashikant Banerjee
0df949202a HDDS-1067 . freon run on client gets hung when two of the datanodes are down in 3 datanode cluster. Contributed by Nilotpal Nandi. 2019-04-01 19:02:56 +05:30
Xiaoyu Yao
8a59efee34
HDDS-1346. Remove hard-coded version ozone-0.5.0 from ReadMe of ozonesecure-mr docker-compose. Contributed by Xiaoyu Yao. 
This closes #652.
 2019-03-27 21:52:36 -07:00
Xiaoyu Yao
6a34c9bb29
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao. 
This closes #627.
 2019-03-23 09:22:34 -07:00
Xiaoyu Yao
992489c11c
HDDS-1215. Change hadoop-runner and apache/hadoop base image to use Java8. Contributed by Xiaoyu Yao. 
This closes #615
 2019-03-19 09:55:52 -07:00
Ajay Yadav
f10d493325
HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. (#601) 2019-03-18 23:08:17 -07:00
Sammi Chen
4d2a116d6e HDDS-699. Detect Ozone Network topology. Contributed by Sammi Chen. 2019-03-17 17:08:29 +08:00
Shashikant Banerjee
a7f5e742a6 HDDS-1088. Add blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi. 2019-03-15 20:54:41 +05:30
Vivek Ratnavel Subramanian
9001508485 HDDS-761. Create S3 subcommand to run S3 related operations. 
Closes #579
 2019-03-14 21:16:59 -07:00
Márton Elek
3d140a537a
HDDS-1247. Bump trunk ozone version to 0.5.0. Contributed by Elek, Marton. 
Closes #588
 2019-03-14 12:01:25 +01:00
Ajay Yadav
dcb0de848d
HDDS-1043. Enable token based authentication for S3 api 
Closes #561
 2019-03-12 18:47:06 +01:00
Ajay Yadav
599e926d46 HDDS-596. Add robot test for OM Block Token. Contributed by Ajay Kumar. 
This closes (#581)
 2019-03-11 15:01:04 -07:00
Bharat Viswanadham
73e1801b2d
HDDS-1242. In S3 when bucket already exists, it should just return location. 2019-03-09 21:42:17 -08:00
Elek, Márton
c072458e5d HDDS-1213. Support plain text S3 MPU initialization request. 2019-03-08 09:55:31 -08:00
Yiqun Lin
fb851c9481 HDDS-1232. Recon Container DB service definition. Contributed by Aravindan Vijayan. 2019-03-08 16:59:41 +08:00
Vivek Ratnavel Subramanian
475011bbf8
HDDS-1226. ozone-filesystem jar missing in hadoop classpath 
Closes #560
 2019-03-07 14:09:13 +01:00
Hanisha Koneru
0eba4079bc
HDDS-1225. Provide docker-compose for OM HA. 
Closes #562
 2019-03-07 11:10:04 +01:00
Vivek Ratnavel Subramanian
a55fc36299 HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values. 2019-03-06 17:43:57 -08:00
Ajay Kumar
9d87247af3
HDDS-1216. Change name of ozoneManager service in docker compose files to om. 
Closes #553
 2019-03-06 15:18:39 +01:00
Elek, Márton
7f636b47b5 HDDS-919. Enable prometheus endpoints for Ozone datanodes (#502) 
Pull request from Elek, Márton. (#502)
 2019-03-05 12:04:57 -08:00
Arpit Agarwal
3ef1235215
HDDS-1218. Do the dist-layout-stitching for Ozone after the test-compile phase. Contributed by Marton Elek. 2019-03-05 10:25:31 -08:00
Anu Engineer
eae3db9649 HDDS-1191. Replace Ozone Rest client with S3 client in smoketests and docs. 
Contributed Elek, Marton.
 2019-02-28 17:14:47 -08:00
Xiaoyu Yao
3a8118b480
HDDS-1190. Fix jdk 11 issue for ozonesecure base image and docker-compose . Contributed by Xiaoyu Yao. 2019-02-28 15:51:08 +01:00
Xiaoyu Yao
0e450202a6
HDDS-1019. Use apache/hadoop-runner image to test ozone secure cluster. Contributed by Xiaoyu Yao. 2019-02-27 12:44:04 +01:00
Xiaoyu Yao
9e0f3d1c52 HDDS-1038. Support Service Level Authorization for Ozone. Contributed by Xiaoyu Yao and Ajay Kumar. 2019-02-26 06:02:10 -08:00
Márton Elek
642fe6a260
HDDS-1135. Ozone jars are missing in the Ozone Snapshot tar. Contributed by Dinesh Chitlangia. 2019-02-20 12:08:24 +01:00
Anu Engineer
7ea91494ce HDDS-1041. Support TDE(Transparent Data Encryption) for Ozone. 
Contributed by Xiaoyu Yao.
 2019-02-16 10:23:10 -08:00
Elek, Márton
afe126d71f HDDS-1114. Fix findbugs/checkstyle/accepteance errors in Ozone. Contributed by Marton Elek. 2019-02-15 11:49:52 -08:00
Anu Engineer
217bdbd940 HDDS-1116.Add java profiler servlet to the Ozone web servers. 
Contributed by Elek, Marton.
 2019-02-15 11:32:06 -08:00
Elek, Márton
d10444e79c
HDDS-1092. Use Java 11 JRE to run Ozone in containers. 2019-02-15 17:26:56 +01:00
Anu Engineer
75e15cc0c4 HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects. 
Contributed by Elek, Marton.
 2019-02-14 23:33:25 -08:00
Anu Engineer
506bd02c63 HDDS-905. Create informative landing page for Ozone S3 gateway. 
Contributed by Elek, Marton.
 2019-02-14 23:16:23 -08:00
Mukul Kumar Singh
73b67b2df5 HDDS-1040. Add blockade Tests for client failures. Contributed by Nilotpal Nandi. 2019-02-11 20:08:25 +05:30
Márton Elek
e7d1ae52d2 HDDS-1017. Use distributed tracing to indentify performance problems in Ozone. Contributed by Elek, Marton. 2019-02-11 12:18:26 +01:00
Xiaoyu Yao
e50dc7ee59 HDDS-1018. Update the base image of krb5 container for the secure ozone cluster. Contributed by Xiaoyu Yao. 2019-02-08 12:45:49 -08:00
Bharat Viswanadham
a140a890c6 HDDS-1069. Temporarily disable the security acceptance tests by default in Ozone. Contributed by Marton Elek. 2019-02-07 18:05:05 -08:00
Bharat Viswanadham
75e8441c61 HDDS-1071. Make Ozone s3 acceptance test suite centos compatible. Contributed by Elek Marton. 2019-02-07 08:53:11 -08:00
Márton Elek
a65aca2fef HDDS-922. Create isolated classloder to use ozonefs with any older hadoop versions. Contributed by Elek, Marton. 2019-02-07 17:02:03 +01:00
Mukul Kumar Singh
911790cc26 HDDS-1027. Add blockade Tests for datanode isolation and scm failures. Contributed by Nilotpal Nandi. 2019-02-06 11:32:38 +05:30
Márton Elek
9ace37b119 HDDS-987. MultipartUpload: S3API for list parts of a object. Contributed by Bharat Viswanadham. 2019-02-05 13:08:36 +01:00
Mukul Kumar Singh
13aa939224 HDDS-997. Add blockade Tests for scm isolation and mixed node isolation. Contributed by Nilotpal Nandi. 2019-02-01 13:10:17 +05:30
Bharat Viswanadham
945a61c164 HDDS-549. Add support for key rename in Ozone Shell. Contributed by Doroszlai Attila. 2019-01-30 16:00:18 -08:00
Márton Elek
0e95ae402c HDDS-1030. Move auditparser robot tests under ozone basic. Contributed by Dinesh Chitlangia. 2019-01-30 17:34:32 +01:00
Nanda kumar
8ff9578126 HDDS-1007. Add robot test for AuditParser. 
Contributed by Dinesh Chitlangia.
 2019-01-25 12:14:10 +05:30
Márton Elek
4e0aa2ceac HDDS-948. MultipartUpload: S3 API for Abort Multipart Upload. Contributed by Bharat Viswanadham. 2019-01-24 20:24:19 +01:00
Márton Elek
3c7d700b65 HDDS-1002. ozonesecure compose incompatible with smoke test. Contributed by Doroszlai, Attila. 2019-01-24 17:17:40 +01:00
Márton Elek
09a5859f58 HDDS-993. Update hadoop version to 3.2.0. Contributed by Supratim Deka. 2019-01-24 11:32:58 +01:00
Elek, Márton
0b91329ed6 HDDS-764. Run S3 smoke tests with replication STANDARD. (#462) 
HDDS-764. Run S3 smoke tests with replication STANDARD. Contributed by Elek, Marton.
 2019-01-23 11:37:49 -08:00
Shashikant Banerjee
e72e27edd8 HDDS-932. Add blockade Tests for Network partition. Contributed by Nilotpal Nandi. 2019-01-23 14:05:49 +05:30
Xiaoyu Yao
53120e2e6c HDDS-592. Fix ozone-secure.robot test. Contributed by Ajay Kumar. 2019-01-15 23:01:03 -07:00
Xiaoyu Yao
61e85d7cd1 HDDS-684. Fix HDDS-4 branch after HDDS-490 and HADOOP-15832. Contributed by Xiaoyu Yao. 2019-01-15 23:01:03 -07:00
Xiaoyu Yao
16e0bb874d HDDS-591. Adding ASF license header to kadm5.acl. Contributed by Ajay Kumar. 2019-01-15 23:01:03 -07:00
Xiaoyu Yao
0aab74026e HDDS-10. Add kdc docker image for secure ozone cluster. Contributed by Ajay Kumar. 2019-01-15 23:01:03 -07:00
Ajay Kumar
d4511889fd HDDS-566. Move OzoneSecure docker-compose after HDDS-447. Contributed by Xiaoyu Yao. 2019-01-15 23:01:03 -07:00
Márton Elek
999f31fd20 HDDS-924. MultipartUpload: S3 APi for complete Multipart Upload. Contributed by Bharat Viswanadham. 2019-01-08 15:48:48 +01:00
Márton Elek
d66925a315 HDDS-902. MultipartUpload: S3 API for uploading a part file. Contributed by Bharat Viswanadham. 2019-01-07 12:39:46 +01:00
Márton Elek
992dd9d189 HDDS-901. MultipartUpload: S3 API for Initiate multipart upload. Contributed by Bharat Viswanadham. 2019-01-07 12:06:22 +01:00
Bharat Viswanadham
99b5061265 HDDS-914. Add Grafana support to ozoneperf docker container. Contributed by Dinesh Chitlangia. 2018-12-18 09:59:13 -08:00
Xiaoyu Yao
94b368f29f HDDS-99. Adding SCM Audit log. Contributed by Dinesh Chitlangia. 2018-12-17 15:40:22 -08:00
Mukul Kumar Singh
92d44b2ad0 HDDS-876. Add blockade tests for flaky network. Contributed by Nilotpal Nandi. 2018-12-13 13:35:40 +05:30
Márton Elek
21c9080121 HDDS-872. Add Dockerfile and skaffold config to deploy ozone dev build to k8s. Contributed by Elek, Marton. 2018-12-11 16:31:33 +01:00
Anu Engineer
34a914be03 HDDS-846. Exports ozone metrics to prometheus. 
Contributed by Elek, Marton.
 2018-11-27 15:57:24 -08:00
Márton Elek
22867deffa HDDS-791. Support Range header for ozone s3 object download. Contributed by Bharat Viswanadham. 2018-11-21 17:04:53 +01:00
Xiaoyu Yao
29374999b6 HDDS-120. Adding HDDS datanode Audit Log. Contributed by Dinesh Chitlangia. 2018-11-16 14:59:59 -08:00
Nanda kumar
c4d9640028 HDDS-801. Quasi close the container when close is not executed via Ratis. 
Contributed by Nanda kumar.
 2018-11-16 23:11:33 +05:30
Márton Elek
d40912b1bd HDDS-223. Create acceptance test for using datanode plugin. Contributed by Sandeep Nemuri. 2018-11-15 15:18:07 +01:00
Anu Engineer
9b01f039eb HDDS-832. Docs folder is missing from the Ozone distribution package. Contributed by Elek, Marton. 2018-11-15 11:08:48 +01:00
Márton Elek
9c32b50d61 HDDS-767. OM should not search for STDOUT root logger for audit logging. Contributed by Dinesh Chitlangia. 2018-11-12 10:54:41 +01:00
Márton Elek
3d5cc1138a HDDS-798. Storage-class is showing incorrectly. Contributed by Bharat Viswanadham. 2018-11-06 18:28:54 +01:00
Bharat Viswanadham
478b2cba0d HDDS-773. Loading ozone s3 bucket browser could be failed. Contributed by Elek Marton. 2018-10-31 07:54:23 -07:00
Márton Elek
ecac351aac HDDS-712. Use x-amz-storage-class to specify replication type and replication factor. Contributed by Bharat Viswanadham. 2018-10-31 13:28:59 +01:00
Arpit Agarwal
a58048e8d5 HDDS-727. ozone.log is not getting created in logs directory. Contributed by Nilotpal Nandi. 2018-10-29 09:35:18 -07:00
Bharat Viswanadham
021caaa55e HDDS-516. Implement CopyObject REST endpoint. Contributed by Bharat Viswanadham. 2018-10-24 15:53:31 -07:00
Anu Engineer
9aebafd2da HDDS-701. Support key multi-delete. 
Contributed by Elek, Marton.
 2018-10-19 10:13:08 -07:00
Jitendra Pandey
d93d515af5 HDDS-651. Rename o3 to o3fs for Filesystem. 2018-10-17 14:19:17 -07:00
Bharat Viswanadham
657032f5dd HDDS-665. Add hdds.datanode.dir to docker-config. Contributed by Bharat Viswanadham. 2018-10-16 15:29:53 -07:00
Márton Elek
0c2914e582 HDDS-657. Remove {volume} path segments from all the remaining rest endpoints. Contributed by Elek, Marton. 2018-10-16 17:30:53 +02:00
Arpit Agarwal
2614078b21 HDDS-490. Improve om and scm start up options . Contributed by Namit Maheshwari. 2018-10-15 16:45:08 -07:00
Márton Elek
cdad91c039 HDDS-616. Collect all the robot test outputs and return with the right exit code. Contributed by Elek, Marton. 2018-10-13 08:40:49 +02:00
Bharat Viswanadham
28ca5c9d16 HDDS-613. Update HeadBucket, DeleteBucket to not to have volume in path. Contributed by Bharat Viswanadham. 2018-10-12 16:59:11 -07:00
Anu Engineer
3c1fe073d2 HDDS-445. Create a logger to print out all of the incoming requests. 
Contributed by Bharat Viswanadham.
 2018-10-12 16:27:54 -07:00
Arpit Agarwal
85ccab7d3f HDDS-641. Fix ozone filesystem robot test. Contributed by Mukul Kumar Singh. 2018-10-12 11:30:57 -07:00
Bharat Viswanadham
38fe447d93 HDDS-524. Implement PutBucket REST endpoint. Contributed by Bharat Viswanadham. 2018-10-12 09:58:16 -07:00
Márton Elek
600438bcde HDDS-602. Bump Ozone version to 0.4.0-SNAPSHOT after ozone-0.3 branch cut. 2018-10-09 19:04:25 +02:00
Márton Elek
25b1e8a48e HDDS-512. Addendum: update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia. 2018-10-05 13:32:47 +02:00
Márton Elek
0e28ef35be HDDS-512. update test.sh to remove robot framework & python-pip installation. Contributed by Dinesh Chitlangia. 2018-10-05 13:20:27 +02:00
Márton Elek
9bc8b1cfd3 HDDS-578. om-audit-log4j2.properties must be packaged in ozone-dist . Contributed by Dinesh Chitlangia. 2018-10-05 04:33:19 -04:00
Anu Engineer
153941b236 HDDS-479. Add more ozone fs tests in the robot integration framework. 
Contributed by  Nilotpal Nandi.
 2018-10-04 22:53:51 -07:00
Bharat Viswanadham
7d082193d2 HDDS-562. Create acceptance test to test aws cli with the s3 gateway. Contributed by Elek Marton. 2018-10-01 15:04:20 -07:00
Bharat Viswanadham
9c3fbbc4f6 HDDS-444. Add rest service to the s3gateway. Contributed by Elek Marton. 2018-09-24 22:10:16 -07:00
Bharat Viswanadham
67173b4847 HDDS-441. Create new s3gateway daemon. Contributed by Elek Marton. 2018-09-24 13:42:55 -07:00
Bharat Viswanadham
62f817d32e HDDS-447. Separate ozone-dist and hadoop-dist projects with real classpath separation. Contributed by Elek Marton. 2018-09-24 10:10:11 -07:00