big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,614 Commits 2 Branches 2 Tags 264 MiB
260d843b25
Commit Graph

689 Commits

Author SHA1 Message Date
Bharat Viswanadham
77fe51e136
HDDS-1379. Convert all OM Volume related operations to HA model. (#689) 2019-04-04 21:09:50 -07:00
Bharat Viswanadham
d2141ef886
HDDS-1189. Build failing due to rat check failure introduced by HDDS-1189. Contributed by Siddharth Wagle. 2019-04-04 17:38:02 -07:00
avijayanhwx
993f36ee33 HDDS-1353 : Metrics scm_pipeline_metrics_num_pipeline_creation_failed keeps increasing because of BackgroundPipelineCreator. (#681) 2019-04-04 19:18:32 +05:30
Yiqun Lin
a92806d05a HDDS-1189. Recon Aggregate DB schema and ORM. Contributed by Siddharth Wagle. 2019-04-04 17:33:37 +08:00
Hanisha Koneru
f09a78f73f
HDDS-1339. Implement ratis snapshots on OM (#651) 2019-04-03 22:50:28 -07:00
Hanisha Koneru
4e64f8d763 HDDS-1324. TestOzoneManagerHA tests are flaky (#676) 2019-04-03 16:02:19 -07:00
Bharat Viswanadham
358f7f9b99
HDDS-1211. Test SCMChillMode failing randomly in Jenkins run (#543) 2019-04-03 15:02:00 -07:00
avijayanhwx
8ff41d6243 HDDS-1358 : Recon Server REST API not working as expected. (#668) 2019-04-03 14:52:06 -07:00
avijayanhwx
59022b28b7 HDDS-1330 : Add a docker compose for Ozone deployment with Recon. (#669) 2019-04-03 13:20:51 -07:00
Xiaoyu Yao
d6c233fce6 HDDS-1377. OM failed to start with incorrect hostname set as ip address in CSR. (#683) 2019-04-03 11:53:51 -07:00
Shashikant Banerjee
7cd7045eea HDDS-1164. Add New blockade Tests to test Replica Manager. Contributed by Nilotpal Nandi. 2019-04-03 22:19:10 +05:30
Ajay Kumar
bfc90bdc64
HDDS-1355. Only FQDN is accepted for OM rpc address in secure environment. Contributed by Ajay Kumar. 
Closes #677
 2019-04-02 15:43:01 +02:00
Kitti Nanasi
aeb43dfba3
HDDS-1153. Make tracing instrumentation configurable 
Closes #673
 2019-04-02 14:21:47 +02:00
Yiqun Lin
d31c86892e HDDS-1337. Handle GroupMismatchException in OzoneClient. Contributed by Shashikant Banerjee. 2019-04-02 16:32:30 +08:00
Vivek Ratnavel Subramanian
04f1db8936 HDDS-1260. Create Recon Server lifecyle integration with Ozone. (#643) 2019-04-01 09:59:32 -07:00
Ajay Kumar
5f951ea2e3
HDDS-1255. Refactor ozone acceptance test to allow run in secure mode 2019-04-01 17:04:28 +02:00
Shashikant Banerjee
0df949202a HDDS-1067 . freon run on client gets hung when two of the datanodes are down in 3 datanode cluster. Contributed by Nilotpal Nandi. 2019-04-01 19:02:56 +05:30
Shashikant Banerjee
ef5de29243 HDDS-1312. Add more unit tests to verify BlockOutputStream functionalities. Contributed by Shashikant Banerjee. 2019-04-01 16:09:58 +05:30
Shashikant Banerjee
509f31b109 HDDS-1295. Add MiniOzoneChaosCluster to mimic long running workload in a unit test environment. Contributed by Mukul Kumar Singh. 2019-04-01 15:50:03 +05:30
Bharat Viswanadham
bf3b7fd732
HDDS-1288. SCM - Failing test on trunk that waits for HB report processing. Contributed by Siddharth Wagle. 2019-03-30 10:54:45 -07:00
Elek, Márton
ec82e4cab2 HDDS-1357. ozone s3 shell command has confusing subcommands (#663) 2019-03-30 10:13:29 -07:00
Doroszlai, Attila
7dc0ecc446 [HDDS-1351] NoClassDefFoundError when running ozone genconf (). Contributed by Doroszlai Attila. 
This closes #659.
 2019-03-29 09:01:56 -07:00
Lokesh Jain
6186ed94b9 HDDS-1300. Optimize non-recursive ozone filesystem apis. Contributed by Lokesh Jain. 2019-03-29 19:27:29 +05:30
Xiaoyu Yao
ca5e4ce036
HDDS-1318. Fix MalformedTracerStateStringException on DN logs. Contributed by Xiaoyu Yao. 
This closes #641
 2019-03-28 12:00:58 -07:00
Xiaoyu Yao
8a59efee34
HDDS-1346. Remove hard-coded version ozone-0.5.0 from ReadMe of ozonesecure-mr docker-compose. Contributed by Xiaoyu Yao. 
This closes #652.
 2019-03-27 21:52:36 -07:00
Vivek Ratnavel Subramanian
b2269581f7 HDDS-1264. Remove Parametrized in TestOzoneShell. (#614) 2019-03-26 22:07:22 -07:00
Bharat Viswanadham
eef8cae7cf
HDDS-1262. In OM HA OpenKey call Should happen only leader OM. (#626) 2019-03-26 21:48:01 -07:00
Shweta Yakkali
f426b7ce8f
HDDS-139. Output of createVolume can be improved. Contributed by Shweta. 2019-03-26 19:01:49 -07:00
Ajay Yadav
82d477293c HDDS-939. Add S3 access check to Ozone manager. Contributed by Ajay Kumar. (#634) 2019-03-26 08:59:59 -07:00
Yiqun Lin
c99b107772 HDDS-1334. Fix asf license errors in newly added files by HDDS-1234. Contributed by Aravindan Vijayan. 2019-03-26 11:51:04 +08:00
Yiqun Lin
e5d72f504e HDDS-1234. Iterate the OM DB snapshot and populate the recon container DB. Contributed by Aravindan Vijayan. 2019-03-25 22:52:02 +08:00
Mukul Kumar Singh
67dd45fc25 HDDS-1185. Optimize GetFileStatus in OzoneFileSystem by reducing the number of rpc call to OM. Contributed by Mukul Kumar Singh. 2019-03-25 17:03:30 +05:30
Shashikant Banerjee
d4e4a7d456 HDDS-1317. KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples. Contributed by Shashikant Banerjee. 2019-03-25 15:41:20 +05:30
Xiaoyu Yao
6a34c9bb29
HDDS-1299. Support TokenIssuer interface for running jobs with OzoneFileSystem. Contributed by Xiaoyu Yao. 
This closes #627.
 2019-03-23 09:22:34 -07:00
Xiaoyu Yao
dea6f2a065 HDDS-1291. Set OmKeyArgs#refreshPipeline flag properly to avoid reading from stale pipeline. Contributed by Xiaoyu Yao. (#639) 2019-03-22 15:08:28 -07:00
Arpit Agarwal
1d389ecb24
HDDS-1323. Ignore unit test TestFailureHandlingByClient. Contributed by Supratim Deka. 2019-03-22 11:29:56 -07:00
Arpit Agarwal
90afc9ab03
HDDS-1320. Update ozone to latest ratis snapshot build (0.4.0-1fc5ace-SNAPSHOT). Contributed by Mukul Kumar Singh. 2019-03-21 14:24:02 -07:00
Arpit Agarwal
2828f8c339 HDDS-1321. TestOzoneManagerHttpServer depends on hard-coded port numbers. Contributed by Arpit Agarwal. (#633) 
Change-Id: I9656af4a7f41812da9d125c10ae0e8daf3dcf7f5
 2019-03-21 14:18:58 -07:00
Yiqun Lin
60cdd4cac1 HDDS-1233. Create an Ozone Manager Service provider for Recon. Contributed by Aravindan Vijayan. 2019-03-21 11:02:29 +08:00
Bharat Viswanadham
310ebf5dc8 HDDS-1308. Fix asf license errors. (#623) 2019-03-19 14:06:39 -07:00
Bharat Viswanadham
1639071b05 HDDS-1307. Test ScmChillMode testChillModeOperations failed. (#622) 
HDDS-1307. Test ScmChillMode testChillModeOperations failed. Contributed by Bharat Viswanadham. (#622)
 2019-03-19 13:57:02 -07:00
Xiaoyu Yao
992489c11c
HDDS-1215. Change hadoop-runner and apache/hadoop base image to use Java8. Contributed by Xiaoyu Yao. 
This closes #615
 2019-03-19 09:55:52 -07:00
Ajay Yadav
f10d493325
HDDS-1119. DN get OM certificate from SCM CA for block token validation. Contributed by Ajay Kumar. (#601) 2019-03-18 23:08:17 -07:00
Bharat Viswanadham
93db5da4d9
HDDS-1250. In OM HA AllocateBlock call where connecting to SCM from OM should not happen on Ratis. 2019-03-18 13:51:44 -07:00
Xiaoyu Yao
66a104bc57 HDDS-1296. Fix checkstyle issue from Nightly run. Contributed by Xiaoyu Yao. (#616) 2019-03-18 08:38:55 -07:00
Sammi Chen
4d2a116d6e HDDS-699. Detect Ozone Network topology. Contributed by Sammi Chen. 2019-03-17 17:08:29 +08:00
Xiaoyu Yao
5cfb88a225 HDDS-1246. Add ozone delegation token utility subcmd for Ozone CLI. Contributed by Xiaoyu Yao. (#594) 2019-03-15 16:08:30 -07:00
Elek, Márton
16b78622cc HDDS-1283. Fix the dynamic documentation of basic s3 client usage. Contributed by Elek, Marton. (#605) 2019-03-15 14:12:10 -07:00
Xiaoyu Yao
d1afa03804
HDDS-1138. Ozone Client should avoid talking to SCM directly. Contributed by Xiaoyu Yao and Mukul Kumar Singh. 
Closes #585
 2019-03-15 10:41:06 -07:00
Elek, Márton
dc21655f2a HDDS-1259. OzoneFS classpath separation is broken by the token validation. Contributed by Elek Marton. 
Closes #604
 2019-03-15 09:43:01 -07:00