big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,200 Commits 2 Branches 2 Tags 264 MiB
f6697aa82b
Commit Graph

159 Commits

Author SHA1 Message Date
Siddharth
a031388a2e HDDS-2266. Avoid evaluation of LOG.trace and LOG.debug statement in the read/write path. (#1633) 2019-10-10 15:30:11 +05:30
Istvan Fajth
1d27930407 HDDS-2233 - Remove ByteStringHelper and refactor the code to the place where it used (#1596) 2019-10-09 11:28:47 +05:30
Anu Engineer
685918ef41
HDDS-2227. GDPR key generation could benefit from secureRandom. (#1574) 2019-10-02 12:34:53 -07:00
Vivek Ratnavel Subramanian
dbdc612b3b HDDS-2163. Add 'Replication factor' to the output of list keys (#1493) 2019-09-20 22:59:45 -07:00
Xiaoyu Yao
d072d3304c HDDS-2020. Remove mTLS from Ozone GRPC. Contributed by Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-19 22:43:00 -07:00
Elek, Márton
da1c67e0c2 HDDS-1054. List Multipart uploads in a bucket (#1277) 2019-09-19 11:06:02 -07:00
bshashikant
2c52d00a27
HDDS-2032. Ozone client should retry writes in case of any ratis/stateMachine exceptions. Contributed by Shashikant Banerjee (#1420). 2019-09-18 22:30:41 +05:30
Siyao Meng
e22a324f87 HDDS-2007. Make ozone fs shell command work with OM HA service ids (#1360) 2019-09-13 11:22:00 -07:00
Doroszlai, Attila
64ed6b177d HDDS-2075. Tracing in OzoneManager call is propagated with wrong parent (#1415) 2019-09-11 11:59:01 -07:00
dchitlangia
b15c116c1e HDDS-2015. Encrypt/decrypt key using symmetric key while writing/reading 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-09-06 11:35:00 -07:00
Anu Engineer
dc72782008 HDDS-738. Removing REST protocol support from OzoneClient. 
Contributed by Elek, Marton.
 2019-08-28 09:53:31 -07:00
Xiaoyu Yao
d58eba8672 HDDS-1927. Consolidate add/remove Acl into OzoneAclUtil class. Contributed by Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-21 16:16:18 -07:00
Bharat Viswanadham
a46ba03d15
HDDS-1913. Fix OzoneBucket and RpcClient APIS for acl. (#1257) 2019-08-16 16:39:49 -07:00
Doroszlai, Attila
46d61913ff HDDS-1954. StackOverflowError in OzoneClientInvocationHandler 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-15 10:46:43 -07:00
Sammi Chen
8f9245bc2d HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (#1184) 2019-08-07 16:59:13 -07:00
Xiaoyu Yao
d429d742f0 HDDS-1544. Support default Acls for volume, bucket, keys and prefix. Contributed by Ajay Kumar, Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-16 12:58:59 -07:00
Shashikant Banerjee
d21eccf8ba HDDS-1492. Generated chunk size name too long. Contributed by Shashikannt Banerjee. (#1084) 2019-07-16 18:01:13 +05:30
Ajay Yadav
cdb20adfcc HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. (#973) 2019-07-10 11:03:58 -07:00
Márton Elek
bbf5844968
HDDS-1525. Mapreduce failure when using Hadoop 2.7.5 
Closes #1065
 2019-07-10 15:31:28 +02:00
Hanisha Koneru
8861573e8c
HDDS-1717. MR Job fails as OMFailoverProxyProvider has dependency hadoop-3.2 
Closes #1056
 2019-07-09 13:22:00 +02:00
Elek, Márton
46b23c11b0 HDDS-1636. Tracing id is not propagated via async datanode grpc call (#895) 2019-06-07 20:40:32 -07:00
Hanisha Koneru
a91d24fea4
HDDS-1496. Support partial chunk reads and checksum verification (#804) 2019-06-06 19:44:40 -07:00
Hanisha Koneru
0b115b60b0 HDDS-1371. OMSnapshotProvider to download DB checkpoint from leader OM. (#703) 2019-06-06 19:42:34 -07:00
Ajay Yadav
3b1c2577d7 HDDS-1541. Implement addAcl,removeAcl,setAcl,getAcl for Key. Contributed by Ajay Kumat. (#885) 2019-06-05 14:42:10 -07:00
Ajay Yadav
12be6ff2ff HDDS-1539. Implement addAcl,removeAcl,setAcl,getAcl for Volume. Contributed Ajay Kumar. (#847) 2019-05-29 23:18:06 -07:00
Shashikant Banerjee
83549dbbea HDDS-1509. TestBlockOutputStreamWithFailures#test2DatanodesFailure fails intermittently. Contributed by Shashikant Banerjee (#805). 2019-05-27 16:31:44 +05:30
Ajay Yadav
ef1cc725b8
HDDS-1538. Update ozone protobuf message for ACLs. Contributed by Ajay Kumar. (#828) 2019-05-21 15:53:40 -07:00
Lokesh Jain
c1d7d68c78
HDDS-1461. Optimize listStatus api in OzoneFileSystem (#782) 2019-05-21 14:47:48 +05:30
Hanisha Koneru
02c9efcb81
HDDS-1491. Ozone KeyInputStream seek() should not read the chunk file. (#795) 2019-05-13 20:49:52 -07:00
avijayanhwx
25951255ce HDDS-1500. Allocate block failures in client should print exception trace. Contributed by Aravindan Vijayan (#801). 2019-05-09 15:38:49 +05:30
Shashikant Banerjee
7f0e2c67e0 HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749). Contributed by Shashikant Banerjee 2019-05-08 01:00:10 +05:30
Shashikant Banerjee
01451a57de Revert "HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749)" 
This reverts commit d525633619.
 2019-05-08 00:49:15 +05:30
bshashikant
d525633619
HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749) 
HDDS-1395. Key write fails with BlockOutputStream has been closed exception (#749).
 2019-05-08 00:38:53 +05:30
Siddharth
1d70c8ca0f HDDS-1464. Client should have different retry policies for different exceptions. (#785) 2019-05-05 09:21:15 -07:00
Ajay Yadav
95790bb7e5
HDDS-1430. NPE if secure ozone if KMS uri is not defined. Contributed by Ajay Kumar. (#752) 2019-04-29 14:07:23 -07:00
Hanisha Koneru
37582705fa
HDDS-1403. KeyOutputStream writes fails after max retries while writing to a closed container (#753) 2019-04-26 10:39:03 -07:00
Márton Elek
b979fdde99
HDDS-1447. Fix CheckStyle warnings. Contributed by Wanqiang Ji. 2019-04-18 08:54:43 +02:00
Shashikant Banerjee
d608be660f HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException.(#729) 2019-04-17 14:49:02 +05:30
Shashikant Banerjee
082f1e0437 Revert "HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException..(#729)" 
This reverts commit df2ae27f3e.
 2019-04-17 14:38:08 +05:30
Shashikant Banerjee
df2ae27f3e HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException..(#729) 2019-04-17 14:25:35 +05:30
Shashikant Banerjee
e5a918cda3 Revert "Merge pull request #729 from bshashikant/HDDS-1373" 
This reverts commit 4ff4314e40, reversing
changes made to 04c0437d13.
 2019-04-17 14:17:54 +05:30
Shashikant Banerjee
22d0468b39 HDDS-1373. KeyOutputStream, close after write request fails after retries, runs into IllegalArgumentException. Contributed by Shashikant Banerjee 2019-04-11 22:13:41 +05:30
Shashikant Banerjee
2d4f6b6daa HDDS-372. There are three buffer copies in BlockOutputStream. Contributed by Shashikant Banerjee. 2019-04-09 10:27:58 +05:30
Kitti Nanasi
aeb43dfba3
HDDS-1153. Make tracing instrumentation configurable 
Closes #673
 2019-04-02 14:21:47 +02:00
Yiqun Lin
d31c86892e HDDS-1337. Handle GroupMismatchException in OzoneClient. Contributed by Shashikant Banerjee. 2019-04-02 16:32:30 +08:00
Shashikant Banerjee
ef5de29243 HDDS-1312. Add more unit tests to verify BlockOutputStream functionalities. Contributed by Shashikant Banerjee. 2019-04-01 16:09:58 +05:30
Lokesh Jain
6186ed94b9 HDDS-1300. Optimize non-recursive ozone filesystem apis. Contributed by Lokesh Jain. 2019-03-29 19:27:29 +05:30
Shweta Yakkali
f426b7ce8f
HDDS-139. Output of createVolume can be improved. Contributed by Shweta. 2019-03-26 19:01:49 -07:00
Mukul Kumar Singh
67dd45fc25 HDDS-1185. Optimize GetFileStatus in OzoneFileSystem by reducing the number of rpc call to OM. Contributed by Mukul Kumar Singh. 2019-03-25 17:03:30 +05:30
Shashikant Banerjee
d4e4a7d456 HDDS-1317. KeyOutputStream#write throws ArrayIndexOutOfBoundsException when running RandomWrite MR examples. Contributed by Shashikant Banerjee. 2019-03-25 15:41:20 +05:30