big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,899 Commits 2 Branches 2 Tags 264 MiB
e78848fc3c
Commit Graph

1068 Commits

Author SHA1 Message Date
Doroszlai, Attila
c4411f7fdf HDDS-2042. Avoid log on console with Ozone shell 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-30 17:40:34 -07:00
Doroszlai, Attila
70855126d1 HDDS-2061. Add hdds.container.chunk.persistdata as exception to TestOzoneConfigurationFields (#1382) 2019-08-30 12:31:52 -07:00
Doroszlai, Attila
472a26d2b8 HDDS-2063. Integration tests create untracked file audit.log (#1384) 2019-08-30 12:23:25 -07:00
dineshchitlangia
46696bd9b0 HDDS-2014. Create Symmetric Key for GDPR (#1362) 2019-08-30 09:55:36 -07:00
Xiaoyu Yao
ec34cee5e3
HDDS-2047. Datanodes fail to come up after 10 retries in a secure env… (#1379) 2019-08-30 09:27:37 -07:00
Nanda kumar
22a58615a2
HDDS-2058. Remove hadoop dependencies in ozone build 
Closes #1376
 2019-08-30 10:21:04 +02:00
Elek, Márton
4f5f46eb4a HDDS-1935. Improve the visibility with Ozone Insight tool (#1255) 2019-08-29 17:07:55 -07:00
Vivek Ratnavel Subramanian
7b3fa4fcaa HDDS-2050. Error while compiling ozone-recon-web (#1374) 2019-08-29 16:57:02 -07:00
Doroszlai, Attila
c749f62470
HDDS-2045. Partially started compose cluster left running 
Closes #1358
 2019-08-29 09:46:50 +02:00
Márton Elek
371c9eb6a6
Revert "HDDS-1596. Create service endpoint to download configuration from SCM." 
This reverts commit c0499bd704.
 2019-08-29 09:25:03 +02:00
Márton Elek
aef6a4fe0d HDDS-1950. S3 MPU part-list call fails if there are no parts 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-28 12:08:16 -07:00
Márton Elek
2fcd0da7dc HDDS-1942. Support copy during S3 multipart upload part creation 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-28 11:56:50 -07:00
Márton Elek
addfb7ff7d HDDS-1937. Acceptance tests fail if scm webui shows invalid json 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-28 11:40:37 -07:00
supratimdeka
1407414a52 HDDS-1094. Performance test infrastructure : skip writing user data on Datanode. Contributed by Supratim Deka (#1323) 2019-08-28 10:05:20 -07:00
Anu Engineer
dc72782008 HDDS-738. Removing REST protocol support from OzoneClient. 
Contributed by Elek, Marton.
 2019-08-28 09:53:31 -07:00
Márton Elek
c0499bd704 HDDS-1596. Create service endpoint to download configuration from SCM. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-28 09:13:46 -07:00
bshashikant
5d31a4eff7 HDDS-1753. Datanode unable to find chunk while replication data using ratis. (#1318) 2019-08-28 10:54:44 +05:30
Vivek Ratnavel Subramanian
b1eee8b52e HDDS-1946. CertificateClient should not persist keys/certs to ozone.m… (#1311) 2019-08-27 17:29:27 -07:00
Nanda kumar
2b9cc7eb95 HDDS-2037. Fix hadoop version in pom.ozone.xml. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-27 16:14:01 -07:00
Shashikant Banerjee
66cfa482c4 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee(#1226). 2019-08-27 23:38:43 +05:30
Shashikant Banerjee
ce8eb1283a Revert "HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee." 
This reverts commit 62445021d5 as it has unintended changes in DirectoryWithSnapshotFeature class..
 2019-08-27 23:23:44 +05:30
HUAN-PING SU
3329257d99 HDDS-1998. TestSecureContainerServer#testClientServerRatisGrpc is failing (#1328) 2019-08-27 11:58:23 +05:30
Bharat Viswanadham
d1aa8596e0
HDDS-1975. Implement default acls for bucket/volume/key for OM HA code. (#1315) 2019-08-26 11:05:40 -07:00
Hanisha Koneru
3f887f3b92
HDDS-1827. Load Snapshot info when OM Ratis server starts. (#1130) 2019-08-23 13:19:13 -07:00
Nanda kumar
20064b69a8
HDDS-1978. Create helper script to run blockade tests. (#1310) 2019-08-23 22:26:30 +05:30
Doroszlai, Attila
75bf090990
HDDS-2024. rat.sh: grep: warning: recursive search of stdin 
Closes #1343
 2019-08-23 12:32:40 +02:00
Vivek Ratnavel Subramanian
e2a55482ee
HDDS-2023. Fix rat check failures in trunk 
Closes #1342
 2019-08-23 12:02:45 +02:00
Vivek Ratnavel Subramanian
b4a95a2b00
HDDS-2000. Don't depend on bootstrap/jquery versions from hadoop-trunk snapshot 
Closes #1339
 2019-08-23 10:56:00 +02:00
Elek, Márton
edd708527d HDDS-1948. S3 MPU can't be created with octet-stream content-type (#1266) 2019-08-22 23:15:43 -07:00
Doroszlai, Attila
f6af7d0fd7 HDDS-1808. TestRatisPipelineCreateAndDestory times out (#1338) 2019-08-22 17:55:42 -07:00
Bharat Viswanadham
4028cac56d
HDDS-1347. In OM HA getS3Secret call Should happen only leader OM. (#670) 2019-08-22 15:00:17 -07:00
avijayanhwx
28fb4b527a HDDS-2008 : Wrong package for RatisHelper class in hadoop-hdds/common module. (#1333) 2019-08-22 10:57:22 -07:00
Xiaoyu Yao
d58eba8672 HDDS-1927. Consolidate add/remove Acl into OzoneAclUtil class. Contributed by Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-21 16:16:18 -07:00
Márton Elek
8fc6567b94 HDDS-1871. Remove anti-affinity rules from k8s minkube example 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-21 12:45:13 -07:00
Doroszlai, Attila
2ae7f444bd HDDS-1999. Basic acceptance test and SCM/OM web UI broken by Bootstrap upgrade (#1327) 2019-08-21 12:16:14 -07:00
Bharat Viswanadham
217e74816c
HDDS-1973. Implement OM RenewDelegationToken request to use Cache and DoubleBuffer. (#1316) 2019-08-21 12:01:27 -07:00
Xiaoyu Yao
10b4997b42
HDDS-1965. Compile error due to leftover ScmBlockLocationTestIngClient file. (fix build) 2019-08-20 16:46:53 -07:00
Xiaoyu Yao
7653ebdbb2
Revert "HDDS-1965. Compile error due to leftover ScmBlockLocationTestIngClient file (#1293)" 
This reverts commit 83e452ecea.
 2019-08-20 16:46:52 -07:00
Sunil G
bd92462321 HDFS-14729. Upgrade Bootstrap and jQuery versions used in HDFS UIs. Contributed by Vivek Ratnavel Subramanian. This closes #1297 2019-08-20 18:42:19 +05:30
Shashikant Banerjee
62445021d5 HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee. 2019-08-20 14:37:01 +05:30
Bharat Viswanadham
4f925afa82
HDDS-1972. Provide example ha proxy with multiple s3 servers back end. (#1304) 2019-08-19 13:59:58 -07:00
avijayanhwx
d69a1a0aa4 HDDS-1105 : Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager (#1259) 2019-08-19 10:47:49 -07:00
Bharat Viswanadham
b83eae7bdb
HDDS-1974. Implement OM CancelDelegationToken request to use Cache and DoubleBuffer. (#1308) 2019-08-18 10:06:00 -07:00
Siyao Meng
3bba8086e0 HDDS-1938. Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter (#1305) 2019-08-17 21:54:48 -07:00
Bharat Viswanadham
a46ba03d15
HDDS-1913. Fix OzoneBucket and RpcClient APIS for acl. (#1257) 2019-08-16 16:39:49 -07:00
Bharat Viswanadham
c8675ec42e
HDDS-1911. Support Prefix ACL operations for OM HA. (#1275) 2019-08-16 15:11:11 -07:00
Bharat Viswanadham
8943e1340d
HDDS-1969. Implement OM GetDelegationToken request to use Cache and DoubleBuffer. (#1296) 2019-08-16 13:22:03 -07:00
Doroszlai, Attila
46d61913ff HDDS-1954. StackOverflowError in OzoneClientInvocationHandler 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-15 10:46:43 -07:00
dineshchitlangia
c801f7a26c HDDS-1768. Audit xxxAcl methods in OzoneManager (#1204) 2019-08-15 08:43:47 -07:00
Doroszlai, Attila
8242085164 HDDS-1964. TestOzoneClientProducer fails with ConnectException 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-14 09:53:31 -07:00
Doroszlai, Attila
06d8ac9522 HDDS-1966. Wrong expected key ACL in acceptance test 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-14 09:34:11 -07:00
Mukul Kumar Singh
2432356570 HDDS-1955. TestBlockOutputStreamWithFailures#test2DatanodesFailure failing because of assertion error. 
Signed-off-by: Nanda kumar <nanda@apache.org>
 2019-08-14 20:37:15 +05:30
Doroszlai, Attila
83e452ecea HDDS-1965. Compile error due to leftover ScmBlockLocationTestIngClient file (#1293) 2019-08-14 18:39:45 +05:30
Márton Elek
846848ac4c HDDS-1914. Ozonescript example docker-compose cluster can't be started 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 23:26:47 -07:00
Doroszlai, Attila
48dc441864 HDDS-1929. OM started on recon host in ozonesecure compose 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 23:12:44 -07:00
Anu Engineer
5a248de511 HDDS-1947. fix naming issue for ScmBlockLocationTestingClient. 
Contributed by star.
 2019-08-13 23:07:02 -07:00
Márton Elek
15545c8bf1 HDDS-1915. Remove hadoop script from ozone distribution 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 22:02:54 -07:00
Doroszlai, Attila
78b714af9c HDDS-1956. Aged IO Thread exits on first read 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 20:34:06 -07:00
Doroszlai, Attila
e6d240dc91 HDDS-1928. Cannot run ozone-recon compose due to syntax error 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 17:27:04 -07:00
Doroszlai, Attila
9691117099 HDDS-1916. Only contract tests are run in ozonefs module 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 16:56:59 -07:00
Nanda kumar
3cff73aff4 HDDS-1917. TestOzoneRpcClientAbstract is failing. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 16:03:31 -07:00
Nanda kumar
cb390dff87 HDDS-1961. TestStorageContainerManager#testScmProcessDatanodeHeartbeat is flaky. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 15:57:24 -07:00
Siyao Meng
68c818415a HDDS-1891. Ozone fs shell command should work with default port when port number is not specified 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 15:30:53 -07:00
Doroszlai, Attila
3dc22d6ef1 HDDS-1952. Disable TestMiniChaosOzoneCluster in integration.sh. (#1284) 
Signed-off-by: Nanda kumar <nanda@apache.org>
 2019-08-13 19:09:01 +05:30
Doroszlai, Attila
0b507d2ddf HDDS-1908. TestMultiBlockWritesWithDnFailures is failing (#1282) 2019-08-13 15:38:55 +05:30
Márton Elek
dfe772d234
HDDS-1912. start-ozone.sh fail due to ozone-config.sh not found. Contributed by kevin su. 2019-08-12 13:03:39 +02:00
Shweta Yakkali
d29007fb35 HDDS-1366. Add ability in Recon to track the number of small files in an Ozone Cluster (#1146) 2019-08-10 10:14:55 -07:00
Xiaoyu Yao
fba222a856
HDDS-1943. TestKeyManagerImpl.testLookupKeyWithLocation is failing. Contributed by Xiaoyu Yao. (#1262) 2019-08-09 22:09:50 -07:00
Bharat Viswanadham
bd4be6e168 HDDS-1895. Support Key ACL operations for OM HA. (#1230) 2019-08-09 20:32:01 -07:00
Nanda kumar
98dd7c48ff HDDS-1906. TestScmSafeMode#testSCMSafeModeRestrictedOp is failing. (#1260) 2019-08-09 11:28:38 -07:00
Doroszlai, Attila
88ed1e0bfd HDDS-1934. TestSecureOzoneCluster may fail due to port conflict (#1254) 2019-08-08 21:38:31 -07:00
Bharat Viswanadham
91f41b7d88
HDDS-1884. Support Bucket ACL operations for OM HA. (#1202) 2019-08-08 21:29:00 -07:00
Bharat Viswanadham
aa5f445fb9
HDDS-1863. Freon RandomKeyGenerator even if keySize is set to 0, it returns some random data to key. (#1167) 2019-08-08 15:40:19 -07:00
Siyao Meng
14a4ce3cee HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. Contributed by Siyao Meng. 2019-08-08 13:38:10 -07:00
Xiaoyu Yao
3ac0f3a0c1
HDDS-1619. Support volume acl operations for OM HA. Contributed by… (#1147) 2019-08-08 09:55:46 -07:00
Bharat Viswanadham
63161cf590
HDDS-1926. The new caching layer is used for old OM requests but not updated 
Closes #1247
 2019-08-08 15:52:04 +02:00
Bharat Viswanadham
70b4617cfe
HDDS-1900. Remove UpdateBucket handler which supports add/remove Acl. (#1219) 2019-08-07 17:07:40 -07:00
Doroszlai, Attila
ab6a5c9d07 HDDS-1925. ozonesecure acceptance test broken by HTTP auth requirement (#1248) 2019-08-07 17:07:15 -07:00
Sammi Chen
8f9245bc2d HDDS-1865. Use "ozone.network.topology.aware.read" to control both RPC client and server side logic (#1184) 2019-08-07 16:59:13 -07:00
Xiaoyu Yao
70f46746b1
HDDS-1907. TestOzoneRpcClientWithRatis is failing with ACL errors. 
Signed-off-by: Nanda kumar <nanda@apache.org>
 2019-08-07 18:34:05 +05:30
Doroszlai, Attila
9cd211ac86 HDDS-1921. TestOzoneManagerDoubleBufferWithOMResponse is flaky (#1238) 2019-08-06 21:14:41 -07:00
HUAN-PING SU
38e6968647 HDDS-1919. Fix Javadoc in TestAuditParser (#1240) 2019-08-06 18:00:34 -07:00
Doroszlai, Attila
c4d97ae500 HDDS-1918. hadoop-ozone-tools has integration tests run as unit (#1236) 2019-08-06 17:00:54 -07:00
Xiaoyu Yao
a63023f261
HDDS-1901. Fix Ozone HTTP WebConsole Authentication. Contributed by Xiaoyu Yao. (#1228) 2019-08-06 12:07:53 -07:00
Bharat Viswanadham
c589983e9c HDDS-1893. Fix bug in removeAcl in Bucket. (#1216) 2019-08-05 10:25:18 -07:00
supratimdeka
f8ea6e1ce1 HDDS-1798. Propagate failure in writeStateMachineData to Ratis. Contributed by Supratim Deka (#1113) 2019-08-05 13:43:41 +05:30
Vivek Ratnavel Subramanian
ec1d453846 HDDS-1788. Fix kerberos principal error in Ozone Recon. (#1201) 2019-08-03 10:49:07 -07:00
Nanda kumar
eaf350c414 HDDS-1887. Enable all the blockade test-cases. Contibuted by NandaKumar(#1206). 2019-08-02 23:23:11 +05:30
Mukul Kumar Singh
b5c74d4ab8 HDDS-1782. Add an option to MiniOzoneChaosCluster to read files multiple times. Contributed by Mukul Kumar Singh. (#1076) 2019-08-02 21:50:39 +05:30
Bharat Viswanadham
c1f74405d7
HDDS-1885. Fix bug in checkAcls in OzoneManager. (#1199) 2019-07-31 19:00:37 -07:00
Bharat Viswanadham
a6f47b5876 HDDS-1875. Fix failures in TestS3MultipartUploadAbortResponse. (#1188) 2019-07-31 09:37:53 -07:00
Bharat Viswanadham
90e5eb0a48
HDDS-1849. Implement S3 Complete MPU request to use Cache and DoubleBuffer. (#1181) 2019-07-31 09:18:40 -07:00
Doroszlai, Attila
ac8ed7b5db
HDDS-1877. hadoop31-mapreduce fails due to wrong HADOOP_VERSION 
Closes #1193
 2019-07-31 16:07:27 +02:00
Bharat Viswanadham
e5c4131485
HDDS-1856. Make required changes for Non-HA to use new HA code in OM. (#1174) 2019-07-30 22:39:03 -07:00
Doroszlai, Attila
e68d8446c4 HDDS-1834. parent directories not found in secure setup due to ACL check. Contributed by Doroszlai, Attila. 
This closes #1171.
 2019-07-30 13:41:16 -07:00
Bharat Viswanadham
88daa730a3
HDDS-1872. Fix entry clean up from openKeyTable during complete MPU. (#1182) 2019-07-30 09:28:26 -07:00
Bharat Viswanadham
68f9f2d833
Revert HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. (#1183) 2019-07-29 16:44:48 -07:00
Siyao Meng
4d07134b13 HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated (#1164) 2019-07-29 16:42:00 -07:00
avijayanhwx
60325c9611 HDDS-1391 : Add ability in OM to serve delta updates through an API. (#1033) 2019-07-29 09:39:40 -07:00
Márton Elek
90afb7bf8c
HDDS-1725. pv-test example to test csi is not working 2019-07-29 11:54:36 +02:00