big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
25,728 Commits 2 Branches 2 Tags 264 MiB
ac50657c37
Commit Graph

115 Commits

Author SHA1 Message Date
Ahmed Hussein
cb2b7970ee
HADOOP-17123. remove guava Preconditions from Hadoop-common-project modules (#3543) 2021-10-14 19:04:00 +09:00
Viraj Jasani
e103c83765
HADOOP-17952. Replace Guava VisibleForTesting by Hadoop's own annotation in hadoop-common-project modules (#3503) 
Reviewed-by: Ahmed Hussein <ahussein@apache.org>
 2021-10-07 11:23:35 +09:00
Tamas Domok
f93e8fbf2d
HDFS-16129. Fixing the signature secret file misusage in HttpFS. Contributed by Tamas Domok 
* HDFS-16129. Fixing the signature secret file misusage in HttpFS.

The signature secret file was not used in HttpFs.
 - if the configuration did not contain the deprecated
httpfs.authentication.signature.secret.file option then it
used the random secret provider
 - if both option (httpfs. and hadoop.http.) was set then
the HttpFSAuthenticationFilter could not read the file
because the file path was not substituted properly

!NOTE! behavioral change: the deprecated httpfs. configuration
values are overwritten with the hadoop.http. values.

The commit also contains a follow up change to the YARN-10814,
empty secret files will result in a random secret provider.

Co-authored-by: Tamas Domok <tdomok@cloudera.com>
 2021-09-20 14:29:50 +02:00
Viraj Jasani
e4062ad027
HADOOP-17115. Replace Guava Sets usage by Hadoop's own Sets in hadoop-common and hadoop-tools (#2985) 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2021-05-20 10:47:04 -05:00
Wei-Chiu Chuang
2b4febcf57
HDFS-15719. [Hadoop 3] Both NameNodes can crash simultaneously due to the short JN socket timeout (#2533) 2021-01-04 20:54:44 -08:00
Wei-Chiu Chuang
66ee0a6df0
HADOOP-17371. Bump Jetty to the latest version 9.4.34. Contributed by Wei-Chiu Chuang. (#2453) 2021-01-04 09:43:58 -08:00
Ahmed Hussein
8c234fc0d4
HADOOP-17389. KMS should log full UGI principal. (#2476) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Jim Brennan <jbrennan@apache.org>
 2020-12-04 09:33:30 +09:00
Ayush Saxena
1e3a6efcef
HADOOP-17288. Use shaded guava from thirdparty. (#2342). Contributed by Ayush Saxena. 2020-10-17 12:01:18 +05:30
He Xiaoqiao
ddc0ee27fa HADOOP-17304. KMS ACL: Allow DeleteKey Operation to Invalidate Cache. Contributed by Xiaoyu. 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
 2020-10-14 16:00:37 +08:00
Masatake Iwasaki
ac40daece1
HADOOP-16972. Ignore AuthenticationFilterInitializer for KMSWebServer. (#1961) 2020-04-18 06:38:25 +09:00
Wei-Chiu Chuang
6b86a5110e HDFS-15097. Purge log in KMS and HttpFS. Contributed by Doris Gu. 2020-01-13 10:48:53 -08:00
Wei-Chiu Chuang
9664b9c7a6 HADOOP-15686. Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr. Contributed by Wei-Chiu Chuang. 
Reviewed-by: Xiaoyu Yao <xyao@apache.org>
 2019-11-20 13:07:43 -08:00
Wei-Chiu Chuang
51b65370b9 HADOOP-14784. [KMS] Improve KeyAuthorizationKeyProvider#toString(). Contributed by Yeliang Cang. 
Reviewed-by: Dinesh Chitlangia <dchitlangia@cloudera.com>
 2019-08-19 11:12:09 -07:00
Zsombor Gegesy
008766c119 HADOOP-15014. KMS should log the IP address of the clients. Contributed by Zsombor Gegesy. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-04-16 05:28:18 -07:00
Márton Elek
84c4966a5a
HADOOP-16067. Incorrect Format Debug Statement KMSACLs. Contributed by Charan Hebri. 2019-02-28 12:15:47 +01:00
Wei-Chiu Chuang
cd2158456d HADOOP-15418. Hadoop KMSAuthenticationFilter needs to use getPropsByPrefix instead of iterator to avoid ConcurrentModificationException. Contributed by lqjack and Suma Shivaprasad 2018-10-18 17:28:28 -07:00
Yiqun Lin
81f635f47f HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles. 2018-10-04 10:30:30 +08:00
Wei-Chiu Chuang
e780556ae9 HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang. 2018-09-05 09:52:35 -07:00
Kitti Nanasi
781437c219 HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi. 2018-08-29 22:07:49 -07:00
Xiao Chen
b94c8874e2 HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang. 2018-08-13 10:40:31 -07:00
Xiao Chen
895845e9b0 HADOOP-15581. Set default jetty log level to INFO in KMS. Contributed by Kitti Nanasi. 2018-07-09 12:06:50 -07:00
Todd Lipcon
7a3c6e9c3c HADOOP-15550. Avoid static initialization of ObjectMappers 2018-06-25 15:36:45 -07:00
Wei-Chiu Chuang
32671d8713 HADOOP-14783. [KMS] Add missing configuration properties into kms-default.xml. Contributed by Chetna Chaudhari. 2018-05-31 16:09:33 -07:00
Wei-Chiu Chuang
438ef4951a HADOOP-15455. Incorrect debug message in KMSACL#hasAccess. Contributed by Yuen-Kuei Hsueh. 2018-05-28 17:32:32 -07:00
Xiao Chen
21c6661461 HADOOP-15234. Throw meaningful message on null when initializing KMSWebApp. Contributed by fang zhenyi. 2018-03-15 20:17:16 -07:00
Arpit Agarwal
2fa7963c3d HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi. 2018-02-24 14:41:55 -08:00
Steve Loughran
996796f104 HADOOP-15214. Make Hadoop compatible with Guava 21.0. 
Contributed by Igor Dvorzhak
 2018-02-08 10:55:54 -08:00
Xiao Chen
86ee0c5e4e HADOOP-14944. Add JvmMetrics to KMS. 2017-10-17 19:06:45 -07:00
Xiao Chen
b7ff624c76 HADOOP-14949. TestKMS#testACLs fails intermittently. 2017-10-16 14:19:31 -07:00
Xiao Chen
4ec5acc704 HADOOP-14705. Add batched interface reencryptEncryptedKeys to KMS. 2017-08-22 07:47:39 -07:00
Sean Mackrory
1a1bf6b7d0 HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer. 2017-08-02 12:25:05 -06:00
John Zhuge
946dd25675 HADOOP-14608. KMS JMX servlet path not backwards compatible. Contributed by John Zhuge. 2017-07-05 11:16:56 -07:00
Xiao Chen
fb5ee3fafb HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j. 2017-06-27 23:49:09 -07:00
Xiao Chen
c4b5c32669 HADOOP-13854. KMS should log error details in KMSExceptionsProvider. 2017-06-08 22:35:31 -07:00
Brahma Reddy Battula
62857be211 HADOOP-14456. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin. 2017-05-31 01:07:58 +08:00
John Zhuge
a9f07e0d3e HADOOP-14317. KMSWebServer$deprecateEnv may leak secret. Contributed by John Zhuge. 2017-04-18 09:29:16 -07:00
Andrew Wang
ec839b94c0 HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers. 2017-03-06 10:47:15 -08:00
Xiao Chen
2007e0cf2a HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled. 2017-02-07 20:36:11 -08:00
Xiao Chen
d88497d44a HADOOP-14047. Require admin to access KMS instrumentation servlets. Contributed by John Zhuge. 2017-02-06 13:14:17 -08:00
Xiao Chen
ebd40056a0 HADOOP-13992. KMS should load SSL configuration the same way as SSLFactory. Contributed by John Zhuge. 2017-01-27 10:49:26 -08:00
Arun Suresh
be529dade1 HADOOP-13903. Improvements to KMS logging to help debug authorization errors. (Tristan Stevens via asuresh) 2017-01-11 00:26:02 -08:00
Xiao Chen
5d182949ba HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge. 2017-01-05 17:21:57 -08:00
Xiao Chen
30f85d7a88 HADOOP-13911. Remove TRUSTSTORE_PASSWORD related scripts from KMS. Contributed by John Zhuge. 2016-12-20 16:02:26 -08:00
Xiao Chen
79d90b810c HADOOP-13827. Add reencryptEncryptedKey interface to KMS. 2016-12-06 12:04:04 -08:00
Xiao Chen
291df5c7fb HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge. 2016-12-05 09:35:17 -08:00
Akira Ajisaka
67d9f2808e HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project. 2016-11-29 14:07:19 +09:00
Akira Ajisaka
c65d6b6541 HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka. 2016-11-21 11:25:11 +09:00
Xiao Chen
7154a20bcb HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao. 2016-11-03 13:09:03 -07:00
Robert Kanter
5877f20f9c HADOOP-10075. Update jetty dependency to version 9 (rkanter) 2016-10-27 16:09:00 -07:00
Xiao Chen
d75cbc5749 HADOOP-13693. Remove the message about HTTP OPTIONS in SPNEGO initialization message from kms audit log. 2016-10-18 18:24:59 -07:00