5697 Commits

Author	SHA1	Message	Date
Praveen Krishna	2b94e51a8f	HADOOP-16114. NetUtils#canonicalizeHost gives different value for same host. ... Author: Praveen Krishna <praveenkrishna@tutanota.com>	2019-03-07 11:06:34 +00:00
Vivek Ratnavel Subramanian	a55fc36299	HDDS-1093. Configuration tab in OM/SCM ui is not displaying the correct values.	2019-03-06 17:43:57 -08:00
Sahil Takiar	618e009ac0	HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2019-03-06 15:04:06 -08:00
Wei-Chiu Chuang	6192c1fe3b	Revert "HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar." ... This reverts commit f5a4b43a49.	2019-03-06 15:02:18 -08:00
Sahil Takiar	f5a4b43a49	HDFS-14111. hdfsOpenFile on HDFS causes unnecessary IO from file offset 0. Contributed by Sahil Takiar. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2019-03-06 14:58:45 -08:00
Eric Yang	3c5b7136e2	HADOOP-16150. Added concat method to ChecksumFS as unsupported operation. ... Contributed by Steve Loughran (cherry picked from commit 8b517e7ad670aa8ee0b73ce5a572f36ce63eabee)	2019-03-05 13:32:00 -05:00
Stephen O'Donnell	686c0141ef	HADOOP-16140. hadoop fs expunge to add -immediate option to purge trash immediately. ... Contributed by Stephen O'Donnell. Signed-off-by: Steve Loughran <stevel@apache.org>	2019-03-05 14:09:00 +00:00
Prabhu Joseph	e40e2d6ad5	YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager. ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2019-03-05 14:10:08 +09:00
coder-chenzhi	fe7551f21b	HADOOP-16162. Remove unused Job Summary Appender configurations from log4j.properties ... This closes #551 Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2019-03-05 13:41:33 +09:00
David Mollitor	9fcd89ab93	HADOOP-16148. Cleanup LineReader Unit Test. ... Contributed by David Mollitor. Signed-off-by: Steve Loughran <stevel@apache.org>	2019-03-04 23:08:12 +00:00
Ajay Kumar	0d61facd37	HADOOP-15889. Add hadoop.token configuration parameter to load tokens. Contributed by Íñigo Goiri	2019-02-28 10:34:28 -08:00
Márton Elek	84c4966a5a	HADOOP-16067. Incorrect Format Debug Statement KMSACLs. Contributed by Charan Hebri.	2019-02-28 12:15:47 +01:00
Eric Yang	feccd282fe	HADOOP-16107. Update ChecksumFileSystem createFile/openFile API to generate checksum. ... Contributed by Steve Loughran	2019-02-27 15:53:41 -05:00
Tsz Wo Nicholas Sze	9192f71e21	HADOOP-16127. In ipc.Client, put a new connection could happen after stop.	2019-02-26 15:14:21 -08:00
Abhishek Modi	52b2eab575	HADOOP-16093. Move DurationInfo from hadoop-aws to hadoop-common org.apache.hadoop.util. ... Contributed by Abhishek Modi	2019-02-26 17:10:41 +00:00
Surendra Singh Lilhore	59ba3552d3	HDFS-14299. ViewFs: Correct error message for read only operations. Contributed by hu xiaodong.	2019-02-26 12:40:32 +05:30
Konstantin V Shvachko	a6ab37192a	HDFS-14130. [SBN read] Make ZKFC ObserverNode aware. Contributed by xiangheng and Konstantin Shvachko.	2019-02-25 14:35:02 -08:00
Inigo Goiri	ba4e7bd192	HADOOP-16125. Support multiple bind users in LdapGroupsMapping. Contributed by Lukas Majercak.	2019-02-25 13:39:13 -08:00
Tsz Wo Nicholas Sze	0edb0c51dc	HADOOP-16126. ipc.Client.stop() may sleep too long to wait for all connections.	2019-02-25 13:15:28 -08:00
Yongjun Zhang	f7a27cdee4	HDFS-14118. Support using DNS to resolve nameservices to IP addresses. Contributed by Fengnan Li.	2019-02-23 09:35:36 -08:00
George Huang	9daf43c6fa	HADOOP-16129. Misc. bug fixes for KMS Benchmark. Contributed by George Huang. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2019-02-22 17:52:09 -08:00
Daryn Sharp	a87e458432	HADOOP-15813. Enable more reliable SSL connection reuse. Contributed by Daryn Sharp. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2019-02-20 18:17:04 -08:00
Shweta Yakkali	371a6db59a	HDFS-14273. Fix checkstyle issues in BlockLocation's method javadoc ... (Contributed by Shweta Yakkali via Daniel Templeton) Change-Id: I546aa4a0fe7f83b53735acd9925f366b2f1a00e2	2019-02-20 15:36:53 -08:00
George Huang	0525d85d57	HADOOP-15967. KMS Benchmark Tool. Contributed by George Huang. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2019-02-19 15:24:30 -08:00
Akira Ajisaka	dabfeab785	YARN-9308. fairscheduler-statedump.log gets generated regardless of service again after the merge of HDFS-7240. Contributed by Wilfred Spiegelenburg.	2019-02-15 14:49:49 +09:00
Erik Krogen	64f28f9efa	HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen.	2019-02-14 11:22:04 -08:00
Siyao Meng	fd026863b1	HDFS-14241. Provide feedback on successful renameSnapshot and deleteSnapshot. Contributed by Siyao Meng. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2019-02-13 19:48:02 -08:00
Chen Liang	024c87291c	HDFS-13617. Allow wrapping NN QOP into token in encrypted message. Contributed by Chen Liang	2019-02-13 12:40:31 -08:00
Vinayakumar B	00c5ffaee2	HADOOP-16108. Tail Follow Interval Should Allow To Specify The Sleep Interval To Save Unnecessary RPC's. Contributed by Ayush Saxena.	2019-02-13 16:44:32 +05:30
Yiqun Lin	7b11b404a3	HADOOP-16097. Provide proper documentation for FairCallQueue. Contributed by Erik Krogen.	2019-02-13 11:16:04 +08:00
Xiaoyu Yao	ca4e46a05e	HDDS-1075. Fix CertificateUtil#parseRSAPublicKey charsetName. Contributed by Siddharth Wagle.	2019-02-11 12:09:14 -08:00
Steve Loughran	668817a6ce	Revert "HADOOP-15954. ABFS: Enable owner and group conversion for MSI and login user using OAuth." ... (accidentally mixed in two patches) This reverts commit fa8cd1bf28.	2019-02-07 21:57:22 +00:00
Wangda Tan	308f3168fa	Make upstream aware of 3.1.2 release ... Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365	2019-02-05 14:03:18 -08:00
Da Zhou	fa8cd1bf28	HADOOP-15954. ABFS: Enable owner and group conversion for MSI and login user using OAuth. ... Contributed by Da Zhou and Junhua Gu.	2019-02-05 19:23:15 +00:00
Steve Loughran	f365957c63	HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile(); ... S3A to implement S3 Select through this API. The new openFile() API is asynchronous, and implemented across FileSystem and FileContext. The MapReduce V2 inputs are moved to this API, and you can actually set must/may options to pass in. This is more useful for setting things like s3a seek policy than for S3 select, as the existing input format/record readers can't handle S3 select output where the stream is shorter than the file length, and splitting plain text is suboptimal. Future work is needed there. In the meantime, any/all filesystem connectors are now free to add their own filesystem-specific configuration parameters which can be set in jobs and used to set filesystem input stream options (seek policy, retry, encryption secrets, etc). Contributed by Steve Loughran	2019-02-05 11:51:02 +00:00
Steve Loughran	7f46d13dac	HADOOP-16079. Token.toString faulting if any token listed can't load. ... Contributed by Steve Loughran.	2019-02-01 14:31:47 +00:00
Inigo Goiri	bcc3a79f58	HADOOP-16084. Fix the comment for getClass in Configuration. Contributed by Fengnan Li.	2019-01-31 10:06:05 -08:00
Akira Ajisaka	1129288cf5	HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki.	2019-01-29 18:29:56 -08:00
Hanisha Koneru	b3bc94ebfd	HDFS-14236. Lazy persist copy/ put fails with ViewFs.	2019-01-29 16:45:44 -08:00
Wei-Chiu Chuang	d1714c20e9	Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh." ... This reverts commit 1d523279da.	2019-01-29 15:43:09 -08:00
Pranay Singh	1d523279da	HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2019-01-25 09:02:57 -08:00
Eric Yang	0dd35e218f	HADOOP-15922. Fixed DelegationTokenAuthenticator URL decoding for doAs user. ... Contributed by He Xiaoqiao	2019-01-22 18:59:36 -05:00
Akira Ajisaka	a463cf75a0	HADOOP-15787. [JDK11] TestIPC.testRTEDuringConnectionSetup fails. Contributed by Zsolt Venczel.	2019-01-22 10:19:05 +09:00
Sunil G	2e2508b8e3	Make 3.2.0 aware to other branches	2019-01-21 21:24:51 +05:30
Xiaoyu Yao	751bc62df7	Merge branch 'HDDS-4' into trunk	2019-01-18 14:44:24 -08:00
Surendra Singh Lilhore	dacc1a759e	HDFS-14175. EC: Native XOR decoder should reset the output buffer before using it. Contributed by Ayush Saxena.	2019-01-18 13:55:12 +05:30
Xiaoyu Yao	570b503e3e	Fix merge conflicts	2019-01-15 22:54:50 -07:00
Xiaoyu Yao	ff61931f91	HDDS-6. Enable SCM kerberos auth. Contributed by Ajay Kumar.	2019-01-15 22:16:58 -07:00
Akira Ajisaka	01405df87f	HADOOP-15941. Addendum patch. Contributed by Takanobu Asanuma.	2019-01-16 10:28:08 +09:00
luhuachao	ccc43621ab	HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration. ... Contributed by luhuachao.	2019-01-15 13:15:18 +00:00
Steve Loughran	6d0bffe17e	HADOOP-14556. S3A to support Delegation Tokens. ... Contributed by Steve Loughran and Daryn Sharp.	2019-01-14 17:59:27 +00:00
Inigo Goiri	35fa3bd685	HADOOP-16045. Don't run TestDU on Windows. Contributed by Lukas Majercak.	2019-01-11 18:07:19 -08:00
Chen Liang	bf08f4abae	HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian.	2019-01-11 14:01:23 -08:00
Chen Liang	01cb958af4	HADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed by Erik Krogen.	2019-01-11 12:51:07 -08:00
Giovanni Matteo Fumarola	fb8932a727	HADOOP-16029. Consecutive StringBuilder.append can be reused. Contributed by Ayush Saxena.	2019-01-11 10:54:49 -08:00
Akira Ajisaka	d4ca907da6	HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper	2019-01-11 11:24:05 +09:00
Kihwal Lee	33c009a45d	HADOOP-15909. KeyProvider class should implement Closeable. Contributed ... by Kuhu Shukla.	2019-01-10 13:21:37 -06:00
Jason Lowe	c634589ab2	Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh." ... This reverts commit ecdeaa7e6a.	2019-01-09 17:24:58 -06:00
Takanobu Asanuma	709ddb10e5	HADOOP-15941. [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible.	2019-01-09 13:55:25 +09:00
shwetayakkali@cloudera.com	4ab5260b7e	HDFS-14132. Add BlockLocation.isStriped() to determine if block is replicated or Striped ... (Contributed by Shweta Yakkali via Daniel Templeton) Change-Id: I0ed8996a0bae2ad2c7d3513143195533f7191af8	2019-01-08 17:04:57 -08:00
Akira Ajisaka	7f78397036	Revert "HADOOP-14556. S3A to support Delegation Tokens." ... This reverts commit d7152332b3.	2019-01-08 14:51:30 +09:00
Eric Yang	802932ca0b	HADOOP-16031. Fixed TestSecureLogins unit test. Contributed by Akira Ajisaka	2019-01-07 13:21:14 -05:00
Steve Loughran	d7152332b3	HADOOP-14556. S3A to support Delegation Tokens. ... Contributed by Steve Loughran.	2019-01-07 13:18:03 +00:00
Eric Yang	d43af8b3db	HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop. ... Contributed by Bolke de Bruin	2019-01-04 17:54:15 -05:00
Inigo Goiri	f4e18242bd	HADOOP-16028. Fix NetworkTopology chooseRandom function to support excluded nodes. Contributed by Sihai Ke.	2019-01-04 09:56:58 -08:00
Sunil G	51427cbdfb	HADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu Chuang.	2019-01-04 21:49:06 +05:30
Pranay Singh	ecdeaa7e6a	HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2019-01-03 09:56:07 -08:00
Akira Ajisaka	57198bc511	HADOOP-15962. The buffer size is small when unpacking tar archives. Contributed by BELUGA BEHR.	2018-12-28 15:38:47 +09:00
Konstantin V Shvachko	bd2a59e508	HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads. Contributed by Konstantin V Shvachko.	2018-12-24 09:39:20 -08:00
Chao Sun	fa8550337d	HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads. Contributed by Chao Sun.	2018-12-24 09:34:01 -08:00
Erik Krogen	ef3e1929dd	HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from blocking within internalQueueCall. Contributed by Chao Sun.	2018-12-24 09:34:01 -08:00
Chen Liang	cae279610b	HDFS-14138. [SBN read] Description errors in the comparison logic of transaction ID. Contributed by xiangheng.	2018-12-24 09:34:01 -08:00
Erik Krogen	b73fb70f97	HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too far behind. Contributed by Konstantin Shvachko.	2018-12-24 09:34:01 -08:00
Chao Sun	cbc2f932eb	HDFS-14067. [SBN read] Allow manual failover between standby and observer. Contributed by Chao Sun.	2018-12-24 09:34:01 -08:00
Chao Sun	8c49135078	HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer. Contributed by Chao Sun.	2018-12-24 09:34:01 -08:00
Chen Liang	a65bb97f5d	HDFS-13791. Limit logging frequency of edit tail related statements. Contributed by Erik Krogen.	2018-12-24 09:34:00 -08:00
Chen Liang	d2e85b0b6d	HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang.	2018-12-24 09:34:00 -08:00
Chen Liang	66ec3a67e8	HDFS-13767. Add msync server implementation. Contributed by Chen Liang.	2018-12-24 09:34:00 -08:00
Plamen Jeliazkov	e27708c2da	HDFS-13665. [SBN read] Move RPC response serialization into Server.doResponse(). Contributed by Plamen Jeliazkov.	2018-12-24 09:34:00 -08:00
Chao Sun	64b7cf59bd	HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.	2018-12-24 09:33:59 -08:00
Erik Krogen	151c8ddbe4	HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.	2018-12-24 09:33:59 -08:00
Plamen Jeliazkov	e880660a20	HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.	2018-12-24 09:33:59 -08:00
Erik Krogen	091ad974cd	HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.	2018-12-24 09:33:59 -08:00
Erik Krogen	9bf0696c73	HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.	2018-12-24 09:33:59 -08:00
Plamen Jeliazkov	c9d73437e8	HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.	2018-12-24 09:33:59 -08:00
Yiqun Lin	feb2664ac4	HDFS-13946. Log longest FSN write/read lock held stack trace.	2018-12-22 23:09:59 +08:00
Surendra Singh Lilhore	763e96ea2b	HDFS-14166. Ls with -e option not giving the result in proper format. Contributed by Shubham Dewan.	2018-12-22 12:22:24 +05:30
Bharat Viswanadham	2499435d9d	HADOOP-16014. Fix test, checkstyle and javadoc issues in TestKerberosAuthenticationHandler. Contributed by Dinesh Chitlangia.	2018-12-21 13:30:48 -08:00
Jason Lowe	3961690037	HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne	2018-12-20 09:29:48 -06:00
Takanobu Asanuma	d963575918	HDFS-13661. Ls command with e option fails when the filesystem is not HDFS.	2018-12-20 10:03:33 +09:00
Surendra Singh Lilhore	788e7473a4	HDFS-14096. [SPS] : Add Support for Storage Policy Satisfier in ViewFs. Contributed by Ayush Saxena.	2018-12-17 11:24:57 +05:30
Gabor Bota	1ea29b7385	HADOOP-16000. Remove TLSv1 and SSLv2Hello from the default value of hadoop.ssl.enabled.protocols ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-12-15 10:53:52 +09:00
Giovanni Matteo Fumarola	76efeacd5f	HADOOP-15995. Add ldap.bind.password.alias in LdapGroupsMapping to distinguish aliases when using multiple providers through CompositeGroupsMapping. Contributed by Lukas Majercak.	2018-12-12 11:10:24 -08:00
Steve Loughran	202926ac33	HADOOP-15808. Harden Token service loader use. ... Contributed by Steve Loughran.	2018-12-11 17:33:49 +00:00
Giovanni Matteo Fumarola	aa89492f29	Revert "HADOOP-15852. Refactor QuotaUsage. Contributed by Beluga Behr." ... This reverts commit fb9deed41d.	2018-12-04 12:57:28 -08:00
Steve Loughran	db2d8b01c6	HADOOP-15966. Hadoop Kerberos broken on macos as java.security.krb5.realm is reset. ... Contributed by Steve Loughran	2018-12-04 15:35:43 +00:00
Giovanni Matteo Fumarola	fb9deed41d	HADOOP-15852. Refactor QuotaUsage. Contributed by Beluga Behr.	2018-12-03 13:25:02 -08:00
Giovanni Matteo Fumarola	c9a3aa64dc	HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak.	2018-12-03 12:10:05 -08:00
Eric Yang	38ea3814bd	HADOOP-15922. Revert patch 004.	2018-11-30 12:49:46 -05:00
Akira Ajisaka	c9bfca217f	MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin.	2018-11-30 13:13:23 +09:00
Steve Loughran	d0edd37269	HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple" ... This reverts commit 829a2e4d27.	2018-11-29 17:52:11 +00:00
Ewan Higgs	c1d24f8483	HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests. ... Contributed by Ewan Higgs and Steve Loughran.	2018-11-29 15:12:17 +00:00
Eric Yang	a9d96948ed	HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter. ... Contributed by He Xiaoqiao	2018-11-26 13:49:19 -05:00
Vinayakumar B	23b441c225	HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena.	2018-11-26 18:11:01 +05:30
Márton Elek	6934a65402	HADOOP-15358. SFTPConnectionPool connections leakage. Contributed by Mikhail Pryakhin.	2018-11-23 09:48:26 +01:00
Akira Ajisaka	1a00b4e325	Add 2.9.2 release notes and changes documents.	2018-11-20 14:25:18 +09:00
Inigo Goiri	460a94a10f	HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang.	2018-11-15 10:58:57 -08:00
Surendra Singh Lilhore	75291e6d53	HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore	2018-11-13 20:22:58 +05:30
Steve Loughran	3c9d97b8f7	HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds. ... Contributed by LiXin Ge.	2018-11-12 12:58:05 +00:00
Giovanni Matteo Fumarola	89b49167a5	HADOOP-15903. Allow HttpServer2 to discover resources in /static when symlinks are used. Contributed by Inigo Goiri.	2018-11-08 14:52:24 -08:00
Jason Lowe	0b6625a973	MAPREDUCE-7148. Fast fail jobs when exceeds dfs quota limitation. Contributed by Wang Yan	2018-11-07 08:20:49 -06:00
Jason Lowe	ab6aa4c726	YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg	2018-11-06 08:40:59 -06:00
Lars Francke	cb8d679c95	HADOOP-15687. Credentials class should allow access to aliases. ... Author: Lars Francke <lars.francke@gmail.com>	2018-11-03 16:21:29 +00:00
Giovanni Matteo Fumarola	44e37b4fd9	HADOOP-15885. Add base64 (urlString) support to DTUtil. Contributed by Inigo Goiri.	2018-11-02 10:54:12 -07:00
Akira Ajisaka	f747f5b06c	HADOOP-15886. Fix findbugs warnings in RegistryDNS.java.	2018-10-31 10:01:31 +09:00
Steve Loughran	62d98ca92a	HADOOP-15855. Review hadoop credential doc, including object store details. ... Contributed by Steve Loughran.	2018-10-30 15:58:04 +00:00
Wei-Chiu Chuang	63e7134df6	Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao." ... This reverts commit fb2b72e6fc.	2018-10-28 17:04:59 -07:00
Hrishikesh Gadre	bfb9adc2b9	HADOOP-9567. Provide auto-renewal for keytab based logins. Contributed by Hrishikesh Gadre, Gary Helmling and Harsh J. ... Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>	2018-10-27 08:59:47 -07:00
Wei-Chiu Chuang	fb2b72e6fc	HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.	2018-10-25 09:33:31 -07:00
Akira Ajisaka	8f97d6f2cd	HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.	2018-10-24 13:49:28 +09:00
Haibo Chen	823bb5dda8	MAPREDUCE-4669. MRAM web UI does not work with HTTPS. (Contributed by Robert Kanter)	2018-10-23 15:28:13 -07:00
Chen Liang	635786a511	HDFS-13566. Add configurable additional RPC listener to NameNode. Contributed by Chen Liang.	2018-10-23 14:53:45 -07:00
Inigo Goiri	dd268a64d3	Revert "HADOOP-15836. Review of AccessControlList. Contributed by BELUGA BEHR." ... This reverts commit 00254d7b8c.	2018-10-23 09:23:03 -07:00
Steve Loughran	52cb766ad0	HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility. ... Contributed by Wei-Chiu Chuang.	2018-10-22 11:21:12 +01:00
Eric Yang	a043dfa216	HADOOP-15821. Addendum patch to fix Hadoop Registry parent project. ... Contributed by Íñigo Goiri	2018-10-21 12:50:10 -04:00
Eric Yang	e2a9fa8448	HADOOP-15821. Move YARN Registry to Hadoop Registry. ... Contributed by Íñigo Goiri	2018-10-19 19:46:48 -04:00
Inigo Goiri	00254d7b8c	HADOOP-15836. Review of AccessControlList. Contributed by BELUGA BEHR.	2018-10-19 13:57:43 -07:00
Wei-Chiu Chuang	cd2158456d	HADOOP-15418. Hadoop KMSAuthenticationFilter needs to use getPropsByPrefix instead of iterator to avoid ConcurrentModificationException. Contributed by lqjack and Suma Shivaprasad	2018-10-18 17:28:28 -07:00
Jitendra Pandey	d93d515af5	HDDS-651. Rename o3 to o3fs for Filesystem.	2018-10-17 14:19:17 -07:00
Jason Lowe	9abda83947	HADOOP-15859. ZStandardDecompressor.c mistakes a class for an instance. Contributed by Jason Lowe	2018-10-17 14:38:42 -05:00
Adam Antal	24dc068a36	HADOOP-11100. Support to configure ftpClient.setControlKeepAliveTimeout. ... Contributed by Adam Antal. Signed-off-by: Xiao Chen <xiao@apache.org>	2018-10-17 11:34:50 -07:00
Steve Loughran	41b3603b5b	HADOOP-15861. Move DelegationTokenIssuer to the right path. ... Contributed by Wei-Chiu Chuang.	2018-10-17 11:01:53 +01:00
Steve Loughran	b738cb148c	HADOOP-15854. AuthToken Use StringBuilder instead of StringBuffer. ... Contributed by Beluga Behr.	2018-10-17 10:29:09 +01:00
Haibo Chen	c2288ac45b	YARN-8448. AM HTTPS Support for AM communication with RMWeb proxy. (Contributed by Robert Kanter)	2018-10-16 13:36:26 -07:00
Robert Kanter	7fe1a40a6b	HADOOP-15853. TestConfigurationDeprecation leaves behind a temp file, resulting in a license issue (ayushtkn via rkanter)	2018-10-15 15:02:37 -07:00
Xiao Chen	b6fc72a025	HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.	2018-10-15 10:51:55 -07:00
Anu Engineer	3c1fe073d2	HDDS-445. Create a logger to print out all of the incoming requests. ... Contributed by Bharat Viswanadham.	2018-10-12 16:27:54 -07:00
Xiao Chen	5ec86b445c	HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. ... Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.	2018-10-12 09:35:52 -07:00
Robert Kanter	d91d47bc73	HADOOP-15717. TGT renewal thread does not log IOException (snemeth via rkanter)	2018-10-11 15:35:44 -07:00
Xiao Chen	64f2b32d57	HADOOP-15676. Cleanup TestSSLHttpServer. Contributed by Szilard Nemeth.	2018-10-11 15:12:36 -07:00
Takanobu Asanuma	7b57f2f71f	HADOOP-15785. [JDK10] Javadoc build fails on JDK 10 in hadoop-common. Contributed by Dinesh Chitlangia.	2018-10-11 13:51:51 +09:00
Robert Kanter	f261c31937	HADOOP-15708. Reading values from Configuration before adding deprecations make it impossible to read value with deprecated key (zsiegl via rkanter)	2018-10-10 18:51:37 -07:00
Steve Loughran	cdc4350718	HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys. ... Contributed by Steve Loughran.	2018-10-10 17:00:37 +01:00
Akira Ajisaka	6fa3feb577	HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter.	2018-10-10 10:16:57 +09:00
Eric Yang	bf04f19456	YARN-8845. Removed unused hadoop.registry.rm reference. ... Contributed by Íñigo Goiri	2018-10-09 15:54:45 -04:00
Takanobu Asanuma	9bbeb52486	HADOOP-15775. [JDK9] Add missing javax.activation-api dependency. Contributed by Akira Ajisaka.	2018-10-09 13:06:14 +09:00
Vidura Mudalige	a30b1d1824	HADOOP-15818. Fix deprecated maven-surefire-plugin configuration in hadoop-kms module ... This closes #425 Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-10-09 12:55:34 +09:00
Jason Lowe	f13e231025	HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe	2018-10-05 09:06:02 -05:00
Yiqun Lin	81f635f47f	HADOOP-15817. Reuse Object Mapper in KMSJSONReader. Contributed by Jonathan Eagles.	2018-10-04 10:30:30 +08:00
Aaron Fabbri	046b8768af	HADOOP-15621 S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing. Contributed by Gabor Bota	2018-10-02 21:22:49 -07:00
Akira Ajisaka	31fa9bb799	HADOOP-15767. [JDK10] Building native package on JDK10 fails due to missing javah. Contributed by Takanobu Asanuma.	2018-10-03 11:29:18 +09:00
Sunil G	58fa96b697	Changed version in trunk to 3.3.0-SNAPSHOT.	2018-10-02 22:41:41 +05:30
Ewan Higgs	6fab6886f6	HDFS-13936. Multipart upload to HDFS to support 0 byte upload. Contributed by Ewan Higgs.	2018-10-02 14:05:35 +02:00
Akira Ajisaka	5c8d90763c	HADOOP-15764. Addendum patch: Fix NPE in SecurityUtil.	2018-09-28 10:03:22 +09:00
Akira Ajisaka	c62b440421	HADOOP-15693. Typo in Secure Mode documentation. Contributed by Thomas Levine.	2018-09-26 10:30:43 +09:00
Akira Ajisaka	93b0f540ed	HADOOP-15783. [JDK10] TestSFTPFileSystem.testGetModifyTime fails.	2018-09-25 16:03:28 +09:00
Sunil G	d060cbea48	HDFS-13937. Multipart Uploader APIs to be marked as private/unstable in 3.2.0. Contributed by Steve Loughran.	2018-09-24 21:19:47 +05:30
Sean Mackrory	0def61482b	Merge branch 'HADOOP-15407' into trunk	2018-09-22 21:19:12 -06:00
Ewan Higgs	429a07e08c	HADOOP-15764. [JDK10] Migrate from sun.net.dns.ResolverConfiguration to the replacement. Contributed by Akira Ajisaka.	2018-09-20 15:13:55 +02:00
Ewan Higgs	3da94a36e2	HADOOP-15756. [JDK10] Migrate from sun.net.util.IPAddressUtil to the replacement. Contributed by Akira Ajisaka.	2018-09-20 14:53:21 +02:00
Steve Loughran	646874c326	HADOOP-15748. S3 listing inconsistency can raise NPE in globber. ... Contributed by Steve Loughran.	2018-09-20 13:04:52 +01:00
Vinayakumar B	7ad27e97f0	HADOOP-15736. Trash : Negative Value For Deletion Interval Leads To Abnormal Behaviour. Contributed by Ayush Saxena.	2018-09-20 09:31:35 +05:30
Chen Liang	a30b4f9e71	HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen.	2018-09-19 13:22:37 -07:00
Jason Lowe	e71f61ecb8	HADOOP-15755. StringUtils#createStartupShutdownMessage throws NPE when args is null. Contributed by Lokesh Jain and Dinesh Chitlangia	2018-09-18 15:57:33 -05:00
Steve Loughran	1cf38a38da	HADOOP-15744. AbstractContractAppendTest fails against HDFS on HADOOP-15407 branch. ... Contributed by Steve Loughran.	2018-09-18 10:56:56 +01:00
Takanobu Asanuma	f796cfde76	HADOOP-15304. [JDK10] Migrate from com.sun.tools.doclets to the replacement. Contributed by Akira Ajisaka.	2018-09-18 18:48:25 +09:00
Yiqun Lin	ee051ef9fe	HADOOP-15742. Log if ipc backoff is enabled in CallQueueManager. Contributed by Ryan Wu.	2018-09-18 11:10:33 +08:00
Sean Mackrory	9475fd902a	HADOOP-15745. ABFS: Add ABFS configuration to ConfigRedactor.	2018-09-17 19:54:01 +00:00
Thomas Marquardt	81dc4a995c	HADOOP-15663. ABFS: Simplify configuration. ... Contributed by Da Zhou.	2018-09-17 19:54:01 +00:00
Thomas Marquardt	ce03a93f78	HADOOP-15446. ABFS: tune imports & javadocs; stabilise tests. ... Contributed by Steve Loughran and Da Zhou.	2018-09-17 19:54:01 +00:00
Steve Loughran	f044deedbb	HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit. ... Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran	2018-09-17 19:54:01 +00:00
Brahma Reddy Battula	ef5c776a42	HADOOP-15733. Correct the log when Invalid emptier Interval configured. Contributed by Ayush Saxena	2018-09-14 07:32:27 +05:30
Hanisha Koneru	291dcf2247	HDDS-423. Introduce an ozone specific log4j.properties. Contributed by Elek, Marton.	2018-09-13 16:37:44 -07:00
Takanobu Asanuma	5d084d7eca	HADOOP-12760. sun.misc.Cleaner has moved to a new location in OpenJDK 9. Contributed by Akira Ajisaka.	2018-09-13 20:42:09 +09:00
Steve Loughran	d7c0a08a1c	HADOOP-15426 Make S3guard client resilient to DDB throttle events and network failures (Contributed by Steve Loughran)	2018-09-12 21:04:49 -07:00
bibinchundatt	c44088ac19	YARN-8739. Fix jenkins issues for Node Attributes branch. Contributed by Sunil Govindan.	2018-09-12 16:01:01 +05:30
Naganarasimha	2475fb0a1e	YARN-6856. [YARN-3409] Support CLI for Node Attributes Mapping. Contributed by Naganarasimha G R.	2018-09-12 16:00:59 +05:30
Mingliang Liu	87f63b6479	HADOOP-14833. Remove s3a user:secret authentication. Contributed by Steve Loughran	2018-09-11 17:18:42 -07:00
Allen Wittenauer	4b8c2b1c1c	HADOOP-14671. Upgrade Apache Yetus to 0.8.0 ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-09-11 08:55:34 -07:00
Inigo Goiri	527288ef89	HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng.	2018-09-06 16:47:54 -07:00
Vrushali C	962089ab59	HADOOP-15657 Registering MutableQuantiles via Metric annotation. Contributed by Sushil Ks	2018-09-05 20:53:21 -07:00
Giovanni Matteo Fumarola	9af96d4ed4	HADOOP-15707. Add IsActiveServlet to be used for Load Balancers. Contributed by Lukas Majercak.	2018-09-05 10:50:25 -07:00
Wei-Chiu Chuang	e780556ae9	HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang.	2018-09-05 09:52:35 -07:00
Steve Loughran	9e96ac666d	HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns. ... Contributed by Kihwal Lee and Lukas Majercak.	2018-09-04 16:46:12 +01:00
Daniel Templeton	f2c2a68ec2	HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD ... (Contributed by Laszlo Kollar via Daniel Templeton) Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba	2018-08-30 09:12:36 -07:00
Steve Loughran	2e6c1109dc	HADOOP-15667. FileSystemMultipartUploader should verify that UploadHandle has non-0 length. ... Contributed by Ewan Higgs	2018-08-30 14:33:16 +01:00
Kitti Nanasi	781437c219	HADOOP-15698. KMS log4j is not initialized properly at startup. Contributed by Kitti Nanasi.	2018-08-29 22:07:49 -07:00
Daniel Templeton	d53a10b0a5	HADOOP-15705. Typo in the definition of "stable" in the interface classification ... Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56	2018-08-29 13:59:32 -07:00
John Zhuge	f9c6fd9471	HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui.	2018-08-27 09:22:59 -07:00
Konstantin V Shvachko	a4121c71c2	HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.	2018-08-24 18:27:30 -07:00
Takanobu Asanuma	bed8cb6979	HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao.	2018-08-23 21:54:38 +09:00
Steve Loughran	34577d2c21	HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended. ... Contributed by Steve Loughran.	2018-08-20 18:36:24 -07:00
Giovanni Matteo Fumarola	79c97f6a0b	HADOOP-14624. Add GenericTestUtils.DelayAnswer that accept slf4j logger API. Contributed by Ian Pickering and Wenxin He.	2018-08-17 14:40:00 -07:00
Xiao Chen	60ffec9f79	HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre.	2018-08-17 11:18:09 -07:00
Jason Lowe	a17eed1b87	HDFS-13822. speedup libhdfs++ build (enable parallel build). Contributed by Allen Wittenauer and Pradeep Ambati	2018-08-17 12:25:36 -05:00
Xiao Chen	8d7c93186e	HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth.	2018-08-17 10:09:23 -07:00
Márton Elek	77b015000a	HADOOP-8807. Update README and website to reflect HADOOP-8662. Contributed by Andras Bokor.	2018-08-17 11:10:29 +02:00
Xiao Chen	edeb2a356a	HADOOP-15655. Enhance KMS client retry behavior. Contributed by Kitti Nanasi.	2018-08-16 22:42:03 -07:00
Akira Ajisaka	3e3963b035	HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering.	2018-08-16 00:31:59 +09:00
Márton Elek	7e822ec246	HDDS-324. Addendum: remove the q letter which is accidentally added to the hadoop-functions.sh.	2018-08-14 20:54:33 +02:00
Xiaoyu Yao	b4031a8f1b	HDDS-324. Use pipeline name as Ratis groupID to allow datanode to report pipeline info. Contributed by Mukul Kumar Singh.	2018-08-13 12:47:49 -07:00
Xiao Chen	b94c8874e2	HADOOP-15638. KMS Accept Queue Size default changed from 500 to 128 in Hadoop 3.x. Contributed by Wei-Chiu Chuang.	2018-08-13 10:40:31 -07:00
Steve Loughran	da9a39eed1	HADOOP-15583. Stabilize S3A Assumed Role support. ... Contributed by Steve Loughran.	2018-08-08 22:57:24 -07:00
Wangda Tan	49c687608b	Make 3.1.1 awared by other branches	2018-08-08 13:02:12 -07:00
Xiao Chen	9499df7b81	HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi.	2018-08-08 10:40:20 -07:00
Ewan Higgs	2ec97abb2e	HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran.	2018-08-08 13:50:23 +02:00
Mukul Kumar Singh	6ed8593d18	HDDS-301. ozone command shell does not contain subcommand to run ozoneFS commands. Contributed by Nilotpal Nandi.	2018-08-07 16:09:53 +05:30
Yiqun Lin	2e4e02b4df	HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun.	2018-08-07 09:32:51 +08:00
Arpit Agarwal	f2e29acbfa	HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar.	2018-08-01 12:32:01 -07:00
Chen Liang	e8f952ef06	HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen.	2018-07-30 10:25:07 -07:00
Eric Yang	77721f39e2	HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds. ... Contributed by Gabor Bota	2018-07-26 18:35:36 -04:00
Xiao Chen	be150a17b1	HDFS-13622. mkdir should print the parent directory in the error message when parent directories do not exist. Contributed by Shweta.	2018-07-26 10:24:32 -07:00
Yiqun Lin	9089790cab	HADOOP-15611. Log more details for FairCallQueue. Contributed by Ryan Wu.	2018-07-26 18:08:28 +08:00
Mukul Kumar Singh	5f0b924360	HADOOP-15395. DefaultImpersonationProvider fails to parse proxy user config if username has . in it. Contributed by Ajay Kumar.	2018-07-25 21:09:11 +05:30
Xiao Chen	81d59506e5	HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi.	2018-07-24 21:45:43 -07:00
Daniel Templeton	849c45db18	HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica ... (Contributed by BELUGA BEHR via Daniel Templeton) Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d	2018-07-24 16:05:27 -07:00
Gera Shegalov	6bec03cfc8	HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera)	2018-07-24 14:32:30 -07:00
bibinchundatt	8461278833	YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt.	2018-07-24 13:09:17 +05:30
Haibo Chen	17e26163ec	HADOOP-15586. Fix wrong log statement in AbstractService. (Szilard Nemeth via Haibo Chen)	2018-07-23 11:18:25 -07:00
Xiao Chen	993ec026d1	HADOOP-15596. Stack trace should not be printed out when running hadoop key commands. Contributed by Kitti Nanasi.	2018-07-20 19:46:46 -07:00
Haibo Chen	e6873dfde0	YARN-7300. DiskValidator is not used in LocalDirAllocator. (Szilard Nemeth via Haibo Chen)	2018-07-19 16:27:11 -07:00
Kihwal Lee	ccf2db7fc2	HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang.	2018-07-19 11:13:37 -05:00
Wei-Chiu Chuang	d215357718	HDFS-13485. DataNode WebHDFS endpoint throws NPE. Contributed by Siyao Meng.	2018-07-16 15:45:55 -07:00
Xiao Chen	d2874e0417	HDFS-13690. Improve error message when creating encryption zone while KMS is unreachable. Contributed by Kitti Nanasi.	2018-07-16 13:19:53 -07:00
Wei-Chiu Chuang	0c7a578927	HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran.	2018-07-16 11:32:45 -07:00
Akira Ajisaka	88625f5cd9	HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma.	2018-07-13 11:42:12 -04:00
Sean Mackrory	4f3f9391b0	HADOOP-15316. GenericTestUtils can exceed maxSleepTime. Contributed by Adam Antal.	2018-07-12 17:24:01 +02:00
Wei-Chiu Chuang	162228e8db	HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng.	2018-07-11 10:02:08 -07:00
Akira Ajisaka	4a08ddfa68	HADOOP-15568. fix some typos in the .sh comments. Contributed by Steve Loughran.	2018-07-09 15:43:38 -04:00
Xiao Chen	895845e9b0	HADOOP-15581. Set default jetty log level to INFO in KMS. Contributed by Kitti Nanasi.	2018-07-09 12:06:50 -07:00
Xiao Chen	def9d94a40	HADOOP-15591. KMSClientProvider should log KMS DT acquisition at INFO level. Contributed by Kitti Nanasi.	2018-07-09 12:01:52 -07:00
Yiqun Lin	7a68ac607c	HDFS-13674. Improve documentation on Metrics. Contributed by Chao Sun.	2018-07-09 14:27:34 +08:00
Arpit Agarwal	061b168529	HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal.	2018-07-06 12:09:05 -07:00
Xiaoyu Yao	498e3bfb6b	HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli.	2018-07-06 11:56:09 -07:00
Andrew Wang	f51da9c4d1	HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon.	2018-07-02 18:31:21 +02:00
Nanda kumar	d40121845e	HADOOP-15574: Suppress build error if there are no docs after excluding private annotations. Contributed by Takanobu Asanuma.	2018-07-01 17:11:46 +05:30
Eric E Payne	d36f6b9e93	HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan.	2018-06-29 18:18:32 +00:00
Eric Yang	384764cdea	YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService. ... Contributed by Chandni Singh	2018-06-28 12:39:49 -04:00
Bharat Viswanadham	d3fa83a44b	HDFS-13705:The native ISA-L library loading failure should be made warning rather than an error message. Contributed by Shashikant Banerjee.	2018-06-28 09:21:56 -07:00
Akira Ajisaka	ddbff7c8d3	HADOOP-14313. Replace/improve Hadoop's byte[] comparator. Contributed by Vikas Vishwakarma.	2018-06-28 14:58:40 +09:00
Akira Ajisaka	2b2399d623	HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.	2018-06-28 14:37:22 +09:00
Todd Lipcon	7a3c6e9c3c	HADOOP-15550. Avoid static initialization of ObjectMappers	2018-06-25 15:36:45 -07:00
Inigo Goiri	abc3e4bad9	HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang.	2018-06-25 09:50:27 -07:00
Steve Loughran	1ba4e62304	HADOOP-14396. Add builder interface to FileContext. ... Contributed by Lei (Eddy) Xu.	2018-06-25 14:38:57 +01:00
Eric E Payne	6432128622	YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan.	2018-06-22 17:15:29 +00:00
Todd Lipcon	59de967954	HADOOP-15549. Upgrade to commons-configuration 2.1 regresses task CPU consumption	2018-06-21 10:32:52 -07:00
Todd Lipcon	43541a1890	HADOOP-15551. Avoid use of Arrays.stream in Configuration.addTags	2018-06-20 16:43:10 -07:00
Xiao Chen	32f867a6a9	HDFS-13682. Cannot create encryption zone after KMS auth token expires.	2018-06-20 15:58:26 -07:00
Eric Yang	2d87592fc6	HADOOP-15527. Improve delay check for stopping processes. ... Fixed script location. Contributed by Vinod Kumar Vavilapalli	2018-06-19 13:38:13 -04:00
Chris Douglas	980031bb04	HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs	2018-06-17 11:54:26 -07:00
Surendra Singh Lilhore	3905fdb793	HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T.	2018-06-17 12:12:01 +05:30
Yiqun Lin	8e7548d33b	HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.	2018-06-13 20:05:55 +08:00
Eric Yang	108da85320	HADOOP-15527. Improve delay check for stopping processes. ... Contributed by Vinod Kumar Vavilapalli	2018-06-12 20:40:32 -04:00
Inigo Goiri	aeaf9fec62	HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola.	2018-06-12 14:16:14 -07:00
Xiao Chen	a16623df21	HADOOP-15307. NFS: flavor AUTH_SYS should use VerifierNone. Contributed by Gabor Bota.	2018-06-12 11:16:24 -07:00
Rohith Sharma K S	2df73dace0	YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.	2018-06-12 17:13:09 +05:30
Yongjun Zhang	7c3dc39083	Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release. ... (cherry picked from commit 5a82f10e3254bc0745c2dda6bcef888d3ff0d1c3)	2018-06-11 15:13:18 -07:00
Sammi Chen	18201b882a	HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen.	2018-06-11 13:53:37 +08:00
Steve Loughran	ef0118b91e	HADOOP-15520. Add tests for various org.apache.hadoop.util classes. ... Contributed by Arash Nabili	2018-06-09 15:33:38 +01:00
Inigo Goiri	12be8bad7d	HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by Giovanni Matteo Fumarola.	2018-06-07 13:34:52 -07:00
Steve Loughran	f494f0b896	HADOOP-15512. Clean up Shell from JDK7 workarounds. ... Contributed by Zsolt Venczel.	2018-06-07 15:55:49 +01:00
Inigo Goiri	db81f85e84	HADOOP-15513. Add additional test cases to cover some corner cases for FileUtil#symlink. Contributed by Giovanni Matteo Fumarola.	2018-06-06 11:44:17 -07:00
Xiao Chen	ba4011d64f	HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel.	2018-06-05 21:18:31 -07:00
Chen Liang	1b0d4f4606	HDFS-13547. Add ingress port based sasl resolver. Contributed by Chen Liang.	2018-06-05 11:51:29 -07:00
Xiao Chen	6d5e87aec2	HADOOP-15507. Add MapReduce counters about EC bytes read.	2018-06-04 21:13:47 -07:00
Haibo Chen	04cf699dd5	YARN-8388. TestCGroupElasticMemoryController.testNormalExit() hangs on Linux. (Miklos Szegedi via Haibo Chen)	2018-06-04 14:23:08 -07:00
Haibo Chen	4880d890ee	YARN-8375. TestCGroupElasticMemoryController fails surefire build. (Miklos Szegedi via Haibo Chen)	2018-06-01 16:29:13 -07:00
Daniel Templeton	cba3194998	HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2 ... (Contributed by Haibo Yan via Daniel Templeton) Change-Id: I28edde8125dd20d8d270f0e609d1c04d8173c8b7	2018-06-01 14:42:39 -07:00
Wei-Chiu Chuang	32671d8713	HADOOP-14783. [KMS] Add missing configuration properties into kms-default.xml. Contributed by Chetna Chaudhari.	2018-05-31 16:09:33 -07:00
Takanobu Asanuma	d1e2b80980	MAPREDUCE-7098. Upgrade common-langs version to 3.7 in hadoop-mapreduce-project ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-05-31 18:31:10 +09:00
Kihwal Lee	e3236a9680	Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg.	2018-05-29 14:15:12 -05:00
Inigo Goiri	3c75f8e493	HADOOP-15497. TestTrash should use proper test path to avoid failing on Windows. Contributed by Anbang Hu.	2018-05-29 09:11:08 -07:00
Wei-Chiu Chuang	438ef4951a	HADOOP-15455. Incorrect debug message in KMSACL#hasAccess. Contributed by Yuen-Kuei Hsueh.	2018-05-28 17:32:32 -07:00
Karthik Palanisamy	61df174e8b	HADOOP-15449. Increase default timeout of ZK session to avoid frequent NameNode failover ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-05-28 19:41:07 +09:00
Johan Gustavsson	d14e26b31f	HADOOP-15477. Make unjar in RunJar overrideable ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-05-28 17:29:59 +09:00
Xiao Chen	02322de3f9	HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota.	2018-05-25 09:10:51 -07:00
Steve Loughran	bddfe796f2	HADOOP-15494. TestRawLocalFileSystemContract fails on Windows. ... Contributed by Anbang Hu.	2018-05-25 11:12:47 +01:00
Arpit Agarwal	51ce02bb54	HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar.	2018-05-23 10:30:12 -07:00
Robert Kanter	aa23d49fc8	HADOOP-15457. Add Security-Related HTTP Response Header in WEBUIs. (kanwaljeets via rkanter)	2018-05-23 10:24:09 -07:00
Sammi Chen	34e8b9f9a8	HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen.	2018-05-23 19:10:09 +08:00
Akira Ajisaka	745f203e57	Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka.	2018-05-23 17:16:23 +09:00
Miklos Szegedi	3e5f7ea986	YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.	2018-05-22 18:10:33 -07:00
Kihwal Lee	bcc8e76bad	HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal.	2018-05-22 11:20:51 -05:00
Mukul Kumar Singh	57c2feb0d3	HADOOP-15474. Rename properties introduced for <tags>. Contributed by Zsolt Venczel.	2018-05-22 13:33:31 +05:30
Rushabh Shah	73e9120ad7	Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp	2018-05-21 12:33:00 -05:00
Xiao Chen	89f5911392	HADOOP-15154. Abstract new method assertCapability for StreamCapabilities testing. Contributed by Zsolt Venczel.	2018-05-18 11:29:20 -07:00
Inigo Goiri	8783613696	HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack.	2018-05-17 19:26:44 -07:00
Inigo Goiri	53b807a6a8	HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.	2018-05-17 17:03:23 -07:00
Steve Loughran	07d8505f75	HADOOP-15466. Correct units in adl.http.timeout. ... Contributed by Sean Mackrory,	2018-05-15 16:19:03 +01:00
Sammi Chen	f3f544b004	Add 2.9.1 release notes and changes documents	2018-05-14 15:14:02 +08:00
sammichen	66c9905b57	Revert "Add 2.9.1 release notes and changes documents" ... This reverts commit e4dc346d65.	2018-05-14 14:38:40 +08:00
littlezhou	e4dc346d65	Add 2.9.1 release notes and changes documents	2018-05-14 14:24:01 +08:00
Rushabh Shah	a5449d3631	HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota	2018-05-12 12:19:13 -05:00
Haibo Chen	274eee3284	MAPREDUCE-7095. Race conditions in closing FadvisedChunkedFile. (Miklos Szegedi via Haibo Chen)	2018-05-10 10:46:55 -07:00
Inigo Goiri	1da8d4190d	HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. Contributed by Xiao Liang.	2018-05-10 09:41:16 -07:00
Sean Mackrory	1cfe7506f7	HADOOP-15356. Make HTTP timeout configurable in ADLS connector. Contributed by Atul Sikaria and Sean Mackrory.	2018-05-09 15:15:51 -06:00
Anu Engineer	3a43ac2851	HDDS-1. Remove SCM Block DB. Contributed by Xiaoyu Yao.	2018-05-07 14:58:52 -07:00
Xiao Chen	a3a1552c33	Revert "HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah." ... This reverts commit 583fa6ed48. Conflicts: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSTokenRenewer.java hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java	2018-05-07 13:32:27 -07:00
Rushabh Shah	4cdbdce752	HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah	2018-05-04 15:36:13 -05:00
Daniel Templeton	87c23ef643	HDFS-13481. TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently ... (Contributed by Gabor Bota via Daniel Templeton) Change-Id: I9921981dfa69669fe7912dd2a31ae8b638283204	2018-05-02 17:13:40 -07:00
Steve Loughran	fe649bb305	HADOOP-12071. conftest is not documented. ... Contributed by Kengo Seki.	2018-05-02 13:33:56 +01:00
Jason Lowe	e07156e8b0	HADOOP-15406. hadoop-nfs dependencies for mockito and junit are not test scope ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-05-02 17:30:10 +09:00
BELUGA BEHR	33768724ff	HADOOP-15377. Improve debug messages in MetricsConfig.java ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-05-02 17:09:22 +09:00
Steve Loughran	8f42dafcf8	HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong ... Contributed by Ajay Kumar	2018-05-01 22:32:40 +01:00
Wei-Chiu Chuang	bff3d7b0cf	HADOOP-15382. Log kinit output in credential renewal thread. Contributed by Gabor Bota.	2018-04-27 10:05:55 -07:00
Ewan Higgs	84ecfe3ceb	HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-04-27 19:21:37 +09:00
Wangda Tan	13d389bf51	HADOOP-15411. AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator. (Suma Shivaprasad via wangda) ... Change-Id: Ia19458a43aceb4ffdb1e8eccc519655235d92ba9	2018-04-26 13:54:40 -07:00
Daryn Sharp	bbc8dfcb8b	HADOOP-15402. Prevent double logout of UGI's LoginContext ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-04-26 13:54:40 -07:00
Owen O'Malley	2adda92de1	HDFS-7240 git commit fixup ... Signed-off-by: Owen O'Malley <omalley@apache.org>	2018-04-26 13:52:17 -07:00
Mukul Kumar Singh	8cc13ff962	HDFS-13425. Ozone: Clean-up of ozone related change from hadoop-common-project. Contributed by Lokesh Jain.	2018-04-26 05:36:04 -07:00
Mukul Kumar Singh	ec6c8742e5	HDFS-13415. Ozone: Remove cblock code from HDFS-7240. Contributed by Elek, Marton.	2018-04-26 05:36:04 -07:00
Anu Engineer	8b832f3c35	HDFS-13405. Ozone: Rename HDSL to HDDS. ... Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.	2018-04-26 05:36:04 -07:00
Anu Engineer	4f37ff7616	HDFS-13341. Ozone: Move ozone specific ServiceRuntimeInfo utility to the framework. Contributed by Elek, Marton.	2018-04-26 05:36:04 -07:00
Anu Engineer	4e61bc431e	HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects. ... Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.	2018-04-26 05:36:04 -07:00
Anu Engineer	740a06cdd7	HDFS-12719. Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch. Contributed by Mukul Kumar Singh.	2018-04-26 05:36:04 -07:00
Anu Engineer	06c6582694	HDFS-12585. Ozone: KSM UI: Add description for configs in UI. Contributed by Ajay Kumar.	2018-04-26 05:36:04 -07:00
Anu Engineer	0b3270a8de	HDFS-12513. Ozone: Create UI page to show Ozone configs by tag. Contributed by Ajay Kumar.	2018-04-26 05:36:04 -07:00
Chris Douglas	6d3d01d7ad	HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov	2018-04-26 05:36:04 -07:00
Anu Engineer	dcc21a4f93	HDFS-12005. Ozone: Web interface for SCM. Contributed by Elek, Marton.	2018-04-26 05:36:04 -07:00
Anu Engineer	acfae2716a	HDFS-12034. Ozone: Web interface for KSM. Contributed by Elek, Marton.	2018-04-26 05:36:04 -07:00
Yiqun Lin	8cf0c864c4	HDFS-12170. Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time. Contributed by Mukul Kumar Singh.	2018-04-26 05:36:04 -07:00
Rakesh Radhakrishnan	665f7c8b69	HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen.	2018-04-26 05:36:04 -07:00
Robert Kanter	7ab08a9c37	HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)	2018-04-23 15:44:15 -07:00
Lei Xu	42e82f0281	Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release. ... (cherry picked from commit f6ecb76d0b919b9836600fe28ec9e637b223cd54) Conflicts: hadoop-project-dist/pom.xml	2018-04-23 14:14:05 -07:00
Virajith Jalaparti	827d8593a5	HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri	2018-04-16 15:55:00 -07:00
Bharat Viswanadham	ec1e8c1a8c	HADOOP-15379. Make IrqHandler.bind() public. Contributed by Ajay Kumar	2018-04-12 21:51:20 -07:00
Aaron Fabbri	0d898b7bb8	HADOOP-12502 SetReplication OutOfMemoryError. Contributed by Vinayakumar B.	2018-04-11 17:19:56 -07:00
Xiao Chen	7c9cdad6d0	HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo.	2018-04-10 21:31:48 -07:00
Xiao Chen	583fa6ed48	HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah.	2018-04-10 15:38:25 -07:00
Jason Lowe	e81397545a	HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan	2018-04-10 16:44:55 -05:00
Xiaoyu Yao	8ab776d61e	HADOOP-15340. Provide meaningful RPC server name for RpcMetrics. Contributed by Elek Marton.	2018-04-10 11:42:54 -07:00
Ewan Higgs	cef8eb7981	HADOOP-15376. Remove double semi colons on imports that make Clover fall over. ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-04-10 23:58:26 +09:00
Bharat	0006346abe	HADOOP-15328. Fix the typo in HttpAuthentication.md. Contributed by fang zhenyi	2018-04-09 16:37:49 -07:00
Mukul Kumar Singh	0b345b7653	HADOOP-15366. Add a helper shutdown routine in HadoopExecutor to ensure clean shutdown. Contributed by Shashikant Banerjee.	2018-04-07 16:29:01 +05:30
Wangda Tan	6cf023f9b7	Added CHANGES/RELEASES/Jdiff for 3.1.0 release ... Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39 (cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)	2018-04-05 15:52:39 -07:00
Wei Yan	3121e8c293	HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.	2018-04-05 12:00:52 -07:00
Miklos Szegedi	e52539b46f	HADOOP-14855. Hadoop scripts may errantly believe a daemon is still running, preventing it from starting. Contributed by Robert Kanter.	2018-04-04 15:35:58 -07:00
Xiao Chen	1077392eaa	HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge.	2018-04-02 23:10:08 -07:00
Xiao Chen	57374c4737	HADOOP-15317. Improve NetworkTopology chooseRandom's loop.	2018-04-02 22:48:26 -07:00
Steve Loughran	dde1579096	HADOOP-15146. Remove DataOutputByteBuffer. ... Contributed by BELUGA BEHR.	2018-04-02 15:52:40 +01:00
Konstantin V Shvachko	acfd764fcc	HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.	2018-03-30 18:55:35 -07:00
Konstantin V Shvachko	2216bde322	HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.	2018-03-29 17:16:23 -07:00
Wei-Chiu Chuang	3fe41c65d8	HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge.	2018-03-27 13:33:41 -07:00
Xiao Chen	c22d62b338	HADOOP-15313. TestKMS should close providers.	2018-03-26 15:59:32 -07:00
Xiaoyu Yao	22194f3d21	HADOOP-15339. Support additional key/value propereties in JMX bean registration. Contributed by Elek Marton.	2018-03-26 10:45:29 -07:00
Anu Engineer	28790b81ec	HADOOP-15295. Remove redundant logging related to tags from Configuration. Contributed by Ajay Kumar.	2018-03-23 21:17:18 -07:00
Lei Xu	f9427b73a2	Update releasenotes and changelogs for 3.0.1 release	2018-03-23 11:46:41 -07:00
Jitendra Pandey	4bea96f9a8	HADOOP-14067. VersionInfo should load version-info.properties from its own classloader. Contributed by Thejas M Nair.	2018-03-22 14:09:06 -07:00
Yufei Gu	268c29a5f5	HADOOP-15331. Fix a race condition causing parsing error of java.io.BufferedInputStream in class org.apache.hadoop.conf.Configuration. Contributed by Miklos Szegedi.	2018-03-22 11:04:37 -07:00
fang zhenyi	a3ed6f40e1	HADOOP-15330. Remove jdk1.7 profile from hadoop-annotations module ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-21 14:01:26 +09:00
Yufei Gu	138c1ed566	HADOOP-15062. TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9. Contributed by Miklos Szegedi.	2018-03-20 15:19:18 -07:00
Inigo Goiri	fe224ff972	HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang.	2018-03-20 11:19:46 -07:00
Inigo Goiri	e65ff1c8be	HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang.	2018-03-19 17:19:30 -07:00
Chris Douglas	3fc3fa9711	HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer	2018-03-19 16:05:55 -07:00
Xiao Chen	21c6661461	HADOOP-15234. Throw meaningful message on null when initializing KMSWebApp. Contributed by fang zhenyi.	2018-03-15 20:17:16 -07:00
Steve Loughran	1976e0066e	HADOOP-15209. DistCp to eliminate needless deletion of files under already-deleted directories. ... Contributed by Steve Loughran.	2018-03-15 18:05:14 +00:00
Aaron Fabbri	e840b4adf4	HADOOP-15278 log s3a at info. Contributed by Steve Loughran.	2018-03-14 15:47:56 -07:00
Wangda Tan	252c2b4d52	Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu" ... Change-Id: I946a466a43d56c73bb0135384e73cb8513595461 (cherry picked from commit 80ee5248b2dda1cb8d122d4f362f2f8cf02b9467)	2018-03-14 13:36:53 -07:00
Takanobu Asanuma	fea16a440d	HADOOP-15294. TestUGILoginFromKeytab fails on Java9 ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-14 13:38:07 +09:00
Inigo Goiri	427fd027a3	HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang.	2018-03-13 20:01:07 -07:00
Chris Douglas	9d6994da19	HADOOP-15311. HttpServer2 needs a way to configure the acceptor/selector count. Contributed by Erik Krogen	2018-03-13 13:55:18 -07:00
Chris Douglas	45d1b0fdcc	HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer	2018-03-12 20:05:39 -07:00
Steve Loughran	dd05871b8b	HADOOP-15297. Make S3A etag => checksum feature optional. ... Contributed by Steve Loughran.	2018-03-12 14:01:42 +00:00
Owen O'Malley	fa6a8b78d4	Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu." ... This reverts commit a847903b6e. Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae (cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)	2018-03-09 22:46:41 -08:00
Owen O'Malley	3a8dade9b1	Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu." ... This reverts commit 172b23af33. (cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)	2018-03-09 22:46:30 -08:00
Takanobu Asanuma	99ab511cba	HADOOP-15293. TestLogLevel fails on Java 9 ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-09 10:20:35 -08:00
Steve Loughran	3f7bd46797	HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output. ... Contributed by Steve Loughran.	2018-03-09 10:44:07 +00:00
Xiao Chen	a906a22645	HADOOP-15280. TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk. Contributed by Bharat Viswanadham.	2018-03-08 10:17:02 -08:00
Takanobu Asanuma	e6f99e205b	HADOOP-15291. TestMiniKdc fails on Java 9 ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-06 06:01:33 -08:00
Steve Loughran	12ecb55ffe	HADOOP-15289. FileStatus.readFields() assertion incorrect. ... Contributed by Steve Loughran.	2018-03-06 10:05:12 +00:00
Takanobu Asanuma	4971276631	HADOOP-15271. Remove unicode multibyte characters from JavaDoc ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-05 15:07:58 -08:00
Ajay Kumar	3dc30bc24e	HADOOP-15286. Remove unused imports from TestKMSWithZK.java ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-04 07:12:52 -08:00
Ray Chiang	923e1773e1	HADOOP-14652. Update metrics-core version to 3.2.4. (rchiang)	2018-03-01 15:36:10 -08:00
Nanda kumar	55d04a6db1	HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-03-01 19:03:47 +09:00
Xiaoyu Yao	f20e10b2dd	HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar.	2018-02-28 09:44:39 -08:00
Arpit Agarwal	ac42dfc888	MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham.	2018-02-27 10:27:18 -08:00
Arpit Agarwal	137f0d324a	HADOOP-14959. DelegationTokenAuthenticator.authenticate() to wrap network exceptions. Contributed by Ajay Kumar.	2018-02-27 10:15:43 -08:00
Arpit Agarwal	28f644bf25	HADOOP-15178. Generalize NetUtils#wrapException to handle other subclasses with String Constructor. Contributed by Ajay Kumar.	2018-02-27 07:38:29 -08:00
Arpit Agarwal	78a10029ec	HADOOP-15265. Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively. Contributed by Nishant Bangarwa.	2018-02-26 13:56:53 -08:00
Arpit Agarwal	2fa7963c3d	HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.	2018-02-24 14:41:55 -08:00
Arpit Agarwal	033f9c68ea	HADOOP-15255. Upper/Lower case conversion support for group names in LdapGroupsMapping. Contributed by Nanda kumar.	2018-02-23 15:37:17 -08:00
Kihwal Lee	59cf758877	HADOOP-9747. Reduce unnecessary UGI synchronization. Contributed by Daryn Sharp.	2018-02-23 13:10:56 -06:00
Anu Engineer	3688e491d5	HADOOP-15007. Stabilize and document Configuration <tag> element. Contributed by Ajay Kumar.	2018-02-23 10:26:22 -08:00
Sean Mackrory	2bc3351eaf	HADOOP-6852. apparent bug in concatenated-bzip2 support (decoding). Contributed by Zsolt Venczel.	2018-02-21 12:57:14 -07:00
Arpit Agarwal	b0d3c877e3	HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar.	2018-02-20 18:18:58 -08:00
Robert Kanter	324e5a7cf2	HADOOP-15235. Authentication Tokens should use HMAC instead of MAC (rkanter)	2018-02-20 17:24:37 -08:00
Steve Loughran	1d37cf675c	HADOOP-15070. add test to verify FileSystem and paths differentiate on user info. ... Contributed by Steve Loughran.	2018-02-19 20:43:40 +00:00
fang zhenyi	4d4dde5112	HADOOP-15223. Replace Collections.EMPTY* with empty* when available ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-02-18 22:19:39 +09:00
Wangda Tan	31db977cb3	HADOOP-14875. Create end user documentation from the compatibility guidelines. (Daniel Templeton via wangda) ... Change-Id: I5d66d0f034874623af22aecae0a0b858b65396ed	2018-02-17 12:28:55 +08:00
Jason Lowe	0898ff42e9	HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka	2018-02-16 14:49:00 -06:00
Steve Loughran	9a013b255f	HADOOP-15176. Enhance IAM Assumed Role support in S3A client. ... Contributed by Steve Loughran (cherry picked from commit 96c047fbb98c2378eed9693a724d4cbbd03c00fd)	2018-02-15 15:57:10 +00:00
Anu Engineer	8f66affd62	HADOOP-15204. Add Configuration API for parsing storage sizes. Contributed by Anu Engineer.	2018-02-14 13:11:37 -08:00
Xiao Chen	1f20f432d2	Revert "HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar." ... This reverts commit 332269de06.	2018-02-14 10:25:05 -08:00
Steve Loughran	f20dc0d577	HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions. ... Contributed by Andras Bokor.	2018-02-14 16:20:14 +00:00
Arpit Agarwal	332269de06	HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar.	2018-02-13 10:14:16 -08:00
Chris Douglas	0c5d7d71a8	HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine	2018-02-12 21:07:15 -08:00
Chris Douglas	9cc6d1dfb3	Revert "HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine" ... This reverts commit 5b88cb3398.	2018-02-12 21:06:10 -08:00
Chris Douglas	5b88cb3398	HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine	2018-02-12 21:00:47 -08:00
Wangda Tan	60f9e60b3b	Preparing for 3.2.0 development ... Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938	2018-02-11 11:17:38 +08:00
Steve Loughran	996796f104	HADOOP-15214. Make Hadoop compatible with Guava 21.0. ... Contributed by Igor Dvorzhak	2018-02-08 10:55:54 -08:00
Anu Engineer	4304fcd5bd	HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.	2018-02-06 13:43:45 -08:00
Kihwal Lee	2dd960de98	HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp.	2018-02-06 15:33:18 -06:00
Jason Lowe	33e6cdbd16	YARN-7876. Localized jars that are expanded after localization are not fully copied. Contributed by Miklos Szegedi	2018-02-05 12:30:20 -06:00
Hanisha Koneru	51cb6c5380	HADOOP-15168. Add kdiag tool to hadoop command. Contributed by Bharat Viswanadham.	2018-02-02 12:51:27 -08:00
Jason Lowe	460d77bd64	HADOOP-15170. Add symlink support to FileUtil#unTarUsingJava. Contributed by Ajay Kumar	2018-02-02 11:33:26 -06:00
Xiao Chen	09dd709d6e	HADOOP-15197. Remove tomcat from the Hadoop-auth test bundle.	2018-02-01 15:33:52 -08:00
Xiaoyu Yao	af015c0b23	HDFS-13060. Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver. Contributed by Ajay Kumar.	2018-01-31 22:39:51 -08:00
Eric Yang	0bee3849e3	YARN-7816. Allow same application name submitted by multiple users. (Contributed by Gour Saha)	2018-01-31 20:51:40 -05:00
Jason Lowe	7288b08330	YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi	2018-01-31 09:39:43 -06:00
Jason Lowe	901d15a30b	Revert "YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi" ... This reverts commit 1b0f265db1.	2018-01-30 08:34:39 -06:00
Xiao Chen	b63dcd583f	HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi.	2018-01-28 22:19:49 -08:00
Haibo Chen	649ef7ac33	YARN-7064. Use cgroup to get container resource utilization. (Miklos Szegedi via Haibo Chen)	2018-01-26 16:27:31 -08:00
Jason Lowe	1b0f265db1	YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi	2018-01-26 13:25:20 -06:00
Chris Douglas	56872cff92	MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine	2018-01-26 09:18:30 -08:00
Wei Yan	0c139d5bcf	HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan.	2018-01-25 11:36:40 -08:00
Billie Rinaldi	e307edcb47	YARN-7540 and YARN-7605. Convert yarn app cli to call yarn api services and implement doAs for Api Service REST API. Contributed by Eric Yang and Jian He	2018-01-23 17:54:39 -08:00
Hanisha Koneru	6347b2253d	HDFS-13023. Journal Sync does not work on a secure cluster. Contributed by Bharat Viswanadham.	2018-01-22 16:02:32 -08:00
Hanisha Koneru	3fde0f1db5	HADOOP-15121. Encounter NullPointerException when using DecayRpcScheduler. Contributed by Tao Jie.	2018-01-22 15:54:44 -08:00
Masahiro Tanaka	6e27b20b4d	HADOOP-15181. Typo in SecureMode.md ... Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2018-01-22 17:12:36 +09:00
Vrushali C	c191538ed1	HADOOP-15166 CLI MiniCluster fails with ClassNotFoundException o.a.h.yarn.server.timelineservice.collector.TimelineCollectorManager. Contributed by Gera Shegalov	2018-01-19 16:15:55 -08:00
Steve Loughran	d689b2d99c	HADOOP-15114. Add closeStreams(...) to IOUtils (addendum). ... Contributed by Ajay Kumar.	2018-01-19 14:54:13 +00:00
Steve Loughran	e5a1ad6e24	HADOOP-14788. Credentials readTokenStorageFile to stop wrapping IOEs in IOEs. ... Contributed by Ajay Kumar.	2018-01-19 14:48:45 +00:00
Steve Loughran	de630708d1	HADOOP-15123. KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG. ... Contributed by Vipin Rathor. (cherry picked from commit 1ef906e29e0989aafcb35c51ad2acbb262b3c8e7) (cherry picked from commit f61edab1d0ea08b6d752ecdfb6068103822012ec)	2018-01-18 12:35:57 +00:00
Steve Loughran	f274fe33ea	Revert "HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits." ... This reverts commit 35ad9b1dd2.	2018-01-18 12:35:57 +00:00
Brahma Reddy Battula	08332e12d0	HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula.	2018-01-18 10:54:32 +05:30
Aaron Fabbri	268ab4e027	HADOOP-15141 Support IAM Assumed roles in S3A. Contributed by Steve Loughran.	2018-01-17 00:05:24 -08:00
Yufei Gu	b202935353	HADOOP-15157. Zookeeper authentication related properties to support CredentialProviders. (Contributed by Gergo Repas)	2018-01-16 10:15:22 -08:00
Arpit Agarwal	7016dd44e0	HDFS-13016. globStatus javadoc refers to glob pattern as "regular expression". Contributed by Mukul Kumar Singh.	2018-01-13 07:19:30 -08:00
Arpit Agarwal	addbcd8cd4	HADOOP-15114. Add closeStreams(...) to IOUtils. Contributed by Ajay Kumar.	2018-01-11 16:50:21 -08:00
Steve Loughran	2e0a451a8d	HADOOP-15033. Use java.util.zip.CRC32C for Java 9 and above ... Contributed by Dmitry Chuyko,	2018-01-11 10:47:50 +00:00
Miklos Szegedi	12d0645990	HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi.	2018-01-10 10:52:26 -08:00
Haibo Chen	2f6c038be6	YARN-7602. NM should reference the singleton JvmMetrics instance.	2018-01-03 09:41:26 -08:00
Arpit Agarwal	4ad39ec308	Revert "HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by Hanisha Koneru." ... This reverts commit 37efa67e37.	2018-01-02 17:34:29 -08:00
Arpit Agarwal	d82874851e	HADOOP-15155. Error in javadoc of ReconfigurableBase#reconfigureProperty. Contributed by Ajay Kumar.	2018-01-02 17:22:55 -08:00
Arpit Agarwal	dfe0cd8655	HADOOP-15152. Typo in javadoc of ReconfigurableBase#reconfigurePropertyImpl. Contributed by Nanda kumar.	2018-01-02 10:50:13 -08:00
Chris Douglas	7fe6f83c8f	HADOOP-15117. open(PathHandle) contract test should be exhaustive for default options	2017-12-30 17:58:35 -08:00
Xiao Chen	81127616c5	HADOOP-15149. CryptoOutputStream should implement StreamCapabilities.	2017-12-29 13:41:15 -08:00
Jitendra Pandey	d31c9d8c49	HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh.	2017-12-27 23:17:07 -08:00
Steve Loughran	c8ff0cc304	HADOOP-13282. S3 blob etags to be made visible in S3A status/getFileChecksum() calls. ... Contributed by Steve Loughran	2017-12-21 14:58:58 +00:00
Junping Du	a7f8caf58e	Add 2.8.3 release jdiff files. ... (cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)	2017-12-18 22:39:01 -08:00
Steve Loughran	35ad9b1dd2	HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits. ... Contributed by Aaron Fabbri	2017-12-18 21:19:06 +00:00
Chris Douglas	5e81f32d11	HADOOP-15106. FileSystem::open(PathHandle) should throw a specific exception on validation failure	2017-12-16 10:53:10 -08:00
Virajith Jalaparti	b668eb9155	HDFS-10675. Datanode support to read from external stores.	2017-12-15 17:51:37 -08:00
Xiaoyu Yao	37efa67e37	HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by Hanisha Koneru.	2017-12-14 10:58:16 -08:00
Jason Lowe	f8af0e2feb	HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan	2017-12-14 10:18:08 -06:00
Yiqun Lin	91c96bdf8e	HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.	2017-12-14 16:00:53 +08:00
Kai Zheng	f86c81d923	HADOOP-15039. Move SemaphoredDelegatingExecutor to hadoop-common. Contributed by Genmao Yu	2017-12-14 11:14:52 +08:00
Andrew Wang	d447152d49	Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release.	2017-12-13 13:05:32 -08:00
Chris Douglas	693169ef34	HDFS-12882. Support full open(PathHandle) contract in HDFS	2017-12-11 20:14:15 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	f19638333b	HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades.	2017-12-08 08:00:21 -08:00
Xiao Chen	19e0894209	HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.	2017-12-07 21:05:55 -08:00
Sunil G	daa1cdd062	YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. Contributed by Sunil G.	2017-12-07 18:56:54 -08:00
Wangda Tan	5e798b1a0d	YARN-6471. Support to add min/max resource configuration for a queue. (Sunil G via wangda) ... Change-Id: I9213f5297a6841fab5c573e85ee4c4e5f4a0b7ff	2017-12-07 18:56:54 -08:00
Sean Mackrory	acb92904d0	HADOOP-15098. TestClusterTopology#testChooseRandom fails intermittently. Contributed by Zsolt Venczel.	2017-12-07 12:30:58 -07:00
Lei Xu	67662e2ac9	HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu.	2017-12-07 11:15:40 -08:00
Arpit Agarwal	e00c7f78c1	HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.	2017-12-04 21:02:04 -08:00
Xiao Chen	404eab4dc0	HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.	2017-12-04 10:40:11 -08:00
Chris Douglas	42307e3c3a	HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak	2017-12-01 22:34:30 -08:00
Chris Douglas	f9d195dfe9	HADOOP-14600. LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions. Contributed by Ping Liu	2017-12-01 22:12:26 -08:00
Chris Douglas	53bbef3802	Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak" ... This reverts commit 5304698dc8.	2017-12-01 11:19:38 -08:00
Chris Douglas	5304698dc8	HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak	2017-12-01 10:29:30 -08:00
Chris Douglas	0780fdb1eb	HDFS-12877. Add open(PathHandle) with default buffersize	2017-11-30 15:13:16 -08:00
Robert Kanter	75a3ab88f5	HADOOP-13493. Compatibility Docs should clarify the policy for what takes precedence when a conflict is found (templedf via rkanter)	2017-11-30 07:39:15 -08:00
Chris Douglas	0e560f3b8d	HDFS-12681. Make HdfsLocatedFileStatus a subtype of LocatedFileStatus	2017-11-29 20:28:06 -08:00
Xiao Chen	d162252d7a	HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev.	2017-11-23 09:01:28 -08:00
Steve Loughran	de8b6ca5ef	HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints. ... Contributed by Steve Loughran and Ryan Blue.	2017-11-22 15:28:12 +00:00
Robert Kanter	f2efaf013f	HADOOP-14982. Clients using FailoverOnNetworkExceptionRetry can go into a loop if they're used without authenticating with kerberos in HA env (pbacsko via rkanter)	2017-11-16 11:11:19 -08:00
Chris Douglas	675e9a8f57	Revert "HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus." ... This reverts commit b85603e3f8.	2017-11-15 19:20:37 -08:00
Xiao Chen	b1941b200d	HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * numValues) > 0 on construction.	2017-11-15 16:44:06 -08:00
Daniel Templeton	69043ba8b5	HADOOP-14876. Create downstream developer docs from the compatibility guidelines	2017-11-15 10:03:29 -08:00
Arun Suresh	b07e68b02a	Addendum patch for Configuration fix. (Jason Lowe via asuresh)	2017-11-13 14:03:50 -08:00
Eric Yang	1b68b8ff2c	HADOOP-15008. Fixed period unit calculation for Hadoop Metrics V2. (Contribute by Erik Krogen)	2017-11-13 12:42:43 -05:00
Akira Ajisaka	975a57a688	HADOOP-15031. Fix javadoc issues in Hadoop Common. Contributed by Mukul Kumar Singh.	2017-11-13 23:12:23 +09:00
Chris Douglas	796a0d3a5c	HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when finish() and resetState() are used. Contributed by Mike Percy	2017-11-10 17:41:29 -08:00
Xiao Chen	3c6adda291	HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev.	2017-11-09 21:06:06 -08:00
Arun Suresh	5eb7dbe9b3	Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)	2017-11-09 15:15:51 -08:00
John Zhuge	6c32ddad30	HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge.	2017-11-09 10:16:12 -08:00
John Zhuge	bf6a660232	HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.	2017-11-09 10:16:12 -08:00
Mingliang Liu	b6d8f87b8e	HADOOP-15015. TestConfigurationFieldsBase to use SLF4J for logging. Contributed by Steve Loughran	2017-11-03 21:01:56 -07:00
Xiaoyu Yao	59d78a5088	HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen.	2017-11-03 16:10:37 -07:00
Chris Douglas	b85603e3f8	HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus.	2017-11-03 14:30:57 -07:00
Chris Douglas	d015e0bbd5	HDFS-7878. API - expose a unique file identifier.	2017-10-31 09:44:01 -07:00
Sean Mackrory	81225430d0	HDFS-206. Support for head in FSShell. Contributed by Gabor Bota.	2017-10-31 08:34:01 -06:00
Jason Lowe	2fae63aa60	HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe	2017-10-31 09:30:13 -05:00
Junping Du	a25b5aa0cf	Add several jdiff xml files for 2.8.2 release.	2017-10-26 19:30:48 -07:00
Junping Du	1ad863e220	Update CHANGES.md and RELEASENOTES for 2.8.2 release.	2017-10-26 19:13:58 -07:00
Xiao Chen	f66ad1fab9	HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen.	2017-10-25 14:11:30 -07:00
Akira Ajisaka	4c970088af	HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang.	2017-10-25 17:17:21 +09:00
Varun Saxena	67e7673750	HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena.	2017-10-25 03:06:12 +05:30
John Zhuge	c904d60c38	Revert "HADOOP-14954. MetricsSystemImpl#init should increment refCount when already initialized. Contributed by John Zhuge." ... This reverts commit 14b3c2695b.	2017-10-23 15:32:25 -07:00
Naganarasimha	6b8122458e	HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt.	2017-10-23 23:42:06 +05:30
Arpit Agarwal	4b00c9a47f	HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham.	2017-10-23 10:47:16 -07:00
John Zhuge	14b3c2695b	HADOOP-14954. MetricsSystemImpl#init should increment refCount when already initialized. Contributed by John Zhuge.	2017-10-20 16:13:41 -07:00
Kai Zheng	ce7cf66e5e	HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang	2017-10-20 09:42:04 +08:00
Wei-Chiu Chuang	97c70c7ac6	HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.	2017-10-19 06:02:13 -07:00
Junping Du	b016f08f67	HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du.	2017-10-18 15:06:30 -07:00
Xiao Chen	86ee0c5e4e	HADOOP-14944. Add JvmMetrics to KMS.	2017-10-17 19:06:45 -07:00
Lei Xu	31ebccc962	HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu)	2017-10-16 19:44:30 -07:00
Wei-Chiu Chuang	e906108fc9	HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.	2017-10-16 16:42:59 -07:00
Xiao Chen	b7ff624c76	HADOOP-14949. TestKMS#testACLs fails intermittently.	2017-10-16 14:19:31 -07:00
Manoj Govindassamy	133d7ca76e	HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem	2017-10-13 17:43:21 -07:00
Robert Kanter	e163f41850	HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter)	2017-10-13 13:52:58 -07:00
Anu Engineer	075358eb6f	HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin.	2017-10-11 15:58:20 -07:00
Arun Suresh	b6c2c9058e	HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh)	2017-10-11 15:21:21 -07:00
Steve Loughran	3de574413c	HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB. ... Contributed by Varada Hemeswari.	2017-10-11 18:06:43 +01:00
Jason Lowe	1123f8f0b6	HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp	2017-10-10 14:47:25 -05:00
Jitendra Pandey	d6602b5f39	HDFS-11575. Supporting HDFS NFS gateway with Federated HDFS. Contributed by Mukul Kumar Singh.	2017-10-10 10:38:05 -07:00
John Zhuge	9676ed19be	HADOOP-14184. Remove service loader config entry for ftp fs. Contributed by Sen Zhao.	2017-10-09 00:33:17 -07:00
Xiaoyu Yao	2b08a1fc64	HADOOP-14920. KMSClientProvider won't work with KMS delegation token retrieved from non-Java client. Contributed by Xiaoyu Yao.	2017-10-06 10:12:24 -07:00
Xiao Chen	25f31d9fc4	HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.	2017-10-05 19:46:47 -07:00
Akira Ajisaka	fe84cdc9da	HADOOP-14616. Client fails to read a block with erasure code (XOR, native) when one of the data block is lost. Contributed by Huafeng Wang.	2017-10-05 11:06:09 +09:00
Daniel Templeton	20e9ce3ab3	HADOOP-14459. SerializationFactory shouldn't throw a NullPointerException if the serializations list is not defined ... (Contributed by Nandor Kollar via Daniel Templeton)	2017-10-04 15:04:02 +02:00
Andrew Wang	b34b3ff94b	Add 3.0.0-beta1 CHANGES and RELEASENOTES.	2017-10-03 17:14:40 -07:00
Akira Ajisaka	c9b525bd94	YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.	2017-10-04 07:01:54 +09:00
Xiaoyu Yao	107c177782	HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar.	2017-10-03 13:02:12 -07:00
Arpit Agarwal	b91305119b	HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh.	2017-10-03 11:23:40 -07:00
Allen Wittenauer	4d5dd75b60	HADOOP-14908. CrossOriginFilter should trigger regex on more input (Johannes Alberti via aw)	2017-10-03 10:58:28 -07:00
Anu Engineer	442ea85545	HADOOP-14752. TestCopyFromLocal#testCopyFromLocalWithThreads is fleaky. Contributed by Andras Bokor.	2017-10-02 13:11:47 -07:00
Chen Liang	563dcdfc1d	HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham.	2017-10-02 10:58:19 -07:00
Xiao Chen	06df6ab254	HADOOP-14095. Document caveats about the default JavaKeyStoreProvider in KMS.	2017-09-29 19:34:29 -07:00
Jason Lowe	6f789fe057	HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru	2017-09-28 16:38:30 -05:00
Akira Ajisaka	d08b8c801a	HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari.	2017-09-26 16:46:03 +09:00
Anu Engineer	0889e5a8b7	HDFS-12529. Get source for config tags from file name. Contributed by Ajay Kumar.	2017-09-25 13:55:09 -07:00
Jason Lowe	ac05a51bbb	HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham	2017-09-25 15:35:44 -05:00
Akira Ajisaka	3a10367a17	HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.	2017-09-26 01:47:02 +09:00
Daniel Templeton	0807470808	HADOOP-14897. Loosen compatibility guidelines for native dependencies	2017-09-25 14:12:25 +02:00
Anu Engineer	ecc85620e8	HDFS-12339. NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper. Contributed by Mukul Kumar Singh.	2017-09-23 12:27:34 -07:00
Anu Engineer	1c4a798505	HADOOP-14894. ReflectionUtils should use Time.monotonicNow to mesaure duration. Contributed by Bharat Viswanadham.	2017-09-23 11:56:34 -07:00
Anu Engineer	423ebcaf51	HDFS-12320. Add quantiles for transactions batched in Journal sync. Contributed by Hanisha Koneru.	2017-09-23 10:34:13 -07:00
Anu Engineer	e1b32e0959	HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru.	2017-09-22 15:45:22 -07:00
Akira Ajisaka	7e58b2478c	HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina.	2017-09-20 21:07:49 +09:00
Daniel Templeton	7618fa9194	HADOOP-13714. Tighten up our compatibility guidelines for Hadoop 3	2017-09-16 09:20:33 +02:00
Steve Loughran	2d2d97fa7d	HADOOP-14553. Add (parallelized) integration tests to hadoop-azure ... Contributed by Steve Loughran	2017-09-15 17:03:01 +01:00
Aaron Fabbri	49467165a5	HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran.	2017-09-14 14:10:48 -07:00
John Zhuge	7ee02d1065	HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.	2017-09-14 11:26:49 -07:00
Andrew Wang	8277fab2be	HADOOP-14857. Fix downstream shaded client integration test. Contributed by Sean Busbey.	2017-09-13 10:59:04 -07:00
Chen Liang	10b2cfa96c	HADOOP-14804. correct wrong parameters format order in core-default.xml. Contributed by Chen Hongfei.	2017-09-13 10:49:34 -07:00
Xiao Chen	fa6cc43edd	Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah." ... This reverts commit 0a6d5c0cf1.	2017-09-12 19:53:07 -07:00
Andrew Wang	f4b6267465	HDFS-12222. Document and test BlockLocation for erasure-coded files. Contributed by Huafeng Wang.	2017-09-12 17:35:30 -07:00
Jason Lowe	86f4d1c66c	HADOOP-14843. Improve FsPermission symbolic parsing unit test coverage. Contributed by Bharat Viswanadham	2017-09-12 16:51:08 -05:00
Ray Chiang	556812c179	HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)	2017-09-12 10:19:34 -07:00
Ray Chiang	ad74691807	HADOOP-14798. Update sshd-core and related mina-core library versions. (rchiang)	2017-09-12 10:04:22 -07:00
Haibo Chen	d2d8f665e6	YARN-7181. CPUTimeTracker.updateElapsedJiffies can report negative usage. (Miklos Szegedi via Haibo Chen)	2017-09-11 12:47:55 -07:00
Aaron Fabbri	180e814b08	HADOOP-14851 LambdaTestUtils.eventually() doesn't spin on Assertion failures. Contributed by Steve Loughran	2017-09-08 19:32:07 -07:00
Junping Du	3fddabc2fe	YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.	2017-09-08 15:16:19 -07:00
John Zhuge	a4661850c1	HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.	2017-09-08 11:51:03 -07:00
Anu Engineer	e8278b02a4	HADOOP-14850. Read HttpServer2 resources directly from the source tree (if exists). Contributed by Elek, Marton.	2017-09-08 10:01:01 -07:00
Steve Loughran	5bbca80428	HADOOP-13421. Switch to v2 of the S3 List Objects API in S3A. ... Contributed by Aaron Fabbri	2017-09-08 12:07:02 +01:00
Xiao Chen	b3a4d7d2a0	HDFS-12400. Provide a way for NN to drain the local key cache before re-encryption.	2017-09-07 20:51:02 -07:00
Anu Engineer	a4cd101934	HDFS-12350. Support meta tags in configs. Contributed by Ajay Kumar.	2017-09-07 12:40:09 -07:00
Jason Lowe	dd814946f6	HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen	2017-09-06 16:04:30 -05:00
Chris Douglas	1f3bc63e67	HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov	2017-09-05 23:51:51 -07:00
Wei-Chiu Chuang	ad32759fd9	HADOOP-14688. Intern strings in KeyVersion and EncryptedKeyVersion. Contributed by Xiao Chen.	2017-09-05 15:11:37 -07:00
Andrew Wang	0d419c984f	Preparing for 3.1.0 development	2017-09-01 11:53:48 -07:00
Jitendra Pandey	063b6d0c93	HADOOP-14674. Correct javadoc for getRandomizedTempPath. Contributed by Mukul Kumar Singh.	2017-09-01 10:17:12 -07:00
Allen Wittenauer	a3fee475f7	HADOOP-14414. Calling maven-site-plugin directly for docs profile is unnecessary (Andras Bokor via aw)	2017-09-01 08:38:30 -07:00
Steve Loughran	621b43e254	HADOOP-13345 HS3Guard: Improved Consistency for S3A. ... Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu, Sean Mackrory, Steve Loughran and others.	2017-09-01 14:13:41 +01:00
Allen Wittenauer	27359b7139	HADOOP-14781. Clarify that HADOOP_CONF_DIR shouldn't actually be set in hadoop-env.sh ... Signed-off-by: Andrew Wang <wang@apache.org>	2017-08-31 21:10:52 -07:00
Allen Wittenauer	0adc3a0533	YARN-6721. container-executor should have stack checking ... Signed-off-by: Chris Douglas <cdouglas@apache.org>	2017-08-31 19:39:31 -07:00
Allen Wittenauer	190410085b	HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build ... Signed-off-by: Andrew Wang <wang@apache.org>	2017-08-31 19:06:49 -07:00
Yiqun Lin	ac12e153a8	HDFS-12317. HDFS metrics render error in the page of Github. Contributed by Yiqun Lin.	2017-08-31 17:23:17 +08:00
Allen Wittenauer	71bbb86d69	HADOOP-14670. Increase minimum cmake version for all platforms ... Signed-off-by: Chris Douglas <cdouglas@apache.org>	2017-08-30 21:47:24 -07:00
Junping Du	41480233a9	HADOOP-14814. Fix incompatible API change on FsServerDefaults to HADOOP-14104. Contributed by Junping Du.	2017-08-30 13:30:14 -07:00
Rohith Sharma K S	32188d3295	YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.	2017-08-30 11:29:54 +05:30
Steve Loughran	021974f4cb	HADOOP-14802. Add support for using container saskeys for all accesses. ... Contributed by Sivaguru Sankaridurg	2017-08-29 19:02:43 +01:00
Arpit Agarwal	8b7cbe3840	HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar.	2017-08-25 09:55:46 -07:00
Steve Loughran	8196a07c32	HDFS-12344. LocatedFileStatus regression: no longer accepting null FSPermission. ... Contributed by Ewan Higgs	2017-08-24 16:17:30 +01:00
John Zhuge	7e6463d2fb	HADOOP-14251. Credential provider should handle property key deprecation. Contributed by John Zhuge.	2017-08-23 11:37:18 -07:00
Subru Krishnan	4249172e14	YARN-7053. Move curator transaction support to ZKCuratorManager. (Jonathan Hung via Subru).	2017-08-22 19:20:57 -07:00
Jason Lowe	c379310212	HADOOP-14687. AuthenticatedURL will reuse bad/expired session cookies. Contributed by Daryn Sharp	2017-08-22 16:50:01 -05:00
Xiao Chen	4ec5acc704	HADOOP-14705. Add batched interface reencryptEncryptedKeys to KMS.	2017-08-22 07:47:39 -07:00
Arpit Agarwal	736ceab2f5	HDFS-12325. SFTPFileSystem operations should restore cwd. Contributed by Chen Liang.	2017-08-21 11:48:51 -07:00
Arpit Agarwal	2d105a2068	Revert "HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru." ... This reverts commit 8bef4eca28.	2017-08-18 10:15:52 -07:00
Lei Xu	99e558b13b	HADOOP-14398. Modify documents for the FileSystem Builder API. (Lei (Eddy) Xu)	2017-08-17 18:06:23 -07:00
Andrew Wang	dd7916d3cd	HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas.	2017-08-17 09:35:36 -07:00
Alexandr Krasheninnikov	1f04cb45f7	HADOOP-14560. Make HttpServer2 backlog size configurable. Contributed by Alexander Krasheninnikov. ... This closes #242.	2017-08-17 01:05:19 -07:00
Andrew Wang	96b3a6b972	HDFS-11082. Provide replicated EC policy to replicate files. Contributed by SammiChen.	2017-08-16 22:17:06 -07:00
Akira Ajisaka	08aaa4b36f	HDFS-12269. Better to return a Map rather than HashMap in getErasureCodingCodecs. Contributed by Huafeng Wang.	2017-08-17 13:20:27 +09:00
Subru Krishnan	75dd866bfb	HADOOP-14773. Extend ZKCuratorManager API for more reusability. (Íñigo Goiri via Subru).	2017-08-15 16:53:59 -07:00
Chris Douglas	645a8f2a4d	HADOOP-14726. Mark FileStatus::isDir as final	2017-08-14 21:57:20 -07:00
Arpit Agarwal	0446511398	HADOOP-14673. Remove leftover hadoop_xml_escape from functions. Contributed by Ajay Kumar.	2017-08-14 16:22:10 -07:00
Arpit Agarwal	8bef4eca28	HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru.	2017-08-14 15:53:35 -07:00
John Zhuge	7769e96149	HADOOP-14627. Support MSI and DeviceCode token provider in ADLS. Contributed by Atul Sikaria.	2017-08-13 00:22:34 -07:00
Subru Krishnan	bbbf0e2a41	HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru).	2017-08-11 13:58:45 -07:00
Xiao Chen	07fff43f4a	HADOOP-14760. Add missing override to LoadBalancingKMSClientProvider.	2017-08-11 11:41:41 -07:00
John Zhuge	582648befa	HADOOP-14260. Configuration.dumpConfiguration should redact sensitive information. Contributed by John Zhuge.	2017-08-11 10:16:08 -07:00
Allen Wittenauer	4222c97108	HADOOP-10392. Use FileSystem#makeQualified(Path) instead of Path#makeQualified(FileSystem) (ajisakaa via aw)	2017-08-11 09:25:56 -07:00
Steve Loughran	d964062f66	HADOOP-14754. TestCommonConfigurationFields failed: core-default.xml has 2 wasb properties missing in classes. ... Contributed by John Zhuge.	2017-08-11 10:18:17 +01:00
Wei-Chiu Chuang	a8b75466b2	HADOOP-14743. CompositeGroupsMapping should not swallow exceptions. Contributed by Wei-Chiu Chuang.	2017-08-10 09:35:27 -07:00
Steve Loughran	54356b1e83	HADOOP-14183. Remove service loader config file for wasb fs. ... Contributed by Esfandiar Manii.	2017-08-10 16:46:33 +01:00
Haohui Mai	1db4788b7d	HADOOP-14598. Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory. Contributed by Steve Loughran.	2017-08-08 16:33:18 -07:00
Jian He	acf9bd8b1d	YARN-6890. Not display killApp button on UI if UI is unsecured but cluster is secured. Contributed by Junping Du	2017-08-08 11:09:38 -07:00
Arpit Agarwal	bc206806da	HDFS-12264. DataNode uses a deprecated method IoUtils#cleanup. Contributed by Ajay Yadav.	2017-08-07 15:05:10 -07:00
Xiao Chen	a3a9c976c3	HADOOP-14727. Socket not closed properly when reading Configurations with BlockReaderRemote. Contributed by Jonathan Eagles.	2017-08-07 10:25:52 -07:00
Akira Ajisaka	a4eb7016cb	HDFS-12198. Document missing namenode metrics that were added recently. Contributed by Yiqun Lin.	2017-08-07 18:47:33 +09:00
Lei Xu	fe3341786a	HDFS-12251. Add document for StreamCapabilities. (Lei (Eddy) Xu)	2017-08-04 11:21:58 -07:00
Arpit Agarwal	a6fdeb8a87	HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav.	2017-08-04 10:40:52 -07:00
wenxinhe	691bf5ec5d	HADOOP-14706. Adding a helper method to determine whether a log is Log4j implement. ... This closes #257 Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2017-08-04 14:35:57 +09:00
Andrew Wang	f4c6b00a9f	HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen.	2017-08-03 15:44:51 -07:00
Chris Douglas	12e44e7bda	HDFS-6984. Serialize FileStatus via protobuf.	2017-08-02 12:12:48 -07:00
Sean Mackrory	1a1bf6b7d0	HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.	2017-08-02 12:25:05 -06:00
Steve Loughran	5e4434f628	HADOOP-14709. Fix checkstyle warnings in ContractTestUtils. ... Contributed by Thomas Marquardt. (cherry picked from commit cb4679261097e729b433a523e3a65779fdc83841)	2017-08-02 12:48:06 +01:00
Masatake Iwasaki	3a0b84d9c9	HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu.	2017-08-02 06:06:25 +00:00
Junping Du	cf6794ebe9	HADOOP-14683. FileStatus.compareTo binary compatible issue. Contributed by Akira Ajisaka.	2017-08-01 17:13:02 -07:00
Lei Xu	02cd71ba9d	HADOOP-14495. Add set options interface to FSDataOutputStreamBuilder. (Lei (Eddy) Xu)	2017-08-01 16:00:53 -07:00
Andrew Wang	a11c230236	HADOOP-14701. Configuration can log misleading warnings about an attempt to override final parameter. Contributed by Andrew Sherman.	2017-08-01 15:13:29 -07:00
Steve Loughran	778d4edd9a	HADOOP-14660 wasb: improve throughput by 34% when account limit exceeded. ... Contributed by Thomas Marquardt.	2017-08-01 21:36:28 +01:00
Arpit Agarwal	72eba25e09	HDFS-14676. Wrong default value for fs.df.interval. Contributed by xiangguang zheng.	2017-08-01 13:31:44 -07:00
Lei Xu	9586b0e24f	HADOOP-14397. Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it. (Lei (Eddy) Xu)	2017-07-31 20:12:40 -07:00
Andras Bokor	abbf4129a2	HADOOP-14343. Wrong pid file name in error message when starting secure daemon ... Signed-off-by: Allen Wittenauer <aw@apache.org>	2017-07-31 20:03:43 -07:00
Akira Ajisaka	f14be0d241	HADOOP-14690. RetryInvocationHandler should override toString(). Contributed by Yeliang Cang.	2017-07-31 14:08:30 +09:00
Ravi Prakash	746189ad8c	HADOOP-14229. hadoop.security.auth_to_local example is incorrect in the documentation. Contributed by Andras Bokor.	2017-07-28 11:43:36 -07:00
Yongjun Zhang	c6330f22a5	HDFS-12190. Enable 'hdfs dfs -stat' to display access time. Contributed by Yongjun Zhang.	2017-07-27 16:48:24 -07:00
Kihwal Lee	27a1a5fde9	HADOOP-14578. Bind IPC connections to kerberos UPN host for proxy users. Contributed by Daryn Sharp.	2017-07-26 13:12:39 -05:00
Brahma Reddy Battula	6d983cca52	HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula.	2017-07-25 23:51:53 +08:00
Akira Ajisaka	cca51e916b	HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.	2017-07-25 15:24:56 +09:00
Jitendra Pandey	f2921e51f0	HADOOP-14518. Customize User-Agent header sent in HTTP/HTTPS requests by WASB. Contributed by Georgi Chalakov.	2017-07-24 23:01:01 -07:00
Ravi Prakash	94ca52ae9e	HADOOP-14597. Native compilation broken with OpenSSL-1.1.0. Contributed by Ravi Prakash.	2017-07-24 16:01:45 -07:00
Jason Lowe	24853bf32a	YARN-6768. Improve performance of yarn api record toString and fromString. Contributed by Jonathan Eagles	2017-07-24 10:19:20 -05:00
Wei-Chiu Chuang	465c213439	HDFS-12094. Log torrent when none isa-l EC is used. Contributed by LiXin Ge.	2017-07-21 12:25:03 -07:00
Kihwal Lee	b3269f7cc1	HADOOP-14659. UGI getShortUserName does not need to search the Subject. Contributed by Daryn Sharp.	2017-07-20 16:12:21 -05:00
Daniel Templeton	c21c260392	HADOOP-14666. Tests use assertTrue(....equals(...)) instead of assertEquals()	2017-07-19 13:58:55 -07:00
Jason Lowe	df180259b0	HADOOP-14669. GenericTestUtils.waitFor should use monotonic time. Contributed by Daniel Templeton	2017-07-19 09:41:22 -05:00
Jitendra Pandey	2843c688bc	HADOOP-14642. wasb: add support for caching Authorization and SASKeys. Contributed by Sivaguru Sankaridurg.	2017-07-19 00:13:06 -07:00
Jason Lowe	5aa2bf231f	HADOOP-14637. GenericTestUtils.waitFor needs to check condition again after max wait time. Contributed by Daniel Templeton	2017-07-18 16:23:41 -05:00
Akira Ajisaka	ccaf036662	HADOOP-14539. Move commons logging APIs over to slf4j in hadoop-common. Contributed by Wenxin He.	2017-07-18 13:32:37 +09:00
Anu Engineer	02b141ac60	HDFS-11786. Add support to make copyFromLocal multi threaded. Contributed by Mukul Kumar Singh.	2017-07-16 10:59:34 -07:00
Xiao Chen	0a6d5c0cf1	HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.	2017-07-14 22:22:53 -07:00
Masatake Iwasaki	b61ab8573e	HADOOP-14646. FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runs. Contributed by Andras Bokor.	2017-07-13 21:41:43 +09:00
Akira Ajisaka	9144fd9e9b	HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor.	2017-07-12 11:35:50 +09:00
Steve Loughran	d670c3a4da	HADOOP-14535 wasb: implement high-performance random access and seek of block blobs. ... Contributed by Thomas Marquardt	2017-07-11 21:34:27 +01:00
Yiqun Lin	3a7f02b815	HDFS-12085. Reconfigure namenode heartbeat interval fails if the interval was set with time unit. Contributed by Weiwei Yang.	2017-07-11 20:40:11 +08:00
wenxinhe	fce7951014	HADOOP-14638. Replace commons-logging APIs with slf4j in StreamPumper. ... This closes #247 Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2017-07-11 13:30:13 +09:00
Jitendra Pandey	f1efa14fc6	HADOOP-10829. Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe. Contributed by Benoy Antony and Rakesh R.	2017-07-10 17:48:27 -07:00
Steve Loughran	09653ea098	HADOOP-14634. Remove jline from main Hadoop pom.xml. ... Contributed by Ray Chiang.	2017-07-10 11:53:13 +01:00
Andrew Wang	f10864a820	Add release notes, changes, jdiff for 3.0.0-alpha4	2017-07-07 11:01:59 -07:00
Akira Ajisaka	7cd095272c	HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He.	2017-07-08 02:54:24 +09:00
Akira Ajisaka	8fc5dcc2a1	Revert "HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He." ... This reverts commit 82cb2a6497.	2017-07-08 02:53:18 +09:00
Wei-Chiu Chuang	8153fe2bd3	HADOOP-14563. LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException. Contributed by Rushabh S Shah.	2017-07-07 06:13:10 -07:00
Akira Ajisaka	82cb2a6497	HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He.	2017-07-07 15:00:47 +09:00
John Zhuge	946dd25675	HADOOP-14608. KMS JMX servlet path not backwards compatible. Contributed by John Zhuge.	2017-07-05 11:16:56 -07:00
Vinayakumar B	a180ba4081	HADOOP-13414. Hide Jetty Server version header in HTTP responses. Contributed by Surendra Singth Lilhore.	2017-07-05 16:05:18 +05:30
Steve Loughran	b17e655b70	HADOOP-14617. Add ReflectionUtils.logThreadInfo that accept slf4j logger API. ... Contributed by Wenxin He.	2017-07-04 11:41:07 +01:00
Wenxin He	f2aba1da30	HADOOP-14571. Deprecate public APIs relate to log4j1 ... This closes #244 Signed-off-by: Akira Ajisaka <aajisaka@apache.org>	2017-07-04 18:55:20 +09:00
Steve Loughran	1aaa7f1eac	HADOOP-14615. Add ServiceOperations.stopQuietly that accept slf4j logger API. ... Contributed by Wenxin He.	2017-07-04 10:48:02 +01:00
Andrew Wang	af2773f609	Updating version for 3.0.0-beta1 development	2017-06-29 17:57:40 -07:00
Daniel Templeton	5a75f73893	HADOOP-14611. NetworkTopology.DEFAULT_HOST_LEVEL is unused ... (Contributed by Chen Liang via Daniel Templeton)	2017-06-29 12:28:43 -07:00
Kai Zheng	ea1da39b19	HADOOP-14479. Erasurecode testcase failures with native enabled. Contributed by Sammi Chen	2017-06-29 11:26:36 +08:00
Lei Xu	d6df0fdbbd	Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable. Contributed by luhuichun via lei.	2017-06-28 13:47:23 -07:00
Xiao Chen	fb5ee3fafb	HADOOP-14515. Addendum. Specifically configure zookeeper-related log levels in KMS log4j.	2017-06-27 23:49:09 -07:00
Kai Zheng	379f19a2c7	HDFS-11943. [Erasure coding] Warn log frequently print to screen in doEncode/doDecode functions. Contributed by liaoyuxiangqin	2017-06-26 16:26:09 +08:00
Akira Ajisaka	a594f96fb1	HADOOP-14549. Use GenericTestUtils.setLogLevel when available in hadoop-tools. Contributed by wenxin he.	2017-06-26 16:41:00 +09:00
Arpit Agarwal	0111711d8b	HADOOP-14543. ZKFC should use getAversion() while setting the zkacl. Contributed by Brahma Reddy Battula.	2017-06-23 16:50:47 -07:00
Steve Loughran	e5db9af8a0	HADOOP-14568. GenericTestUtils#waitFor missing parameter verification. ... Contributed by Yiqun Lin	2017-06-23 14:39:58 +01:00
Akira Ajisaka	092ebdf885	HADOOP-12940. Fix warnings from Spotbugs in hadoop-common.	2017-06-23 10:28:58 +09:00
Arpit Agarwal	8ceaac1877	HDFS-12010. TestCopyPreserveFlag fails consistently because of mismatch in access time. Contributed by Mukul Kumar Singh.	2017-06-22 15:42:50 -07:00
Vinayakumar B	8dbd53ef9f	HDFS-11067. DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries. Contributed by Vinayakumar B.	2017-06-22 17:37:08 +05:30
Akira Ajisaka	b64951905e	HADOOP-14542. Add IOUtils.cleanupWithLogger that accepts slf4j logger API. Contributed by Chen Liang.	2017-06-22 17:42:59 +09:00
Daryn Sharp	e806c6e0ce	HADOOP-14146. KerberosAuthenticationHandler should authenticate with SPN in AP-REQ. Contributed by Daryn Sharp	2017-06-21 11:03:41 -05:00
Akira Ajisaka	1a598479a9	HDFS-11992. Replace commons-logging APIs with slf4j in FsDatasetImpl. Contributed by hu xiaodong.	2017-06-21 11:19:48 +09:00
Yongjun Zhang	5157f6c46e	HADOOP-14429. FTPFileSystem#getFsAction always returns FsAction.NONE. (Hongyuan Li via Yongjun Zhang)	2017-06-20 16:51:13 -07:00
Lei Xu	45ff4d38e6	HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun.	2017-06-20 11:55:09 -07:00
Brahma Reddy Battula	2e9daa2e27	HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han.	2017-06-20 20:44:31 +08:00
Xiao Chen	15964ef147	HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j.	2017-06-19 23:12:02 -07:00
Akira Ajisaka	300804595e	HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong.	2017-06-19 19:39:36 +09:00
Akira Ajisaka	7ade5124b8	HADOOP-14538. Fix TestFilterFileSystem and TestHarFileSystem failures after DistributedFileSystem.append API. Contributed by Lei (Eddy) Xu.	2017-06-19 19:09:18 +09:00
Masatake Iwasaki	75043d3429	HADOOP-14424. Add CRC32C performance test. Contributed by LiXin Ge.	2017-06-19 09:16:45 +09:00
Lei Xu	6460df21a0	HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu.	2017-06-16 17:24:00 -07:00
Xiao Chen	4ebc23ba7b	HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively.	2017-06-16 09:49:33 -07:00
Steve Loughran	942ecbbc98	HADOOP-14486 TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0. ... Contributed by Hongyuan Li.	2017-06-16 09:45:22 +01:00
Akira Ajisaka	e855cc4ed4	HADOOP-14289. Move log4j APIs over to slf4j in hadoop-common.	2017-06-16 13:17:10 +09:00
Lei Xu	5e7cfdca7b	HADOOP-14394. Provide Builder pattern for DistributedFileSystem.create. (lei)	2017-06-15 10:59:24 -07:00
Xiao Chen	ef8edab930	HADOOP-14523. OpensslAesCtrCryptoCodec.finalize() holds excessive amounts of memory. Contributed by Misha Dmitriev.	2017-06-15 10:40:59 -07:00
Steve Loughran	d780a67864	HADOOP-14506. Add create() contract test that verifies ancestor dir creation. ... Contributed by Sean Mackrory.	2017-06-15 14:49:34 +01:00
Arpit Agarwal	8633ef8e10	HADOOP-14503. Make RollingAverages a mutable metric. Contributed by Hanisha Koneru.	2017-06-12 20:43:43 -07:00
Jonathan Eagles	a81916ea89	HADOOP-14501. Switch from aalto-xml to woodstox to handle odd XML features (jeagles)	2017-06-12 17:07:53 -05:00
Daniel Templeton	86368cc766	HADOOP-14310. RolloverSignerSecretProvider.LOG should be @VisibleForTesting ... (Contributed by Arun Shanmugam Kumar via Daniel Templeton)	2017-06-12 09:42:16 -07:00
Mingliang Liu	a2121cb0d9	HADOOP-14465. LdapGroupsMapping - support user and group search base. Contributed by Shwetha G S and Mingliang Liu	2017-06-09 14:55:07 -07:00
Xiao Chen	c4b5c32669	HADOOP-13854. KMS should log error details in KMSExceptionsProvider.	2017-06-08 22:35:31 -07:00
Xiao Chen	0202480742	HADOOP-13174. Add more debug logs for delegation tokens and authentication.	2017-06-08 21:34:15 -07:00
John Zhuge	5672ae7b37	HDFS-11861. ipc.Client.Connection#sendRpcRequest should log request name. Contributed by John Zhuge.	2017-06-07 15:52:52 -07:00
Carlo Curino	b65100c14b	YARN-6547. Enhance SLS-based tests leveraging invariant checker.	2017-06-06 17:19:15 -07:00
Brahma Reddy Battula	19ef3a81f8	HADOOP-14485. Redundant 'final' modifier in try-with-resources statement. Contributed by wenxin he.	2017-06-06 23:11:47 +08:00
Kihwal Lee	855e0477b1	HADOOP-14035. Reduce fair call queue backoff's impact on clients. Contributed by Daryn Sharp.	2017-06-06 08:35:12 -05:00
Brahma Reddy Battula	66c6fd8314	HADOOP-14431. ModifyTime of FileStatus returned by SFTPFileSystem's getFileStatus method is wrong. Contributed by Hongyuan Li.	2017-06-06 12:31:40 +08:00
Mingliang Liu	6aeda55bb8	HADOOP-14428. s3a: mkdir appears to be broken. Contributed by Mingliang Liu	2017-06-05 11:26:56 -07:00
Brahma Reddy Battula	abdd609e51	HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger.	2017-06-06 00:21:03 +08:00
Andrew Wang	7101477e47	HDFS-11383. Intern strings in BlockLocation and ExtendedBlock. Contributed by Misha Dmitriev.	2017-06-01 15:20:18 -07:00
Kihwal Lee	1543d0f5be	HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B.	2017-05-31 10:55:03 -05:00
Brahma Reddy Battula	62857be211	HADOOP-14456. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin.	2017-05-31 01:07:58 +08:00
Arpit Agarwal	bd6a2172e0	HDFS-11891. DU#refresh should print the path of the directory when an exception is caught. Contributed by Chen Liang.	2017-05-26 16:02:40 -07:00
Andrew Wang	2cd612ba8e	Update 3.0.0-alpha3 changes, release notes, jdiff.	2017-05-26 14:14:38 -07:00
Andrew Wang	16ad896d5c	Update maven version for 3.0.0-alpha4 development	2017-05-26 14:09:44 -07:00
Steve Loughran	8bf0e2d6b3	HADOOP-14430 the accessTime of FileStatus returned by SFTPFileSystem's ... getFileStatus method is always 0. Contributed by Hongyuan Li.	2017-05-25 15:19:58 +01:00
Steve Loughran	1ba9704eec	HADOOP-14399. Configuration does not correctly XInclude absolute file URIs. ... Contributed by Jonathan Eagles	2017-05-25 14:59:33 +01:00
Akira Ajisaka	6a52b5e144	HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu.	2017-05-25 15:36:44 +09:00
Brahma Reddy Battula	dcf4559ebd	HADOOP-14166. Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used. Contributed by Surendra Singh Lilhore.	2017-05-25 01:27:13 +08:00
Brahma Reddy Battula	b7a0c0e701	HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin.	2017-05-25 01:03:22 +08:00
Kai Zheng	a62be38a5e	HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen	2017-05-24 18:45:52 +08:00
Brahma Reddy Battula	52661e0912	HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.	2017-05-23 23:52:42 +08:00