Steve Loughran
f20dc0d577
HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions.
...
Contributed by Andras Bokor.
2018-02-14 16:20:14 +00:00
Chris Douglas
0c5d7d71a8
HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine
2018-02-12 21:07:15 -08:00
Chris Douglas
9cc6d1dfb3
Revert "HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine"
...
This reverts commit 5b88cb3398
.
2018-02-12 21:06:10 -08:00
Chris Douglas
5b88cb3398
HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine
2018-02-12 21:00:47 -08:00
Wangda Tan
60f9e60b3b
Preparing for 3.2.0 development
...
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Steve Loughran
996796f104
HADOOP-15214. Make Hadoop compatible with Guava 21.0.
...
Contributed by Igor Dvorzhak
2018-02-08 10:55:54 -08:00
Anu Engineer
4304fcd5bd
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
2018-02-06 13:43:45 -08:00
Kihwal Lee
2dd960de98
HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp.
2018-02-06 15:33:18 -06:00
Jason Lowe
33e6cdbd16
YARN-7876. Localized jars that are expanded after localization are not fully copied. Contributed by Miklos Szegedi
2018-02-05 12:30:20 -06:00
Hanisha Koneru
51cb6c5380
HADOOP-15168. Add kdiag tool to hadoop command. Contributed by Bharat Viswanadham.
2018-02-02 12:51:27 -08:00
Jason Lowe
460d77bd64
HADOOP-15170. Add symlink support to FileUtil#unTarUsingJava. Contributed by Ajay Kumar
2018-02-02 11:33:26 -06:00
Xiaoyu Yao
af015c0b23
HDFS-13060. Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver. Contributed by Ajay Kumar.
2018-01-31 22:39:51 -08:00
Eric Yang
0bee3849e3
YARN-7816. Allow same application name submitted by multiple users. (Contributed by Gour Saha)
2018-01-31 20:51:40 -05:00
Jason Lowe
7288b08330
YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi
2018-01-31 09:39:43 -06:00
Jason Lowe
901d15a30b
Revert "YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi"
...
This reverts commit 1b0f265db1
.
2018-01-30 08:34:39 -06:00
Xiao Chen
b63dcd583f
HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi.
2018-01-28 22:19:49 -08:00
Haibo Chen
649ef7ac33
YARN-7064. Use cgroup to get container resource utilization. (Miklos Szegedi via Haibo Chen)
2018-01-26 16:27:31 -08:00
Jason Lowe
1b0f265db1
YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi
2018-01-26 13:25:20 -06:00
Chris Douglas
56872cff92
MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine
2018-01-26 09:18:30 -08:00
Wei Yan
0c139d5bcf
HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan.
2018-01-25 11:36:40 -08:00
Billie Rinaldi
e307edcb47
YARN-7540 and YARN-7605. Convert yarn app cli to call yarn api services and implement doAs for Api Service REST API. Contributed by Eric Yang and Jian He
2018-01-23 17:54:39 -08:00
Hanisha Koneru
6347b2253d
HDFS-13023. Journal Sync does not work on a secure cluster. Contributed by Bharat Viswanadham.
2018-01-22 16:02:32 -08:00
Hanisha Koneru
3fde0f1db5
HADOOP-15121. Encounter NullPointerException when using DecayRpcScheduler. Contributed by Tao Jie.
2018-01-22 15:54:44 -08:00
Masahiro Tanaka
6e27b20b4d
HADOOP-15181. Typo in SecureMode.md
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-01-22 17:12:36 +09:00
Vrushali C
c191538ed1
HADOOP-15166 CLI MiniCluster fails with ClassNotFoundException o.a.h.yarn.server.timelineservice.collector.TimelineCollectorManager. Contributed by Gera Shegalov
2018-01-19 16:15:55 -08:00
Steve Loughran
d689b2d99c
HADOOP-15114. Add closeStreams(...) to IOUtils (addendum).
...
Contributed by Ajay Kumar.
2018-01-19 14:54:13 +00:00
Steve Loughran
e5a1ad6e24
HADOOP-14788. Credentials readTokenStorageFile to stop wrapping IOEs in IOEs.
...
Contributed by Ajay Kumar.
2018-01-19 14:48:45 +00:00
Steve Loughran
de630708d1
HADOOP-15123. KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG.
...
Contributed by Vipin Rathor.
(cherry picked from commit 1ef906e29e0989aafcb35c51ad2acbb262b3c8e7)
(cherry picked from commit f61edab1d0ea08b6d752ecdfb6068103822012ec)
2018-01-18 12:35:57 +00:00
Steve Loughran
f274fe33ea
Revert "HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits."
...
This reverts commit 35ad9b1dd2
.
2018-01-18 12:35:57 +00:00
Brahma Reddy Battula
08332e12d0
HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula.
2018-01-18 10:54:32 +05:30
Aaron Fabbri
268ab4e027
HADOOP-15141 Support IAM Assumed roles in S3A. Contributed by Steve Loughran.
2018-01-17 00:05:24 -08:00
Yufei Gu
b202935353
HADOOP-15157. Zookeeper authentication related properties to support CredentialProviders. (Contributed by Gergo Repas)
2018-01-16 10:15:22 -08:00
Arpit Agarwal
7016dd44e0
HDFS-13016. globStatus javadoc refers to glob pattern as "regular expression". Contributed by Mukul Kumar Singh.
2018-01-13 07:19:30 -08:00
Arpit Agarwal
addbcd8cd4
HADOOP-15114. Add closeStreams(...) to IOUtils. Contributed by Ajay Kumar.
2018-01-11 16:50:21 -08:00
Steve Loughran
2e0a451a8d
HADOOP-15033. Use java.util.zip.CRC32C for Java 9 and above
...
Contributed by Dmitry Chuyko,
2018-01-11 10:47:50 +00:00
Miklos Szegedi
12d0645990
HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi.
2018-01-10 10:52:26 -08:00
Haibo Chen
2f6c038be6
YARN-7602. NM should reference the singleton JvmMetrics instance.
2018-01-03 09:41:26 -08:00
Arpit Agarwal
4ad39ec308
Revert "HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by Hanisha Koneru."
...
This reverts commit 37efa67e37
.
2018-01-02 17:34:29 -08:00
Arpit Agarwal
d82874851e
HADOOP-15155. Error in javadoc of ReconfigurableBase#reconfigureProperty. Contributed by Ajay Kumar.
2018-01-02 17:22:55 -08:00
Arpit Agarwal
dfe0cd8655
HADOOP-15152. Typo in javadoc of ReconfigurableBase#reconfigurePropertyImpl. Contributed by Nanda kumar.
2018-01-02 10:50:13 -08:00
Chris Douglas
7fe6f83c8f
HADOOP-15117. open(PathHandle) contract test should be exhaustive for default options
2017-12-30 17:58:35 -08:00
Xiao Chen
81127616c5
HADOOP-15149. CryptoOutputStream should implement StreamCapabilities.
2017-12-29 13:41:15 -08:00
Jitendra Pandey
d31c9d8c49
HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh.
2017-12-27 23:17:07 -08:00
Steve Loughran
c8ff0cc304
HADOOP-13282. S3 blob etags to be made visible in S3A status/getFileChecksum() calls.
...
Contributed by Steve Loughran
2017-12-21 14:58:58 +00:00
Junping Du
a7f8caf58e
Add 2.8.3 release jdiff files.
...
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
2017-12-18 22:39:01 -08:00
Steve Loughran
35ad9b1dd2
HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits.
...
Contributed by Aaron Fabbri
2017-12-18 21:19:06 +00:00
Chris Douglas
5e81f32d11
HADOOP-15106. FileSystem::open(PathHandle) should throw a specific exception on validation failure
2017-12-16 10:53:10 -08:00
Virajith Jalaparti
b668eb9155
HDFS-10675. Datanode support to read from external stores.
2017-12-15 17:51:37 -08:00
Xiaoyu Yao
37efa67e37
HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by Hanisha Koneru.
2017-12-14 10:58:16 -08:00
Jason Lowe
f8af0e2feb
HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan
2017-12-14 10:18:08 -06:00
Yiqun Lin
91c96bdf8e
HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.
2017-12-14 16:00:53 +08:00
Kai Zheng
f86c81d923
HADOOP-15039. Move SemaphoredDelegatingExecutor to hadoop-common. Contributed by Genmao Yu
2017-12-14 11:14:52 +08:00
Andrew Wang
d447152d49
Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release.
2017-12-13 13:05:32 -08:00
Chris Douglas
693169ef34
HDFS-12882. Support full open(PathHandle) contract in HDFS
2017-12-11 20:14:15 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f19638333b
HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades.
2017-12-08 08:00:21 -08:00
Xiao Chen
19e0894209
HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.
2017-12-07 21:05:55 -08:00
Sunil G
daa1cdd062
YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. Contributed by Sunil G.
2017-12-07 18:56:54 -08:00
Wangda Tan
5e798b1a0d
YARN-6471. Support to add min/max resource configuration for a queue. (Sunil G via wangda)
...
Change-Id: I9213f5297a6841fab5c573e85ee4c4e5f4a0b7ff
2017-12-07 18:56:54 -08:00
Sean Mackrory
acb92904d0
HADOOP-15098. TestClusterTopology#testChooseRandom fails intermittently. Contributed by Zsolt Venczel.
2017-12-07 12:30:58 -07:00
Lei Xu
67662e2ac9
HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu.
2017-12-07 11:15:40 -08:00
Arpit Agarwal
e00c7f78c1
HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.
2017-12-04 21:02:04 -08:00
Xiao Chen
404eab4dc0
HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.
2017-12-04 10:40:11 -08:00
Chris Douglas
42307e3c3a
HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
2017-12-01 22:34:30 -08:00
Chris Douglas
f9d195dfe9
HADOOP-14600. LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions. Contributed by Ping Liu
2017-12-01 22:12:26 -08:00
Chris Douglas
53bbef3802
Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak"
...
This reverts commit 5304698dc8
.
2017-12-01 11:19:38 -08:00
Chris Douglas
5304698dc8
HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
2017-12-01 10:29:30 -08:00
Chris Douglas
0780fdb1eb
HDFS-12877. Add open(PathHandle) with default buffersize
2017-11-30 15:13:16 -08:00
Robert Kanter
75a3ab88f5
HADOOP-13493. Compatibility Docs should clarify the policy for what takes precedence when a conflict is found (templedf via rkanter)
2017-11-30 07:39:15 -08:00
Chris Douglas
0e560f3b8d
HDFS-12681. Make HdfsLocatedFileStatus a subtype of LocatedFileStatus
2017-11-29 20:28:06 -08:00
Xiao Chen
d162252d7a
HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev.
2017-11-23 09:01:28 -08:00
Steve Loughran
de8b6ca5ef
HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints.
...
Contributed by Steve Loughran and Ryan Blue.
2017-11-22 15:28:12 +00:00
Robert Kanter
f2efaf013f
HADOOP-14982. Clients using FailoverOnNetworkExceptionRetry can go into a loop if they're used without authenticating with kerberos in HA env (pbacsko via rkanter)
2017-11-16 11:11:19 -08:00
Chris Douglas
675e9a8f57
Revert "HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus."
...
This reverts commit b85603e3f8
.
2017-11-15 19:20:37 -08:00
Xiao Chen
b1941b200d
HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * numValues) > 0 on construction.
2017-11-15 16:44:06 -08:00
Daniel Templeton
69043ba8b5
HADOOP-14876. Create downstream developer docs from the compatibility guidelines
2017-11-15 10:03:29 -08:00
Arun Suresh
b07e68b02a
Addendum patch for Configuration fix. (Jason Lowe via asuresh)
2017-11-13 14:03:50 -08:00
Eric Yang
1b68b8ff2c
HADOOP-15008. Fixed period unit calculation for Hadoop Metrics V2. (Contribute by Erik Krogen)
2017-11-13 12:42:43 -05:00
Akira Ajisaka
975a57a688
HADOOP-15031. Fix javadoc issues in Hadoop Common. Contributed by Mukul Kumar Singh.
2017-11-13 23:12:23 +09:00
Chris Douglas
796a0d3a5c
HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when finish() and resetState() are used. Contributed by Mike Percy
2017-11-10 17:41:29 -08:00
Xiao Chen
3c6adda291
HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev.
2017-11-09 21:06:06 -08:00
Arun Suresh
5eb7dbe9b3
Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
2017-11-09 15:15:51 -08:00
John Zhuge
6c32ddad30
HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge.
2017-11-09 10:16:12 -08:00
John Zhuge
bf6a660232
HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
2017-11-09 10:16:12 -08:00
Mingliang Liu
b6d8f87b8e
HADOOP-15015. TestConfigurationFieldsBase to use SLF4J for logging. Contributed by Steve Loughran
2017-11-03 21:01:56 -07:00
Xiaoyu Yao
59d78a5088
HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen.
2017-11-03 16:10:37 -07:00
Chris Douglas
b85603e3f8
HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus.
2017-11-03 14:30:57 -07:00
Chris Douglas
d015e0bbd5
HDFS-7878. API - expose a unique file identifier.
2017-10-31 09:44:01 -07:00
Sean Mackrory
81225430d0
HDFS-206. Support for head in FSShell. Contributed by Gabor Bota.
2017-10-31 08:34:01 -06:00
Jason Lowe
2fae63aa60
HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
2017-10-31 09:30:13 -05:00
Junping Du
a25b5aa0cf
Add several jdiff xml files for 2.8.2 release.
2017-10-26 19:30:48 -07:00
Junping Du
1ad863e220
Update CHANGES.md and RELEASENOTES for 2.8.2 release.
2017-10-26 19:13:58 -07:00
Xiao Chen
f66ad1fab9
HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen.
2017-10-25 14:11:30 -07:00
Akira Ajisaka
4c970088af
HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang.
2017-10-25 17:17:21 +09:00
Varun Saxena
67e7673750
HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena.
2017-10-25 03:06:12 +05:30
John Zhuge
c904d60c38
Revert "HADOOP-14954. MetricsSystemImpl#init should increment refCount when already initialized. Contributed by John Zhuge."
...
This reverts commit 14b3c2695b
.
2017-10-23 15:32:25 -07:00
Naganarasimha
6b8122458e
HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt.
2017-10-23 23:42:06 +05:30
Arpit Agarwal
4b00c9a47f
HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham.
2017-10-23 10:47:16 -07:00
John Zhuge
14b3c2695b
HADOOP-14954. MetricsSystemImpl#init should increment refCount when already initialized. Contributed by John Zhuge.
2017-10-20 16:13:41 -07:00
Kai Zheng
ce7cf66e5e
HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang
2017-10-20 09:42:04 +08:00
Wei-Chiu Chuang
97c70c7ac6
HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
2017-10-19 06:02:13 -07:00