Sunil G
2e2508b8e3
Make 3.2.0 aware to other branches
2019-01-21 21:24:51 +05:30
Surendra Singh Lilhore
dacc1a759e
HDFS-14175. EC: Native XOR decoder should reset the output buffer before using it. Contributed by Ayush Saxena.
2019-01-18 13:55:12 +05:30
Akira Ajisaka
01405df87f
HADOOP-15941. Addendum patch. Contributed by Takanobu Asanuma.
2019-01-16 10:28:08 +09:00
luhuachao
ccc43621ab
HADOOP-16019. ZKDelegationTokenSecretManager won't log exception message occured in function setJaasConfiguration.
...
Contributed by luhuachao.
2019-01-15 13:15:18 +00:00
Steve Loughran
6d0bffe17e
HADOOP-14556. S3A to support Delegation Tokens.
...
Contributed by Steve Loughran and Daryn Sharp.
2019-01-14 17:59:27 +00:00
Inigo Goiri
35fa3bd685
HADOOP-16045. Don't run TestDU on Windows. Contributed by Lukas Majercak.
2019-01-11 18:07:19 -08:00
Chen Liang
bf08f4abae
HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian.
2019-01-11 14:01:23 -08:00
Chen Liang
01cb958af4
HADOOP-16013. DecayRpcScheduler decay thread should run as a daemon. Contributed by Erik Krogen.
2019-01-11 12:51:07 -08:00
Giovanni Matteo Fumarola
fb8932a727
HADOOP-16029. Consecutive StringBuilder.append can be reused. Contributed by Ayush Saxena.
2019-01-11 10:54:49 -08:00
Akira Ajisaka
d4ca907da6
HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on Java 1.8.0_191 or upper
2019-01-11 11:24:05 +09:00
Kihwal Lee
33c009a45d
HADOOP-15909. KeyProvider class should implement Closeable. Contributed
...
by Kuhu Shukla.
2019-01-10 13:21:37 -06:00
Jason Lowe
c634589ab2
Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."
...
This reverts commit ecdeaa7e6a
.
2019-01-09 17:24:58 -06:00
Takanobu Asanuma
709ddb10e5
HADOOP-15941. [JDK 11] Compilation failure: package com.sun.jndi.ldap is not visible.
2019-01-09 13:55:25 +09:00
shwetayakkali@cloudera.com
4ab5260b7e
HDFS-14132. Add BlockLocation.isStriped() to determine if block is replicated or Striped
...
(Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: I0ed8996a0bae2ad2c7d3513143195533f7191af8
2019-01-08 17:04:57 -08:00
Akira Ajisaka
7f78397036
Revert "HADOOP-14556. S3A to support Delegation Tokens."
...
This reverts commit d7152332b3
.
2019-01-08 14:51:30 +09:00
Steve Loughran
d7152332b3
HADOOP-14556. S3A to support Delegation Tokens.
...
Contributed by Steve Loughran.
2019-01-07 13:18:03 +00:00
Eric Yang
d43af8b3db
HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop.
...
Contributed by Bolke de Bruin
2019-01-04 17:54:15 -05:00
Inigo Goiri
f4e18242bd
HADOOP-16028. Fix NetworkTopology chooseRandom function to support excluded nodes. Contributed by Sihai Ke.
2019-01-04 09:56:58 -08:00
Sunil G
51427cbdfb
HADOOP-15997. KMS client uses wrong UGI after HADOOP-14445. Contributed by Wei-Chiu Chuang.
2019-01-04 21:49:06 +05:30
Pranay Singh
ecdeaa7e6a
HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-01-03 09:56:07 -08:00
Akira Ajisaka
57198bc511
HADOOP-15962. The buffer size is small when unpacking tar archives. Contributed by BELUGA BEHR.
2018-12-28 15:38:47 +09:00
Konstantin V Shvachko
bd2a59e508
HDFS-14170. [SBN read] Fix checkstyle warnings related to SBN reads. Contributed by Konstantin V Shvachko.
2018-12-24 09:39:20 -08:00
Chao Sun
fa8550337d
HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
Erik Krogen
ef3e1929dd
HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from blocking within internalQueueCall. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
Chen Liang
cae279610b
HDFS-14138. [SBN read] Description errors in the comparison logic of transaction ID. Contributed by xiangheng.
2018-12-24 09:34:01 -08:00
Erik Krogen
b73fb70f97
HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too far behind. Contributed by Konstantin Shvachko.
2018-12-24 09:34:01 -08:00
Chao Sun
cbc2f932eb
HDFS-14067. [SBN read] Allow manual failover between standby and observer. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
Chao Sun
8c49135078
HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer. Contributed by Chao Sun.
2018-12-24 09:34:01 -08:00
Chen Liang
a65bb97f5d
HDFS-13791. Limit logging frequency of edit tail related statements. Contributed by Erik Krogen.
2018-12-24 09:34:00 -08:00
Chen Liang
d2e85b0b6d
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang.
2018-12-24 09:34:00 -08:00
Chen Liang
66ec3a67e8
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
2018-12-24 09:34:00 -08:00
Plamen Jeliazkov
e27708c2da
HDFS-13665. [SBN read] Move RPC response serialization into Server.doResponse(). Contributed by Plamen Jeliazkov.
2018-12-24 09:34:00 -08:00
Chao Sun
64b7cf59bd
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
2018-12-24 09:33:59 -08:00
Erik Krogen
151c8ddbe4
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
2018-12-24 09:33:59 -08:00
Plamen Jeliazkov
e880660a20
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
2018-12-24 09:33:59 -08:00
Erik Krogen
091ad974cd
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
2018-12-24 09:33:59 -08:00
Erik Krogen
9bf0696c73
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
2018-12-24 09:33:59 -08:00
Plamen Jeliazkov
c9d73437e8
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
2018-12-24 09:33:59 -08:00
Yiqun Lin
feb2664ac4
HDFS-13946. Log longest FSN write/read lock held stack trace.
2018-12-22 23:09:59 +08:00
Surendra Singh Lilhore
763e96ea2b
HDFS-14166. Ls with -e option not giving the result in proper format. Contributed by Shubham Dewan.
2018-12-22 12:22:24 +05:30
Jason Lowe
3961690037
HADOOP-15973. Configuration: Included properties are not cached if resource is a stream. Contributed by Eric Payne
2018-12-20 09:29:48 -06:00
Takanobu Asanuma
d963575918
HDFS-13661. Ls command with e option fails when the filesystem is not HDFS.
2018-12-20 10:03:33 +09:00
Surendra Singh Lilhore
788e7473a4
HDFS-14096. [SPS] : Add Support for Storage Policy Satisfier in ViewFs. Contributed by Ayush Saxena.
2018-12-17 11:24:57 +05:30
Gabor Bota
1ea29b7385
HADOOP-16000. Remove TLSv1 and SSLv2Hello from the default value of hadoop.ssl.enabled.protocols
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-12-15 10:53:52 +09:00
Giovanni Matteo Fumarola
76efeacd5f
HADOOP-15995. Add ldap.bind.password.alias in LdapGroupsMapping to distinguish aliases when using multiple providers through CompositeGroupsMapping. Contributed by Lukas Majercak.
2018-12-12 11:10:24 -08:00
Steve Loughran
202926ac33
HADOOP-15808. Harden Token service loader use.
...
Contributed by Steve Loughran.
2018-12-11 17:33:49 +00:00
Giovanni Matteo Fumarola
aa89492f29
Revert "HADOOP-15852. Refactor QuotaUsage. Contributed by Beluga Behr."
...
This reverts commit fb9deed41d
.
2018-12-04 12:57:28 -08:00
Steve Loughran
db2d8b01c6
HADOOP-15966. Hadoop Kerberos broken on macos as java.security.krb5.realm is reset.
...
Contributed by Steve Loughran
2018-12-04 15:35:43 +00:00
Giovanni Matteo Fumarola
fb9deed41d
HADOOP-15852. Refactor QuotaUsage. Contributed by Beluga Behr.
2018-12-03 13:25:02 -08:00
Giovanni Matteo Fumarola
c9a3aa64dc
HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak.
2018-12-03 12:10:05 -08:00
Eric Yang
38ea3814bd
HADOOP-15922. Revert patch 004.
2018-11-30 12:49:46 -05:00
Akira Ajisaka
c9bfca217f
MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin.
2018-11-30 13:13:23 +09:00
Steve Loughran
d0edd37269
HADOOP-15959. Revert "HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple"
...
This reverts commit 829a2e4d27
.
2018-11-29 17:52:11 +00:00
Ewan Higgs
c1d24f8483
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
...
Contributed by Ewan Higgs and Steve Loughran.
2018-11-29 15:12:17 +00:00
Eric Yang
a9d96948ed
HADOOP-15922. Fixed doAsUser decoding for DelegationTokenAuthenticationFilter.
...
Contributed by He Xiaoqiao
2018-11-26 13:49:19 -05:00
Vinayakumar B
23b441c225
HADOOP-15948. Inconsistency in get and put syntax if filename/dirname contains space. Contributed by Ayush Saxena.
2018-11-26 18:11:01 +05:30
Márton Elek
6934a65402
HADOOP-15358. SFTPConnectionPool connections leakage. Contributed by Mikhail Pryakhin.
2018-11-23 09:48:26 +01:00
Akira Ajisaka
1a00b4e325
Add 2.9.2 release notes and changes documents.
2018-11-20 14:25:18 +09:00
Inigo Goiri
460a94a10f
HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang.
2018-11-15 10:58:57 -08:00
Surendra Singh Lilhore
75291e6d53
HADOOP-15869. BlockDecompressorStream#decompress should not return -1 in case of IOException. Contributed by Surendra Singh Lilhore
2018-11-13 20:22:58 +05:30
Steve Loughran
3c9d97b8f7
HADOOP-15110. Gauges are getting logged in exceptions from AutoRenewalThreadForUserCreds.
...
Contributed by LiXin Ge.
2018-11-12 12:58:05 +00:00
Giovanni Matteo Fumarola
89b49167a5
HADOOP-15903. Allow HttpServer2 to discover resources in /static when symlinks are used. Contributed by Inigo Goiri.
2018-11-08 14:52:24 -08:00
Jason Lowe
0b6625a973
MAPREDUCE-7148. Fast fail jobs when exceeds dfs quota limitation. Contributed by Wang Yan
2018-11-07 08:20:49 -06:00
Jason Lowe
ab6aa4c726
YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg
2018-11-06 08:40:59 -06:00
Lars Francke
cb8d679c95
HADOOP-15687. Credentials class should allow access to aliases.
...
Author: Lars Francke <lars.francke@gmail.com>
2018-11-03 16:21:29 +00:00
Giovanni Matteo Fumarola
44e37b4fd9
HADOOP-15885. Add base64 (urlString) support to DTUtil. Contributed by Inigo Goiri.
2018-11-02 10:54:12 -07:00
Steve Loughran
62d98ca92a
HADOOP-15855. Review hadoop credential doc, including object store details.
...
Contributed by Steve Loughran.
2018-10-30 15:58:04 +00:00
Wei-Chiu Chuang
63e7134df6
Revert "HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao."
...
This reverts commit fb2b72e6fc
.
2018-10-28 17:04:59 -07:00
Hrishikesh Gadre
bfb9adc2b9
HADOOP-9567. Provide auto-renewal for keytab based logins. Contributed by Hrishikesh Gadre, Gary Helmling and Harsh J.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2018-10-27 08:59:47 -07:00
Wei-Chiu Chuang
fb2b72e6fc
HADOOP-15864. Job submitter / executor fail when SBN domain name can not resolved. Contributed by He Xiaoqiao.
2018-10-25 09:33:31 -07:00
Akira Ajisaka
8f97d6f2cd
HADOOP-15822. zstd compressor can fail with a small output buffer. Contributed by Jason Lowe.
2018-10-24 13:49:28 +09:00
Haibo Chen
823bb5dda8
MAPREDUCE-4669. MRAM web UI does not work with HTTPS. (Contributed by Robert Kanter)
2018-10-23 15:28:13 -07:00
Chen Liang
635786a511
HDFS-13566. Add configurable additional RPC listener to NameNode. Contributed by Chen Liang.
2018-10-23 14:53:45 -07:00
Inigo Goiri
dd268a64d3
Revert "HADOOP-15836. Review of AccessControlList. Contributed by BELUGA BEHR."
...
This reverts commit 00254d7b8c
.
2018-10-23 09:23:03 -07:00
Steve Loughran
52cb766ad0
HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility.
...
Contributed by Wei-Chiu Chuang.
2018-10-22 11:21:12 +01:00
Eric Yang
e2a9fa8448
HADOOP-15821. Move YARN Registry to Hadoop Registry.
...
Contributed by Íñigo Goiri
2018-10-19 19:46:48 -04:00
Inigo Goiri
00254d7b8c
HADOOP-15836. Review of AccessControlList. Contributed by BELUGA BEHR.
2018-10-19 13:57:43 -07:00
Jitendra Pandey
d93d515af5
HDDS-651. Rename o3 to o3fs for Filesystem.
2018-10-17 14:19:17 -07:00
Jason Lowe
9abda83947
HADOOP-15859. ZStandardDecompressor.c mistakes a class for an instance. Contributed by Jason Lowe
2018-10-17 14:38:42 -05:00
Adam Antal
24dc068a36
HADOOP-11100. Support to configure ftpClient.setControlKeepAliveTimeout.
...
Contributed by Adam Antal.
Signed-off-by: Xiao Chen <xiao@apache.org>
2018-10-17 11:34:50 -07:00
Steve Loughran
41b3603b5b
HADOOP-15861. Move DelegationTokenIssuer to the right path.
...
Contributed by Wei-Chiu Chuang.
2018-10-17 11:01:53 +01:00
Haibo Chen
c2288ac45b
YARN-8448. AM HTTPS Support for AM communication with RMWeb proxy. (Contributed by Robert Kanter)
2018-10-16 13:36:26 -07:00
Robert Kanter
7fe1a40a6b
HADOOP-15853. TestConfigurationDeprecation leaves behind a temp file, resulting in a license issue (ayushtkn via rkanter)
2018-10-15 15:02:37 -07:00
Xiao Chen
b6fc72a025
HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
2018-10-15 10:51:55 -07:00
Anu Engineer
3c1fe073d2
HDDS-445. Create a logger to print out all of the incoming requests.
...
Contributed by Bharat Viswanadham.
2018-10-12 16:27:54 -07:00
Xiao Chen
5ec86b445c
HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances.
...
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.
2018-10-12 09:35:52 -07:00
Robert Kanter
d91d47bc73
HADOOP-15717. TGT renewal thread does not log IOException (snemeth via rkanter)
2018-10-11 15:35:44 -07:00
Xiao Chen
64f2b32d57
HADOOP-15676. Cleanup TestSSLHttpServer. Contributed by Szilard Nemeth.
2018-10-11 15:12:36 -07:00
Takanobu Asanuma
7b57f2f71f
HADOOP-15785. [JDK10] Javadoc build fails on JDK 10 in hadoop-common. Contributed by Dinesh Chitlangia.
2018-10-11 13:51:51 +09:00
Robert Kanter
f261c31937
HADOOP-15708. Reading values from Configuration before adding deprecations make it impossible to read value with deprecated key (zsiegl via rkanter)
2018-10-10 18:51:37 -07:00
Steve Loughran
cdc4350718
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys.
...
Contributed by Steve Loughran.
2018-10-10 17:00:37 +01:00
Akira Ajisaka
6fa3feb577
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter.
2018-10-10 10:16:57 +09:00
Eric Yang
bf04f19456
YARN-8845. Removed unused hadoop.registry.rm reference.
...
Contributed by Íñigo Goiri
2018-10-09 15:54:45 -04:00
Takanobu Asanuma
9bbeb52486
HADOOP-15775. [JDK9] Add missing javax.activation-api dependency. Contributed by Akira Ajisaka.
2018-10-09 13:06:14 +09:00
Jason Lowe
f13e231025
HADOOP-15820. ZStandardDecompressor native code sets an integer field as a long. Contributed by Jason Lowe
2018-10-05 09:06:02 -05:00
Aaron Fabbri
046b8768af
HADOOP-15621 S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing. Contributed by Gabor Bota
2018-10-02 21:22:49 -07:00
Akira Ajisaka
31fa9bb799
HADOOP-15767. [JDK10] Building native package on JDK10 fails due to missing javah. Contributed by Takanobu Asanuma.
2018-10-03 11:29:18 +09:00
Sunil G
58fa96b697
Changed version in trunk to 3.3.0-SNAPSHOT.
2018-10-02 22:41:41 +05:30
Ewan Higgs
6fab6886f6
HDFS-13936. Multipart upload to HDFS to support 0 byte upload. Contributed by Ewan Higgs.
2018-10-02 14:05:35 +02:00
Akira Ajisaka
5c8d90763c
HADOOP-15764. Addendum patch: Fix NPE in SecurityUtil.
2018-09-28 10:03:22 +09:00
Akira Ajisaka
c62b440421
HADOOP-15693. Typo in Secure Mode documentation. Contributed by Thomas Levine.
2018-09-26 10:30:43 +09:00
Akira Ajisaka
93b0f540ed
HADOOP-15783. [JDK10] TestSFTPFileSystem.testGetModifyTime fails.
2018-09-25 16:03:28 +09:00
Sunil G
d060cbea48
HDFS-13937. Multipart Uploader APIs to be marked as private/unstable in 3.2.0. Contributed by Steve Loughran.
2018-09-24 21:19:47 +05:30
Sean Mackrory
0def61482b
Merge branch 'HADOOP-15407' into trunk
2018-09-22 21:19:12 -06:00
Ewan Higgs
429a07e08c
HADOOP-15764. [JDK10] Migrate from sun.net.dns.ResolverConfiguration to the replacement. Contributed by Akira Ajisaka.
2018-09-20 15:13:55 +02:00
Ewan Higgs
3da94a36e2
HADOOP-15756. [JDK10] Migrate from sun.net.util.IPAddressUtil to the replacement. Contributed by Akira Ajisaka.
2018-09-20 14:53:21 +02:00
Steve Loughran
646874c326
HADOOP-15748. S3 listing inconsistency can raise NPE in globber.
...
Contributed by Steve Loughran.
2018-09-20 13:04:52 +01:00
Vinayakumar B
7ad27e97f0
HADOOP-15736. Trash : Negative Value For Deletion Interval Leads To Abnormal Behaviour. Contributed by Ayush Saxena.
2018-09-20 09:31:35 +05:30
Chen Liang
a30b4f9e71
HADOOP-15726. Create utility to limit frequency of log statements. Contributed by Erik Krogen.
2018-09-19 13:22:37 -07:00
Jason Lowe
e71f61ecb8
HADOOP-15755. StringUtils#createStartupShutdownMessage throws NPE when args is null. Contributed by Lokesh Jain and Dinesh Chitlangia
2018-09-18 15:57:33 -05:00
Steve Loughran
1cf38a38da
HADOOP-15744. AbstractContractAppendTest fails against HDFS on HADOOP-15407 branch.
...
Contributed by Steve Loughran.
2018-09-18 10:56:56 +01:00
Yiqun Lin
ee051ef9fe
HADOOP-15742. Log if ipc backoff is enabled in CallQueueManager. Contributed by Ryan Wu.
2018-09-18 11:10:33 +08:00
Sean Mackrory
9475fd902a
HADOOP-15745. ABFS: Add ABFS configuration to ConfigRedactor.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
81dc4a995c
HADOOP-15663. ABFS: Simplify configuration.
...
Contributed by Da Zhou.
2018-09-17 19:54:01 +00:00
Thomas Marquardt
ce03a93f78
HADOOP-15446. ABFS: tune imports & javadocs; stabilise tests.
...
Contributed by Steve Loughran and Da Zhou.
2018-09-17 19:54:01 +00:00
Steve Loughran
f044deedbb
HADOOP-15407. HADOOP-15540. Support Windows Azure Storage - Blob file system "ABFS" in Hadoop: Core Commit.
...
Contributed by Shane Mainali, Thomas Marquardt, Zichen Sun, Georgi Chalakov, Esfandiar Manii, Amit Singh, Dana Kaban, Da Zhou, Junhua Gu, Saher Ahwal, Saurabh Pant, James Baker, Shaoyu Zhang, Lawrence Chen, Kevin Chen and Steve Loughran
2018-09-17 19:54:01 +00:00
Brahma Reddy Battula
ef5c776a42
HADOOP-15733. Correct the log when Invalid emptier Interval configured. Contributed by Ayush Saxena
2018-09-14 07:32:27 +05:30
Hanisha Koneru
291dcf2247
HDDS-423. Introduce an ozone specific log4j.properties. Contributed by Elek, Marton.
2018-09-13 16:37:44 -07:00
Takanobu Asanuma
5d084d7eca
HADOOP-12760. sun.misc.Cleaner has moved to a new location in OpenJDK 9. Contributed by Akira Ajisaka.
2018-09-13 20:42:09 +09:00
Steve Loughran
d7c0a08a1c
HADOOP-15426 Make S3guard client resilient to DDB throttle events and network failures (Contributed by Steve Loughran)
2018-09-12 21:04:49 -07:00
bibinchundatt
c44088ac19
YARN-8739. Fix jenkins issues for Node Attributes branch. Contributed by Sunil Govindan.
2018-09-12 16:01:01 +05:30
Naganarasimha
2475fb0a1e
YARN-6856. [YARN-3409] Support CLI for Node Attributes Mapping. Contributed by Naganarasimha G R.
2018-09-12 16:00:59 +05:30
Mingliang Liu
87f63b6479
HADOOP-14833. Remove s3a user:secret authentication. Contributed by Steve Loughran
2018-09-11 17:18:42 -07:00
Allen Wittenauer
4b8c2b1c1c
HADOOP-14671. Upgrade Apache Yetus to 0.8.0
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-09-11 08:55:34 -07:00
Inigo Goiri
527288ef89
HDFS-13836. RBF: Handle mount table znode with null value. Contributed by yanghuafeng.
2018-09-06 16:47:54 -07:00
Vrushali C
962089ab59
HADOOP-15657 Registering MutableQuantiles via Metric annotation. Contributed by Sushil Ks
2018-09-05 20:53:21 -07:00
Giovanni Matteo Fumarola
9af96d4ed4
HADOOP-15707. Add IsActiveServlet to be used for Load Balancers. Contributed by Lukas Majercak.
2018-09-05 10:50:25 -07:00
Wei-Chiu Chuang
e780556ae9
HADOOP-15696. KMS performance regression due to too many open file descriptors after Jetty migration. Contributed by Wei-Chiu Chuang.
2018-09-05 09:52:35 -07:00
Steve Loughran
9e96ac666d
HADOOP-10219. ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns.
...
Contributed by Kihwal Lee and Lukas Majercak.
2018-09-04 16:46:12 +01:00
Daniel Templeton
f2c2a68ec2
HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD
...
(Contributed by Laszlo Kollar via Daniel Templeton)
Change-Id: I6e2459d0700df7f3bad4eac8297a11690191c3ba
2018-08-30 09:12:36 -07:00
Steve Loughran
2e6c1109dc
HADOOP-15667. FileSystemMultipartUploader should verify that UploadHandle has non-0 length.
...
Contributed by Ewan Higgs
2018-08-30 14:33:16 +01:00
Daniel Templeton
d53a10b0a5
HADOOP-15705. Typo in the definition of "stable" in the interface classification
...
Change-Id: I3eae2143400a534903db4f186400561fc8d2bd56
2018-08-29 13:59:32 -07:00
John Zhuge
f9c6fd9471
HADOOP-15633. fs.TrashPolicyDefault: Can't create trash directory. Contributed by Fei Hui.
2018-08-27 09:22:59 -07:00
Konstantin V Shvachko
a4121c71c2
HDFS-13848. Refactor NameNode failover proxy providers. Contributed by Konstantin Shvachko.
2018-08-24 18:27:30 -07:00
Takanobu Asanuma
bed8cb6979
HADOOP-14314. The OpenSolaris taxonomy link is dead in InterfaceClassification.md. Contributed by Rui Gao.
2018-08-23 21:54:38 +09:00
Steve Loughran
34577d2c21
HADOOP-15679. ShutdownHookManager shutdown time needs to be configurable & extended.
...
Contributed by Steve Loughran.
2018-08-20 18:36:24 -07:00
Giovanni Matteo Fumarola
79c97f6a0b
HADOOP-14624. Add GenericTestUtils.DelayAnswer that accept slf4j logger API. Contributed by Ian Pickering and Wenxin He.
2018-08-17 14:40:00 -07:00
Xiao Chen
60ffec9f79
HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre.
2018-08-17 11:18:09 -07:00
Jason Lowe
a17eed1b87
HDFS-13822. speedup libhdfs++ build (enable parallel build). Contributed by Allen Wittenauer and Pradeep Ambati
2018-08-17 12:25:36 -05:00
Xiao Chen
8d7c93186e
HADOOP-15674. Test failure TestSSLHttpServer.testExcludedCiphers with TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard Nemeth.
2018-08-17 10:09:23 -07:00
Márton Elek
77b015000a
HADOOP-8807. Update README and website to reflect HADOOP-8662. Contributed by Andras Bokor.
2018-08-17 11:10:29 +02:00
Xiao Chen
edeb2a356a
HADOOP-15655. Enhance KMS client retry behavior. Contributed by Kitti Nanasi.
2018-08-16 22:42:03 -07:00
Akira Ajisaka
3e3963b035
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering.
2018-08-16 00:31:59 +09:00
Márton Elek
7e822ec246
HDDS-324. Addendum: remove the q letter which is accidentally added to the hadoop-functions.sh.
2018-08-14 20:54:33 +02:00
Xiaoyu Yao
b4031a8f1b
HDDS-324. Use pipeline name as Ratis groupID to allow datanode to report pipeline info. Contributed by Mukul Kumar Singh.
2018-08-13 12:47:49 -07:00
Steve Loughran
da9a39eed1
HADOOP-15583. Stabilize S3A Assumed Role support.
...
Contributed by Steve Loughran.
2018-08-08 22:57:24 -07:00
Wangda Tan
49c687608b
Make 3.1.1 awared by other branches
2018-08-08 13:02:12 -07:00
Xiao Chen
9499df7b81
HDFS-13658. Expose HighestPriorityLowRedundancy blocks statistics. Contributed by Kitti Nanasi.
2018-08-08 10:40:20 -07:00
Ewan Higgs
2ec97abb2e
HADOOP-15576. S3A Multipart Uploader to work with S3Guard and encryption Originally contributed by Ewan Higgs with refinements by Steve Loughran.
2018-08-08 13:50:23 +02:00
Mukul Kumar Singh
6ed8593d18
HDDS-301. ozone command shell does not contain subcommand to run ozoneFS commands. Contributed by Nilotpal Nandi.
2018-08-07 16:09:53 +05:30
Yiqun Lin
2e4e02b4df
HDFS-13792. Fix FSN read/write lock metrics name. Contributed by Chao Sun.
2018-08-07 09:32:51 +08:00
Arpit Agarwal
f2e29acbfa
HADOOP-15476. fix logging for split-dns multihome . Contributed by Ajay Kumar.
2018-08-01 12:32:01 -07:00
Chen Liang
e8f952ef06
HADOOP-15637. LocalFs#listLocatedStatus does not filter out hidden .crc files. Contributed by Erik Krogen.
2018-07-30 10:25:07 -07:00
Eric Yang
77721f39e2
HADOOP-15593. Fixed NPE in UGI spawnAutoRenewalThreadForUserCreds.
...
Contributed by Gabor Bota
2018-07-26 18:35:36 -04:00
Xiao Chen
be150a17b1
HDFS-13622. mkdir should print the parent directory in the error message when parent directories do not exist. Contributed by Shweta.
2018-07-26 10:24:32 -07:00
Yiqun Lin
9089790cab
HADOOP-15611. Log more details for FairCallQueue. Contributed by Ryan Wu.
2018-07-26 18:08:28 +08:00
Mukul Kumar Singh
5f0b924360
HADOOP-15395. DefaultImpersonationProvider fails to parse proxy user config if username has . in it. Contributed by Ajay Kumar.
2018-07-25 21:09:11 +05:30
Xiao Chen
81d59506e5
HADOOP-15609. Retry KMS calls when SSLHandshakeException occurs. Contributed by Kitti Nanasi.
2018-07-24 21:45:43 -07:00
Daniel Templeton
849c45db18
HDFS-13448. HDFS Block Placement - Ignore Locality for First Block Replica
...
(Contributed by BELUGA BEHR via Daniel Templeton)
Change-Id: I965d1cfa642ad24296038b83e3d5c9983545267d
2018-07-24 16:05:27 -07:00
Gera Shegalov
6bec03cfc8
HADOOP-15612. Improve exception when tfile fails to load LzoCodec. (gera)
2018-07-24 14:32:30 -07:00
bibinchundatt
8461278833
YARN-8544. [DS] AM registration fails when hadoop authorization is enabled. Contributed by Bibin A Chundatt.
2018-07-24 13:09:17 +05:30
Haibo Chen
17e26163ec
HADOOP-15586. Fix wrong log statement in AbstractService. (Szilard Nemeth via Haibo Chen)
2018-07-23 11:18:25 -07:00
Xiao Chen
993ec026d1
HADOOP-15596. Stack trace should not be printed out when running hadoop key commands. Contributed by Kitti Nanasi.
2018-07-20 19:46:46 -07:00
Haibo Chen
e6873dfde0
YARN-7300. DiskValidator is not used in LocalDirAllocator. (Szilard Nemeth via Haibo Chen)
2018-07-19 16:27:11 -07:00
Kihwal Lee
ccf2db7fc2
HADOOP-15614. TestGroupsCaching.testExceptionOnBackgroundRefreshHandled reliably fails. Contributed by Weiwei Yang.
2018-07-19 11:13:37 -05:00
Wei-Chiu Chuang
d215357718
HDFS-13485. DataNode WebHDFS endpoint throws NPE. Contributed by Siyao Meng.
2018-07-16 15:45:55 -07:00
Xiao Chen
d2874e0417
HDFS-13690. Improve error message when creating encryption zone while KMS is unreachable. Contributed by Kitti Nanasi.
2018-07-16 13:19:53 -07:00
Wei-Chiu Chuang
0c7a578927
HADOOP-15598. DataChecksum calculate checksum is contented on hashtable synchronization. Contributed by Prasanth Jayachandran.
2018-07-16 11:32:45 -07:00
Akira Ajisaka
88625f5cd9
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma.
2018-07-13 11:42:12 -04:00
Sean Mackrory
4f3f9391b0
HADOOP-15316. GenericTestUtils can exceed maxSleepTime. Contributed by Adam Antal.
2018-07-12 17:24:01 +02:00
Wei-Chiu Chuang
162228e8db
HDFS-13723. Occasional "Should be different group" error in TestRefreshUserMappings#testGroupMappingRefresh. Contributed by Siyao Meng.
2018-07-11 10:02:08 -07:00
Akira Ajisaka
4a08ddfa68
HADOOP-15568. fix some typos in the .sh comments. Contributed by Steve Loughran.
2018-07-09 15:43:38 -04:00
Xiao Chen
def9d94a40
HADOOP-15591. KMSClientProvider should log KMS DT acquisition at INFO level. Contributed by Kitti Nanasi.
2018-07-09 12:01:52 -07:00
Yiqun Lin
7a68ac607c
HDFS-13674. Improve documentation on Metrics. Contributed by Chao Sun.
2018-07-09 14:27:34 +08:00
Arpit Agarwal
061b168529
HDDS-167. Rename KeySpaceManager to OzoneManager. Contributed by Arpit Agarwal.
2018-07-06 12:09:05 -07:00
Xiaoyu Yao
498e3bfb6b
HADOOP-15571. Multiple FileContexts created with the same configuration object should be allowed to have different umask. Contributed by Vinod Kumar Vavilapalli.
2018-07-06 11:56:09 -07:00
Andrew Wang
f51da9c4d1
HADOOP-15554. Improve JIT performance for Configuration parsing. Contributed by Todd Lipcon.
2018-07-02 18:31:21 +02:00
Eric E Payne
d36f6b9e93
HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan.
2018-06-29 18:18:32 +00:00
Eric Yang
384764cdea
YARN-8409. Fixed NPE in ActiveStandbyElectorBasedElectorService.
...
Contributed by Chandni Singh
2018-06-28 12:39:49 -04:00
Bharat Viswanadham
d3fa83a44b
HDFS-13705:The native ISA-L library loading failure should be made warning rather than an error message. Contributed by Shashikant Banerjee.
2018-06-28 09:21:56 -07:00
Akira Ajisaka
ddbff7c8d3
HADOOP-14313. Replace/improve Hadoop's byte[] comparator. Contributed by Vikas Vishwakarma.
2018-06-28 14:58:40 +09:00
Akira Ajisaka
2b2399d623
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.
2018-06-28 14:37:22 +09:00
Todd Lipcon
7a3c6e9c3c
HADOOP-15550. Avoid static initialization of ObjectMappers
2018-06-25 15:36:45 -07:00
Inigo Goiri
abc3e4bad9
HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang.
2018-06-25 09:50:27 -07:00
Steve Loughran
1ba4e62304
HADOOP-14396. Add builder interface to FileContext.
...
Contributed by Lei (Eddy) Xu.
2018-06-25 14:38:57 +01:00
Eric E Payne
6432128622
YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan.
2018-06-22 17:15:29 +00:00
Todd Lipcon
59de967954
HADOOP-15549. Upgrade to commons-configuration 2.1 regresses task CPU consumption
2018-06-21 10:32:52 -07:00
Todd Lipcon
43541a1890
HADOOP-15551. Avoid use of Arrays.stream in Configuration.addTags
2018-06-20 16:43:10 -07:00
Xiao Chen
32f867a6a9
HDFS-13682. Cannot create encryption zone after KMS auth token expires.
2018-06-20 15:58:26 -07:00
Eric Yang
2d87592fc6
HADOOP-15527. Improve delay check for stopping processes.
...
Fixed script location.
Contributed by Vinod Kumar Vavilapalli
2018-06-19 13:38:13 -04:00
Chris Douglas
980031bb04
HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs
2018-06-17 11:54:26 -07:00
Surendra Singh Lilhore
3905fdb793
HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T.
2018-06-17 12:12:01 +05:30
Yiqun Lin
8e7548d33b
HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun.
2018-06-13 20:05:55 +08:00
Eric Yang
108da85320
HADOOP-15527. Improve delay check for stopping processes.
...
Contributed by Vinod Kumar Vavilapalli
2018-06-12 20:40:32 -04:00
Inigo Goiri
aeaf9fec62
HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola.
2018-06-12 14:16:14 -07:00
Rohith Sharma K S
2df73dace0
YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri.
2018-06-12 17:13:09 +05:30
Yongjun Zhang
7c3dc39083
Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release.
...
(cherry picked from commit 5a82f10e3254bc0745c2dda6bcef888d3ff0d1c3)
2018-06-11 15:13:18 -07:00
Sammi Chen
18201b882a
HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen.
2018-06-11 13:53:37 +08:00
Steve Loughran
ef0118b91e
HADOOP-15520. Add tests for various org.apache.hadoop.util classes.
...
Contributed by Arash Nabili
2018-06-09 15:33:38 +01:00
Inigo Goiri
12be8bad7d
HADOOP-15516. Add test cases to cover FileUtil#readLink. Contributed by Giovanni Matteo Fumarola.
2018-06-07 13:34:52 -07:00
Steve Loughran
f494f0b896
HADOOP-15512. Clean up Shell from JDK7 workarounds.
...
Contributed by Zsolt Venczel.
2018-06-07 15:55:49 +01:00
Inigo Goiri
db81f85e84
HADOOP-15513. Add additional test cases to cover some corner cases for FileUtil#symlink. Contributed by Giovanni Matteo Fumarola.
2018-06-06 11:44:17 -07:00
Xiao Chen
ba4011d64f
HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel.
2018-06-05 21:18:31 -07:00
Chen Liang
1b0d4f4606
HDFS-13547. Add ingress port based sasl resolver. Contributed by Chen Liang.
2018-06-05 11:51:29 -07:00
Xiao Chen
6d5e87aec2
HADOOP-15507. Add MapReduce counters about EC bytes read.
2018-06-04 21:13:47 -07:00
Haibo Chen
04cf699dd5
YARN-8388. TestCGroupElasticMemoryController.testNormalExit() hangs on Linux. (Miklos Szegedi via Haibo Chen)
2018-06-04 14:23:08 -07:00
Haibo Chen
4880d890ee
YARN-8375. TestCGroupElasticMemoryController fails surefire build. (Miklos Szegedi via Haibo Chen)
2018-06-01 16:29:13 -07:00
Daniel Templeton
cba3194998
HDFS-13636. Cross-Site Scripting vulnerability in HttpServer2
...
(Contributed by Haibo Yan via Daniel Templeton)
Change-Id: I28edde8125dd20d8d270f0e609d1c04d8173c8b7
2018-06-01 14:42:39 -07:00
Takanobu Asanuma
d1e2b80980
MAPREDUCE-7098. Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-31 18:31:10 +09:00
Kihwal Lee
e3236a9680
Additional check when unpacking archives. Contributed by Wilfred Spiegelenburg.
2018-05-29 14:15:12 -05:00
Inigo Goiri
3c75f8e493
HADOOP-15497. TestTrash should use proper test path to avoid failing on Windows. Contributed by Anbang Hu.
2018-05-29 09:11:08 -07:00
Karthik Palanisamy
61df174e8b
HADOOP-15449. Increase default timeout of ZK session to avoid frequent NameNode failover
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-28 19:41:07 +09:00
Johan Gustavsson
d14e26b31f
HADOOP-15477. Make unjar in RunJar overrideable
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-28 17:29:59 +09:00
Xiao Chen
02322de3f9
HADOOP-15473. Configure serialFilter in KeyProvider to avoid UnrecoverableKeyException caused by JDK-8189997. Contributed by Gabor Bota.
2018-05-25 09:10:51 -07:00
Steve Loughran
bddfe796f2
HADOOP-15494. TestRawLocalFileSystemContract fails on Windows.
...
Contributed by Anbang Hu.
2018-05-25 11:12:47 +01:00
Arpit Agarwal
51ce02bb54
HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar.
2018-05-23 10:30:12 -07:00
Robert Kanter
aa23d49fc8
HADOOP-15457. Add Security-Related HTTP Response Header in WEBUIs. (kanwaljeets via rkanter)
2018-05-23 10:24:09 -07:00
Sammi Chen
34e8b9f9a8
HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen.
2018-05-23 19:10:09 +08:00
Akira Ajisaka
745f203e57
Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka.
2018-05-23 17:16:23 +09:00
Miklos Szegedi
3e5f7ea986
YARN-8310. Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats. Contributed by Robert Kanter.
2018-05-22 18:10:33 -07:00
Kihwal Lee
bcc8e76bad
HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal.
2018-05-22 11:20:51 -05:00
Mukul Kumar Singh
57c2feb0d3
HADOOP-15474. Rename properties introduced for <tags>. Contributed by Zsolt Venczel.
2018-05-22 13:33:31 +05:30
Rushabh Shah
73e9120ad7
Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp
2018-05-21 12:33:00 -05:00
Xiao Chen
89f5911392
HADOOP-15154. Abstract new method assertCapability for StreamCapabilities testing. Contributed by Zsolt Venczel.
2018-05-18 11:29:20 -07:00
Inigo Goiri
8783613696
HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack.
2018-05-17 19:26:44 -07:00
Inigo Goiri
53b807a6a8
HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu.
2018-05-17 17:03:23 -07:00
Steve Loughran
07d8505f75
HADOOP-15466. Correct units in adl.http.timeout.
...
Contributed by Sean Mackrory,
2018-05-15 16:19:03 +01:00
Sammi Chen
f3f544b004
Add 2.9.1 release notes and changes documents
2018-05-14 15:14:02 +08:00
sammichen
66c9905b57
Revert "Add 2.9.1 release notes and changes documents"
...
This reverts commit e4dc346d65
.
2018-05-14 14:38:40 +08:00
littlezhou
e4dc346d65
Add 2.9.1 release notes and changes documents
2018-05-14 14:24:01 +08:00
Rushabh Shah
a5449d3631
HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota
2018-05-12 12:19:13 -05:00
Haibo Chen
274eee3284
MAPREDUCE-7095. Race conditions in closing FadvisedChunkedFile. (Miklos Szegedi via Haibo Chen)
2018-05-10 10:46:55 -07:00
Inigo Goiri
1da8d4190d
HADOOP-15454. TestRollingFileSystemSinkWithLocal fails on Windows. Contributed by Xiao Liang.
2018-05-10 09:41:16 -07:00
Sean Mackrory
1cfe7506f7
HADOOP-15356. Make HTTP timeout configurable in ADLS connector. Contributed by Atul Sikaria and Sean Mackrory.
2018-05-09 15:15:51 -06:00
Anu Engineer
3a43ac2851
HDDS-1. Remove SCM Block DB. Contributed by Xiaoyu Yao.
2018-05-07 14:58:52 -07:00
Xiao Chen
a3a1552c33
Revert "HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah."
...
This reverts commit 583fa6ed48
.
Conflicts:
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSTokenRenewer.java
hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
2018-05-07 13:32:27 -07:00
Rushabh Shah
4cdbdce752
HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah
2018-05-04 15:36:13 -05:00
Daniel Templeton
87c23ef643
HDFS-13481. TestRollingFileSystemSinkWithHdfs#testFlushThread: test failed intermittently
...
(Contributed by Gabor Bota via Daniel Templeton)
Change-Id: I9921981dfa69669fe7912dd2a31ae8b638283204
2018-05-02 17:13:40 -07:00
Steve Loughran
fe649bb305
HADOOP-12071. conftest is not documented.
...
Contributed by Kengo Seki.
2018-05-02 13:33:56 +01:00
BELUGA BEHR
33768724ff
HADOOP-15377. Improve debug messages in MetricsConfig.java
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-02 17:09:22 +09:00
Steve Loughran
8f42dafcf8
HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong
...
Contributed by Ajay Kumar
2018-05-01 22:32:40 +01:00
Wei-Chiu Chuang
bff3d7b0cf
HADOOP-15382. Log kinit output in credential renewal thread. Contributed by Gabor Bota.
2018-04-27 10:05:55 -07:00
Ewan Higgs
84ecfe3ceb
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-27 19:21:37 +09:00
Wangda Tan
13d389bf51
HADOOP-15411. AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator. (Suma Shivaprasad via wangda)
...
Change-Id: Ia19458a43aceb4ffdb1e8eccc519655235d92ba9
2018-04-26 13:54:40 -07:00
Daryn Sharp
bbc8dfcb8b
HADOOP-15402. Prevent double logout of UGI's LoginContext
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-26 13:54:40 -07:00
Owen O'Malley
2adda92de1
HDFS-7240 git commit fixup
...
Signed-off-by: Owen O'Malley <omalley@apache.org>
2018-04-26 13:52:17 -07:00
Mukul Kumar Singh
8cc13ff962
HDFS-13425. Ozone: Clean-up of ozone related change from hadoop-common-project. Contributed by Lokesh Jain.
2018-04-26 05:36:04 -07:00
Mukul Kumar Singh
ec6c8742e5
HDFS-13415. Ozone: Remove cblock code from HDFS-7240. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Anu Engineer
8b832f3c35
HDFS-13405. Ozone: Rename HDSL to HDDS.
...
Contributed by Ajay Kumar, Elek Marton, Mukul Kumar Singh, Shashikant Banerjee and Anu Engineer.
2018-04-26 05:36:04 -07:00
Anu Engineer
4f37ff7616
HDFS-13341. Ozone: Move ozone specific ServiceRuntimeInfo utility to the framework. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Anu Engineer
4e61bc431e
HDFS-13258. Ozone: restructure Hdsl/Ozone code to separated maven subprojects.
...
Contributed by Elek Marton, Mukul Kumar Singh, Xiaoyu Yao, Ajay Kumar, Anu Engineer, Lokesh Jain, Nanda Kumar.
2018-04-26 05:36:04 -07:00
Anu Engineer
740a06cdd7
HDFS-12719. Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Anu Engineer
06c6582694
HDFS-12585. Ozone: KSM UI: Add description for configs in UI. Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
Anu Engineer
0b3270a8de
HDFS-12513. Ozone: Create UI page to show Ozone configs by tag. Contributed by Ajay Kumar.
2018-04-26 05:36:04 -07:00
Chris Douglas
6d3d01d7ad
HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov
2018-04-26 05:36:04 -07:00
Anu Engineer
dcc21a4f93
HDFS-12005. Ozone: Web interface for SCM. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Anu Engineer
acfae2716a
HDFS-12034. Ozone: Web interface for KSM. Contributed by Elek, Marton.
2018-04-26 05:36:04 -07:00
Yiqun Lin
8cf0c864c4
HDFS-12170. Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time. Contributed by Mukul Kumar Singh.
2018-04-26 05:36:04 -07:00
Rakesh Radhakrishnan
665f7c8b69
HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen.
2018-04-26 05:36:04 -07:00
Robert Kanter
7ab08a9c37
HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
2018-04-23 15:44:15 -07:00
Lei Xu
42e82f0281
Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release.
...
(cherry picked from commit f6ecb76d0b919b9836600fe28ec9e637b223cd54)
Conflicts:
hadoop-project-dist/pom.xml
2018-04-23 14:14:05 -07:00
Virajith Jalaparti
827d8593a5
HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri
2018-04-16 15:55:00 -07:00
Bharat Viswanadham
ec1e8c1a8c
HADOOP-15379. Make IrqHandler.bind() public. Contributed by Ajay Kumar
2018-04-12 21:51:20 -07:00
Aaron Fabbri
0d898b7bb8
HADOOP-12502 SetReplication OutOfMemoryError. Contributed by Vinayakumar B.
2018-04-11 17:19:56 -07:00
Xiao Chen
7c9cdad6d0
HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo.
2018-04-10 21:31:48 -07:00
Xiao Chen
583fa6ed48
HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah.
2018-04-10 15:38:25 -07:00
Jason Lowe
e81397545a
HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan
2018-04-10 16:44:55 -05:00
Xiaoyu Yao
8ab776d61e
HADOOP-15340. Provide meaningful RPC server name for RpcMetrics. Contributed by Elek Marton.
2018-04-10 11:42:54 -07:00
Ewan Higgs
cef8eb7981
HADOOP-15376. Remove double semi colons on imports that make Clover fall over.
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-10 23:58:26 +09:00
Bharat
0006346abe
HADOOP-15328. Fix the typo in HttpAuthentication.md. Contributed by fang zhenyi
2018-04-09 16:37:49 -07:00
Mukul Kumar Singh
0b345b7653
HADOOP-15366. Add a helper shutdown routine in HadoopExecutor to ensure clean shutdown. Contributed by Shashikant Banerjee.
2018-04-07 16:29:01 +05:30
Wangda Tan
6cf023f9b7
Added CHANGES/RELEASES/Jdiff for 3.1.0 release
...
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
2018-04-05 15:52:39 -07:00
Wei Yan
3121e8c293
HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma.
2018-04-05 12:00:52 -07:00
Miklos Szegedi
e52539b46f
HADOOP-14855. Hadoop scripts may errantly believe a daemon is still running, preventing it from starting. Contributed by Robert Kanter.
2018-04-04 15:35:58 -07:00
Xiao Chen
1077392eaa
HADOOP-15355. TestCommonConfigurationFields is broken by HADOOP-15312. Contributed by LiXin Ge.
2018-04-02 23:10:08 -07:00
Xiao Chen
57374c4737
HADOOP-15317. Improve NetworkTopology chooseRandom's loop.
2018-04-02 22:48:26 -07:00
Steve Loughran
dde1579096
HADOOP-15146. Remove DataOutputByteBuffer.
...
Contributed by BELUGA BEHR.
2018-04-02 15:52:40 +01:00
Konstantin V Shvachko
acfd764fcc
HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.
2018-03-30 18:55:35 -07:00
Konstantin V Shvachko
2216bde322
HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.
2018-03-29 17:16:23 -07:00
Wei-Chiu Chuang
3fe41c65d8
HADOOP-15312. Undocumented KeyProvider configuration keys. Contributed by LiXin Ge.
2018-03-27 13:33:41 -07:00
Xiao Chen
c22d62b338
HADOOP-15313. TestKMS should close providers.
2018-03-26 15:59:32 -07:00
Xiaoyu Yao
22194f3d21
HADOOP-15339. Support additional key/value propereties in JMX bean registration. Contributed by Elek Marton.
2018-03-26 10:45:29 -07:00
Anu Engineer
28790b81ec
HADOOP-15295. Remove redundant logging related to tags from Configuration. Contributed by Ajay Kumar.
2018-03-23 21:17:18 -07:00
Lei Xu
f9427b73a2
Update releasenotes and changelogs for 3.0.1 release
2018-03-23 11:46:41 -07:00
Jitendra Pandey
4bea96f9a8
HADOOP-14067. VersionInfo should load version-info.properties from its own classloader. Contributed by Thejas M Nair.
2018-03-22 14:09:06 -07:00
Yufei Gu
268c29a5f5
HADOOP-15331. Fix a race condition causing parsing error of java.io.BufferedInputStream in class org.apache.hadoop.conf.Configuration. Contributed by Miklos Szegedi.
2018-03-22 11:04:37 -07:00
Yufei Gu
138c1ed566
HADOOP-15062. TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9. Contributed by Miklos Szegedi.
2018-03-20 15:19:18 -07:00
Inigo Goiri
fe224ff972
HDFS-13268. TestWebHdfsFileContextMainOperations fails on Windows. Contributed by Xiao Liang.
2018-03-20 11:19:46 -07:00
Inigo Goiri
e65ff1c8be
HDFS-13296. GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases. Contributed by Xiao Liang.
2018-03-19 17:19:30 -07:00
Chris Douglas
3fc3fa9711
HADOOP-14667. Flexible Visual Studio support. Contributed by Allen Wittenauer
2018-03-19 16:05:55 -07:00
Steve Loughran
1976e0066e
HADOOP-15209. DistCp to eliminate needless deletion of files under already-deleted directories.
...
Contributed by Steve Loughran.
2018-03-15 18:05:14 +00:00
Aaron Fabbri
e840b4adf4
HADOOP-15278 log s3a at info. Contributed by Steve Loughran.
2018-03-14 15:47:56 -07:00
Wangda Tan
252c2b4d52
Revert "HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu"
...
Change-Id: I946a466a43d56c73bb0135384e73cb8513595461
(cherry picked from commit 80ee5248b2dda1cb8d122d4f362f2f8cf02b9467)
2018-03-14 13:36:53 -07:00
Takanobu Asanuma
fea16a440d
HADOOP-15294. TestUGILoginFromKeytab fails on Java9
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-14 13:38:07 +09:00
Inigo Goiri
427fd027a3
HADOOP-15308. TestConfiguration fails on Windows because of paths. Contributed by Xiao Liang.
2018-03-13 20:01:07 -07:00
Chris Douglas
9d6994da19
HADOOP-15311. HttpServer2 needs a way to configure the acceptor/selector count. Contributed by Erik Krogen
2018-03-13 13:55:18 -07:00
Chris Douglas
45d1b0fdcc
HADOOP-14696. parallel tests don't work for Windows. Contributed by Allen Wittenauer
2018-03-12 20:05:39 -07:00
Steve Loughran
dd05871b8b
HADOOP-15297. Make S3A etag => checksum feature optional.
...
Contributed by Steve Loughran.
2018-03-12 14:01:42 +00:00
Owen O'Malley
fa6a8b78d4
Revert "HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu."
...
This reverts commit a847903b6e
.
Change-Id: I3122a2142f5bdf8507dece930e447556a43cd9ae
(cherry picked from commit 8fad3ec76070ccfcd3ed80feaba4355077bc6f5c)
2018-03-09 22:46:41 -08:00
Owen O'Malley
3a8dade9b1
Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
...
This reverts commit 172b23af33
.
(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
2018-03-09 22:46:30 -08:00
Takanobu Asanuma
99ab511cba
HADOOP-15293. TestLogLevel fails on Java 9
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-09 10:20:35 -08:00
Steve Loughran
3f7bd46797
HADOOP-15277. Remove .FluentPropertyBeanIntrospector from CLI operation log output.
...
Contributed by Steve Loughran.
2018-03-09 10:44:07 +00:00
Steve Loughran
12ecb55ffe
HADOOP-15289. FileStatus.readFields() assertion incorrect.
...
Contributed by Steve Loughran.
2018-03-06 10:05:12 +00:00
Takanobu Asanuma
4971276631
HADOOP-15271. Remove unicode multibyte characters from JavaDoc
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-05 15:07:58 -08:00
Nanda kumar
55d04a6db1
HADOOP-15275. Incorrect javadoc for return type of RetryPolicy#shouldRetry
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-01 19:03:47 +09:00
Xiaoyu Yao
f20e10b2dd
HDFS-13081. Datanode#checkSecureConfig should allow SASL and privileged HTTP. Contributed by Ajay Kumar.
2018-02-28 09:44:39 -08:00
Arpit Agarwal
ac42dfc888
MAPREDUCE-7061. SingleCluster setup document needs to be updated. Contributed by Bharat Viswanadham.
2018-02-27 10:27:18 -08:00
Arpit Agarwal
137f0d324a
HADOOP-14959. DelegationTokenAuthenticator.authenticate() to wrap network exceptions. Contributed by Ajay Kumar.
2018-02-27 10:15:43 -08:00
Arpit Agarwal
28f644bf25
HADOOP-15178. Generalize NetUtils#wrapException to handle other subclasses with String Constructor. Contributed by Ajay Kumar.
2018-02-27 07:38:29 -08:00
Arpit Agarwal
2fa7963c3d
HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.
2018-02-24 14:41:55 -08:00
Arpit Agarwal
033f9c68ea
HADOOP-15255. Upper/Lower case conversion support for group names in LdapGroupsMapping. Contributed by Nanda kumar.
2018-02-23 15:37:17 -08:00
Kihwal Lee
59cf758877
HADOOP-9747. Reduce unnecessary UGI synchronization. Contributed by Daryn Sharp.
2018-02-23 13:10:56 -06:00
Anu Engineer
3688e491d5
HADOOP-15007. Stabilize and document Configuration <tag> element. Contributed by Ajay Kumar.
2018-02-23 10:26:22 -08:00
Sean Mackrory
2bc3351eaf
HADOOP-6852. apparent bug in concatenated-bzip2 support (decoding). Contributed by Zsolt Venczel.
2018-02-21 12:57:14 -07:00
Arpit Agarwal
b0d3c877e3
HADOOP-12897. KerberosAuthenticator.authenticate to include URL on IO failures. Contributed by Ajay Kumar.
2018-02-20 18:18:58 -08:00
Steve Loughran
1d37cf675c
HADOOP-15070. add test to verify FileSystem and paths differentiate on user info.
...
Contributed by Steve Loughran.
2018-02-19 20:43:40 +00:00
fang zhenyi
4d4dde5112
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-02-18 22:19:39 +09:00
Wangda Tan
31db977cb3
HADOOP-14875. Create end user documentation from the compatibility guidelines. (Daniel Templeton via wangda)
...
Change-Id: I5d66d0f034874623af22aecae0a0b858b65396ed
2018-02-17 12:28:55 +08:00
Jason Lowe
0898ff42e9
HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka
2018-02-16 14:49:00 -06:00
Steve Loughran
9a013b255f
HADOOP-15176. Enhance IAM Assumed Role support in S3A client.
...
Contributed by Steve Loughran
(cherry picked from commit 96c047fbb98c2378eed9693a724d4cbbd03c00fd)
2018-02-15 15:57:10 +00:00
Anu Engineer
8f66affd62
HADOOP-15204. Add Configuration API for parsing storage sizes. Contributed by Anu Engineer.
2018-02-14 13:11:37 -08:00
Steve Loughran
f20dc0d577
HADOOP-10571. Use Log.*(Object, Throwable) overload to log exceptions.
...
Contributed by Andras Bokor.
2018-02-14 16:20:14 +00:00
Chris Douglas
0c5d7d71a8
HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine
2018-02-12 21:07:15 -08:00
Chris Douglas
9cc6d1dfb3
Revert "HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine"
...
This reverts commit 5b88cb3398
.
2018-02-12 21:06:10 -08:00
Chris Douglas
5b88cb3398
HADOOP-15195. With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Contributed by Grigori Rybkine
2018-02-12 21:00:47 -08:00
Wangda Tan
60f9e60b3b
Preparing for 3.2.0 development
...
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Steve Loughran
996796f104
HADOOP-15214. Make Hadoop compatible with Guava 21.0.
...
Contributed by Igor Dvorzhak
2018-02-08 10:55:54 -08:00
Anu Engineer
4304fcd5bd
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
2018-02-06 13:43:45 -08:00
Kihwal Lee
2dd960de98
HADOOP-15212. Add independent secret manager method for logging expired tokens. Contributed by Daryn Sharp.
2018-02-06 15:33:18 -06:00
Jason Lowe
33e6cdbd16
YARN-7876. Localized jars that are expanded after localization are not fully copied. Contributed by Miklos Szegedi
2018-02-05 12:30:20 -06:00
Hanisha Koneru
51cb6c5380
HADOOP-15168. Add kdiag tool to hadoop command. Contributed by Bharat Viswanadham.
2018-02-02 12:51:27 -08:00
Jason Lowe
460d77bd64
HADOOP-15170. Add symlink support to FileUtil#unTarUsingJava. Contributed by Ajay Kumar
2018-02-02 11:33:26 -06:00
Xiaoyu Yao
af015c0b23
HDFS-13060. Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver. Contributed by Ajay Kumar.
2018-01-31 22:39:51 -08:00
Eric Yang
0bee3849e3
YARN-7816. Allow same application name submitted by multiple users. (Contributed by Gour Saha)
2018-01-31 20:51:40 -05:00
Jason Lowe
7288b08330
YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi
2018-01-31 09:39:43 -06:00
Jason Lowe
901d15a30b
Revert "YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi"
...
This reverts commit 1b0f265db1
.
2018-01-30 08:34:39 -06:00
Xiao Chen
b63dcd583f
HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi.
2018-01-28 22:19:49 -08:00
Haibo Chen
649ef7ac33
YARN-7064. Use cgroup to get container resource utilization. (Miklos Szegedi via Haibo Chen)
2018-01-26 16:27:31 -08:00
Jason Lowe
1b0f265db1
YARN-2185. Use pipes when localizing archives. Contributed by Miklos Szegedi
2018-01-26 13:25:20 -06:00
Chris Douglas
56872cff92
MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine
2018-01-26 09:18:30 -08:00
Wei Yan
0c139d5bcf
HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan.
2018-01-25 11:36:40 -08:00
Billie Rinaldi
e307edcb47
YARN-7540 and YARN-7605. Convert yarn app cli to call yarn api services and implement doAs for Api Service REST API. Contributed by Eric Yang and Jian He
2018-01-23 17:54:39 -08:00
Hanisha Koneru
6347b2253d
HDFS-13023. Journal Sync does not work on a secure cluster. Contributed by Bharat Viswanadham.
2018-01-22 16:02:32 -08:00
Hanisha Koneru
3fde0f1db5
HADOOP-15121. Encounter NullPointerException when using DecayRpcScheduler. Contributed by Tao Jie.
2018-01-22 15:54:44 -08:00
Masahiro Tanaka
6e27b20b4d
HADOOP-15181. Typo in SecureMode.md
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-01-22 17:12:36 +09:00
Vrushali C
c191538ed1
HADOOP-15166 CLI MiniCluster fails with ClassNotFoundException o.a.h.yarn.server.timelineservice.collector.TimelineCollectorManager. Contributed by Gera Shegalov
2018-01-19 16:15:55 -08:00
Steve Loughran
d689b2d99c
HADOOP-15114. Add closeStreams(...) to IOUtils (addendum).
...
Contributed by Ajay Kumar.
2018-01-19 14:54:13 +00:00
Steve Loughran
e5a1ad6e24
HADOOP-14788. Credentials readTokenStorageFile to stop wrapping IOEs in IOEs.
...
Contributed by Ajay Kumar.
2018-01-19 14:48:45 +00:00
Steve Loughran
de630708d1
HADOOP-15123. KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG.
...
Contributed by Vipin Rathor.
(cherry picked from commit 1ef906e29e0989aafcb35c51ad2acbb262b3c8e7)
(cherry picked from commit f61edab1d0ea08b6d752ecdfb6068103822012ec)
2018-01-18 12:35:57 +00:00
Steve Loughran
f274fe33ea
Revert "HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits."
...
This reverts commit 35ad9b1dd2
.
2018-01-18 12:35:57 +00:00
Brahma Reddy Battula
08332e12d0
HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula.
2018-01-18 10:54:32 +05:30
Aaron Fabbri
268ab4e027
HADOOP-15141 Support IAM Assumed roles in S3A. Contributed by Steve Loughran.
2018-01-17 00:05:24 -08:00
Yufei Gu
b202935353
HADOOP-15157. Zookeeper authentication related properties to support CredentialProviders. (Contributed by Gergo Repas)
2018-01-16 10:15:22 -08:00
Arpit Agarwal
7016dd44e0
HDFS-13016. globStatus javadoc refers to glob pattern as "regular expression". Contributed by Mukul Kumar Singh.
2018-01-13 07:19:30 -08:00
Arpit Agarwal
addbcd8cd4
HADOOP-15114. Add closeStreams(...) to IOUtils. Contributed by Ajay Kumar.
2018-01-11 16:50:21 -08:00
Steve Loughran
2e0a451a8d
HADOOP-15033. Use java.util.zip.CRC32C for Java 9 and above
...
Contributed by Dmitry Chuyko,
2018-01-11 10:47:50 +00:00
Miklos Szegedi
12d0645990
HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi.
2018-01-10 10:52:26 -08:00
Haibo Chen
2f6c038be6
YARN-7602. NM should reference the singleton JvmMetrics instance.
2018-01-03 09:41:26 -08:00
Arpit Agarwal
4ad39ec308
Revert "HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by Hanisha Koneru."
...
This reverts commit 37efa67e37
.
2018-01-02 17:34:29 -08:00
Arpit Agarwal
d82874851e
HADOOP-15155. Error in javadoc of ReconfigurableBase#reconfigureProperty. Contributed by Ajay Kumar.
2018-01-02 17:22:55 -08:00
Arpit Agarwal
dfe0cd8655
HADOOP-15152. Typo in javadoc of ReconfigurableBase#reconfigurePropertyImpl. Contributed by Nanda kumar.
2018-01-02 10:50:13 -08:00
Chris Douglas
7fe6f83c8f
HADOOP-15117. open(PathHandle) contract test should be exhaustive for default options
2017-12-30 17:58:35 -08:00
Xiao Chen
81127616c5
HADOOP-15149. CryptoOutputStream should implement StreamCapabilities.
2017-12-29 13:41:15 -08:00
Jitendra Pandey
d31c9d8c49
HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh.
2017-12-27 23:17:07 -08:00
Steve Loughran
c8ff0cc304
HADOOP-13282. S3 blob etags to be made visible in S3A status/getFileChecksum() calls.
...
Contributed by Steve Loughran
2017-12-21 14:58:58 +00:00
Junping Du
a7f8caf58e
Add 2.8.3 release jdiff files.
...
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
2017-12-18 22:39:01 -08:00
Steve Loughran
35ad9b1dd2
HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits.
...
Contributed by Aaron Fabbri
2017-12-18 21:19:06 +00:00
Chris Douglas
5e81f32d11
HADOOP-15106. FileSystem::open(PathHandle) should throw a specific exception on validation failure
2017-12-16 10:53:10 -08:00
Virajith Jalaparti
b668eb9155
HDFS-10675. Datanode support to read from external stores.
2017-12-15 17:51:37 -08:00
Xiaoyu Yao
37efa67e37
HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by Hanisha Koneru.
2017-12-14 10:58:16 -08:00
Jason Lowe
f8af0e2feb
HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan
2017-12-14 10:18:08 -06:00
Yiqun Lin
91c96bdf8e
HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.
2017-12-14 16:00:53 +08:00
Kai Zheng
f86c81d923
HADOOP-15039. Move SemaphoredDelegatingExecutor to hadoop-common. Contributed by Genmao Yu
2017-12-14 11:14:52 +08:00
Andrew Wang
d447152d49
Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release.
2017-12-13 13:05:32 -08:00
Chris Douglas
693169ef34
HDFS-12882. Support full open(PathHandle) contract in HDFS
2017-12-11 20:14:15 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
f19638333b
HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades.
2017-12-08 08:00:21 -08:00
Xiao Chen
19e0894209
HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.
2017-12-07 21:05:55 -08:00
Sunil G
daa1cdd062
YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. Contributed by Sunil G.
2017-12-07 18:56:54 -08:00
Wangda Tan
5e798b1a0d
YARN-6471. Support to add min/max resource configuration for a queue. (Sunil G via wangda)
...
Change-Id: I9213f5297a6841fab5c573e85ee4c4e5f4a0b7ff
2017-12-07 18:56:54 -08:00
Sean Mackrory
acb92904d0
HADOOP-15098. TestClusterTopology#testChooseRandom fails intermittently. Contributed by Zsolt Venczel.
2017-12-07 12:30:58 -07:00
Lei Xu
67662e2ac9
HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu.
2017-12-07 11:15:40 -08:00
Arpit Agarwal
e00c7f78c1
HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.
2017-12-04 21:02:04 -08:00
Xiao Chen
404eab4dc0
HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.
2017-12-04 10:40:11 -08:00
Chris Douglas
42307e3c3a
HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
2017-12-01 22:34:30 -08:00
Chris Douglas
f9d195dfe9
HADOOP-14600. LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions. Contributed by Ping Liu
2017-12-01 22:12:26 -08:00
Chris Douglas
53bbef3802
Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak"
...
This reverts commit 5304698dc8
.
2017-12-01 11:19:38 -08:00
Chris Douglas
5304698dc8
HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
2017-12-01 10:29:30 -08:00
Chris Douglas
0780fdb1eb
HDFS-12877. Add open(PathHandle) with default buffersize
2017-11-30 15:13:16 -08:00
Robert Kanter
75a3ab88f5
HADOOP-13493. Compatibility Docs should clarify the policy for what takes precedence when a conflict is found (templedf via rkanter)
2017-11-30 07:39:15 -08:00
Chris Douglas
0e560f3b8d
HDFS-12681. Make HdfsLocatedFileStatus a subtype of LocatedFileStatus
2017-11-29 20:28:06 -08:00
Xiao Chen
d162252d7a
HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev.
2017-11-23 09:01:28 -08:00
Steve Loughran
de8b6ca5ef
HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints.
...
Contributed by Steve Loughran and Ryan Blue.
2017-11-22 15:28:12 +00:00
Robert Kanter
f2efaf013f
HADOOP-14982. Clients using FailoverOnNetworkExceptionRetry can go into a loop if they're used without authenticating with kerberos in HA env (pbacsko via rkanter)
2017-11-16 11:11:19 -08:00
Chris Douglas
675e9a8f57
Revert "HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus."
...
This reverts commit b85603e3f8
.
2017-11-15 19:20:37 -08:00
Xiao Chen
b1941b200d
HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * numValues) > 0 on construction.
2017-11-15 16:44:06 -08:00
Daniel Templeton
69043ba8b5
HADOOP-14876. Create downstream developer docs from the compatibility guidelines
2017-11-15 10:03:29 -08:00
Arun Suresh
b07e68b02a
Addendum patch for Configuration fix. (Jason Lowe via asuresh)
2017-11-13 14:03:50 -08:00
Eric Yang
1b68b8ff2c
HADOOP-15008. Fixed period unit calculation for Hadoop Metrics V2. (Contribute by Erik Krogen)
2017-11-13 12:42:43 -05:00
Akira Ajisaka
975a57a688
HADOOP-15031. Fix javadoc issues in Hadoop Common. Contributed by Mukul Kumar Singh.
2017-11-13 23:12:23 +09:00
Chris Douglas
796a0d3a5c
HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when finish() and resetState() are used. Contributed by Mike Percy
2017-11-10 17:41:29 -08:00
Xiao Chen
3c6adda291
HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev.
2017-11-09 21:06:06 -08:00
Arun Suresh
5eb7dbe9b3
Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
2017-11-09 15:15:51 -08:00
John Zhuge
6c32ddad30
HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge.
2017-11-09 10:16:12 -08:00
John Zhuge
bf6a660232
HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
2017-11-09 10:16:12 -08:00
Mingliang Liu
b6d8f87b8e
HADOOP-15015. TestConfigurationFieldsBase to use SLF4J for logging. Contributed by Steve Loughran
2017-11-03 21:01:56 -07:00
Xiaoyu Yao
59d78a5088
HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen.
2017-11-03 16:10:37 -07:00
Chris Douglas
b85603e3f8
HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus.
2017-11-03 14:30:57 -07:00
Chris Douglas
d015e0bbd5
HDFS-7878. API - expose a unique file identifier.
2017-10-31 09:44:01 -07:00
Sean Mackrory
81225430d0
HDFS-206. Support for head in FSShell. Contributed by Gabor Bota.
2017-10-31 08:34:01 -06:00
Jason Lowe
2fae63aa60
HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
2017-10-31 09:30:13 -05:00
Junping Du
a25b5aa0cf
Add several jdiff xml files for 2.8.2 release.
2017-10-26 19:30:48 -07:00
Junping Du
1ad863e220
Update CHANGES.md and RELEASENOTES for 2.8.2 release.
2017-10-26 19:13:58 -07:00
Xiao Chen
f66ad1fab9
HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen.
2017-10-25 14:11:30 -07:00
Akira Ajisaka
4c970088af
HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang.
2017-10-25 17:17:21 +09:00
Varun Saxena
67e7673750
HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena.
2017-10-25 03:06:12 +05:30
John Zhuge
c904d60c38
Revert "HADOOP-14954. MetricsSystemImpl#init should increment refCount when already initialized. Contributed by John Zhuge."
...
This reverts commit 14b3c2695b
.
2017-10-23 15:32:25 -07:00
Naganarasimha
6b8122458e
HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt.
2017-10-23 23:42:06 +05:30
Arpit Agarwal
4b00c9a47f
HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham.
2017-10-23 10:47:16 -07:00
John Zhuge
14b3c2695b
HADOOP-14954. MetricsSystemImpl#init should increment refCount when already initialized. Contributed by John Zhuge.
2017-10-20 16:13:41 -07:00
Kai Zheng
ce7cf66e5e
HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang
2017-10-20 09:42:04 +08:00
Wei-Chiu Chuang
97c70c7ac6
HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
2017-10-19 06:02:13 -07:00
Junping Du
b016f08f67
HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du.
2017-10-18 15:06:30 -07:00
Xiao Chen
86ee0c5e4e
HADOOP-14944. Add JvmMetrics to KMS.
2017-10-17 19:06:45 -07:00
Lei Xu
31ebccc962
HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu)
2017-10-16 19:44:30 -07:00
Wei-Chiu Chuang
e906108fc9
HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.
2017-10-16 16:42:59 -07:00
Manoj Govindassamy
133d7ca76e
HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem
2017-10-13 17:43:21 -07:00
Robert Kanter
e163f41850
HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter)
2017-10-13 13:52:58 -07:00
Anu Engineer
075358eb6f
HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin.
2017-10-11 15:58:20 -07:00
Arun Suresh
b6c2c9058e
HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh)
2017-10-11 15:21:21 -07:00
Steve Loughran
3de574413c
HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB.
...
Contributed by Varada Hemeswari.
2017-10-11 18:06:43 +01:00
Jason Lowe
1123f8f0b6
HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp
2017-10-10 14:47:25 -05:00
John Zhuge
9676ed19be
HADOOP-14184. Remove service loader config entry for ftp fs. Contributed by Sen Zhao.
2017-10-09 00:33:17 -07:00
Xiaoyu Yao
2b08a1fc64
HADOOP-14920. KMSClientProvider won't work with KMS delegation token retrieved from non-Java client. Contributed by Xiaoyu Yao.
2017-10-06 10:12:24 -07:00
Xiao Chen
25f31d9fc4
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
2017-10-05 19:46:47 -07:00
Akira Ajisaka
fe84cdc9da
HADOOP-14616. Client fails to read a block with erasure code (XOR, native) when one of the data block is lost. Contributed by Huafeng Wang.
2017-10-05 11:06:09 +09:00
Daniel Templeton
20e9ce3ab3
HADOOP-14459. SerializationFactory shouldn't throw a NullPointerException if the serializations list is not defined
...
(Contributed by Nandor Kollar via Daniel Templeton)
2017-10-04 15:04:02 +02:00
Andrew Wang
b34b3ff94b
Add 3.0.0-beta1 CHANGES and RELEASENOTES.
2017-10-03 17:14:40 -07:00
Xiaoyu Yao
107c177782
HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar.
2017-10-03 13:02:12 -07:00
Arpit Agarwal
b91305119b
HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh.
2017-10-03 11:23:40 -07:00
Allen Wittenauer
4d5dd75b60
HADOOP-14908. CrossOriginFilter should trigger regex on more input (Johannes Alberti via aw)
2017-10-03 10:58:28 -07:00
Anu Engineer
442ea85545
HADOOP-14752. TestCopyFromLocal#testCopyFromLocalWithThreads is fleaky. Contributed by Andras Bokor.
2017-10-02 13:11:47 -07:00
Chen Liang
563dcdfc1d
HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham.
2017-10-02 10:58:19 -07:00
Jason Lowe
6f789fe057
HADOOP-14902. LoadGenerator#genFile write close timing is incorrectly calculated. Contributed by Hanisha Koneru
2017-09-28 16:38:30 -05:00
Akira Ajisaka
d08b8c801a
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari.
2017-09-26 16:46:03 +09:00
Anu Engineer
0889e5a8b7
HDFS-12529. Get source for config tags from file name. Contributed by Ajay Kumar.
2017-09-25 13:55:09 -07:00
Jason Lowe
ac05a51bbb
HADOOP-14881. LoadGenerator should use Time.monotonicNow() to measure durations. Contributed by Bharat Viswanadham
2017-09-25 15:35:44 -05:00
Akira Ajisaka
3a10367a17
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
2017-09-26 01:47:02 +09:00
Daniel Templeton
0807470808
HADOOP-14897. Loosen compatibility guidelines for native dependencies
2017-09-25 14:12:25 +02:00
Anu Engineer
1c4a798505
HADOOP-14894. ReflectionUtils should use Time.monotonicNow to mesaure duration. Contributed by Bharat Viswanadham.
2017-09-23 11:56:34 -07:00
Anu Engineer
423ebcaf51
HDFS-12320. Add quantiles for transactions batched in Journal sync. Contributed by Hanisha Koneru.
2017-09-23 10:34:13 -07:00
Anu Engineer
e1b32e0959
HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru.
2017-09-22 15:45:22 -07:00
Akira Ajisaka
7e58b2478c
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina.
2017-09-20 21:07:49 +09:00
Daniel Templeton
7618fa9194
HADOOP-13714. Tighten up our compatibility guidelines for Hadoop 3
2017-09-16 09:20:33 +02:00
Steve Loughran
2d2d97fa7d
HADOOP-14553. Add (parallelized) integration tests to hadoop-azure
...
Contributed by Steve Loughran
2017-09-15 17:03:01 +01:00
Aaron Fabbri
49467165a5
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran.
2017-09-14 14:10:48 -07:00
John Zhuge
7ee02d1065
HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.
2017-09-14 11:26:49 -07:00
Andrew Wang
8277fab2be
HADOOP-14857. Fix downstream shaded client integration test. Contributed by Sean Busbey.
2017-09-13 10:59:04 -07:00
Chen Liang
10b2cfa96c
HADOOP-14804. correct wrong parameters format order in core-default.xml. Contributed by Chen Hongfei.
2017-09-13 10:49:34 -07:00
Xiao Chen
fa6cc43edd
Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
...
This reverts commit 0a6d5c0cf1
.
2017-09-12 19:53:07 -07:00
Andrew Wang
f4b6267465
HDFS-12222. Document and test BlockLocation for erasure-coded files. Contributed by Huafeng Wang.
2017-09-12 17:35:30 -07:00
Jason Lowe
86f4d1c66c
HADOOP-14843. Improve FsPermission symbolic parsing unit test coverage. Contributed by Bharat Viswanadham
2017-09-12 16:51:08 -05:00
Ray Chiang
ad74691807
HADOOP-14798. Update sshd-core and related mina-core library versions. (rchiang)
2017-09-12 10:04:22 -07:00
Haibo Chen
d2d8f665e6
YARN-7181. CPUTimeTracker.updateElapsedJiffies can report negative usage. (Miklos Szegedi via Haibo Chen)
2017-09-11 12:47:55 -07:00
Aaron Fabbri
180e814b08
HADOOP-14851 LambdaTestUtils.eventually() doesn't spin on Assertion failures. Contributed by Steve Loughran
2017-09-08 19:32:07 -07:00
Junping Du
3fddabc2fe
YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
2017-09-08 15:16:19 -07:00
John Zhuge
a4661850c1
HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
2017-09-08 11:51:03 -07:00
Anu Engineer
e8278b02a4
HADOOP-14850. Read HttpServer2 resources directly from the source tree (if exists). Contributed by Elek, Marton.
2017-09-08 10:01:01 -07:00
Steve Loughran
5bbca80428
HADOOP-13421. Switch to v2 of the S3 List Objects API in S3A.
...
Contributed by Aaron Fabbri
2017-09-08 12:07:02 +01:00
Xiao Chen
b3a4d7d2a0
HDFS-12400. Provide a way for NN to drain the local key cache before re-encryption.
2017-09-07 20:51:02 -07:00
Anu Engineer
a4cd101934
HDFS-12350. Support meta tags in configs. Contributed by Ajay Kumar.
2017-09-07 12:40:09 -07:00
Jason Lowe
dd814946f6
HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen
2017-09-06 16:04:30 -05:00
Chris Douglas
1f3bc63e67
HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov
2017-09-05 23:51:51 -07:00
Wei-Chiu Chuang
ad32759fd9
HADOOP-14688. Intern strings in KeyVersion and EncryptedKeyVersion. Contributed by Xiao Chen.
2017-09-05 15:11:37 -07:00
Andrew Wang
0d419c984f
Preparing for 3.1.0 development
2017-09-01 11:53:48 -07:00
Jitendra Pandey
063b6d0c93
HADOOP-14674. Correct javadoc for getRandomizedTempPath. Contributed by Mukul Kumar Singh.
2017-09-01 10:17:12 -07:00
Steve Loughran
621b43e254
HADOOP-13345 HS3Guard: Improved Consistency for S3A.
...
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.
2017-09-01 14:13:41 +01:00
Allen Wittenauer
27359b7139
HADOOP-14781. Clarify that HADOOP_CONF_DIR shouldn't actually be set in hadoop-env.sh
...
Signed-off-by: Andrew Wang <wang@apache.org>
2017-08-31 21:10:52 -07:00
Allen Wittenauer
0adc3a0533
YARN-6721. container-executor should have stack checking
...
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-08-31 19:39:31 -07:00
Allen Wittenauer
190410085b
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
...
Signed-off-by: Andrew Wang <wang@apache.org>
2017-08-31 19:06:49 -07:00
Yiqun Lin
ac12e153a8
HDFS-12317. HDFS metrics render error in the page of Github. Contributed by Yiqun Lin.
2017-08-31 17:23:17 +08:00
Allen Wittenauer
71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms
...
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-08-30 21:47:24 -07:00
Junping Du
41480233a9
HADOOP-14814. Fix incompatible API change on FsServerDefaults to HADOOP-14104. Contributed by Junping Du.
2017-08-30 13:30:14 -07:00
Rohith Sharma K S
32188d3295
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
2017-08-30 11:29:54 +05:30
Steve Loughran
021974f4cb
HADOOP-14802. Add support for using container saskeys for all accesses.
...
Contributed by Sivaguru Sankaridurg
2017-08-29 19:02:43 +01:00
Arpit Agarwal
8b7cbe3840
HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar.
2017-08-25 09:55:46 -07:00
Steve Loughran
8196a07c32
HDFS-12344. LocatedFileStatus regression: no longer accepting null FSPermission.
...
Contributed by Ewan Higgs
2017-08-24 16:17:30 +01:00
John Zhuge
7e6463d2fb
HADOOP-14251. Credential provider should handle property key deprecation. Contributed by John Zhuge.
2017-08-23 11:37:18 -07:00
Subru Krishnan
4249172e14
YARN-7053. Move curator transaction support to ZKCuratorManager. (Jonathan Hung via Subru).
2017-08-22 19:20:57 -07:00
Jason Lowe
c379310212
HADOOP-14687. AuthenticatedURL will reuse bad/expired session cookies. Contributed by Daryn Sharp
2017-08-22 16:50:01 -05:00
Xiao Chen
4ec5acc704
HADOOP-14705. Add batched interface reencryptEncryptedKeys to KMS.
2017-08-22 07:47:39 -07:00
Arpit Agarwal
736ceab2f5
HDFS-12325. SFTPFileSystem operations should restore cwd. Contributed by Chen Liang.
2017-08-21 11:48:51 -07:00
Arpit Agarwal
2d105a2068
Revert "HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru."
...
This reverts commit 8bef4eca28
.
2017-08-18 10:15:52 -07:00
Lei Xu
99e558b13b
HADOOP-14398. Modify documents for the FileSystem Builder API. (Lei (Eddy) Xu)
2017-08-17 18:06:23 -07:00
Andrew Wang
dd7916d3cd
HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas.
2017-08-17 09:35:36 -07:00
Alexandr Krasheninnikov
1f04cb45f7
HADOOP-14560. Make HttpServer2 backlog size configurable. Contributed by Alexander Krasheninnikov.
...
This closes #242 .
2017-08-17 01:05:19 -07:00
Andrew Wang
96b3a6b972
HDFS-11082. Provide replicated EC policy to replicate files. Contributed by SammiChen.
2017-08-16 22:17:06 -07:00
Akira Ajisaka
08aaa4b36f
HDFS-12269. Better to return a Map rather than HashMap in getErasureCodingCodecs. Contributed by Huafeng Wang.
2017-08-17 13:20:27 +09:00
Subru Krishnan
75dd866bfb
HADOOP-14773. Extend ZKCuratorManager API for more reusability. (Íñigo Goiri via Subru).
2017-08-15 16:53:59 -07:00
Chris Douglas
645a8f2a4d
HADOOP-14726. Mark FileStatus::isDir as final
2017-08-14 21:57:20 -07:00
Arpit Agarwal
0446511398
HADOOP-14673. Remove leftover hadoop_xml_escape from functions. Contributed by Ajay Kumar.
2017-08-14 16:22:10 -07:00
Arpit Agarwal
8bef4eca28
HADOOP-14732. ProtobufRpcEngine should use Time.monotonicNow to measure durations. Contributed by Hanisha Koneru.
2017-08-14 15:53:35 -07:00
John Zhuge
7769e96149
HADOOP-14627. Support MSI and DeviceCode token provider in ADLS. Contributed by Atul Sikaria.
2017-08-13 00:22:34 -07:00
Subru Krishnan
bbbf0e2a41
HADOOP-14741. Refactor curator based ZooKeeper communication into common library. (Íñigo Goiri via Subru).
2017-08-11 13:58:45 -07:00
Xiao Chen
07fff43f4a
HADOOP-14760. Add missing override to LoadBalancingKMSClientProvider.
2017-08-11 11:41:41 -07:00
John Zhuge
582648befa
HADOOP-14260. Configuration.dumpConfiguration should redact sensitive information. Contributed by John Zhuge.
2017-08-11 10:16:08 -07:00
Allen Wittenauer
4222c97108
HADOOP-10392. Use FileSystem#makeQualified(Path) instead of Path#makeQualified(FileSystem) (ajisakaa via aw)
2017-08-11 09:25:56 -07:00
Steve Loughran
d964062f66
HADOOP-14754. TestCommonConfigurationFields failed: core-default.xml has 2 wasb properties missing in classes.
...
Contributed by John Zhuge.
2017-08-11 10:18:17 +01:00
Wei-Chiu Chuang
a8b75466b2
HADOOP-14743. CompositeGroupsMapping should not swallow exceptions. Contributed by Wei-Chiu Chuang.
2017-08-10 09:35:27 -07:00
Steve Loughran
54356b1e83
HADOOP-14183. Remove service loader config file for wasb fs.
...
Contributed by Esfandiar Manii.
2017-08-10 16:46:33 +01:00
Haohui Mai
1db4788b7d
HADOOP-14598. Blacklist Http/HttpsFileSystem in FsUrlStreamHandlerFactory. Contributed by Steve Loughran.
2017-08-08 16:33:18 -07:00
Jian He
acf9bd8b1d
YARN-6890. Not display killApp button on UI if UI is unsecured but cluster is secured. Contributed by Junping Du
2017-08-08 11:09:38 -07:00
Arpit Agarwal
bc206806da
HDFS-12264. DataNode uses a deprecated method IoUtils#cleanup. Contributed by Ajay Yadav.
2017-08-07 15:05:10 -07:00
Xiao Chen
a3a9c976c3
HADOOP-14727. Socket not closed properly when reading Configurations with BlockReaderRemote. Contributed by Jonathan Eagles.
2017-08-07 10:25:52 -07:00
Akira Ajisaka
a4eb7016cb
HDFS-12198. Document missing namenode metrics that were added recently. Contributed by Yiqun Lin.
2017-08-07 18:47:33 +09:00
Lei Xu
fe3341786a
HDFS-12251. Add document for StreamCapabilities. (Lei (Eddy) Xu)
2017-08-04 11:21:58 -07:00
Arpit Agarwal
a6fdeb8a87
HADOOP-13963. /bin/bash is hard coded in some of the scripts. Contributed by Ajay Yadav.
2017-08-04 10:40:52 -07:00
wenxinhe
691bf5ec5d
HADOOP-14706. Adding a helper method to determine whether a log is Log4j implement.
...
This closes #257
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-08-04 14:35:57 +09:00
Andrew Wang
f4c6b00a9f
HDFS-12131. Add some of the FSNamesystem JMX values as metrics. Contributed by Erik Krogen.
2017-08-03 15:44:51 -07:00
Chris Douglas
12e44e7bda
HDFS-6984. Serialize FileStatus via protobuf.
2017-08-02 12:12:48 -07:00
Sean Mackrory
1a1bf6b7d0
HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.
2017-08-02 12:25:05 -06:00
Steve Loughran
5e4434f628
HADOOP-14709. Fix checkstyle warnings in ContractTestUtils.
...
Contributed by Thomas Marquardt.
(cherry picked from commit cb4679261097e729b433a523e3a65779fdc83841)
2017-08-02 12:48:06 +01:00
Masatake Iwasaki
3a0b84d9c9
HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu.
2017-08-02 06:06:25 +00:00
Junping Du
cf6794ebe9
HADOOP-14683. FileStatus.compareTo binary compatible issue. Contributed by Akira Ajisaka.
2017-08-01 17:13:02 -07:00
Lei Xu
02cd71ba9d
HADOOP-14495. Add set options interface to FSDataOutputStreamBuilder. (Lei (Eddy) Xu)
2017-08-01 16:00:53 -07:00
Andrew Wang
a11c230236
HADOOP-14701. Configuration can log misleading warnings about an attempt to override final parameter. Contributed by Andrew Sherman.
2017-08-01 15:13:29 -07:00
Steve Loughran
778d4edd9a
HADOOP-14660 wasb: improve throughput by 34% when account limit exceeded.
...
Contributed by Thomas Marquardt.
2017-08-01 21:36:28 +01:00
Arpit Agarwal
72eba25e09
HDFS-14676. Wrong default value for fs.df.interval. Contributed by xiangguang zheng.
2017-08-01 13:31:44 -07:00
Lei Xu
9586b0e24f
HADOOP-14397. Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for it. (Lei (Eddy) Xu)
2017-07-31 20:12:40 -07:00
Andras Bokor
abbf4129a2
HADOOP-14343. Wrong pid file name in error message when starting secure daemon
...
Signed-off-by: Allen Wittenauer <aw@apache.org>
2017-07-31 20:03:43 -07:00
Akira Ajisaka
f14be0d241
HADOOP-14690. RetryInvocationHandler should override toString(). Contributed by Yeliang Cang.
2017-07-31 14:08:30 +09:00
Ravi Prakash
746189ad8c
HADOOP-14229. hadoop.security.auth_to_local example is incorrect in the documentation. Contributed by Andras Bokor.
2017-07-28 11:43:36 -07:00
Yongjun Zhang
c6330f22a5
HDFS-12190. Enable 'hdfs dfs -stat' to display access time. Contributed by Yongjun Zhang.
2017-07-27 16:48:24 -07:00
Kihwal Lee
27a1a5fde9
HADOOP-14578. Bind IPC connections to kerberos UPN host for proxy users. Contributed by Daryn Sharp.
2017-07-26 13:12:39 -05:00
Brahma Reddy Battula
6d983cca52
HADOOP-14455. ViewFileSystem#rename should support be supported within same nameservice with different mountpoints. Contributed by Brahma Reddy Battula.
2017-07-25 23:51:53 +08:00
Akira Ajisaka
cca51e916b
HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.
2017-07-25 15:24:56 +09:00
Jitendra Pandey
f2921e51f0
HADOOP-14518. Customize User-Agent header sent in HTTP/HTTPS requests by WASB. Contributed by Georgi Chalakov.
2017-07-24 23:01:01 -07:00
Ravi Prakash
94ca52ae9e
HADOOP-14597. Native compilation broken with OpenSSL-1.1.0. Contributed by Ravi Prakash.
2017-07-24 16:01:45 -07:00
Jason Lowe
24853bf32a
YARN-6768. Improve performance of yarn api record toString and fromString. Contributed by Jonathan Eagles
2017-07-24 10:19:20 -05:00
Wei-Chiu Chuang
465c213439
HDFS-12094. Log torrent when none isa-l EC is used. Contributed by LiXin Ge.
2017-07-21 12:25:03 -07:00
Kihwal Lee
b3269f7cc1
HADOOP-14659. UGI getShortUserName does not need to search the Subject. Contributed by Daryn Sharp.
2017-07-20 16:12:21 -05:00
Daniel Templeton
c21c260392
HADOOP-14666. Tests use assertTrue(....equals(...)) instead of assertEquals()
2017-07-19 13:58:55 -07:00
Jason Lowe
df180259b0
HADOOP-14669. GenericTestUtils.waitFor should use monotonic time. Contributed by Daniel Templeton
2017-07-19 09:41:22 -05:00
Jitendra Pandey
2843c688bc
HADOOP-14642. wasb: add support for caching Authorization and SASKeys. Contributed by Sivaguru Sankaridurg.
2017-07-19 00:13:06 -07:00
Jason Lowe
5aa2bf231f
HADOOP-14637. GenericTestUtils.waitFor needs to check condition again after max wait time. Contributed by Daniel Templeton
2017-07-18 16:23:41 -05:00
Akira Ajisaka
ccaf036662
HADOOP-14539. Move commons logging APIs over to slf4j in hadoop-common. Contributed by Wenxin He.
2017-07-18 13:32:37 +09:00
Anu Engineer
02b141ac60
HDFS-11786. Add support to make copyFromLocal multi threaded. Contributed by Mukul Kumar Singh.
2017-07-16 10:59:34 -07:00
Xiao Chen
0a6d5c0cf1
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
2017-07-14 22:22:53 -07:00
Masatake Iwasaki
b61ab8573e
HADOOP-14646. FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runs. Contributed by Andras Bokor.
2017-07-13 21:41:43 +09:00
Akira Ajisaka
9144fd9e9b
HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor.
2017-07-12 11:35:50 +09:00
Steve Loughran
d670c3a4da
HADOOP-14535 wasb: implement high-performance random access and seek of block blobs.
...
Contributed by Thomas Marquardt
2017-07-11 21:34:27 +01:00
Yiqun Lin
3a7f02b815
HDFS-12085. Reconfigure namenode heartbeat interval fails if the interval was set with time unit. Contributed by Weiwei Yang.
2017-07-11 20:40:11 +08:00
wenxinhe
fce7951014
HADOOP-14638. Replace commons-logging APIs with slf4j in StreamPumper.
...
This closes #247
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-07-11 13:30:13 +09:00
Jitendra Pandey
f1efa14fc6
HADOOP-10829. Iteration on CredentialProviderFactory.serviceLoader is thread-unsafe. Contributed by Benoy Antony and Rakesh R.
2017-07-10 17:48:27 -07:00
Steve Loughran
09653ea098
HADOOP-14634. Remove jline from main Hadoop pom.xml.
...
Contributed by Ray Chiang.
2017-07-10 11:53:13 +01:00
Andrew Wang
f10864a820
Add release notes, changes, jdiff for 3.0.0-alpha4
2017-07-07 11:01:59 -07:00
Akira Ajisaka
7cd095272c
HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He.
2017-07-08 02:54:24 +09:00
Akira Ajisaka
8fc5dcc2a1
Revert "HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He."
...
This reverts commit 82cb2a6497
.
2017-07-08 02:53:18 +09:00
Wei-Chiu Chuang
8153fe2bd3
HADOOP-14563. LoadBalancingKMSClientProvider#warmUpEncryptedKeys swallows IOException. Contributed by Rushabh S Shah.
2017-07-07 06:13:10 -07:00
Akira Ajisaka
82cb2a6497
HADOOP-14587. Use GenericTestUtils.setLogLevel when available in hadoop-common. Contributed by Wenxin He.
2017-07-07 15:00:47 +09:00
Vinayakumar B
a180ba4081
HADOOP-13414. Hide Jetty Server version header in HTTP responses. Contributed by Surendra Singth Lilhore.
2017-07-05 16:05:18 +05:30
Steve Loughran
b17e655b70
HADOOP-14617. Add ReflectionUtils.logThreadInfo that accept slf4j logger API.
...
Contributed by Wenxin He.
2017-07-04 11:41:07 +01:00
Wenxin He
f2aba1da30
HADOOP-14571. Deprecate public APIs relate to log4j1
...
This closes #244
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2017-07-04 18:55:20 +09:00
Steve Loughran
1aaa7f1eac
HADOOP-14615. Add ServiceOperations.stopQuietly that accept slf4j logger API.
...
Contributed by Wenxin He.
2017-07-04 10:48:02 +01:00
Andrew Wang
af2773f609
Updating version for 3.0.0-beta1 development
2017-06-29 17:57:40 -07:00
Daniel Templeton
5a75f73893
HADOOP-14611. NetworkTopology.DEFAULT_HOST_LEVEL is unused
...
(Contributed by Chen Liang via Daniel Templeton)
2017-06-29 12:28:43 -07:00
Kai Zheng
ea1da39b19
HADOOP-14479. Erasurecode testcase failures with native enabled. Contributed by Sammi Chen
2017-06-29 11:26:36 +08:00
Lei Xu
d6df0fdbbd
Add -E option in 'ls' to list erasure coding policy of each file and directory if applicable. Contributed by luhuichun via lei.
2017-06-28 13:47:23 -07:00
Kai Zheng
379f19a2c7
HDFS-11943. [Erasure coding] Warn log frequently print to screen in doEncode/doDecode functions. Contributed by liaoyuxiangqin
2017-06-26 16:26:09 +08:00
Akira Ajisaka
a594f96fb1
HADOOP-14549. Use GenericTestUtils.setLogLevel when available in hadoop-tools. Contributed by wenxin he.
2017-06-26 16:41:00 +09:00
Arpit Agarwal
0111711d8b
HADOOP-14543. ZKFC should use getAversion() while setting the zkacl. Contributed by Brahma Reddy Battula.
2017-06-23 16:50:47 -07:00
Steve Loughran
e5db9af8a0
HADOOP-14568. GenericTestUtils#waitFor missing parameter verification.
...
Contributed by Yiqun Lin
2017-06-23 14:39:58 +01:00
Akira Ajisaka
092ebdf885
HADOOP-12940. Fix warnings from Spotbugs in hadoop-common.
2017-06-23 10:28:58 +09:00
Arpit Agarwal
8ceaac1877
HDFS-12010. TestCopyPreserveFlag fails consistently because of mismatch in access time. Contributed by Mukul Kumar Singh.
2017-06-22 15:42:50 -07:00
Vinayakumar B
8dbd53ef9f
HDFS-11067. DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries. Contributed by Vinayakumar B.
2017-06-22 17:37:08 +05:30
Akira Ajisaka
b64951905e
HADOOP-14542. Add IOUtils.cleanupWithLogger that accepts slf4j logger API. Contributed by Chen Liang.
2017-06-22 17:42:59 +09:00
Akira Ajisaka
1a598479a9
HDFS-11992. Replace commons-logging APIs with slf4j in FsDatasetImpl. Contributed by hu xiaodong.
2017-06-21 11:19:48 +09:00
Yongjun Zhang
5157f6c46e
HADOOP-14429. FTPFileSystem#getFsAction always returns FsAction.NONE. (Hongyuan Li via Yongjun Zhang)
2017-06-20 16:51:13 -07:00
Lei Xu
45ff4d38e6
HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun.
2017-06-20 11:55:09 -07:00
Brahma Reddy Battula
2e9daa2e27
HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han.
2017-06-20 20:44:31 +08:00
Akira Ajisaka
300804595e
HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong.
2017-06-19 19:39:36 +09:00
Akira Ajisaka
7ade5124b8
HADOOP-14538. Fix TestFilterFileSystem and TestHarFileSystem failures after DistributedFileSystem.append API. Contributed by Lei (Eddy) Xu.
2017-06-19 19:09:18 +09:00
Masatake Iwasaki
75043d3429
HADOOP-14424. Add CRC32C performance test. Contributed by LiXin Ge.
2017-06-19 09:16:45 +09:00
Lei Xu
6460df21a0
HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu.
2017-06-16 17:24:00 -07:00
Xiao Chen
4ebc23ba7b
HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively.
2017-06-16 09:49:33 -07:00
Steve Loughran
942ecbbc98
HADOOP-14486 TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0.
...
Contributed by Hongyuan Li.
2017-06-16 09:45:22 +01:00
Akira Ajisaka
e855cc4ed4
HADOOP-14289. Move log4j APIs over to slf4j in hadoop-common.
2017-06-16 13:17:10 +09:00
Lei Xu
5e7cfdca7b
HADOOP-14394. Provide Builder pattern for DistributedFileSystem.create. (lei)
2017-06-15 10:59:24 -07:00
Xiao Chen
ef8edab930
HADOOP-14523. OpensslAesCtrCryptoCodec.finalize() holds excessive amounts of memory. Contributed by Misha Dmitriev.
2017-06-15 10:40:59 -07:00
Steve Loughran
d780a67864
HADOOP-14506. Add create() contract test that verifies ancestor dir creation.
...
Contributed by Sean Mackrory.
2017-06-15 14:49:34 +01:00
Arpit Agarwal
8633ef8e10
HADOOP-14503. Make RollingAverages a mutable metric. Contributed by Hanisha Koneru.
2017-06-12 20:43:43 -07:00
Jonathan Eagles
a81916ea89
HADOOP-14501. Switch from aalto-xml to woodstox to handle odd XML features (jeagles)
2017-06-12 17:07:53 -05:00
Mingliang Liu
a2121cb0d9
HADOOP-14465. LdapGroupsMapping - support user and group search base. Contributed by Shwetha G S and Mingliang Liu
2017-06-09 14:55:07 -07:00
Xiao Chen
0202480742
HADOOP-13174. Add more debug logs for delegation tokens and authentication.
2017-06-08 21:34:15 -07:00
John Zhuge
5672ae7b37
HDFS-11861. ipc.Client.Connection#sendRpcRequest should log request name. Contributed by John Zhuge.
2017-06-07 15:52:52 -07:00
Carlo Curino
b65100c14b
YARN-6547. Enhance SLS-based tests leveraging invariant checker.
2017-06-06 17:19:15 -07:00
Brahma Reddy Battula
19ef3a81f8
HADOOP-14485. Redundant 'final' modifier in try-with-resources statement. Contributed by wenxin he.
2017-06-06 23:11:47 +08:00
Kihwal Lee
855e0477b1
HADOOP-14035. Reduce fair call queue backoff's impact on clients. Contributed by Daryn Sharp.
2017-06-06 08:35:12 -05:00
Brahma Reddy Battula
66c6fd8314
HADOOP-14431. ModifyTime of FileStatus returned by SFTPFileSystem's getFileStatus method is wrong. Contributed by Hongyuan Li.
2017-06-06 12:31:40 +08:00
Mingliang Liu
6aeda55bb8
HADOOP-14428. s3a: mkdir appears to be broken. Contributed by Mingliang Liu
2017-06-05 11:26:56 -07:00
Brahma Reddy Battula
abdd609e51
HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger.
2017-06-06 00:21:03 +08:00
Andrew Wang
7101477e47
HDFS-11383. Intern strings in BlockLocation and ExtendedBlock. Contributed by Misha Dmitriev.
2017-06-01 15:20:18 -07:00
Kihwal Lee
1543d0f5be
HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B.
2017-05-31 10:55:03 -05:00
Brahma Reddy Battula
62857be211
HADOOP-14456. Modifier 'static' is redundant for inner enums. Contributed by ZhangBing Lin.
2017-05-31 01:07:58 +08:00
Arpit Agarwal
bd6a2172e0
HDFS-11891. DU#refresh should print the path of the directory when an exception is caught. Contributed by Chen Liang.
2017-05-26 16:02:40 -07:00
Andrew Wang
2cd612ba8e
Update 3.0.0-alpha3 changes, release notes, jdiff.
2017-05-26 14:14:38 -07:00
Andrew Wang
16ad896d5c
Update maven version for 3.0.0-alpha4 development
2017-05-26 14:09:44 -07:00
Steve Loughran
8bf0e2d6b3
HADOOP-14430 the accessTime of FileStatus returned by SFTPFileSystem's
...
getFileStatus method is always 0.
Contributed by Hongyuan Li.
2017-05-25 15:19:58 +01:00
Steve Loughran
1ba9704eec
HADOOP-14399. Configuration does not correctly XInclude absolute file URIs.
...
Contributed by Jonathan Eagles
2017-05-25 14:59:33 +01:00
Akira Ajisaka
6a52b5e144
HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu.
2017-05-25 15:36:44 +09:00
Brahma Reddy Battula
dcf4559ebd
HADOOP-14166. Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used. Contributed by Surendra Singh Lilhore.
2017-05-25 01:27:13 +08:00
Brahma Reddy Battula
b7a0c0e701
HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin.
2017-05-25 01:03:22 +08:00
Kai Zheng
a62be38a5e
HDFS-11793. Allow to enable user defined erasure coding policy. Contributed by Sammi Chen
2017-05-24 18:45:52 +08:00
Brahma Reddy Battula
52661e0912
HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin.
2017-05-23 23:52:42 +08:00
Rakesh Radhakrishnan
1b5451bf05
HDFS-11794. Add ec sub command -listCodec to show currently supported ec codecs. Contributed by SammiChen.
2017-05-23 17:03:28 +05:30
Brahma Reddy Battula
2a8fcf0c9a
HDFS-11863. Document missing metrics for blocks count in pending IBR. Contributed By Yiqun Lin.
2017-05-23 02:16:25 +08:00
Sunil G
b6f66b0da1
YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.
2017-05-22 14:10:06 +05:30
Mingliang Liu
c80d3bc480
HDFS-11862. Option -v missing for du command in FileSystemShell.md. Contributed by Yiqun Lin
2017-05-21 01:23:35 -07:00
Mingliang Liu
1db186f662
HDFS-11803. Add -v option for du command to show header line. Contributed by Xiaobing Zhou
2017-05-19 14:21:01 -07:00
Chris Douglas
ef9e536a71
HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak
2017-05-17 17:21:03 -07:00
Mingliang Liu
eb7791b474
HADOOP-14427. Avoid reloading of Configuration in ViewFileSystem creation. Contributed by Vinayakumar B
2017-05-17 13:12:14 -07:00
Akira Ajisaka
d4aa9e3c69
HADOOP-14415. Use java.lang.AssertionError instead of junit.framework.AssertionFailedError. Contributed by Chen Liang.
2017-05-17 15:38:28 -04:00
Rohith Sharma K S
d87a63a901
HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe.
2017-05-17 08:27:45 +05:30
Jason Lowe
7bc2172248
HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan
2017-05-12 16:54:08 -05:00
Akira Ajisaka
a9e24a13b7
HADOOP-14375. Remove tomcat support from hadoop-functions.sh. Contributed by John Zhuge.
2017-05-12 08:48:51 -05:00
Daniel Templeton
09f28da2d2
HADOOP-14413. Add Javadoc comment for jitter parameter on CachingGetSpaceUsed
...
(Contributed by Erik Krogen via Daniel Templeton)
2017-05-11 12:06:06 -07:00
Brahma Reddy Battula
4aae2d40a3
HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang
2017-05-11 23:33:45 +05:30
Mingliang Liu
3873904a94
HDFS-11800. Document output of 'hdfs count -u' should contain PATHNAME. Contributed by Xiaobing Zhou
2017-05-10 14:33:33 -07:00
Akira Ajisaka
a5fa954684
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong.
2017-05-10 05:29:47 -05:00
Masatake Iwasaki
06ffeb8d4d
HADOOP-14405. Fix performance regression due to incorrect use of DataChecksum. Contributed by LiXin Ge.
2017-05-10 14:16:41 +09:00
Jason Lowe
f7faac8e90
HADOOP-14377. Increase Common test timeouts from 1 second to 10 seconds. Contributed by Eric Badger
2017-05-09 16:08:34 -05:00
Chris Douglas
45382bf047
AuditLogger and TestAuditLogger are dead code. Contributed by Vrushali C
2017-05-09 10:31:52 -07:00
Lei Xu
149b903be3
HADOOP-14384. Reduce the visibility of FileSystem.newFSDataOutputStreamBuilder before the API becomes stable. (lei)
2017-05-09 10:27:17 -07:00
Andrew Wang
543aac9f28
HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.
2017-05-09 09:22:53 -07:00
Andrew Wang
54fd0e44b7
HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy.
2017-05-08 21:59:49 -07:00
Haohui Mai
ff5ec3b841
HADOOP-14383. Implement FileSystem that reads from HTTP / HTTPS endpoints.
2017-05-08 15:28:45 -07:00
Chris Douglas
e4f34ecb04
HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang
2017-05-05 12:10:50 -07:00
Steve Loughran
4e6bbd049d
HADOOP-14382 Remove usages of MoreObjects.toStringHelper.
...
Contributed by Andrew Wang
2017-05-05 13:03:09 +01:00
Andrew Wang
c2a52ef9c2
HDFS-11643. Add shouldReplicate option to create builder. Contributed by SammiChen.
2017-05-04 11:39:14 -07:00
Arpit Agarwal
81092b1f11
HDFS-11722. Change Datanode file IO profiling sampling to percentage. Contributed by Hanisha Koneru.
2017-05-03 16:29:30 -07:00
Arpit Agarwal
30cd265134
Revert "HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru."
...
This reverts commit 08fb82d6d1
.
2017-05-03 16:28:47 -07:00
Arpit Agarwal
08fb82d6d1
HDFS-11488. JN log segment syncing should support HA upgrade. Contributed by Hanisha Koneru.
2017-05-03 15:46:08 -07:00
Mingliang Liu
83dded556d
HDFS-11739. Fix regression in tests caused by YARN-679. Contributed by Steve Loughran
2017-05-03 11:22:44 -07:00
Kihwal Lee
d4631e466b
HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger.
2017-05-03 09:47:17 -05:00
Robert Kanter
8b82317fab
HADOOP-14352. Make some HttpServer2 SSL properties optional (jzhuge via rkanter)
2017-05-02 17:51:28 -07:00
Jason Lowe
cedaf4cab9
HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger
2017-05-02 16:50:51 -05:00
Andrew Wang
dcc292d7de
HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri.
2017-05-02 10:51:20 -07:00
Akira Ajisaka
20cde55274
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong.
2017-05-02 23:36:54 +09:00
Mingliang Liu
c735362df7
HADOOP-14363. Inconsistent default block location in FileSystem javadoc. Contributed by Chen Liang
2017-04-29 23:49:36 -07:00
Eric Payne
6fe11f6155
HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger.
2017-04-28 14:45:26 -05:00
Junping Du
373bb4931f
YARN-679. Add an entry point that can start any Yarn service. Contributed by Steve Loughran.
2017-04-28 10:45:02 -07:00