Steve Loughran
|
f274fe33ea
|
Revert "HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits."
This reverts commit 35ad9b1dd2.
|
2018-01-18 12:35:57 +00:00 |
|
Brahma Reddy Battula
|
08332e12d0
|
HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula.
|
2018-01-18 10:54:32 +05:30 |
|
Aaron Fabbri
|
268ab4e027
|
HADOOP-15141 Support IAM Assumed roles in S3A. Contributed by Steve Loughran.
|
2018-01-17 00:05:24 -08:00 |
|
Yufei Gu
|
b202935353
|
HADOOP-15157. Zookeeper authentication related properties to support CredentialProviders. (Contributed by Gergo Repas)
|
2018-01-16 10:15:22 -08:00 |
|
Arpit Agarwal
|
7016dd44e0
|
HDFS-13016. globStatus javadoc refers to glob pattern as "regular expression". Contributed by Mukul Kumar Singh.
|
2018-01-13 07:19:30 -08:00 |
|
Arpit Agarwal
|
addbcd8cd4
|
HADOOP-15114. Add closeStreams(...) to IOUtils. Contributed by Ajay Kumar.
|
2018-01-11 16:50:21 -08:00 |
|
Steve Loughran
|
2e0a451a8d
|
HADOOP-15033. Use java.util.zip.CRC32C for Java 9 and above
Contributed by Dmitry Chuyko,
|
2018-01-11 10:47:50 +00:00 |
|
Miklos Szegedi
|
12d0645990
|
HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi.
|
2018-01-10 10:52:26 -08:00 |
|
Arpit Agarwal
|
4ad39ec308
|
Revert "HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by Hanisha Koneru."
This reverts commit 37efa67e37.
|
2018-01-02 17:34:29 -08:00 |
|
Arpit Agarwal
|
d82874851e
|
HADOOP-15155. Error in javadoc of ReconfigurableBase#reconfigureProperty. Contributed by Ajay Kumar.
|
2018-01-02 17:22:55 -08:00 |
|
Arpit Agarwal
|
dfe0cd8655
|
HADOOP-15152. Typo in javadoc of ReconfigurableBase#reconfigurePropertyImpl. Contributed by Nanda kumar.
|
2018-01-02 10:50:13 -08:00 |
|
Xiao Chen
|
81127616c5
|
HADOOP-15149. CryptoOutputStream should implement StreamCapabilities.
|
2017-12-29 13:41:15 -08:00 |
|
Jitendra Pandey
|
d31c9d8c49
|
HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh.
|
2017-12-27 23:17:07 -08:00 |
|
Steve Loughran
|
c8ff0cc304
|
HADOOP-13282. S3 blob etags to be made visible in S3A status/getFileChecksum() calls.
Contributed by Steve Loughran
|
2017-12-21 14:58:58 +00:00 |
|
Steve Loughran
|
35ad9b1dd2
|
HADOOP-13974. S3Guard CLI to support list/purge of pending multipart commits.
Contributed by Aaron Fabbri
|
2017-12-18 21:19:06 +00:00 |
|
Chris Douglas
|
5e81f32d11
|
HADOOP-15106. FileSystem::open(PathHandle) should throw a specific exception on validation failure
|
2017-12-16 10:53:10 -08:00 |
|
Virajith Jalaparti
|
b668eb9155
|
HDFS-10675. Datanode support to read from external stores.
|
2017-12-15 17:51:37 -08:00 |
|
Xiaoyu Yao
|
37efa67e37
|
HADOOP-10054. ViewFsFileStatus.toString() is broken. Contributed by Hanisha Koneru.
|
2017-12-14 10:58:16 -08:00 |
|
Jason Lowe
|
f8af0e2feb
|
HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan
|
2017-12-14 10:18:08 -06:00 |
|
Kai Zheng
|
f86c81d923
|
HADOOP-15039. Move SemaphoredDelegatingExecutor to hadoop-common. Contributed by Genmao Yu
|
2017-12-14 11:14:52 +08:00 |
|
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
|
f19638333b
|
HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades.
|
2017-12-08 08:00:21 -08:00 |
|
Xiao Chen
|
19e0894209
|
HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.
|
2017-12-07 21:05:55 -08:00 |
|
Sunil G
|
daa1cdd062
|
YARN-7564. Cleanup to fix checkstyle issues of YARN-5881 branch. Contributed by Sunil G.
|
2017-12-07 18:56:54 -08:00 |
|
Wangda Tan
|
5e798b1a0d
|
YARN-6471. Support to add min/max resource configuration for a queue. (Sunil G via wangda)
Change-Id: I9213f5297a6841fab5c573e85ee4c4e5f4a0b7ff
|
2017-12-07 18:56:54 -08:00 |
|
Lei Xu
|
67662e2ac9
|
HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu.
|
2017-12-07 11:15:40 -08:00 |
|
Arpit Agarwal
|
e00c7f78c1
|
HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.
|
2017-12-04 21:02:04 -08:00 |
|
Xiao Chen
|
404eab4dc0
|
HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.
|
2017-12-04 10:40:11 -08:00 |
|
Chris Douglas
|
f9d195dfe9
|
HADOOP-14600. LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions. Contributed by Ping Liu
|
2017-12-01 22:12:26 -08:00 |
|
Chris Douglas
|
0780fdb1eb
|
HDFS-12877. Add open(PathHandle) with default buffersize
|
2017-11-30 15:13:16 -08:00 |
|
Chris Douglas
|
0e560f3b8d
|
HDFS-12681. Make HdfsLocatedFileStatus a subtype of LocatedFileStatus
|
2017-11-29 20:28:06 -08:00 |
|
Xiao Chen
|
d162252d7a
|
HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev.
|
2017-11-23 09:01:28 -08:00 |
|
Steve Loughran
|
de8b6ca5ef
|
HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints.
Contributed by Steve Loughran and Ryan Blue.
|
2017-11-22 15:28:12 +00:00 |
|
Robert Kanter
|
f2efaf013f
|
HADOOP-14982. Clients using FailoverOnNetworkExceptionRetry can go into a loop if they're used without authenticating with kerberos in HA env (pbacsko via rkanter)
|
2017-11-16 11:11:19 -08:00 |
|
Chris Douglas
|
675e9a8f57
|
Revert "HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus."
This reverts commit b85603e3f8.
|
2017-11-15 19:20:37 -08:00 |
|
Xiao Chen
|
b1941b200d
|
HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * numValues) > 0 on construction.
|
2017-11-15 16:44:06 -08:00 |
|
Arun Suresh
|
b07e68b02a
|
Addendum patch for Configuration fix. (Jason Lowe via asuresh)
|
2017-11-13 14:03:50 -08:00 |
|
Eric Yang
|
1b68b8ff2c
|
HADOOP-15008. Fixed period unit calculation for Hadoop Metrics V2. (Contribute by Erik Krogen)
|
2017-11-13 12:42:43 -05:00 |
|
Akira Ajisaka
|
975a57a688
|
HADOOP-15031. Fix javadoc issues in Hadoop Common. Contributed by Mukul Kumar Singh.
|
2017-11-13 23:12:23 +09:00 |
|
Chris Douglas
|
796a0d3a5c
|
HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when finish() and resetState() are used. Contributed by Mike Percy
|
2017-11-10 17:41:29 -08:00 |
|
Xiao Chen
|
3c6adda291
|
HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev.
|
2017-11-09 21:06:06 -08:00 |
|
Arun Suresh
|
5eb7dbe9b3
|
Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
|
2017-11-09 15:15:51 -08:00 |
|
John Zhuge
|
6c32ddad30
|
HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge.
|
2017-11-09 10:16:12 -08:00 |
|
John Zhuge
|
bf6a660232
|
HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
|
2017-11-09 10:16:12 -08:00 |
|
Xiaoyu Yao
|
59d78a5088
|
HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen.
|
2017-11-03 16:10:37 -07:00 |
|
Chris Douglas
|
b85603e3f8
|
HDFS-12681. Fold HdfsLocatedFileStatus into HdfsFileStatus.
|
2017-11-03 14:30:57 -07:00 |
|
Chris Douglas
|
d015e0bbd5
|
HDFS-7878. API - expose a unique file identifier.
|
2017-10-31 09:44:01 -07:00 |
|
Sean Mackrory
|
81225430d0
|
HDFS-206. Support for head in FSShell. Contributed by Gabor Bota.
|
2017-10-31 08:34:01 -06:00 |
|
Jason Lowe
|
2fae63aa60
|
HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
|
2017-10-31 09:30:13 -05:00 |
|
Xiao Chen
|
f66ad1fab9
|
HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen.
|
2017-10-25 14:11:30 -07:00 |
|
Varun Saxena
|
67e7673750
|
HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena.
|
2017-10-25 03:06:12 +05:30 |
|
John Zhuge
|
c904d60c38
|
Revert "HADOOP-14954. MetricsSystemImpl#init should increment refCount when already initialized. Contributed by John Zhuge."
This reverts commit 14b3c2695b.
|
2017-10-23 15:32:25 -07:00 |
|
Naganarasimha
|
6b8122458e
|
HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt.
|
2017-10-23 23:42:06 +05:30 |
|
Arpit Agarwal
|
4b00c9a47f
|
HDFS-12683. DFSZKFailOverController re-order logic for logging Exception. Contributed by Bharat Viswanadham.
|
2017-10-23 10:47:16 -07:00 |
|
John Zhuge
|
14b3c2695b
|
HADOOP-14954. MetricsSystemImpl#init should increment refCount when already initialized. Contributed by John Zhuge.
|
2017-10-20 16:13:41 -07:00 |
|
Kai Zheng
|
ce7cf66e5e
|
HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang
|
2017-10-20 09:42:04 +08:00 |
|
Wei-Chiu Chuang
|
97c70c7ac6
|
HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
|
2017-10-19 06:02:13 -07:00 |
|
Junping Du
|
b016f08f67
|
HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du.
|
2017-10-18 15:06:30 -07:00 |
|
Xiao Chen
|
86ee0c5e4e
|
HADOOP-14944. Add JvmMetrics to KMS.
|
2017-10-17 19:06:45 -07:00 |
|
Lei Xu
|
31ebccc962
|
HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu)
|
2017-10-16 19:44:30 -07:00 |
|
Wei-Chiu Chuang
|
e906108fc9
|
HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.
|
2017-10-16 16:42:59 -07:00 |
|
Manoj Govindassamy
|
133d7ca76e
|
HADOOP-13055. Implement linkMergeSlash and linkFallback for ViewFileSystem
|
2017-10-13 17:43:21 -07:00 |
|
Robert Kanter
|
e163f41850
|
HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter)
|
2017-10-13 13:52:58 -07:00 |
|
Arun Suresh
|
b6c2c9058e
|
HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh)
|
2017-10-11 15:21:21 -07:00 |
|
Jason Lowe
|
1123f8f0b6
|
HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp
|
2017-10-10 14:47:25 -05:00 |
|
John Zhuge
|
9676ed19be
|
HADOOP-14184. Remove service loader config entry for ftp fs. Contributed by Sen Zhao.
|
2017-10-09 00:33:17 -07:00 |
|
Xiaoyu Yao
|
2b08a1fc64
|
HADOOP-14920. KMSClientProvider won't work with KMS delegation token retrieved from non-Java client. Contributed by Xiaoyu Yao.
|
2017-10-06 10:12:24 -07:00 |
|
Xiao Chen
|
25f31d9fc4
|
HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
|
2017-10-05 19:46:47 -07:00 |
|
Akira Ajisaka
|
fe84cdc9da
|
HADOOP-14616. Client fails to read a block with erasure code (XOR, native) when one of the data block is lost. Contributed by Huafeng Wang.
|
2017-10-05 11:06:09 +09:00 |
|
Daniel Templeton
|
20e9ce3ab3
|
HADOOP-14459. SerializationFactory shouldn't throw a NullPointerException if the serializations list is not defined
(Contributed by Nandor Kollar via Daniel Templeton)
|
2017-10-04 15:04:02 +02:00 |
|
Xiaoyu Yao
|
107c177782
|
HDFS-12455. WebHDFS - Adding "snapshot enabled" status to ListStatus query result. Contributed by Ajay Kumar.
|
2017-10-03 13:02:12 -07:00 |
|
Arpit Agarwal
|
b91305119b
|
HDFS-11968. ViewFS: StoragePolicies commands fail with HDFS federation. Contributed by Mukul Kumar Singh.
|
2017-10-03 11:23:40 -07:00 |
|
Allen Wittenauer
|
4d5dd75b60
|
HADOOP-14908. CrossOriginFilter should trigger regex on more input (Johannes Alberti via aw)
|
2017-10-03 10:58:28 -07:00 |
|
Chen Liang
|
563dcdfc1d
|
HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham.
|
2017-10-02 10:58:19 -07:00 |
|
Akira Ajisaka
|
d08b8c801a
|
HADOOP-14893. WritableRpcEngine should use Time.monotonicNow. Contributed by Chetna Chaudhari.
|
2017-09-26 16:46:03 +09:00 |
|
Anu Engineer
|
0889e5a8b7
|
HDFS-12529. Get source for config tags from file name. Contributed by Ajay Kumar.
|
2017-09-25 13:55:09 -07:00 |
|
Akira Ajisaka
|
3a10367a17
|
HADOOP-14892. MetricsSystemImpl should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
|
2017-09-26 01:47:02 +09:00 |
|
Anu Engineer
|
1c4a798505
|
HADOOP-14894. ReflectionUtils should use Time.monotonicNow to mesaure duration. Contributed by Bharat Viswanadham.
|
2017-09-23 11:56:34 -07:00 |
|
Anu Engineer
|
e1b32e0959
|
HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru.
|
2017-09-22 15:45:22 -07:00 |
|
Akira Ajisaka
|
7e58b2478c
|
HADOOP-7308. Remove unused TaskLogAppender configurations from log4j.properties. Contributed by Todd Lipcon and J.Andreina.
|
2017-09-20 21:07:49 +09:00 |
|
Aaron Fabbri
|
49467165a5
|
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran.
|
2017-09-14 14:10:48 -07:00 |
|
John Zhuge
|
7ee02d1065
|
HADOOP-14864. FSDataInputStream#unbuffer UOE should include stream class name. Contributed by Bharat Viswanadham.
|
2017-09-14 11:26:49 -07:00 |
|
Andrew Wang
|
8277fab2be
|
HADOOP-14857. Fix downstream shaded client integration test. Contributed by Sean Busbey.
|
2017-09-13 10:59:04 -07:00 |
|
Chen Liang
|
10b2cfa96c
|
HADOOP-14804. correct wrong parameters format order in core-default.xml. Contributed by Chen Hongfei.
|
2017-09-13 10:49:34 -07:00 |
|
Xiao Chen
|
fa6cc43edd
|
Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
This reverts commit 0a6d5c0cf1.
|
2017-09-12 19:53:07 -07:00 |
|
Andrew Wang
|
f4b6267465
|
HDFS-12222. Document and test BlockLocation for erasure-coded files. Contributed by Huafeng Wang.
|
2017-09-12 17:35:30 -07:00 |
|
Haibo Chen
|
d2d8f665e6
|
YARN-7181. CPUTimeTracker.updateElapsedJiffies can report negative usage. (Miklos Szegedi via Haibo Chen)
|
2017-09-11 12:47:55 -07:00 |
|
Junping Du
|
3fddabc2fe
|
YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
|
2017-09-08 15:16:19 -07:00 |
|
John Zhuge
|
a4661850c1
|
HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
|
2017-09-08 11:51:03 -07:00 |
|
Anu Engineer
|
e8278b02a4
|
HADOOP-14850. Read HttpServer2 resources directly from the source tree (if exists). Contributed by Elek, Marton.
|
2017-09-08 10:01:01 -07:00 |
|
Steve Loughran
|
5bbca80428
|
HADOOP-13421. Switch to v2 of the S3 List Objects API in S3A.
Contributed by Aaron Fabbri
|
2017-09-08 12:07:02 +01:00 |
|
Xiao Chen
|
b3a4d7d2a0
|
HDFS-12400. Provide a way for NN to drain the local key cache before re-encryption.
|
2017-09-07 20:51:02 -07:00 |
|
Anu Engineer
|
a4cd101934
|
HDFS-12350. Support meta tags in configs. Contributed by Ajay Kumar.
|
2017-09-07 12:40:09 -07:00 |
|
Jason Lowe
|
dd814946f6
|
HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen
|
2017-09-06 16:04:30 -05:00 |
|
Chris Douglas
|
1f3bc63e67
|
HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov
|
2017-09-05 23:51:51 -07:00 |
|
Wei-Chiu Chuang
|
ad32759fd9
|
HADOOP-14688. Intern strings in KeyVersion and EncryptedKeyVersion. Contributed by Xiao Chen.
|
2017-09-05 15:11:37 -07:00 |
|
Steve Loughran
|
621b43e254
|
HADOOP-13345 HS3Guard: Improved Consistency for S3A.
Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu,
Sean Mackrory, Steve Loughran and others.
|
2017-09-01 14:13:41 +01:00 |
|
Allen Wittenauer
|
27359b7139
|
HADOOP-14781. Clarify that HADOOP_CONF_DIR shouldn't actually be set in hadoop-env.sh
Signed-off-by: Andrew Wang <wang@apache.org>
|
2017-08-31 21:10:52 -07:00 |
|
Allen Wittenauer
|
71bbb86d69
|
HADOOP-14670. Increase minimum cmake version for all platforms
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-30 21:47:24 -07:00 |
|
Junping Du
|
41480233a9
|
HADOOP-14814. Fix incompatible API change on FsServerDefaults to HADOOP-14104. Contributed by Junping Du.
|
2017-08-30 13:30:14 -07:00 |
|
Rohith Sharma K S
|
32188d3295
|
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
|
2017-08-30 11:29:54 +05:30 |
|