Kihwal Lee
b6bb99c18a
HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp.
2017-02-09 10:47:29 -06:00
Kihwal Lee
a0bfb41504
HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp.
2017-02-09 10:04:28 -06:00
Junping Du
eec52e158b
YARN-6145. Improve log message on fail over. Contributed by Jian He.
2017-02-08 02:11:19 -08:00
Xiao Chen
2007e0cf2a
HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled.
2017-02-07 20:36:11 -08:00
Xiao Chen
69b23632c4
HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge.
2017-02-07 09:36:55 -08:00
Junping Du
cce35c3815
HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena.
2017-02-05 19:42:11 -08:00
Yiqun Lin
3ea6d3517e
HDFS-11371. Document missing metrics of erasure coding. Contributed by Yiqun Lin.
2017-02-04 11:01:27 +08:00
Akira Ajisaka
cb8f3f3adf
HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin.
2017-02-04 10:58:08 +09:00
Xiao Chen
ba75bc7593
HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre.
2017-02-03 17:13:53 -08:00
Chris Douglas
59c5f18784
HADOOP-13895. Make FileStatus Serializable
2017-02-01 10:19:36 -08:00
Xiao Chen
ebd40056a0
HADOOP-13992. KMS should load SSL configuration the same way as SSLFactory. Contributed by John Zhuge.
2017-01-27 10:49:26 -08:00
Xiaoyu Yao
2034315763
HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao.
2017-01-26 20:34:32 -08:00
Andrew Wang
ff02bdfe65
Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release.
2017-01-25 15:39:40 -08:00
Jason Lowe
9e19f758c1
YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger
2017-01-25 21:41:43 +00:00
Xiaoyu Yao
a46933e8ce
HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao.
2017-01-25 13:33:06 -08:00
Steve Loughran
7fc3e68a87
HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang.
2017-01-25 21:29:27 +00:00
Xiao Chen
9c0a4d3e71
HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge.
2017-01-24 21:30:10 -08:00
Arpit Agarwal
b57368b6f8
HDFS-11194. Maintain aggregated peer performance metrics on NameNode.
2017-01-24 16:58:20 -08:00
Eric Yang
a847903b6e
HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu.
2017-01-21 15:43:18 -08:00
Lei Xu
e015b56319
HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei)
2017-01-20 14:48:04 +08:00
Andrew Wang
5d8b80ea9b
Preparing for 3.0.0-alpha3 development
2017-01-19 15:50:07 -08:00
Daniel Templeton
f5839fd6df
YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton)
2017-01-19 12:45:17 -08:00
Akira Ajisaka
1763467210
HADOOP-14001. Improve delegation token validity checking.
2017-01-19 17:56:39 +09:00
Yiqun Lin
383aa9c9f5
HADOOP-13965. Groups should be consistent in using default group mapping class. Contributed by Yiqun Lin.
2017-01-19 09:42:56 +08:00
Allen Wittenauer
0eb4b513b7
HADOOP-13673. Update scripts to be smarter when running with privilege
...
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
2017-01-18 14:39:05 -08:00
Akira Ajisaka
9130af3f74
HADOOP-13955. Replace deprecated HttpServer2 and SSLFactory constants. Contributed by John Zhuge.
2017-01-18 18:11:33 +09:00
Kihwal Lee
706d630eb9
HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger.
2017-01-17 15:10:24 -06:00
Akira Ajisaka
e407449ddb
HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore.
2017-01-17 10:10:23 +09:00
Lei Xu
ed09c1418d
HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei)
2017-01-15 14:02:11 +08:00
Steve Loughran
e648b6e138
HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran
2017-01-11 17:25:15 +00:00
Arpit Agarwal
4046794a53
HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru.
2017-01-10 10:43:11 -08:00
Andrew Wang
511d39e074
HADOOP-13885. Implement getLinkTarget for ViewFileSystem. Contributed by Manoj Govindassamy.
2017-01-09 18:01:37 -08:00
Wei-Chiu Chuang
0a212a40fc
HADOOP-13953. Make FTPFileSystem's data connection mode and transfer mode configurable. Contributed by Xiao Chen.
2017-01-09 15:18:26 -08:00
Arpit Agarwal
4a659ff40f
HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin.
2017-01-05 19:34:32 -08:00
Xiao Chen
5d182949ba
HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge.
2017-01-05 17:21:57 -08:00
Jason Lowe
a0a2761621
HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales
2017-01-04 14:46:25 +00:00
Akira Ajisaka
01d31fe938
HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang.
2017-01-04 14:10:36 +09:00
Mingliang Liu
88731c731a
Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran"
...
This reverts commit 451efb08fe
.
2017-01-03 14:44:26 -08:00
Mingliang Liu
451efb08fe
HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
2017-01-03 13:08:38 -08:00
Robert Kanter
591fb15944
YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter)
2017-01-03 12:13:32 -08:00
Brahma Reddy Battula
6938b67711
HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin.
2016-12-31 16:16:02 +05:30
Akira Ajisaka
0665c5f09a
HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula.
2016-12-28 01:39:30 +09:00
Daniel Templeton
ded2d08f33
HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
2016-12-27 07:18:08 -08:00
Xiaoyu Yao
4e9029653d
HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou.
2016-12-22 23:46:58 -08:00
Mingliang Liu
e92a77099b
HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
2016-12-22 20:15:18 -08:00
Akira Ajisaka
22befbd585
MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt.
2016-12-23 04:48:04 +09:00
Kai Zheng
56a13a6a59
HDFS-11216. Add remoteBytesRead counter metrics for erasure coding reconstruction task. Contributed by Sammi Chen
2016-12-22 14:18:54 +08:00
Akira Ajisaka
f6e2521eb2
HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.
2016-12-21 14:17:47 +09:00
Jason Lowe
631f1daee3
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-15 20:52:40 +00:00
Jason Lowe
169bfc0903
Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger"
...
This reverts commit 9947aeb60c
.
2016-12-15 20:51:24 +00:00
Xiaoyu Yao
f5e0bd30fd
HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.
2016-12-14 13:45:21 -08:00
Arpit Agarwal
6ba9587d37
HDFS-10958. Add instrumentation hooks around Datanode disk IO.
2016-12-14 11:18:58 -08:00
Akira Ajisaka
72bff192cd
HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.
2016-12-14 18:50:43 +09:00
Jason Lowe
9947aeb60c
HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
2016-12-13 22:55:09 +00:00
Steve Loughran
f66f61892a
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-12 13:58:27 +00:00
Wei-Chiu Chuang
b606e025f1
HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge.
2016-12-09 15:22:21 -08:00
Brahma Reddy Battula
80b8023276
HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin.
2016-12-09 18:21:42 +05:30
Akira Ajisaka
7d8e440eee
Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran"
...
This reverts commit c265515725
.
2016-12-09 12:49:27 +09:00
Steve Loughran
c265515725
HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran
2016-12-08 17:57:15 +00:00
Brahma Reddy Battula
0ef796174e
HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B.
2016-12-08 18:57:43 +05:30
Akira Ajisaka
deb4743b2c
Revert "HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin."
...
This reverts commit 0857641f62
.
2016-12-08 13:37:06 +09:00
Akira Ajisaka
0857641f62
HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin.
2016-12-08 13:34:45 +09:00
Ming Ma
c73e08a6da
HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma)
2016-12-07 08:26:09 -08:00
Karthik Kambatla
c8d0a049b0
HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha)
2016-12-06 14:10:58 -08:00
Andrew Wang
f53b481ffe
HDFS-11172. Support an erasure coding policy using RS 10 + 4. Contributed by Wei Zhou.
2016-12-06 12:49:38 -08:00
Xiao Chen
79d90b810c
HADOOP-13827. Add reencryptEncryptedKey interface to KMS.
2016-12-06 12:04:04 -08:00
Andrew Wang
7b988e8899
HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn.
2016-12-05 23:18:18 -08:00
Akira Ajisaka
b2a3d6c519
HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. Contributed by Varun Vasudev.
2016-12-06 14:01:47 +09:00
Xiao Chen
a2b5d60220
HADOOP-13864. KMS should not require truststore password. Contributed by Mike Yoder.
2016-12-05 17:36:00 -08:00
Xiao Chen
291df5c7fb
HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge.
2016-12-05 09:35:17 -08:00
Mingliang Liu
19f373a46b
HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane
2016-12-01 12:54:28 -08:00
Andrew Wang
1f7613be95
HADOOP-13840. Implement getUsed() for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-30 17:55:12 -08:00
Kai Zheng
51e6c1cc3f
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-30 15:52:56 +08:00
Kai Zheng
cfd8076f81
Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen"
...
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
2016-11-30 15:44:52 +08:00
Akira Ajisaka
67d9f2808e
HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project.
2016-11-29 14:07:19 +09:00
Robert Kanter
47ca9e26fb
HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter)
2016-11-28 18:08:09 -08:00
Andrew Wang
a2b1ff0257
HADOOP-13828. Implement getFileChecksum(path, length) for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-28 11:54:43 -08:00
Kai Zheng
5d5614f847
HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen
2016-11-28 14:34:44 +08:00
Akira Ajisaka
209e805430
HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.
2016-11-28 14:34:57 +09:00
Harsh J
07825f2b49
HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J.
2016-11-25 22:22:23 +05:30
Brahma Reddy Battula
ee3d437a33
HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula.
2016-11-25 19:54:50 +05:30
Steve Loughran
01665e456d
HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli
...
Cherry picked from 24715cefe80fba531dd16a44ec1cead67c389eb1
2016-11-24 17:54:10 +00:00
Steve Loughran
3df3fa396c
HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula.
2016-11-24 17:44:36 +00:00
Brahma Reddy Battula
13501053dd
HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula.
2016-11-24 22:23:22 +05:30
Steve Loughran
abb9fa7fc6
HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash
2016-11-24 16:41:59 +00:00
Andrew Wang
c7a5f2906f
HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li.
2016-11-23 17:08:38 -08:00
Mingliang Liu
860d49aa6a
HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran
2016-11-23 16:42:27 -08:00
Andrew Wang
de4894936a
HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R.
2016-11-23 16:42:06 -08:00
Andrew Wang
dd98a8005a
HDFS-11058. Implement 'hadoop fs -df' command for ViewFileSystem. Contributed by Manoj Govindassamy.
2016-11-23 16:40:39 -08:00
Jian He
3d94da1e00
HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth
2016-11-23 16:01:55 -08:00
Mingliang Liu
2bf9a15e8a
HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran
2016-11-22 14:27:23 -08:00
Lei Xu
3a09e5970d
HDFS-11145. Implement getTrashRoot() for ViewFileSystem. (Manoj Govindassamy via lei)
2016-11-22 13:52:09 -08:00
Mingliang Liu
beb70fed4f
HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
...
This closes #131
2016-11-22 13:12:23 -08:00
Brahma Reddy Battula
afcf8d38e7
HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula.
2016-11-22 19:45:45 +05:30
Wei-Chiu Chuang
c0b1a44f6c
HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory.
2016-11-17 22:48:35 -06:00
Mingliang Liu
ae8849fe37
HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran
2016-11-17 14:11:38 -08:00
Kihwal Lee
bd3735554f
HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula.
2016-11-17 12:16:38 -06:00
Mingliang Liu
aab9737a05
HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula
2016-11-16 20:08:48 -08:00
Mingliang Liu
5af572b644
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
2016-11-15 10:57:00 -08:00
Mingliang Liu
04014c4c73
HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran
...
This closes #158
2016-11-14 19:38:10 -08:00
Zhe Zhang
ff0b99eafe
HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen.
2016-11-14 11:05:29 -08:00
Chris Douglas
5c61ad2488
HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane
2016-11-11 11:15:07 -08:00
Yongjun Zhang
fd2f22adec
HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang.
2016-11-10 22:42:59 -08:00
Yongjun Zhang
470bdaa27a
HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
2016-11-10 22:38:38 -08:00
Akira Ajisaka
8848a8a76c
HDFS-11116. Fix javac warnings caused by deprecation of APIs in TestViewFsDefaultValue. Contributed by Yiqun Lin.
2016-11-11 13:45:30 +09:00
Xiao Chen
822ae88f7d
HADOOP-13346. DelegationTokenAuthenticationHandler writes via closed writer. Contributed by Gregory Chanan and Hrishikesh Gadre.
2016-11-09 09:33:00 -08:00
Xiao Chen
367c3d4121
HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception.
2016-11-09 09:07:12 -08:00
Akira Ajisaka
c074880096
HADOOP-13800. Remove unused HADOOP_AUDIT_LOGGER from hadoop-env.sh. Contributed by Yiqun Lin.
2016-11-09 22:02:40 +09:00
Andrew Wang
e1c6ef2efa
HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey.
2016-11-08 16:33:55 -08:00
Zhe Zhang
77c13c3857
HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen.
2016-11-08 16:07:36 -08:00
Mingliang Liu
2a65eb121e
HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn
2016-11-08 15:40:22 -08:00
Subru Krishnan
29e3b3417c
YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru).
2016-11-08 14:38:18 -08:00
Brahma Reddy Battula
dbb133ccfc
HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu.
2016-11-08 20:55:10 +05:30
Zhe Zhang
3dbad5d823
HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen.
2016-11-07 16:08:10 -08:00
Steve Loughran
f76895573d
HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt
2016-11-07 12:36:10 +00:00
Xiao Chen
d8bab3dcb6
HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu.
2016-11-04 18:06:55 -07:00
Akira Ajisaka
de0132748d
MAPREDUCE-6796. Remove unused properties from JTConfig.java. Contributed by Haibo Chen.
2016-11-05 03:49:19 +09:00
Mingliang Liu
abfc15d5ef
HADOOP-13792. Stackoverflow for schemeless defaultFS with trailing slash. Contributed by John Zhuge
2016-11-04 10:46:27 -07:00
Xiao Chen
7154a20bcb
HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao.
2016-11-03 13:09:03 -07:00
Andrew Wang
7e521c5a49
HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory.
2016-11-02 19:11:05 -07:00
Daniel Templeton
0dc2a6a3a5
HADOOP-13667. Fix typing mistake of inline document in hadoop-metrics2.properties (Contributed by Rui Gao via Daniel Templeton)
2016-11-02 06:53:33 -07:00
Arpit Agarwal
1b6ecaf016
HADOOP-13738. DiskChecker should perform some disk IO.
2016-11-01 18:02:23 -07:00
Steve Loughran
a1761a841e
HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi.
2016-10-31 20:54:46 +00:00
Wei-Chiu Chuang
112f04eb1b
HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin.
2016-10-28 15:33:27 -07:00
Jason Lowe
c017171da0
HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang
2016-10-28 14:57:50 +00:00
Robert Kanter
5877f20f9c
HADOOP-10075. Update jetty dependency to version 9 (rkanter)
2016-10-27 16:09:00 -07:00
Brahma Reddy Battula
0c837db8a8
HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu
2016-10-27 19:46:41 +05:30
Masatake Iwasaki
0bdd263d82
HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran.
2016-10-27 15:46:59 +09:00
Andrew Wang
22ff0eff4d
HADOOP-8299. ViewFileSystem link slash mount point crashes with IndexOutOfBoundsException. Contributed by Manoj Govindassamy.
2016-10-26 14:25:03 -07:00
Chris Nauroth
1f8490a5ba
HADOOP-13502. Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. Contributed by Chris Nauroth.
2016-10-26 08:55:42 -07:00
Chris Nauroth
9cad3e2350
HADOOP-13614. Purge some superfluous/obsolete S3 FS tests that are slowing test runs down. Contributed by Steve Loughran.
2016-10-26 08:27:26 -07:00
Wei-Chiu Chuang
d88dca844a
HADOOP-11798. Native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-25 16:53:53 -07:00
Andrew Wang
084bdab156
HDFS-5684. Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting. Contributed by Manoj Govindassamy.
2016-10-25 15:35:39 -07:00
Andrew Wang
86c735bcb1
Revert "HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu."
...
This reverts commit cef61d505e
.
2016-10-25 13:45:52 -07:00
Chris Nauroth
309a43925c
HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth.
2016-10-25 09:03:03 -07:00
Chris Nauroth
d8fa1cfa67
HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth.
2016-10-24 21:22:34 -07:00
Akira Ajisaka
dc3272bfe8
HDFS-11046. Duplicate '-' in the daemon log name.
2016-10-25 10:07:43 +09:00
Xiaoyu Yao
d0a347984d
HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-23 10:58:36 -07:00
Xiaoyu Yao
da901b6c14
Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao."
...
This reverts commit be72372248
.
2016-10-23 08:25:37 -07:00
Wei-Chiu Chuang
25438526ed
HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen.
2016-10-21 16:20:07 -07:00
Xiaoyu Yao
be72372248
HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao.
2016-10-21 14:23:02 -07:00
Chris Douglas
ae8bccd509
HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du
2016-10-21 12:59:54 -07:00
Anu Engineer
262827cf75
HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal.
2016-10-20 13:35:26 -07:00
Anu Engineer
3fbf4cd5da
HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran.
2016-10-20 12:33:58 -07:00
Brahma Reddy Battula
f872c6bc03
HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula
2016-10-20 21:47:17 +05:30
Benoy Antony
4bca385241
HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter
2016-10-18 18:32:01 -07:00
Xiao Chen
efdf810cf9
HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge.
2016-10-18 18:18:43 -07:00
Steve Loughran
6c348c5691
HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran
2016-10-18 21:16:02 +01:00
Kai Zheng
c023c74886
HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki
2016-10-18 12:02:53 +06:00
Akira Ajisaka
bedfec0c10
HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini.
2016-10-18 15:00:44 +09:00
Andrew Wang
b671ee6846
HDFS-11013. Correct typos in native erasure coding dump code. Contributed by László Bence Nagy.
2016-10-17 14:14:50 -07:00
Andrew Wang
987ee51141
HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei.
2016-10-17 13:25:58 -07:00
Andrew Wang
0f4afc8100
HADOOP-13722. Code cleanup -- ViewFileSystem and InodeTree. Contributed by Manoj Govindassamy.
2016-10-17 13:15:11 -07:00
Wei-Chiu Chuang
ed9fcbec54
HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory.
2016-10-17 05:04:49 -07:00
Andrew Wang
aee538be6c
HADOOP-13721. Remove stale method ViewFileSystem#getTrashCanLocation. Contributed by Manoj Govindassamy.
2016-10-14 14:08:31 -07:00
Xiaoyu Yao
dbe663d524
HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang.
2016-10-13 23:05:16 -07:00
Arpit Agarwal
008122b3c9
HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru.
2016-10-13 11:37:03 -07:00
Andrew Wang
12d739a34b
HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures.
2016-10-12 15:19:52 -07:00
Kihwal Lee
85cd06f663
HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah.
2016-10-12 15:11:42 -05:00
Xiao Chen
b84c4891f9
HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key.
2016-10-11 17:05:00 -07:00
Andrew Wang
8a09bf7c19
HADOOP-13705. Revert HADOOP-13534 Remove unused TrashPolicy#getInstance and initialize code.
2016-10-11 13:46:07 -07:00
Wei-Chiu Chuang
4b32b1420d
HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang.
2016-10-11 13:21:33 -07:00
Mingliang Liu
2fb392a587
HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu
2016-10-11 10:57:08 -07:00
Mingliang Liu
c874fa914d
HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu
2016-10-10 13:33:07 -07:00
Andrew Wang
03060075c5
HADOOP-13699. Configuration does not substitute multiple references to the same var.
2016-10-10 12:19:26 -07:00
Steve Loughran
cef61d505e
HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu.
2016-10-10 12:32:39 +01:00
Kai Zheng
3d59b18d49
HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang
2016-10-09 15:53:36 +06:00
Kai Zheng
ec0b70716c
HADOOP-12579. Deprecate WriteableRPCEngine. Contributed by Wei Zhou
2016-10-09 15:07:03 +06:00
Xiao Chen
2e853be657
HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen.
2016-10-07 13:46:27 -07:00
Steve Loughran
ebd4f39a39
HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran.
2016-10-07 12:51:40 +01:00
Chris Nauroth
1d330fbaf6
HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth.
2016-10-06 13:19:16 -07:00
Chris Nauroth
2d46c3f6b7
HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran.
2016-10-06 10:57:01 -07:00
Brahma Reddy Battula
35b9d7de9f
HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin
2016-10-06 18:06:08 +05:30
Brahma Reddy Battula
b90fc70d67
HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen
2016-10-06 17:47:31 +05:30
Wei-Chiu Chuang
c5ca216915
HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge.
2016-10-05 17:36:50 -07:00
Mingliang Liu
00160f71b6
HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang
2016-10-05 16:50:01 -04:00
Akira Ajisaka
9a61b52fbe
HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao.
2016-10-05 20:41:08 +09:00
Xiao Chen
853d65a157
HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen.
2016-10-03 16:01:54 -07:00
Wei-Chiu Chuang
57aec2b46b
HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark.
2016-09-30 12:58:37 -07:00
Chris Nauroth
1e0ea27e96
Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin."
...
This reverts commit 0458a2af6e
.
2016-09-29 13:59:09 -07:00
Kihwal Lee
236ac773c9
HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp.
2016-09-29 13:27:30 -05:00
Steve Loughran
ee0c722dc8
HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan.
2016-09-29 17:01:00 +01:00
Steve Loughran
1518cb9532
HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri
2016-09-29 11:35:00 +01:00
Kihwal Lee
e19b37ead2
HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp.
2016-09-28 08:24:21 -05:00
Mingliang Liu
9a44a832a9
HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang
2016-09-27 17:36:53 -07:00
Wangda Tan
875062b5bc
HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda)
2016-09-27 11:26:45 -07:00
Brahma Reddy Battula
edf0d0f8b2
HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki
2016-09-27 07:04:37 +05:30
Konstantin V Shvachko
6eb700ee74
HDFS-10866. Fix Eclipse Java compile errors related to generic parameters. Contributed by Konstantin Shvachko.
2016-09-23 14:10:11 -07:00
Brahma Reddy Battula
bbdf350ff9
HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document.
2016-09-23 19:21:34 +05:30
Mingliang Liu
e80386d69d
HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani.
2016-09-20 13:20:01 -07:00
Kai Zheng
734d54c1a8
HDFS-10861. Refactor StripeReaders and use ECChunk version decode API. Contributed by Sammi Chen
2016-09-21 21:34:48 +08:00
Xiao Chen
ea839bd48e
HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen.
2016-09-17 22:25:39 -07:00
Kai Zheng
58bae35447
YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng
2016-09-18 08:43:36 +08:00
Andrew Wang
8a40953058
HDFS-10823. Implement HttpFSFileSystem#listStatusIterator.
2016-09-16 15:37:36 -07:00
Sangjin Lee
fcbac00212
Revert "HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)"
...
This reverts commit 4d3ea92f4f
.
2016-09-15 10:18:56 -07:00
Akira Ajisaka
7cad7b7046
HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki.
2016-09-15 23:42:34 +09:00
Steve Loughran
53a12fa721
HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran
2016-09-14 15:45:04 +01:00
Kai Zheng
ea0c2b8b05
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-15 10:46:00 +08:00
Jing Zhao
08d8e0ba25
HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou.
2016-09-13 11:12:52 -07:00
Yongjun Zhang
d2466ec3e0
HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang)
2016-09-12 21:25:06 -07:00
Mingliang Liu
59d59667a8
HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang
2016-09-12 16:17:08 -07:00
Allen Wittenauer
58ed4fa544
HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS
...
This commit includes the following changes:
HADOOP-13356. Add a function to handle command_subcommand_OPTS
HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
HADOOP-13357. Modify common to use hadoop_subcommand_opts
HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
HADOOP-13564. modify mapred to use hadoop_subcommand_opts
HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
HADOOP-13360. Documentation for HADOOP_subcommand_OPTS
This closes apache/hadoop#126
2016-09-12 11:10:00 -07:00
Arpit Agarwal
a99bf26a08
HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy)
2016-09-10 18:22:25 -07:00
Chris Douglas
9f192cc5ac
MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan
2016-09-09 11:12:44 -07:00
Kihwal Lee
d4d076876a
HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp.
2016-09-09 10:39:35 -05:00
Chris Douglas
011f3b24d4
HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang
2016-09-08 17:53:40 -07:00
Chris Douglas
1192781a78
HADOOP-13519. Make Path Serializable. Contributed by Steve Loughran
2016-09-08 17:46:12 -07:00
Allen Wittenauer
cae331186d
Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)"
...
This reverts commit 05ede00386
.
2016-09-08 12:40:30 -07:00
Zhe Zhang
401db4fc65
HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng.
2016-09-08 11:54:33 -07:00
Kai Zheng
d355573f56
Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng"
...
This reverts commit 62a9667136
2016-09-08 05:50:17 +08:00
Anu Engineer
f414d5e118
HADOOP-13388. Clean up TestLocalFileSystemPermission. Contributed by Andras Bokor.
2016-09-07 11:09:41 -07:00
Xiao Chen
680be58aac
HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen.
2016-09-06 20:54:17 -07:00
Chris Nauroth
f0d5382ff3
HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth.
2016-09-06 11:02:39 -07:00
Chris Douglas
d37dc5d1b8
HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin
2016-09-06 10:38:04 -07:00
Andrew Wang
f388a20943
Add CHANGES and release notes for 3.0.0-alpha1 to site
2016-09-06 09:51:55 -07:00
Kihwal Lee
39d1b1d747
HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp.
2016-09-06 10:02:42 -05:00
Kai Zheng
62a9667136
HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng
2016-09-07 17:05:33 +08:00
Kihwal Lee
23abb09c1f
HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp.
2016-09-02 11:03:18 -05:00
Kihwal Lee
76cd81f4b6
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-09-01 15:44:44 -05:00
Chris Douglas
3069df7551
FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria
2016-09-01 11:32:26 -07:00
Mingliang Liu
dcd21d083a
HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang)
2016-09-01 11:03:06 -07:00
Ray Chiang
05ede00386
YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)
2016-08-29 15:55:33 -07:00
Mingliang Liu
6fcb04c178
HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri)
2016-08-29 13:04:28 -07:00
Anu Engineer
e1ad598cef
HADOOP-7363. TestRawLocalFileSystemContract is needed. Contributed by Andras Bokor.
2016-08-29 09:26:46 -07:00
Jason Lowe
92d8f37155
HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe
2016-08-29 15:55:38 +00:00
Kihwal Lee
81485dbfc1
Revert "HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp."
...
This reverts commit d288a0ba83
.
2016-08-25 16:04:54 -05:00
Kihwal Lee
d288a0ba83
HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp.
2016-08-25 11:44:13 -05:00
Albert Chu
52b25fe6ae
HADOOP-13533. Do not require user to set HADOOP_SSH_OPTS to a non-null string, allow setting of an empty string. (Albert Chu via aw) closes #121
...
Signed-off-by: Allen Wittenauer <aw@apache.org>
2016-08-25 07:11:06 -07:00
Allen Wittenauer
601599b036
HADOOP-13532. Fix typo in hadoop_connect_to_hosts error message (Albert Chu via aw) closes #120
2016-08-25 06:58:42 -07:00
Akira Ajisaka
ab3b727b5f
HADOOP-13534. Remove unused TrashPolicy#getInstance and initialize code. Contributed by Yiqun Lin.
2016-08-25 13:54:57 +09:00
Akira Ajisaka
092b4d5bfd
HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin.
2016-08-24 16:47:52 +09:00
Chris Douglas
c37346d0e3
HADOOP-12726. Unsupported FS operations should throw UnsupportedOperationException. Contributed by Daniel Templeton.
2016-08-23 14:12:52 -07:00
Masatake Iwasaki
8aae8d6bf0
HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu.
2016-08-24 00:03:27 +09:00
Wei-Chiu Chuang
f0efea490e
HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen.
2016-08-23 04:14:24 -07:00
Eric Yang
c49333becf
HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang)
2016-08-22 18:29:56 -07:00
Xiao Chen
4070caad70
HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya.
2016-08-22 18:09:35 -07:00
Xiao Chen
f4d4d3474c
HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen.
2016-08-22 14:42:13 -07:00
Mingliang Liu
115ecb52a8
HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang)
2016-08-21 09:40:29 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
99603e9022
HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan.
2016-08-19 19:08:53 -07:00
Chris Nauroth
763f0497bb
HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran.
2016-08-19 10:48:10 -07:00
Wei-Chiu Chuang
03a9343d57
HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen.
2016-08-19 09:22:49 -07:00
Akira Ajisaka
8179f9a493
HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu.
2016-08-19 16:15:00 +09:00
Kai Zheng
dbcaf999d9
HADOOP-13504. Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010. Contributed by Sammi Chen
2016-08-19 11:18:15 +08:00
Jing Zhao
c5c3e81b49
HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou.
2016-08-18 14:55:26 -07:00
Mingliang Liu
0f51eae0c0
HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu)
2016-08-18 14:10:37 -07:00
Junping Du
0da69c324d
YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi.
...
(cherry picked from commit d464483bf7f0b3e3be3ba32cd6c3eee546747ab5)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
2016-08-18 07:27:23 -07:00
Steve Loughran
040c185d62
HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie
2016-08-18 14:36:55 +01:00
Anu Engineer
c57523163f
HADOOP-11786. Fix Javadoc typos in org.apache.hadoop.fs.FileSystem. Contributed by Andras Bokor.
2016-08-17 15:00:14 -07:00
Mingliang Liu
23532716fc
HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)
2016-08-16 17:33:04 -07:00
Mingliang Liu
27a6e09c4e
Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)"
...
This reverts commit 9336a0495f
.
2016-08-16 16:25:37 -07:00
Andrew Wang
4b689e7a75
HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory.
2016-08-16 15:01:18 -07:00
Masatake Iwasaki
b8a446ba57
HADOOP-13419. Fix javadoc warnings by JDK8 in hadoop-common package. Contributed by Kai Sasaki.
2016-08-16 13:30:40 +09:00
Mingliang Liu
9336a0495f
HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)
2016-08-15 20:24:54 -07:00
Mingliang Liu
382d615260
HDFS-10678. Documenting NNThroughputBenchmark tool. (Contributed by Mingliang Liu)
2016-08-15 20:22:14 -07:00
Mingliang Liu
4bcbef39f7
HDFS-10724. Document caller context config keys. (Contributed by Mingliang Liu)
2016-08-15 20:20:33 -07:00
Mingliang Liu
12ad63d723
HDFS-10725. Caller context should always be constructed by a builder. (Contributed by Mingliang Liu)
2016-08-15 20:14:05 -07:00
Varun Saxena
d714030b5d
HADOOP-13333. testConf.xml ls comparators in wrong order (Vrushali C via Varun Saxena)
2016-08-16 03:03:44 +05:30
Kai Zheng
b5af9be72c
HDFS-8668. Erasure Coding: revisit buffer used for encoding and decoding. Contributed by Sammi Chen
2016-08-13 13:52:37 +08:00
Sangjin Lee
4d3ea92f4f
HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)
2016-08-11 19:56:58 -07:00
Wei-Chiu Chuang
d892ae9576
HADOOP-13441. Document LdapGroupsMapping keystore password properties. Contributed by Yuanbo Liu.
2016-08-11 11:57:43 -07:00
Kai Zheng
8fbb57fbd9
HADOOP-11588. Benchmark framework and test for erasure coders. Contributed by Rui Li
2016-08-12 15:05:52 +08:00
Xiao Chen
e83be44af5
HADOOP-13461. NPE in KeyProvider.rollNewVersion. Contributed by Colm O hEigeartaigh.
2016-08-10 16:28:02 -07:00
Chris Nauroth
4d4fe07c3c
HADOOP-13476. CredentialProviderFactory fails at class loading from libhdfs (JNI). Contributed by Aaron Fabbri.
2016-08-10 09:54:31 -07:00
Wei-Chiu Chuang
d00d3add9e
HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah.
2016-08-09 18:11:34 -07:00
Karthik Kambatla
85422bb7c5
HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha)
2016-08-09 13:42:32 -07:00
Kihwal Lee
caf800d529
HADOOP-13473. Tracing in IPC Server is broken. Contributed by Daryn Sharp.
2016-08-09 14:33:15 -05:00
Masatake Iwasaki
8f9b61852b
HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang.
2016-08-09 09:54:44 +09:00
Sangjin Lee
0ad48aa2c8
HADOOP-12747. support wildcard in libjars argument (sjlee)
2016-08-08 17:34:56 -07:00
Lei Xu
6418edd6fe
HADOOP-13380. TestBasicDiskValidator should not write data to /tmp (Yufei Gu via lei)
2016-08-08 15:06:03 -07:00
Arpit Agarwal
58e1523c8e
HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang)
2016-08-08 12:36:27 -07:00
Jitendra Pandey
625585950a
HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu.
2016-08-08 11:00:19 -07:00
Wei-Chiu Chuang
49ba09a922
HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang.
2016-08-05 16:32:44 -07:00
Kai Zheng
cca6229696
HDFS-10718. Prefer direct ByteBuffer in native RS encoder and decoder. Contributed by Sammi Chen
2016-08-05 04:22:48 +08:00
Arpit Agarwal
331ef25152
HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang)
2016-08-04 12:25:39 -07:00
Arpit Agarwal
b8ca84ac99
HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal)
2016-08-04 10:07:53 -07:00
Kihwal Lee
9422515239
HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp.
2016-08-04 10:45:55 -05:00
Xiao Chen
05db64913d
HADOOP-13443. KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default. Contributed by Anthony Young-Garner.
2016-08-04 15:57:34 +08:00
Wei-Chiu Chuang
a1f6564d31
HADOOP-13458. LoadBalancingKMSClientProvider#doOp should log IOException stacktrace. Contributed by Chen Liang.
2016-08-03 14:19:47 -07:00
Jason Lowe
c82745432a
HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger
2016-08-03 20:17:30 +00:00
Kihwal Lee
580a833496
HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp.
2016-08-03 13:22:22 -05:00
Kihwal Lee
2d8227605f
HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp.
2016-08-03 09:31:49 -05:00
Arpit Agarwal
d28c2d9f55
HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor)
2016-08-02 15:17:45 -07:00
Arpit Agarwal
954465e7ba
HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley)
2016-08-02 13:40:33 -07:00
Chris Nauroth
0458a2af6e
HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin.
2016-08-02 12:43:30 -07:00
Kihwal Lee
b3018e73cc
HADOOP-13429. Dispose of unnecessary SASL servers. Contributed by Daryn Sharp.
2016-08-02 10:40:28 -05:00
Akira Ajisaka
770b5eb2db
HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon.
2016-08-01 17:35:59 +09:00
Kai Zheng
34ccaa8367
HADOOP-11540. Raw Reed-Solomon coder using Intel ISA-L library. Contributed by Kai Zheng
2016-08-01 06:34:26 +08:00
Akira Ajisaka
3d191cc152
HADOOP-13440. FileContext does not react on changing umask via configuration.
2016-07-31 11:29:15 +09:00
Xiao Chen
8ebf2e95d2
HADOOP-13381. KMS clients should use KMS Delegation Tokens from current UGI. Contributed by Xiao Chen.
2016-07-28 18:24:41 -07:00
Xiao Chen
d9aae22fdf
HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge
2016-07-28 16:29:40 -07:00
Lei Xu
a3d0cba810
HDFS-10689. Hdfs dfs chmod should reset sticky bit permission when the bit is omitted in the octal mode. (Manoj Govindassamy via Lei Xu)
2016-07-28 13:52:14 -07:00
Akira Ajisaka
54fe17a607
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
2016-07-27 19:41:09 +09:00
Chris Nauroth
255ea45e50
HADOOP-13422. ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process. Contributed by Sergey Shelukhin.
2016-07-26 15:33:20 -07:00
Kai Zheng
f1a4863dfc
HADOOP-13041. Adding tests for coder utilities. Contributed by Kai Sasaki
2016-07-26 21:53:37 +08:00
Chris Douglas
22a9a6b0d4
HADOOP-13272. ViewFileSystem should support storage policy related API. Contributed by Peter Shi
2016-07-22 18:08:12 -07:00
Chris Nauroth
5fda66e4a3
HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran.
2016-07-22 15:38:18 -07:00
Chris Nauroth
43cf6b101d
HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge.
2016-07-21 14:12:31 -07:00
Steve Loughran
37362c2f92
HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan)
2016-07-20 13:42:51 +01:00
Akira Ajisaka
dc065dd64c
HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki.
2016-07-19 16:05:48 -07:00
Akira Ajisaka
92fe2db540
HADOOP-13301. Millisecond timestamp for FsShell console log and MapReduce jobsummary log. Contributed by John Zhuge.
2016-07-18 15:45:44 -07:00
Akira Ajisaka
c2bcffb34e
HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki.
2016-07-18 11:48:23 -07:00
Steve Loughran
76be82bc04
HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor
2016-07-18 14:38:35 +01:00
Andrew Wang
da456ffd62
Preparing for 3.0.0-alpha2 development
2016-07-15 19:04:17 -07:00
Robert Kanter
442162048a
HADOOP-13254. Create framework for configurable disk checkers (yufeigu via rkanter)
2016-07-15 13:41:26 -07:00
Akira Ajisaka
1381483233
HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou.
2016-07-14 23:13:55 -07:00
Steve Loughran
be26c1b9b0
Revert "HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor"
...
This reverts commit 45af585e7a
.
2016-07-14 10:30:36 +01:00
Steve Loughran
45af585e7a
HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor
2016-07-14 10:29:29 +01:00
Zhe Zhang
728bf7f698
HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung.
2016-07-13 16:37:40 -07:00
Akira Ajisaka
505ce88437
HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R.
2016-07-13 13:02:20 -07:00
Tsuyoshi Ozawa
77ffe76212
HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa)
2016-07-13 21:28:04 +09:00
Lei Xu
a290a98b6a
HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei)
2016-07-12 16:49:32 -07:00
Vrushali Channapattan
32b033d57c
YARN-5052 Update timeline service v2 documentation to capture information about filters (Varun Saxena via Vrushali C)
2016-07-10 08:46:03 -07:00
Jitendra Pandey
ef30bf3c3f
HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer.
2016-07-08 14:17:14 -07:00
Jitendra Pandey
6e597600f7
HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu.
2016-07-07 14:58:19 -07:00
Allen Wittenauer
a0035661c1
HADOOP-13349. HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH (aw)
2016-07-07 14:15:34 -07:00
Akira Ajisaka
d1626a7b37
MAPREDUCE-6717. Remove deprecated StringUtils.getFormattedTimeWithDiff. Contributed by Shen Yinjie.
2016-07-07 11:18:43 -07:00
Jian He
d792a90206
YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du
2016-07-05 18:05:16 -07:00
Jitendra Pandey
aa42c7a6dd
HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu.
2016-07-01 15:34:03 -07:00
Vinayakumar B
c25021fb71
HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B)
2016-07-01 12:09:59 +05:30
Masatake Iwasaki
5c07c573db
HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims)
2016-06-30 07:21:08 +09:00
Steve Loughran
96fa0f848b
HADOOP-12709 Cut s3:// from trunk. Contributed by Mingliang Liu.
2016-06-29 16:04:50 +01:00
Steve Loughran
111739df8f
HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki
2016-06-29 14:32:03 +01:00
Allen Wittenauer
b3649adf6a
HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw)
2016-06-28 20:47:05 -07:00
Allen Wittenauer
6103635591
HADOOP-9330. Add custom JUnit4 test runner with configurable timeout (Steve Loughran via aw)
2016-06-28 20:40:41 -07:00
Allen Wittenauer
1faaa69078
HADOOP-9321. fix coverage org.apache.hadoop.net (Ivan A. Veselovsky via aw)
2016-06-28 20:37:42 -07:00
Andrew Wang
77031a9c37
HADOOP-12864. Remove bin/rcc script. Contributed by Allen Wittenauer.
2016-06-28 14:25:02 -07:00
Allen Wittenauer
23c3ff85a9
HADOOP-13209. replace slaves with workers (John Smith via aw)
2016-06-28 05:53:03 -07:00
Andrew Wang
7d2070493e
HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen.
2016-06-27 18:46:33 -07:00
Andrew Wang
771f798edf
HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen.
2016-06-27 18:20:56 -07:00
Arpit Agarwal
9683eab0e1
HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell)
2016-06-27 09:36:05 -07:00
Tsz-Wo Nicholas Sze
d328e66706
HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls.
2016-06-25 15:45:16 +08:00
Sangjin Lee
bf74dbf80d
HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee)
2016-06-24 14:44:15 -07:00
Colin Patrick Mccabe
975786492c
Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
2016-06-24 09:46:36 -07:00
Zhe Zhang
0b9edf6e0f
HADOOP-13019. Implement ErasureCodec for HitchHiker XOR coding. Contributed by Kai Sasaki.
2016-06-23 15:52:51 -07:00
Andrew Wang
e98c0c7a1c
Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen."
...
This reverts commit 35356de1ba
.
2016-06-23 11:08:02 -07:00
Steve Loughran
4ee3543625
HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel.
2016-06-22 15:45:25 +01:00
Masatake Iwasaki
67089875f0
HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims)
2016-06-22 23:38:20 +09:00
Akira Ajisaka
e15cd43369
HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton.
2016-06-21 20:16:22 +09:00
Tsuyoshi Ozawa
5d58858bb6
HADOOP-9613. [JDK8] Update jersey version to latest 1.x release.
2016-06-21 08:05:32 +09:00
Colin Patrick Mccabe
8c1f81d4bf
HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe)
2016-06-20 14:25:07 -07:00
Colin Patrick Mccabe
5370a6ffae
HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe)
2016-06-20 10:46:18 -07:00
Akira Ajisaka
fc6b50cc57
HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde.
2016-06-20 17:07:26 +09:00
Arpit Agarwal
0319d73c3b
HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal)
2016-06-18 16:16:54 -07:00
Chris Nauroth
5f6bc65bb3
Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)"
...
This reverts commit 97056c3355
.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2016-06-17 23:50:22 -07:00
Xiaoyu Yao
0761379fe4
HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao.
2016-06-17 15:25:14 -07:00
Akira Ajisaka
09e82acaf9
HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang.
2016-06-17 16:20:38 +09:00
Akira Ajisaka
51d497fa93
MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao.
2016-06-17 11:03:54 +09:00
Konstantin V Shvachko
a2a5cb60b0
HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi.
2016-06-16 18:20:49 -07:00
Colin Patrick Mccabe
bf780406f2
HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe)
2016-06-16 16:48:05 -07:00
Xiaoyu Yao
b1674caa40
HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen.
2016-06-16 15:22:00 -07:00
Chris Nauroth
127d2c7281
HADOOP-13241. document s3a better. Contributed by Steve Loughran.
2016-06-16 11:18:02 -07:00
Vinayakumar B
cc6c265171
HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B)
2016-06-16 16:47:06 +05:30
Jitendra Pandey
6f0aa75121
HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin.
2016-06-15 11:41:49 -07:00
Allen Wittenauer
e2f640942b
HADOOP-13245. Fix up some misc create-release issues (aw)
2016-06-14 16:03:20 -07:00
Vinayakumar B
8e8cb4c6ca
HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma)
2016-06-14 16:01:26 +05:30
Masatake Iwasaki
20b13d109a
HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki.
2016-06-14 19:20:46 +09:00
Akira Ajisaka
e3ba9ad3f1
HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki.
2016-06-14 10:18:41 +09:00
Andrew Wang
0accc3306d
HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge.
2016-06-13 11:43:46 -07:00
Karthik Kambatla
49b4064644
HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha)
2016-06-12 14:12:31 -07:00
Jing Zhao
0bbb4ddd79
HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu.
2016-06-10 10:38:13 -07:00
Chris Nauroth
9581fb715c
HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane.
2016-06-09 14:33:31 -07:00
Steve Loughran
31ffaf76f2
HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory.
2016-06-09 21:00:47 +01:00
Steve Loughran
656c460c0e
HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth
2016-06-09 17:28:49 +01:00
Kai Zheng
723432b338
HADOOP-13220. Follow on fixups after upgraded mini-kdc using Kerby. Contributed by Jiajia Li
2016-06-09 15:56:12 +08:00
Robert Kanter
733f3f18d5
MAPREDUCE-6702. TestMiniMRChildTask.testTaskEnv and TestMiniMRChildTask.testTaskOldEnv are failing (ajisakaa via rkanter)
2016-06-07 15:46:06 -07:00
Junping Du
c14c1b298e
HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe.
2016-06-07 09:18:58 -07:00
Tsz-Wo Nicholas Sze
35f255b03b
Revert "Revert "HADOOP-13226 Support async call retry and failover.""
...
This reverts commit 5360da8bd9
.
2016-06-06 16:31:43 +08:00
Tsz-Wo Nicholas Sze
574dcd34c0
Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls.""
...
This reverts commit e4450d47f1
.
2016-06-06 16:31:23 +08:00
Tsz-Wo Nicholas Sze
aa20fa150d
Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou""
...
This reverts commit 4d36b221a2
.
2016-06-06 16:28:47 +08:00
Tsz-Wo Nicholas Sze
eded3d109e
Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou""
...
This reverts commit 106234d873
.
2016-06-06 16:28:21 +08:00
Andrew Wang
106234d873
Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"
...
This reverts commit fc94810d3f
.
2016-06-03 18:09:55 -07:00
Andrew Wang
4d36b221a2
Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"
...
This reverts commit 1b9f18623a
.
2016-06-03 18:09:18 -07:00
Andrew Wang
e4450d47f1
Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."
...
This reverts commit 42c22f7e3d
.
2016-06-03 18:09:16 -07:00
Andrew Wang
5360da8bd9
Revert "HADOOP-13226 Support async call retry and failover."
...
This reverts commit 83f2f78c11
.
2016-06-03 18:09:09 -07:00
Andrew Wang
713cb71820
HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen.
2016-06-03 16:48:54 -07:00
Chris Nauroth
d82bc85018
HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu.
2016-06-03 16:38:30 -07:00
Allen Wittenauer
78b3a03831
HADOOP-13109. Add ability to edit existing token file via dtutil -alias flag (Matthew Paduano via aw)
2016-06-03 15:34:39 -07:00
Jian He
99cc439e29
YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du
2016-06-03 11:10:42 -07:00
Chris Nauroth
c58a59f708
HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran.
2016-06-03 08:55:33 -07:00
Arpit Agarwal
97e2449477
HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (Contributed by Akira Ajisaka)
2016-06-02 13:14:45 -07:00
Akira Ajisaka
ead61c45da
HADOOP-13224. Grep job in Single Cluster document fails. (aajisaka)
2016-06-03 02:00:13 +09:00
Masatake Iwasaki
aadb77e412
HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula.
2016-06-02 20:55:04 +09:00
Akira Ajisaka
99675e00df
HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou.
2016-06-02 19:14:53 +09:00
Andrew Wang
35356de1ba
HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen.
2016-06-01 13:13:17 -07:00
Steve Loughran
5870611030
HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel)
2016-06-01 14:18:20 +01:00
Colin Patrick Mccabe
8ceb06e239
HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe)
2016-05-31 17:54:34 -07:00
Tsz-Wo Nicholas Sze
83f2f78c11
HADOOP-13226 Support async call retry and failover.
2016-05-31 16:30:11 -07:00
Andrew Wang
bca31fe276
HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang.
2016-05-31 09:35:24 -07:00
Kai Zheng
93d8a7f2a2
Revert "HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng"
...
This reverts commit a6c79f92d5
.
2016-06-01 08:41:15 +08:00
Xiaoyu Yao
4ca8859583
HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao.
2016-05-27 18:07:44 -07:00
Kai Zheng
916140604f
HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li
2016-05-28 14:23:39 +08:00
Yongjun Zhang
34cc21f6d1
HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang)
2016-05-26 22:43:45 -07:00
Karthik Kambatla
55c3e2de3d
HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha)
2016-05-26 14:24:31 -07:00
Allen Wittenauer
fed9bf0ec1
HADOOP-12727. Minor cleanups needed for CMake 3.X (Alan Burlison via aw)
2016-05-26 07:37:22 -07:00
Kai Zheng
77202fa103
HADOOP-13010. Refactor raw erasure coders. Contributed by Kai Zheng
2016-05-27 13:23:34 +08:00
Allen Wittenauer
3c83cee118
HADOOP-12925. Checks for SPARC architecture need to include 64-bit SPARC (Alan Burlison via aw)
2016-05-25 15:28:02 -07:00
Kai Zheng
a6c79f92d5
HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng
2016-05-27 04:29:42 +08:00
Karthik Kambatla
57c31a3fef
HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha)
2016-05-24 10:37:00 -07:00
Allen Wittenauer
eebb39a56f
HADOOP-13112. Change CredentialShell to use CommandShell base class (Matthew Paduano via aw)
2016-05-23 13:37:38 -07:00
Allen Wittenauer
d8c1fd1944
HADOOP-13178. TestShellBasedIdMapping.testStaticMapUpdate doesn't work on OS X (Kai Sasaki via aw)
2016-05-21 10:00:36 -07:00
Steve Loughran
39ec1515a2
HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran)
2016-05-21 16:39:31 +01:00
Chris Nauroth
bcde1562d2
HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth.
2016-05-20 12:47:41 -07:00
Steve Loughran
757050ff35
HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong.
2016-05-20 13:52:15 +01:00
Tsz-Wo Nicholas Sze
42c22f7e3d
HADOOP-13168. Support Future.get with timeout in ipc async calls.
2016-05-19 15:34:04 -07:00
Jian He
feb90ffcca
YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong
2016-05-19 13:01:36 -07:00
Kai Zheng
2120de588b
Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk
2016-05-19 07:17:08 -07:00
Kai Zheng
182fc1986a
HADOOP-12782. Faster LDAP group name resolution with ActiveDirectory. Contributed by Wei-Chiu Chuang
2016-05-19 07:15:52 -07:00
Steve Loughran
22ff9e68d1
HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.
2016-05-19 14:48:18 +01:00
Chris Nauroth
bad85f3e3a
HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B.
2016-05-18 09:39:43 -07:00
Colin Patrick Mccabe
f2c1d9181f
HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe)
2016-05-18 09:15:32 -07:00
Andrew Wang
7154ace712
HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder.
2016-05-17 17:44:30 -07:00
Xiaoyu Yao
9478484845
HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao.
2016-05-17 14:58:22 -07:00
Yongjun Zhang
e24fe2641b
HDFS-9732, Improve DelegationTokenIdentifier.toString() for better logging. Contributed by Yongjun Zhang.
2016-05-17 14:03:08 -07:00
Akira Ajisaka
9fe5828f05
HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi.
2016-05-17 15:53:09 +09:00
Sangjin Lee
61f46be071
HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee)
2016-05-16 18:49:47 -07:00
Allen Wittenauer
730bc746f9
HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw)
...
This commit contains the following JIRA issues:
HADOOP-12931. bin/hadoop work for dynamic subcommands
HADOOP-12932. bin/yarn work for dynamic subcommands
HADOOP-12933. bin/hdfs work for dynamic subcommands
HADOOP-12934. bin/mapred work for dynamic subcommands
HADOOP-12935. API documentation for dynamic subcommands
HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands
HADOOP-13086. enable daemonization of dynamic commands
HADOOP-13087. env var doc update for dynamic commands
HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement
HADOOP-13089. hadoop distcp adds client opts twice when dynamic
HADOOP-13094. hadoop-common unit tests for dynamic commands
HADOOP-13095. hadoop-hdfs unit tests for dynamic commands
HADOOP-13107. clean up how rumen is executed
HADOOP-13108. dynamic subcommands need a way to manipulate arguments
HADOOP-13110. add a streaming subcommand to mapred
HADOOP-13111. convert hadoop gridmix to be dynamic
HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow
HADOOP-13117. clarify daemonization and security vars for dynamic commands
HADOOP-13120. add a --debug message when dynamic commands have been used
HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop
HADOOP-13129. fix typo in dynamic subcommand docs
HADOOP-13151. Underscores should be escaped in dynamic subcommands document
HADOOP-13153. fix typo in debug statement for dynamic subcommands
2016-05-16 17:54:45 -07:00
Jing Zhao
a9a8297cad
HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze.
2016-05-16 15:23:36 -07:00
Sangjin Lee
1f2794b4fa
HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale)
2016-05-13 10:01:46 -07:00
Andrew Wang
3bfd29949f
HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu.
2016-05-12 23:48:37 -07:00
Andrew Wang
3c5c57af28
HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.
2016-05-12 18:27:28 -07:00
Andrew Wang
ca5613af91
Revert "Update project version to 3.0.0-alpha1-SNAPSHOT."
...
This reverts commit 6b53802cba
.
2016-05-12 15:32:45 -07:00
Allen Wittenauer
0f3d6bc65e
HADOOP-12581. ShellBasedIdMapping needs suport for Solaris (Alan Burlison via aw)
2016-05-12 14:42:04 -07:00
Steve Loughran
27c4e90efc
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel
...
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
2016-05-12 19:24:20 +01:00
Andrew Wang
6b53802cba
Update project version to 3.0.0-alpha1-SNAPSHOT.
2016-05-12 11:05:05 -07:00
Sangjin Lee
0bbe01f8d5
YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)
2016-05-12 10:11:23 -07:00
Steve Loughran
def2a6d385
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel.
2016-05-12 13:57:35 +01:00
Colin Patrick Mccabe
687233f20d
HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe)
2016-05-11 13:45:39 -07:00
Larry McCay
acb509b2fa
HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay)
2016-05-11 14:30:07 -04:00
Chris Nauroth
dee279b532
HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay.
2016-05-11 10:58:32 -07:00
Steve Loughran
3553261400
HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel)
2016-05-11 14:21:08 +01:00
Tsuyoshi Ozawa
6e56578031
HADOOP-10694. Remove synchronized input streams from Writable deserialization. Contributed by Gopal V and Rajesh Balamohan.
2016-05-10 17:27:10 -07:00
Zhe Zhang
307db61aac
HDFS-10172. hdfs erasurecode command should remove the redundant -usage option. Contributed by Yuanbo Liu.
2016-05-10 15:20:17 -07:00
Eric Payne
6b1c1cb01c
YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts.
2016-05-10 21:28:02 +00:00
Steve Loughran
025219b12f
HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel)
2016-05-10 21:37:22 +01:00
Steve Loughran
829a2e4d27
HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel).
2016-05-10 21:32:57 +01:00
Akira Ajisaka
0f0c6415af
HADOOP-13118. Fix IOUtils#cleanup and IOUtils#closeStream javadoc. Contributed by Wei-Chiu Chuang.
2016-05-10 10:02:46 -07:00
Andrew Wang
8ef75a702e
HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge.
2016-05-06 17:23:11 -07:00
Allen Wittenauer
1c5bbf6499
HADOOP-12866. add a subcommand for gridmix (Kai Sasaki via aw)
2016-05-06 14:07:02 -07:00
Xiaoyu Yao
dacd1f50fe
HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang.
2016-05-05 18:08:47 -07:00
Xiaoyu Yao
4e5e87ddd4
HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao)
2016-05-05 17:56:58 -07:00
Tsz-Wo Nicholas Sze
f305d9c0f6
HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException
2016-05-05 15:53:02 -07:00
Allen Wittenauer
35cf503149
HADOOP-13077. Handle special characters in passwords in httpfs.sh (Xiao Chen via aw)
2016-05-05 11:33:06 -07:00
Ming Ma
1268cf5fbe
HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma)
2016-05-04 17:02:26 -07:00
Arpit Agarwal
f343d91ecc
HADOOP-13068. Clean up RunJar and related test class. (Contributed by Andras Bokor)
2016-05-04 09:49:33 -07:00
Akira Ajisaka
36972d61d1
HADOOP-12504. Remove metrics v1. (aajisaka)
2016-05-04 22:52:23 +09:00
Masatake Iwasaki
355325bcc7
HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang.
2016-05-04 15:12:51 +09:00
Chris Douglas
c1cc6ac667
HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri
2016-05-02 22:36:58 -07:00
Tsz-Wo Nicholas Sze
1b9f18623a
HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou
2016-05-02 11:16:30 -07:00
Colin Patrick Mccabe
2beedead72
HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe)
2016-05-02 08:58:32 -07:00
Allen Wittenauer
971af603ea
HADOOP-13045. hadoop_add_classpath is not working in .hadooprc
2016-04-30 12:23:51 -07:00
Ravi Prakash
2753185a01
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
2016-04-29 22:32:27 -07:00
Robert Kanter
9d4d30243b
Remove parent's env vars from child processes
2016-04-29 09:25:51 -07:00
Lei Xu
0a152103f1
HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
2016-04-27 14:22:51 -07:00
Arpit Agarwal
3337ef2bfe
HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor)
2016-04-27 10:06:54 -07:00
Jian He
4beff01354
YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode
2016-04-26 21:00:17 -07:00
Arpit Agarwal
ea5475d1c1
HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu)
2016-04-26 20:46:38 -07:00
Masatake Iwasaki
68b4564e78
HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang.
2016-04-27 10:45:36 +09:00
Tsz-Wo Nicholas Sze
fc94810d3f
HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou
2016-04-26 17:10:13 -07:00
Zhe Zhang
5865fe2bf0
HDFS-9869. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]. Contributed by Rakesh R.
2016-04-25 22:01:54 -07:00
Masatake Iwasaki
bec5b4cd8c
HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims)
2016-04-25 22:41:50 +09:00
Jing Zhao
63e5412f1a
HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.
2016-04-22 15:14:40 -07:00
Akira Ajisaka
c610031cab
HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor.
2016-04-23 06:19:57 +09:00
Kihwal Lee
9dbdc8e12d
HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp.
2016-04-22 15:02:46 -05:00
Ravi Prakash
d6402faded
Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano"
...
This reverts commit 4838b735f0
.
2016-04-22 10:17:20 -07:00
Steve Loughran
19f0f9608e
HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel)
2016-04-22 11:25:03 +01:00
Larry McCay
337bcde1dc
HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers
2016-04-21 20:17:33 -07:00
Jing Zhao
4a043b3fec
HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou.
2016-04-21 20:17:27 -07:00
Ravi Prakash
4838b735f0
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
2016-04-21 11:32:39 -07:00
Xiaoyu Yao
b4be288c5d
HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.
2016-04-21 10:18:48 -07:00
Xiaoyu Yao
5bd7b592e5
HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
2016-04-20 23:10:52 -07:00
Kai Zheng
b5d4c7dc76
HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li.
2016-04-20 15:47:01 +08:00
Akira Ajisaka
6e6b6dd5aa
HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi.
2016-04-15 14:14:36 +09:00
Andrew Wang
a74580a4d3
HADOOP-12811. Change kms server port number which conflicts with HMaster port number. Contributed by Xiao Chen.
2016-04-14 11:36:12 -07:00
Steve Loughran
df18b6e984
HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel)
2016-04-14 12:44:55 +01:00
Steve Loughran
40211d1f0a
HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel)
2016-04-14 10:35:31 +01:00
Akira Ajisaka
27b131e79c
HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor.
2016-04-14 10:55:51 +09:00
Xiaoyu Yao
8ced42daff
HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao.
2016-04-13 15:34:17 -07:00
Colin Patrick Mccabe
35f0770555
HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
2016-04-12 16:28:42 -07:00
Robert Kanter
042a3ae960
HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter)
2016-04-12 14:40:43 -07:00
Akira Ajisaka
209303be3a
HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang.
2016-04-12 15:26:50 +09:00
Akira Ajisaka
a409508b3f
HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran.
2016-04-12 14:55:01 +09:00
Vinod Kumar Vavilapalli
069c6c62de
HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba.
2016-04-11 12:02:06 -07:00
Chris Nauroth
843ee8d59d
HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
2016-04-08 13:36:58 -07:00
Steve Loughran
6791221572
HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel)
2016-04-08 12:59:19 +01:00
Tsz-Wo Nicholas Sze
a62637a413
HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou
2016-04-07 14:02:51 +08:00
Vinayakumar B
8d29e2451f
HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B
...
This closes #89
2016-04-07 10:15:24 +05:30
Jian He
93bacda08b
YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev
2016-04-06 16:13:47 -07:00
Masatake Iwasaki
85ec5573eb
HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
2016-04-06 03:22:48 +09:00
Kihwal Lee
917464505c
HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla.
2016-04-05 09:07:24 -05:00
Arpit Agarwal
7280550a8f
HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran)
2016-04-04 10:50:11 -07:00
Akira Ajisaka
da614ca5dc
HADOOP-12967. Remove FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
2016-04-04 17:48:08 +09:00
Steve Loughran
0ecdd4cffa
HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse.
2016-04-03 16:40:19 +01:00
Akira Ajisaka
a8d8b80a20
HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula.
2016-04-01 13:59:14 +09:00
Xiaoyu Yao
aac4d65bf9
HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao.
2016-03-31 15:22:24 -07:00
Colin Patrick Mccabe
19639785f5
HADOOP-12955. Fix bugs in the initialization of the ISA-L library JNI bindings (Kai Zheng via cmccabe)
2016-03-31 15:09:11 -07:00
Jian He
0dd9bcab97
YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage
2016-03-31 14:28:13 -07:00
Xiaoyu Yao
d95c6eb32c
HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao.
2016-03-31 08:42:57 -07:00
Allen Wittenauer
0a74610d1c
HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw)
2016-03-31 07:51:05 -07:00
Zhe ZHang
e4fc609d5d
HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang.
2016-03-30 14:13:11 -07:00
Colin Patrick Mccabe
e3d15a2e23
DOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe)
2016-03-29 17:13:52 -07:00
Arpit Agarwal
46a5245db9
HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S)
2016-03-29 12:08:46 -07:00
Andrew Wang
8bfaa80037
HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge.
2016-03-28 14:13:48 -07:00
Robert Kanter
8cac1bb09f
HADOOP-12954. Add a way to change hadoop.security.token.service.use_ip (rkanter)
2016-03-28 10:36:59 -07:00
Junping Du
90fcb16c0f
MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang.
2016-03-28 05:30:42 -07:00
Akira Ajisaka
01cfee6381
HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula.
2016-03-28 15:57:57 +09:00
Jason Lowe
9a09200a1f
HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee
2016-03-25 22:58:04 +00:00
Andrew Wang
938222b2e2
HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang.
2016-03-23 14:57:14 -07:00
Allen Wittenauer
738155063e
HADOOP-12857. rework hadoop-tools (aw)
2016-03-23 13:46:38 -07:00
Andrew Wang
e3bb38d625
HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
2016-03-21 11:39:05 -07:00
Haohui Mai
ed1e23fe8f
HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.
2016-03-20 17:40:59 -07:00
Sangjin Lee
cd8b6889a7
HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee)
2016-03-19 14:02:04 -07:00
Chris Nauroth
33239c9925
HADOOP-12926. lz4.c does not detect 64-bit mode properly. Contributed by Alan Burlison.
2016-03-18 16:33:01 -07:00
Steve Loughran
605fdcbb81
YARN-4593 Deadlock in AbstractService.getConfig() (stevel)
2016-03-16 14:35:24 +00:00
Steve Loughran
5a725f0ab8
HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel)
2016-03-16 14:31:19 +00:00
Zhe Zhang
19e8f07691
HADOOP-12826. Rename the new Java coder and make it default. Contributed by Rui Li.
2016-03-14 16:45:32 -07:00
Tsz-Wo Nicholas Sze
1898810cda
HADOOP-12923. Move the test code in ipc.Client to test.
2016-03-14 15:48:01 -07:00
Colin Patrick Mccabe
658ee95ff3
HADOOP-11996. Improve and restructure native ISAL support (Kai Zheng via cmccabe)
2016-03-11 12:57:54 -08:00
Colin Patrick Mccabe
6e9a582eb1
HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe)
2016-03-11 12:26:40 -08:00
Steve Loughran
754299695b
Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)"
...
This reverts commit 682adc6ba9
.
2016-03-11 17:00:17 +00:00
Masatake Iwasaki
682adc6ba9
HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)
2016-03-11 15:03:40 +09:00
Harsh J
318c9b68b0
HADOOP-11404. Clarify the "expected client Kerberos principal is null" authorization message. Contributed by Stephen Chu
2016-03-10 17:05:09 +05:30
Arpit Agarwal
2e040d31c7
HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal)
2016-03-08 23:29:43 -08:00
Akira Ajisaka
87c8005ad3
HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak.
2016-03-09 15:35:51 +09:00
Chris Nauroth
89b16d27e2
HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth.
2016-03-08 21:22:06 -08:00
Allen Wittenauer
55f73a1cbd
HADOOP-12798. Update changelog and release notes (2016-03-04) (aw)
2016-03-08 16:48:38 -08:00
Andrew Wang
a3cc6e2511
HADOOP-12895. SSLFactory#createSSLSocketFactory exception message is wrong. Contributed by Wei-Chiu Chuang.
2016-03-08 13:51:48 -08:00
Akira Ajisaka
f86850b544
HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.
2016-03-08 14:28:47 +09:00
Arpit Agarwal
c2140d05ef
HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu)
2016-03-07 21:10:24 -08:00
Ming Ma
49eedc7ff0
HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma)
2016-03-07 20:26:19 -08:00
Andrew Wang
391da36d93
HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang)
2016-03-07 14:00:02 -08:00
Chris Nauroth
2759689d7d
HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
2016-03-04 15:29:50 -08:00
Masatake Iwasaki
cbd31328a6
HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
2016-03-04 14:11:36 +09:00
Andrew Wang
1bc454615e
HADOOP-11792. Remove all of the CHANGES.txt files.
2016-03-03 21:02:31 -08:00
Akira Ajisaka
0a9f00af5e
HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula.
2016-03-03 23:32:30 +09:00
Akira Ajisaka
1c3136cbd8
HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula.
2016-03-03 23:22:35 +09:00
Akira Ajisaka
eb864d35d6
HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge.
2016-03-03 18:46:48 +09:00
Masatake Iwasaki
f70e317ccc
HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims)
2016-03-03 17:14:32 +09:00
Arpit Agarwal
27941a1811
HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou)
2016-03-02 18:35:28 -08:00
Colin Patrick Mccabe
700b0e4019
HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
2016-03-02 17:56:11 -08:00
Andrew Wang
480302b4ba
HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng.
2016-03-02 09:40:30 -08:00
Chris Nauroth
f98dff329b
HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
2016-03-01 13:18:42 -08:00
Akira Ajisaka
44d9bac1f5
Add HADOOP-12843 to 2.8.0 in CHANGES.txt.
2016-03-02 00:24:38 +09:00
Chris Nauroth
d251e55415
HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
2016-02-29 21:59:52 -08:00
Uma Maheswara Rao G
307ec80aca
HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng
2016-02-29 21:52:20 -08:00
Karthik Kambatla
680f3fc02d
HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha)
2016-02-29 18:59:59 -08:00
Jian He
d8f390d015
HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du
2016-02-29 16:24:05 -08:00
Haohui Mai
0fa54d45b1
HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.
2016-02-29 11:41:00 -08:00
Masatake Iwasaki
809ebc0b14
HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
2016-02-29 18:20:14 +09:00
Akira Ajisaka
e3ac231f72
Move HADOOP-9121 from 3.0.0 to 2.7.3 in CHANGES.txt.
2016-02-29 11:40:18 +09:00
Chris Nauroth
7634d404b7
HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
2016-02-28 11:22:55 -08:00
Li Lu
7545ce6636
HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9)
2016-02-27 21:59:03 -08:00
Steve Loughran
03cfb454fe
HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel)
2016-02-27 20:23:51 +00:00
Chris Nauroth
798babf661
HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu.
2016-02-26 21:59:08 -08:00
Lei Xu
2093acf6b6
HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei)
2016-02-26 10:47:49 -08:00
Akira Ajisaka
f0de733ca0
Moved HADOOP-8818 from 3.0.0 to 2.7.3 in CHANGES.txt.
2016-02-27 01:30:20 +09:00
Karthik Kambatla
c2460dad64
HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha)
2016-02-25 16:31:09 -08:00
Xiaoyu Yao
b2951f9fbc
HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri.
2016-02-25 15:47:05 -08:00
Zhe Zhang
ccff6035f5
HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
...
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
2016-02-25 09:24:32 -08:00
Zhe Zhang
efdc0070d8
HADOOP-12808. Rename the RS coder from HDFS-RAID as legacy. Contributed by Rui Li.
...
Change-Id: Icb64eb60833fe0139aadb6da9aa666f664defc0e
2016-02-24 14:29:03 -08:00
cnauroth
d6b181c6fa
HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao.
2016-02-24 13:55:39 -08:00
Arpit Agarwal
2e76c2f751
HADOOP-12070. Some of the bin/hadoop subcommands are not available on Windows. (Contributed by Kengo Seki)
2016-02-24 12:45:34 -08:00
cnauroth
3369a4f691
HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
2016-02-23 21:37:50 -08:00
Colin Patrick Mccabe
d9c409a428
HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe)
2016-02-23 11:11:22 -08:00
cnauroth
27b77751c1
HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
2016-02-22 17:30:13 -08:00
Zhe Zhang
a2fdfff02d
HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
...
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
2016-02-22 14:13:54 -08:00
cnauroth
d4f5fc23b2
HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
2016-02-22 13:39:38 -08:00
Junping Du
18f9b77a32
Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala.
2016-02-19 14:21:25 -08:00
Yongjun Zhang
a963baba10
HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang)
2016-02-19 09:41:22 -08:00
cnauroth
8ab7658025
HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
2016-02-18 14:06:38 -08:00
Akira Ajisaka
c7ac25e52c
HDFS-9830. Remove references to hftp in ViewFs documentation in trunk. Contributed by Wei-Chiu Chuang.
2016-02-19 05:02:57 +09:00
Tsz-Wo Nicholas Sze
bbfaf3c271
HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases.
2016-02-18 11:47:33 -08:00
Robert Kanter
a365a3941c
HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter)
2016-02-18 11:09:50 -08:00
cnauroth
5d1889a66d
HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
2016-02-18 10:07:28 -08:00
Zhe Zhang
0fb14aaced
HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz)
...
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
2016-02-17 13:30:50 -08:00
cnauroth
76fab26c5c
HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
2016-02-17 12:19:59 -08:00
Xiaoyu Yao
fd1befb6ba
HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao.
2016-02-17 08:27:27 -08:00
Masatake Iwasaki
1a1c2f5bab
HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs (Wei-Chiu Chuang via iwasakims)
2016-02-18 00:13:11 +09:00
Vinayakumar B
96ea309431
HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue)
2016-02-17 10:13:41 +05:30
Vinayakumar B
4b0e59fdc0
HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu)
2016-02-16 17:32:03 +05:30
Akira Ajisaka
1c48e50ce7
HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen.
2016-02-15 11:38:25 +09:00
Junping Du
ec12ce8f48
Set the release date for 2.6.4.
2016-02-13 01:42:50 -08:00
Masatake Iwasaki
36ba5cac37
HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims)
2016-02-13 14:59:38 +09:00
cnauroth
91a96eaa53
HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
2016-02-12 15:50:10 -08:00
Arpit Agarwal
1de1641f17
HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal)
2016-02-12 12:41:04 -08:00
Vinayakumar B
c78740a979
HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula)
2016-02-12 11:53:28 +05:30
Karthik Kambatla
33ce7f6c07
HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha)
2016-02-11 20:37:14 -08:00
Andrew Wang
8fdef0bd9d
HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen.
2016-02-11 17:20:10 -08:00
cnauroth
70c756d35e
HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth.
2016-02-11 16:52:58 -08:00
Uma Maheswara Rao G
df4dcd3e75
HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang.
2016-02-10 14:54:45 -08:00
Jason Lowe
6f03959e4d
HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger
2016-02-10 21:53:08 +00:00
Zhe Zhang
4ef1324ff6
HADOOP-12764. Increase default value of KMX maxHttpHeaderSize and make it configurable.
...
Change-Id: I6e970563c201152e1428feafb8124e61c15a6fc0
2016-02-10 09:56:40 -08:00
Sangjin Lee
58acbf940a
HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee)
2016-02-08 13:55:30 -08:00
cnauroth
cf3261570a
HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
2016-02-08 09:36:09 -08:00
Varun Vasudev
d37eb828ff
HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
2016-02-08 20:19:17 +05:30
Varun Vasudev
af218101e5
Revert "HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana."
...
This reverts commit f3bbe0bd02
.
2016-02-08 20:16:44 +05:30
Varun Vasudev
f3bbe0bd02
HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana.
2016-02-08 14:22:18 +05:30
Andrew Wang
5b59a0ea85
HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. Contributed by Daniel Templeton.
2016-02-06 20:52:35 -08:00
Steve Loughran
1495ff979a
HADOOP-12292. Make use of DeleteObjects optional -move CHANGES.TXT reference
2016-02-06 18:20:12 +00:00
Steve Loughran
29ae258013
HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel)
2016-02-06 15:05:16 +00:00
cnauroth
cfa8513890
HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
2016-02-05 15:47:51 -08:00
cnauroth
a37e423e84
HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
2016-02-05 14:38:21 -08:00
Kihwal Lee
49e176c29f
HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
2016-02-05 15:47:14 -06:00
Colin Patrick Mccabe
9086dd58c3
HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
2016-02-05 10:56:54 -08:00
Xiaoyu Yao
5d00067ca7
HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
2016-02-05 10:37:07 -08:00
Xuan
63c63e298c
YARN-4662. Document some newly added metrics. Contributed by Jian He
2016-02-03 20:05:22 -08:00
zhezhang
c89a14a8a4
HADOOP-12041. Implement another Reed-Solomon coder in pure Java. Contributed by Kai Zheng.
...
Change-Id: I35ff2e498d4f988c9a064f74374f7c7258b7a6b7
2016-02-03 15:05:02 -08:00
Sangjin Lee
4dc0a39493
HADOOP-12761. incremental maven build is not really incremental (sjlee)
2016-02-03 08:58:49 -08:00
Junping Du
414cf07650
Adding release 2.6.5 to CHANGES.txt
2016-02-02 18:06:10 -08:00
zhezhang
6d1213860f
HDFS-9403. Erasure coding: some EC tests are missing timeout. Contributed by Gao Rui.
...
Change-Id: I13c4bc0e566c4f8af5371d26f8e18a749ed41d8b
2016-02-02 14:03:45 -08:00
Andrew Wang
8171874dd1
HADOOP-12755. Fix typo in defaultFS warning message.
2016-02-02 11:56:37 -08:00
Akira Ajisaka
700a176fa7
HADOOP-12757. Findbug compilation fails for 'Kafka Library support'. (aajisaka)
2016-02-02 23:15:39 +09:00
Karthik Kambatla
ee005e010c
HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha)
2016-01-28 17:43:17 -08:00
Colin Patrick Mccabe
2e8ab3d465
HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
2016-01-27 11:39:55 -08:00
Allen Wittenauer
79d7949fbb
HADOOP-12492. maven install triggers bats test (aw)
2016-01-27 11:27:27 -08:00
Yongjun Zhang
97056c3355
HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
2016-01-27 08:04:25 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
ec4d2d9f40
Release process for 2.7.2: Set the release date for 2.7.2
2016-01-25 15:45:57 -08:00
Walter Su
6eacdea0e4
HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.
2016-01-25 19:30:04 +08:00
Akira Ajisaka
643227927a
HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
2016-01-25 13:59:25 +09:00
Akira Ajisaka
736eb17a79
HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
2016-01-25 13:47:29 +09:00
Allen Wittenauer
d22c4239a4
HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw)
2016-01-22 12:15:22 -08:00
Kihwal Lee
2fd19b9674
HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma.
2016-01-22 09:10:06 -06:00
Akira Ajisaka
0bae506c22
HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
2016-01-22 21:08:31 +09:00
Xiaoyu Yao
f3427d3766
HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu.
2016-01-21 13:51:58 -08:00
Allen Wittenauer
8cecad2d56
HADOOP-12651. Replace dev-support with wrappers to Yetus (aw)
2016-01-21 12:22:03 -08:00
Zhe Zhang
1bb31fb22e
HADOOP-11828. Implement the Hitchhiker erasure coding algorithm. Contributed by Jack Liu Quan.
...
Change-Id: If43475ccc2574df60949c947af562722db076251
2016-01-21 10:30:05 -08:00
Akira Ajisaka
2ac39ca762
HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey.
2016-01-22 02:45:22 +09:00
Vinayakumar B
446987e20a
HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal)
2016-01-21 20:08:24 +05:30
Masatake Iwasaki
9eec6cbedc
HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims)
2016-01-20 05:00:02 +09:00
Lei Xu
2ec438e8f7
HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
2016-01-20 14:26:11 -08:00
Ravi Prakash
1acc509b45
HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
2016-01-19 13:57:08 -08:00
Wangda Tan
89d1fd5dac
HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
2016-01-19 21:27:38 +08:00
Akira Ajisaka
92c5f565fd
HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
2016-01-19 13:31:26 +09:00
cnauroth
8bc93db2e7
HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
2016-01-18 09:08:58 -08:00
cnauroth
da77f423d1
HADOOP-12691. Move files to correct location.
2016-01-16 07:47:43 -08:00
Colin Patrick Mccabe
2a30386539
HADOOP-12662. The build should fail if a -Dbundle option fails (Kai Zheng via cmccabe)
2016-01-15 14:05:21 -08:00
Colin Patrick Mccabe
5af5f9575a
HADOOP-12714. Fix hadoop-mapreduce-client-nativetask unit test which fails because it is not able to open the "glibc bug spill" file. (cmccabe)
2016-01-15 13:53:05 -08:00
Colin Patrick Mccabe
b2c155f810
HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
2016-01-15 12:29:18 -08:00
Andrew Wang
5d5a22a878
HADOOP-12713. Disable spurious checkstyle checks.
2016-01-15 11:58:56 -08:00
Akira Ajisaka
1da762c745
Move HADOOP-12590 from 2.9.0 to 2.8.0 in CHANGES.txt.
2016-01-15 10:48:18 +09:00
Jason Lowe
cdf8895259
HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe
2016-01-14 23:45:03 +00:00
Jason Lowe
651c23e8ef
Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6
2016-01-14 23:41:14 +00:00
cnauroth
06f4ac0ccd
HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay.
2016-01-14 11:56:00 -08:00
Colin Patrick Mccabe
b1ed28fa77
HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)
2016-01-14 11:02:34 -08:00
Akira Ajisaka
ff8758377c
HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
2016-01-15 00:32:47 +09:00
Colin Patrick Mccabe
8315582c4f
HDFS-9517. Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes (Wei-Chiu Chuang via cmccabe)
2016-01-13 16:28:06 -08:00
Karthik Kambatla
fb64e6051a
HADOOP-12683. Add number of samples in last interval in snapshot of MutableStat. (Vikram Srivastava via kasha)
2016-01-13 15:43:47 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
cb73c753da
HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
...
Moved entry from HDFS CHANGES.txt to that of common.
2016-01-13 14:55:06 -08:00
cnauroth
fbb5868deb
HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang.
2016-01-12 15:57:32 -08:00
Lei Xu
126705f67e
HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei)
2016-01-12 12:19:53 -08:00
Colin Patrick Mccabe
30c7dfd8ba
HADOOP-12653. Use SO_REUSEADDR to avoid getting "Address already in use" when using kerberos and attempting to bind to any port on the local IP address (cmccabe)
2016-01-12 10:46:22 -08:00
Akira Ajisaka
56b9500bbd
HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
2016-01-12 13:34:18 +09:00
cnauroth
0e76f1fcea
HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
2016-01-09 22:18:11 -08:00
Benoy Antony
dec8dfdfa6
HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony)
2016-01-09 13:41:18 -08:00
Steve Loughran
d7ed04758c
HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel)
2016-01-09 11:15:07 +00:00
Steve Loughran
84bf5122e4
HADOOP-12573. TestRPC.testClientBackOff failing. (Xiao Chen via stevel)
2016-01-09 11:14:47 +00:00
cnauroth
f0fa6d869b
HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
2016-01-08 20:18:59 -08:00
rohithsharmaks
ed18527e38
Revert "HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)"
...
This reverts commit 2b252844e0
.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-08 14:30:28 +05:30
Steve Loughran
bac798abfc
HADOOP-12597. In kms-site.xml configuration "hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with new name. (Surendra Singh Lilhore via stevel)
2016-01-07 16:00:54 +00:00
Steve Loughran
172d07825c
HADOOP-12613. TestFind.processArguments occasionally fails. (Wei-Chiu Chuang via stevel)
2016-01-07 15:04:12 +00:00
Steve Loughran
7914f569ef
HADOOP-12655. TestHttpServer.testBindAddress patch - move from improvement to bug fix
2016-01-07 15:04:11 +00:00
Steve Loughran
3190534814
HADOOP-12655. TestHttpServer.testBindAddress bind port range is wider than expected. (Wei-Chiu Chuang via stevel)
2016-01-07 14:51:53 +00:00
Steve Loughran
3fcdbe076f
HADOOP-12663. Remove Hard-Coded Values From FileSystem.java. (BELUGA BEHR via stevel)
2016-01-07 14:45:34 +00:00
Steve Loughran
21bededd2f
HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel)
2016-01-07 14:40:09 +00:00
rohithsharmaks
2b252844e0
HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)
2016-01-07 10:42:48 +05:30
cnauroth
978bbdfeb2
HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
2016-01-06 11:15:59 -08:00
Ravi Prakash
2d16f40dab
HADOOP-12689. S3 filesystem operations stopped working correctly
2016-01-05 23:26:03 -08:00
Zhe Zhang
c52b407cbf
HADOOP-12685. Input buffer position after encode/decode not consistent between different kinds of buffers. Contributed by Rui Li.
...
Change-Id: I713c7b4e3cfae70c04b7e4b292ab53eae348d8d9
2016-01-05 16:32:18 -08:00
Yongjun Zhang
28bd138018
HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang)
2016-01-05 11:09:05 -08:00
Uma Mahesh
778146eaae
HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng
2016-01-04 14:32:09 -08:00
Akira Ajisaka
1af2917856
HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi.
2016-01-04 20:33:17 +09:00
Akira Ajisaka
db99e30f67
Set release date for 2.6.3
2016-01-04 16:12:12 +09:00
Akira Ajisaka
64ae85fd2e
HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki.
2016-01-04 14:31:22 +09:00
Xiaoyu Yao
ab725cff66
HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang.
2015-12-30 10:29:26 -08:00
Xiaoyu Yao
993311e547
HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang.
2015-12-28 10:41:26 -08:00
Akira Ajisaka
a0249da8a7
Add HADOOP-12681 to 2.8.0 in CHANGES.txt.
2015-12-28 14:41:42 +09:00
Karthik Kambatla
8b1837fcd1
HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha)
2015-12-23 14:34:53 -08:00
Akira Ajisaka
fa544020f6
HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki.
2015-12-21 21:23:03 +09:00
Chris Douglas
8652cce5b2
HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri
2015-12-18 18:30:18 -08:00
cnauroth
932956458d
HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal.
2015-12-18 16:24:53 -08:00
Arpit Agarwal
8fb70a031b
HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang)
2015-12-18 16:08:26 -08:00
Zhe Zhang
ef3f3f6bb1
HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang.
...
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
2015-12-18 16:04:47 -08:00
Colin Patrick Mccabe
f349d0a76c
HADOOP-12647. Add /usr/lib default for ISAL library and fix missing .c file in CMakeLists (Kai Zheng via cmccabe)
2015-12-18 09:27:26 -08:00
Akira Ajisaka
061c05cc05
HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru.
2015-12-18 13:58:28 +09:00
Akira Ajisaka
bd5e207432
HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki.
2015-12-18 13:12:33 +09:00
Zhe Zhang
f5756a2038
HADOOP-12615. Fix NPE in MiniKMS.start(). Contributed by Wei-Chiu Chuang.
...
Change-Id: Ie3e148bd1401618b1737a577957298bf622891f4
2015-12-17 13:24:29 -08:00
Vinod Kumar Vavilapalli
ce16541c62
HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos)
...
Addendum commit to include CHANGES.txt entry.
2015-12-16 14:40:21 -08:00
Allen Wittenauer
607473e1d0
HADOOP-12192. update releasedocmaker command line (aw)
2015-12-16 06:23:58 -08:00
Uma Mahesh
ae67c8424c
HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh)
2015-12-15 15:13:37 -08:00
Colin Patrick Mccabe
bc72422981
HADOOP-12638. UnsatisfiedLinkError while checking ISA-L in checknative command. (Kai Sasaki via Colin P. McCabe)
2015-12-14 13:12:50 -08:00
Allen Wittenauer
576b569b6c
Revert "HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw)"
...
This reverts commit 832b3cbde1
.
2015-12-11 10:59:42 -08:00
Akira Ajisaka
eee0cf4611
HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki.
2015-12-11 16:18:30 +09:00
Robert Kanter
e27fffdb90
HADOOP-12625. Add a config to disable the /logs endpoints (rkanter)
2015-12-09 14:32:20 -08:00
Uma Mahesh
ad53c52063
HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh)
2015-12-08 22:39:17 -08:00
mattf
ada9c2c410
HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf)
2015-12-08 17:27:50 -08:00
Haohui Mai
c4084d9bc3
HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du.
2015-12-09 05:41:44 +08:00
Allen Wittenauer
832b3cbde1
HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw)
2015-12-08 12:56:38 -08:00
Steve Loughran
65f395226b
HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]
2015-12-06 17:43:35 +00:00
Xiaoyu Yao
cbc7b6bf97
HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao.
2015-12-04 10:39:45 -08:00
Jian He
755dda8dd8
YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
2015-12-03 17:45:31 -08:00
Akira Ajisaka
3857fed2c8
HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu.
2015-12-03 11:50:31 +08:00
Arpit Agarwal
485c3468a8
HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki)
2015-12-01 09:27:23 -08:00
Junping Du
028894281b
Creating 2.6.4 entries in CHANGES.txt files.
2015-12-01 08:16:39 -08:00
cnauroth
c37c3f41b3
Revert "HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw)"
...
This reverts commit 6725e7f1be
.
2015-11-28 17:21:11 -08:00
cnauroth
2577e5b2c1
Revert "HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw)"
...
This reverts commit 4c8125d60d
.
2015-11-28 17:20:49 -08:00
cnauroth
b2c78536cb
HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth.
2015-11-28 15:40:07 -08:00
Allen Wittenauer
4c8125d60d
HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw)
2015-11-27 21:06:28 -08:00
Allen Wittenauer
6725e7f1be
HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw)
2015-11-27 18:25:45 -08:00
Yongjun Zhang
0348e769ab
HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang)
2015-11-25 18:37:52 -08:00
Vinod Kumar Vavilapalli
d57fd181c7
Adding release 2.8.0 to CHANGES.txt
2015-11-25 17:33:26 -08:00
Robert Kanter
7fd00b3db4
MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter)
2015-11-25 17:03:38 -08:00
Haohui Mai
b21dffb1fe
HDFS-9451. Clean up depreated umasks and related unit tests. Contributed by Wei-Chiu Chuang.
2015-11-25 12:47:24 -08:00
Akira Ajisaka
bab03f3ee6
HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang.
2015-11-26 01:21:20 +09:00
Xiaoyu Yao
fe5624b85d
HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
2015-11-24 12:47:57 -08:00
Allen Wittenauer
e8a87d739f
HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux (Alan Burlison via aw)
2015-11-24 12:45:08 -08:00
Haohui Mai
db4cab21f4
HDFS-5165. Remove the TotalFiles metrics. Contributed by Akira AJISAKA.
2015-11-24 11:41:57 -08:00
Jason Lowe
17b1a5482b
Revert "HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula."
...
This reverts commit 4356e8a5ef
.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSourceAdapter.java
2015-11-24 19:12:04 +00:00
cnauroth
0e1c12c174
HADOOP-12294. Correct CHANGES.txt description.
2015-11-24 10:51:56 -08:00
Jian He
8676a118a1
YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan
2015-11-23 17:19:48 -08:00
Haohui Mai
4bff073b4d
Revert "HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling."
...
This reverts commit 4c061e607e
.
2015-11-23 15:00:56 -08:00
Haohui Mai
5f269a0ad8
HADOOP-9822. create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor. Contributed by Tsuyoshi Ozawa.
2015-11-23 13:22:20 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
70c26703f4
HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang.
2015-11-23 09:59:50 -08:00
Haohui Mai
817ae221ac
HADOOP-12313. NPE in JvmPauseMonitor when calling stop() before start(). Contributed by Gabor Liptak.
2015-11-22 23:07:43 -08:00
Haohui Mai
8228697857
HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka.
2015-11-22 23:02:50 -08:00
Haohui Mai
611aa77f75
HADOOP-11677. Add cookie flags for logs and static contexts. Contributed by nijel.
2015-11-22 19:52:13 -08:00
Tsuyoshi Ozawa
053a511919
HADOOP-11149. TestZKFailoverController times out. Contributed by Steve Loughran. closes apache/hadoop#51
2015-11-23 12:44:50 +09:00
Haohui Mai
c3ba44d858
HADOOP-10068. Improve log4j regex in testFindContainingJar. Contributed by Robert Rati.
2015-11-22 18:29:03 -08:00
Haohui Mai
dc46c46b91
HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux.
2015-11-22 18:10:08 -08:00
Haohui Mai
aac260faa1
HADOOP-10555. Add offset support to MurmurHash. Contributed by Sergey Shelukhin.
2015-11-22 18:00:29 -08:00
Haohui Mai
077fa529e1
HADOOP-10035. Cleanup TestFilterFileSystem. Contributed by Suresh Srinivas.
2015-11-22 17:30:08 -08:00
Haohui Mai
0d27917042
HADOOP-12098. Remove redundant test dependencies in Hadoop Archives. Contributed by Varun Saxena.
2015-11-22 17:25:22 -08:00
Haohui Mai
5f688453df
HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider. Contributed by Masatake Iwasaki.
2015-11-22 16:56:15 -08:00
Haohui Mai
4492b9e730
HADOOP-12294. Remove the support of the deprecated dfs.umask. Contributed by Chang Li.
2015-11-22 16:47:44 -08:00
Haohui Mai
f0cd903866
HADOOP-12467. Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts. Contributed by Radhey Shah.
2015-11-22 16:03:59 -08:00
Haohui Mai
66428d33a7
HADOOP-11218. Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory. Contributed by Vijay Singh.
2015-11-22 16:00:34 -08:00
Haohui Mai
4c061e607e
HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling.
2015-11-22 15:18:24 -08:00
Steve Loughran
a6f20d80de
Revert "HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter."
...
This reverts commit b7e3f419bdaa4d46ffb9829dd7873b5221cab077.
2015-11-22 11:41:13 +00:00
Haohui Mai
4539131102
HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
2015-11-19 15:47:31 -08:00
Haohui Mai
747455a13b
HADOOP-11901. BytesWritable fails to support 2G chunks due to integer overflow. Contributed by Reynold Xin.
2015-11-19 12:54:08 -08:00
Tsuyoshi Ozawa
25e82b4eb9
HADOOP-12575. Add build instruction for docker toolbox instead of boot2docker. Contributed by Kai Sasaki.
2015-11-19 17:44:10 +09:00
Tsuyoshi Ozawa
bd166f0eed
HADOOP-12582. Using BytesWritable's getLength() and getBytes() instead of get() and getSize(). Contributed by Akira AJISAKA.
2015-11-19 17:27:23 +09:00
Tsuyoshi Ozawa
989b9e3e11
HADOOP-12564. Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package. Contributed by Dustin Cote.
2015-11-19 01:38:18 +09:00
Tsuyoshi Ozawa
169921e8ab
Moved HADOOP-8419 in CHANGES.txt from 3.0.0 to 2.8.0.
2015-11-19 01:34:20 +09:00
Akira Ajisaka
4a3b8f1ed2
HADOOP-12568. Update core-default.xml to describe posixGroups support. Contributed by Wei-Chiu Chuang.
2015-11-18 17:23:00 +09:00
cnauroth
7fab5c8cec
HADOOP-12567. NPE in SaslRpcServer. Contributed by Sergey Shelukhin.
2015-11-17 15:59:57 -08:00
Akira Ajisaka
a7f776ffdf
MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun.
2015-11-17 15:16:47 +09:00
Tsuyoshi Ozawa
c753617a48
Move HADOOP-11361, HADOOP-12348 and HADOOP-12482 from 2.8.0 to 2.7.3 in CHANGES.txt for backporting.
2015-11-14 14:43:34 +09:00
Akira Ajisaka
47c79a2a4d
Move HADOOP-12374 from 2.8.0 to 2.7.3 in CHANGES.txt.
2015-11-14 13:14:54 +09:00
Akira Ajisaka
f94d892704
HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad.
2015-11-13 21:52:57 +09:00
Haohui Mai
0ca8df716a
HADOOP-12562. Make hadoop dockerfile usable by Yetus. Contributed by Allen Wittenauer.
2015-11-12 10:19:22 -08:00
Tsuyoshi Ozawa
d90769757a
Updated CHANGES.txt to move HADOOP-12526 to 2.6.3.
2015-11-11 23:20:49 +09:00
Colin Patrick Mccabe
493e8ae552
HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 (Mingliang Liu via Colin P. McCabe)
2015-11-10 10:54:52 -08:00
Lei Xu
0eb9c60c5b
HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei)
2015-11-09 23:01:30 -08:00
Haohui Mai
94a1833638
HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai.
2015-11-09 15:25:19 -08:00
Akira Ajisaka
3ae82863f0
HADOOP-12553. [JDK8] Fix javadoc error caused by illegal tag. (aajisaka)
2015-11-08 19:17:57 +09:00
Allen Wittenauer
b76b0ce51e
HADOOP-12366. expose calculated paths (aw)
2015-11-07 08:32:56 -08:00
Jason Lowe
74a9a51886
Update CHANGES.txt for commit of HADOOP 12413 to 2.7.3 and 2.6.3
2015-11-06 17:16:14 +00:00
Lei Xu
bff7c90a56
HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)
2015-11-05 18:35:15 -08:00
Colin Patrick Mccabe
21c0e3eda5
CHANGES.txt: move HADOOP-11887 to trunk
2015-11-05 11:12:24 -08:00
Colin Patrick Mccabe
482e35c55a
HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe)
2015-11-05 10:44:47 -08:00
cnauroth
0fb1867fd6
HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade.
2015-11-04 10:28:44 -08:00
Haohui Mai
88beb46cf6
Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou."
...
This reverts commit 84cbd72afd
.
2015-11-04 10:21:13 -08:00
Jason Lowe
b9d25c3ee2
HADOOP-12296. when setnetgrent returns 0 in linux, exception should be thrown. Contributed by Chang Li
2015-11-04 16:34:01 +00:00
Jason Lowe
0383a3973b
Add 2.7.3 release to CHANGES.txt
2015-11-04 16:26:14 +00:00
Varun Vasudev
73b9c7b82b
HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer.
2015-11-04 15:56:17 +05:30
Zhe Zhang
3e1745d8e8
HADOOP-12544. Erasure Coding: create dummy raw coder to isolate performance issues in testing. Contributed by Rui Li.
...
Change-Id: I9856456b59ed881c5ba2acce51e4d9bd01dc6f48
2015-11-03 22:26:27 -08:00
cnauroth
957f0311a1
HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. Contributed by Chris Nauroth.
2015-11-02 22:25:05 -08:00
Allen Wittenauer
6e0d353235
HADOOP-12541. make re2j dependency consistent (Matthew Paduano via aw)
2015-11-02 20:39:46 -08:00
cnauroth
9e7dcab185
HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade.
2015-11-02 10:21:39 -08:00
cnauroth
3ce0a6502e
HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth.
2015-11-02 10:17:41 -08:00
Walter Su
6e4f8a46c5
HADOOP-12047. Indicate preference not to affect input buffers during coding in erasure coder. (Contributed by Kai Zheng)
2015-11-02 10:40:14 +08:00
Arpit Agarwal
3cde6931cb
HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu)
2015-11-01 15:35:02 -08:00
Sangjin Lee
a4a6b5b4b4
Updated the 2.6.2 final release date.
2015-10-30 18:47:16 -07:00
Gábor Lipták
18727c63da
HADOOP-12133 Add schemas to Maven Assembly XMLs
...
Signed-off-by: Allen Wittenauer <aw@apache.org>
2015-10-30 11:36:52 -07:00
Jason Lowe
eadf7b3096
Creating 2.6.3 entries in CHANGES.txt files.
2015-10-30 14:50:50 +00:00
Zhe Zhang
8def51a708
HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore.
...
Change-Id: I985627a5d1400249d72d084283ef366d5ac6e07b
2015-10-29 11:23:08 -07:00
Jian He
c41699965e
YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du
2015-10-29 00:00:48 -07:00
Walter Su
5eca6dece6
HADOOP-12327. Initialize output buffers with ZERO bytes in erasure coder. Contributed by Kai Zheng.
2015-10-29 15:04:34 +08:00
Vinayakumar B
7d2d16f4ee
HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina)
2015-10-29 11:28:17 +05:30
Sangjin Lee
b0c818b60d
Set the release date for 2.6.2
2015-10-28 20:43:35 -07:00
cnauroth
2d10cb8e00
HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth.
2015-10-28 09:44:10 -07:00
Steve Loughran
a04b16970b
HADOOP-12514. Make static fields in GenericTestUtils for assertExceptionContains() package-private and final. (Mingliang Liu via stevel)
2015-10-28 10:36:43 +00:00
Steve Loughran
ff2b2bea91
HADOOP-12385. Include nested stack trace in SaslRpcClient.getServerToken() (stevel)
2015-10-28 10:25:22 +00:00
yliu
c201cf951d
HADOOP-12040. Adjust inputs order for the decode API in raw erasure coder. (Kai Zheng via yliu)
2015-10-28 16:18:23 +08:00
cnauroth
bf8e452982
HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth.
2015-10-27 23:07:14 -07:00
cnauroth
1f7ecb0c84
HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu.
2015-10-27 22:56:22 -07:00
cnauroth
73822de7c3
HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth.
2015-10-27 22:48:56 -07:00
Allen Wittenauer
1396867b52
HADOOP-12494. fetchdt stores the token based on token kind instead of token service (HeeSoo Kim via aw)
2015-10-27 12:02:43 -07:00
Zhihai Xu
ed9806ea40
HADOOP-12178. NPE during handling of SASL setup if problem with SASL resolver class. Contributed by Steve Loughran
2015-10-27 09:51:26 -07:00
Akira Ajisaka
bcb2386e39
HADOOP-12515. Mockito dependency is missing in hadoop-kafka module. Contributed by Kai Zheng.
2015-10-27 20:17:16 +09:00
Tsuyoshi Ozawa
ea6b183a1a
HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. Contributed by Akira AJISAKA.
2015-10-27 10:57:45 +09:00
Jing Zhao
a01a209fbe
HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. Contributed by Steve Loughran.
2015-10-26 14:03:15 -07:00
Tsuyoshi Ozawa
123b3db743
HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by Akihiro Suda.
2015-10-26 23:18:52 +09:00
Tsuyoshi Ozawa
ce60b4fc8b
YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula.
2015-10-26 16:45:11 +09:00
Jitendra Pandey
600ad7bf41
HDFS-9184. Logging HDFS operation's caller context into audit logs. Contributed by Mingliang Liu.
2015-10-23 12:15:01 -07:00
Jonathan Eagles
f8adeb712d
YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)
2015-10-23 10:34:08 -05:00
Tsuyoshi Ozawa
35a303dfbe
HADOOP-7266. Deprecate metrics v1. Contributed by Akira AJISAKA.
2015-10-23 23:47:51 +09:00
Tsuyoshi Ozawa
513ec3de19
HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. (Zhe Zhang and Chu Tong via ozawa)
2015-10-23 06:50:50 +09:00
Tsuyoshi Ozawa
039a1f9e96
Revert HADOOP-9692.
...
This reverts commit 381610da62
.
This reverts commit b5ca649bff
.
2015-10-23 06:48:26 +09:00
cnauroth
cb282d5b89
HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade.
2015-10-22 14:29:57 -07:00
Junping Du
0fce5f9a49
YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.
2015-10-22 13:41:09 -07:00
cnauroth
47641fcbc9
HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade.
2015-10-22 12:21:32 -07:00
Allen Wittenauer
4c0bae240b
HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw)
2015-10-22 08:19:56 -07:00
Tsuyoshi Ozawa
381610da62
HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong.
2015-10-22 11:59:12 +09:00
Tsuyoshi Ozawa
b5ca649bff
HADOOP-9692. SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong.
2015-10-22 11:55:25 +09:00
Andrew Wang
d1cdce77fa
HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. Contributed by Xiao Chen.
2015-10-21 15:21:01 -07:00
Allen Wittenauer
d759b4bd74
HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw)
2015-10-21 11:30:59 -07:00
Ming Ma
e27c2ae8ba
HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma)
2015-10-21 08:06:58 -07:00
Allen Wittenauer
b37c41fd6e
HADOOP-12495. Fix posix_spawn error on OS X (aw)
2015-10-21 08:00:26 -07:00
Kihwal Lee
01b103f4ff
HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee.
2015-10-20 15:09:15 -05:00
Allen Wittenauer
ded012e1d6
HADOOP-12493. bash unit tests are failing (aw)
2015-10-19 19:02:20 -07:00
Kihwal Lee
6144e0137b
HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee.
2015-10-19 10:52:29 -05:00
Vinayakumar B
7f0e1eb43d
HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N)
2015-10-19 12:16:16 +05:30
yliu
476a251e5e
HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu)
2015-10-19 09:54:11 +08:00
Steve Loughran
0ab3f9d564
HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel).
2015-10-18 14:05:28 +01:00
Steve Loughran
e286512a71
HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel)
2015-10-18 12:23:43 +01:00
Steve Loughran
bafeb6c7bc
HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. (Daryn Sharp via stevel).
2015-10-18 11:45:41 +01:00
cnauroth
a121fa1d39
HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query String. Contributed by Larry McCay.
2015-10-15 16:44:59 -07:00
cnauroth
fdd7406224
HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation failure. Contributed by Chris Nauroth.
2015-10-15 15:54:48 -07:00
cnauroth
5f3f0e0f70
HADOOP-12475. Move attribution to 2.8.0 section of CHANGES.txt.
2015-10-15 15:53:57 -07:00
Sangjin Lee
8d2d3eb7bb
HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee)
2015-10-15 11:43:07 -07:00
Allen Wittenauer
dc45a7a7c4
Revert "HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw)"
...
This reverts commit 0d77e85f0a
.
2015-10-15 08:26:06 -07:00
Steve Loughran
dfa7848463
HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)
2015-10-14 20:25:47 +01:00
Allen Wittenauer
ab13aa30cb
fix CHANGES.txt name typo
2015-10-14 11:48:28 -07:00
Allen Wittenauer
56dc7773f8
HADOOP-12364. Deleting pid file after stop is causing the daemons to keep restarting (Sigi Li via aw)
2015-10-14 11:16:10 -07:00
Allen Wittenauer
0d77e85f0a
HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw)
2015-10-14 08:59:41 -07:00
Colin Patrick Mccabe
d286032b71
HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe)
2015-10-13 16:11:46 -07:00
Steve Loughran
c59af2fdf8
HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)
2015-10-13 21:49:28 +01:00
Tsuyoshi Ozawa
33fefa33e5
HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7. (stevel and ozawa)
2015-10-14 05:31:43 +09:00
Haohui Mai
d1e1925bf6
HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu.
2015-10-13 13:24:15 -07:00
Steve Loughran
59e9980117
HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel)
2015-10-13 21:12:08 +01:00
Haohui Mai
7f00fcac77
HADOOP-12474. MiniKMS should use random ports for Jetty server by default. Contributed by Mingliang Liu.
2015-10-13 13:07:57 -07:00
Colin Patrick Mccabe
6716f15964
HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe)
2015-10-13 12:18:03 -07:00
Jitendra Pandey
84cbd72afd
HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou.
2015-10-13 09:12:04 -07:00
yliu
e617cf6dd1
HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu)
2015-10-12 16:09:14 +08:00
Haohui Mai
7e2c971fed
Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu."
...
This reverts commit fa5a54cac7
.
2015-10-10 03:24:59 -07:00
Haohui Mai
fa5a54cac7
HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu.
2015-10-09 22:38:06 -07:00
Akira Ajisaka
e1bf8b3df6
HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang.
2015-10-09 11:10:29 +09:00
Andrew Wang
66e2cfa1a0
HDFS-8632. Add InterfaceAudience annotation to the erasure coding classes. Contributed by Rakesh R.
2015-10-07 18:12:26 -07:00
Akira Ajisaka
7fbf69bf47
HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N.
2015-10-08 06:08:28 +09:00
Uma Mahesh
8b7339312c
HDFS-9182. Cleanup the findbugs and other issues after HDFS EC merged to trunk. Contributed by Uma Maheswara Rao G.
2015-10-06 22:22:32 -07:00
Steve Loughran
6d5713a8a8
HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel)
2015-10-06 21:39:53 +01:00
cnauroth
5f6edb30c2
HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth.
2015-10-05 20:11:41 -07:00
Allen Wittenauer
b59e434116
HADOOP-10949. metrics2 sink plugin for Apache Kafka (Babak Behzad via aw)
2015-10-05 14:02:07 -07:00
Colin Patrick Mccabe
3e1752f9fb
HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe)
2015-10-05 11:35:31 -07:00
Vinod Kumar Vavilapalli
f1c19b9365
HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan.
2015-10-05 10:56:55 -07:00
Tsuyoshi Ozawa
30e2f836a2
HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8.
2015-10-05 08:15:06 +09:00
Harsh J
c918f7be5e
HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.
2015-10-03 18:37:58 +05:30
Jason Lowe
fdf02d1f26
YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu
2015-10-02 20:20:31 +00:00
Zhihai Xu
fd026f535c
HADOOP-8437. getLocalPathForWrite should throw IOException for invalid paths. Contributed by Brahma Reddy Battula
2015-10-01 11:56:49 -07:00
Akira Ajisaka
ecbfd68974
HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). Contributed by Rahul Palamuttam and Kanaka Kumar Avvaru.
2015-10-01 18:25:31 +02:00
Zhe Zhang
6c17d31528
Merge remote-tracking branch 'apache/trunk' into HDFS-7285
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java
Change-Id: I53ec1c426dc988d6c4a2c87b00caef49c4057010
2015-09-30 08:39:13 -07:00
yliu
06abc57a90
HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test directory. (Contributed by Colin Patrick McCabe and Chris Nauroth)
2015-09-30 10:56:22 +08:00
Haohui Mai
8703301b46
HDFS-9174. Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread. Contributed by Yi Liu.
2015-09-29 14:56:06 -07:00
Colin Patrick Mccabe
a2efb945e3
Add HADOOP-12447 to CHANGES.txt
2015-09-29 09:37:13 -07:00
Colin Patrick Mccabe
850d679acb
HADOOP-12447. Clean up some htrace integration issues (cmccabe)
2015-09-29 09:25:11 -07:00
Zhe Zhang
8fd5520246
Merge remote-tracking branch 'apache/trunk' into HDFS-7285
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/hdfs.proto
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFS.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
Change-Id: Ic7946c4ea35bed587fe879ce58b959b25ecc0823
2015-09-29 01:39:16 -07:00
yliu
d6fa34e014
HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu)
2015-09-29 16:20:35 +08:00
Ming Ma
5c3b663bf9
HADOOP-12440. TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down. (Xiao Chen via mingma)
2015-09-28 18:12:51 -07:00
Kihwal Lee
3abbdc929b
HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu.
2015-09-28 17:31:51 -05:00
Colin Patrick Mccabe
892ade689f
HDFS-9080. Update htrace version to 4.0.1 (cmccabe)
2015-09-28 07:42:12 -07:00
Vinayakumar B
f0f984e4e6
HADOOP-11984. Enable parallel JUnit tests in pre-commit (Contributed by Chris Nauroth)
2015-09-27 14:12:07 +05:30
Vinayakumar B
861b52db24
HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid (Contributed by nijel)
2015-09-26 21:36:17 +05:30
cnauroth
7fe521b1dd
HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu.
2015-09-25 22:33:53 -07:00
Yongjun Zhang
3187dbd7a8
HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang)
2015-09-24 21:36:38 -07:00
Zhihai Xu
9cc9f8126b
Update CHANGES.txt to reflect commit of HADOOP-8436 to 2.8.0
2015-09-24 12:52:07 -07:00
Zhihai Xu
52c1f272ec
HADOOP-12252. LocalDirAllocator should not throw NPE with empty string configuration. Contributed by Zhihai Xu
2015-09-24 11:51:22 -07:00
Arpit Agarwal
df31c446bf
HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal)
2015-09-24 11:41:48 -07:00
Haohui Mai
0ef7ff47d5
HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem. Contributed by Chris Nauroth.
2015-09-23 19:36:44 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
1f707ecffd
Release process for 2.6.1: Set the release date for 2.6.1
2015-09-23 15:10:50 -07:00
Vinayakumar B
a2c76e5f26
HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore)
2015-09-23 15:28:41 +05:30
Zhe Zhang
1080c37300
Merge remote-tracking branch 'apache/trunk' into HDFS-7285
...
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
Change-Id: I8511c4d64b0959e79129febc179845a3892fedcc
2015-09-22 13:27:09 -07:00
Tsuyoshi Ozawa
dfd807afab
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
2015-09-22 12:54:29 +09:00
Steve Loughran
c39ddc306d
HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel)
2015-09-19 12:41:42 +01:00
Zhihai Xu
88d89267ff
HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu
2015-09-18 10:40:04 -07:00
Zhihai Xu
3732d5238a
Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu"
...
This reverts commit e690a32e57
.
2015-09-18 10:30:40 -07:00
Zhihai Xu
e690a32e57
Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu
2015-09-18 08:24:53 -07:00
Wangda Tan
6b97fa6652
HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda)
2015-09-17 17:46:28 -07:00
Jason Lowe
58d1a02b8d
MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu
2015-09-17 14:30:18 +00:00
Haohui Mai
0832b38d48
HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu.
2015-09-16 18:38:37 -07:00
Eric Yang
2ffe2db95e
HADOOP-12374. Updated expunge command description.
...
(WeiWei Yang via eyang)
2015-09-15 20:03:24 -07:00
Akira Ajisaka
77aaf4cf7d
HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu.
2015-09-16 10:20:24 +09:00
Vinayakumar B
ce69c9b54c
HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru)
2015-09-16 00:18:29 +05:30
cnauroth
b2017d9b03
HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu.
2015-09-15 10:41:50 -07:00
Vinayakumar B
a440567491
HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore)
2015-09-15 17:30:46 +05:30
Steve Loughran
7269906254
HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).
2015-09-13 14:25:26 +01:00
Steve Loughran
3f685cd571
HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel)
2015-09-12 18:56:42 +01:00
Steve Loughran
4992f075c8
syncing branch-2 and trunk CHANGES.TXT to be closer together
2015-09-12 18:51:37 +01:00
Steve Loughran
8c054412e1
fix trunk/hadoop-common CHANGES.TXT to be the reference across trunk & branch-2
2015-09-12 18:13:54 +01:00
Robert Kanter
9538af0e1a
HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter)
2015-09-11 15:20:17 -07:00
Steve Loughran
ca0827a862
HADOOP-12324. Better exception reporting in SaslPlainServer. (Mike Yoder via stevel)
2015-09-11 15:58:53 +01:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
fbbb7ff1ed
Updating all CHANGES.txt files to move entires from future releases into 2.6.1
...
section given the large number of backports to 2.6.1.
2015-09-10 13:45:57 -07:00
Vinayakumar B
94cf7ab9d2
HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore)
2015-09-09 11:03:57 +05:30
Zhihai Xu
d9c1fab2ec
HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong.
2015-09-08 13:06:36 -07:00
Vinayakumar B
090d26652c
HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina)
2015-09-08 19:11:18 +05:30
Andrew Wang
e1feaf6db0
HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao.
2015-09-04 13:42:55 -07:00
Arpit Agarwal
524ba8708b
HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal)
2015-09-03 11:14:47 -07:00
Tsuyoshi Ozawa
0ebc658105
HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla.
2015-09-03 23:32:42 +09:00
Tsuyoshi Ozawa
355eaaa33d
HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter error message. Contributed by Wei Yan.
2015-09-03 22:48:53 +09:00
Jian He
09c64ba1ba
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
2015-09-02 17:45:23 -07:00
Akira Ajisaka
65ccf2b125
HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore.
2015-09-02 14:28:38 +09:00
Zhe Zhang
53358fe680
Merge remote-tracking branch 'apache/trunk' into HDFS-7285
2015-09-01 14:48:37 -07:00
Zhe Zhang
ab56fcdb12
Merge remote-tracking branch 'apache/trunk' into HDFS-7285
2015-09-01 14:30:25 -07:00
Andrew Wang
0eb9b19325
HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder.
2015-09-01 10:57:32 -07:00
Tsuyoshi Ozawa
dd149adeac
HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun.
2015-09-02 02:01:51 +09:00
Akira Ajisaka
2e251a7674
HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N.
2015-09-01 20:55:33 +09:00
yliu
f4d96be6c6
HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu)
2015-09-01 16:20:56 +08:00
Andrew Wang
7ad3556ed3
HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract.
2015-08-31 18:17:14 -07:00
Lei Xu
6ab2d19f5c
HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu)
2015-08-29 09:59:30 -07:00
Arpit Agarwal
bdbe53c676
HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal)
2015-08-29 09:52:37 -07:00
Andrew Wang
90fe7bcc3b
HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin.
2015-08-27 10:17:00 -07:00
Andrew Wang
50fa383704
Revert "MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha)"
...
This reverts commit 61bf9cae6f
.
2015-08-27 10:15:19 -07:00
Walter Su
067ec8c2b1
HDFS-8838. Erasure Coding: Tolerate datanode failures in DFSStripedOutputStream when the data length is small. Contributed by Tsz Wo Nicholas Sze.
2015-08-27 09:11:23 +08:00
Jing Zhao
f44b599003
HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su.
2015-08-26 16:27:34 -07:00
Harsh J
af78767870
HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals before deleting. Contributed by Casey Brotherton.
2015-08-25 11:21:19 +05:30
Xiaoyu Yao
48774d0a45
HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer
2015-08-24 14:31:24 -07:00
Zhe Zhang
6b6a63bbbd
Merge commit '456e901a4c5c639267ee87b8e5f1319f256d20c2' (HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai.) into HDFS-7285-merge
2015-08-24 12:59:26 -07:00
Xuan
37e1c3d82a
YARN-221. NM should provide a way for AM to tell it not to aggregate
...
logs. Contributed by Ming Ma
2015-08-22 16:25:24 -07:00
Karthik Kambatla
61bf9cae6f
MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha)
2015-08-22 00:39:04 -07:00
Xiaoyu Yao
caa636bf10
HADOOP-12347. Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives. Contributed by Xiaoyu Yao
2015-08-21 16:32:57 -07:00
Vinod Kumar Vavilapalli
33474939a0
Creating 2.6.2 entries in CHANGES.txt files.
2015-08-20 17:21:06 -07:00
Akira Ajisaka
36b1a1e784
HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki.
2015-08-20 11:09:45 +09:00
Robert Kanter
1e06299df8
HADOOP-12317. Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST (adhoot via rkanter)
2015-08-19 19:00:51 -07:00
Arpit Agarwal
9c3571ea60
HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer)
2015-08-19 09:42:35 -07:00
Tsz-Wo Nicholas Sze
7ecbfd44aa
HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes.
2015-08-18 19:25:50 -07:00
Chris Douglas
30e342a5d3
HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan
2015-08-18 17:32:48 -07:00
Benoy Antony
71aedfabf3
hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu.
2015-08-18 13:43:34 -07:00
Arpit Agarwal
a88f31ebf3
HDFS-8880. NameNode metrics logging. (Arpit Agarwal)
2015-08-17 16:55:46 -07:00
Xiaoyu Yao
a7862d5fe4
HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer.
2015-08-17 10:15:56 -07:00
Vinayakumar B
fc508b41a9
HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
...
Moved to 2.6.1
2015-08-14 15:55:29 +05:30
Vinayakumar B
05ed69058f
HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe)
...
Moved to 2.6.1
2015-08-14 12:53:46 +05:30
Vinayakumar B
e7aa81394d
HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
...
Moved CHANGES.txt entry to 2.6.1
2015-08-14 12:23:51 +05:30
Vinayakumar B
24a11e3996
HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
...
Moved CHANGES.txt entry to 2.6.1
(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
2015-08-14 12:09:56 +05:30
Arpit Agarwal
6b1cefc561
HADOOP-12322. Typos in rpcmetrics.java. (Contributed by Anu Engineer)
2015-08-13 21:17:30 -07:00
Allen Wittenauer
b73181f187
HADOOP-12244. recover broken rebase during precommit (aw)
2015-08-13 12:29:19 -07:00
Zhe Zhang
1d37a88121
HDFS-8854. Erasure coding: add ECPolicy to replace schema+cellSize in hadoop-hdfs. Contributed by Walter Su.
2015-08-13 10:04:45 -07:00
yliu
53bef9c5b9
HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu)
2015-08-13 16:45:20 +08:00
cnauroth
6cc8e38db5
HADOOP-12258. Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression. Contributed by Zhihai Xu.
2015-08-12 16:44:53 -07:00
Aaron T. Myers
820f864a26
HADOOP-12318. Expose underlying LDAP exceptions in SaslPlainServer. Contributed by Mike Yoder.
2015-08-12 15:24:16 -07:00
Andrew Wang
1ea1a8334e
HDFS-8887. Expose storage type and storage ID in BlockLocation.
2015-08-11 23:25:33 -07:00
Xuan
3ae716fa69
YARN-3999. RM hangs on draing events. Contributed by Jian He
2015-08-11 18:25:11 -07:00
Jian He
f59612edd7
HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy Battula
2015-08-05 16:12:45 -07:00
cnauroth
3da0bedaec
HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth.
2015-08-05 14:56:41 -07:00
Colin Patrick Mccabe
4ab49a4365
HADOOP-12302. Fix native compilation on Windows after HADOOP-7824 (Vinayakumar B via Colin P. McCabe)
2015-08-05 09:46:51 -07:00
Colin Patrick Mccabe
6f83274afc
HADOOP-12280. Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded (Masatake Iwasaki via Colin P. McCabe)
2015-08-05 09:42:38 -07:00
Akira Ajisaka
52f3525586
HADOOP-12274. Remove direct download link from BULIDING.txt. Contributed by Caleb Severn.
2015-08-05 17:45:55 +09:00
Lei Xu
d5403747b5
HADOOP-12269. Update aws-sdk dependency to 1.10.6 (Thomas Demoor via Lei (Eddy) Xu)
2015-08-04 18:51:52 -07:00
Zhihai Xu
a628a6f126
HADOOP-12268. AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation. Contributed by Zhihai Xu
2015-07-31 21:32:45 -07:00
Colin Patrick Mccabe
454da959c7
HADOOP-12183. Annotate the HTrace span created by FsShell with the command-line arguments passed by the user (Masatake Iwasaki via Colin P. McCabe)
2015-07-31 15:14:18 -07:00
Colin Patrick Mccabe
21d10ccc6e
HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
2015-07-31 15:01:34 -07:00
Allen Wittenauer
a890a31529
HADOOP-10854. unit tests for the shell scripts (aw)
2015-07-31 14:34:48 -07:00
Allen Wittenauer
666cafca8d
HADOOP-12249. pull argument parsing into a function (aw)
2015-07-31 14:32:21 -07:00
Harsh J
2087eaf684
HADOOP-12271. Hadoop Jar Error Should Be More Explanatory. Contributed by Josh Elser.
2015-07-31 10:12:32 +05:30
Jason Lowe
6f0a35724f
HADOOP-10945. 4-digit octal umask permissions throws a parse error. Contributed by Chang Li
2015-07-29 15:25:10 +00:00
Akira Ajisaka
2a1d656196
Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)"
...
This reverts commit 02c01815ec
.
2015-07-29 16:48:30 +09:00
Jakob Homan
0712a8103f
HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak.
2015-07-28 21:03:31 -07:00
Colin Patrick Mccabe
69b095730b
HADOOP-12175. FsShell must load SpanReceierHost to support tracing (Masatake Iwasaki via Colin P. McCabe)
2015-07-28 12:56:15 -07:00
Arun Suresh
030fcfa99c
HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh)
2015-07-27 23:02:03 -07:00
Akira Ajisaka
e21dde501a
HADOOP-12245. References to misspelled REMAINING_QUATA in FileSystemShell.md. Contributed by Gabor Liptak.
2015-07-28 11:33:10 +09:00
Allen Wittenauer
098ba450cc
HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw)
...
(cherry picked from commit 8e657fba2fd33f7550597ea9c4c6e9a87aa1ef1c)
2015-07-24 18:31:23 -07:00
Colin Patrick Mccabe
e4b0c74434
HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be removed (Alan Burlison via Colin P. McCabe)
2015-07-24 13:03:31 -07:00
Robert Kanter
ee233ec95c
HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter)
2015-07-24 09:41:53 -07:00
Akira Ajisaka
02c01815ec
HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)
2015-07-24 11:37:23 +09:00
Jakob Homan
ab3197c204
HADOOP-12009: Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via jghoman)
2015-07-23 17:46:13 -07:00
Andrew Wang
6736a1ab70
HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu.
2015-07-23 14:42:35 -07:00
Arpit Agarwal
adfa34ff99
HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula)
2015-07-23 10:13:04 -07:00
Colin Patrick Mccabe
1b3bceb58c
HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin Walsh via Colin P. McCabe)
2015-07-22 11:34:10 -07:00
cnauroth
efa97243ec
HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
2015-07-22 11:16:49 -07:00
Vinayakumar B
94c6a4aa85
HADOOP-12017. Hadoop archives command should use configurable replication factor when closing (Contributed by Bibin A Chundatt)
2015-07-22 10:25:49 +05:30
cnauroth
a26cc66f38
HDFS-8773. Few FSNamesystem metrics are not documented in the Metrics page. Contributed by Rakesh R.
2015-07-21 14:12:03 -07:00
cnauroth
cb03768b1b
HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R.
2015-07-21 13:55:58 -07:00
Allen Wittenauer
68d1f4bfe8
HADOOP-11762. Enable swift distcp to secure HDFS (Chen He via aw)
2015-07-21 11:19:29 -07:00
Vinayakumar B
87f29c6b8a
HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B)
2015-07-21 13:12:46 +05:30
Akira Ajisaka
773c670943
HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. (aajisaka)
2015-07-21 11:21:49 +09:00
Jing Zhao
29495cb8f6
HADOOP-12060. Fix ByteBuffer usage for raw erasure coders. Contributed by Kai Zheng.
2015-07-20 10:15:14 -07:00
Steve Loughran
98c2bc87b1
HADOOP-11893. Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public. (Brahma Reddy Battula via stevel)
2015-07-20 13:22:14 +01:00
Steve Loughran
a9431425d1
HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage() in logging/span events. (Varun Saxena via stevel)
2015-07-20 13:13:23 +01:00
Steve Loughran
05fa3368f1
HADOOP-12088. KMSClientProvider uses equalsIgnoreCase("application/json"). (Brahma Reddy Battula via stevel)
2015-07-20 13:03:03 +01:00
Steve Loughran
9141e1aa16
HADOOP-12209 Comparable type should be in FileStatus. (Yong Zhang via stevel)
2015-07-20 12:32:44 +01:00
Steve Loughran
05130e94c5
HADOOP-12235 hadoop-openstack junit & mockito dependencies should be "provided". (Ted Yu via stevel)
2015-07-20 11:22:39 +01:00
Allen Wittenauer
ee36f4f9b8
HADOOP-10979. Auto-entries in hadoop_usage (aw)
2015-07-16 16:58:11 -07:00
Haohui Mai
d96bbe152c
HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. Contributed by kanaka kumar avvaru.
2015-07-16 15:21:53 -07:00
Tsuyoshi Ozawa
90bda9c611
HADOOP-12240. Fix tests requiring native library to be skipped in non-native profile. Contributed by Masatake Iwasaki.
2015-07-16 16:04:55 +09:00
Tsuyoshi Ozawa
111e6a3fdf
HADOOP-10615. FileInputStream in JenkinsHash#main() is never closed. Contributed by Chen He.
2015-07-16 14:08:31 +09:00
Tsuyoshi Ozawa
cec1d43db0
HADOOP-12153. ByteBufferReadable doesn't declare @InterfaceAudience and @InterfaceStability. Contributed by Brahma Reddy Battula.
2015-07-15 14:19:17 +09:00
cnauroth
0a16ee6017
HADOOP-12232. Upgrade Tomcat dependency to 6.0.44. Contributed by Chris Nauroth.
2015-07-14 15:22:33 -07:00
Tsuyoshi Ozawa
4084eaf943
HADOOP-12191. Bzip2Factory is not thread safe. Contributed by Brahma Reddy Battula.
2015-07-14 19:14:42 +09:00
Chris Douglas
a431ed9075
HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl
2015-07-13 15:36:11 -07:00
Akira Ajisaka
d6675606dc
YARN-3069. Document missing properties in yarn-default.xml. Contributed by Ray Chiang.
2015-07-13 12:57:01 +09:00
Chris Douglas
1a0752d85a
HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl
2015-07-09 17:48:43 -07:00
Karthik Kambatla
ac6048372a
HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. (Chris Douglas via kasha)
2015-07-09 09:56:40 -07:00
Akira Ajisaka
6b7692c468
HADOOP-12200. TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profile. Contributed by Masatake Iwasaki.
2015-07-09 13:14:53 +09:00
Colin Patrick Mccabe
b8832fcf1e
HADOOP-12201. Add tracing to FileSystem#createFileSystem and Globber#glob (cmccabe)
2015-07-08 20:07:21 -07:00
Karthik Kambatla
2e3d83f97b
HADOOP-11878. FileContext#fixRelativePart should check for not null for a more informative exception. (Brahma Reddy Battula via kasha)
2015-07-08 11:34:34 -07:00
Andrew Wang
625d7ed9eb
HADOOP-12194. Support for incremental generation in the protoc plugin.
2015-07-08 11:09:43 -07:00
Allen Wittenauer
98e59261b7
Revert "HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw)"
...
This reverts commit 79ed0f959f
.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2015-07-08 08:06:30 -07:00
Andrew Wang
3dc92e84c2
HADOOP-12195. Add annotation to package-info.java file to workaround MCOMPILER-205.
2015-07-07 11:14:12 -07:00
Andrew Wang
aa96a8c0c5
HADOOP-12193. Rename Touchz.java to Touch.java.
2015-07-07 11:12:56 -07:00
Chris Douglas
559425dcb9
HADOOP-5732. Add SFTPFileSystem. Contributed by Ramtin Boustani and Inigo Goiri
2015-07-07 10:08:59 -07:00
Vinayakumar B
e0febce0e7
HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu)
...
Moved CHANGES.txt entry to 2.7.2
2015-07-07 18:13:35 +05:30
Varun Vasudev
c40bdb56a7
YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan.
2015-07-07 16:59:29 +05:30
Vinayakumar B
99c8c5839b
HADOOP-12117. Potential NPE from Configuration#loadProperty with allowNullValueProperties set. (Contributed by zhihai xu)
2015-07-07 16:11:27 +05:30
Colin Patrick Mccabe
81f3644376
HADOOP-11974. Fix FIONREAD #include on Solaris (Alan Burlison via Colin P. McCabe)
2015-07-06 17:17:59 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
bf89ddb9b8
Release process for 2.7.1: Set the release date for 2.7.1.
2015-07-06 16:39:59 -07:00
Chris Douglas
47a69ec7a5
HADOOP-12185. NetworkTopology is not efficient adding/getting/removing nodes. Contributed by Inigo Goiri
2015-07-06 15:03:22 -07:00
cnauroth
ed1e3ce482
HADOOP-12045. Enable LocalFileSystem#setTimes to change atime. Contributed by Kazuho Fujii.
2015-07-06 13:40:15 -07:00
Vinayakumar B
233cab89ad
HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync multiple times (Contributed by zhihai xu)
2015-07-06 15:39:43 +05:30
Chris Douglas
e59f6fad6a
HADOOP-12173. NetworkTopology::add calls toString always. Contributed by Inigo Goiri
2015-07-02 21:39:48 -07:00
cnauroth
f3796224bf
HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence of the parent. Contributed by Chris Nauroth.
2015-07-01 19:47:58 -07:00
Colin Patrick Mccabe
a78d5074fb
HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe)
2015-07-01 17:57:11 -07:00
Lei Xu
532e38cb7f
HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. (Lei Xu)
2015-06-30 17:41:59 -07:00
cnauroth
b8e792cba2
HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2. Contributed by Li Lu.
2015-06-30 16:54:30 -07:00
Robert Kanter
aaafa0b2ee
HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter)
2015-06-30 16:49:27 -07:00
Colin Patrick Mccabe
ad60807238
HADOOP-12124. Add HTrace support for FsShell (cmccabe)
2015-06-30 16:46:25 -07:00
Colin Patrick Mccabe
68e588cbee
HADOOP-10798. globStatus() should always return a sorted list of files (cmccabe)
2015-06-30 16:40:21 -07:00
Andrew Wang
9ee7b6e6c4
HADOOP-12158. Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed.
2015-06-30 15:04:33 -07:00
Gera Shegalov
6f2a41e37d
YARN-3768. ArrayIndexOutOfBoundsException with empty environment variables. (Zhihai Xu via gera)
2015-06-30 14:59:33 -07:00
Allen Wittenauer
147e020c7a
HADOOP-12149. copy all of test-patch BINDIR prior to re-exec (aw)
2015-06-30 11:31:26 -07:00
Steve Loughran
076948d9a4
Revert "HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)"
...
This reverts commit 3dfa8161f9
.
2015-06-30 11:54:12 +01:00
Vinayakumar B
6d99017f38
HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' (Contributed by J.Andreina)
2015-06-30 15:25:20 +05:30
Ming Ma
8e1bdc17d9
HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma)
2015-06-29 14:37:38 -07:00
cnauroth
460e98f7b3
HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
2015-06-29 13:48:02 -07:00
Colin Patrick Mccabe
fad291ea6d
HADOOP-12112. Make hadoop-common-project Native code -Wall-clean (alanburlison via cmccabe)
2015-06-29 12:35:16 -07:00
Colin Patrick Mccabe
5a27c3fd76
HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework (Alan Burlison via Colin P. McCabe)
2015-06-29 12:31:26 -07:00
Vinayakumar B
c815344e2e
HADOOP-12119. hadoop fs -expunge does not work for federated namespace (Contributed by J.Andreina)
2015-06-29 15:58:54 +05:30
Vinod Kumar Vavilapalli
aad6a7d5db
Adding release 2.7.2 to CHANGES.txt.
2015-06-28 16:29:12 -07:00
Steve Loughran
3dfa8161f9
HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via stevel)
2015-06-28 19:14:00 +01:00
Allen Wittenauer
79ed0f959f
HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw)
2015-06-27 08:59:50 -07:00
Colin Patrick Mccabe
aa07dea357
HADOOP-12036. Consolidate all of the cmake extensions in one directory (alanburlison via cmccabe)
2015-06-26 12:32:31 -07:00
Amareshwari Sriramadasu
8ef07f767f
HADOOP-11203. Allow ditscp to accept bandwitdh in fraction MegaBytes. Contributed by Raju Bairishetti
2015-06-26 09:52:06 +05:30
Benoy Antony
a815cc157c
HADOOP-12049. Control http authentication cookie persistence via configuration. Contributed by Huizhi Lu.
2015-06-24 15:59:39 -07:00
Jonathan Eagles
2236b577a3
HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error occurs (Jason Lowe via jeagles)
2015-06-24 14:51:04 -05:00
Aaron T. Myers
49dfad9429
HDFS-6440. Support more than 2 NameNodes. Contributed by Jesse Yates.
2015-06-23 17:26:11 -07:00
Jason Lowe
077250d8d7
MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA
2015-06-22 21:59:20 +00:00
Colin Patrick Mccabe
d112d18324
HDFS-8582. Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings (Lei (Eddy) Xu via Colin P. McCabe)
2015-06-19 19:14:05 -07:00
Yongjun Zhang
49f5d20efe
HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing. Contributed by Yongjun Zhang.
2015-06-19 14:06:17 -07:00
Colin Patrick Mccabe
6e0a9f92fe
HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe)
2015-06-18 11:39:05 -07:00
Vinayakumar B
295d678be8
HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
2015-06-18 14:39:00 +05:30
Yongjun Zhang
74351af3b7
HADOOP-11965. determine-flaky-tests needs a summary mode. Contributed by Yufei Gu,
2015-06-17 20:58:17 -07:00
cnauroth
fbf55dcaf4
HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. Contributed by Larry McCay.
2015-06-16 14:44:03 -07:00
Akira Ajisaka
b578807b99
HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. Contributed by Brahma Reddy Battula.
2015-06-16 13:38:03 -07:00
Tsz-Wo Nicholas Sze
175e6d120f
HDFS-8361. Choose SSD over DISK in block placement.
2015-06-15 17:12:01 -07:00
Vinod Kumar Vavilapalli
04c9a077c8
HADOOP-12001. Moving CHANGES.txt up into 2.8.
2015-06-15 14:29:07 -07:00
Vinod Kumar Vavilapalli
722aa1db1f
HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and GID attributes during the search. Contributed by Patrick White.
2015-06-15 14:22:34 -07:00
Akira Ajisaka
e4489d97e5
HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to hadoop-common. Contributed by Masatake Iwasaki.
2015-06-12 07:25:15 -07:00
Vinayakumar B
95c73d49b1
HADOOP-12074. in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException (Contributed by Lavkesh Lahngir)
2015-06-11 11:51:14 +05:30
Vinayakumar B
48ca23def1
HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() (Contributed by kanaka kumar avvaru)
2015-06-10 11:05:58 +05:30
Kai Zheng
e299fe86b8
HDFS-8557 Allow to configure RS and XOR raw coders. Contributed by Kai Zheng
2015-06-10 15:35:26 +08:00
Arpit Agarwal
3107434031
HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal)
2015-06-09 20:58:39 -07:00
cnauroth
c45784bc90
HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic.
2015-06-08 22:42:14 -07:00
Xiaoyu Yao
927577c87c
HDFS-8552. Fix hdfs CLI usage message for namenode and zkfc. Contributed by Brahma Reddy Battula
2015-06-08 21:57:26 -07:00
Colin Patrick Mccabe
fc2ed4a1f9
HADOOP-11347. RawLocalFileSystem#mkdir and create should honor umask (Varun Saxena via Colin P. McCabe)
2015-06-08 17:49:31 -07:00
Arpit Agarwal
84ba1a75b6
HADOOP-12054. RPC client should not retry for InvalidToken exceptions. (Contributed by Varun Saxena)
2015-06-08 15:45:23 -07:00
cnauroth
0e80d51983
HDFS-8554. TestDatanodeLayoutUpgrade fails on Windows. Contributed by Chris Nauroth.
2015-06-08 08:39:02 -07:00
Kai Zheng
c41b02cc00
HADOOP-12065 Using more meaningful keys in EC schema. Contributed by Kai Zheng
2015-06-08 20:24:17 +08:00
Steve Loughran
18f6809776
HADOOP-12052 IPC client downgrades all exception types to IOE, breaks callers trying to use them. (Brahma Reddy Battula via stevel)
2015-06-08 13:02:56 +01:00
cnauroth
e46cb80002
HADOOP-12055. Deprecate usage of NativeIO#link. Contributed by Andrew Wang.
2015-06-06 09:17:03 -07:00
Jason Lowe
b3ffa87003
MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li
2015-06-05 22:38:31 +00:00
Andrew Wang
bc11e158b1
HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory. Contributed by Zhihai Xu.
2015-06-05 13:52:21 -07:00
Andrew Wang
2dbc40e608
HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey.
2015-06-05 13:11:01 -07:00
Gera Shegalov
9f6d67844d
HADOOP-11924. Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera)
2015-06-04 11:38:28 -07:00
Arpit Agarwal
8266dae0e9
HADOOP-11994. smart-apply-patch wrongly assumes that git is infallible. (Contributed by Kengo Seki)
2015-06-04 10:54:18 -07:00
Akira Ajisaka
dbed757cba
HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii.
2015-06-05 01:45:34 +09:00
Vinayakumar B
1bb79c9d01
HADOOP-12019. update BUILDING.txt to include python for 'mvn site' in windows (Contributed by Vinayakumar B)
2015-06-04 10:42:52 +05:30
Akira Ajisaka
b5f0d294f8
HADOOP-12018. smart-apply-patch.sh fails if the patch edits CR+LF files and is created by 'git diff --no-prefix'. Contributed by Kengo Seki.
2015-06-04 11:14:55 +09:00
Akira Ajisaka
a6a8ee3c24
HADOOP-11991. test-patch.sh isn't re-executed even if smart-apply-patch.sh is modified. Contributed by Kengo Seki.
2015-06-03 15:01:02 +09:00
Kai Zheng
0799e1e4b6
HADOOP-12011 Allow to dump verbose information to ease debugging in raw erasure coders. Contributed by Kai Zheng
2015-06-02 22:05:16 +08:00
Andrew Wang
990078b927
HADOOP-12037. Fix wrong classname in example configuration of hadoop-auth documentation. Contributed by Masatake Iwasaki.
2015-06-01 18:04:52 -07:00
Vinayakumar B
63e3fee5f6
HADOOP-9905. remove dependency of zookeeper for hadoop-client (Contributed by Vinayakumar B)
2015-06-01 17:47:02 +05:30
Andrew Wang
374ddd9f9e
HADOOP-12043. Display warning if defaultFs is not set when running fs commands. Contributed by Eddy Xu.
2015-05-29 17:15:58 -07:00
Andrew Wang
7673d4f205
HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang)
2015-05-29 14:54:18 -07:00
Vinayakumar B
7366e42563
HADOOP-12042. Users may see TrashPolicy if hdfs dfs -rm is run (Contributed by Andreina J)
2015-05-29 16:51:23 +05:30
cnauroth
860b8373c3
HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay.
2015-05-28 15:01:42 -07:00
Allen Wittenauer
ae14543420
HADOOP-12022. fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits (aw)
2015-05-28 13:24:01 -07:00
cnauroth
94e7d49a6d
HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic.
2015-05-28 12:31:06 -07:00
Allen Wittenauer
7ebe80ec12
HADOOP-11930. test-patch in offline mode should tell maven to be in offline mode (Sean Busbey via aw)
2015-05-28 12:11:48 -07:00
Colin Patrick Mccabe
a1140959da
HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating (Masatake Iwasaki via Colin P. McCabe)
2015-05-28 12:00:55 -07:00
Colin Patrick Mccabe
246cefa089
HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread. (zhouyingchao via cmccabe)
2015-05-28 11:52:28 -07:00
Allen Wittenauer
08ae87f6ba
HADOOP-11983. HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is supposed to do (Sangjin Lee via aw)
2015-05-28 11:29:58 -07:00
Allen Wittenauer
5df1fadf87
HADOOP-7947. Validate XMLs if a relevant tool is available, when using scripts (Kengo Seki via aw)
2015-05-28 11:01:00 -07:00
Allen Wittenauer
cbba7d68f0
HADOOP-11142. Remove hdfs dfs reference from file system shell documentation (Kengo Seki via aw)
2015-05-28 10:57:04 -07:00
Allen Wittenauer
5504a261f8
HADOOP-11406. xargs -P is not portable (Kengo Seki via aw)
2015-05-28 10:36:40 -07:00
Allen Wittenauer
b01d33cf86
HADOOP-12030. test-patch should only report on newly introduced findbugs warnings. (Sean Busbey via aw)
2015-05-28 09:53:50 -07:00
Allen Wittenauer
f1cea9c6bf
HADOOP-12035. shellcheck plugin displays a wrong version potentially (Kengo Seki via aw)
2015-05-28 09:11:08 -07:00
Allen Wittenauer
87c26f8b7d
HADOOP-12004. test-patch breaks with reexec in certain situations (Sean Busbey via aw)
2015-05-28 08:15:17 -07:00
Allen Wittenauer
bf500d9798
HDFS-5033. Bad error message for fs -put/copyFromLocal if user doesn't have permissions to read the source (Darrell Taylor via aw)
2015-05-27 16:51:34 -07:00
Allen Wittenauer
4d8fb8c19c
HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException (Darrell Taylor via aw)
2015-05-27 16:36:55 -07:00
Akira Ajisaka
bb1816328a
HADOOP-11242. Record the time of calling in tracing span of IPC server. Contributed by Mastake Iwasaki.
2015-05-27 18:04:40 +09:00
Colin Patrick Mccabe
7dba7005b7
HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
2015-05-26 12:15:46 -07:00
Kai Zheng
4ad484883f
HADOOP-11847 Enhance raw coder allowing to read least required inputs in decoding. Contributed by Kai Zheng
2015-05-26 12:07:16 -07:00
Vinayakumar B
5a391e1d25
HADOOP-12029. Remove chunkSize from ECSchema as its not required for coders (Contributed by Vinayakumar B)
2015-05-26 12:07:16 -07:00
Kai Zheng
b30e96bfb4
HDFS-8382 Remove chunkSize and initialize from erasure coder. Contributed by Kai Zheng
2015-05-26 12:07:15 -07:00
Kai Zheng
4ae32abdf4
HADOOP-12013 Generate fixed data to perform erasure coder test. Contributed by Kai Zheng
2015-05-26 12:07:14 -07:00
Zhe Zhang
343c0e76fc
HADOOP-11938. Enhance ByteBuffer version encode/decode API of raw erasure coder. Contributed by Kai Zheng.
2015-05-26 12:02:31 -07:00
Zhe Zhang
b64f6745a4
HADOOP-11566. Add tests and fix for erasure coders to recover erased parity units. Contributed by Kai Zheng.
2015-05-26 12:02:31 -07:00
Zhe Zhang
09c3a375ba
HADOOP-11920. Refactor some codes for erasure coders. Contributed by Kai Zheng.
2015-05-26 12:02:31 -07:00
Zhe Zhang
9c7a78c874
HADOOP-11921. Enhance tests for erasure coders. Contributed by Kai Zheng.
2015-05-26 12:02:31 -07:00
Jing Zhao
3f2c6938f1
HDFS-8223. Should calculate checksum for parity blocks in DFSStripedOutputStream. Contributed by Yi Liu.
2015-05-26 11:59:54 -07:00
Zhe Zhang
e8df2581c3
HDFS-8156. Add/implement necessary APIs even we just have the system default schema. Contributed by Kai Zheng.
2015-05-26 11:59:53 -07:00
Uma Maheswara Rao G
014d8675c5
HDFS-8024. Erasure Coding: ECworker frame, basics, bootstraping and configuration. (Contributed by Uma Maheswara Rao G)
2015-05-26 11:59:52 -07:00
Tsz-Wo Nicholas Sze
909632dd90
HADOOP-11841. Remove unused ecschema-def.xml files.
2015-05-26 11:59:12 -07:00
Vinayakumar B
ceb3d1c170
HDFS-7349. Support DFS command for the EC encoding (Contributed by Vinayakumar B)
2015-05-26 11:59:11 -07:00
Vinayakumar B
f53e402635
HDFS-8090. Erasure Coding: Add RPC to client-namenode to list all ECSchemas loaded in Namenode. (Contributed by Vinayakumar B)
2015-05-26 11:58:40 -07:00
Kai Zheng
971bd5e885
HADOOP-11818 Minor improvements for erasurecode classes. Contributed by Rakesh R
2015-05-26 11:55:17 -07:00
Kai Zheng
1a37b0fe9a
HDFS-8074 Define a system-wide default EC schema. Contributed by Kai Zheng
2015-05-26 11:55:16 -07:00
Vinayakumar B
99502cbbe2
HADOOP-11645. Erasure Codec API covering the essential aspects for an erasure code ( Contributed by Kai Zheng)
2015-05-26 11:55:15 -07:00
Vinayakumar B
aac73c21c3
HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang.
...
Updated CHANGES-HDFS-EC-7285.txt
2015-05-26 11:55:15 -07:00
Kai Zheng
d43102d2c5
Updated CHANGES-HDFS-EC-7285.txt
2015-05-26 11:55:14 -07:00
Kai Zheng
17f7cdc047
HADOOP-11805 Better to rename some raw erasure coders. Contributed by Kai Zheng
2015-05-26 11:55:14 -07:00
Zhe Zhang
e54a74b566
HADOOP-11740. Combine erasure encoder and decoder interfaces. Contributed by Zhe Zhang.
2015-05-26 11:55:13 -07:00
Kai Zheng
98ea3ec0da
HADOOP-11782 Correct two thrown messages in ECSchema class. Contributed by Xinwei Qin
2015-05-26 11:44:47 -07:00
Zhe Zhang
d9af36b9bd
HADOOP-11664. Loading predefined EC schemas from configuration. Contributed by Kai Zheng.
2015-05-26 11:43:43 -07:00
Kai Zheng
df297245a7
HADOOP-11647. Reed-Solomon ErasureCoder. Contributed by Kai Zheng
2015-05-26 11:43:41 -07:00
Kai Zheng
90d332d6be
HADOOP-11707. Add factory to create raw erasure coder. Contributed by Kai Zheng
2015-05-26 11:43:41 -07:00
Kai Zheng
e3dbfeb138
Updated CHANGES-HDFS-EC-7285.txt accordingly
2015-05-26 11:42:05 -07:00
Kai Zheng
c3bc083405
HADOOP-11706 Refine a little bit erasure coder API
2015-05-26 11:42:04 -07:00
Kai Zheng
68caf8728e
Fixed a compiling issue introduced by HADOOP-11705.
2015-05-26 11:32:26 -07:00
drankye
292e367d07
HADOOP-11705. Make erasure coder configurable. Contributed by Kai Zheng
2015-05-26 11:32:25 -07:00
Vinayakumar B
8f89d7489d
HADOOP-11646. Erasure Coder API for encoding and decoding of block group ( Contributed by Kai Zheng )
2015-05-26 11:32:25 -07:00
drankye
c0945a8971
HADOOP-11643. Define EC schema API for ErasureCodec. Contributed by Kai Zheng
2015-05-26 11:32:24 -07:00
drankye
dae27f6dd1
HADOOP-11542. Raw Reed-Solomon coder in pure Java. Contributed by Kai Zheng
2015-05-26 11:07:15 -07:00
Kai Zheng
b29f3bde4d
HADOOP-11541. Raw XOR coder
2015-05-26 11:03:35 -07:00
Vinayakumar B
9f19eb9fcf
HADOOP-11534. Minor improvements for raw erasure coders ( Contributed by Kai Zheng )
2015-05-26 11:03:35 -07:00
Uma Maheswara Rao G
e50bcea83d
HADOOP-11514. Raw Erasure Coder API for concrete encoding and decoding (Kai Zheng via umamahesh)
2015-05-26 11:03:35 -07:00
Akira Ajisaka
56996a685e
HADOOP-8751. NPE in Token.toString() when Token is constructed using null identifier. Contributed by kanaka kumar avvaru.
2015-05-26 16:16:21 +09:00
Colin Patrick Mccabe
f34638399a
HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe)
2015-05-22 12:51:03 -07:00
Vinayakumar B
55ed6558ba
HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)
2015-05-22 16:45:19 +05:30
Akira Ajisaka
ab7958f227
HADOOP-11594. Improve the readability of site index of documentation. Contributed by Masatake Iwasaki.
2015-05-22 16:51:05 +09:00
Akira Ajisaka
b2a40942c1
HADOOP-11955. Fix a typo in the cluster setup doc. Contributed by Yanjun Wang.
2015-05-22 16:09:01 +09:00
Akira Ajisaka
c7fea088f7
HADOOP-12014. hadoop-config.cmd displays a wrong error message. Contributed by Kengo Seki.
2015-05-22 14:15:08 +09:00
Jakob Homan
4fc942a84f
HADOOP-12016. Typo in FileSystem::listStatusIterator. Contributed by Arthur Vigil.
2015-05-21 14:50:03 -07:00
Akira Ajisaka
0e4f1081c7
HADOOP-10366. Add whitespaces between classes for values in core-default.xml to fit better in browser. Contributed by kanaka kumar avvaru.
2015-05-21 17:52:03 +09:00
Haohui Mai
fb6b38d67d
HADOOP-11772. RPC Invoker relies on static ClientCache which has synchronized(this) blocks. Contributed by Haohui Mai.
2015-05-20 20:10:50 -07:00
Akira Ajisaka
4aa730ce85
HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula.
2015-05-20 19:25:45 +09:00
Haohui Mai
ce53c8eb0c
HADOOP-11995. Make jetty version configurable from the maven command line. Contributed by Sriharsha Devineni.
2015-05-19 18:28:20 -07:00
Allen Wittenauer
12d6c5ce4f
HADOOP-12000. cannot use --java-home in test-patch (aw)
2015-05-19 15:24:23 -07:00
cnauroth
e422e76fca
HADOOP-11963. Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. Contributed by Anu Engineer.
2015-05-19 11:50:27 -07:00
Arun Suresh
fd3cb533d2
HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh)
2015-05-19 11:35:57 -07:00
Colin Patrick Mccabe
470c87dbc6
HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe)
2015-05-19 10:50:15 -07:00
Akira Ajisaka
eb4c9ddeb5
Move HADOOP-11581 in CHANGES.txt from 3.0.0 to 2.8.0.
2015-05-19 18:38:35 +09:00
Vinayakumar B
d4a2830b63
HADOOP-11103. Clean up RemoteException (Contributed by Sean Busbey)
2015-05-19 14:41:05 +05:30
Akira Ajisaka
f889a49271
Move HADOOP-8934 in CHANGES.txt from 3.0.0 to 2.8.0.
2015-05-19 18:02:10 +09:00
Akira Ajisaka
3b50dcdce4
HADOOP-10971. Add -C flag to make hadoop fs -ls
print filenames only. Contributed by Kengo Seki.
2015-05-19 17:25:27 +09:00
Jing Zhao
0790275f05
HADOOP-1540. Support file exclusion list in distcp. Contributed by Rich Haase.
2015-05-18 13:24:35 -07:00
Arpit Agarwal
a2190bf15d
HDFS-8345. Storage policy APIs must be exposed via the FileSystem interface. (Arpit Agarwal)
2015-05-18 11:36:29 -07:00
Allen Wittenauer
060c84ea86
HADOOP-11949. Add user-provided plugins to test-patch (Sean Busbey via aw)
2015-05-18 17:06:31 +00:00
Allen Wittenauer
bcc17866dd
HADOOP-11944. add option to test-patch to avoid relocating patch process directory (Sean Busbey via aw)
2015-05-18 16:13:50 +00:00
Allen Wittenauer
182d86dac0
HADOOP-11884. test-patch.sh should pull the real findbugs version (Kengo Seki via aw)
2015-05-18 16:08:49 +00:00
Akira Ajisaka
a46506d99c
HADOOP-10582. Fix the test case for copying to non-existent dir in TestFsShellCopy. Contributed by Kousuke Saruta.
2015-05-18 16:31:41 +09:00
Akira Ajisaka
f5c48238d5
HADOOP-11939. Deprecate DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula.
2015-05-18 16:13:16 +09:00
Akira Ajisaka
cab0dadbd8
HADOOP-11988. Fix typo in the document for hadoop fs -find. Contributed by Kengo Seki.
2015-05-17 13:35:51 +09:00
cnauroth
cb8e69a80c
HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth.
2015-05-14 22:22:24 -07:00
cnauroth
09fe16f166
HADOOP-11713. ViewFileSystem should support snapshot methods. Contributed by Rakesh R.
2015-05-14 14:55:58 -07:00
Vinayakumar B
ffbb574623
HADOOP-10993. Dump java command line to *.out file (Contributed by Kengo Seki)
2015-05-14 15:24:35 +05:30
Vinayakumar B
0daa5ada68
HADOOP-8174. Remove confusing comment in Path#isAbsolute() (Contributed by Suresh Srinivas)
2015-05-14 14:17:36 +05:30
Tsuyoshi Ozawa
4356e8a5ef
HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula.
2015-05-14 10:20:45 +09:00
cnauroth
93b770f7e7
HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth.
2015-05-13 12:25:06 -07:00
Akira Ajisaka
92c38e41e1
HADOOP-9723. Improve error message when hadoop archive output path already exists. Contributed by Jean-Baptiste Onofré and Yongjun Zhang.
2015-05-13 17:28:57 +09:00
Zhijie Shen
fcd0702c10
YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
2015-05-12 21:13:22 -07:00
Akira Ajisaka
2463666ecb
HDFS-6184. Capture NN's thread dump when it fails over. Contributed by Ming Ma.
2015-05-13 11:37:22 +09:00
Haohui Mai
2f4b6d1157
HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out even in debug level. Contributed by Junping Du.
2015-05-12 10:30:32 -07:00
Allen Wittenauer
a83eaeaa2e
HADOOP-11947. test-patch should return early from determine-issue when run in jenkins mode. (Sean Busbey via aw)
2015-05-11 12:07:48 -07:00
Allen Wittenauer
d4f422612a
HADOOP-11948. test-patch's issue matching regex should be configurable. (Sean Busbey via aw)
2015-05-11 11:53:54 -07:00
Allen Wittenauer
2d671e5b3d
HADOOP-11950. Add cli option to test-patch to set the project-under-test (Sean Busbey via aw)
2015-05-11 11:50:01 -07:00
Allen Wittenauer
baeb479aef
HADOOP-11951. test-patch should give better info about failures to handle dev-support updates without resetrepo option (Sean Busbey via aw)
2015-05-11 11:45:47 -07:00
Allen Wittenauer
32cc3139e3
HADOOP-11928. Test-patch check for @author tags incorrectly flags removal of @author tags (Kengo Seki via aw)
2015-05-11 11:35:02 -07:00
Akira Ajisaka
b9cebfc0ba
HADOOP-11663. Remove description about Java 6 from docs. Contributed by Masatake Iwasaki.
2015-05-12 00:30:59 +09:00
Junping Du
7e543c27fa
YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak.
2015-05-11 05:27:07 -07:00
Allen Wittenauer
ed0f4db0dd
HADOOP-11775. Fix Javadoc typos in hadoop-openstack module (Yanjun Wang via aw)
2015-05-08 17:01:08 -07:00
Robert Kanter
315074bb08
HADOOP-9737. JarFinder#getJar should delete the jar file upon destruction of the JVM (jbonofre via rkanter)
2015-05-08 16:05:04 -07:00
Allen Wittenauer
c945c20483
HADOOP-11590. Update sbin commands and documentation to use new --slaves option (aw)
2015-05-08 15:27:25 -07:00
Allen Wittenauer
effcc5cbb7
HADOOP-11906. test-patch.sh should use file command for patch determinism (Sean Busbey via aw)
2015-05-08 15:13:38 -07:00
Xiaoyu Yao
e8f66c449c
HADOOP-11942. Add links to SLGUserGuide to site index (Masatake Iwasaki via xyao)
2015-05-08 14:34:34 -07:00
Jason Lowe
ec2748dedb
HADOOP-9729. The example code of org.apache.hadoop.util.Tool is incorrect. Contributed by hellojinjie
2015-05-08 21:28:38 +00:00
Jason Lowe
c4bd2cdded
HADOOP-7165. listLocatedStatus(path, filter) is not redefined in FilterFs. Contributed by Hairong Kuang
2015-05-08 20:36:07 +00:00
Colin Patrick Mccabe
8f7c2364d7
HDFS-8284. Update documentation about how to use HTrace with HDFS (Masatake Iwasaki via Colin P. McCabe)
2015-05-08 12:30:03 -07:00
Arpit Agarwal
a0fae8dcae
HADOOP-10356. Corrections in winutils/chmod.c (Contributed by René Nyffenegger)
2015-05-08 11:42:50 -07:00
cnauroth
26f61d41df
HDFS-5640. Add snapshot methods to FileContext. Contributed by Rakesh R.
2015-05-08 11:20:55 -07:00
Robert (Bobby) Evans
cc17c83585
HADOOP-6842. "hadoop fs -text" does not give a useful text representation of MapWritable objects
2015-05-08 11:57:14 -05:00
Vinayakumar B
1ffb7fa42e
HADOOP-11877. SnappyDecompressor's Logger class name is wrong ( Contributed by surendra singh lilhore)
2015-05-08 16:52:14 +05:30
Vinayakumar B
f33efbc827
HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak)
2015-05-08 10:22:11 +05:30
Allen Wittenauer
ab5058de8e
HADOOP-11936. Dockerfile references a removed image (aw)
2015-05-07 11:46:32 -07:00
Akira Ajisaka
305e4733d6
HADOOP-10387. Misspelling of threshold in log4j.properties for tests in hadoop-common-project. Contributed by Brahma Reddy Battula.
2015-05-07 16:53:57 +09:00
Allen Wittenauer
f325522c14
HADOOP-11813. releasedocmaker.py should use today's date instead of unreleased (Darrell Taylor via aw)
2015-05-06 10:34:09 -07:00
Xiaoyu Yao
7a26d174af
HDFS-8310. Fix TestCLI.testAll 'help: help for find' on Windows. (Kiran Kumar M R via Xiaoyu Yao)
2015-05-06 10:24:46 -07:00
Colin Patrick Mccabe
90b3845648
HADOOP-11912. Extra configuration key used in TraceUtils should respect prefix (Masatake Iwasaki via Colin P. McCabe)
2015-05-05 17:40:31 -07:00
Allen Wittenauer
4402e4c633
HADOOP-11926. test-patch.sh mv does wrong math (aw)
2015-05-05 17:01:42 -07:00
Robert Kanter
9809a16d3c
MAPREDUCE-6192. Create unit test to automatically compare MR related classes and mapred-default.xml (rchiang via rkanter)
2015-05-05 14:43:28 -07:00
Allen Wittenauer
d33419ae01
HADOOP-11917. test-patch.sh should work with ${BASEDIR}/patchprocess setups (aw)
2015-05-05 11:26:31 -07:00
Allen Wittenauer
3ff91e9e93
HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven builds (aw)
2015-05-05 11:02:15 -07:00
Allen Wittenauer
9b01f81eb8
HADOOP-11911. test-patch should allow configuration of default branch (Sean Busbey via aw)
2015-05-05 09:59:31 -07:00
Andrew Wang
05adc76ace
HADOOP-11120. hadoop fs -rmr gives wrong advice. Contributed by Juliet Houghland.
2015-05-05 08:37:37 -07:00
Tsuyoshi Ozawa
338e88a19e
HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug. Contributed by Ming Ma.
2015-05-05 12:39:24 +09:00
Wangda Tan
71f4de220c
YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda)
2015-05-04 15:49:19 -07:00
Tsuyoshi Ozawa
bb9ddef0e7
HADOOP-11328. ZKFailoverController does not log Exception when doRun raises errors. Contributed by Tianyin Xu.
2015-05-04 17:47:37 +09:00
Tsuyoshi Ozawa
76fa606e2d
HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen.
2015-05-04 17:05:00 +09:00
Gera Shegalov
3ddb260e30
HADOOP-11900. Add failIfNoTests=false to hadoop-build-tools pom. (gera)
2015-05-01 18:18:55 -07:00
Gera Shegalov
f343f8657e
HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera)
2015-05-01 18:18:55 -07:00
Wangda Tan
7d46a806e7
YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda)
2015-05-01 16:40:55 -07:00
Colin Patrick Mccabe
b82567d455
HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe)
2015-05-01 11:19:40 -07:00
Jonathan Eagles
2d7363b273
HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles)
2015-05-01 13:11:50 -05:00
Allen Wittenauer
5f8112ffd2
HADOOP-11866. increase readability and reliability of checkstyle, shellcheck, and whitespace reports (aw)
2015-04-30 15:15:32 -07:00
Arun Suresh
f0db797be2
HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh)
2015-04-30 13:59:43 -07:00
Akira Ajisaka
f384a063a6
HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula.
2015-04-30 19:34:41 +09:00
Akira Ajisaka
e89fc53a1d
HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang.
2015-04-30 19:11:22 +09:00
Jing Zhao
7947e5b53b
HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze.
2015-04-29 10:41:46 -07:00
Allen Wittenauer
eccf709a61
HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via aw)
2015-04-28 10:32:32 -07:00
Robert Kanter
9fec02c069
HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter)
2015-04-27 13:25:11 -07:00
Arpit Agarwal
0d5b0143cc
HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao)
2015-04-27 12:23:34 -07:00
Jakob Homan
1a2459bd4b
HADOOP-11857. Fix CommandFormat#commandFormat java doc annotation. Contributed by J.Andreina.
2015-04-26 18:35:01 -07:00
Allen Wittenauer
8847777ae4
HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw)
2015-04-26 15:51:08 -07:00
Allen Wittenauer
8b69c825e5
HADOOP-11865. Incorrect path mentioned in document for accessing script files (J.Andreina via aw)
2015-04-26 09:55:46 -07:00
Ravi Prakash
a287d2fb77
HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak)
2015-04-24 13:39:07 -07:00
cnauroth
80935268f5
HADOOP-11843. Make setting up the build environment easier. Contributed by Niels Basjes.
2015-04-24 13:05:18 -07:00
Colin Patrick Mccabe
a0e0a63209
HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe)
2015-04-23 19:00:24 -07:00
Haohui Mai
bcf89ddc7d
HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai.
2015-04-23 17:33:45 -07:00
Akira Ajisaka
ac281e3fc8
HADOOP-11627. Remove io.native.lib.available. Contributed by Brahma Reddy Battula.
2015-04-24 08:08:55 +09:00
Steve Loughran
19262d99eb
HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel)
2015-04-23 21:41:51 +01:00
Andrew Wang
26971e52ae
HADOOP-11852. Disable symlinks in trunk.
2015-04-23 11:47:01 -07:00
Arpit Agarwal
49f6e3d35e
HADOOP-10597. RPC Server signals backoff to clients when all request queues are full. (Contributed by Ming Ma)
2015-04-23 09:35:04 -07:00
Steve Loughran
08d4386162
HADOOP-11864. JWTRedirectAuthenticationHandler breaks java8 javadocs. (Larry McCay via stevel)
2015-04-23 09:06:22 +01:00
cnauroth
18eb5e7934
HADOOP-11861. test-patch.sh rewrite addendum patch. Contributed by Allen Wittenauer.
2015-04-22 22:23:31 -07:00
Jason Lowe
0ebe84d30a
HADOOP-11868. Invalid user logins trigger large backtraces in server log. Contributed by Chang Li
2015-04-22 20:56:29 +00:00
Jakob Homan
e54a3e1f4f
HADOOP-11850: Typos in hadoop-common java docs. Contributed by Surendra Singh Lilhore.
2015-04-22 13:48:16 -07:00
Colin Patrick Mccabe
a3b1d8c902
HADOOP-11848. Incorrect arguments to sizeof in DomainSocket.c (Malcolm Kavalsky via Colin P. McCabe)
2015-04-22 12:36:37 -07:00
Jitendra Pandey
1f4767c7f2
HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. Contributed by Eugene Koifman.
2015-04-22 10:00:14 -07:00
Ravi Prakash
cfba355052
HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak)
2015-04-21 16:49:37 -07:00
Steve Loughran
2c14690368
HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. (Larry McCay via stevel)
2015-04-21 22:38:41 +01:00
Gera Shegalov
6d2cf9fbbd
HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera)
2015-04-21 13:57:23 -07:00
Allen Wittenauer
73ddb6b4f8
HADOOP-11746. rewrite test-patch.sh (aw)
2015-04-21 21:29:45 +01:00
Arun Suresh
424a00daa0
HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh)
2015-04-21 11:31:51 -07:00
Arpit Agarwal
dfc1c4c303
HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal)
2015-04-21 10:58:05 -07:00
Vinod Kumar Vavilapalli
d52de61544
Set the release date for 2.7.0
2015-04-20 20:16:58 -07:00
Arpit Agarwal
c92f6f3605
HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao)
2015-04-20 15:42:42 -07:00
Haohui Mai
c6b5203cfd
HADOOP-11837. AuthenticationFilter should destroy SignerSecretProvider in Tomcat deployments. Contributed by Bowen Zhang.
2015-04-17 10:59:47 -07:00
Vinayakumar B
b5a0b24643
HADOOP-11819. HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist. (Contributed by Rohith)
2015-04-14 11:58:12 +05:30
Allen Wittenauer
d4e8c09593
HADOOP-9642. Configuration to resolve environment variables via ${env.VARIABLE} references (Kengo Seki via aw)
2015-04-14 08:20:13 +02:00
Arpit Agarwal
b9b832a0d8
HADOOP-7713. Update CHANGES.txt
2015-04-13 21:20:16 -07:00
Arpit Agarwal
18a3dad44a
HDFS-7701. Support reporting per storage type quota and usage with hadoop/hdfs shell. (Contributed by Peter Shi)
2015-04-13 21:01:15 -07:00
Tsuyoshi Ozawa
174d8b3a10
HADOOP-11811. Fix typos in hadoop-project/pom.xml. Contributed by Brahma Reddy Battula.
2015-04-13 06:59:51 -05:00
Akira Ajisaka
83979e61a4
MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina.
2015-04-10 20:21:00 +09:00
Vinod Kumar Vavilapalli
623fd46c1e
Adding release 2.7.1 to CHANGES.txt
2015-04-09 13:54:20 -07:00
Haohui Mai
63c659ddd0
HADOOP-11815. HttpServer2 should destroy SignerSecretProvider when it stops. Contributed by Rohith.
2015-04-09 10:58:12 -07:00
Haohui Mai
dc0282d64c
HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu.
2015-04-08 17:56:23 -07:00
Allen Wittenauer
f4b3fc5621
HADOOP-11781. fix race conditions and add URL support to smart-apply-patch.sh (Raymie Stata via aw)
2015-04-08 10:05:25 -07:00
Arpit Agarwal
5449adc9e5
HADOOP-11801. Update BUILDING.txt for Ubuntu. (Contributed by Gabor Liptak)
2015-04-07 18:06:05 -07:00
cnauroth
bd77a7c4d9
HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. Contributed by Xiaoyu Yao.
2015-04-07 14:47:21 -07:00
Owen O'Malley
ce63573314
HADOOP-11717. Support JWT tokens for web single sign on to the Hadoop
...
servers. (Larry McCay via omalley)
2015-04-07 08:09:41 -07:00
Vinod Kumar Vavilapalli
4b3948ea36
HADOOP-11776. Fixed the broken JDiff support in Hadoop 2. Contributed by Li Lu.
2015-04-04 13:52:01 -07:00
Vinod Kumar Vavilapalli
5370e7128b
HADOOP-11377. Added Null.java without which jdiff completely flops. Contributed by Tsuyoshi Ozawa.
2015-04-04 13:47:08 -07:00
Colin Patrick Mccabe
932730df7d
HADOOP-11785. Reduce the number of listStatus operation in distcp buildListing (Zoran Dimitrijevic via Colin P. McCabe)
2015-04-03 14:08:25 -07:00
Akira Ajisaka
228ae9aaa4
HADOOP-11800. Clean up some test methods in TestCodec.java. Contributed by Brahma Reddy Battula.
2015-04-04 00:32:18 +09:00
Allen Wittenauer
8d3c0f601d
HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw)
2015-04-02 20:50:36 -07:00
Wangda Tan
bad070fe15
YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)
2015-04-02 17:23:20 -07:00
cnauroth
5763b173d3
HADOOP-9805. Refactor RawLocalFileSystem#rename for improved testability. Contributed by Jean-Pierre Matsumoto.
2015-04-02 16:13:00 -07:00
Allen Wittenauer
f383fd9b6c
HADOOP-11731. Rework the changelog and releasenotes (aw)
2015-04-01 17:52:22 -07:00
Brandon Li
60ce825a71
HADOOP-11757. NFS gateway should shutdown when it can't start UDP or TCP server. Contributed by Brandon Li
2015-04-01 17:04:44 -07:00
Colin Patrick Mccabe
c94d594a57
HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe)
2015-04-01 14:10:10 -07:00
cnauroth
a3a96a07fa
HADOOP-11787. OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac. Contributed by Kiran Kumar M R.
2015-04-01 11:40:09 -07:00
Colin Patrick Mccabe
d9ac5ee2c4
HADOOP-11660. Add support for hardware crc of HDFS checksums on ARM aarch64 architecture (Edward Nevill via Colin P. McCabe)
2015-03-30 13:55:02 -07:00
Haohui Mai
90e07d55ac
HADOOP-11754. RM fails to start in non-secure mode due to authentication filter failure. Contributed by Haohui Mai.
2015-03-30 11:44:22 -07:00
Haohui Mai
82fa3adfd8
HADOOP-11761. Fix findbugs warnings in org.apache.hadoop.security.authentication. Contributed by Li Lu.
2015-03-30 11:08:54 -07:00
cnauroth
3836ad6c0b
HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu.
2015-03-27 15:03:41 -07:00
Tsuyoshi Ozawa
e074952bd6
HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula.
2015-03-27 23:15:51 +09:00
cnauroth
af618f23a7
HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R.
2015-03-26 21:56:31 -07:00
Haohui Mai
47782cbf4a
HADOOP-11748. The secrets of auth cookies should not be specified in configuration in clear text. Contributed by Li Lu and Haohui Mai.
2015-03-26 17:35:37 -07:00
Allen Wittenauer
5695c7a541
HADOOP-11553 addendum fix the typo in the changes file
2015-03-26 15:18:03 -07:00
Allen Wittenauer
b30ca8ce0e
HADOOP-11553. Foramlize the shell API (aw)
2015-03-26 15:09:51 -07:00
Arpit Agarwal
3d0708bdb0
HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao)
2015-03-26 10:24:11 -07:00
Harsh J
b4b4fe9056
HADOOP-11719.[Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text. Contributed by Brahma Reddy Battula.
2015-03-26 11:29:54 +05:30
cnauroth
4528eb9fb2
HADOOP-11524. hadoop_do_classpath_subcommand throws a shellcheck warning. Contributed by Chris Nauroth.
2015-03-25 22:36:09 -07:00
Yongjun Zhang
44809b8081
HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang)
2015-03-25 15:45:45 -07:00
Haohui Mai
e4b8d9e72d
HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng.
2015-03-25 11:12:42 -07:00
Tsuyoshi Ozawa
323945b33a
HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. (ozawa)
2015-03-25 18:02:32 +09:00
Tsuyoshi Ozawa
b351086ff6
HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa)
2015-03-25 16:59:40 +09:00
Tsuyoshi Ozawa
5582b0f1d4
HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). Contributed by Walter Su.
2015-03-25 16:36:10 +09:00
Tsuyoshi Ozawa
3ca5bd1632
Fix CHANGES.txt for HADOOP-11602.
2015-03-24 21:06:26 +09:00
Tsuyoshi Ozawa
6e891a921e
HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena.
2015-03-24 20:57:39 +09:00
Tsuyoshi Ozawa
0b9f12c847
HADOOP-11737. mockito's version in hadoop-nfs’ pom.xml shouldn't be specified. Contributed by Kengo Seki.
2015-03-23 13:56:24 +09:00
Karthik Kambatla
fe5c23b670
HADOOP-11447. Add a more meaningful toString method to SampleStat and MutableStat. (kasha)
2015-03-20 17:03:03 -07:00
Tsuyoshi Ozawa
43dde502b3
HADOOP-11709. Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variable. Contributed by Ajith S.
2015-03-21 00:54:20 +09:00
Tsuyoshi Ozawa
522c897146
HADOOP-11729. Fix link to cgroups doc in site.xml. Contributed by Masatake Iwasaki.
2015-03-19 23:08:18 +09:00
Haohui Mai
19b298f612
HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony.
2015-03-18 22:31:59 -07:00
Colin Patrick Mccabe
bf6295bed8
HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe)
2015-03-18 19:14:21 -07:00
Akira Ajisaka
34117325b2
HADOOP-11659. o.a.h.FileSystem.Cache#remove should use a single hash map lookup. Contributed by Brahma Reddy Battula.
2015-03-18 15:43:10 +09:00
Aaron T. Myers
fc90bf7b27
HADOOP-11722. Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted. Contributed by Arun Suresh.
2015-03-17 19:41:36 -07:00
Tsuyoshi Ozawa
ef9946cd52
HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA.
2015-03-17 16:09:21 +09:00
cnauroth
2681ed9698
HADOOP-8059. Update CHANGES.txt to target 2.7.0.
2015-03-16 14:17:25 -07:00
cnauroth
72cd4e4a4e
HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R.
2015-03-16 14:04:40 -07:00
Colin Patrick Mccabe
bf3275dbaa
HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe)
2015-03-16 12:02:10 -07:00
Yongjun Zhang
d1eebd9c9c
HADOOP-9477. Amendment to CHANGES.txt.
2015-03-16 09:16:57 -07:00
Yongjun Zhang
03b77ede92
HADOOP-11692. Amendment to CHANGES.txt.
2015-03-16 09:08:41 -07:00
Tsuyoshi Ozawa
79426f3334
HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Jean-Pierre Matsumoto.
2015-03-15 14:29:49 +09:00
Tsuyoshi Ozawa
b308a8d181
Revert "HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki."
...
This reverts commit 7da136ecca
.
2015-03-15 14:27:38 +09:00
Tsuyoshi Ozawa
7da136ecca
HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki.
2015-03-15 14:17:35 +09:00
Andrew Wang
387f271c81
HADOOP-11711. Provide a default value for AES/CTR/NoPadding CryptoCodec classes.
2015-03-12 21:40:58 -07:00
yliu
a85291003c
HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu)
2015-03-13 02:25:02 +08:00
Yongjun Zhang
8212877415
HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang)
2015-03-12 14:52:36 -07:00
cnauroth
ff83ae7231
HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField. Contributed by Hui Zheng.
2015-03-11 23:27:49 -07:00
cnauroth
7a346bcb4f
HADOOP-11693. Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. Contributed by Duo Xu.
2015-03-11 14:36:51 -07:00
cnauroth
fb34f45727
HDFS-7491. Add incremental blockreport latency to DN metrics. Contributed by Ming Ma.
2015-03-11 14:11:19 -07:00
Allen Wittenauer
344d7cb6dc
HADOOP-11703. git should ignore .DS_Store files on Mac OS X (Abin Shahab via aw)
2015-03-11 13:19:12 -07:00
Gera Shegalov
64eb068ee8
DelegateToFileSystem erroneously uses default FS's port in constructor. (Brahma Reddy Battula via gera)
2015-03-10 13:52:06 -07:00
cnauroth
8d5b01e005
Revert "HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux (Kiran Kumar M R via Colin P. McCabe)"
...
This reverts commit 3241fc2b17
.
2015-03-10 11:02:07 -07:00
Allen Wittenauer
7711049837
HADOOP-11668. hadoop-daemons.sh bw compat broke with --slaves change (Vinayakumar B via aw)
2015-03-09 22:31:50 -07:00
Allen Wittenauer
47f7f18d4c
HADOOP-10115. Exclude duplicate jars in hadoop package under different component's lib (Vinayakumar B via aw)
2015-03-09 21:44:06 -07:00
Tsuyoshi Ozawa
54639c7d7a
HADOOP-11226. Add a configuration to set ipc.Client's traffic class with IPTOS_LOWDELAY|IPTOS_RELIABILITY. Contributed by Gopal V.
2015-03-10 13:08:29 +09:00
Colin Patrick Mccabe
3241fc2b17
HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux (Kiran Kumar M R via Colin P. McCabe)
2015-03-09 12:56:33 -07:00
Yongjun Zhang
de1101cb5b
HADOOP-11692. Improve authentication failure WARN message to avoid user confusion. Contributed by Yongjun Zhang.
2015-03-09 11:55:32 -07:00
Haohui Mai
42e3a80511
HADOOP-11686. MiniKDC cannot change ORG_NAME or ORG_DOMAIN. Contributed by Duo Zhang.
2015-03-09 11:07:40 -07:00
Yongjun Zhang
5578e22ce9
Revert "HDFS-7857. Improve authentication failure WARN message to avoid user confusion. Contributed by Yongjun Zhang."
...
This reverts commit d799fbe1cc
.
2015-03-08 20:54:43 -07:00
Yongjun Zhang
d799fbe1cc
HDFS-7857. Improve authentication failure WARN message to avoid user confusion. Contributed by Yongjun Zhang.
2015-03-08 20:39:46 -07:00
Vinod Kumar Vavilapalli
b3e699271b
Adding 2.8 section in CHANGES.txt
2015-03-08 20:24:33 -07:00
Chris Douglas
790aa6790e
HADOOP-11673. Skip using JUnit Assume in TestCodec.
...
Contributed by Brahma Reddy Battula.
2015-03-08 19:18:59 -07:00
Steve Loughran
64443490d7
HADOOP-11670. Regression: s3a auth setup broken. (Adam Budde via stevel)
2015-03-08 11:22:16 -07:00
cnauroth
608ebd52ba
HADOOP-11642. Upgrade azure sdk version from 0.6.0 to 2.0.0. Contributed by Shashank Khandelwal and Ivan Mitic.
2015-03-06 15:25:01 -08:00
Jian He
21101c01f2
YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu
2015-03-06 14:18:11 -08:00
Allen Wittenauer
01bfe6f05b
HADOOP-11653. shellprofiles should require .sh extension (Brahma Reddy Battula via aw)
2015-03-06 13:54:11 -08:00
yliu
5e9b8144d5
HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static. (Sean Busbey via yliu)
2015-03-05 06:38:45 +08:00
Tsuyoshi Ozawa
74a4754d1c
HADOOP-11648. Set DomainSocketWatcher thread name explicitly. Contributed by Liang Xie.
2015-03-05 16:05:44 +09:00
Karthik Kambatla
8d88691d16
YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)
2015-03-04 19:49:05 -08:00
Akira Ajisaka
29bb689865
Move HADOOP-6857 to 3.0.0.
2015-03-03 21:52:37 -08:00
Steve Loughran
15b7076ad5
HADOOP-11183. Memory-based S3AOutputstream. (Thomas Demoor via stevel)
2015-03-03 16:18:51 -08:00
Tsuyoshi Ozawa
d1c6accb6f
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
2015-03-03 14:17:52 +09:00
Gera Shegalov
b18d3830ac
HADOOP-11605. FilterFileSystem#create with ChecksumOpt should propagate it to wrapped FS. (gera)
2015-03-02 18:09:23 -08:00
Akira Ajisaka
ca1c00bf81
HADOOP-11658. Externalize io.compression.codecs property. Contributed by Kai Zheng.
2015-03-02 01:12:44 -08:00
Akira Ajisaka
dd9cd0797c
HADOOP-11615. Update ServiceLevelAuth.md for YARN. Contributed by Brahma Reddy Battula.
2015-03-01 22:16:06 -08:00
Akira Ajisaka
30e73ebc77
HADOOP-11657. Align the output of hadoop fs -du
to be more Unix-like. (aajisaka)
2015-03-01 21:09:15 -08:00
Tsuyoshi Ozawa
e9ac88aac7
HADOOP-11634. Description of webhdfs' principal/keytab should switch places each other. Contributed by Brahma Reddy Battula.
2015-03-02 04:18:07 +09:00
Allen Wittenauer
b01d3433ae
HADOOP-10774. Update KerberosTestUtils for hadoop-auth tests when using IBM Java (sangamesh via aw)
2015-02-28 23:22:06 -08:00
Akira Ajisaka
915bec3e84
move HADOOP-10976 to 2.7
2015-02-28 17:15:13 -08:00
Tsuyoshi Ozawa
48c7ee7553
HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile. Contributed by Vinayakumar B.
2015-02-27 17:46:07 +09:00
cnauroth
2214dab60f
HADOOP-9922. hadoop windows native build will fail in 32 bit machine. Contributed by Kiran Kumar M R.
2015-02-26 12:41:33 -08:00
Allen Wittenauer
dce8b9c4d0
HADOOP-11637. bash location hard-coded in shell scripts (aw)
2015-02-26 09:29:16 -08:00
Andrew Wang
71385f9b70
HADOOP-11620. Add support for load balancing across a group of KMS for HA. Contributed by Arun Suresh.
2015-02-25 21:16:37 -08:00
cnauroth
5731c0e0d0
HADOOP-11629. WASB filesystem should not start BandwidthGaugeUpdater if fs.azure.skip.metrics set to true. Contributed by Shanyu Zhao.
2015-02-25 09:08:55 -08:00
Tsuyoshi Ozawa
ad8ed3e802
HADOOP-11632. Cleanup Find.java to remove SupressWarnings annotations. Contributed by Akira AJISAKA.
2015-02-25 16:25:04 +09:00
Akira Ajisaka
1a625b8158
HADOOP-11480. Typo in hadoop-aws/index.md uses wrong scheme for test.fs.s3.name. Contributed by Ted Yu.
2015-02-24 17:11:46 -08:00
Colin Patrick Mccabe
ac3468add4
move HADOOP-11495 to 2.7
2015-02-24 15:54:58 -08:00
Allen Wittenauer
d4ac6822e1
YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw)
2015-02-24 11:25:26 -08:00
Tsuyoshi Ozawa
9cedad11d8
Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)"
...
This reverts commit 946456c6d8
.
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java
2015-02-25 00:32:04 +09:00
Gera Shegalov
1dba57271f
HADOOP-11619. FTPFileSystem should override getDefaultPort. (Brahma Reddy Battula via gera)
2015-02-23 21:05:59 -08:00
Akira Ajisaka
ab5976161f
HADOOP-8642. Document that io.native.lib.available only controls native bz2 and zlib compression codecs. (aajisaka)
2015-02-23 17:34:43 -08:00
Allen Wittenauer
208430a15d
HADOOP-11625. Minor fixes to command manual & SLA doc (aw)
2015-02-23 17:23:43 -08:00
Haohui Mai
16bd79ee8e
HADOOP-10478. Fix new findbugs warnings in hadoop-maven-plugins. Contributed by Li Lu.
2015-02-23 16:38:24 -08:00
cnauroth
769507bd7a
HDFS-7009. Active NN and standby NN have different live nodes. Contributed by Ming Ma.
2015-02-23 15:12:27 -08:00
Arpit Agarwal
8b465b4b8c
HDFS-7806. Refactor: move StorageType from hadoop-hdfs to hadoop-common. (Contributed by Xiaoyu Yao)
2015-02-21 15:38:35 -08:00
Steve Loughran
709ff99cff
HADOOP-11584 s3a file block size set to 0 in getFileStatus. (Brahma Reddy Battula via stevel)
2015-02-21 12:03:03 +00:00
Robert Kanter
6f0133039a
HADOOP-11612. Workaround for Curator's ChildReaper requiring Guava 15+. (rkanter)
2015-02-20 19:47:28 -08:00
cnauroth
3c5ff0759c
HADOOP-11604. Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. Contributed by Chris Nauroth.
2015-02-20 13:07:16 -08:00
Steve Loughran
aa1c437b6a
HADOOP-11607. Reduce log spew in S3AFileSystem. (Lei (Eddy) Xu via stevel)
2015-02-20 20:51:24 +00:00
cnauroth
02e7dec79d
HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer.
2015-02-20 12:37:48 -08:00
Jason Lowe
f0f2992686
HADOOP-9087. Queue size metric for metric sinks isn't actually maintained. Contributed by Akira AJISAKA
2015-02-19 17:30:07 +00:00
yliu
64a8375635
HADOOP-11595. Add default implementation for AbstractFileSystem#truncate. (yliu)
2015-02-19 08:26:42 +08:00
Tsuyoshi Ozawa
946456c6d8
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
2015-02-19 13:06:53 +09:00
Akira Ajisaka
18fb421fab
HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing in ClientBaseWithFixes. Contributed by Kengo Seki.
2015-02-18 17:55:04 -08:00
Akira Ajisaka
1714609919
HADOOP-11545. ArrayIndexOutOfBoundsException is thrown with "hadoop credential list -provider". Contributed by Brahma Reddy Battula.
2015-02-18 11:17:10 -08:00
Tsuyoshi Ozawa
3f56a4cb0c
HADOOP-11599. Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when IPC_CLIENT_PING_KEY is not configured. Contributed by zhihai xu.
2015-02-18 17:35:11 +09:00
Allen Wittenauer
b6fc1f3e43
HADOOP-11593. Convert site documentation from apt to markdown (stragglers) (Masatake Iwasaki via aw)
2015-02-17 21:30:24 -10:00
Kihwal Lee
685af8a3d0
HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is full. Contributed by Ming Ma.
2015-02-17 17:14:58 -06:00
Steve Loughran
00b80958d8
HADOOP-11521. Make connection timeout configurable in s3a. (Thomas Demoor via stevel)
2015-02-17 20:06:27 +00:00
Steve Loughran
6be5670949
HADOOP-11596 moving entry in CHANGES.TXT up to improvements there, as it wasn't in 2.7 & it was confusing diffs
2015-02-17 20:06:05 +00:00
Ravi Prakash
13d1ba9965
HADOOP-11596. Allow smart-apply-patch.sh to add new files in binary git patches (raviprak)
2015-02-17 11:13:47 -08:00
Steve Loughran
78a7e8d3a6
HADOOP-11522. Update S3A Documentation. (Thomas Demoor via stevel)
2015-02-17 18:15:02 +00:00
Allen Wittenauer
72389c78db
HADOOP-11575. Daemon log documentation is misleading (Naganarasimha G R via aw)
2015-02-17 07:00:00 -10:00
Steve Loughran
826267f789
HADOOP-11570. S3AInputStream.close() downloads the remaining bytes of the object from S3. (Dan Hecht via stevel).
2015-02-17 16:36:44 +00:00
Tsuyoshi Ozawa
2f0f756b26
HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa)
2015-02-17 21:56:20 +09:00
Vinayakumar B
cf4b7f506d
HADOOP-11000. HAServiceProtocol's health state is incorrectly transitioned to SERVICE_NOT_RESPONDING (Contributed by Ming Ma)
2015-02-17 14:55:56 +05:30
Tsuyoshi Ozawa
ef950ea1c0
HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R.
2015-02-15 00:30:46 +09:00
Tsuyoshi Ozawa
b7d48286a9
Rvert "HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R."
...
This reverts commit 965ce9e24e
.
2015-02-15 00:28:59 +09:00
Tsuyoshi Ozawa
965ce9e24e
HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. Contributed by Rakesh R.
2015-02-15 00:13:10 +09:00
Robert Kanter
875256834b
HADOOP-11467. KerberosAuthenticator can connect to a non-secure cluster. (yzhangal via rkanter)
2015-02-13 14:01:46 -08:00
Xuan
253035491c
YARN-3164. RMAdmin command usage prints incorrect command name.
...
Contributed by Bibin A Chundatt
2015-02-12 21:39:16 -08:00
Allen Wittenauer
93b941c637
HADOOP-11565. Add --slaves shell option (aw)
2015-02-12 18:01:28 -08:00
Akira Ajisaka
9395c76697
HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use getTrimmed(). Contributed by Tsuyoshi Ozawa.
2015-02-12 15:50:48 -08:00
Haohui Mai
04d09ecd56
HDFS-7711. Move the entry in CHANGE.txt to the right place.
2015-02-12 15:44:05 -08:00
Haohui Mai
74f38d5917
HDFS-7711. Fix various typos in ClusterSetup.md. Contributed by Brahma Reddy Battula.
2015-02-12 15:39:35 -08:00
Akira Ajisaka
11d8934463
HADOOP-11586. Update use of Iterator to Iterable in AbstractMetricsContext.java. Contributed by Ray Chiang.
2015-02-12 14:41:03 -08:00
Akira Ajisaka
3157d992b0
Move HADOOP-11543 section in CHANGES.txt to remove the conflict between trunk and branch-2.
2015-02-12 14:33:55 -08:00
Allen Wittenauer
58cb9f5293
HDFS-7322. deprecate sbin/hadoop-daemon.sh (aw)
2015-02-12 11:51:35 -08:00
Colin Patrick Mccabe
6b39ad0865
HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe)
2015-02-12 10:40:46 -08:00
Haohui Mai
bc5aa7d0b1
HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in hadoop-common project root. Contributed by Xiaoyu Yao.
2015-02-12 10:30:39 -08:00
cnauroth
67efab935e
HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in hadoop_config.cmd. Contributed by Kiran Kumar M R.
2015-02-11 16:36:09 -08:00
Allen Wittenauer
fe689d34a4
HADOOP-11585. Fix formatting in Tracing.md (Masatake Iwasaki via aw)
2015-02-11 16:14:58 -08:00
Allen Wittenauer
7776847a59
HADOOP-11437. Remove the version and author information from distcp's README file (Brahma Reddy Battula via aw)
2015-02-11 15:47:36 -08:00
Allen Wittenauer
026dfddfa3
HADOOP-11583. Fix syntax error in SecureMode.md (Masatake Iwasaki via aw)
2015-02-11 12:13:48 -08:00
Konstantin V Shvachko
6f6737b3bf
HADOOP-11579. Documentation for truncate. Contributed by Konstantin Shvachko.
2015-02-11 09:50:19 -08:00
Akira Ajisaka
22441ab7b2
HADOOP-11580. Remove SingleNodeSetup.md from trunk. (aajisaka)
2015-02-11 09:08:19 -08:00
Allen Wittenauer
b015fec601
HADOOP-11581. Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls (Brahma Reddy Battula via aw)
2015-02-11 07:49:05 -08:00
Allen Wittenauer
cfd8a2174a
HADOOP-11554. Expose HadoopKerberosName as a hadoop subcommand (aw)
2015-02-11 07:40:39 -08:00
Steve Loughran
c3da2db48f
YARN-2683. [YARN-913] registry config options: document and move to core-default. (stevel)
2015-02-11 14:26:37 +00:00
Allen Wittenauer
7eeca90daa
HADOOP-11559. Add links to RackAwareness and InterfaceClassification to site index (Masatake Iwasaki via aw)
2015-02-10 17:06:03 -08:00
Allen Wittenauer
e9d26fe9eb
HADOOP-11495. Convert site documentation from apt to markdown (Masatake Iwasaki via aw)
2015-02-10 13:39:57 -08:00
Colin Patrick Mccabe
6338ce3ae8
HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without holding the netlock (Liang Xie via Colin P. McCabe)
2015-02-10 13:24:40 -08:00
Harsh J
e0ec0718d0
HADOOP-11512. Use getTrimmedStrings when reading serialization keys. Contributed by Ryan P.
2015-02-10 12:51:56 +05:30
yliu
1b56d1ce32
HADOOP-11510. Expose truncate API via FileContext. (yliu)
2015-02-10 01:45:29 +08:00
Allen Wittenauer
576459801c
HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) (missed file)
2015-02-09 12:54:25 -08:00
Allen Wittenauer
30b797ee9d
HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw)
2015-02-09 12:50:44 -08:00
Arpit Agarwal
ab934e8594
HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai)
2015-02-09 12:17:40 -08:00
Allen Wittenauer
5c79439568
HADOOP-11485. Pluggable shell integration (aw)
2015-02-06 13:09:01 -08:00
Steve Loughran
17165d3df9
HADOOP-11520. Clean incomplete multi-part uploads in S3A tests. (Thomas Demoor via stevel)
2015-02-06 21:01:41 +00:00