big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,443 Commits 2 Branches 2 Tags 264 MiB
a0ff42d761
Commit Graph

5285 Commits

Author SHA1 Message Date
Chris Nauroth
23b1a7bdf1 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 2017-04-11 22:03:09 -07:00
Wei-Chiu Chuang
f050afb578 HADOOP-13665. Erasure Coding codec should support fallback coder. Contributed by Kai Sasaki. 2017-04-11 07:32:13 -07:00
Jason Lowe
0e065f2ede YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu 2017-04-11 08:44:18 -05:00
Chris Douglas
a5e57df3c5 HADOOP-14225. Remove xmlenc dependency 2017-04-10 11:48:40 -07:00
Andrew Wang
be144117a8 HADOOP-14293. Initialize FakeTimer with a less trivial value. 2017-04-10 11:37:01 -07:00
Steve Loughran
2ed65540a3
HADOOP-14066 VersionInfo should be marked as public API 2017-04-08 13:41:10 +01:00
John Zhuge
56e81f2a20 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge. 
Signed-off-by: John Zhuge <jzhuge@apache.org>
 2017-04-07 12:04:44 -07:00
Allen Wittenauer
96cbb4fce2 HADOOP-14202. fix jsvc/secure user var inconsistencies 
Signed-off-by: John Zhuge <jzhuge@apache.org>
 2017-04-07 08:59:21 -07:00
Zhe Zhang
95b7f1d29a HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 2017-04-06 16:59:21 -07:00
Xiaoyu Yao
32bb36b750 HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang. 2017-04-05 17:28:00 -07:00
Andrew Wang
18432130a7 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-04 13:38:25 -07:00
Chris Douglas
6eba79232f HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang 2017-04-03 20:13:14 -07:00
Wei-Chiu Chuang
bbd68478d5 HDFS-11598. Improve -setrep for Erasure Coded files. Contributed by Yiqun Lin. 2017-04-03 07:57:28 -07:00
Jonathan Eagles
1309c585fb HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles) 2017-03-30 14:14:43 -05:00
Wei-Chiu Chuang
8c591b8d19 HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin. 2017-03-30 11:16:05 -07:00
Chris Douglas
7297e82cb4 HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu 2017-03-30 10:17:11 -07:00
Andrew Wang
4966a6e26e HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy. 2017-03-29 14:37:21 -07:00
Mingliang Liu
13c766b62c HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu 2017-03-29 11:13:39 -07:00
Jonathan Eagles
523f467d93 HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles) 2017-03-29 10:12:02 -05:00
Yiqun Lin
6b09336438 HDFS-11577. Combine the old and the new chooseRandom for better performance. Contributed by Chen Liang. 2017-03-28 23:02:07 +08:00
John Zhuge
253e3e78ab HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 2017-03-27 23:05:57 -07:00
Akira Ajisaka
448ec81fd7
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts. 2017-03-28 14:32:40 +09:00
Jonathan Eagles
db2adf356a Configuration#get return value optimization (jeagles) 2017-03-27 12:48:44 -05:00
Jonathan Eagles
858d597be0 Delay construction of PreCondition.check failure message in Configuration#set (jeagles) 2017-03-27 11:01:48 -05:00
Junping Du
6df029db36 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release. 2017-03-25 14:28:48 -07:00
Junping Du
d8e6d6df4c Add 2.8.0 RELEASENOTEs.md and CHANGES.md. 2017-03-25 14:02:25 -07:00
Tsuyoshi Ozawa
84ddedc0b2 HADOOP-10101. Update guava dependency to the latest version. (ozawa) 2017-03-25 10:06:52 +09:00
Andrew Wang
332a997e10 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-24 12:56:46 -07:00
Andrew Wang
52b00600df HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy. 2017-03-24 11:44:46 -07:00
Daniel Templeton
d49d1862a6 YARN-6360. Prevent FS state dump logger from cramming other log files 
(Contributed by Yufei Gu via Daniel Templeton)
 2017-03-24 11:31:04 -07:00
Andrew Wang
0e556a5ba6 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen. 2017-03-24 11:12:02 -07:00
John Zhuge
ab759e91b7 HDFS-10649. Remove unused PermissionStatus#applyUMask. Contributed by Chen Liang. 2017-03-23 23:31:27 -07:00
John Zhuge
128015584d HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 2017-03-23 13:57:08 -07:00
Mingliang Liu
d35e79abc2 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 2017-03-23 13:34:03 -07:00
Ravi Prakash
595f62e362 HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles 2017-03-23 09:28:10 -07:00
Zhe Zhang
59d69257a8 HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 2017-03-22 22:22:22 -07:00
Erik Krogen
e1a99802fc HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen. 2017-03-17 17:12:49 -07:00
Andrew Wang
92ea6d74ec HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 2017-03-17 11:26:02 -07:00
Mingliang Liu
c04fb35c45 HADOOP-14191. Duplicate hadoop-minikdc dependency in hadoop-common module. Contributed by Xiaobing Zhou 2017-03-16 16:08:32 -07:00
Jitendra Pandey
09ad8effb8 HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh. 2017-03-16 12:20:46 -07:00
Mingliang Liu
fa67a96d7b HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu 2017-03-14 14:38:21 -07:00
Mingliang Liu
e6cda5819b Revert "HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu" 
This reverts commit b8c69557b7.
 2017-03-14 13:03:42 -07:00
Chen Liang
9832ae0ed8 HDFS-11482. Add storage type demand to into DFSNetworkTopology#chooseRandom. Contributed by Chen Liang. 2017-03-13 17:30:10 -07:00
Jing Zhao
55796a0946 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 2017-03-13 14:24:51 -07:00
Mingliang Liu
b8c69557b7 HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu 2017-03-13 14:15:02 -07:00
Andrey Dyatlov
04a5f5a6dc
HADOOP-14156. Fix grammar error in ConfTest.java. 
This closes #187

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2017-03-13 16:15:53 +09:00
Ray Chiang
4db9cc70d0 YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang) 2017-03-10 16:13:31 -08:00
Jian He
4478273e5f HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-10 09:25:58 -08:00
Mingliang Liu
fd26783aaf HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 2017-03-10 00:21:20 -08:00
John Zhuge
570827a819 HADOOP-14052. Fix dead link in KMS document. Contributed by Christina Vu. 
Change-Id: I7093f443d93927184196f62f02cc106a2c89e9cf
 2017-03-08 23:50:15 -08:00
Jian He
2be8947d12 Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand" 
This reverts commit 241c1cc05b.
 2017-03-08 13:20:01 -08:00
Jian He
241c1cc05b HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:48:27 -08:00
John Zhuge
98142d2f72 Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran" 
This reverts commit 53a12fa721.
 2017-03-08 09:54:22 -08:00
Arpit Agarwal
1f9848dfe1 HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh. 2017-03-07 11:41:05 -08:00
Arpit Agarwal
959940b0ab HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-07 10:12:35 -08:00
Mingliang Liu
686823529b HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-06 17:16:36 -08:00
Mingliang Liu
52d7d5aa1a Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth" 
This reverts commit 6b7cd62b8c.
 2017-03-06 17:10:11 -08:00
Ray Chiang
d9dc444dc7 YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang) 2017-03-06 14:02:49 -08:00
Andrew Wang
ec839b94c0 HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers. 2017-03-06 10:47:15 -08:00
Akira Ajisaka
209ecd1a5c
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma. 2017-03-07 01:34:51 +09:00
Mingliang Liu
6b7cd62b8c HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 2017-03-03 17:09:12 -08:00
Jason Lowe
05237636d3 YARN-6274. Documentation refers to incorrect nodemanager health checker interval property. Contributed by WeiWei Yang 2017-03-03 07:57:37 -06:00
Harsh J
eb5a17954a HADOOP-6801. io.sort.mb and io.sort.factor were renamed and moved to mapreduce but are still in CommonConfigurationKeysPublic.java and used in SequenceFile.java. 
This closes #146

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2017-03-03 18:38:04 +09:00
Rakesh Radhakrishnan
3749152b66 HDFS-11416. Refactor out system default erasure coding policy. Contributed by Andrew Wang. 2017-03-03 09:28:03 +05:30
Andrew Wang
8f4817f2c5 Revert "HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru." 
This reverts commit e61491d476.
 2017-03-02 16:20:48 -08:00
Arpit Agarwal
e61491d476 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-02 15:38:25 -08:00
Arpit Agarwal
eeca8b0c4e HDFS-11419. HDFS specific network topology classes with storage type info included. Contributed by Chen Liang. 2017-03-02 09:21:27 -08:00
Arpit Agarwal
899d5c4d49 HDFS-11479. Socket re-use address option should be used in SimpleUdpServer. Contributed by Mukul Kumar Singh. 2017-03-01 12:59:02 -08:00
Brahma Reddy Battula
dcd03df9f9 HDFS-11432. Federation : Support fully qualified path for Quota/Snapshot/cacheadmin/cryptoadmin commands. Contributed by Brahma Reddy Battula. 2017-03-01 10:45:56 +05:30
Akira Ajisaka
258342e76c HADOOP-14118. move jets3t into a dependency on hadoop-aws JAR. 2017-02-28 13:47:44 +09:00
Yiqun Lin
9db2e0c8d4 HADOOP-14119. Remove unused imports from GzipCodec.java. Contributed by Yiqun Lin. 2017-02-27 18:39:14 +08:00
Xuan
289bc50e66 HADOOP-14116:FailoverOnNetworkExceptionRetry does not wait when failover 
on certain exception. Contributed by Jian He
 2017-02-24 11:42:23 -08:00
Andrew Wang
c1a52b04d0 HDFS-11427. Rename rs-default to rs. 2017-02-24 10:58:45 -08:00
Harsh J
e8694deb6a HADOOP-13817. Add a finite shell command timeout to ShellBasedUnixGroupsMapping. (harsh) 2017-02-24 21:34:00 +05:30
Akira Ajisaka
50decd3613 HADOOP-14097. Remove Java6 specific code from GzipCodec.java. Contributed by Elek, Marton. 2017-02-25 00:28:31 +09:00
Andrew Wang
132f758e3d HDFS-11426. Refactor EC CLI to be similar to storage policies CLI. 2017-02-23 16:00:11 -08:00
Mingliang Liu
a4d4a23785 HADOOP-13321. Deprecate FileSystem APIs that promote inefficient call patterns. Contributed by Chris Nauroth and Mingliang Liu 2017-02-23 12:55:40 -08:00
Mingliang Liu
003ae00693 HDFS-11430. Separate class InnerNode from class NetworkTopology and make it extendable. Contributed by Tsz Wo Nicholas Sze 2017-02-21 15:32:46 -08:00
Eric Yang
172b23af33 HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu. 2017-02-18 18:34:13 -08:00
Yongjun Zhang
4c26c241ad HADOOP-13805. UGI.getCurrentUser() fails if user does not have a keytab associated. Contributed by Xiao Chen, Wei-Chiu Chuang, Yongjun Zhang. 2017-02-17 09:18:50 -08:00
Wei-Chiu Chuang
5690b51ef7 HDFS-11100. Recursively deleting file protected by sticky bit should fail. Contributed by John Zhuge. 2017-02-16 05:39:37 -08:00
Wei-Chiu Chuang
cc45da79fd HADOOP-13233. help of stat is confusing. Contributed by Attila Bukor. 2017-02-13 10:14:45 -08:00
Arpit Agarwal
0aacd8fd25 HDFS-11403. Zookeper ACLs on NN HA enabled clusters should be handled consistently. Contributed by Hanisha Koneru. 2017-02-11 01:17:56 -08:00
Kihwal Lee
0c01cf5798 HADOOP-14033. Reduce fair call queue lock contention. Contributed by Daryn Sharp. 2017-02-09 16:17:24 -06:00
Kihwal Lee
b6bb99c18a HADOOP-14034. Allow ipc layer exceptions to selectively close connections. Contributed by Daryn Sharp. 2017-02-09 10:47:29 -06:00
Kihwal Lee
a0bfb41504 HADOOP-14032. Reduce fair call queue priority inversion. Contributed by Daryn Sharp. 2017-02-09 10:04:28 -06:00
Junping Du
eec52e158b YARN-6145. Improve log message on fail over. Contributed by Jian He. 2017-02-08 02:11:19 -08:00
Xiao Chen
2007e0cf2a HDFS-11210. Enhance key rolling to guarantee new KeyVersion is returned from generateEncryptedKeys after a key is rolled. 2017-02-07 20:36:11 -08:00
Xiao Chen
69b23632c4 HDFS-10860. Switch HttpFS from Tomcat to Jetty. Contributed by John Zhuge. 2017-02-07 09:36:55 -08:00
Xiao Chen
d88497d44a HADOOP-14047. Require admin to access KMS instrumentation servlets. Contributed by John Zhuge. 2017-02-06 13:14:17 -08:00
Junping Du
cce35c3815 HADOOP-12097. Allow port range to be specified while starting webapp. Contributed by Varun Saxena. 2017-02-05 19:42:11 -08:00
Yiqun Lin
3ea6d3517e HDFS-11371. Document missing metrics of erasure coding. Contributed by Yiqun Lin. 2017-02-04 11:01:27 +08:00
Akira Ajisaka
cb8f3f3adf HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin. 2017-02-04 10:58:08 +09:00
Xiao Chen
ba75bc7593 HADOOP-14044. Synchronization issue in delegation token cancel functionality. Contributed by Hrishikesh Gadre. 2017-02-03 17:13:53 -08:00
Chris Douglas
59c5f18784 HADOOP-13895. Make FileStatus Serializable 2017-02-01 10:19:36 -08:00
Xiao Chen
ebd40056a0 HADOOP-13992. KMS should load SSL configuration the same way as SSLFactory. Contributed by John Zhuge. 2017-01-27 10:49:26 -08:00
Xiaoyu Yao
2034315763 HADOOP-14029. Fix KMSClientProvider for non-secure proxyuser use case. Contributed by Xiaoyu Yao. 2017-01-26 20:34:32 -08:00
Andrew Wang
ff02bdfe65 Add CHANGES, RELEASENOTES, and jdiff for 3.0.0-alpha2 release. 2017-01-25 15:39:40 -08:00
Jason Lowe
9e19f758c1 YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger 2017-01-25 21:41:43 +00:00
Xiaoyu Yao
a46933e8ce HADOOP-13988. KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUser. Contributed by Greg Senia and Xiaoyu Yao. 2017-01-25 13:33:06 -08:00
Steve Loughran
7fc3e68a87 HADOOP-13433 Race in UGI.reloginFromKeytab. Contributed by Duo Zhang. 2017-01-25 21:29:27 +00:00
Xiao Chen
9c0a4d3e71 HADOOP-13990. Document KMS usage of CredentialProvider API. Contributed by John Zhuge. 2017-01-24 21:30:10 -08:00
Arpit Agarwal
b57368b6f8 HDFS-11194. Maintain aggregated peer performance metrics on NameNode. 2017-01-24 16:58:20 -08:00
Eric Yang
a847903b6e HADOOP-13119. Add ability to secure log servlet using proxy users. Contribute by Yuanbo Liu. 2017-01-21 15:43:18 -08:00
Lei Xu
e015b56319 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 2017-01-20 14:48:04 +08:00
Andrew Wang
5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Daniel Templeton
f5839fd6df YARN-6028. Add document for container metrics (Contributed by Weiwei Yang via Daniel Templeton) 2017-01-19 12:45:17 -08:00
Akira Ajisaka
1763467210 HADOOP-14001. Improve delegation token validity checking. 2017-01-19 17:56:39 +09:00
Yiqun Lin
383aa9c9f5 HADOOP-13965. Groups should be consistent in using default group mapping class. Contributed by Yiqun Lin. 2017-01-19 09:42:56 +08:00
Allen Wittenauer
0eb4b513b7 HADOOP-13673. Update scripts to be smarter when running with privilege 
Signed-off-by: Andrew Wang <wang@apache.org>
Signed-off-by: Ravi Prakash <raviprak@apache.org>
 2017-01-18 14:39:05 -08:00
Akira Ajisaka
9130af3f74 HADOOP-13955. Replace deprecated HttpServer2 and SSLFactory constants. Contributed by John Zhuge. 2017-01-18 18:11:33 +09:00
Kihwal Lee
706d630eb9 HADOOP-13976. Path globbing does not match newlines. Contributed by Eric Badger. 2017-01-17 15:10:24 -06:00
Akira Ajisaka
e407449ddb HADOOP-13933. Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagers. Contributed by Surendra Singh Lilhore. 2017-01-17 10:10:23 +09:00
Jitendra Pandey
d1d0b3e1fd HDFS-11307. The rpc to portmap service for NFS has hardcoded timeout. Contributed by Mukul Kumar Singh. 2017-01-16 14:53:53 -08:00
Lei Xu
ed09c1418d HADOOP-13928. TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime error. (John Zhuge via lei) 2017-01-15 14:02:11 +08:00
Andrew Wang
5f336512d0 HADOOP-13961. Fix compilation failure from missing hadoop-kms test jar. Contributed by Sangjin Lee and John Zhuge. 2017-01-11 15:48:50 -08:00
Steve Loughran
e648b6e138 HADOOP-13336 S3A to support per-bucket configuration. Contributed by Steve Loughran 2017-01-11 17:25:15 +00:00
Arun Suresh
be529dade1 HADOOP-13903. Improvements to KMS logging to help debug authorization errors. (Tristan Stevens via asuresh) 2017-01-11 00:26:02 -08:00
Arpit Agarwal
4046794a53 HDFS-11299. Support multiple Datanode File IO hooks. Contributed by Hanisha Koneru. 2017-01-10 10:43:11 -08:00
Andrew Wang
511d39e074 HADOOP-13885. Implement getLinkTarget for ViewFileSystem. Contributed by Manoj Govindassamy. 2017-01-09 18:01:37 -08:00
Wei-Chiu Chuang
0a212a40fc HADOOP-13953. Make FTPFileSystem's data connection mode and transfer mode configurable. Contributed by Xiao Chen. 2017-01-09 15:18:26 -08:00
Arpit Agarwal
4a659ff40f HDFS-11282. Document the missing metrics of DataNode Volume IO operations. Contributed by Yiqun Lin. 2017-01-05 19:34:32 -08:00
Xiao Chen
5d182949ba HADOOP-13597. Switch KMS from Tomcat to Jetty. Contributed by John Zhuge. 2017-01-05 17:21:57 -08:00
Jason Lowe
a0a2761621 HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales 2017-01-04 14:46:25 +00:00
Akira Ajisaka
01d31fe938 HADOOP-12733. Remove references to obsolete io.seqfile configuration variables. Contributed by Ray Chiang. 2017-01-04 14:10:36 +09:00
Mingliang Liu
88731c731a Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran" 
This reverts commit 451efb08fe.
 2017-01-03 14:44:26 -08:00
Mingliang Liu
451efb08fe HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 2017-01-03 13:08:38 -08:00
Robert Kanter
591fb15944 YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter) 2017-01-03 12:13:32 -08:00
Brahma Reddy Battula
6938b67711 HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin. 2016-12-31 16:16:02 +05:30
Akira Ajisaka
0665c5f09a HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula. 2016-12-28 01:39:30 +09:00
Daniel Templeton
ded2d08f33 HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton) 2016-12-27 07:18:08 -08:00
Xiaoyu Yao
4e9029653d HDFS-10917. Collect peer performance statistics on DataNode. Contributed by Xiaobing Zhou. 2016-12-22 23:46:58 -08:00
Mingliang Liu
e92a77099b HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth 2016-12-22 20:15:18 -08:00
Akira Ajisaka
22befbd585 MAPREDUCE-6704. Update the documents to run MapReduce application. Contributed by Bibin A Chundatt. 2016-12-23 04:48:04 +09:00
Kai Zheng
56a13a6a59 HDFS-11216. Add remoteBytesRead counter metrics for erasure coding reconstruction task. Contributed by Sammi Chen 2016-12-22 14:18:54 +08:00
Akira Ajisaka
f6e2521eb2 HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin. 2016-12-21 14:17:47 +09:00
Xiao Chen
30f85d7a88 HADOOP-13911. Remove TRUSTSTORE_PASSWORD related scripts from KMS. Contributed by John Zhuge. 2016-12-20 16:02:26 -08:00
Jason Lowe
631f1daee3 HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger 2016-12-15 20:52:40 +00:00
Jason Lowe
169bfc0903 Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger" 
This reverts commit 9947aeb60c.
 2016-12-15 20:51:24 +00:00
Xiaoyu Yao
f5e0bd30fd HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao. 2016-12-14 13:45:21 -08:00
Arpit Agarwal
6ba9587d37 HDFS-10958. Add instrumentation hooks around Datanode disk IO. 2016-12-14 11:18:58 -08:00
Akira Ajisaka
72bff192cd HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin. 2016-12-14 18:50:43 +09:00
Jason Lowe
9947aeb60c HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger 2016-12-13 22:55:09 +00:00
Steve Loughran
f66f61892a HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran 2016-12-12 13:58:27 +00:00
Xiaoyu Yao
4c38f11cec HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 2016-12-09 21:27:04 -08:00
Wei-Chiu Chuang
b606e025f1 HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge. 2016-12-09 15:22:21 -08:00
Brahma Reddy Battula
80b8023276 HADOOP-13883. Add description of -fs option in generic command usage. Contributed By Yiqun Lin. 2016-12-09 18:21:42 +05:30
Akira Ajisaka
7d8e440eee Revert "HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran" 
This reverts commit c265515725.
 2016-12-09 12:49:27 +09:00
Steve Loughran
c265515725 HADOOP-13852 hadoop build to allow hadoop version property to be explicitly set. Contriibuted by Steve Loughran 2016-12-08 17:57:15 +00:00
Brahma Reddy Battula
0ef796174e HADOOP-13867. FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementations. Contributed By Vinayakumar B. 2016-12-08 18:57:43 +05:30
Akira Ajisaka
deb4743b2c Revert "HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin." 
This reverts commit 0857641f62.
 2016-12-08 13:37:06 +09:00
Akira Ajisaka
0857641f62 HDFS-11140. Directory Scanner should log startup message time correctly. Contributed by Yiqun Lin. 2016-12-08 13:34:45 +09:00
Ming Ma
c73e08a6da HDFS-10206. Datanodes not sorted properly by distance when the reader isn't a datanode. (Nandakumar via mingma) 2016-12-07 08:26:09 -08:00
Karthik Kambatla
c8d0a049b0 HADOOP-13859. TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties. (Haibo Chen via kasha) 2016-12-06 14:10:58 -08:00
Andrew Wang
f53b481ffe HDFS-11172. Support an erasure coding policy using RS 10 + 4. Contributed by Wei Zhou. 2016-12-06 12:49:38 -08:00
Xiao Chen
79d90b810c HADOOP-13827. Add reencryptEncryptedKey interface to KMS. 2016-12-06 12:04:04 -08:00
Andrew Wang
7b988e8899 HADOOP-13861. Spelling errors in logging and exceptions for code. Contributed by Grant Sohn. 2016-12-05 23:18:18 -08:00
Akira Ajisaka
b2a3d6c519 HADOOP-13835. Move Google Test Framework code from mapreduce to hadoop-common. Contributed by Varun Vasudev. 2016-12-06 14:01:47 +09:00
Xiao Chen
a2b5d60220 HADOOP-13864. KMS should not require truststore password. Contributed by Mike Yoder. 2016-12-05 17:36:00 -08:00
Xiao Chen
291df5c7fb HADOOP-13847. KMSWebApp should close KeyProviderCryptoExtension. Contributed by John Zhuge. 2016-12-05 09:35:17 -08:00
Mingliang Liu
19f373a46b HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane 2016-12-01 12:54:28 -08:00
Andrew Wang
1f7613be95 HADOOP-13840. Implement getUsed() for ViewFileSystem. Contributed by Manoj Govindassamy. 2016-11-30 17:55:12 -08:00
Kai Zheng
51e6c1cc3f HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen 2016-11-30 15:52:56 +08:00
Kai Zheng
cfd8076f81 Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen" 
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
 2016-11-30 15:44:52 +08:00
Akira Ajisaka
00096dcc0c HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 2016-11-29 19:47:02 +09:00
Akira Ajisaka
67d9f2808e HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project. 2016-11-29 14:07:19 +09:00
Robert Kanter
47ca9e26fb HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 2016-11-28 18:08:09 -08:00
Andrew Wang
a2b1ff0257 HADOOP-13828. Implement getFileChecksum(path, length) for ViewFileSystem. Contributed by Manoj Govindassamy. 2016-11-28 11:54:43 -08:00
Kai Zheng
5d5614f847 HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen 2016-11-28 14:34:44 +08:00
Akira Ajisaka
209e805430 HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki. 2016-11-28 14:34:57 +09:00
Harsh J
07825f2b49 HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J. 2016-11-25 22:22:23 +05:30
Brahma Reddy Battula
ee3d437a33 HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula. 2016-11-25 19:54:50 +05:30
Steve Loughran
01665e456d HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli 
Cherry picked from 24715cefe80fba531dd16a44ec1cead67c389eb1
 2016-11-24 17:54:10 +00:00
Steve Loughran
3df3fa396c HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula. 2016-11-24 17:44:36 +00:00
Brahma Reddy Battula
13501053dd HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula. 2016-11-24 22:23:22 +05:30
Steve Loughran
abb9fa7fc6 HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash 2016-11-24 16:41:59 +00:00
Andrew Wang
c7a5f2906f HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li. 2016-11-23 17:08:38 -08:00
Mingliang Liu
860d49aa6a HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran 2016-11-23 16:42:27 -08:00
Andrew Wang
de4894936a HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R. 2016-11-23 16:42:06 -08:00
Andrew Wang
dd98a8005a HDFS-11058. Implement 'hadoop fs -df' command for ViewFileSystem. Contributed by Manoj Govindassamy. 2016-11-23 16:40:39 -08:00
Jian He
3d94da1e00 HADOOP-11552. Allow handoff on the server side for RPC requests. Contributed by Siddharth Seth 2016-11-23 16:01:55 -08:00
Mingliang Liu
2bf9a15e8a HADOOP-13166. Add getFileStatus("/") test to AbstractContractGetFileStatusTest. Contributed by Steve Loughran 2016-11-22 14:27:23 -08:00
Lei Xu
3a09e5970d HDFS-11145. Implement getTrashRoot() for ViewFileSystem. (Manoj Govindassamy via lei) 2016-11-22 13:52:09 -08:00
Mingliang Liu
beb70fed4f HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran 
This closes #131
 2016-11-22 13:12:23 -08:00
Brahma Reddy Battula
afcf8d38e7 HADOOP-13646. Remove outdated overview.html. Contributed By Brahma Reddy Battula. 2016-11-22 19:45:45 +05:30
Akira Ajisaka
c65d6b6541 HADOOP-13814. Sample configuration of KMS HTTP Authentication signature is misleading. Contributed by Masahiro Tanaka. 2016-11-21 11:25:11 +09:00
Wei-Chiu Chuang
c0b1a44f6c HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory. 2016-11-17 22:48:35 -06:00
Mingliang Liu
ae8849fe37 HADOOP-11601. Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files. Contributed by Steve Loughran 2016-11-17 14:11:38 -08:00
Kihwal Lee
bd3735554f HADOOP-13742. Expose NumOpenConnectionsPerUser as a metric. Brahma Reddy Battula. 2016-11-17 12:16:38 -06:00
Mingliang Liu
aab9737a05 HADOOP-13822. Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics(). Contribute by Brahma Reddy Battula 2016-11-16 20:08:48 -08:00
Xiao Chen
61c0bedf77 HADOOP-13815. TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk. 2016-11-15 16:26:27 -08:00
Mingliang Liu
5af572b644 HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu 2016-11-15 10:57:00 -08:00
Mingliang Liu
04014c4c73 HADOOP-13810. Add a test to verify that Configuration handles &-encoded characters. Contributed by Steve Loughran 
This closes #158
 2016-11-14 19:38:10 -08:00
Zhe Zhang
ff0b99eafe HDFS-10872. Add MutableRate metrics for FSNamesystemLock operations. Contributed by Erik Krogen. 2016-11-14 11:05:29 -08:00
Chris Douglas
5c61ad2488 HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane 2016-11-11 11:15:07 -08:00
Yongjun Zhang
fd2f22adec HADOOP-13720. Add more info to the msgs printed in AbstractDelegationTokenSecretManager. Contributed by Yongjun Zhang. 2016-11-10 22:42:59 -08:00
Yongjun Zhang
470bdaa27a HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang) 2016-11-10 22:38:38 -08:00
Akira Ajisaka
8848a8a76c HDFS-11116. Fix javac warnings caused by deprecation of APIs in TestViewFsDefaultValue. Contributed by Yiqun Lin. 2016-11-11 13:45:30 +09:00
Xiao Chen
822ae88f7d HADOOP-13346. DelegationTokenAuthenticationHandler writes via closed writer. Contributed by Gregory Chanan and Hrishikesh Gadre. 2016-11-09 09:33:00 -08:00
Xiao Chen
367c3d4121 HADOOP-13590. Retry until TGT expires even if the UGI renewal thread encountered exception. 2016-11-09 09:07:12 -08:00
Akira Ajisaka
c074880096 HADOOP-13800. Remove unused HADOOP_AUDIT_LOGGER from hadoop-env.sh. Contributed by Yiqun Lin. 2016-11-09 22:02:40 +09:00
Andrew Wang
e1c6ef2efa HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey. 2016-11-08 16:33:55 -08:00
Zhe Zhang
77c13c3857 HADOOP-13782. Make MutableRates metrics thread-local write, aggregate-on-read. Contributed by Erik Krogen. 2016-11-08 16:07:36 -08:00
Mingliang Liu
2a65eb121e HADOOP-13802. Make generic options help more consistent, and aligned. Contributed by Grant Sohn 2016-11-08 15:40:22 -08:00
Subru Krishnan
29e3b3417c YARN-5833. Add validation to ensure default ports are unique in Configuration. (Konstantinos Karanasos via Subru). 2016-11-08 14:38:18 -08:00
Brahma Reddy Battula
dbb133ccfc HADOOP-13707. If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed. Contributed by Yuanbo Liu. 2016-11-08 20:55:10 +05:30
Zhe Zhang
3dbad5d823 HADOOP-13804. MutableStat mean loses accuracy if add(long, long) is used. Contributed by Erik Krogen. 2016-11-07 16:08:10 -08:00
Steve Loughran
f76895573d HADOOP-13797 Remove hardcoded absolute path for ls. Contributed by Christine Koppelt 2016-11-07 12:36:10 +00:00
Xiao Chen
d8bab3dcb6 HDFS-10756. Expose getTrashRoot to HTTPFS and WebHDFS. Contributed by Yuanbo Liu. 2016-11-04 18:06:55 -07:00
Xiaoyu Yao
95665a6eea Revert "HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao." 
This reverts commit 9097e2efe4.
 2016-11-04 16:02:47 -07:00
Akira Ajisaka
de0132748d MAPREDUCE-6796. Remove unused properties from JTConfig.java. Contributed by Haibo Chen. 2016-11-05 03:49:19 +09:00
Mingliang Liu
abfc15d5ef HADOOP-13792. Stackoverflow for schemeless defaultFS with trailing slash. Contributed by John Zhuge 2016-11-04 10:46:27 -07:00
Xiao Chen
7154a20bcb HADOOP-12453. Support decoding KMS Delegation Token with its own Identifier. Contributed by Xiaoyu Yao. 2016-11-03 13:09:03 -07:00
Andrew Wang
7e521c5a49 HDFS-11080. Update HttpFS to use ConfigRedactor. Contributed by Sean Mackrory. 2016-11-02 19:11:05 -07:00
Daniel Templeton
0dc2a6a3a5 HADOOP-13667. Fix typing mistake of inline document in hadoop-metrics2.properties (Contributed by Rui Gao via Daniel Templeton) 2016-11-02 06:53:33 -07:00
Arpit Agarwal
1b6ecaf016 HADOOP-13738. DiskChecker should perform some disk IO. 2016-11-01 18:02:23 -07:00
Steve Loughran
a1761a841e HADOOP-13680. fs.s3a.readahead.range to use getLongBytes. Contributed by Abhishek Modi. 2016-10-31 20:54:46 +00:00
Wei-Chiu Chuang
112f04eb1b HDFS-11061. Update dfs -count -t command line help and documentation. Contributed by Yiqun Lin. 2016-10-28 15:33:27 -07:00
Jason Lowe
c017171da0 HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang 2016-10-28 14:57:50 +00:00
Xiao Chen
b62bc2bbd8 HADOOP-13763. KMS REST API Documentation Decrypt URL typo. Contributed by Jeffrey E Rodriguez. 2016-10-27 18:05:40 -07:00
Robert Kanter
5877f20f9c HADOOP-10075. Update jetty dependency to version 9 (rkanter) 2016-10-27 16:09:00 -07:00
Brahma Reddy Battula
0c837db8a8 HADOOP-13201. Print the directory paths when ViewFs denies the rename operation on internal dirs. Contributed by Tianyin Xiu 2016-10-27 19:46:41 +05:30
Masatake Iwasaki
0bdd263d82 HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran. 2016-10-27 15:46:59 +09:00
Andrew Wang
22ff0eff4d HADOOP-8299. ViewFileSystem link slash mount point crashes with IndexOutOfBoundsException. Contributed by Manoj Govindassamy. 2016-10-26 14:25:03 -07:00
Chris Nauroth
1f8490a5ba HADOOP-13502. Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests. Contributed by Chris Nauroth. 2016-10-26 08:55:42 -07:00
Chris Nauroth
9cad3e2350 HADOOP-13614. Purge some superfluous/obsolete S3 FS tests that are slowing test runs down. Contributed by Steve Loughran. 2016-10-26 08:27:26 -07:00
Wei-Chiu Chuang
d88dca844a HADOOP-11798. Native raw erasure coder in XOR codes. Contributed by SammiChen. 2016-10-25 16:53:53 -07:00
Andrew Wang
084bdab156 HDFS-5684. Annotate o.a.h.fs.viewfs.ViewFileSystem.MountPoint as VisibleForTesting. Contributed by Manoj Govindassamy. 2016-10-25 15:35:39 -07:00
Andrew Wang
86c735bcb1 Revert "HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu." 
This reverts commit cef61d505e.
 2016-10-25 13:45:52 -07:00
Xiao Chen
09ef97dccb HADOOP-13669. Addendum patch 2 for KMS Server should log exceptions before throwing. 2016-10-25 09:59:12 -07:00
Chris Nauroth
309a43925c HADOOP-13309. Document S3A known limitations in file ownership and permission model. Contributed by Chris Nauroth. 2016-10-25 09:03:03 -07:00
Chris Nauroth
d8fa1cfa67 HADOOP-13727. S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. Contributed by Chris Nauroth. 2016-10-24 21:22:34 -07:00
Akira Ajisaka
dc3272bfe8 HDFS-11046. Duplicate '-' in the daemon log name. 2016-10-25 10:07:43 +09:00
Xiaoyu Yao
d0a347984d HADOOP-13749. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao. 2016-10-23 10:58:36 -07:00
Xiaoyu Yao
da901b6c14 Revert "HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao." 
This reverts commit be72372248.
 2016-10-23 08:25:37 -07:00
Wei-Chiu Chuang
25438526ed HDFS-11033. Add documents for native raw erasure coder in XOR codes. Contributed by SammiChen. 2016-10-21 16:20:07 -07:00
Xiaoyu Yao
be72372248 HDFS-10757. KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used. Contributed by Xiaoyu Yao. 2016-10-21 14:23:02 -07:00
Chris Douglas
ae8bccd509 HADOOP-13702. Add instrumented ReadWriteLock. Contributed by Jingcheng Du 2016-10-21 12:59:54 -07:00
Anu Engineer
262827cf75 HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal. 2016-10-20 13:35:26 -07:00
Anu Engineer
3fbf4cd5da HADOOP-13716. Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup. Contributed by Steve Loughran. 2016-10-20 12:33:58 -07:00
Brahma Reddy Battula
f872c6bc03 HADOOP-13236. truncate will fail when we use viewfilesystem. Contributed by Brahma Reddy Battula 2016-10-20 21:47:17 +05:30
Benoy Antony
4bca385241 HADOOP-12082 Support multiple authentication schemes via AuthenticationFilter 2016-10-18 18:32:01 -07:00
Xiao Chen
d75cbc5749 HADOOP-13693. Remove the message about HTTP OPTIONS in SPNEGO initialization message from kms audit log. 2016-10-18 18:24:59 -07:00
Xiao Chen
efdf810cf9 HADOOP-7352. FileSystem#listStatus should throw IOE upon access error. Contributed by John Zhuge. 2016-10-18 18:18:43 -07:00
Steve Loughran
6c348c5691 HADOOP-13560. S3ABlockOutputStream to support huge (many GB) file writes. Contributed by Steve Loughran 2016-10-18 21:16:02 +01:00
Kai Zheng
c023c74886 HADOOP-13061. Refactor erasure coders. Contributed by Kai Sasaki 2016-10-18 12:02:53 +06:00
Akira Ajisaka
bedfec0c10 HADOOP-13522. Add %A and %a formats for fs -stat command to print permissions. Contributed by Alex Garbarini. 2016-10-18 15:00:44 +09:00
Andrew Wang
b671ee6846 HDFS-11013. Correct typos in native erasure coding dump code. Contributed by László Bence Nagy. 2016-10-17 14:14:50 -07:00
Andrew Wang
987ee51141 HADOOP-13724. Fix a few typos in site markdown documents. Contributed by Ding Fei. 2016-10-17 13:25:58 -07:00
Andrew Wang
0f4afc8100 HADOOP-13722. Code cleanup -- ViewFileSystem and InodeTree. Contributed by Manoj Govindassamy. 2016-10-17 13:15:11 -07:00
Wei-Chiu Chuang
ed9fcbec54 HADOOP-13661. Upgrade HTrace version. Contributed by Sean Mackrory. 2016-10-17 05:04:49 -07:00
Andrew Wang
aee538be6c HADOOP-13721. Remove stale method ViewFileSystem#getTrashCanLocation. Contributed by Manoj Govindassamy. 2016-10-14 14:08:31 -07:00
Xiaoyu Yao
dbe663d524 HADOOP-13686. Adding additional unit test for Trash (I). Contributed by Weiwei Yang. 2016-10-13 23:05:16 -07:00
Akira Ajisaka
5a5a724731 HADOOP-13417. Fix javac and checkstyle warnings in hadoop-auth package. 2016-10-14 14:45:55 +09:00
Xiao Chen
ae51b11f78 HADOOP-13669. Addendum patch for KMS Server should log exceptions before throwing. 2016-10-13 22:32:08 -07:00
Arpit Agarwal
008122b3c9 HADOOP-13710. Supress CachingGetSpaceUsed from logging interrupted exception stacktrace. Contributed by Hanisha Koneru. 2016-10-13 11:37:03 -07:00
Xiaoyu Yao
9097e2efe4 HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao. 2016-10-13 10:52:28 -07:00
Andrew Wang
12d739a34b HADOOP-13700. Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures. 2016-10-12 15:19:52 -07:00
Kihwal Lee
85cd06f663 HDFS-10789. Route webhdfs through the RPC call queue. Contributed by Daryn Sharp and Rushabh S Shah. 2016-10-12 15:11:42 -05:00
Xiao Chen
b84c4891f9 HADOOP-13698. Document caveat for KeyShell when underlying KeyProvider does not delete a key. 2016-10-11 17:05:00 -07:00
Andrew Wang
8a09bf7c19 HADOOP-13705. Revert HADOOP-13534 Remove unused TrashPolicy#getInstance and initialize code. 2016-10-11 13:46:07 -07:00
Wei-Chiu Chuang
4b32b1420d HADOOP-13684. Snappy may complain Hadoop is built without snappy if libhadoop is not found. Contributed by Wei-Chiu Chuang. 2016-10-11 13:21:33 -07:00
Mingliang Liu
2fb392a587 HADOOP-13697. LogLevel#main should not throw exception if no arguments. Contributed by Mingliang Liu 2016-10-11 10:57:08 -07:00
Mingliang Liu
c874fa914d HDFS-10985. o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions. Contributed by Mingliang Liu 2016-10-10 13:33:07 -07:00
Xiao Chen
65912e4027 HADOOP-13669. KMS Server should log exceptions before throwing. Contributed by Suraj Acharya. 2016-10-10 12:51:12 -07:00
Andrew Wang
03060075c5 HADOOP-13699. Configuration does not substitute multiple references to the same var. 2016-10-10 12:19:26 -07:00
Steve Loughran
cef61d505e HADOOP-13696. change hadoop-common dependency scope of jsch to provided. Contributed by Yuanbo Liu. 2016-10-10 12:32:39 +01:00
Kai Zheng
3d59b18d49 HADOOP-13641. Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation. Contributed by Huafeng Wang 2016-10-09 15:53:36 +06:00
Kai Zheng
ec0b70716c HADOOP-12579. Deprecate WriteableRPCEngine. Contributed by Wei Zhou 2016-10-09 15:07:03 +06:00
Xiao Chen
2e853be657 HADOOP-13627. Have an explicit KerberosAuthException for UGI to throw, text from public constants. Contributed by Xiao Chen. 2016-10-07 13:46:27 -07:00
Robert Kanter
c183b9de8d HADOOP-12611. TestZKSignerSecretProvider#testMultipleInit occasionally fail (ebadger via rkanter) 2016-10-07 09:33:31 -07:00
Steve Loughran
ebd4f39a39 HADOOP-12977 s3a to handle delete("/", true) robustly. Contributed by Steve Loughran. 2016-10-07 12:51:40 +01:00
Chris Nauroth
1d330fbaf6 HADOOP-13150. Avoid use of toString() in output of HDFS ACL shell commands. Contributed by Chris Nauroth. 2016-10-06 13:19:16 -07:00
Chris Nauroth
2d46c3f6b7 HADOOP-13323. Downgrade stack trace on FS load from Warn to debug. Contributed by Steve Loughran. 2016-10-06 10:57:01 -07:00
Brahma Reddy Battula
35b9d7de9f HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin 2016-10-06 18:06:08 +05:30
Brahma Reddy Battula
b90fc70d67 HDFS-10963. Reduce log level when network topology cannot find enough datanodes. Contributed by Xiao chen 2016-10-06 17:47:31 +05:30
Wei-Chiu Chuang
c5ca216915 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge. 2016-10-05 17:36:50 -07:00
Mingliang Liu
00160f71b6 HADOOP-13628. Support to retrieve specific property from configuration via REST API. Contributed by Weiwei Yang 2016-10-05 16:50:01 -04:00
Akira Ajisaka
9a61b52fbe HADOOP-13685. Document -safely option of rm command. Contributed by Xiaoyu Yao. 2016-10-05 20:41:08 +09:00
Xiao Chen
853d65a157 HDFS-10918. Add a tool to get FileEncryptionInfo from CLI. Contributed by Xiao Chen. 2016-10-03 16:01:54 -07:00
Xiao Chen
89bd6d29a6 HADOOP-13317. Add logs to KMS server-side to improve supportability. Contributed by Suraj Acharya. 2016-09-30 17:51:39 -07:00
Wei-Chiu Chuang
57aec2b46b HADOOP-12974. Create a CachingGetSpaceUsed implementation that uses df. Contributed by Elliott Clark. 2016-09-30 12:58:37 -07:00
Chris Nauroth
1e0ea27e96 Revert "HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin." 
This reverts commit 0458a2af6e.
 2016-09-29 13:59:09 -07:00
Kihwal Lee
236ac773c9 HADOOP-13537. Support external calls in the RPC call queue. Contributed by Daryn Sharp. 2016-09-29 13:27:30 -05:00
Steve Loughran
ee0c722dc8 HADOOP-13164 Optimize S3AFileSystem::deleteUnnecessaryFakeDirectories. Contributed by Rajesh Balamohan. 2016-09-29 17:01:00 +01:00
Steve Loughran
1518cb9532 HADOOP-13663 Index out of range in SysInfoWindows. Contributed by Inigo Goiri 2016-09-29 11:35:00 +01:00
Kihwal Lee
e19b37ead2 HADOOP-11780. Prevent IPC reader thread death. Contributed by Daryn Sharp. 2016-09-28 08:24:21 -05:00
Mingliang Liu
9a44a832a9 HADOOP-13658. Replace config key literal strings with names I: hadoop common. Contributed by Chen Liang 2016-09-27 17:36:53 -07:00
Wangda Tan
875062b5bc HADOOP-13544. JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs. (vinodkv via wangda) 2016-09-27 11:26:45 -07:00
Brahma Reddy Battula
edf0d0f8b2 HDFS-9444. Add utility to find set of available ephemeral ports to ServerSocketUtil. Contributed by Masatake Iwasaki 2016-09-27 07:04:37 +05:30
Xiao Chen
fa397e74fe HADOOP-13638. KMS should set UGI's Configuration object properly. Contributed by Wei-Chiu Chuang. 2016-09-26 13:00:57 -07:00
Konstantin V Shvachko
6eb700ee74 HDFS-10866. Fix Eclipse Java compile errors related to generic parameters. Contributed by Konstantin Shvachko. 2016-09-23 14:10:11 -07:00
Brahma Reddy Battula
bbdf350ff9 HDFS-10886. Replace fs.default.name with fs.defaultFS in viewfs document. 2016-09-23 19:21:34 +05:30
Mingliang Liu
e80386d69d HADOOP-13601. Fix a log message typo in AbstractDelegationTokenSecretManager. Contributed by Mehran Hassani. 2016-09-20 13:20:01 -07:00
Kai Zheng
734d54c1a8 HDFS-10861. Refactor StripeReaders and use ECChunk version decode API. Contributed by Sammi Chen 2016-09-21 21:34:48 +08:00
Xiao Chen
ea839bd48e HDFS-10489. Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones. Contributed by Xiao Chen. 2016-09-17 22:25:39 -07:00
Kai Zheng
58bae35447 YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng 2016-09-18 08:43:36 +08:00
Andrew Wang
8a40953058 HDFS-10823. Implement HttpFSFileSystem#listStatusIterator. 2016-09-16 15:37:36 -07:00
Wei-Chiu Chuang
f6f3a447bf HADOOP-13580. If user is unauthorized, log "unauthorized" instead of "Invalid signed text:". Contributed by Wei-Chiu Chuang. 2016-09-16 14:53:30 -07:00
Sangjin Lee
fcbac00212 Revert "HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee)" 
This reverts commit 4d3ea92f4f.
 2016-09-15 10:18:56 -07:00
Akira Ajisaka
7cad7b7046 HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki. 2016-09-15 23:42:34 +09:00
Steve Loughran
53a12fa721 HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran 2016-09-14 15:45:04 +01:00
Kai Zheng
ea0c2b8b05 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-15 10:46:00 +08:00
Jing Zhao
08d8e0ba25 HADOOP-13546. Override equals and hashCode of the default retry policy to avoid connection leakage. Contributed by Xiaobing Zhou. 2016-09-13 11:12:52 -07:00
Yongjun Zhang
d2466ec3e0 HDFS-10657. testAclCLI.xml setfacl test should expect mask r-x. (John Zhuge via Yongjun Zhang) 2016-09-12 21:25:06 -07:00
Mingliang Liu
59d59667a8 HADOOP-13588. ConfServlet should respect Accept request header. Contributed by Weiwei Yang 2016-09-12 16:17:08 -07:00
Allen Wittenauer
58ed4fa544 HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS 
This commit includes the following changes:

	HADOOP-13356. Add a function to handle command_subcommand_OPTS
	HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
	HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
	HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
	HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
	HADOOP-13357. Modify common to use hadoop_subcommand_opts
	HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
	HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
	HADOOP-13564. modify mapred to use hadoop_subcommand_opts
	HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
	HADOOP-13360. Documentation for HADOOP_subcommand_OPTS

This closes apache/hadoop#126
 2016-09-12 11:10:00 -07:00
Arpit Agarwal
a99bf26a08 HDFS-10830. FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use. (Arpit Agarwal and Manoj Govindassamy) 2016-09-10 18:22:25 -07:00
Chris Douglas
9f192cc5ac MAPREDUCE-6628. Potential memory leak in CryptoOutputStream. Contributed by Mariappan Asokan 2016-09-09 11:12:44 -07:00
Kihwal Lee
d4d076876a HADOOP-10940. RPC client does no bounds checking of responses. Contributed by Daryn Sharp. 2016-09-09 10:39:35 -05:00
Chris Douglas
011f3b24d4 HDFS-10742. Measure lock time in FsDatasetImpl. Contributed by Chen Liang 2016-09-08 17:53:40 -07:00
Chris Douglas
1192781a78 HADOOP-13519. Make Path Serializable. Contributed by Steve Loughran 2016-09-08 17:46:12 -07:00
Allen Wittenauer
cae331186d Revert "YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang)" 
This reverts commit 05ede00386.
 2016-09-08 12:40:30 -07:00
Zhe Zhang
401db4fc65 HDFS-8901. Use ByteBuffer in striping positional read. Contributed by Sammi Chen and Kai Zheng. 2016-09-08 11:54:33 -07:00
Kai Zheng
d355573f56 Revert "HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng" 
This reverts commit 62a9667136
 2016-09-08 05:50:17 +08:00
Anu Engineer
f414d5e118 HADOOP-13388. Clean up TestLocalFileSystemPermission. Contributed by Andras Bokor. 2016-09-07 11:09:41 -07:00
Xiao Chen
680be58aac HADOOP-13558. UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket. Contributed by Xiao Chen. 2016-09-06 20:54:17 -07:00
Chris Nauroth
f0d5382ff3 HDFS-6962. ACL inheritance conflicts with umaskmode. Contributed by Chris Nauroth. 2016-09-06 11:02:39 -07:00
Chris Douglas
d37dc5d1b8 HDFS-9847. HDFS configuration should accept time units. Contributed by Yiqun Lin 2016-09-06 10:38:04 -07:00
Andrew Wang
f388a20943 Add CHANGES and release notes for 3.0.0-alpha1 to site 2016-09-06 09:51:55 -07:00
Kihwal Lee
39d1b1d747 HADOOP-13549. Eliminate intermediate buffer for server-side PB encoding. Contributed by Daryn Sharp. 2016-09-06 10:02:42 -05:00
Kai Zheng
62a9667136 HADOOP-13218. Migrate other Hadoop side tests to prepare for removing WritableRPCEngine. Contributed by Wei Zhou and Kai Zheng 2016-09-07 17:05:33 +08:00
Kihwal Lee
23abb09c1f HADOOP-13547. Optimize IPC client protobuf decoding. Contributed by Daryn Sharp. 2016-09-02 11:03:18 -05:00
Kihwal Lee
76cd81f4b6 HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp. 2016-09-01 15:44:44 -05:00
Chris Douglas
3069df7551 FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria 2016-09-01 11:32:26 -07:00
Mingliang Liu
dcd21d083a HADOOP-13375. o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky. (Contributed by Weiwei Yang) 2016-09-01 11:03:06 -07:00
Ray Chiang
05ede00386 YARN-5567. Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus. (Yufei Gu via rchiang) 2016-08-29 15:55:33 -07:00
Mingliang Liu
6fcb04c178 HADOOP-13559. Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes. (Contributed by Aaron Fabbri) 2016-08-29 13:04:28 -07:00
Anu Engineer
e1ad598cef HADOOP-7363. TestRawLocalFileSystemContract is needed. Contributed by Andras Bokor. 2016-08-29 09:26:46 -07:00
Jason Lowe
92d8f37155 HADOOP-13552. RetryInvocationHandler logs all remote exceptions. Contributed by Jason Lowe 2016-08-29 15:55:38 +00:00
Kihwal Lee
81485dbfc1 Revert "HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp." 
This reverts commit d288a0ba83.
 2016-08-25 16:04:54 -05:00
Kihwal Lee
d288a0ba83 HADOOP-13465. Design Server.Call to be extensible for unified call queue. Contributed by Daryn Sharp. 2016-08-25 11:44:13 -05:00
Albert Chu
52b25fe6ae HADOOP-13533. Do not require user to set HADOOP_SSH_OPTS to a non-null string, allow setting of an empty string. (Albert Chu via aw) closes #121 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2016-08-25 07:11:06 -07:00
Allen Wittenauer
601599b036 HADOOP-13532. Fix typo in hadoop_connect_to_hosts error message (Albert Chu via aw) closes #120 2016-08-25 06:58:42 -07:00
Akira Ajisaka
ab3b727b5f HADOOP-13534. Remove unused TrashPolicy#getInstance and initialize code. Contributed by Yiqun Lin. 2016-08-25 13:54:57 +09:00
Xiao Chen
3476156807 HADOOP-13396. Allow pluggable audit loggers in KMS. Contributed by Xiao Chen 2016-08-24 10:14:46 -07:00
Akira Ajisaka
092b4d5bfd HADOOP-13538. Deprecate getInstance and initialize methods with Path in TrashPolicy. Contributed by Yiqun Lin. 2016-08-24 16:47:52 +09:00
Chris Douglas
c37346d0e3 HADOOP-12726. Unsupported FS operations should throw UnsupportedOperationException. Contributed by Daniel Templeton. 2016-08-23 14:12:52 -07:00
Masatake Iwasaki
8aae8d6bf0 HADOOP-13497. fix wrong command in CredentialProviderAPI.md. Contributed by Yuanbo Liu. 2016-08-24 00:03:27 +09:00
Wei-Chiu Chuang
f0efea490e HDFS-8986. Add option to -du to calculate directory space usage excluding snapshots. Contributed by Xiao Chen. 2016-08-23 04:14:24 -07:00
Eric Yang
c49333becf HDFS-8312. Added permission check for moving file to Trash. (Weiwei Yang via Eric Yang) 2016-08-22 18:29:56 -07:00
Xiao Chen
4070caad70 HADOOP-13526. Add detailed logging in KMS for the authentication failure of proxy user. Contributed by Suraj Acharya. 2016-08-22 18:09:35 -07:00
Xiao Chen
f4d4d3474c HADOOP-13487. Hadoop KMS should load old delegation tokens from Zookeeper on startup. Contributed by Xiao Chen. 2016-08-22 14:42:13 -07:00
Mingliang Liu
115ecb52a8 HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (Contributed by Weiqing Yang) 2016-08-21 09:40:29 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
99603e9022 HADOOP-13428. Fixed hadoop-common build files to generate jdiff by working around a jdiff-bug. Contributed by Wangda Tan. 2016-08-19 19:08:53 -07:00
Chris Nauroth
763f0497bb HADOOP-13252. Tune S3A provider plugin mechanism. Contributed by Steve Loughran. 2016-08-19 10:48:10 -07:00
Wei-Chiu Chuang
03a9343d57 HADOOP-12765. HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections. Contributed by Min Shen. 2016-08-19 09:22:49 -07:00
Akira Ajisaka
8179f9a493 HDFS-10645. Make block report size as a metric and add this metric to datanode web ui. Contributed by Yuanbo Liu. 2016-08-19 16:15:00 +09:00
Kai Zheng
dbcaf999d9 HADOOP-13504. Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010. Contributed by Sammi Chen 2016-08-19 11:18:15 +08:00
Jing Zhao
c5c3e81b49 HADOOP-13503. Improve SaslRpcClient failure logging. Contributed by Xiaobing Zhou. 2016-08-18 14:55:26 -07:00
Mingliang Liu
0f51eae0c0 HADOOP-13512. ReloadingX509TrustManager should keep reloading in case of exception. (Contributed by Mingliang Liu) 2016-08-18 14:10:37 -07:00
Junping Du
0da69c324d YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi. 
(cherry picked from commit d464483bf7f0b3e3be3ba32cd6c3eee546747ab5)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
 2016-08-18 07:27:23 -07:00
Steve Loughran
040c185d62 HADOOP-13405 doc for fs.s3a.acl.default indicates incorrect values. Contributed by Shen Yinjie 2016-08-18 14:36:55 +01:00
Anu Engineer
c57523163f HADOOP-11786. Fix Javadoc typos in org.apache.hadoop.fs.FileSystem. Contributed by Andras Bokor. 2016-08-17 15:00:14 -07:00
Mingliang Liu
23532716fc HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-16 17:33:04 -07:00
Mingliang Liu
27a6e09c4e Revert "HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu)" 
This reverts commit 9336a0495f.
 2016-08-16 16:25:37 -07:00
Andrew Wang
4b689e7a75 HADOOP-13494. ReconfigurableBase can log sensitive information. Contributed by Sean Mackrory. 2016-08-16 15:01:18 -07:00
Masatake Iwasaki
b8a446ba57 HADOOP-13419. Fix javadoc warnings by JDK8 in hadoop-common package. Contributed by Kai Sasaki. 2016-08-16 13:30:40 +09:00
Mingliang Liu
9336a0495f HADOOP-13470. GenericTestUtils$LogCapturer is flaky. (Contributed by Mingliang Liu) 2016-08-15 20:24:54 -07:00
Mingliang Liu
382d615260 HDFS-10678. Documenting NNThroughputBenchmark tool. (Contributed by Mingliang Liu) 2016-08-15 20:22:14 -07:00
Mingliang Liu
4bcbef39f7 HDFS-10724. Document caller context config keys. (Contributed by Mingliang Liu) 2016-08-15 20:20:33 -07:00
Mingliang Liu
12ad63d723 HDFS-10725. Caller context should always be constructed by a builder. (Contributed by Mingliang Liu) 2016-08-15 20:14:05 -07:00
Xiao Chen
9daa9979a1 HADOOP-13437. KMS should reload whitelist and default key ACLs when hot-reloading. Contributed by Xiao Chen. 2016-08-15 18:14:45 -07:00
Varun Saxena
d714030b5d HADOOP-13333. testConf.xml ls comparators in wrong order (Vrushali C via Varun Saxena) 2016-08-16 03:03:44 +05:30
Kai Zheng
b5af9be72c HDFS-8668. Erasure Coding: revisit buffer used for encoding and decoding. Contributed by Sammi Chen 2016-08-13 13:52:37 +08:00
Sangjin Lee
4d3ea92f4f HADOOP-13410. RunJar adds the content of the jar twice to the classpath (Yuanbo Liu via sjlee) 2016-08-11 19:56:58 -07:00
Wei-Chiu Chuang
db719ef125 HADOOP-13190. Mention LoadBalancingKMSClientProvider in KMS HA documentation. Contributed by Wei-Chiu Chuang. 2016-08-11 12:27:09 -07:00
Wei-Chiu Chuang
d892ae9576 HADOOP-13441. Document LdapGroupsMapping keystore password properties. Contributed by Yuanbo Liu. 2016-08-11 11:57:43 -07:00
Kai Zheng
8fbb57fbd9 HADOOP-11588. Benchmark framework and test for erasure coders. Contributed by Rui Li 2016-08-12 15:05:52 +08:00
Xiao Chen
e83be44af5 HADOOP-13461. NPE in KeyProvider.rollNewVersion. Contributed by Colm O hEigeartaigh. 2016-08-10 16:28:02 -07:00
Chris Nauroth
4d4fe07c3c HADOOP-13476. CredentialProviderFactory fails at class loading from libhdfs (JNI). Contributed by Aaron Fabbri. 2016-08-10 09:54:31 -07:00
Wei-Chiu Chuang
d00d3add9e HDFS-8224. Schedule a block for scanning if its metadata file is corrupt. Contributed by Rushabh S Shah. 2016-08-09 18:11:34 -07:00
Karthik Kambatla
85422bb7c5 HADOOP-13299. JMXJsonServlet is vulnerable to TRACE. (Haibo Chen via kasha) 2016-08-09 13:42:32 -07:00
Kihwal Lee
caf800d529 HADOOP-13473. Tracing in IPC Server is broken. Contributed by Daryn Sharp. 2016-08-09 14:33:15 -05:00
Masatake Iwasaki
8f9b61852b HADOOP-13439. Fix race between TestMetricsSystemImpl and TestGangliaMetrics. Contributed by Chen Liang. 2016-08-09 09:54:44 +09:00
Sangjin Lee
0ad48aa2c8 HADOOP-12747. support wildcard in libjars argument (sjlee) 2016-08-08 17:34:56 -07:00
Wei-Chiu Chuang
070548943a HADOOP-13395. Enhance TestKMSAudit. Contributed by Xiao Chen. 2016-08-08 15:11:05 -07:00
Lei Xu
6418edd6fe HADOOP-13380. TestBasicDiskValidator should not write data to /tmp (Yufei Gu via lei) 2016-08-08 15:06:03 -07:00
Arpit Agarwal
58e1523c8e HADOOP-13457. Remove hardcoded absolute path for shell executable. (Chen Liang) 2016-08-08 12:36:27 -07:00
Jitendra Pandey
625585950a HADOOP-10823. TestReloadingX509TrustManager is flaky. Contributed by Mingliang Liu. 2016-08-08 11:00:19 -07:00
Masatake Iwasaki
10ed06a0c9 HADOOP-13418. Fix javadoc warnings by JDK8 in hadoop-nfs package. Contributed by Kai Sasaki. 2016-08-06 12:22:02 +09:00
Wei-Chiu Chuang
49ba09a922 HADOOP-13353. LdapGroupsMapping getPassward shouldn't return null when IOException throws. Contributed by Zhaohao Liang and Wei-Chiu Chuang. 2016-08-05 16:32:44 -07:00
Kai Zheng
cca6229696 HDFS-10718. Prefer direct ByteBuffer in native RS encoder and decoder. Contributed by Sammi Chen 2016-08-05 04:22:48 +08:00
Arpit Agarwal
331ef25152 HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang) 2016-08-04 12:25:39 -07:00
Arpit Agarwal
b8ca84ac99 HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal) 2016-08-04 10:07:53 -07:00
Kihwal Lee
9422515239 HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp. 2016-08-04 10:45:55 -05:00
Xiao Chen
05db64913d HADOOP-13443. KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default. Contributed by Anthony Young-Garner. 2016-08-04 15:57:34 +08:00
Wei-Chiu Chuang
a1f6564d31 HADOOP-13458. LoadBalancingKMSClientProvider#doOp should log IOException stacktrace. Contributed by Chen Liang. 2016-08-03 14:19:47 -07:00
Jason Lowe
c82745432a HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger 2016-08-03 20:17:30 +00:00
Kihwal Lee
580a833496 HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp. 2016-08-03 13:22:22 -05:00
Kihwal Lee
2d8227605f HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp. 2016-08-03 09:31:49 -05:00
Arpit Agarwal
d28c2d9f55 HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor) 2016-08-02 15:17:45 -07:00
Arpit Agarwal
954465e7ba HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-02 13:40:33 -07:00
Chris Nauroth
0458a2af6e HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin. 2016-08-02 12:43:30 -07:00
Kihwal Lee
b3018e73cc HADOOP-13429. Dispose of unnecessary SASL servers. Contributed by Daryn Sharp. 2016-08-02 10:40:28 -05:00
Akira Ajisaka
770b5eb2db HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon. 2016-08-01 17:35:59 +09:00
Kai Zheng
34ccaa8367 HADOOP-11540. Raw Reed-Solomon coder using Intel ISA-L library. Contributed by Kai Zheng 2016-08-01 06:34:26 +08:00
Akira Ajisaka
3d191cc152 HADOOP-13440. FileContext does not react on changing umask via configuration. 2016-07-31 11:29:15 +09:00
Xiao Chen
8ebf2e95d2 HADOOP-13381. KMS clients should use KMS Delegation Tokens from current UGI. Contributed by Xiao Chen. 2016-07-28 18:24:41 -07:00
Xiao Chen
d9aae22fdf HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge 2016-07-28 16:29:40 -07:00
Lei Xu
a3d0cba810 HDFS-10689. Hdfs dfs chmod should reset sticky bit permission when the bit is omitted in the octal mode. (Manoj Govindassamy via Lei Xu) 2016-07-28 13:52:14 -07:00
Akira Ajisaka
54fe17a607 HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák. 2016-07-27 19:41:09 +09:00
Chris Nauroth
255ea45e50 HADOOP-13422. ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process. Contributed by Sergey Shelukhin. 2016-07-26 15:33:20 -07:00
Kai Zheng
f1a4863dfc HADOOP-13041. Adding tests for coder utilities. Contributed by Kai Sasaki 2016-07-26 21:53:37 +08:00
Chris Douglas
22a9a6b0d4 HADOOP-13272. ViewFileSystem should support storage policy related API. Contributed by Peter Shi 2016-07-22 18:08:12 -07:00
Chris Nauroth
5fda66e4a3 HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran. 2016-07-22 15:38:18 -07:00
Chris Nauroth
43cf6b101d HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge. 2016-07-21 14:12:31 -07:00
Steve Loughran
37362c2f92 HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan) 2016-07-20 13:42:51 +01:00
Akira Ajisaka
dc065dd64c HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki. 2016-07-19 16:05:48 -07:00
Akira Ajisaka
92fe2db540 HADOOP-13301. Millisecond timestamp for FsShell console log and MapReduce jobsummary log. Contributed by John Zhuge. 2016-07-18 15:45:44 -07:00
Akira Ajisaka
c2bcffb34e HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki. 2016-07-18 11:48:23 -07:00
Steve Loughran
76be82bc04 HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor 2016-07-18 14:38:35 +01:00
Andrew Wang
da456ffd62 Preparing for 3.0.0-alpha2 development 2016-07-15 19:04:17 -07:00
Robert Kanter
442162048a HADOOP-13254. Create framework for configurable disk checkers (yufeigu via rkanter) 2016-07-15 13:41:26 -07:00
Akira Ajisaka
1381483233 HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou. 2016-07-14 23:13:55 -07:00
Steve Loughran
be26c1b9b0 Revert "HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor" 
This reverts commit 45af585e7a.
 2016-07-14 10:30:36 +01:00
Steve Loughran
45af585e7a HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor 2016-07-14 10:29:29 +01:00
Zhe Zhang
728bf7f698 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung. 2016-07-13 16:37:40 -07:00
Akira Ajisaka
505ce88437 HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R. 2016-07-13 13:02:20 -07:00
Tsuyoshi Ozawa
77ffe76212 HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa) 2016-07-13 21:28:04 +09:00
Lei Xu
a290a98b6a HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei) 2016-07-12 16:49:32 -07:00
Vrushali Channapattan
32b033d57c YARN-5052 Update timeline service v2 documentation to capture information about filters (Varun Saxena via Vrushali C) 2016-07-10 08:46:03 -07:00
Jitendra Pandey
ef30bf3c3f HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer. 2016-07-08 14:17:14 -07:00
Jitendra Pandey
6e597600f7 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 14:58:19 -07:00
Allen Wittenauer
a0035661c1 HADOOP-13349. HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH (aw) 2016-07-07 14:15:34 -07:00
Akira Ajisaka
d1626a7b37 MAPREDUCE-6717. Remove deprecated StringUtils.getFormattedTimeWithDiff. Contributed by Shen Yinjie. 2016-07-07 11:18:43 -07:00
Jian He
d792a90206 YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du 2016-07-05 18:05:16 -07:00
Jitendra Pandey
aa42c7a6dd HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:34:03 -07:00
Vinayakumar B
c25021fb71 HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B) 2016-07-01 12:09:59 +05:30
Andrew Wang
846ada2de3 HADOOP-12345. Pad hostname correctly in CredentialsSys.java. Contributed by Pradeep Nayak Udupi Kadbet. 2016-06-29 17:32:35 -07:00
Masatake Iwasaki
5c07c573db HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims) 2016-06-30 07:21:08 +09:00
Steve Loughran
96fa0f848b HADOOP-12709 Cut s3:// from trunk. Contributed by Mingliang Liu. 2016-06-29 16:04:50 +01:00
Steve Loughran
111739df8f HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki 2016-06-29 14:32:03 +01:00
Allen Wittenauer
b3649adf6a HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw) 2016-06-28 20:47:05 -07:00
Allen Wittenauer
6103635591 HADOOP-9330. Add custom JUnit4 test runner with configurable timeout (Steve Loughran via aw) 2016-06-28 20:40:41 -07:00
Allen Wittenauer
1faaa69078 HADOOP-9321. fix coverage org.apache.hadoop.net (Ivan A. Veselovsky via aw) 2016-06-28 20:37:42 -07:00
Andrew Wang
77031a9c37 HADOOP-12864. Remove bin/rcc script. Contributed by Allen Wittenauer. 2016-06-28 14:25:02 -07:00
Allen Wittenauer
be38e530bb HADOOP-9888. KerberosName static initialization gets default realm, which is unneeded in non-secure deployment. (Dmytro Kabakchei via aw) 2016-06-28 07:22:51 -07:00
Allen Wittenauer
23c3ff85a9 HADOOP-13209. replace slaves with workers (John Smith via aw) 2016-06-28 05:53:03 -07:00
Andrew Wang
7d2070493e HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen. 2016-06-27 18:46:33 -07:00
Andrew Wang
771f798edf HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen. 2016-06-27 18:20:56 -07:00
Arpit Agarwal
9683eab0e1 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:36:05 -07:00
Tsz-Wo Nicholas Sze
d328e66706 HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:45:16 +08:00
Sangjin Lee
bf74dbf80d HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 2016-06-24 14:44:15 -07:00
Colin Patrick Mccabe
975786492c Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 2016-06-24 09:46:36 -07:00
Zhe Zhang
0b9edf6e0f HADOOP-13019. Implement ErasureCodec for HitchHiker XOR coding. Contributed by Kai Sasaki. 2016-06-23 15:52:51 -07:00
Andrew Wang
e98c0c7a1c Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen." 
This reverts commit 35356de1ba.
 2016-06-23 11:08:02 -07:00
Steve Loughran
4ee3543625 HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:45:25 +01:00
Masatake Iwasaki
67089875f0 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims) 2016-06-22 23:38:20 +09:00
Akira Ajisaka
e15cd43369 HADOOP-13296. Cleanup javadoc for Path. Contributed by Daniel Templeton. 2016-06-21 20:16:22 +09:00
Tsuyoshi Ozawa
5d58858bb6 HADOOP-9613. [JDK8] Update jersey version to latest 1.x release. 2016-06-21 08:05:32 +09:00
Colin Patrick Mccabe
8c1f81d4bf HADOOP-13288. Guard null stats key in FileSystemStorageStatistics (Mingliang Liu via Colin P. McCabe) 2016-06-20 14:25:07 -07:00
Colin Patrick Mccabe
5370a6ffae HADOOP-13280. FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps (Mingliang Liu via cmccabe) 2016-06-20 10:46:18 -07:00
Akira Ajisaka
fc6b50cc57 HADOOP-13192. org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly. Contributed by binde. 2016-06-20 17:07:26 +09:00
Arpit Agarwal
0319d73c3b HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal) 2016-06-18 16:16:54 -07:00
Chris Nauroth
5f6bc65bb3 Revert "HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)" 
This reverts commit 97056c3355.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-06-17 23:50:22 -07:00
Xiaoyu Yao
0761379fe4 HADOOP-13285. DecayRpcScheduler MXBean should only report decayed CallVolumeSummary. Contributed by Xiaoyu Yao. 2016-06-17 15:25:14 -07:00
Akira Ajisaka
09e82acaf9 HADOOP-12943. Add -w -r options in dfs -test command. Contributed by Weiwei Yang. 2016-06-17 16:20:38 +09:00
Akira Ajisaka
51d497fa93 MAPREDUCE-6542. HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe. Contributed by zhangyubiao. 2016-06-17 11:03:54 +09:00
Konstantin V Shvachko
a2a5cb60b0 HADOOP-13189. FairCallQueue makes callQueue larger than the configured capacity. Contributed by Vinitha Gankidi. 2016-06-16 18:20:49 -07:00
Colin Patrick Mccabe
bf780406f2 HADOOP-12975. Add jitter to CachingGetSpaceUsed's thread (Elliott Clark via Colin P. McCabe) 2016-06-16 16:48:05 -07:00
Xiaoyu Yao
b1674caa40 HADOOP-13255. KMSClientProvider should check and renew tgt when doing delegation token operations. Contributed by Xiao Chen. 2016-06-16 15:22:00 -07:00
Chris Nauroth
127d2c7281 HADOOP-13241. document s3a better. Contributed by Steve Loughran. 2016-06-16 11:18:02 -07:00
Vinayakumar B
cc6c265171 HDFS-10256. Use GenericTestUtils.getTestDir method in tests for temporary directories (Contributed by Vinayakumar B) 2016-06-16 16:47:06 +05:30
Jitendra Pandey
6f0aa75121 HADOOP-12291. Add support for nested groups in LdapGroupsMapping. Contributed by Esther Kundin. 2016-06-15 11:41:49 -07:00
Allen Wittenauer
e2f640942b HADOOP-13245. Fix up some misc create-release issues (aw) 2016-06-14 16:03:20 -07:00
Vinayakumar B
8e8cb4c6ca HADOOP-13179. GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe. (Contributed by hongbin ma) 2016-06-14 16:01:26 +05:30
Masatake Iwasaki
20b13d109a HADOOP-13244. o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor. Contributed by Kai Sasaki. 2016-06-14 19:20:46 +09:00
Akira Ajisaka
e3ba9ad3f1 HADOOP-13270. BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks. Contributed by Kai Sasaki. 2016-06-14 10:18:41 +09:00
Andrew Wang
0accc3306d HADOOP-13079. Add -q option to Ls to print ? instead of non-printable characters. Contributed by John Zhuge. 2016-06-13 11:43:46 -07:00
Karthik Kambatla
49b4064644 HADOOP-13243. TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently. (Daniel Templeton via kasha) 2016-06-12 14:12:31 -07:00
Akira Ajisaka
8a1dccecce HADOOP-13213. Small Documentation bug with AuthenticatedURL in hadoop-auth. Contributed by Tom Ellis. 
This closes #97.
 2016-06-11 03:32:21 +09:00
Jing Zhao
0bbb4ddd79 HADOOP-13249. RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Contributed by Zhihai Xu. 2016-06-10 10:38:13 -07:00
Wangda Tan
03fc6b1bb0 YARN-3426. Add jdiff support to YARN. (vinodkv via wangda) 2016-06-10 09:51:09 -07:00
Chris Nauroth
9581fb715c HADOOP-12666. Support Microsoft Azure Data Lake - as a file system in Hadoop. Contributed by Vishwajeet Dusane. 2016-06-09 14:33:31 -07:00
Steve Loughran
31ffaf76f2 HADOOP-12537 S3A to support Amazon STS temporary credentials. Contributed by Sean Mackrory. 2016-06-09 21:00:47 +01:00
Steve Loughran
656c460c0e HADOOP-13237: s3a initialization against public bucket fails if caller lacks any credentials. Contributed by Chris Nauroth 2016-06-09 17:28:49 +01:00
Kai Zheng
723432b338 HADOOP-13220. Follow on fixups after upgraded mini-kdc using Kerby. Contributed by Jiajia Li 2016-06-09 15:56:12 +08:00
Robert Kanter
733f3f18d5 MAPREDUCE-6702. TestMiniMRChildTask.testTaskEnv and TestMiniMRChildTask.testTaskOldEnv are failing (ajisakaa via rkanter) 2016-06-07 15:46:06 -07:00
Junping Du
c14c1b298e HADOOP-10048. LocalDirAllocator should avoid holding locks while accessing the filesystem. Contributed by Jason Lowe. 2016-06-07 09:18:58 -07:00
Tsz-Wo Nicholas Sze
35f255b03b Revert "Revert "HADOOP-13226 Support async call retry and failover."" 
This reverts commit 5360da8bd9.
 2016-06-06 16:31:43 +08:00
Tsz-Wo Nicholas Sze
574dcd34c0 Revert "Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls."" 
This reverts commit e4450d47f1.
 2016-06-06 16:31:23 +08:00
Tsz-Wo Nicholas Sze
aa20fa150d Revert "Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou"" 
This reverts commit 4d36b221a2.
 2016-06-06 16:28:47 +08:00
Tsz-Wo Nicholas Sze
eded3d109e Revert "Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou"" 
This reverts commit 106234d873.
 2016-06-06 16:28:21 +08:00
Andrew Wang
106234d873 Revert "HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou" 
This reverts commit fc94810d3f.
 2016-06-03 18:09:55 -07:00
Andrew Wang
4d36b221a2 Revert "HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou" 
This reverts commit 1b9f18623a.
 2016-06-03 18:09:18 -07:00
Andrew Wang
e4450d47f1 Revert "HADOOP-13168. Support Future.get with timeout in ipc async calls." 
This reverts commit 42c22f7e3d.
 2016-06-03 18:09:16 -07:00
Andrew Wang
5360da8bd9 Revert "HADOOP-13226 Support async call retry and failover." 
This reverts commit 83f2f78c11.
 2016-06-03 18:09:09 -07:00
Andrew Wang
713cb71820 HADOOP-13155. Implement TokenRenewer to renew and cancel delegation tokens in KMS. Contributed by Xiao Chen. 2016-06-03 16:48:54 -07:00
Chris Nauroth
d82bc85018 HADOOP-13105. Support timeouts in LDAP queries in LdapGroupsMapping. Contributed by Mingliang Liu. 2016-06-03 16:38:30 -07:00
Allen Wittenauer
78b3a03831 HADOOP-13109. Add ability to edit existing token file via dtutil -alias flag (Matthew Paduano via aw) 2016-06-03 15:34:39 -07:00
Jian He
99cc439e29 YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du 2016-06-03 11:10:42 -07:00
Chris Nauroth
c58a59f708 HADOOP-13171. Add StorageStatistics to S3A; instrument some more operations. Contributed by Steve Loughran. 2016-06-03 08:55:33 -07:00
Arpit Agarwal
97e2449477 HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (Contributed by Akira Ajisaka) 2016-06-02 13:14:45 -07:00
Akira Ajisaka
ead61c45da HADOOP-13224. Grep job in Single Cluster document fails. (aajisaka) 2016-06-03 02:00:13 +09:00
Masatake Iwasaki
aadb77e412 HDFS-10367. TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Contributed by Brahma Reddy Battula. 2016-06-02 20:55:04 +09:00
Akira Ajisaka
99675e00df HADOOP-13232. Typo in exception in ValueQueue.java. Contributed by Jiayi Zhou. 2016-06-02 19:14:53 +09:00
Andrew Wang
35356de1ba HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen. 2016-06-01 13:13:17 -07:00
Steve Loughran
5870611030 HADOOP-13162. Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs. (Rajesh Balamohan via stevel) 2016-06-01 14:18:20 +01:00
Colin Patrick Mccabe
8ceb06e239 HADOOP-13137. TraceAdmin should support Kerberized cluster (Wei-Chiu Chuang via cmccabe) 2016-05-31 17:54:34 -07:00
Tsz-Wo Nicholas Sze
83f2f78c11 HADOOP-13226 Support async call retry and failover. 2016-05-31 16:30:11 -07:00
Andrew Wang
bca31fe276 HADOOP-13132. Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider. Contributed by Wei-Chiu Chuang. 2016-05-31 09:35:24 -07:00
Kai Zheng
93d8a7f2a2 Revert "HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng" 
This reverts commit a6c79f92d5.
 2016-06-01 08:41:15 +08:00
Xiaoyu Yao
4ca8859583 HADOOP-13197. Add non-decayed call metrics for DecayRpcScheduler. Contributed by Xiaoyu Yao. 2016-05-27 18:07:44 -07:00
Kai Zheng
916140604f HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li 2016-05-28 14:23:39 +08:00
Yongjun Zhang
34cc21f6d1 HADOOP-12847. hadoop daemonlog should support https and SPNEGO for Kerberized cluster. (Wei-Chiu Chuang via Yongjun Zhang) 2016-05-26 22:43:45 -07:00
Karthik Kambatla
55c3e2de3d HDFS-10463. TestRollingFileSystemSinkWithHdfs needs some cleanup. (Daniel Templeton via kasha) 2016-05-26 14:24:31 -07:00
Allen Wittenauer
fed9bf0ec1 HADOOP-12727. Minor cleanups needed for CMake 3.X (Alan Burlison via aw) 2016-05-26 07:37:22 -07:00
Kai Zheng
77202fa103 HADOOP-13010. Refactor raw erasure coders. Contributed by Kai Zheng 2016-05-27 13:23:34 +08:00
Allen Wittenauer
3c83cee118 HADOOP-12925. Checks for SPARC architecture need to include 64-bit SPARC (Alan Burlison via aw) 2016-05-25 15:28:02 -07:00
Kai Zheng
a6c79f92d5 HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng 2016-05-27 04:29:42 +08:00
Karthik Kambatla
57c31a3fef HDFS-9782. RollingFileSystemSink should have configurable roll interval. (Daniel Templeton via kasha) 2016-05-24 10:37:00 -07:00
Allen Wittenauer
eebb39a56f HADOOP-13112. Change CredentialShell to use CommandShell base class (Matthew Paduano via aw) 2016-05-23 13:37:38 -07:00
Allen Wittenauer
d8c1fd1944 HADOOP-13178. TestShellBasedIdMapping.testStaticMapUpdate doesn't work on OS X (Kai Sasaki via aw) 2016-05-21 10:00:36 -07:00
Steve Loughran
39ec1515a2 HADOOP-13130. s3a failures can surface as RTEs, not IOEs. (Steve Loughran) 2016-05-21 16:39:31 +01:00
Chris Nauroth
bcde1562d2 HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth. 2016-05-20 12:47:41 -07:00
Steve Loughran
757050ff35 HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider. Contributed by Steven Wong. 2016-05-20 13:52:15 +01:00
Tsz-Wo Nicholas Sze
42c22f7e3d HADOOP-13168. Support Future.get with timeout in ipc async calls. 2016-05-19 15:34:04 -07:00
Jian He
feb90ffcca YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong 2016-05-19 13:01:36 -07:00
Kai Zheng
2120de588b Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk 2016-05-19 07:17:08 -07:00
Kai Zheng
182fc1986a HADOOP-12782. Faster LDAP group name resolution with ActiveDirectory. Contributed by Wei-Chiu Chuang 2016-05-19 07:15:52 -07:00
Steve Loughran
22ff9e68d1 HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel. 2016-05-19 14:48:18 +01:00
Chris Nauroth
bad85f3e3a HADOOP-13138. Unable to append to a SequenceFile with Compression.NONE. Contributed by Vinayakumar B. 2016-05-18 09:39:43 -07:00
Colin Patrick Mccabe
f2c1d9181f HADOOP-13140. FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes (Mingliang Liu via cmccabe) 2016-05-18 09:15:32 -07:00
Andrew Wang
7154ace712 HADOOP-13157. Follow-on improvements to hadoop credential commands. Contributed by Mike Yoder. 2016-05-17 17:44:30 -07:00
Xiaoyu Yao
9478484845 HADOOP-13159. Fix potential NPE in Metrics2 source for DecayRpcScheduler. Contributed by Xiaoyu Yao. 2016-05-17 14:58:22 -07:00
Yongjun Zhang
e24fe2641b HDFS-9732, Improve DelegationTokenIdentifier.toString() for better logging. Contributed by Yongjun Zhang. 2016-05-17 14:03:08 -07:00
Akira Ajisaka
9fe5828f05 HDFS-10242. Cannot create space quota of zero. Contributed by Takashi Ohnishi. 2016-05-17 15:53:09 +09:00
Sangjin Lee
61f46be071 HDFS-10208. Addendum for HDFS-9579: to handle the case when client machine can't resolve network path (Ming Ma via sjlee) 2016-05-16 18:49:47 -07:00
Allen Wittenauer
730bc746f9 HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw) 
This commit contains the following JIRA issues:

    HADOOP-12931. bin/hadoop work for dynamic subcommands
    HADOOP-12932. bin/yarn work for dynamic subcommands
    HADOOP-12933. bin/hdfs work for dynamic subcommands
    HADOOP-12934. bin/mapred work for dynamic subcommands
    HADOOP-12935. API documentation for dynamic subcommands
    HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands
    HADOOP-13086. enable daemonization of dynamic commands
    HADOOP-13087. env var doc update for dynamic commands
    HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement
    HADOOP-13089. hadoop distcp adds client opts twice when dynamic
    HADOOP-13094. hadoop-common unit tests for dynamic commands
    HADOOP-13095. hadoop-hdfs unit tests for dynamic commands
    HADOOP-13107. clean up how rumen is executed
    HADOOP-13108. dynamic subcommands need a way to manipulate arguments
    HADOOP-13110. add a streaming subcommand to mapred
    HADOOP-13111. convert hadoop gridmix to be dynamic
    HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow
    HADOOP-13117. clarify daemonization and security vars for dynamic commands
    HADOOP-13120. add a --debug message when dynamic commands have been used
    HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop
    HADOOP-13129. fix typo in dynamic subcommand docs
    HADOOP-13151. Underscores should be escaped in dynamic subcommands document
    HADOOP-13153. fix typo in debug statement for dynamic subcommands
 2016-05-16 17:54:45 -07:00
Jing Zhao
a9a8297cad HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo Nicholas Sze. 2016-05-16 15:23:36 -07:00
Sangjin Lee
1f2794b4fa HADOOP-12971. FileSystemShell doc should explain relative path (John Zhuge via sale) 2016-05-13 10:01:46 -07:00
Andrew Wang
3bfd29949f HADOOP-11180. Change log message "token.Token: Cannot find class for token kind kms-dt" to debug. Contributed by Yi Liu. 2016-05-12 23:48:37 -07:00
Andrew Wang
3c5c57af28 HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1. 2016-05-12 18:27:28 -07:00
Andrew Wang
ca5613af91 Revert "Update project version to 3.0.0-alpha1-SNAPSHOT." 
This reverts commit 6b53802cba.
 2016-05-12 15:32:45 -07:00
Allen Wittenauer
0f3d6bc65e HADOOP-12581. ShellBasedIdMapping needs suport for Solaris (Alan Burlison via aw) 2016-05-12 14:42:04 -07:00
Steve Loughran
27c4e90efc HADOOP-13028 add low level counter metrics for S3A; use in read performance tests. contributed by: stevel 
patch includes
HADOOP-12844 Recover when S3A fails on IOException in read()
HADOOP-13058 S3A FS fails during init against a read-only FS if multipart purge
HADOOP-13047 S3a Forward seek in stream length to be configurable
 2016-05-12 19:24:20 +01:00
Andrew Wang
6b53802cba Update project version to 3.0.0-alpha1-SNAPSHOT. 2016-05-12 11:05:05 -07:00
Sangjin Lee
0bbe01f8d5 YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale) 2016-05-12 10:11:23 -07:00
Steve Loughran
def2a6d385 HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Chris Nauroth via stevel. 2016-05-12 13:57:35 +01:00
Colin Patrick Mccabe
687233f20d HADOOP-13065. Add a new interface for retrieving FS and FC Statistics (Mingliang Liu via cmccabe) 2016-05-11 13:45:39 -07:00
Larry McCay
acb509b2fa HADOOP-12942. hadoop credential commands non-obviously use password of "none" (Mike Yoder via lmccay) 2016-05-11 14:30:07 -04:00
Chris Nauroth
dee279b532 HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by Larry McCay. 2016-05-11 10:58:32 -07:00
Steve Loughran
3553261400 HADOOP-13125 FS Contract tests don't report FS initialization errors well. (stevel) 2016-05-11 14:21:08 +01:00
Tsuyoshi Ozawa
6e56578031 HADOOP-10694. Remove synchronized input streams from Writable deserialization. Contributed by Gopal V and Rajesh Balamohan. 2016-05-10 17:27:10 -07:00
Zhe Zhang
307db61aac HDFS-10172. hdfs erasurecode command should remove the redundant -usage option. Contributed by Yuanbo Liu. 2016-05-10 15:20:17 -07:00
Eric Payne
6b1c1cb01c YARN-4768. getAvailablePhysicalMemorySize can be inaccurate on linux. Contributed by Nathan Roberts. 2016-05-10 21:28:02 +00:00
Steve Loughran
025219b12f HADOOP-12982 Document missing S3A and S3 properties. (Wei-Chiu Chuang via stevel) 2016-05-10 21:37:22 +01:00
Steve Loughran
829a2e4d27 HADOOP-12751. While using kerberos Hadoop incorrectly assumes names with '@' to be non-simple. (Bolke de Bruin via stevel). 2016-05-10 21:32:57 +01:00
Akira Ajisaka
0f0c6415af HADOOP-13118. Fix IOUtils#cleanup and IOUtils#closeStream javadoc. Contributed by Wei-Chiu Chuang. 2016-05-10 10:02:46 -07:00
Andrew Wang
8ef75a702e HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge. 2016-05-06 17:23:11 -07:00
Allen Wittenauer
1c5bbf6499 HADOOP-12866. add a subcommand for gridmix (Kai Sasaki via aw) 2016-05-06 14:07:02 -07:00
Xiaoyu Yao
dacd1f50fe HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 2016-05-05 18:08:47 -07:00
Xiaoyu Yao
4e5e87ddd4 HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao) 2016-05-05 17:56:58 -07:00
Tsz-Wo Nicholas Sze
f305d9c0f6 HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 15:53:02 -07:00
Allen Wittenauer
35cf503149 HADOOP-13077. Handle special characters in passwords in httpfs.sh (Xiao Chen via aw) 2016-05-05 11:33:06 -07:00
Ming Ma
1268cf5fbe HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma) 2016-05-04 17:02:26 -07:00
Arpit Agarwal
f343d91ecc HADOOP-13068. Clean up RunJar and related test class. (Contributed by Andras Bokor) 2016-05-04 09:49:33 -07:00
Akira Ajisaka
36972d61d1 HADOOP-12504. Remove metrics v1. (aajisaka) 2016-05-04 22:52:23 +09:00
Masatake Iwasaki
355325bcc7 HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang. 2016-05-04 15:12:51 +09:00
Chris Douglas
c1cc6ac667 HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri 2016-05-02 22:36:58 -07:00
Tsz-Wo Nicholas Sze
1b9f18623a HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:16:30 -07:00
Colin Patrick Mccabe
2beedead72 HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 2016-05-02 08:58:32 -07:00
Allen Wittenauer
971af603ea HADOOP-13045. hadoop_add_classpath is not working in .hadooprc 2016-04-30 12:23:51 -07:00
Ravi Prakash
2753185a01 HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano 2016-04-29 22:32:27 -07:00
Robert Kanter
9d4d30243b Remove parent's env vars from child processes 2016-04-29 09:25:51 -07:00
Andrew Wang
6f26b66587 HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen. 2016-04-27 15:56:16 -07:00
Lei Xu
0a152103f1 HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu) 2016-04-27 14:22:51 -07:00
Arpit Agarwal
3337ef2bfe HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor) 2016-04-27 10:06:54 -07:00
Jian He
4beff01354 YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode 2016-04-26 21:00:17 -07:00
Arpit Agarwal
ea5475d1c1 HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:46:38 -07:00
Masatake Iwasaki
68b4564e78 HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang. 2016-04-27 10:45:36 +09:00
Tsz-Wo Nicholas Sze
fc94810d3f HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-04-26 17:10:13 -07:00
Zhe Zhang
5865fe2bf0 HDFS-9869. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]. Contributed by Rakesh R. 2016-04-25 22:01:54 -07:00
Masatake Iwasaki
bec5b4cd8c HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims) 2016-04-25 22:41:50 +09:00
Jing Zhao
63e5412f1a HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou. 2016-04-22 15:14:40 -07:00
Akira Ajisaka
c610031cab HADOOP-13033. Add missing Javadoc entries to Interns.java. Contributed by Andras Bokor. 2016-04-23 06:19:57 +09:00
Kihwal Lee
9dbdc8e12d HADOOP-13052. ChecksumFileSystem mishandles crc file permissions. Contributed by Daryn Sharp. 2016-04-22 15:02:46 -05:00
Ravi Prakash
d6402faded Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano" 
This reverts commit 4838b735f0.
 2016-04-22 10:17:20 -07:00
Steve Loughran
19f0f9608e HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel) 2016-04-22 11:25:03 +01:00
Larry McCay
337bcde1dc HADOOP-13011 - Clearly Document the Password Details for Keystore-based Credential Providers 2016-04-21 20:17:33 -07:00
Jing Zhao
4a043b3fec HDFS-9894. Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives. Contributed by Xiaobing Zhou. 2016-04-21 20:17:27 -07:00
Ravi Prakash
4838b735f0 HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano 2016-04-21 11:32:39 -07:00
Xiaoyu Yao
b4be288c5d HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou. 2016-04-21 10:18:48 -07:00
Xiaoyu Yao
5bd7b592e5 HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 2016-04-20 23:10:52 -07:00
Kai Zheng
b5d4c7dc76 HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li. 2016-04-20 15:47:01 +08:00
Steve Loughran
4feed9b2db HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2016-04-15 17:44:12 +01:00
Akira Ajisaka
6e6b6dd5aa HADOOP-12989. Some tests in org.apache.hadoop.fs.shell.find occasionally time out. Contributed by Takashi Ohnishi. 2016-04-15 14:14:36 +09:00
Andrew Wang
a74580a4d3 HADOOP-12811. Change kms server port number which conflicts with HMaster port number. Contributed by Xiao Chen. 2016-04-14 11:36:12 -07:00
Steve Loughran
df18b6e984 HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel) 2016-04-14 12:44:55 +01:00
Steve Loughran
40211d1f0a HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving (Xiaobing Zhou via stevel) 2016-04-14 10:35:31 +01:00
Akira Ajisaka
27b131e79c HADOOP-12822. Change "Metrics intern cache overflow" log level from WARN to INFO. Contributed by Andras Bokor. 2016-04-14 10:55:51 +09:00
Xiaoyu Yao
8ced42daff HADOOP-12993. Change ShutdownHookManger complete shutdown log from INFO to DEBUG. Contributed by Xiaoyu Yao. 2016-04-13 15:34:17 -07:00
Colin Patrick Mccabe
35f0770555 HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe) 2016-04-12 16:28:42 -07:00
Robert Kanter
042a3ae960 HADOOP-12964. Http server vulnerable to clickjacking (haibochen via rkanter) 2016-04-12 14:40:43 -07:00
Akira Ajisaka
209303be3a HDFS-8356. Document missing properties in hdfs-default.xml. Contributed by Ray Chiang. 2016-04-12 15:26:50 +09:00
Akira Ajisaka
a409508b3f HDFS-10277. PositionedReadable test testReadFullyZeroByteFile failing in HDFS. Contributed by Steve Loughran. 2016-04-12 14:55:01 +09:00
Vinod Kumar Vavilapalli
069c6c62de HADOOP-12406. Fixed AbstractMapWritable.readFields to use the thread's ClassLoader to load class instead of System ClassLoader. Contributed by Nadeem Douba. 2016-04-11 12:02:06 -07:00
Chris Nauroth
843ee8d59d HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran. 2016-04-08 13:36:58 -07:00
Steve Loughran
6791221572 HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run. (Kai Sasaki via stevel) 2016-04-08 12:59:19 +01:00
Andrew Wang
594c70f779 HADOOP-12951. Improve documentation on KMS ACLs and delegation tokens. Contributed by Xiao Chen. 2016-04-07 23:50:27 -07:00
Tsz-Wo Nicholas Sze
a62637a413 HADOOP-12909. Change ipc.Client to support asynchronous calls. Contributed by Xiaobing Zhou 2016-04-07 14:02:51 +08:00
Vinayakumar B
8d29e2451f HADOOP-12984. Add GenericTestUtils.getTestDir method and use it for emporary directory in tests (Contributed by Steve Loughran and Vinayakumar B 
This closes #89
 2016-04-07 10:15:24 +05:30
Jian He
93bacda08b YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev 2016-04-06 16:13:47 -07:00
Masatake Iwasaki
85ec5573eb HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 2016-04-06 03:22:48 +09:00
Kihwal Lee
917464505c HDFS-10239. Fsshell mv fails if port usage doesn't match in src and destination paths. Contributed by Kuhu Shukla. 2016-04-05 09:07:24 -05:00
Arpit Agarwal
7280550a8f HADOOP-11212. NetUtils.wrapException to handle SocketException explicitly. (Contributed by Steve Loughran) 2016-04-04 10:50:11 -07:00
Akira Ajisaka
da614ca5dc HADOOP-12967. Remove FileUtil#copyMerge. Contributed by Brahma Reddy Battula. 2016-04-04 17:48:08 +09:00
Steve Loughran
0ecdd4cffa HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. 2016-04-03 16:40:19 +01:00
Akira Ajisaka
a8d8b80a20 HADOOP-11661. Deprecate FileUtil#copyMerge. Contributed by Brahma Reddy Battula. 2016-04-01 13:59:14 +09:00
Xiaoyu Yao
aac4d65bf9 HADOOP-12950. ShutdownHookManager should have a timeout for each of the Registered shutdown hook. Contributed by Xiaoyu Yao. 2016-03-31 15:22:24 -07:00
Colin Patrick Mccabe
19639785f5 HADOOP-12955. Fix bugs in the initialization of the ISA-L library JNI bindings (Kai Zheng via cmccabe) 2016-03-31 15:09:11 -07:00
Jian He
0dd9bcab97 YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage 2016-03-31 14:28:13 -07:00
Xiaoyu Yao
d95c6eb32c HADOOP-12916. Allow RPC scheduler/callqueue backoff using response times. Contributed by Xiaoyu Yao. 2016-03-31 08:42:57 -07:00
Allen Wittenauer
0a74610d1c HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw) 2016-03-31 07:51:05 -07:00
Akira Ajisaka
acca149ec9 HADOOP-12902. JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter. Contributed by Gabor Liptak. 2016-03-31 16:04:47 +09:00
Zhe ZHang
e4fc609d5d HADOOP-12886. Exclude weak ciphers in SSLFactory through ssl-server.xml. Contributed by Wei-Chiu Chuang. 2016-03-30 14:13:11 -07:00
Colin Patrick Mccabe
e3d15a2e23 DOOP-12972. Lz4Compressor#getLibraryName returns the wrong version number (cmccabe) 2016-03-29 17:13:52 -07:00
Arpit Agarwal
46a5245db9 HDFS-9478. Reason for failing ipc.FairCallQueue contruction should be thrown. (Contributed by Ajith S) 2016-03-29 12:08:46 -07:00
Andrew Wang
8bfaa80037 HADOOP-10965. Print fully qualified path in CommandWithDestination error messages. Contributed by John Zhuge. 2016-03-28 14:13:48 -07:00
Robert Kanter
8cac1bb09f HADOOP-12954. Add a way to change hadoop.security.token.service.use_ip (rkanter) 2016-03-28 10:36:59 -07:00
Junping Du
90fcb16c0f MAPREDUCE-6655. Fix a typo (STRICT_IE6) in Encrypted Shuffle. Contributed by Wei-Chiu Chuang. 2016-03-28 05:30:42 -07:00
Akira Ajisaka
01cfee6381 HADOOP-12873. Remove MRv1 terms from HttpAuthentication.md. Contributed by Brahma Reddy Battula. 2016-03-28 15:57:57 +09:00
Jason Lowe
9a09200a1f HADOOP-12958. PhantomReference for filesystem statistics can trigger OOM. Contributed by Sangjin Lee 2016-03-25 22:58:04 +00:00
Andrew Wang
d4df7849a5 HADOOP-12962. KMS key names are incorrectly encoded when creating key. Contributed by Xiao Chen. 2016-03-25 15:28:53 -07:00
Andrew Wang
938222b2e2 HADOOP-12947. Update documentation Hadoop Groups Mapping to add static group mapping, negative cache. Contributed by Wei-Chiu Chuang. 2016-03-23 14:57:14 -07:00
Allen Wittenauer
738155063e HADOOP-12857. rework hadoop-tools (aw) 2016-03-23 13:46:38 -07:00
Benoy Antony
e7ed05e4f5 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay. 2016-03-21 13:19:43 -07:00
Andrew Wang
e3bb38d625 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 2016-03-21 11:39:05 -07:00
Haohui Mai
ed1e23fe8f HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:40:59 -07:00
Sangjin Lee
cd8b6889a7 HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee) 2016-03-19 14:02:04 -07:00
Chris Nauroth
33239c9925 HADOOP-12926. lz4.c does not detect 64-bit mode properly. Contributed by Alan Burlison. 2016-03-18 16:33:01 -07:00
Steve Loughran
605fdcbb81 YARN-4593 Deadlock in AbstractService.getConfig() (stevel) 2016-03-16 14:35:24 +00:00
Steve Loughran
5a725f0ab8 HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager (Costin Leau via stevel) 2016-03-16 14:31:19 +00:00
Zhe Zhang
19e8f07691 HADOOP-12826. Rename the new Java coder and make it default. Contributed by Rui Li. 2016-03-14 16:45:32 -07:00
Tsz-Wo Nicholas Sze
1898810cda HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:48:01 -07:00
Colin Patrick Mccabe
658ee95ff3 HADOOP-11996. Improve and restructure native ISAL support (Kai Zheng via cmccabe) 2016-03-11 12:57:54 -08:00
Colin Patrick Mccabe
6e9a582eb1 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe) 2016-03-11 12:26:40 -08:00
Steve Loughran
754299695b Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)" 
This reverts commit 682adc6ba9.
 2016-03-11 17:00:17 +00:00
Masatake Iwasaki
682adc6ba9 HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 2016-03-11 15:03:40 +09:00
Li Lu
9a79b738c5 HADOOP-12906. AuthenticatedURL should convert a 404/Not Found into an FileNotFoundException. (Steve Loughran via gtcarrera9) 2016-03-10 11:38:31 -08:00
Harsh J
318c9b68b0 HADOOP-11404. Clarify the "expected client Kerberos principal is null" authorization message. Contributed by Stephen Chu 2016-03-10 17:05:09 +05:30
Arpit Agarwal
2e040d31c7 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:29:43 -08:00
Akira Ajisaka
87c8005ad3 HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak. 2016-03-09 15:35:51 +09:00
Chris Nauroth
89b16d27e2 HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 2016-03-08 21:22:06 -08:00
Allen Wittenauer
55f73a1cbd HADOOP-12798. Update changelog and release notes (2016-03-04) (aw) 2016-03-08 16:48:38 -08:00
Andrew Wang
a3cc6e2511 HADOOP-12895. SSLFactory#createSSLSocketFactory exception message is wrong. Contributed by Wei-Chiu Chuang. 2016-03-08 13:51:48 -08:00
Akira Ajisaka
f86850b544 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 2016-03-08 14:28:47 +09:00
Arpit Agarwal
c2140d05ef HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:24 -08:00
Ming Ma
49eedc7ff0 HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 2016-03-07 20:26:19 -08:00
Andrew Wang
391da36d93 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang) 2016-03-07 14:00:02 -08:00
Chris Nauroth
2759689d7d HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 2016-03-04 15:29:50 -08:00
Zhe Zhang
3e8099a45a HDFS-9888. Allow reseting KerberosName in unit tests. Contributed by Xiao Chen. 2016-03-04 09:48:05 -08:00
Masatake Iwasaki
cbd31328a6 HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 2016-03-04 14:11:36 +09:00
Andrew Wang
1bc454615e HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:02:31 -08:00
Akira Ajisaka
0a9f00af5e HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula. 2016-03-03 23:32:30 +09:00
Akira Ajisaka
1c3136cbd8 HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 2016-03-03 23:22:35 +09:00
Akira Ajisaka
eb864d35d6 HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 2016-03-03 18:46:48 +09:00
Masatake Iwasaki
f70e317ccc HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 2016-03-03 17:14:32 +09:00
Arpit Agarwal
27941a1811 HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou) 2016-03-02 18:35:28 -08:00
Colin Patrick Mccabe
700b0e4019 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 2016-03-02 17:56:11 -08:00
Andrew Wang
480302b4ba HADOOP-12859. Disable hiding field style checks in class setters. Contributed by Kai Zheng. 2016-03-02 09:40:30 -08:00
Chris Nauroth
f98dff329b HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty. 2016-03-01 13:18:42 -08:00
Akira Ajisaka
44d9bac1f5 Add HADOOP-12843 to 2.8.0 in CHANGES.txt. 2016-03-02 00:24:38 +09:00
Chris Nauroth
d251e55415 HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay. 2016-02-29 21:59:52 -08:00
Uma Maheswara Rao G
307ec80aca HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng 2016-02-29 21:52:20 -08:00
Karthik Kambatla
680f3fc02d HADOOP-10321. TestCompositeService should cover all enumerations of adding a service to a parent service. (Ray Chiang via kasha) 2016-02-29 18:59:59 -08:00
Jian He
d8f390d015 HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. Contributed by Junping Du 2016-02-29 16:24:05 -08:00
Haohui Mai
0fa54d45b1 HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-02-29 11:41:00 -08:00
Masatake Iwasaki
809ebc0b14 HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims) 2016-02-29 18:20:14 +09:00
Akira Ajisaka
e3ac231f72 Move HADOOP-9121 from 3.0.0 to 2.7.3 in CHANGES.txt. 2016-02-29 11:40:18 +09:00
Chris Nauroth
7634d404b7 HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay. 2016-02-28 11:22:55 -08:00
Li Lu
7545ce6636 HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 (Mingliang Liu via gtcarrera9) 2016-02-27 21:59:03 -08:00
Steve Loughran
03cfb454fe HADOOP-12825. Log slow name resolutions. (Sidharta Seethana via stevel) 2016-02-27 20:23:51 +00:00
Chris Nauroth
798babf661 HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. Contributed by Mingliang Liu. 2016-02-26 21:59:08 -08:00
Lei Xu
2093acf6b6 HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei) 2016-02-26 10:47:49 -08:00
Akira Ajisaka
f0de733ca0 Moved HADOOP-8818 from 3.0.0 to 2.7.3 in CHANGES.txt. 2016-02-27 01:30:20 +09:00
Karthik Kambatla
c2460dad64 HDFS-9858. RollingFileSystemSink can throw an NPE on non-secure clusters. (Daniel Templeton via kasha) 2016-02-25 16:31:09 -08:00
Xiaoyu Yao
b2951f9fbc HADOOP-12824. Collect network and disk usage on the node running Windows. Contributed by Inigo Goiri. 2016-02-25 15:47:05 -08:00
Zhe Zhang
ccff6035f5 HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen. 
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
 2016-02-25 09:24:32 -08:00
Zhe Zhang
efdc0070d8 HADOOP-12808. Rename the RS coder from HDFS-RAID as legacy. Contributed by Rui Li. 
Change-Id: Icb64eb60833fe0139aadb6da9aa666f664defc0e
 2016-02-24 14:29:03 -08:00
cnauroth
d6b181c6fa HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8. Contributed by Xiaoyu Yao. 2016-02-24 13:55:39 -08:00
Arpit Agarwal
2e76c2f751 HADOOP-12070. Some of the bin/hadoop subcommands are not available on Windows. (Contributed by Kengo Seki) 2016-02-24 12:45:34 -08:00
cnauroth
3369a4f691 HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty. 2016-02-23 21:37:50 -08:00
Colin Patrick Mccabe
d9c409a428 HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions (Gregory Chanan via cmccabe) 2016-02-23 11:11:22 -08:00
cnauroth
27b77751c1 HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay. 2016-02-22 17:30:13 -08:00
Zhe Zhang
a2fdfff02d HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. 
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
 2016-02-22 14:13:54 -08:00
cnauroth
d4f5fc23b2 HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki. 2016-02-22 13:39:38 -08:00
Junping Du
18f9b77a32 Support additional compression levels for GzipCodec. Contributed by Ravi Mutyala. 2016-02-19 14:21:25 -08:00
Yongjun Zhang
a963baba10 HADOOP-12828. Print user when services are started. (Wei-Chiu Chuang via Yongjun Zhang) 2016-02-19 09:41:22 -08:00
cnauroth
8ab7658025 HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay. 2016-02-18 14:06:38 -08:00
Akira Ajisaka
c7ac25e52c HDFS-9830. Remove references to hftp in ViewFs documentation in trunk. Contributed by Wei-Chiu Chuang. 2016-02-19 05:02:57 +09:00
Tsz-Wo Nicholas Sze
bbfaf3c271 HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases. 2016-02-18 11:47:33 -08:00
Robert Kanter
a365a3941c HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter) 2016-02-18 11:09:50 -08:00
cnauroth
5d1889a66d HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth. 2016-02-18 10:07:28 -08:00
Zhe Zhang
0fb14aaced HDFS-9799. Reimplement getCurrentTrashDir to remove incompatibility. (zhz) 
Change-Id: I7834bcebffed38cb384db5395ddb8b6dd9e79a0b
 2016-02-17 13:30:50 -08:00
cnauroth
76fab26c5c HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay. 2016-02-17 12:19:59 -08:00
Xiaoyu Yao
fd1befb6ba HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. Contributed by Xiaoyu Yao. 2016-02-17 08:27:27 -08:00
Masatake Iwasaki
1a1c2f5bab HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs (Wei-Chiu Chuang via iwasakims) 2016-02-18 00:13:11 +09:00
Vinayakumar B
96ea309431 HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls (Contributed by Ryan Blue) 2016-02-17 10:13:41 +05:30
Vinayakumar B
4b0e59fdc0 HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public (Contributed by Ted Yu) 2016-02-16 17:32:03 +05:30
Akira Ajisaka
1c48e50ce7 HADOOP-12786. "hadoop key" command usage is not documented. Contributed by Xiao Chen. 2016-02-15 11:38:25 +09:00
Junping Du
ec12ce8f48 Set the release date for 2.6.4. 2016-02-13 01:42:50 -08:00
Masatake Iwasaki
36ba5cac37 HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag (iwasakims) 2016-02-13 14:59:38 +09:00
cnauroth
91a96eaa53 HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty. 2016-02-12 15:50:10 -08:00
Arpit Agarwal
1de1641f17 HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:04 -08:00
Vinayakumar B
c78740a979 HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. (Contributed by Brahma Reddy Battula) 2016-02-12 11:53:28 +05:30
Karthik Kambatla
33ce7f6c07 HDFS-9780. RollingFileSystemSink doesn't work on secure clusters. (Daniel Templeton via kasha) 2016-02-11 20:37:14 -08:00
Andrew Wang
8fdef0bd9d HADOOP-12699. TestKMS#testKMSProvider intermittently fails during 'test rollover draining'. Contributed by Xiao Chen. 2016-02-11 17:20:10 -08:00
cnauroth
70c756d35e HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. Contributed by Chris Nauroth. 2016-02-11 16:52:58 -08:00
Uma Maheswara Rao G
df4dcd3e75 HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. Contributed by Wei-Chiu Chuang. 2016-02-10 14:54:45 -08:00
Jason Lowe
6f03959e4d HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in chroot. Contributed by Eric Badger 2016-02-10 21:53:08 +00:00
Zhe Zhang
4ef1324ff6 HADOOP-12764. Increase default value of KMX maxHttpHeaderSize and make it configurable. 
Change-Id: I6e970563c201152e1428feafb8124e61c15a6fc0
 2016-02-10 09:56:40 -08:00
Sangjin Lee
58acbf940a HADOOP-12773. HBase classes fail to load with client/job classloader enabled (sjlee) 2016-02-08 13:55:30 -08:00
cnauroth
cf3261570a HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran. 2016-02-08 09:36:09 -08:00
Varun Vasudev
d37eb828ff HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana. 2016-02-08 20:19:17 +05:30
Varun Vasudev
af218101e5 Revert "HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana." 
This reverts commit f3bbe0bd02.
 2016-02-08 20:16:44 +05:30
Varun Vasudev
f3bbe0bd02 HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors. Contributed by Sidharta Seethana. 2016-02-08 14:22:18 +05:30
Andrew Wang
5b59a0ea85 HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. Contributed by Daniel Templeton. 2016-02-06 20:52:35 -08:00
Steve Loughran
1495ff979a HADOOP-12292. Make use of DeleteObjects optional -move CHANGES.TXT reference 2016-02-06 18:20:12 +00:00
Steve Loughran
29ae258013 HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 15:05:16 +00:00
cnauroth
cfa8513890 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran. 2016-02-05 15:47:51 -08:00
cnauroth
a37e423e84 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay. 2016-02-05 14:38:21 -08:00
Kihwal Lee
49e176c29f HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla. 2016-02-05 15:47:14 -06:00
Colin Patrick Mccabe
9086dd58c3 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe) 2016-02-05 10:56:54 -08:00
Xiaoyu Yao
5d00067ca7 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou. 2016-02-05 10:37:07 -08:00
Xuan
63c63e298c YARN-4662. Document some newly added metrics. Contributed by Jian He 2016-02-03 20:05:22 -08:00
zhezhang
c89a14a8a4 HADOOP-12041. Implement another Reed-Solomon coder in pure Java. Contributed by Kai Zheng. 
Change-Id: I35ff2e498d4f988c9a064f74374f7c7258b7a6b7
 2016-02-03 15:05:02 -08:00
Sangjin Lee
4dc0a39493 HADOOP-12761. incremental maven build is not really incremental (sjlee) 2016-02-03 08:58:49 -08:00
Junping Du
414cf07650 Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:06:10 -08:00
zhezhang
6d1213860f HDFS-9403. Erasure coding: some EC tests are missing timeout. Contributed by Gao Rui. 
Change-Id: I13c4bc0e566c4f8af5371d26f8e18a749ed41d8b
 2016-02-02 14:03:45 -08:00
Andrew Wang
8171874dd1 HADOOP-12755. Fix typo in defaultFS warning message. 2016-02-02 11:56:37 -08:00
Akira Ajisaka
700a176fa7 HADOOP-12757. Findbug compilation fails for 'Kafka Library support'. (aajisaka) 2016-02-02 23:15:39 +09:00
Karthik Kambatla
ee005e010c HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha) 2016-01-28 17:43:17 -08:00
Colin Patrick Mccabe
2e8ab3d465 HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe) 2016-01-27 11:39:55 -08:00
Allen Wittenauer
79d7949fbb HADOOP-12492. maven install triggers bats test (aw) 2016-01-27 11:27:27 -08:00
Yongjun Zhang
97056c3355 HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang) 2016-01-27 08:04:25 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
ec4d2d9f40 Release process for 2.7.2: Set the release date for 2.7.2 2016-01-25 15:45:57 -08:00
Walter Su
6eacdea0e4 HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen. 2016-01-25 19:30:04 +08:00
Akira Ajisaka
643227927a HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 2016-01-25 13:59:25 +09:00
Akira Ajisaka
736eb17a79 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 2016-01-25 13:47:29 +09:00
Allen Wittenauer
d22c4239a4 HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw) 2016-01-22 12:15:22 -08:00
Kihwal Lee
2fd19b9674 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:10:06 -06:00
Akira Ajisaka
0bae506c22 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki. 2016-01-22 21:08:31 +09:00
Xiaoyu Yao
f3427d3766 HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu. 2016-01-21 13:51:58 -08:00
Allen Wittenauer
8cecad2d56 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 2016-01-21 12:22:03 -08:00
Zhe Zhang
1bb31fb22e HADOOP-11828. Implement the Hitchhiker erasure coding algorithm. Contributed by Jack Liu Quan. 
Change-Id: If43475ccc2574df60949c947af562722db076251
 2016-01-21 10:30:05 -08:00
Akira Ajisaka
2ac39ca762 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey. 2016-01-22 02:45:22 +09:00
Vinayakumar B
446987e20a HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal) 2016-01-21 20:08:24 +05:30
Masatake Iwasaki
9eec6cbedc HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims) 2016-01-20 05:00:02 +09:00
Lei Xu
2ec438e8f7 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 2016-01-20 14:26:11 -08:00
Ravi Prakash
1acc509b45 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano 2016-01-19 13:57:08 -08:00
Wangda Tan
89d1fd5dac HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda) 2016-01-19 21:27:38 +08:00
Akira Ajisaka
92c5f565fd HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki. 2016-01-19 13:31:26 +09:00
cnauroth
8bc93db2e7 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth. 2016-01-18 09:08:58 -08:00
cnauroth
da77f423d1 HADOOP-12691. Move files to correct location. 2016-01-16 07:47:43 -08:00
Colin Patrick Mccabe
2a30386539 HADOOP-12662. The build should fail if a -Dbundle option fails (Kai Zheng via cmccabe) 2016-01-15 14:05:21 -08:00
Colin Patrick Mccabe
5af5f9575a HADOOP-12714. Fix hadoop-mapreduce-client-nativetask unit test which fails because it is not able to open the "glibc bug spill" file. (cmccabe) 2016-01-15 13:53:05 -08:00
Colin Patrick Mccabe
b2c155f810 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) 2016-01-15 12:29:18 -08:00
Andrew Wang
5d5a22a878 HADOOP-12713. Disable spurious checkstyle checks. 2016-01-15 11:58:56 -08:00
Akira Ajisaka
1da762c745 Move HADOOP-12590 from 2.9.0 to 2.8.0 in CHANGES.txt. 2016-01-15 10:48:18 +09:00
Jason Lowe
cdf8895259 HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe 2016-01-14 23:45:03 +00:00
Jason Lowe
651c23e8ef Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6 2016-01-14 23:41:14 +00:00
cnauroth
06f4ac0ccd HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay. 2016-01-14 11:56:00 -08:00
Colin Patrick Mccabe
b1ed28fa77 HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe) 2016-01-14 11:02:34 -08:00
Akira Ajisaka
ff8758377c HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge. 2016-01-15 00:32:47 +09:00
Colin Patrick Mccabe
8315582c4f HDFS-9517. Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes (Wei-Chiu Chuang via cmccabe) 2016-01-13 16:28:06 -08:00
Karthik Kambatla
fb64e6051a HADOOP-12683. Add number of samples in last interval in snapshot of MutableStat. (Vikram Srivastava via kasha) 2016-01-13 15:43:47 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
cb73c753da HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa) 
Moved entry from HDFS CHANGES.txt to that of common.
 2016-01-13 14:55:06 -08:00
cnauroth
fbb5868deb HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang. 2016-01-12 15:57:32 -08:00
Lei Xu
126705f67e HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) 2016-01-12 12:19:53 -08:00
Colin Patrick Mccabe
30c7dfd8ba HADOOP-12653. Use SO_REUSEADDR to avoid getting "Address already in use" when using kerberos and attempting to bind to any port on the local IP address (cmccabe) 2016-01-12 10:46:22 -08:00
Akira Ajisaka
56b9500bbd HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 2016-01-12 13:34:18 +09:00
cnauroth
0e76f1fcea HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth. 2016-01-09 22:18:11 -08:00
Benoy Antony
dec8dfdfa6 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 2016-01-09 13:41:18 -08:00
Steve Loughran
d7ed04758c HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel) 2016-01-09 11:15:07 +00:00
Steve Loughran
84bf5122e4 HADOOP-12573. TestRPC.testClientBackOff failing. (Xiao Chen via stevel) 2016-01-09 11:14:47 +00:00
cnauroth
f0fa6d869b HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty. 2016-01-08 20:18:59 -08:00
rohithsharmaks
ed18527e38 Revert "HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks)" 
This reverts commit 2b252844e0.

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2016-01-08 14:30:28 +05:30
Steve Loughran
bac798abfc HADOOP-12597. In kms-site.xml configuration "hadoop.security.keystore.JavaKeyStoreProvider.password" should be updated with new name. (Surendra Singh Lilhore via stevel) 2016-01-07 16:00:54 +00:00
Steve Loughran
172d07825c HADOOP-12613. TestFind.processArguments occasionally fails. (Wei-Chiu Chuang via stevel) 2016-01-07 15:04:12 +00:00
Steve Loughran
7914f569ef HADOOP-12655. TestHttpServer.testBindAddress patch - move from improvement to bug fix 2016-01-07 15:04:11 +00:00
Steve Loughran
3190534814 HADOOP-12655. TestHttpServer.testBindAddress bind port range is wider than expected. (Wei-Chiu Chuang via stevel) 2016-01-07 14:51:53 +00:00
Steve Loughran
3fcdbe076f HADOOP-12663. Remove Hard-Coded Values From FileSystem.java. (BELUGA BEHR via stevel) 2016-01-07 14:45:34 +00:00
Steve Loughran
21bededd2f HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:40:09 +00:00
rohithsharmaks
2b252844e0 HADOOP-12687. SecureUtil#QualifiedHostResolver#getByName should also try to resolve direct hostname (Sunil G via rohithsharmaks) 2016-01-07 10:42:48 +05:30
cnauroth
978bbdfeb2 HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade. 2016-01-06 11:15:59 -08:00
Ravi Prakash
2d16f40dab HADOOP-12689. S3 filesystem operations stopped working correctly 2016-01-05 23:26:03 -08:00
Zhe Zhang
c52b407cbf HADOOP-12685. Input buffer position after encode/decode not consistent between different kinds of buffers. Contributed by Rui Li. 
Change-Id: I713c7b4e3cfae70c04b7e4b292ab53eae348d8d9
 2016-01-05 16:32:18 -08:00
Yongjun Zhang
28bd138018 HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang) 2016-01-05 11:09:05 -08:00
Uma Mahesh
778146eaae HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng 2016-01-04 14:32:09 -08:00
Akira Ajisaka
1af2917856 HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi. 2016-01-04 20:33:17 +09:00
Akira Ajisaka
db99e30f67 Set release date for 2.6.3 2016-01-04 16:12:12 +09:00
Akira Ajisaka
64ae85fd2e HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki. 2016-01-04 14:31:22 +09:00
Xiaoyu Yao
ab725cff66 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang. 2015-12-30 10:29:26 -08:00
Xiaoyu Yao
993311e547 HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang. 2015-12-28 10:41:26 -08:00
Akira Ajisaka
a0249da8a7 Add HADOOP-12681 to 2.8.0 in CHANGES.txt. 2015-12-28 14:41:42 +09:00
Karthik Kambatla
8b1837fcd1 HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha) 2015-12-23 14:34:53 -08:00
Akira Ajisaka
fa544020f6 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 2015-12-21 21:23:03 +09:00
Chris Douglas
8652cce5b2 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri 2015-12-18 18:30:18 -08:00
cnauroth
932956458d HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 2015-12-18 16:24:53 -08:00
Arpit Agarwal
8fb70a031b HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:08:26 -08:00
Zhe Zhang
ef3f3f6bb1 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
 2015-12-18 16:04:47 -08:00
Colin Patrick Mccabe
f349d0a76c HADOOP-12647. Add /usr/lib default for ISAL library and fix missing .c file in CMakeLists (Kai Zheng via cmccabe) 2015-12-18 09:27:26 -08:00
Akira Ajisaka
061c05cc05 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru. 2015-12-18 13:58:28 +09:00
Akira Ajisaka
bd5e207432 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki. 2015-12-18 13:12:33 +09:00
Zhe Zhang
f5756a2038 HADOOP-12615. Fix NPE in MiniKMS.start(). Contributed by Wei-Chiu Chuang. 
Change-Id: Ie3e148bd1401618b1737a577957298bf622891f4
 2015-12-17 13:24:29 -08:00
Vinod Kumar Vavilapalli
ce16541c62 HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos) 
Addendum commit to include CHANGES.txt entry.
 2015-12-16 14:40:21 -08:00
Allen Wittenauer
607473e1d0 HADOOP-12192. update releasedocmaker command line (aw) 2015-12-16 06:23:58 -08:00
Uma Mahesh
ae67c8424c HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh) 2015-12-15 15:13:37 -08:00
Colin Patrick Mccabe
bc72422981 HADOOP-12638. UnsatisfiedLinkError while checking ISA-L in checknative command. (Kai Sasaki via Colin P. McCabe) 2015-12-14 13:12:50 -08:00
Allen Wittenauer
576b569b6c Revert "HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw)" 
This reverts commit 832b3cbde1.
 2015-12-11 10:59:42 -08:00
Akira Ajisaka
eee0cf4611 HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki. 2015-12-11 16:18:30 +09:00
Robert Kanter
e27fffdb90 HADOOP-12625. Add a config to disable the /logs endpoints (rkanter) 2015-12-09 14:32:20 -08:00
Uma Mahesh
ad53c52063 HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh) 2015-12-08 22:39:17 -08:00
mattf
ada9c2c410 HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:27:50 -08:00
Haohui Mai
c4084d9bc3 HADOOP-10729. Add tests for PB RPC in case version mismatch of client and server. Contributed by Junping Du. 2015-12-09 05:41:44 +08:00
Allen Wittenauer
832b3cbde1 HDFS-9525. hadoop utilities need to support provided delegation tokens (HeeSoo Kim via aw) 2015-12-08 12:56:38 -08:00
Steve Loughran
65f395226b HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072] 2015-12-06 17:43:35 +00:00
Xiaoyu Yao
cbc7b6bf97 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao. 2015-12-04 10:39:45 -08:00
Jian He
755dda8dd8 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan 2015-12-03 17:45:31 -08:00
Akira Ajisaka
3857fed2c8 HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. Contributed by Mingliang Liu. 2015-12-03 11:50:31 +08:00
Arpit Agarwal
485c3468a8 HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. (Contributed by Masatake Iwasaki) 2015-12-01 09:27:23 -08:00
Junping Du
028894281b Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:16:39 -08:00
cnauroth
c37c3f41b3 Revert "HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw)" 
This reverts commit 6725e7f1be.
 2015-11-28 17:21:11 -08:00
cnauroth
2577e5b2c1 Revert "HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw)" 
This reverts commit 4c8125d60d.
 2015-11-28 17:20:49 -08:00
cnauroth
b2c78536cb HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a Stable interface. Contributed by Chris Nauroth. 2015-11-28 15:40:07 -08:00
Allen Wittenauer
4c8125d60d HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw) 2015-11-27 21:06:28 -08:00
Allen Wittenauer
6725e7f1be HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw) 2015-11-27 18:25:45 -08:00
Yongjun Zhang
0348e769ab HADOOP-12468. Partial group resolution failure should not result in user lockout. (Wei-Chiu Chuang via Yongjun Zhang) 2015-11-25 18:37:52 -08:00
Vinod Kumar Vavilapalli
d57fd181c7 Adding release 2.8.0 to CHANGES.txt 2015-11-25 17:33:26 -08:00
Robert Kanter
7fd00b3db4 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 2015-11-25 17:03:38 -08:00
Haohui Mai
b21dffb1fe HDFS-9451. Clean up depreated umasks and related unit tests. Contributed by Wei-Chiu Chuang. 2015-11-25 12:47:24 -08:00
Akira Ajisaka
bab03f3ee6 HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang. 2015-11-26 01:21:20 +09:00
Tom Zeng
b4c6b511e7 HADOOP-12415. Add io.netty dependency to hadoop-nfs and to hadoop-hdfs, needed to build Bigtop successfuly, see BIGTOP-2049 
Signed-off-by: Konstantin Boudnik <cos@boudnik.org>
 2015-11-24 18:36:34 -08:00
Xiaoyu Yao
fe5624b85d HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-11-24 12:47:57 -08:00
Allen Wittenauer
e8a87d739f HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux (Alan Burlison via aw) 2015-11-24 12:45:08 -08:00
Haohui Mai
db4cab21f4 HDFS-5165. Remove the TotalFiles metrics. Contributed by Akira AJISAKA. 2015-11-24 11:41:57 -08:00
Jason Lowe
17b1a5482b Revert "HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Brahma Reddy Battula." 
This reverts commit 4356e8a5ef.

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/impl/MetricsSourceAdapter.java
 2015-11-24 19:12:04 +00:00
cnauroth
0e1c12c174 HADOOP-12294. Correct CHANGES.txt description. 2015-11-24 10:51:56 -08:00
Jian He
8676a118a1 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan 2015-11-23 17:19:48 -08:00
Haohui Mai
4bff073b4d Revert "HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling." 
This reverts commit 4c061e607e.
 2015-11-23 15:00:56 -08:00
Haohui Mai
5f269a0ad8 HADOOP-9822. create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor. Contributed by Tsuyoshi Ozawa. 2015-11-23 13:22:20 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
70c26703f4 HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a security flaw. Contributed by Wei-Chiu Chuang. 2015-11-23 09:59:50 -08:00
Haohui Mai
817ae221ac HADOOP-12313. NPE in JvmPauseMonitor when calling stop() before start(). Contributed by Gabor Liptak. 2015-11-22 23:07:43 -08:00
Haohui Mai
8228697857 HDFS-9024. Deprecate the TotalFiles metric. Contributed by Akira Ahisaka. 2015-11-22 23:02:50 -08:00
Haohui Mai
611aa77f75 HADOOP-11677. Add cookie flags for logs and static contexts. Contributed by nijel. 2015-11-22 19:52:13 -08:00
Tsuyoshi Ozawa
053a511919 HADOOP-11149. TestZKFailoverController times out. Contributed by Steve Loughran. closes apache/hadoop#51 2015-11-23 12:44:50 +09:00
Haohui Mai
c3ba44d858 HADOOP-10068. Improve log4j regex in testFindContainingJar. Contributed by Robert Rati. 2015-11-22 18:29:03 -08:00
Haohui Mai
dc46c46b91 HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux. 2015-11-22 18:10:08 -08:00
Haohui Mai
aac260faa1 HADOOP-10555. Add offset support to MurmurHash. Contributed by Sergey Shelukhin. 2015-11-22 18:00:29 -08:00
Haohui Mai
077fa529e1 HADOOP-10035. Cleanup TestFilterFileSystem. Contributed by Suresh Srinivas. 2015-11-22 17:30:08 -08:00
Haohui Mai
0d27917042 HADOOP-12098. Remove redundant test dependencies in Hadoop Archives. Contributed by Varun Saxena. 2015-11-22 17:25:22 -08:00
Haohui Mai
5f688453df HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider. Contributed by Masatake Iwasaki. 2015-11-22 16:56:15 -08:00
Haohui Mai
4492b9e730 HADOOP-12294. Remove the support of the deprecated dfs.umask. Contributed by Chang Li. 2015-11-22 16:47:44 -08:00
Haohui Mai
f0cd903866 HADOOP-12467. Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts. Contributed by Radhey Shah. 2015-11-22 16:03:59 -08:00
Haohui Mai
66428d33a7 HADOOP-11218. Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory. Contributed by Vijay Singh. 2015-11-22 16:00:34 -08:00
Haohui Mai
4c061e607e HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling. 2015-11-22 15:18:24 -08:00
Steve Loughran
a6f20d80de Revert "HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter." 
This reverts commit b7e3f419bdaa4d46ffb9829dd7873b5221cab077.
 2015-11-22 11:41:13 +00:00
Haohui Mai
4539131102 HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter. 2015-11-19 15:47:31 -08:00
Haohui Mai
747455a13b HADOOP-11901. BytesWritable fails to support 2G chunks due to integer overflow. Contributed by Reynold Xin. 2015-11-19 12:54:08 -08:00
Tsuyoshi Ozawa
25e82b4eb9 HADOOP-12575. Add build instruction for docker toolbox instead of boot2docker. Contributed by Kai Sasaki. 2015-11-19 17:44:10 +09:00
Tsuyoshi Ozawa
bd166f0eed HADOOP-12582. Using BytesWritable's getLength() and getBytes() instead of get() and getSize(). Contributed by Akira AJISAKA. 2015-11-19 17:27:23 +09:00
Tsuyoshi Ozawa
989b9e3e11 HADOOP-12564. Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package. Contributed by Dustin Cote. 2015-11-19 01:38:18 +09:00
Tsuyoshi Ozawa
169921e8ab Moved HADOOP-8419 in CHANGES.txt from 3.0.0 to 2.8.0. 2015-11-19 01:34:20 +09:00
Akira Ajisaka
4a3b8f1ed2 HADOOP-12568. Update core-default.xml to describe posixGroups support. Contributed by Wei-Chiu Chuang. 2015-11-18 17:23:00 +09:00
cnauroth
7fab5c8cec HADOOP-12567. NPE in SaslRpcServer. Contributed by Sergey Shelukhin. 2015-11-17 15:59:57 -08:00
Akira Ajisaka
a7f776ffdf MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun. 2015-11-17 15:16:47 +09:00
Tsuyoshi Ozawa
c753617a48 Move HADOOP-11361, HADOOP-12348 and HADOOP-12482 from 2.8.0 to 2.7.3 in CHANGES.txt for backporting. 2015-11-14 14:43:34 +09:00
Akira Ajisaka
47c79a2a4d Move HADOOP-12374 from 2.8.0 to 2.7.3 in CHANGES.txt. 2015-11-14 13:14:54 +09:00
Akira Ajisaka
f94d892704 HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad. 2015-11-13 21:52:57 +09:00
Haohui Mai
0ca8df716a HADOOP-12562. Make hadoop dockerfile usable by Yetus. Contributed by Allen Wittenauer. 2015-11-12 10:19:22 -08:00
Tsuyoshi Ozawa
d90769757a Updated CHANGES.txt to move HADOOP-12526 to 2.6.3. 2015-11-11 23:20:49 +09:00
Colin Patrick Mccabe
493e8ae552 HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 (Mingliang Liu via Colin P. McCabe) 2015-11-10 10:54:52 -08:00
Lei Xu
0eb9c60c5b HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei) 2015-11-09 23:01:30 -08:00
Haohui Mai
94a1833638 HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai. 2015-11-09 15:25:19 -08:00
Akira Ajisaka
3ae82863f0 HADOOP-12553. [JDK8] Fix javadoc error caused by illegal tag. (aajisaka) 2015-11-08 19:17:57 +09:00
Allen Wittenauer
b76b0ce51e HADOOP-12366. expose calculated paths (aw) 2015-11-07 08:32:56 -08:00
Jason Lowe
74a9a51886 Update CHANGES.txt for commit of HADOOP 12413 to 2.7.3 and 2.6.3 2015-11-06 17:16:14 +00:00
Lei Xu
bff7c90a56 HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei) 2015-11-05 18:35:15 -08:00
Colin Patrick Mccabe
21c0e3eda5 CHANGES.txt: move HADOOP-11887 to trunk 2015-11-05 11:12:24 -08:00
Colin Patrick Mccabe
482e35c55a HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe) 2015-11-05 10:44:47 -08:00
cnauroth
0fb1867fd6 HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade. 2015-11-04 10:28:44 -08:00
Haohui Mai
88beb46cf6 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit 84cbd72afd.
 2015-11-04 10:21:13 -08:00
Jason Lowe
b9d25c3ee2 HADOOP-12296. when setnetgrent returns 0 in linux, exception should be thrown. Contributed by Chang Li 2015-11-04 16:34:01 +00:00
Jason Lowe
0383a3973b Add 2.7.3 release to CHANGES.txt 2015-11-04 16:26:14 +00:00
Varun Vasudev
73b9c7b82b HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer. 2015-11-04 15:56:17 +05:30
Zhe Zhang
3e1745d8e8 HADOOP-12544. Erasure Coding: create dummy raw coder to isolate performance issues in testing. Contributed by Rui Li. 
Change-Id: I9856456b59ed881c5ba2acce51e4d9bd01dc6f48
 2015-11-03 22:26:27 -08:00
cnauroth
957f0311a1 HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. Contributed by Chris Nauroth. 2015-11-02 22:25:05 -08:00
Allen Wittenauer
6e0d353235 HADOOP-12541. make re2j dependency consistent (Matthew Paduano via aw) 2015-11-02 20:39:46 -08:00
cnauroth
9e7dcab185 HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade. 2015-11-02 10:21:39 -08:00
cnauroth
3ce0a6502e HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth. 2015-11-02 10:17:41 -08:00
Walter Su
6e4f8a46c5 HADOOP-12047. Indicate preference not to affect input buffers during coding in erasure coder. (Contributed by Kai Zheng) 2015-11-02 10:40:14 +08:00
Arpit Agarwal
3cde6931cb HDFS-9343. Empty caller context considered invalid. (Contributed by Mingliang Liu) 2015-11-01 15:35:02 -08:00
Sangjin Lee
a4a6b5b4b4 Updated the 2.6.2 final release date. 2015-10-30 18:47:16 -07:00
Gábor Lipták
18727c63da HADOOP-12133 Add schemas to Maven Assembly XMLs 
Signed-off-by: Allen Wittenauer <aw@apache.org>
 2015-10-30 11:36:52 -07:00
Jason Lowe
eadf7b3096 Creating 2.6.3 entries in CHANGES.txt files. 2015-10-30 14:50:50 +00:00
Zhe Zhang
8def51a708 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore. 
Change-Id: I985627a5d1400249d72d084283ef366d5ac6e07b
 2015-10-29 11:23:08 -07:00
Jian He
c41699965e YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du 2015-10-29 00:00:48 -07:00
Walter Su
5eca6dece6 HADOOP-12327. Initialize output buffers with ZERO bytes in erasure coder. Contributed by Kai Zheng. 2015-10-29 15:04:34 +08:00
Vinayakumar B
7d2d16f4ee HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina) 2015-10-29 11:28:17 +05:30
Sangjin Lee
b0c818b60d Set the release date for 2.6.2 2015-10-28 20:43:35 -07:00
cnauroth
2d10cb8e00 HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth. 2015-10-28 09:44:10 -07:00
Steve Loughran
a04b16970b HADOOP-12514. Make static fields in GenericTestUtils for assertExceptionContains() package-private and final. (Mingliang Liu via stevel) 2015-10-28 10:36:43 +00:00
Steve Loughran
ff2b2bea91 HADOOP-12385. Include nested stack trace in SaslRpcClient.getServerToken() (stevel) 2015-10-28 10:25:22 +00:00
yliu
c201cf951d HADOOP-12040. Adjust inputs order for the decode API in raw erasure coder. (Kai Zheng via yliu) 2015-10-28 16:18:23 +08:00
cnauroth
bf8e452982 HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth. 2015-10-27 23:07:14 -07:00
cnauroth
1f7ecb0c84 HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu. 2015-10-27 22:56:22 -07:00
cnauroth
73822de7c3 HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth. 2015-10-27 22:48:56 -07:00
Allen Wittenauer
1396867b52 HADOOP-12494. fetchdt stores the token based on token kind instead of token service (HeeSoo Kim via aw) 2015-10-27 12:02:43 -07:00
Zhihai Xu
ed9806ea40 HADOOP-12178. NPE during handling of SASL setup if problem with SASL resolver class. Contributed by Steve Loughran 2015-10-27 09:51:26 -07:00
Akira Ajisaka
bcb2386e39 HADOOP-12515. Mockito dependency is missing in hadoop-kafka module. Contributed by Kai Zheng. 2015-10-27 20:17:16 +09:00
Tsuyoshi Ozawa
ea6b183a1a HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. Contributed by Akira AJISAKA. 2015-10-27 10:57:45 +09:00
Jing Zhao
a01a209fbe HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. Contributed by Steve Loughran. 2015-10-26 14:03:15 -07:00
Tsuyoshi Ozawa
123b3db743 HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by Akihiro Suda. 2015-10-26 23:18:52 +09:00
Tsuyoshi Ozawa
ce60b4fc8b YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula. 2015-10-26 16:45:11 +09:00
Jitendra Pandey
600ad7bf41 HDFS-9184. Logging HDFS operation's caller context into audit logs. Contributed by Mingliang Liu. 2015-10-23 12:15:01 -07:00
Jonathan Eagles
f8adeb712d YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles) 2015-10-23 10:34:08 -05:00
Tsuyoshi Ozawa
35a303dfbe HADOOP-7266. Deprecate metrics v1. Contributed by Akira AJISAKA. 2015-10-23 23:47:51 +09:00
Tsuyoshi Ozawa
513ec3de19 HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. (Zhe Zhang and Chu Tong via ozawa) 2015-10-23 06:50:50 +09:00
Tsuyoshi Ozawa
039a1f9e96 Revert HADOOP-9692. 
This reverts commit 381610da62.
This reverts commit b5ca649bff.
 2015-10-23 06:48:26 +09:00
cnauroth
cb282d5b89 HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade. 2015-10-22 14:29:57 -07:00
Junping Du
0fce5f9a49 YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong. 2015-10-22 13:41:09 -07:00
cnauroth
47641fcbc9 HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade. 2015-10-22 12:21:32 -07:00
Allen Wittenauer
4c0bae240b HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw) 2015-10-22 08:19:56 -07:00
Tsuyoshi Ozawa
381610da62 HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong. 2015-10-22 11:59:12 +09:00
Tsuyoshi Ozawa
b5ca649bff HADOOP-9692. SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong. 2015-10-22 11:55:25 +09:00
Andrew Wang
d1cdce77fa HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. Contributed by Xiao Chen. 2015-10-21 15:21:01 -07:00
Allen Wittenauer
d759b4bd74 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 2015-10-21 11:30:59 -07:00
Ming Ma
e27c2ae8ba HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma) 2015-10-21 08:06:58 -07:00
Allen Wittenauer
b37c41fd6e HADOOP-12495. Fix posix_spawn error on OS X (aw) 2015-10-21 08:00:26 -07:00
Kihwal Lee
01b103f4ff HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee. 2015-10-20 15:09:15 -05:00
Allen Wittenauer
ded012e1d6 HADOOP-12493. bash unit tests are failing (aw) 2015-10-19 19:02:20 -07:00
Kihwal Lee
6144e0137b HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee. 2015-10-19 10:52:29 -05:00
Vinayakumar B
7f0e1eb43d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N) 2015-10-19 12:16:16 +05:30
yliu
476a251e5e HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 2015-10-19 09:54:11 +08:00
Steve Loughran
0ab3f9d564 HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel). 2015-10-18 14:05:28 +01:00
Steve Loughran
e286512a71 HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel) 2015-10-18 12:23:43 +01:00
Steve Loughran
bafeb6c7bc HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. (Daryn Sharp via stevel). 2015-10-18 11:45:41 +01:00
cnauroth
a121fa1d39 HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query String. Contributed by Larry McCay. 2015-10-15 16:44:59 -07:00
cnauroth
fdd7406224 HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation failure. Contributed by Chris Nauroth. 2015-10-15 15:54:48 -07:00
cnauroth
5f3f0e0f70 HADOOP-12475. Move attribution to 2.8.0 section of CHANGES.txt. 2015-10-15 15:53:57 -07:00
Sangjin Lee
8d2d3eb7bb HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client (Walter Su via sjlee) 2015-10-15 11:43:07 -07:00
Allen Wittenauer
dc45a7a7c4 Revert "HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw)" 
This reverts commit 0d77e85f0a.
 2015-10-15 08:26:06 -07:00
Steve Loughran
dfa7848463 HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel) 2015-10-14 20:25:47 +01:00
Allen Wittenauer
ab13aa30cb fix CHANGES.txt name typo 2015-10-14 11:48:28 -07:00
Allen Wittenauer
56dc7773f8 HADOOP-12364. Deleting pid file after stop is causing the daemons to keep restarting (Sigi Li via aw) 2015-10-14 11:16:10 -07:00
Allen Wittenauer
0d77e85f0a HADOOP-12436. GlobPattern regex library has performance issues with wildcard characters (Matthew Paduano via aw) 2015-10-14 08:59:41 -07:00
Colin Patrick Mccabe
d286032b71 HDFS-9187. Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem (cmccabe) 2015-10-13 16:11:46 -07:00
Steve Loughran
c59af2fdf8 HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel) 2015-10-13 21:49:28 +01:00
Tsuyoshi Ozawa
33fefa33e5 HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7. (stevel and ozawa) 2015-10-14 05:31:43 +09:00
Haohui Mai
d1e1925bf6 HDFS-9145. Tracking methods that hold FSNamesytemLock for too long. Contributed by Mingliang Liu. 2015-10-13 13:24:15 -07:00
Steve Loughran
59e9980117 HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) 2015-10-13 21:12:08 +01:00
Haohui Mai
7f00fcac77 HADOOP-12474. MiniKMS should use random ports for Jetty server by default. Contributed by Mingliang Liu. 2015-10-13 13:07:57 -07:00
Colin Patrick Mccabe
6716f15964 HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey Brotherton via Colin P. McCabe) 2015-10-13 12:18:03 -07:00
Jitendra Pandey
84cbd72afd HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou. 2015-10-13 09:12:04 -07:00
yliu
e617cf6dd1 HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via yliu) 2015-10-12 16:09:14 +08:00
Haohui Mai
7e2c971fed Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu." 
This reverts commit fa5a54cac7.
 2015-10-10 03:24:59 -07:00
Haohui Mai
fa5a54cac7 HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu. 2015-10-09 22:38:06 -07:00
Akira Ajisaka
e1bf8b3df6 HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking. Contributed by Ray Chiang. 2015-10-09 11:10:29 +09:00
Andrew Wang
66e2cfa1a0 HDFS-8632. Add InterfaceAudience annotation to the erasure coding classes. Contributed by Rakesh R. 2015-10-07 18:12:26 -07:00
Akira Ajisaka
7fbf69bf47 HADOOP-12465. Incorrect javadoc in WritableUtils.java. Contributed by Jagadesh Kiran N. 2015-10-08 06:08:28 +09:00
Uma Mahesh
8b7339312c HDFS-9182. Cleanup the findbugs and other issues after HDFS EC merged to trunk. Contributed by Uma Maheswara Rao G. 2015-10-06 22:22:32 -07:00
Steve Loughran
6d5713a8a8 HADOOP-12284. UserGroupInformation doAs can throw misleading exception (Aaron Dosset via stevel) 2015-10-06 21:39:53 +01:00
cnauroth
5f6edb30c2 HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth. 2015-10-05 20:11:41 -07:00
Allen Wittenauer
b59e434116 HADOOP-10949. metrics2 sink plugin for Apache Kafka (Babak Behzad via aw) 2015-10-05 14:02:07 -07:00
Colin Patrick Mccabe
3e1752f9fb HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 (Masatake Iwasaki via Colin P. McCabe) 2015-10-05 11:35:31 -07:00
Vinod Kumar Vavilapalli
f1c19b9365 HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan. 2015-10-05 10:56:55 -07:00
Tsuyoshi Ozawa
30e2f836a2 HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 and 8. 2015-10-05 08:15:06 +09:00
Harsh J
c918f7be5e HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian. 2015-10-03 18:37:58 +05:30
Jason Lowe
fdf02d1f26 YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu 2015-10-02 20:20:31 +00:00
Zhihai Xu
fd026f535c HADOOP-8437. getLocalPathForWrite should throw IOException for invalid paths. Contributed by Brahma Reddy Battula 2015-10-01 11:56:49 -07:00
Akira Ajisaka
ecbfd68974 HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). Contributed by Rahul Palamuttam and Kanaka Kumar Avvaru. 2015-10-01 18:25:31 +02:00
Zhe Zhang
6c17d31528 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DataStreamer.java

Change-Id: I53ec1c426dc988d6c4a2c87b00caef49c4057010
 2015-09-30 08:39:13 -07:00
yliu
06abc57a90 HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test directory. (Contributed by Colin Patrick McCabe and Chris Nauroth) 2015-09-30 10:56:22 +08:00
Haohui Mai
8703301b46 HDFS-9174. Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread. Contributed by Yi Liu. 2015-09-29 14:56:06 -07:00
Colin Patrick Mccabe
a2efb945e3 Add HADOOP-12447 to CHANGES.txt 2015-09-29 09:37:13 -07:00
Colin Patrick Mccabe
850d679acb HADOOP-12447. Clean up some htrace integration issues (cmccabe) 2015-09-29 09:25:11 -07:00
Zhe Zhang
8fd5520246 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/proto/hdfs.proto
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocolPB/PBHelper.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirStatAndListingOp.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/proto/DatanodeProtocol.proto
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockTokenWithDFS.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java

Change-Id: Ic7946c4ea35bed587fe879ce58b959b25ecc0823
 2015-09-29 01:39:16 -07:00
yliu
d6fa34e014 HDFS-8859. Improve DataNode ReplicaMap memory footprint to save about 45%. (yliu) 2015-09-29 16:20:35 +08:00
Ming Ma
5c3b663bf9 HADOOP-12440. TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down. (Xiao Chen via mingma) 2015-09-28 18:12:51 -07:00
Kihwal Lee
3abbdc929b HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu. 2015-09-28 17:31:51 -05:00
Colin Patrick Mccabe
892ade689f HDFS-9080. Update htrace version to 4.0.1 (cmccabe) 2015-09-28 07:42:12 -07:00
Vinayakumar B
f0f984e4e6 HADOOP-11984. Enable parallel JUnit tests in pre-commit (Contributed by Chris Nauroth) 2015-09-27 14:12:07 +05:30
Vinayakumar B
861b52db24 HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid (Contributed by nijel) 2015-09-26 21:36:17 +05:30
cnauroth
7fe521b1dd HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu. 2015-09-25 22:33:53 -07:00
Yongjun Zhang
3187dbd7a8 HDFS-9123. Copying from the root to a subdirectory should be forbidden. (Wei-Chiu Chuang via Yongjun Zhang) 2015-09-24 21:36:38 -07:00
Zhihai Xu
9cc9f8126b Update CHANGES.txt to reflect commit of HADOOP-8436 to 2.8.0 2015-09-24 12:52:07 -07:00
Zhihai Xu
52c1f272ec HADOOP-12252. LocalDirAllocator should not throw NPE with empty string configuration. Contributed by Zhihai Xu 2015-09-24 11:51:22 -07:00
Arpit Agarwal
df31c446bf HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. (Contributed by Arpit Agarwal) 2015-09-24 11:41:48 -07:00
Haohui Mai
0ef7ff47d5 HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem. Contributed by Chris Nauroth. 2015-09-23 19:36:44 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
1f707ecffd Release process for 2.6.1: Set the release date for 2.6.1 2015-09-23 15:10:50 -07:00
Vinayakumar B
a2c76e5f26 HDFS-9013. Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk (Contributed by Surendra Singh Lilhore) 2015-09-23 15:28:41 +05:30
Zhe Zhang
1080c37300 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

Change-Id: I8511c4d64b0959e79129febc179845a3892fedcc
 2015-09-22 13:27:09 -07:00
Tsuyoshi Ozawa
dfd807afab HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 2015-09-22 12:54:29 +09:00
Steve Loughran
c39ddc306d HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) 2015-09-19 12:41:42 +01:00
Zhihai Xu
88d89267ff HADOOP-12404. Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 2015-09-18 10:40:04 -07:00
Zhihai Xu
3732d5238a Revert "Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu" 
This reverts commit e690a32e57.
 2015-09-18 10:30:40 -07:00
Zhihai Xu
e690a32e57 Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Contributed by Zhihai Xu 2015-09-18 08:24:53 -07:00
Wangda Tan
6b97fa6652 HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a retry interval. (Sunil G via wangda) 2015-09-17 17:46:28 -07:00
Jason Lowe
58d1a02b8d MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 2015-09-17 14:30:18 +00:00
Haohui Mai
0832b38d48 HADOOP-12417. TestWebDelegationToken failing with port in use. Contributed by Mingliang Liu. 2015-09-16 18:38:37 -07:00
Eric Yang
2ffe2db95e HADOOP-12374. Updated expunge command description. 
(WeiWei Yang via eyang)
 2015-09-15 20:03:24 -07:00
Akira Ajisaka
77aaf4cf7d HADOOP-12416. Trash messages should be handled by Logger instead of being delivered on System.out. Contributed by Mingliang Liu. 2015-09-16 10:20:24 +09:00
Vinayakumar B
ce69c9b54c HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru) 2015-09-16 00:18:29 +05:30
cnauroth
b2017d9b03 HADOOP-12413. AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Contributed by Zhihai Xu. 2015-09-15 10:41:50 -07:00
Vinayakumar B
a440567491 HDFS-9067. o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk (Contributed by Surendra Singh Lilhore) 2015-09-15 17:30:46 +05:30
Steve Loughran
7269906254 HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel). 2015-09-13 14:25:26 +01:00
Steve Loughran
3f685cd571 HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) 2015-09-12 18:56:42 +01:00
Steve Loughran
4992f075c8 syncing branch-2 and trunk CHANGES.TXT to be closer together 2015-09-12 18:51:37 +01:00
Steve Loughran
8c054412e1 fix trunk/hadoop-common CHANGES.TXT to be the reference across trunk & branch-2 2015-09-12 18:13:54 +01:00
Robert Kanter
9538af0e1a HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. (zxu via rkanter) 2015-09-11 15:20:17 -07:00
Steve Loughran
ca0827a862 HADOOP-12324. Better exception reporting in SaslPlainServer. (Mike Yoder via stevel) 2015-09-11 15:58:53 +01:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
fbbb7ff1ed Updating all CHANGES.txt files to move entires from future releases into 2.6.1 
section given the large number of backports to 2.6.1.
 2015-09-10 13:45:57 -07:00
Vinayakumar B
94cf7ab9d2 HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore) 2015-09-09 11:03:57 +05:30
Zhihai Xu
d9c1fab2ec HADOOP-12388. Fix components' version information in the web page About the Cluster. Contributed by Jun Gong. 2015-09-08 13:06:36 -07:00
Vinayakumar B
090d26652c HADOOP-12384. Add '-direct' flag option for fs copy so that user can choose not to create '._COPYING_' file (Contributed by J.Andreina) 2015-09-08 19:11:18 +05:30
Andrew Wang
e1feaf6db0 HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. Contributed by Xiaoyu Yao. 2015-09-04 13:42:55 -07:00
Arpit Agarwal
524ba8708b HDFS-9009. Send metrics logs to NullAppender by default. (Arpit Agarwal) 2015-09-03 11:14:47 -07:00
Tsuyoshi Ozawa
0ebc658105 HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla. 2015-09-03 23:32:42 +09:00
Tsuyoshi Ozawa
355eaaa33d HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter error message. Contributed by Wei Yan. 2015-09-03 22:48:53 +09:00
Jian He
09c64ba1ba YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 2015-09-02 17:45:23 -07:00
Akira Ajisaka
65ccf2b125 HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore. 2015-09-02 14:28:38 +09:00
Zhe Zhang
53358fe680 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 2015-09-01 14:48:37 -07:00
Zhe Zhang
ab56fcdb12 Merge remote-tracking branch 'apache/trunk' into HDFS-7285 2015-09-01 14:30:25 -07:00
Andrew Wang
0eb9b19325 HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder. 2015-09-01 10:57:32 -07:00
Tsuyoshi Ozawa
dd149adeac HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun. 2015-09-02 02:01:51 +09:00
Akira Ajisaka
2e251a7674 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N. 2015-09-01 20:55:33 +09:00
yliu
f4d96be6c6 HADOOP-12367. Move TestFileUtil's test resources to resources folder. (wang via yliu) 2015-09-01 16:20:56 +08:00
Andrew Wang
7ad3556ed3 HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. 2015-08-31 18:17:14 -07:00
Lei Xu
6ab2d19f5c HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu) 2015-08-29 09:59:30 -07:00
Arpit Agarwal
bdbe53c676 HDFS-8983. NameNode support for protected directories. (Contributed by Arpit Agarwal) 2015-08-29 09:52:37 -07:00
Andrew Wang
90fe7bcc3b HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin. 2015-08-27 10:17:00 -07:00
Andrew Wang
50fa383704 Revert "MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha)" 
This reverts commit 61bf9cae6f.
 2015-08-27 10:15:19 -07:00
Walter Su
067ec8c2b1 HDFS-8838. Erasure Coding: Tolerate datanode failures in DFSStripedOutputStream when the data length is small. Contributed by Tsz Wo Nicholas Sze. 2015-08-27 09:11:23 +08:00
Jing Zhao
f44b599003 HDFS-8896. DataNode object isn't GCed when shutdown, because it has GC root in ShutdownHookManager. Contributed by Walter Su. 2015-08-26 16:27:34 -07:00
Harsh J
af78767870 HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals before deleting. Contributed by Casey Brotherton. 2015-08-25 11:21:19 +05:30
Xiaoyu Yao
48774d0a45 HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. Contributed by Anu Engineer 2015-08-24 14:31:24 -07:00
Zhe Zhang
6b6a63bbbd Merge commit '456e901a4c5c639267ee87b8e5f1319f256d20c2' (HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai.) into HDFS-7285-merge 2015-08-24 12:59:26 -07:00
Xuan
37e1c3d82a YARN-221. NM should provide a way for AM to tell it not to aggregate 
logs. Contributed by Ming Ma
 2015-08-22 16:25:24 -07:00
Karthik Kambatla
61bf9cae6f MAPREDUCE-6455. Unable to use surefire > 2.18. (Charlie Helin via kasha) 2015-08-22 00:39:04 -07:00
Xiaoyu Yao
caa636bf10 HADOOP-12347. Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives. Contributed by Xiaoyu Yao 2015-08-21 16:32:57 -07:00
Vinod Kumar Vavilapalli
33474939a0 Creating 2.6.2 entries in CHANGES.txt files. 2015-08-20 17:21:06 -07:00
Akira Ajisaka
36b1a1e784 HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki. 2015-08-20 11:09:45 +09:00
Robert Kanter
1e06299df8 HADOOP-12317. Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST (adhoot via rkanter) 2015-08-19 19:00:51 -07:00
Arpit Agarwal
9c3571ea60 HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer) 2015-08-19 09:42:35 -07:00
Tsz-Wo Nicholas Sze
7ecbfd44aa HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes. 2015-08-18 19:25:50 -07:00
Chris Douglas
30e342a5d3 HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan 2015-08-18 17:32:48 -07:00
Benoy Antony
71aedfabf3 hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu. 2015-08-18 13:43:34 -07:00
Arpit Agarwal
a88f31ebf3 HDFS-8880. NameNode metrics logging. (Arpit Agarwal) 2015-08-17 16:55:46 -07:00