big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,679 Commits 2 Branches 2 Tags 264 MiB
4d1fac5df2
Commit Graph

15679 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
332a997e10 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-24 12:56:46 -07:00
Andrew Wang
52b00600df HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy. 2017-03-24 11:44:46 -07:00
Daniel Templeton
33815af424 YARN-6334. TestRMFailover#testAutomaticFailover always passes even when it should fail 
(Contributed by Yufei Gu via Daniel Templeton)
 2017-03-24 11:42:54 -07:00
Daniel Templeton
d49d1862a6 YARN-6360. Prevent FS state dump logger from cramming other log files 
(Contributed by Yufei Gu via Daniel Templeton)
 2017-03-24 11:31:04 -07:00
Andrew Wang
0e556a5ba6 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen. 2017-03-24 11:12:02 -07:00
Ravi Prakash
d4f73e7e27 HDFS-11574. Spelling mistakes in the Java source. Contributed by Hu Xiaodong. 2017-03-24 09:38:17 -07:00
John Zhuge
ab759e91b7 HDFS-10649. Remove unused PermissionStatus#applyUMask. Contributed by Chen Liang. 2017-03-23 23:31:27 -07:00
John Zhuge
128015584d HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 2017-03-23 13:57:08 -07:00
Mingliang Liu
d35e79abc2 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 2017-03-23 13:34:03 -07:00
Chris Douglas
c55195588f HADOOP-14197. Fix ADLS doc for credential provider. Contributed by John Zhuge 2017-03-23 12:17:27 -07:00
Chris Douglas
03955612b7 HADOOP-14196. Azure Data Lake doc is missing required config entry. Contributed by Atul Sikaria 2017-03-23 12:13:23 -07:00
Mingliang Liu
2e30aa72e0 HADOOP-14135. Remove URI parameter in AWSCredentialProvider constructors. Contributed by Mingliang Liu 2017-03-23 11:33:29 -07:00
Ravi Prakash
595f62e362 HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles 2017-03-23 09:28:10 -07:00
Steve Loughran
a5a4867f3b
HADOOP-14120 needless S3AFileSystem.setOptionalPutRequestParameters in S3ABlockOutputStream putObject(). 
Contributed by Yuanbo Liu

(cherry picked from commit 20878d052cebc715c2494a97362fdff08885a77f)
 2017-03-23 12:54:54 +00:00
Zhe Zhang
59d69257a8 HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 2017-03-22 22:22:22 -07:00
John Zhuge
ed2d03f2a5 HDFS-11561. HttpFS doc errors. Contributed by Yuanbo Liu. 2017-03-22 22:15:24 -07:00
Varun Saxena
f462e1ff68 YARN-5934. Fix TestTimelineWebServices.testPrimaryFilterNumericString (Akira Ajisaka via Varun Saxena) 2017-03-22 04:11:53 +05:30
Robert Kanter
cc938e99ec YARN-6326. Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS (yufeigu via rkanter) 2017-03-21 15:21:11 -07:00
Daniel Templeton
0a05c5c598 YARN-6284. hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable 
(Contributed by Laura Adams via Daniel Templeton)
 2017-03-21 14:15:40 -07:00
Junping Du
c01d15ab27 YARN-6367. YARN logs CLI needs alway check containerLogsInfo/containerLogInfo before parse the JSON object from NMWebService. Contributed by Xuan Gong. 2017-03-21 10:53:27 -07:00
Akira Ajisaka
74af0bdf68 HADOOP-14187. Update ZooKeeper dependency to 3.4.9 and Curator dependency to 2.12.0. Contributed by Tsuyoshi Ozawa. 2017-03-22 02:46:59 +09:00
Steve Loughran
2841666f1f
HADOOP-14204 S3A multipart commit failing, 
"UnsupportedOperationException at java.util.Collections$UnmodifiableList.sort".

Contributed by Steve Loughran

(cherry picked from commit 595501c9ddacd5fdb740ac1bf9bfeb0ffbbd6c0e)
 2017-03-21 13:15:15 +00:00
Yiqun Lin
3b908f71c5 HDFS-11358. DiskBalancer: Report command supports reading nodes from host file. Contributed by Yiqun Lin. 2017-03-21 17:44:17 +08:00
Sunil G
1a98a279f4 YARN-6362. Use frontend-maven-plugin 0.0.22 version for new yarn ui. Contributed by Kai Sasaki. 2017-03-21 13:46:31 +05:30
Arpit Agarwal
e7c8da614c HDFS-11545. Propagate DataNode's slow disks info to the NameNode via Heartbeats. Contributed by Hanisha Koneru. 2017-03-20 21:54:58 -07:00
Chris Douglas
b104f3a282 HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri 2017-03-20 17:15:13 -07:00
Mingliang Liu
8e15e24059 HADOOP-13945. Azure: Add Kerberos and Delegation token support to WASB client. Contributed by Santhosh G Nayak 
Change-Id: I39fb0a3b0491bf2160571366939a0502a0045429
 2017-03-20 16:31:24 -07:00
Daniel Templeton
49efd5d204 YARN-6309. Fair scheduler docs should have the queue and queuePlacementPolicy 
elements listed in bold so that they're easier to see
(Contributed by Esmaeil Mirzaee via Daniel Templeton)
 2017-03-20 14:25:00 -07:00
Arpit Agarwal
6c399a88e9 HADOOP-14059. typo in s3a rename(self, subdir) error message. Contributed by Steve Loughran. 2017-03-20 11:29:23 -07:00
Varun Saxena
35034653d0 YARN-6353. Clean up OrderingPolicy javadoc (Daniel Templeton via Varun Saxena) 2017-03-20 23:29:09 +05:30
Naganarasimha
34a931c0fa MAPREDUCE-6865. Fix typo in javadoc for DistributedCache. Contributed by Attila Sasvari. 2017-03-20 00:04:23 +05:30
Arpit Agarwal
ffa160ddb8 HDFS-11547. Add logs for slow BlockReceiver while writing data to disk. Contributed by Xiaobing Zhou. 2017-03-17 19:02:24 -07:00
Erik Krogen
e1a99802fc HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen. 2017-03-17 17:12:49 -07:00
Hanisha Koneru
7f8e928400 HDFS-11517. Expose slow disks via DataNode JMX. Contributed by Hanisha Koneru 2017-03-17 15:42:25 -07:00
Jason Lowe
4a8e304502 YARN-6217. TestLocalCacheDirectoryManager test timeout is too aggressive. Contributed by Miklos Szegedi 2017-03-17 14:06:35 -05:00
Andrew Wang
92ea6d74ec HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 2017-03-17 11:26:02 -07:00
Mingliang Liu
86035c1644 HADOOP-14192. Aliyun OSS FileSystem contract test should implement getTestBaseDir(). Contributed by Mingliang Liu 2017-03-17 11:01:00 -07:00
Xiaobing Zhou
7536815039 HDFS-10394. move declaration of okhttp version from hdfs-client to hadoop-project POM. Contributed by Xiaobing Zhou. 2017-03-16 18:13:43 -07:00
Mingliang Liu
c04fb35c45 HADOOP-14191. Duplicate hadoop-minikdc dependency in hadoop-common module. Contributed by Xiaobing Zhou 2017-03-16 16:08:32 -07:00
Andrew Wang
4812518b23 HDFS-10530. BlockManager reconstruction work scheduling should correctly adhere to EC block placement policy. Contributed by Manoj Govindassamy and Rui Gao. 2017-03-16 15:07:38 -07:00
Jitendra Pandey
09ad8effb8 HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh. 2017-03-16 12:20:46 -07:00
Steve Loughran
79ede403ee
Revert "HDFS-11431. hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider." 
This reverts commit cd976b263b.
 2017-03-16 19:06:51 +00:00
Kihwal Lee
ba62b50eba HDFS-10601. Improve log message to include hostname when the NameNode is in safemode. Contributed by Kuhu Shukla. 2017-03-16 10:54:59 -05:00
Jason Lowe
7114baddb6 YARN-4051. ContainerKillEvent lost when container is still recovering and application finishes. Contributed by sandflee 2017-03-16 09:30:10 -05:00
Steve Loughran
cd976b263b
HDFS-11431. hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider. 
Contributed by Steven Rand.

(cherry picked from commit b59dd4c79824280616641408b538e90f10eb49f8)
 2017-03-16 14:08:30 +00:00
Jian He
6d95866dcf YARN-6332. Make RegistrySecurity use short user names for ZK ACLs. Contributed by Billie Rinaldi 2017-03-16 12:59:55 +08:00
Hanisha Koneru
d69a82c89c HDFS-11511. Support Timeout when checking single disk. Contributed by Hanisha Koneru. 2017-03-15 18:01:45 -07:00
Chen Liang
615ac09499 HDFS-11419. DFSTopologyNodeImpl#chooseRandom optimizations. Contributed by Chen Liang. 2017-03-15 12:28:22 -07:00
Junping Du
221783b35b YARN-6294. ATS client should better handle Socket closed case. Contributed by Li Lu. 2017-03-15 11:48:17 -07:00
Rohith Sharma K S
bb6a214cd3 YARN-6336. Jenkins report YARN new UI build failure. Contributed by Sunil G. 2017-03-15 15:54:09 +05:30