big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
14,435 Commits 2 Branches 2 Tags 264 MiB
f67237cbe7
Commit Graph

14435 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jing Zhao
0cde9e12a7 HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang. 2016-07-25 18:41:13 -07:00
Chris Douglas
d383bfdcd4 YARN-5164. Use plan RLE to improve CapacityOverTimePolicy efficiency 2016-07-25 16:37:50 -07:00
Jason Lowe
703fdf86c6 MAPREDUCE-6744. Increase timeout on TestDFSIO tests. Contributed by Eric Badger 2016-07-25 21:54:48 +00:00
Steve Loughran
86ae218893 HADOOP-13188 S3A file-create should throw error rather than overwrite directories. Contributed by Steve Loughran 2016-07-25 15:50:23 +01:00
Steve Loughran
be9e46b42d HADOOP-13406 S3AFileSystem: Consider reusing filestatus in delete() and mkdirs(). Contributed by Rajesh Balamohan 2016-07-25 14:45:03 +01:00
Steve Loughran
7052ca8804 HADOOP-13389 TestS3ATemporaryCredentials.testSTS error when using IAM credentials. Contributed by Steven K. Wong 2016-07-23 18:00:08 +01:00
Kai Zheng
b79ba4fe96 HDFS-10651. Clean up some configuration related codes about legacy block reader. Contributed by Youwei Wang 2016-07-23 17:45:33 +08:00
Chris Douglas
22a9a6b0d4 HADOOP-13272. ViewFileSystem should support storage policy related API. Contributed by Peter Shi 2016-07-22 18:08:12 -07:00
Chris Nauroth
5fda66e4a3 HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran. 2016-07-22 15:38:18 -07:00
Arpit Agarwal
c6e3a0020f HDFS-10660. Expose storage policy apis via HDFSAdmin interface. (Contributed by Rakesh R) 2016-07-22 12:33:50 -07:00
Uma Maheswara Rao G
77ac04efe4 HDFS-10565: Erasure Coding: Document about the current allowed storage policies for EC Striped mode files 2016-07-22 11:08:20 -07:00
Chris Nauroth
c60a68ce1d HADOOP-13392. [Azure Data Lake] OAuth2 configuration should be default set to true when AdlFileSystem is configured. Contributed by Vishwajeet Dusane and Chris Douglas. 2016-07-22 09:16:38 -07:00
Chris Douglas
dca6335dbc HADOOP-13393. Omit unsupported fs.defaultFS setting in ADLS documentation 2016-07-21 23:21:47 -07:00
Xiao Chen
132deb4cac HDFS-10225. DataNode hot swap drives should disallow storage type changes. Contributed by Lei (Eddy) Xu. 2016-07-21 16:41:02 -07:00
mattf-horton
12aa184479 HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects, while adding it in to the only place it is still needed, hadoop-openstack. Contributed by Matt Foley. 2016-07-21 14:43:57 -07:00
Chris Nauroth
43cf6b101d HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge. 2016-07-21 14:12:31 -07:00
Akira Ajisaka
ecff7d0359 MAPREDUCE-6738. TestJobListCache.testAddExisting failed intermittently in slow VM testbed. Contributed by Junping Du. 2016-07-21 11:34:48 -07:00
Akira Ajisaka
fcde6940e0 HDFS-10287. MiniDFSCluster should implement AutoCloseable. Contributed by Andras Bokor. 2016-07-21 11:26:08 -07:00
Jing Zhao
bd3dcf46e2 HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp. 2016-07-21 11:14:39 -07:00
Rohith Sharma K S
557a245d83 YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe. 2016-07-21 12:47:27 +05:30
Rohith Sharma K S
be34b2a8fd YARN-1126. Add validation of users input nodes-states options to nodes CLI. Contributed by Wei Yan. 2016-07-21 12:20:47 +05:30
Lei Xu
521f34317a HADOOP-12928. Update netty to 3.10.5.Final to sync with zookeeper. (lei) 2016-07-20 20:38:20 -07:00
Andrew Wang
e340064013 HADOOP-13383. Update release notes for 3.0.0-alpha1. 2016-07-20 16:57:55 -07:00
Akira Ajisaka
c63afdbe14 YARN-4883. Make consistent operation name in AdminService. Contributed by Kai Sasaki. 2016-07-20 16:51:01 -07:00
Akira Ajisaka
38128baff4 HDFS-10425. Clean up NNStorage and TestSaveNamespace. Contributed by Andras Bokor. 2016-07-20 10:44:11 -07:00
Vinod Kumar Vavilapalli
1c9d2ab503 YARN-5340. Fixed a race condition in RollingLevelDBTimelineStore that caused loss of Timeline events. Contributed by Li Lu. 2016-07-20 08:36:36 -07:00
Steve Loughran
37362c2f92 HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan) 2016-07-20 13:42:51 +01:00
Varun Vasudev
9ccf935b2c YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang. 2016-07-20 12:48:32 +05:30
Arun Suresh
8fbe6ece24 YARN-5350. Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost. (asuresh) 2016-07-19 23:03:58 -07:00
Sangjin Lee
8f0d3d69d6 MAPREDUCE-6365. Refactor JobResourceUploader#uploadFilesInternal (Chris Trezzo via sjlee) 2016-07-19 20:15:37 -07:00
Akira Ajisaka
dc065dd64c HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki. 2016-07-19 16:05:48 -07:00
Akira Ajisaka
f7dabe3add HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg. 2016-07-19 15:13:01 -07:00
Akira Ajisaka
7ddef0fee4 HDFS-10647. Add a link to HDFS disk balancer document in site.xml. Contributed by Yiqun Lin. 2016-07-19 14:46:07 -07:00
Akira Ajisaka
fc570b55b9 HDFS-10603. Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot. Contributed by Yiqun Lin. 2016-07-19 13:49:24 -07:00
Arun Suresh
cda0a280dd YARN-5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh) 2016-07-19 10:43:37 -07:00
Arun Suresh
5f2d33a551 Revert "YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)" 
This reverts commit e905a42a2c.
 2016-07-19 10:43:19 -07:00
Junping Du
dc2f4b6ac8 YARN-5213. Fix a bug in LogCLIHelpers which cause TestLogsCLI#testFetchApplictionLogs fails intermittently. Contributed by Xuan Gong. 2016-07-19 07:17:58 -07:00
Varun Saxena
fe20494a72 YARN-4996. Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic (Kai Sasaki via Varun Saxena) 2016-07-19 16:03:28 +05:30
Akira Ajisaka
92fe2db540 HADOOP-13301. Millisecond timestamp for FsShell console log and MapReduce jobsummary log. Contributed by John Zhuge. 2016-07-18 15:45:44 -07:00
Akira Ajisaka
c2bcffb34e HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki. 2016-07-18 11:48:23 -07:00
Steve Loughran
76be82bc04 HADOOP-13073 RawLocalFileSystem does not react on changing umask. Contributed by Andras Bokor 2016-07-18 14:38:35 +01:00
Akira Ajisaka
5b4a708704 HDFS-10639. Fix typos in HDFSDiskbalancer.md. Contributed by Yiqun Lin. 2016-07-15 21:41:57 -07:00
Andrew Wang
da456ffd62 Preparing for 3.0.0-alpha2 development 2016-07-15 19:04:17 -07:00
Tsuyoshi Ozawa
ea9f43781e HADOOP-13298. Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/. (ozawa) 2016-07-16 08:01:16 +09:00
Ray Chiang
f5f1c81e7d YARN-5272. Handle queue names consistently in FairScheduler. (Wilfred Spiegelenburg via rchiang) 2016-07-15 14:38:50 -07:00
Arun Suresh
e905a42a2c YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh) 2016-07-15 14:35:12 -07:00
Jitendra Pandey
c2f9cd584c HADOOP-13368. DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation. Contributed by Mingliang Liu. 2016-07-15 14:28:53 -07:00
Robert Kanter
442162048a HADOOP-13254. Create framework for configurable disk checkers (yufeigu via rkanter) 2016-07-15 13:41:26 -07:00
Robert Kanter
0881ed3fc3 MAPREDUCE-6652. Add configuration property to prevent JHS from loading jobs with a task count greater than X (haibochen via rkanter) 2016-07-15 13:30:03 -07:00
Akira Ajisaka
c48e9d608c HDFS-10628. Log HDFS Balancer exit message to its own log. Contributed by Jiayi Zhou. 2016-07-15 11:42:44 -07:00