big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,290 Commits 2 Branches 2 Tags 264 MiB
b01514f65b
Commit Graph

15290 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mingliang Liu
19f373a46b HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane 2016-12-01 12:54:28 -08:00
Kihwal Lee
96c574927a HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp. 2016-12-01 12:11:27 -06:00
Akira Ajisaka
e0fa49234f HDFS-11180. Intermittent deadlock in NameNode when failover happens. 2016-12-01 23:08:59 +09:00
Andrew Wang
1f7613be95 HADOOP-13840. Implement getUsed() for ViewFileSystem. Contributed by Manoj Govindassamy. 2016-11-30 17:55:12 -08:00
Andrew Wang
7226a71b1f HDFS-5517. Lower the default maximum number of blocks per file. Contributed by Aaron T. Myers and Andrew Wang. 2016-11-30 15:58:31 -08:00
Li Lu
69fb70c31a YARN-5761. Separate QueueManager from Scheduler. (Xuan Gong via gtcarrera9) 2016-11-30 13:38:42 -08:00
Mingliang Liu
3fd844b99f HADOOP-13830. Intermittent failure of ITestS3NContractRootDir#testRecursiveRootListing: "Can not create a Path from an empty string". Contributed by Steve Loughran 2016-11-30 13:01:19 -08:00
Daniel Templeton
4fca94fbda YARN-5942. "Overridden" is misspelled as "overriden" in FairScheduler.md 
(Contributed by Heather Sutherland via Daniel Templeton)
 2016-11-30 11:23:51 -08:00
Akira Ajisaka
be5a757096 HADOOP-13790. Make qbt script executable. Contributed by Andrew Wang. 2016-12-01 03:52:44 +09:00
Ravi Prakash
7c848719de MAPREDUCE-6810. Fix hadoop-mapreduce-client-nativetask compilation with GCC-6.2.1. Contributed by Ravi Prakash. 2016-11-30 10:47:41 -08:00
Daniel Templeton
b3befc021b YARN-4997. Update fair scheduler to use pluggable auth provider (Contributed by Tao Jie via Daniel Templeton) 2016-11-30 09:50:33 -08:00
Ravi Prakash
625df87c7b HDFS-8678. Bring back the feature to view chunks of files in the HDFS file browser. Contributed by Ivo Udelsmann. 2016-11-30 09:12:15 -08:00
Kai Zheng
51e6c1cc3f HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen 2016-11-30 15:52:56 +08:00
Kai Zheng
cfd8076f81 Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen" 
This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.
 2016-11-30 15:44:52 +08:00
Xiaoyu Yao
aeecfa24f4 HADOOP-10930. Refactor: Wrap Datanode IO related operations. Contributed by Xiaoyu Yao. 2016-11-29 20:52:36 -08:00
Arpit Agarwal
eaaa32950c HDFS-11149. Support for parallel checking of FsVolumes. 2016-11-29 20:31:02 -08:00
Junping Du
8f6e14399a MAPREDUCE-6565. Configuration to use host name in delegation token service is not read from job.xml during MapReduce job execution. Contributed by Li Lu. 2016-11-29 15:51:27 -08:00
Daniel Templeton
6d8b4f6c27 YARN-4395. Typo in comment in ClientServiceDelegate (Contributed by Alison Yu via Daniel Templeton) 2016-11-29 15:30:22 -08:00
Daniel Templeton
dd9a96cb17 YARN-5851. TestContainerManagerSecurity testContainerManager[1] failed (Contributed by Haibo Chen via Daniel Templeton) 2016-11-29 14:22:19 -08:00
Daniel Templeton
3b9d3acd20 YARN-5890. FairScheduler should log information about AM-resource-usage and max-AM-share for queues 
(Contributed by Yufei Gu via Daniel Templeton)
 2016-11-29 12:46:05 -08:00
Andrew Wang
b407d53195 Revert "HDFS-5517. Lower the default maximum number of blocks per file. Contributed by Aaron T. Myers." 
This reverts commit 09451252fa.
 2016-11-29 10:50:10 -08:00
Daniel Templeton
25f9872be6 YARN-5774. MR Job stuck in ACCEPTED status without any progress in Fair Scheduler 
if set yarn.scheduler.minimum-allocation-mb to 0. (Contributed by Yufei Gu via Daniel Templeton)
 2016-11-29 09:40:49 -08:00
Akira Ajisaka
00096dcc0c HADOOP-13812. Upgrade Tomcat to 6.0.48. Contributed by John Zhuge. 2016-11-29 19:47:02 +09:00
Andrew Wang
09451252fa HDFS-5517. Lower the default maximum number of blocks per file. Contributed by Aaron T. Myers. 2016-11-29 00:12:35 -08:00
Akira Ajisaka
67d9f2808e HADOOP-13706. Update jackson from 1.9.13 to 2.x in hadoop-common-project. 2016-11-29 14:07:19 +09:00
Robert Kanter
47ca9e26fb HADOOP-13838. KMSTokenRenewer should close providers (xiaochen via rkanter) 2016-11-28 18:08:09 -08:00
Mingliang Liu
d60a60be8a HADOOP-13823. s3a rename: fail if dest file exists. Contributed by Steve Loughran 2016-11-28 16:30:29 -08:00
Allen Wittenauer
be88d574a9 MAPREDUCE-6743. nativetask unit tests need to provide usable output; fix link errors during mvn test 2016-11-28 15:24:44 -08:00
Daniel Templeton
62b42ef5dd YARN-5725. Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange 
when setting IP and host (Contributed by Miklos Szegedi via Daniel Templeton)
 2016-11-28 15:19:52 -08:00
Andrew Wang
a2b1ff0257 HADOOP-13828. Implement getFileChecksum(path, length) for ViewFileSystem. Contributed by Manoj Govindassamy. 2016-11-28 11:54:43 -08:00
Kai Zheng
5d5614f847 HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen 2016-11-28 14:34:44 +08:00
Akira Ajisaka
209e805430 HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki. 2016-11-28 14:34:57 +09:00
Akira Ajisaka
9e173d2bac HADOOP-13816. Ambiguous plugin version warning from maven build. Contributed by Kai Sasaki. 2016-11-28 13:10:31 +09:00
Naganarasimha
c06114d6a3 YARN-5572. HBaseTimelineWriterImpl appears to reference a bad property name. Contributed by Varun Saxena. 2016-11-27 23:35:53 +05:30
Naganarasimha
e2f77ca77b Revert "YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena." 
This reverts commit 9f2960be19.
 2016-11-27 23:32:59 +05:30
Naganarasimha
9f2960be19 YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena. 2016-11-27 23:31:27 +05:30
Harsh J
07825f2b49 HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable rather than hard coded to 2000 bytes. Contributed by Harsh J. 2016-11-25 22:22:23 +05:30
Brahma Reddy Battula
ee3d437a33 HADOOP-13820. Replace ugi.getUsername() with ugi.getShortUserName() in viewFS. Contributed By Brahma Reddy Battula. 2016-11-25 19:54:50 +05:30
Akira Ajisaka
bb1b5e083b HDFS-11174. Wrong HttpFS test command in doc. Contributed by John Zhuge. 2016-11-25 21:28:29 +09:00
Akira Ajisaka
636f7547b7 HDFS-11175. Document uppercase key names are not supported in TransparentEncryption.md. Contributed by Yiqun Lin. 2016-11-25 17:48:54 +09:00
Steve Loughran
01665e456d HADOOP-10776 Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects. Contributed by Vinod Kumar Vavilapalli 
Cherry picked from 24715cefe80fba531dd16a44ec1cead67c389eb1
 2016-11-24 17:54:10 +00:00
Steve Loughran
3df3fa396c HADOOP-13833 TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP-13605. Contributed by Brahma Reddy Battula. 2016-11-24 17:44:36 +00:00
Brahma Reddy Battula
13501053dd HADOOP-11603. Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized. Contributed By Brahma Reddy Battula. 2016-11-24 22:23:22 +05:30
Steve Loughran
abb9fa7fc6 HADOOP-13018. Make Kdiag check whether hadoop.token.files points to existent and valid files. Contributed by Ravi Prakash 2016-11-24 16:41:59 +00:00
Sunil
eb0a483ed0 YARN-4206. Add Application timeouts in Application report and CLI. Contributed by Rohith Sharma K S. 2016-11-24 18:18:42 +05:30
Rohith Sharma K S
e15c20edba YARN-5920. Fix deadlock in TestRMHA.testTransitionedToStandbyShouldNotHang. Contributed by Varun Saxena. 2016-11-24 12:18:38 +05:30
Daniel Templeton
10468529a9 YARN-4752. Improved preemption in FairScheduler. (kasha) 
Contains:
YARN-5605. Preempt containers (all on one node) to meet the requirement of starved applications
YARN-5821. Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy
YARN-5783. Verify identification of starved applications.
YARN-5819. Verify fairshare and minshare preemption
YARN-5885. Cleanup YARN-4752 branch for merge

Change-Id: Iee0962377d019dd64dc69a020725d2eaf360858c
 2016-11-23 19:48:59 -10:00
Andrew Wang
c7a5f2906f HADOOP-13766. Fix a typo in the comments of RPC.getProtocolVersion. Contributed by Ethan Li. 2016-11-23 17:08:38 -08:00
Mingliang Liu
860d49aa6a HADOOP-13605. Clean up FileSystem javadocs, logging; improve diagnostics on FS load. Contributed by Steve Loughran 2016-11-23 16:42:27 -08:00
Andrew Wang
de4894936a HDFS-11368. Erasure Coding: Deprecate replication-related config keys. Contributed by Rakesh R. 2016-11-23 16:42:06 -08:00