big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9,589 Commits 2 Branches 2 Tags 264 MiB
0da1330bfd
Commit Graph

9589 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Nauroth
4888b16a43 MAPREDUCE-5886. Allow wordcount example job to accept multiple input paths. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601704 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-10 17:48:52 +00:00
Jian He
d3b8971798 YARN-2030. Augmented RMStateStore with state machine. Contributed by Binglin Chang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601537 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-10 01:00:15 +00:00
Andrew Wang
123c563fe6 HDFS-6460. Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance. Contributed by Yongjun Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601535 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-10 00:39:20 +00:00
Jian He
c94f2cec3a Augmented RMStateStore with state machine. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601491 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-09 19:44:31 +00:00
Aaron Myers
36383505c4 Moving CHANGES.txt entry for HADOOP-9099 to the correct section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601482 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-09 19:01:39 +00:00
Aaron Myers
d4b9a04840 HADOOP-10664. TestNetUtils.testNormalizeHostName fails. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601478 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-09 18:53:19 +00:00
Andrew Wang
a72f850e33 HDFS-6399. Add note about setfacl in HDFS permissions guide. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601476 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-09 18:42:17 +00:00
Colin McCabe
8b2b7ff0ae HDFS-6257. TestCacheDirectives#testExceedsCapacity fails occasionally (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601473 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-09 18:39:37 +00:00
Vinod Kumar Vavilapalli
424fd9494f YARN-1368. Added core functionality of recovering container state into schedulers after ResourceManager Restart so as to preserve running work in the cluster. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601303 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-09 03:09:21 +00:00
Junping Du
cc9bc8eef7 HDFS-6500. Snapshot shouldn't be removed silently after renaming to an existing snapshot. (Contributed by Nicholas SZE) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601199 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-08 07:06:35 +00:00
Karthik Kambatla
9958072d53 YARN-2132. ZKRMStateStore.ZKAction#runWithRetries doesn't log the exception it encounters. (Vamsee Yarlagadda via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601065 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-07 06:12:59 +00:00
Konstantin Boudnik
fb7ea6d8bc HDFS-6297. Add CLI testcases to reflect new features of dfs and dfsadmin (Contributed by Dasha Boudnik) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601059 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-07 05:22:34 +00:00
Karthik Kambatla
85d4c787e0 YARN-2128. FairScheduler: Incorrect calculation of amResource usage. (Wei Yan via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601050 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-07 01:21:33 +00:00
Karthik Kambatla
969bef3c77 YARN-2122. In AllocationFileLoaderService, the reloadThread should be created in init() and started in start(). (Robert Kanter via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601045 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-07 00:49:20 +00:00
Colin McCabe
9528ed939d HDFS-6497. Make TestAvailableSpaceVolumeChoosingPolicy deterministic (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601035 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 23:40:39 +00:00
Andrew Wang
14394eed00 HDFS-6487. TestStandbyCheckpoint#testSBNCheckpoints is racy. Contributed by Mit Desai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601016 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 21:36:56 +00:00
Vinod Kumar Vavilapalli
825365d1d0 YARN-2121. Fixed NPE handling in Timeline Server's TimelineAuthenticator. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601000 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 20:32:43 +00:00
Zhijie Shen
08b4aa699a YARN-2117. Fixed the issue that secret file reader is potentially not closed in TimelineAuthenticationFilterInitializer. Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600994 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 20:07:58 +00:00
Karthik Kambatla
40ba8c17c1 MAPREDUCE-5777. Support utf-8 text with Byte Order Marker. (Zhihai Xu via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600977 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 18:37:03 +00:00
Steve Loughran
3d077726d0 HADOOP-10647. String Format Exception in SwiftNativeFileSystemStore.java. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600971 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 18:00:52 +00:00
Zhijie Shen
d7f5d76869 YARN-2118. Fixed the type mismatch in Map#containsKey check of TimelineWebServices#injectOwnerInfo. Contributed by Ted Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600967 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 17:47:03 +00:00
Uma Maheswara Rao G
f81c7b0252 MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs). Contributed by Yi Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600900 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 14:45:39 +00:00
Uma Maheswara Rao G
6a4f6d6b3e HDFS-6464. Support multiple xattr.name parameters for WebHDFS getXAttrs. Contributed by Yi Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600810 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 03:48:43 +00:00
Charles Lamb
a93a37a8cd Various fixes to CHANGES-fs-encryption.txt. Various Jiras ended up in the hadoop-common CHANGES-fs-encryption.txt by accident. Moved them to HDFS CHANGES-fs-encryption.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600804 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 01:49:53 +00:00
Charles Lamb
3f892e9d53 HDFS-6473. Protocol and API for Encryption Zones (clamb) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600803 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 01:42:18 +00:00
Colin McCabe
e40524d759 HDFS-6369. Document that BlockReader#available() can return more bytes than are remaining in the block (Ted Yu via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600801 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 00:59:18 +00:00
Andrew Wang
1cbff8ff82 HDFS-6476. Print out the KeyProvider after finding KP successfully on startup. Contributed by Juan Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600799 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-06 00:55:14 +00:00
Junping Du
0ceb742549 YARN-1977. Add tests on getApplicationRequest with filtering start time range. (Contributed by Junping Du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600644 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-05 13:15:44 +00:00
Charles Lamb
bdee397e95 HADOOP-6392. Wire crypto streams for encrypted files in DFSClient. (clamb and yliu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600582 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-05 10:10:48 +00:00
Yi Liu
d86db3f76f HADOOP-10662. NullPointerException in CryptoInputStream while wrapped stream is not ByteBufferReadable. Add tests using normal stream. Contributed by Yi Liu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1600553 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-05 01:30:40 +00:00
Karthik Kambatla
d1d6bb70f4 YARN-2061. Revisit logging levels in ZKRMStateStore. (Ray Chiang via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600498 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-04 21:11:09 +00:00
Karthik Kambatla
731f417f67 YARN-2119. DEFAULT_PROXY_ADDRESS should use DEFAULT_PROXY_PORT. (Anubhav Dhoot via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600484 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-04 20:12:47 +00:00
Andrew Wang
02fcb6b6ba HDFS-6268. Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found. (wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599734 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-03 18:33:09 +00:00
Aaron Myers
0634b42366 HADOOP-10658. SSLFactory expects truststores being configured. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599435 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-03 07:23:16 +00:00
Ravi Prakash
ad5d0d7167 HADOOP 9704. Write metrics sink plugin for Hadoop/Graphite (Chu Tong, Alex Newman and Babak Behzad via raviprak) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599413 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-03 05:42:50 +00:00
Sanford Ryza
16caa3fd18 YARN-1913. With Fair Scheduler, cluster can logjam when all resources are consumed by AMs (Wei Yan via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599400 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-03 00:56:48 +00:00
Jing Zhao
a29d2d3371 HDFS-6424. blockReport doesn't need to invalidate blocks on SBN. Contributed by Ming Ma. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599397 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-03 00:47:11 +00:00
Jing Zhao
cf03bdc3fc HADOOP-10630. Possible race condition in RetryInvocationHandler. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599366 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-02 21:33:07 +00:00
Karthik Kambatla
5bbc484393 YARN-1877. Updated CHANGES.txt to fix the JIRA number. It was previously committed as YARN-2010. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599348 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-02 20:28:13 +00:00
Michael Stack
f15ff5e4f4 HDFS-6109 let sync_file_range() system call run in background (Liang Xie via stack) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599347 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-02 20:27:15 +00:00
Karthik Kambatla
0aad2d56df YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599345 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-02 20:22:52 +00:00
Yi Liu
75ec5792df HADOOP-10653. Add a new constructor for CryptoInputStream that receives current position of wrapped stream. Contributed by Yi Liu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1599228 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-02 14:35:32 +00:00
Junping Du
790cbbf3e2 YARN-2103. Inconsistency between viaProto flag and initial value of SerializedExceptionProto.Builder (Contributed by Binglin Chang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599115 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-02 08:15:30 +00:00
Karthik Kambatla
a4ba451802 YARN-1474. Make schedulers services. (Tsuyoshi Ozawa via kasha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598908 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-31 19:33:09 +00:00
Kihwal Lee
77805fb69b Fix merge error. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598873 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-31 14:32:21 +00:00
Vinod Kumar Vavilapalli
23c325ad47 YARN-2115. Replaced RegisterNodeManagerRequest's ContainerStatus with a new NMContainerStatus which has more information that is needed for work-preserving RM-restart. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598790 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-31 00:20:50 +00:00
Andrew Wang
880a0c673c HDFS-6375. Listing extended attributes with the search permission. Contributed by Charles Lamb. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598788 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-31 00:12:02 +00:00
Andrew Wang
da5df3af0a Move HDFS-6110 down to 2.5.0 section of CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598787 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-31 00:07:46 +00:00
Charles Lamb
871616b993 merge from trunk r1598783 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1598785 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-31 00:01:20 +00:00
Charles Lamb
4054a40891 HDFS-6388. HDFS integration with KeyProvider. (clamb) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/fs-encryption@1598783 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-30 23:53:45 +00:00