big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,897 Commits 2 Branches 2 Tags 264 MiB
c6d09d8c0c
Commit Graph

5897 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jing Zhao
7e2aba0ab5 HDFS-5007. Replace hard-coded property keys with DFSConfigKeys fields. Contributed by Kousuke Saruta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504764 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 05:41:33 +00:00
Arun Murthy
31f29de05b Fixed CHANGES.txt to reflect that new content in branch-2 goes to hadoop-2.3.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504742 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 01:29:07 +00:00
Arun Murthy
87a02553ee Fixed CHANGES.txt to reflect that all fixes in 2.1.1-beta are now in 2.1.0-beta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504738 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 01:03:19 +00:00
Arun Murthy
ac914f79bc YARN-918. Remove ApplicationAttemptId from RegisterApplicationMasterRequestProto. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504735 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 00:57:40 +00:00
Vinod Kumar Vavilapalli
7a29bccd7a YARN-814. Improving diagnostics when containers fail during launch due to various reasons like invalid env etc. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504732 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 00:28:18 +00:00
Jing Zhao
8724ceb235 HADOOP-9717. Add retry attempt count to the RPC requests. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504725 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 23:44:06 +00:00
Luke Lu
ba3d29a2e2 HADOOP-9164. Print paths of loaded native libraries in NativeLibraryChecker. (Binglin Chang via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504700 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 22:38:36 +00:00
Chris Nauroth
e2efe52ac8 HDFS-4996. ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504679 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 21:57:24 +00:00
Jason Darrell Lowe
cc536fe4da MAPREDUCE-5265. History server admin service to refresh user and superuser group mappings. Contributed by Ashwin Shankar 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504645 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 20:41:14 +00:00
Arun Murthy
32bc200d54 YARN-701. Use application tokens irrespective of secure or non-secure mode. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504604 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 19:03:48 +00:00
Tsz-wo Sze
7ec67c5118 HADOOP-9716. Rpc retries should use the same call ID as the original call. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504362 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 04:42:56 +00:00
Chris Nauroth
a5cd4b9bee HDFS-5003. TestNNThroughputBenchmark failed caused by existing directories. Contributed by Xi Fang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504352 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 03:28:19 +00:00
Jing Zhao
68faa67f1b HDFS-5005. Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504326 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 00:04:28 +00:00
Hitesh Shah
1c133ffb72 YARN-865. RM webservices can't query based on application Types. Contributed by Xuan Gong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504288 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 21:42:24 +00:00
Bikas Saha
9f3e488936 YARN-922. Change FileSystemRMStateStore to use directories (Jian He via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504261 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 20:19:49 +00:00
Colin McCabe
b767ee07c2 fix misspelling in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504229 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 18:41:14 +00:00
Vinod Kumar Vavilapalli
c6facfb10d YARN-912. Move client facing exceptions to yarn-api module. Contributed by Mayank Bansal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504032 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 07:31:33 +00:00
Vinod Kumar Vavilapalli
8b9c1e68ab YARN-62. Modified NodeManagers to avoid AMs from abusing container tokens for repetitive container launches. Contributed by Omkar Vinit Joshi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503986 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 04:24:44 +00:00
Kihwal Lee
1b6324265d HADOOP-9738. TestDistCh fails. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503976 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 02:22:14 +00:00
Kihwal Lee
d26334b410 HDFS-4998. TestUnderReplicatedBlocks fails intermittently. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503971 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 01:57:35 +00:00
Bikas Saha
3520039979 YARN-927. Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest (bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503960 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 00:47:46 +00:00
Jason Darrell Lowe
865d902bd1 MAPREDUCE-5380. Invalid mapred command should return non-zero exit code. Contributed by Stephen Chu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503957 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 00:29:50 +00:00
Jason Darrell Lowe
febc5040b9 HADOOP-9734. Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503954 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 00:06:48 +00:00
Vinod Kumar Vavilapalli
6d12709b19 YARN-820. Fixed an invalid state transition in NodeManager caused by failing resource localization. Contributed by Mayank Bansal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503947 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 23:44:56 +00:00
Vinod Kumar Vavilapalli
af0d2fc3e3 YARN-661. Fixed NM to cleanup users' local directories correctly when starting up. Contributed by Omkar Vinit Joshi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503942 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 23:31:02 +00:00
Bikas Saha
bf876f70fb MAPREDUCE-5398. MR changes for YARN-513 (Jian He via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503934 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 22:51:12 +00:00
Bikas Saha
33b5a81509 YARN-513. Create common proxy client for communicating with RM (Xuan Gong & Jian He via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503933 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 22:47:40 +00:00
Colin McCabe
badab7ed5e HDFS-4657. Limit the number of blocks logged by the NN after a block report to a configurable value. (Aaron Twinning Meyers via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503862 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 20:07:42 +00:00
Daryn Sharp
a3a9d72e98 HADOOP-9683. [RPC v9] Wrap IpcConnectionContext in RPC headers (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503811 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 17:59:39 +00:00
Colin McCabe
32076136f7 HADOOP-9618. thread which detects GC pauses (Todd Lipcon via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503806 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 17:48:24 +00:00
Jason Darrell Lowe
44ea6e3ad5 Back out revision 1503499 for MAPREDUCE-5317. Stale files left behind for failed jobs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503744 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 15:05:16 +00:00
Tsz-wo Sze
2d6049f1d6 HDFS-4992. Make balancer's mover thread count and dispatcher thread count configurable. Contributed by Max Lapan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503720 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 14:04:33 +00:00
Suresh Srinivas
afaec5f52d HDFS-4903. Print trash configuration and trash emptier state in namenode log. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503570 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 06:33:40 +00:00
Bikas Saha
8f8be404a7 Trivial fix for minor refactor error for YARN-521 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503543 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 02:40:57 +00:00
Vinod Kumar Vavilapalli
4466d8653f YARN-523. Modified a test-case to validate container diagnostics on localization failures. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503532 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 00:57:41 +00:00
Bikas Saha
1fe8e2d7ee YARN-521. Augment AM - RM client module to be able to request containers only at specific locations (Sandy Ryza via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503526 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 00:23:18 +00:00
Jason Darrell Lowe
8a037edbfb MAPREDUCE-5317. Stale files left behind for failed jobs. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503499 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-15 22:24:37 +00:00
Kihwal Lee
37b2a96055 HADOOP-9707. Fix register lists for crc32c inline assembly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503390 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-15 18:15:00 +00:00
Chris Nauroth
1db4319072 YARN-909. Disable TestLinuxContainerExecutorWithMocks on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503357 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-15 17:27:31 +00:00
Bikas Saha
fe735f237c YARN-654. AMRMClient: Perform sanity checks for parameters of public methods (Xuan Gong via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503353 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-15 17:13:05 +00:00
Harsh J
adfd2fa314 HADOOP-9241. DU refresh interval is not configurable. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502954 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-14 10:46:37 +00:00
Bikas Saha
b980f2aa4e YARN-763. AMRMClientAsync should stop heartbeating after receiving shutdown from RM (Xuan Gong via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502914 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-13 23:30:20 +00:00
Bikas Saha
2adee63426 YARN-541. getAllocatedContainers() is not returning all the allocated containers (bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502906 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-13 22:31:02 +00:00
Colin McCabe
a038ec6ceb HADOOP-9703. org.apache.hadoop.ipc.Client leaks threads on stop (Tsuyoshi OZAWA via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502696 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 21:36:44 +00:00
Todd Lipcon
0880be20ac HDFS-4982. JournalNode should relogin from keytab before fetching logs from other JNs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502682 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 20:44:45 +00:00
Suresh Srinivas
b47df4e3b9 HDFS-4912. Cleanup FSNamesystem#startFileInternal. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502634 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 17:44:00 +00:00
Jing Zhao
3630a23c55 HDFS-4978. Make disallowSnapshot idempotent. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502400 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 00:11:31 +00:00
Alejandro Abdelnur
1714932158 YARN-333. Schedulers cannot control the queue-name of an application. (sandyr via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502374 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 21:39:28 +00:00
Colin McCabe
8767e4cde1 HADOOP-9418. Add symlink support to DistributedFileSystem (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502373 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 21:31:04 +00:00
Chris Nauroth
2409882a47 HDFS-4374. Display NameNode startup progress in UI. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502331 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 19:20:38 +00:00