big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
24,084 Commits 2 Branches 2 Tags 264 MiB
c7e71a6c0b
Commit Graph

24084 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arun Murthy
51a667bef8 MAPREDUCE-2762. Cleanup MR staging directory on completion. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185880 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 21:37:31 +00:00
Owen O'Malley
073a13aeb1 HDFS-2467. HftpFileSystem uses incorrect compare for finding delegation 
tokens. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185842 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 20:33:16 +00:00
Arun Murthy
bb00ab68c3 MAPREDUCE-279. Adding a changelog to branch-0.23. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185488 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 05:30:32 +00:00
Mahadev Konar
9ff7c1b1de MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185486 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 05:08:32 +00:00
Arun Murthy
c1d90772b6 MAPREDUCE-3068. Added a whitelist of environment variables for containers from the NodeManager and set MALLOC_ARENA_MAX for all daemons and containers. Contributed by Chris Riccomini. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185447 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 01:22:14 +00:00
Mahadev Konar
955d8eca21 MAPREDUCE-3196. TestLinuxContainerExecutorWithMocks fails on Mac OSX. (Arun Murthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185417 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 22:41:26 +00:00
Jitendra Nath Pandey
ab7e7dfd7e Merged r1185354 from trunk for HDFS-2188. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1185363 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 20:42:32 +00:00
Jitendra Nath Pandey
8d4842383e HDFS-2188. Make FSEditLog create its journals from a list of URIs rather than NNStorage. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185354 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 20:23:57 +00:00
Alejandro Abdelnur
15a1d9af19 MAPREDUCE-3003. Publish MR JARs to Maven snapshot repository. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185286 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 17:06:42 +00:00
Vinod Kumar Vavilapalli
a26b1672a8 MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185247 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 15:17:06 +00:00
Arun Murthy
9f36bdd731 MAPREDUCE-3127. Fixed CHANGES.txt to reflect correct jira. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184992 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 04:22:28 +00:00
Arun Murthy
6b2f3dd5ce MAPREDUCE-3101. Changed default value of yarn.resourcemanager.acl.enable to true and added some more documentation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184989 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 04:08:36 +00:00
Arun Murthy
bc6220c538 MAPREDUCE-3136. Added the missing link to index.html. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184981 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 02:35:20 +00:00
Mahadev Konar
29f65be3e2 MAPREDUCE-3189. Add link decoration back to MR2's CSS. (Todd Lipcon via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184979 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 02:22:16 +00:00
Arun Murthy
86e1c9536f MAPREDUCE-3136. Added documentation for setting up Hadoop clusters in both non-secure and secure mode for both HDFS & YARN. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184977 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 02:18:06 +00:00
Arun Murthy
4872615441 MAPREDUCE-3190. Ensure bin/yarn fails early with a clear error message when HADOOP_COMMON_HOME or HADOOP_HDFS_HOME are not set. Contributed by todd & acmurthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184975 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 02:14:10 +00:00
Mahadev Konar
94b3bf9f75 MAPREDUCE-2840. mr279 TestUberAM.testSleepJob test fails. (jonathan eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184971 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 01:19:51 +00:00
Mahadev Konar
68328ae926 MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184904 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-16 19:27:02 +00:00
Tsz-wo Sze
50cb2771e9 HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing file or creating a file without specifying the replication parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183554 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 23:25:09 +00:00
Mahadev Konar
b5e21e7e63 MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs and Heap Size set to 10 GB. (Eric Payne via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183545 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 22:49:19 +00:00
Mahadev Konar
b3284c4607 MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183540 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 22:38:52 +00:00
Matthew Foley
5f9eab403c HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183539 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 22:36:35 +00:00
Jitendra Nath Pandey
57f99c2b02 MAPREDUCE-3192. Fix Javadoc warning in JobClient.java and Cluster.java. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183513 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 21:49:35 +00:00
Todd Lipcon
a11f67fb78 HADOOP-7729. Send back valid HTTP response if user hits IPC port with HTTP GET. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183512 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 21:44:35 +00:00
Konstantin Shvachko
4cb7a4854d HDFS-2012. Balancer incorrectly treats nodes whose utilization equals avgUtilization. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183457 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 18:31:55 +00:00
Suresh Srinivas
068556b9e0 Fix the jira number from HADOOP-7545 to HADOOP-7745. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183445 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 17:53:31 +00:00
Steve Loughran
65861ab51f HADOOP-7705 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183292 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 10:53:01 +00:00
Arun Murthy
09eb725c06 MAPREDUCE-3124. Fixed location of native libs i.e. libhadoop.so for containers. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183188 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:27:10 +00:00
Jitendra Nath Pandey
002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:24:20 +00:00
Arun Murthy
c7fb49b3c5 MAPREDUCE-3170. Fixed job output commit for deep hierarchies. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183185 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:16:30 +00:00
Tsz-wo Sze
c46dbedaf9 HDFS-2424. Added a root element "HdfsFileStatuses" for the response of webhdfs listStatus. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183175 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 00:30:30 +00:00
Alejandro Abdelnur
59df2d48c3 MAPREDUCE-3183. hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml missing license header. (Hitesh Shah via tucu). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183160 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 23:16:07 +00:00
Alejandro Abdelnur
3790f31317 HADOOP-7743. Add Maven profile to create a full source tarball. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183151 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 22:38:03 +00:00
Suresh Srinivas
0c77d705be HADOOP-7545. Fix wrong variable name in exception message introduced in HADOOP-7509. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183132 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 22:05:37 +00:00
Tsz-wo Sze
5904e00b4f HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException to IllegalArgumentException and response it http BAD_REQUEST in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183098 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 21:06:41 +00:00
Tsz-wo Sze
7d1a5078b7 HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in webhdfs responses. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183081 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 20:41:00 +00:00
Alejandro Abdelnur
e9544ef3d2 HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183068 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 20:23:59 +00:00
Mahadev Konar
e123a37bf1 HDFS-2401. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182694 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 07:13:54 +00:00
Mahadev Konar
6b6f02c51d MAPREDUCE-3133. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182688 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 07:07:01 +00:00
Mahadev Konar
5a71f004e9 HADOOP-7709. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182686 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 06:56:37 +00:00
Suresh Srinivas
4f5932f6da Add svn:ignore for target directories 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182651 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 05:02:45 +00:00
Suresh Srinivas
d15e60777b HADOOP-7664. Remove warmings when overriding final parameter configuration if the override value is same as the final parameter value. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182645 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 03:38:58 +00:00
Suresh Srinivas
3e6d128c83 HADOOP-7509. Improve exception message thrown when Authentication is required. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182641 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 03:23:34 +00:00
Suresh Srinivas
7ca7832158 HDFS-2231. Configuration changes for HA namenode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1182626 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 00:09:55 +00:00
Arun Murthy
26d63ecdae MAPREDUCE-2789. Complete schedulingInfo on CLI. Contributed by Eric Payne. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182616 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 23:29:01 +00:00
Arun Murthy
277e520579 MAPREDUCE-2666. Retrieve shuffle port number from JobHistory on MR AM restart. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182613 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 23:12:01 +00:00
Alejandro Abdelnur
327e02fdf4 MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs native. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182575 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 20:38:51 +00:00
Ravi Gummadi
f143895bc2 MAPREDUCE-3166. [Rumen] Make Rumen use job history api instead of relying on current history file name format. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182330 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 12:19:02 +00:00
Ravi Gummadi
efb3cd64a2 MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182293 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 09:58:14 +00:00
Vinod Kumar Vavilapalli
d6546fc0a4 MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182230 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-12 06:51:32 +00:00