big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,004 Commits 2 Branches 2 Tags 264 MiB
94242c9385
Commit Graph

536 Commits

Author SHA1 Message Date
Konstantin Shvachko
2c1ee1d342 Preparing for release 0.22.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213121 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 00:26:01 +00:00
Vinod Kumar Vavilapalli
b0d3781b64 MAPREDUCE-3519. Fixed a deadlock in NodeManager LocalDirectories's handling service. Contributed by Ravi Gummadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212680 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 23:16:15 +00:00
Tsz-wo Sze
9b1f47226b HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 09:26:33 +00:00
Mahadev Konar
066cddb44e MAPREDUCE-3513. Capacity Scheduler web UI has a spelling mistake for Memory. (chackaravarthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212215 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 01:58:29 +00:00
Mahadev Konar
224fc101fd MAPREDUCE-3327. RM web ui scheduler link doesn't show correct max value for queues (Anupam Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212212 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 01:38:35 +00:00
Mahadev Konar
ec87e163d4 MAPREDUCE-3147. Handle leaf queues with the same name properly. (Ravi Prakash via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211243 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 00:29:45 +00:00
Arun Murthy
a55599062c MAPREDUCE-3496. Fixed client to print queue acls in consistent order. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210738 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 01:34:03 +00:00
Alejandro Abdelnur
6a358ee140 MAPREDUCE-3389. MRApps loads the 'mrapp-generated-classpath' file with classpath from the build machine. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210548 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 18:02:47 +00:00
Sanjay Radia
65200998c0 HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:44:36 +00:00
Mahadev Konar
e948247715 MAPREDUCE-3485. DISKS_FAILED -101 error code should be defined in same location as ABORTED_CONTAINER_EXIT_STATUS. (Ravi Gummadi via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210192 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:11:08 +00:00
Mahadev Konar
1972a76e5a MAPREDUCE-3458. Fix findbugs warnings in hadoop-examples. (Devaraj K via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210190 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 19:58:32 +00:00
Mahadev Konar
bb2b8f565c MAPREDUCE-3456. /bin/yarn should set defaults for *_HOME (Eric Payne via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209825 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 03:38:05 +00:00
Alejandro Abdelnur
f7eda5a8d3 MAPREDUCE-3500. MRJobConfig creates an LD_LIBRARY_PATH using the platform ARCH. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209813 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 01:07:39 +00:00
Thomas White
72e9ec7a45 MAPREDUCE-3479. JobClient#getJob cannot find local jobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209791 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 00:16:30 +00:00
Siddharth Seth
6b2cbe1198 MAPREDUCE-3453. RM web ui application details page shows RM cluster about information. (Contributed by Jonathan Eagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209759 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 22:51:01 +00:00
Siddharth Seth
a3f37e15f7 MAPREDUCE-3460. MR AM can hang if containers are allocated on a node blacklisted by the AM. (Contributed by Hitesh Shah and Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209737 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 22:18:38 +00:00
Thomas White
714ae6e62f MAPREDUCE-3369. Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209281 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 22:29:42 +00:00
Siddharth Seth
449554f782 MAPREDUCE-3169 amendment. Deprecate MiniMRCluster. Contributed by Ahmed Radwan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209235 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 21:00:28 +00:00
Siddharth Seth
102541b12b MAPREDUCE-3443. JobClient and Job should function in the context of the UGI which created them. (Contributed by Mahadev Konar) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209231 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 20:39:37 +00:00
Mahadev Konar
6a9624dcec MAPREDUCE-3452. fifoscheduler web ui page always shows 0% used for the queue (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208999 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 08:43:29 +00:00
Mahadev Konar
08da8ea5db MAPREDUCE-3463. Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job. (Siddharth Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208994 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 08:35:20 +00:00
Mahadev Konar
e2a78da87b MAPREDUCE-3488. Streaming jobs are failing because the main class isnt set in the pom files. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208792 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 21:17:06 +00:00
Alejandro Abdelnur
ff9bae6b7d MAREDUCE-3477. Hadoop site documentation cannot be built anymore. (jeagles via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208768 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 20:48:47 +00:00
Mahadev Konar
94bf0dacba MAPREDUCE-3450. NM port info no longer available in JobHistory. (Siddharth Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208327 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 08:43:00 +00:00
Mahadev Konar
03e8ec7faf MAPREDUCE-3448. TestCombineOutputCollector javac unchecked warning on mocked generics (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208136 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 23:33:13 +00:00
Mahadev Konar
ea17da82f7 MAPREDUCE-3121. NodeManager should handle disk-failures (Ravi Gummadi via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208131 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 23:17:54 +00:00
Thomas White
be9c46a447 MAPREDUCE-3433. Finding counters by legacy group name returns empty counters. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207755 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 05:07:47 +00:00
Siddharth Seth
784a4a3084 MAPREDUCE-3045. Fixed UI filters to not filter on hidden title-numeric sort fields. Contributed by Jonathan Eagles 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207714 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 00:10:56 +00:00
Mahadev Konar
cc4a468113 MAPREDUCE-3413. RM web ui applications not sorted in any order by default. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206926 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 23:56:46 +00:00
Mahadev Konar
7f0f8cb7b0 MAPREDUCE-3238. Small cleanup in SchedulerApp. (Todd Lipcon via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206921 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 23:40:03 +00:00
Mahadev Konar
64b5a70a53 MAPREDUCE-3371. Review and improve the yarn-api javadocs. (Ravi Prakash via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206899 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-27 23:02:48 +00:00
Konstantin Shvachko
080a34143d HADOOP-7861. changes2html.pl generates links to HADOOP, HDFS, and MAPREDUCE jiras. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205988 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-24 21:44:36 +00:00
Arun Murthy
f17ed541c7 MAPREDUCE-3265. Removed debug logs during job submission to LOG.debug to cut down noise. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205628 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 22:04:33 +00:00
Tsz-wo Sze
d3a51478e3 HDFS-2587. Add apt doc for WebHDFS REST API. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205626 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 22:02:19 +00:00
Matthew Foley
db092f5048 HADOOP-7827 HDFS-2588 MAPREDUCE-3464. jsp pages missing DOCTYPE. Contributed by Dave Vronay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205519 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 18:15:37 +00:00
Arun Murthy
41b1e3ffec MAPREDUCE-3329. Fixed CapacityScheduler to ensure maximum-capacity cannot be lesser than capacity for any queue. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205260 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-23 01:42:51 +00:00
Mahadev Konar
865cd32885 MAPREDUCE-3411. Performance Upgrade for jQuery (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205210 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 22:46:59 +00:00
Mahadev Konar
2e3f531735 MAPREDUCE-3408. yarn-daemon.sh unconditionnaly sets yarn.root.logger (Bruno Mahe via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205200 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 22:31:55 +00:00
Mahadev Konar
fac80b85ae MAPREDUCE-3454. [Gridmix] TestDistCacheEmulation is broken (Hitesh Shah MAPREDUCE-3454. via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205143 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 19:46:10 +00:00
Amar Kamat
e21c2ff5f1 MAPREDUCE-3412. Fix 'ant docs'. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204885 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-22 09:52:50 +00:00
Mahadev Konar
38fea39be7 MAPREDUCE-3444. trunk/0.23 builds broken (Hitesh Shah via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204698 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 20:57:03 +00:00
Mahadev Konar
6ee82eefa8 MAPREDUCE-3447. mapreduce examples not working (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204695 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 20:50:20 +00:00
Mahadev Konar
63edb9d724 MAPREDUCE-3434. Nightly build broken (Hitesh Shah via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204638 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-21 18:25:51 +00:00
Alejandro Abdelnur
26447229ba HADOOP-7590. Mavenize streaming and MR examples. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203941 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-19 01:24:32 +00:00
Thomas White
bd0fbbb942 MAPREDUCE-3372. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203488 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 05:14:15 +00:00
Thomas White
bd2e2aaf99 MAPREDUCE-3373. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203455 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-18 00:57:08 +00:00
Alejandro Abdelnur
ed45ad0fcc MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203411 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 22:58:44 +00:00
Alejandro Abdelnur
302e3dfe2c MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2. (Ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203371 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-17 21:13:29 +00:00
Vinod Kumar Vavilapalli
9d7402e0af MAPREDUCE-3407. Fixed pom files to refer to the correct MR app-jar needed by the integration tests. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202766 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 16:30:05 +00:00
Vinod Kumar Vavilapalli
00b50a5c94 MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202744 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-16 15:37:27 +00:00
Vinod Kumar Vavilapalli
c56e051961 MAPREDUCE-3102. Changed NodeManager to fail fast when LinuxContainerExecutor has wrong configuration or permissions. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202117 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 10:30:26 +00:00
Mahadev Konar
3491205b0a MAPREDUCE-3331. Improvement to single node cluster setup documentation for 0.23 (Anupam Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1202002 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 02:05:25 +00:00
Amar Kamat
116b91cdfb MAPREDUCE-3375. [Gridmix] Memory Emulation system tests. (Vinay Thota via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201997 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-15 01:48:42 +00:00
Mahadev Konar
4cdcf7b867 MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201951 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 22:44:44 +00:00
Mahadev Konar
58bfa24ae4 MAPREDUCE-3341. Enhance logging of initalized queue limit values. (Anupam Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201947 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 22:38:56 +00:00
Mahadev Konar
503593af1e MAPREDUCE-3325. Improvements to CapacityScheduler doc. (Thomas Graves via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201925 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 21:59:56 +00:00
Mahadev Konar
ac320f5046 MAPREDUCE-3324. Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI servers (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201914 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-14 21:30:10 +00:00
Vinod Kumar Vavilapalli
27c9b8833b MAPREDUCE-3370. More changes accidentally missed from the previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200775 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 08:51:21 +00:00
Vinod Kumar Vavilapalli
9c17410c50 MAPREDUCE-3370. Fixed MiniMRYarnCluster and related tests to not use a hard-coded path for the mr-app jar. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200768 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 08:44:52 +00:00
Vinod Kumar Vavilapalli
dbc82dbdfb MAPREDUCE-3379. Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200747 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-11 06:30:27 +00:00
Vinod Kumar Vavilapalli
200bb27557 MAPREDUCE-3392. Fixed Cluster's getDelegationToken's API to return null when there isn't a supported token. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200484 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 19:19:25 +00:00
Vinod Kumar Vavilapalli
15150cd997 MAPREDUCE-3280. Removed the unnecessary job user-name configuration in mapred-site.xml. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200441 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-10 17:28:16 +00:00
Vinod Kumar Vavilapalli
2df83e5b4d MAPREDUCE-3333. Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199751 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 13:41:19 +00:00
Vinod Kumar Vavilapalli
3853d112ea MAPREDUCE-3336. Replaced guice internal.Preconditions api usage with the public Preconditions API. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199714 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 12:40:41 +00:00
Amar Kamat
cec9f82344 MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests. (Vinay Thota via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199678 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-09 09:47:50 +00:00
Vinod Kumar Vavilapalli
80cc8e9486 MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199144 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 07:55:51 +00:00
Vinod Kumar Vavilapalli
9fe9f42c8f MAPREDUCE-3342. Fixed JobHistoryServer to also show the job's queue name. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199133 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 07:28:56 +00:00
Amar Kamat
6749d1395f [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199105 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-08 04:44:25 +00:00
Thomas White
00b5aa76f9 Update CHANGES.txt for commit 1198910. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198912 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-07 20:14:33 +00:00
Thomas White
9a6da7979e MAPREDUCE-3344. o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIterator. Contributed by Brock Noland. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198910 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-07 20:13:00 +00:00
Mahadev Konar
6733a1ca5e MAPREDUCE-3291. App fail to launch due to delegation token not found in cache (Robert Evans via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198583 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-06 22:58:47 +00:00
Vinod Kumar Vavilapalli
0b5a4823a9 MAPREDUCE-3217. Reenabled and fixed bugs in the failing ant test TestAuditLogger. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197438 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-04 09:01:51 +00:00
Vinod Kumar Vavilapalli
08cb4cf334 MAPREDUCE-3219. Reenabled and fixed bugs in the failing test TestDelegationToken. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197415 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-04 07:48:26 +00:00
Vinod Kumar Vavilapalli
dae055bb70 MAPREDUCE-3215. Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197101 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 13:19:29 +00:00
Vinod Kumar Vavilapalli
aa297b188e MAPREDUCE-3221. Reneabled the previously ignored test in TestSubmitJob and fixed bugs in it. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197080 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 12:25:18 +00:00
Vinod Kumar Vavilapalli
c27601fefe MAPREDUCE-3297. Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196986 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 08:02:19 +00:00
Arun Murthy
0df4878033 MAPREDUCE-3337. Added missing license headers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196977 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-03 07:06:53 +00:00
Jakob Homan
201a18de0c MAPREDUCE-3139. SlivePartitioner generates negative partitions. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196776 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 19:38:31 +00:00
Arun Murthy
3ad6024a84 HADOOP-7789. Fixed site to include yarn-default.xml. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196412 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 00:50:59 +00:00
Arun Murthy
073210043d HADOOP-7789. Fixed site to include yarn-default.xml. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196411 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-02 00:50:41 +00:00
Mahadev Konar
bb35bff29b MAPREDUCE-3332. contrib/raid compile breaks due to changes in hdfs/protocol/datatransfer/Sender#writeBlock related to checksum handling (Hitesh Shah via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196356 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 23:07:56 +00:00
Arun Murthy
1112a50ad3 HADOOP-7789. Improvements to site navigation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195876 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:53:38 +00:00
Arun Murthy
4e42044b1c Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195872 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 08:46:22 +00:00
Arun Murthy
a3a4ccfed7 Preparing for release 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195838 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 06:02:53 +00:00
Thomas White
8e04fa8b84 HADOOP-7782. Aggregate project javadocs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195817 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 04:47:10 +00:00
Mahadev Konar
adf58e70a0 MAPREDUCE-3317. Rumen TraceBuilder is emiting null as hostname. (Ravi Gummadi via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195814 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 04:32:03 +00:00
Mahadev Konar
68dfbff8db MAPREDUCE-3316. Rebooted link is not working properly. (Bhallamudi Venkata Siva Kamesh via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195805 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 04:06:39 +00:00
Arun Murthy
cfb6a9883d MAPREDUCE-3237. Move LocalJobRunner to hadoop-mapreduce-client-core. Contributed by Tom White. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195792 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 03:16:44 +00:00
Arun Murthy
e5badc0c1a Fixing CHANGES.txt to reflect 0.23 content. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195766 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 02:09:51 +00:00
Arun Murthy
d36f847b87 MAPREDUCE-3322. Added a better index.html and an brief overview of YARN architecture. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195764 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 02:00:58 +00:00
Mahadev Konar
68fa208b1c MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195761 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:51:56 +00:00
Arun Murthy
b451dd7aaa MAPREDUCE-3220. Fixed TestCombineOutputCollector. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195745 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 01:04:15 +00:00
Arun Murthy
5f7e991659 MAPREDUCE-3321. Disabled a few MR tests for 0.23. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195743 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-01 00:57:22 +00:00
Arun Murthy
b3f90c7060 MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195579 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 17:33:29 +00:00
Arun Murthy
9db078212f MAPREDUCE-3035. Fixed MR JobHistory to ensure rack information is present. Contributed by chakravarthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195575 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 17:27:42 +00:00
Amar Kamat
7e056015ad MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195535 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 15:51:32 +00:00
Vinod Kumar Vavilapalli
21b1e1da49 MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195416 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 11:29:23 +00:00
Vinod Kumar Vavilapalli
a75c4cf4e4 MAPREDUCE-2696. Fixed NodeManager to cleanup logs in a thread when logs' aggregation is not enabled. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195383 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 09:55:29 +00:00
Vinod Kumar Vavilapalli
47a381e306 MAPREDUCE-3146. Added a MR specific command line to dump logs for a given TaskAttemptID. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195349 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 06:42:06 +00:00
Vinod Kumar Vavilapalli
5f9e67e226 MAPREDUCE-2766. Fixed NM to set secure permissions for files and directories in distributed-cache. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195340 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 05:51:33 +00:00
Arun Murthy
85fce9017c Adding executable svn prop on mock-container-executor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195336 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 05:29:13 +00:00
Vinod Kumar Vavilapalli
273e092c93 MAPREDUCE-3313. Fixed initialization of ClusterMetrics which was failing TestResourceTrackerService sometimes. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195319 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-31 03:30:56 +00:00
Vinod Kumar Vavilapalli
1c8d64f38a MAPREDUCE-3274. Fixed a race condition in MRAppMaster that was causing a task-scheduling deadlock. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195145 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-30 11:29:41 +00:00
Arun Murthy
7f4dc27757 MAPREDUCE-3256. Added authorization checks for the protocol between NodeManager and ApplicationMaster. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194850 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 09:35:36 +00:00
Thomas White
cd77a1668f HADOOP-7763. Add top-level navigation to APT docs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190703 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-29 00:16:16 +00:00
Alejandro Abdelnur
1bcff6860c Adding missing CHANGES.txt entry for MAPREDUCE-3014 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190585 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 21:27:08 +00:00
Vinod Kumar Vavilapalli
c1e333f32f MAPREDUCE-3306. Fixed a bug in NodeManager ApplicationImpl that was causing NodeManager to crash. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190523 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 19:45:57 +00:00
Arun Murthy
b93abdcd66 MAPREDUCE-3304. Fixed intermittent test failure due to a race in TestRMContainerAllocator#testBlackListedNodes. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190495 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 18:45:48 +00:00
Vinod Kumar Vavilapalli
cbdb07f4ca MAPREDUCE-2775. Fixed ResourceManager and NodeManager to force a decommissioned node to shutdown. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190467 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 17:31:06 +00:00
Eric Yang
da1db28e93 HADOOP-7740. Fixed security audit logger configuration. (Arpit Gupta via Eric Yang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190452 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 17:08:09 +00:00
Vinod Kumar Vavilapalli
a39992ea63 MAPREDUCE-3296. Fixed the remaining nine FindBugs warnings. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190187 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 07:44:35 +00:00
Vinod Kumar Vavilapalli
670fa24b48 MAPREDUCE-2989. Modified JobHistory to link to task and AM logs from the JobHistoryServer. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190174 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 06:45:04 +00:00
Mahadev Konar
47c28ce14d MAPREDUCE-3292. In secure mode job submission fails with Provider org.apache.hadoop.mapreduce.security.token.JobTokenIndentifier not found. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190171 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 06:13:18 +00:00
Mahadev Konar
062876bed7 MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190165 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 06:04:51 +00:00
Arun Murthy
69dd284452 MAPREDUCE-3290. Fixed a NPE in ClientRMService. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190162 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 05:45:59 +00:00
Arun Murthy
34e6de8f85 MAPREDUCE-3258. Fixed AM & JobHistory web-ui to display counters properly. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190160 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 05:08:04 +00:00
Mahadev Konar
9b34900c89 MAPREDUCE-3209. Jenkins reports 160 FindBugs warnings (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190140 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 02:42:11 +00:00
Arun Murthy
3cccbc9e16 MAPREDUCE-2736. Removing bin/(start,stop)-mapred.sh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190129 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 02:00:03 +00:00
Arun Murthy
caf07897a7 MAPREDUCE-2736. Resurrecting bin/mapred and bin/mapred-config.sh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190128 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:56:57 +00:00
Mahadev Konar
b304062f1f MAPREDUCE-3186. User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed. (Eric Payne via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190122 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:40:24 +00:00
Mahadev Konar
35b62e6e72 MAPREDUCE-3282. bin/mapred job -list throws exception. (acmurthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190110 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-28 01:16:29 +00:00
Arun Murthy
739acd6e14 MAPREDUCE-3284. Moved JobQueueClient to hadoop-mapreduce-client-core. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190084 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 23:21:09 +00:00
Vinod Kumar Vavilapalli
b9f6890db9 MAPREDUCE-3281. Fixed one more bug due to which TestLinuxContainerExecutorWithMocks was failing. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190007 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 20:38:40 +00:00
Eli Collins
1ad8415b72 MAPREDUCE-2736. Remove unused contrib components dependent on MR1. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189982 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 20:06:26 +00:00
Arun Murthy
724f217343 MAPREDUCE-3228. Fixed MR AM to timeout RPCs to bad NodeManagers. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189879 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 17:32:02 +00:00
Vinod Kumar Vavilapalli
1b8511ef89 MAPREDUCE-3281. Fixed a bug in TestLinuxContainerExecutorWithMocks. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189818 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 15:55:41 +00:00
Vinod Kumar Vavilapalli
f114dad5ef MAPREDUCE-2986. Fixed MiniYARNCluster to support multiple NodeManagers. Contributed by Anupam Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189721 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 12:42:12 +00:00
Vinod Kumar Vavilapalli
2fe343f963 MAPREDUCE-3240. Fixed NodeManager to be able to forcefully cleanup its containers (process-trees) irrespective of whether the container succeeded, or killed. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189711 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 12:03:17 +00:00
Arun Murthy
f799e61269 MAPREDUCE-3279. Fixed TestJobHistoryParsing which assumed user name to be mapred all the time. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189670 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 08:31:44 +00:00
Arun Murthy
fc74b5a25c MAPREDUCE-3259. Added java.library.path of NodeManager to ContainerLocalizer in LinuxContainerExecutor. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189667 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 08:28:34 +00:00
Arun Murthy
db8ac0ec3c MAPREDUCE-3257. Added authorization checks for the protocol between ResourceManager and ApplicatoinMaster. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189630 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 06:24:22 +00:00
Arun Murthy
5fadd4de2a MAPREDUCE-3175. Add authorization to admin web-pages such as /stacks, /jmx etc. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189619 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 06:11:08 +00:00
Mahadev Konar
33dc6578de MAPREDUCE-3264. mapreduce.job.user.name needs to be set automatically. (acmurthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189616 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 06:04:17 +00:00
Arun Murthy
3e4efbb609 MAPREDUCE-3254. Fixed streaming to set the job.jar by using the right JobConf ctor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189587 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-27 02:47:07 +00:00
Arun Murthy
237154982b MAPREDUCE-3205. Fix memory specifications to be physical rather than virtual, allowing for a ratio between the two to be configurable. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189542 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 23:58:31 +00:00
Arun Murthy
8aabd3d4e6 MAPREDUCE-2858. Added a WebApp Proxy for applications. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189036 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 06:29:21 +00:00
Mahadev Konar
2adc51c618 MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. (vinodkv via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189023 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 04:31:28 +00:00
Arun Murthy
29c6c3ed32 MAPREDUCE-2977. Fix ResourceManager to renew HDFS delegation tokens for applications. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189012 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 02:53:22 +00:00
Arun Murthy
03659985a0 MAPREDUCE-3269. Fixed log4j properties to correctly set logging options for JobHistoryServer vis-a-vis JobSummary logs. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188999 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 02:16:19 +00:00
Arun Murthy
7dcef364a9 MAPREDUCE-3263. Fixed the MAPREDUCE-3028 commit which broke MR1. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188997 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-26 02:12:50 +00:00
Arun Murthy
2486e4eb09 MAPREDUCE-3253. Fixed ContextFactory to clone JobContext correctly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188842 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 18:14:12 +00:00
Arun Murthy
fffdf661e3 MAPREDUCE-2821. Added missing fields (resourcePerMap & resourcePerReduce) to JobSummary logs. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188528 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:26:14 +00:00
Mahadev Konar
d19cfe0164 MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188522 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 06:07:13 +00:00
Todd Lipcon
bccfd6a09f Amend MAPREDUCE-3159. Fix JavaDoc warnings in previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188479 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 01:14:17 +00:00
Arun Murthy
c70ee2488c MAPREDUCE-3248. Fixed log4j properties. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188476 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 01:03:08 +00:00
Arun Murthy
6217e54718 MAPREDUCE-3159. Ensure DefaultContainerExecutor doesn't delete application directories during app-init. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188466 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-25 00:36:19 +00:00
Todd Lipcon
43553df4e3 MAPREDUCE-3252. Fix map tasks to not rewrite data an extra time when map output fits in spill buffer. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188424 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 22:33:02 +00:00
Arun Murthy
a503755990 MAPREDUCE-3249. Ensure shuffle-port is correctly used duringMR AM recovery. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188388 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 21:19:31 +00:00
Arun Murthy
6288dfa873 MAPREDUCE-3028. Added job-end notification support. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188377 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 21:02:43 +00:00
Vinod Kumar Vavilapalli
7ce1c4ab35 MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed the configuration to use yarn names. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188236 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 17:09:37 +00:00
Vinod Kumar Vavilapalli
4086566144 MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188043 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-24 08:41:48 +00:00
Vinod Kumar Vavilapalli
977d7cc5b9 MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187669 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 08:11:47 +00:00
Vinod Kumar Vavilapalli
665a90cbf3 MAPREDUCE-3087. Fixed the mapreduce classpath to correctly include the generated-classpath file needed for tests. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187658 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 06:46:12 +00:00
Vinod Kumar Vavilapalli
5795fcfd99 MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187654 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-22 06:14:46 +00:00
Mahadev Konar
e175574635 MAPREDUCE-3242. Trunk compilation broken with bad interaction from MAPREDUCE-3070 and MAPREDUCE-3239. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187587 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 22:44:39 +00:00
Mahadev Konar
4186121c08 MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better error messages on misconfig (Todd Lipcon via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187556 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 21:36:58 +00:00
Arun Murthy
89e7ca6a52 MAPREDUCE-3070. Fix NodeManager to use ephemeral ports by default. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187496 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 18:47:39 +00:00
Mahadev Konar
45b2bce871 MAPREDUCE-3163. JobClient spews errors when killing MR2 job. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187491 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 18:35:35 +00:00
Todd Lipcon
5945a05eee MAPREDUCE-2629. Workaround a JVM class loading quirk which prevents JIT compilation of inner classes methods in ReduceContextImpl. Contributed by Eric Caspole. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187183 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-21 05:20:27 +00:00
Arun Murthy
02d5fa3e62 MAPREDUCE-3226. Fix shutdown of fetcher threads. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187116 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 22:44:38 +00:00
Alejandro Abdelnur
49baada6cc MAPREDUCE-3204. mvn site:site fails on MapReduce. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187062 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 21:38:58 +00:00
Vinod Kumar Vavilapalli
df2991c0cb MAPREDUCE-3104. Implemented Application-acls. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186748 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 11:45:38 +00:00
Suresh Srinivas
37137845c8 Merging change r1186579 for HDFS-2471 from 0.23 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186584 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-20 00:38:42 +00:00
Arun Murthy
aeae1ba497 MAPREDUCE-3188. Ensure correct shutdown in services. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186554 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:59:30 +00:00
Arun Murthy
fc362b1caf MAPREDUCE-3179. Ensure failed tests exit with right error code. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186552 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:54:23 +00:00
Arun Murthy
7a2744c458 MAPREDUCE-3212. Fix usage/help message for bin/yarn. Contributed by Bhallamudi Venkata Siva Kamesh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186546 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:43:01 +00:00
Arun Murthy
7ca7fdadc4 MAPREDUCE-3208. Fix NPE task/container log appenders. Contributed by liangzhwa. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186542 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:38:17 +00:00
Arun Murthy
74748ec625 MAPREDUCE-2693. Fix NPE in job-blacklisting. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186529 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 22:02:21 +00:00
Jitendra Nath Pandey
ba66ca6856 MAPREDUCE-3149. Add a test to verify that TokenCache handles file system uri with no authority. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186516 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 21:52:50 +00:00
Arun Murthy
e549ac9369 MAPREDUCE-2788. Normalize resource requests in FifoScheduler appropriately. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186467 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 20:37:01 +00:00
Arun Murthy
9473b2e43f MAPREDUCE-3181. Fixed MapReduce runtime to load yarn-default.xml and yarn-site.xml. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186458 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 20:28:11 +00:00
Vinod Kumar Vavilapalli
94e1703b72 MAPREDUCE-3176. Fixed ant mapreduce tests that are timing out because of wrong framework name. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186368 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 17:55:08 +00:00
Vinod Kumar Vavilapalli
e3bb120e9f MAPREDUCE-3162. Separated application-init and container-init event types in NodeManager's Application state machine. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185988 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 06:40:03 +00:00
Vinod Kumar Vavilapalli
13e4562924 MAPREDUCE-3144. Augmented JobHistory with the information needed for serving aggregated logs. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185976 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 05:21:18 +00:00
Vinod Kumar Vavilapalli
3e3abcb769 MAPREDUCE-3199. Fixed pom files to include correct log4j configuration for tests. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185967 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-19 04:30:27 +00:00
Mahadev Konar
b4d20c707a MAPREDUCE-3203. Fix some javac warnings in MRAppMaster. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185909 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 22:46:42 +00:00
Arun Murthy
ab787f44aa MAPREDUCE-3165. Ensure logging options are set correctly for MR AM and tasks. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185887 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 21:45:38 +00:00
Arun Murthy
51a667bef8 MAPREDUCE-2762. Cleanup MR staging directory on completion. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185880 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 21:37:31 +00:00
Arun Murthy
bb00ab68c3 MAPREDUCE-279. Adding a changelog to branch-0.23. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185488 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 05:30:32 +00:00
Mahadev Konar
9ff7c1b1de MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185486 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 05:08:32 +00:00
Arun Murthy
c1d90772b6 MAPREDUCE-3068. Added a whitelist of environment variables for containers from the NodeManager and set MALLOC_ARENA_MAX for all daemons and containers. Contributed by Chris Riccomini. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185447 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-18 01:22:14 +00:00
Mahadev Konar
955d8eca21 MAPREDUCE-3196. TestLinuxContainerExecutorWithMocks fails on Mac OSX. (Arun Murthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185417 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 22:41:26 +00:00
Alejandro Abdelnur
15a1d9af19 MAPREDUCE-3003. Publish MR JARs to Maven snapshot repository. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185286 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 17:06:42 +00:00
Vinod Kumar Vavilapalli
a26b1672a8 MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185247 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 15:17:06 +00:00
Arun Murthy
9f36bdd731 MAPREDUCE-3127. Fixed CHANGES.txt to reflect correct jira. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184992 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 04:22:28 +00:00
Arun Murthy
6b2f3dd5ce MAPREDUCE-3101. Changed default value of yarn.resourcemanager.acl.enable to true and added some more documentation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184989 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 04:08:36 +00:00
Arun Murthy
bc6220c538 MAPREDUCE-3136. Added the missing link to index.html. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184981 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 02:35:20 +00:00
Mahadev Konar
29f65be3e2 MAPREDUCE-3189. Add link decoration back to MR2's CSS. (Todd Lipcon via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184979 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 02:22:16 +00:00
Arun Murthy
86e1c9536f MAPREDUCE-3136. Added documentation for setting up Hadoop clusters in both non-secure and secure mode for both HDFS & YARN. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184977 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 02:18:06 +00:00
Arun Murthy
4872615441 MAPREDUCE-3190. Ensure bin/yarn fails early with a clear error message when HADOOP_COMMON_HOME or HADOOP_HDFS_HOME are not set. Contributed by todd & acmurthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184975 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 02:14:10 +00:00
Mahadev Konar
94b3bf9f75 MAPREDUCE-2840. mr279 TestUberAM.testSleepJob test fails. (jonathan eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184971 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-17 01:19:51 +00:00
Mahadev Konar
68328ae926 MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1184904 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-16 19:27:02 +00:00
Mahadev Konar
b5e21e7e63 MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs and Heap Size set to 10 GB. (Eric Payne via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183545 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 22:49:19 +00:00
Mahadev Konar
b3284c4607 MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183540 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 22:38:52 +00:00
Jitendra Nath Pandey
57f99c2b02 MAPREDUCE-3192. Fix Javadoc warning in JobClient.java and Cluster.java. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183513 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 21:49:35 +00:00
Arun Murthy
09eb725c06 MAPREDUCE-3124. Fixed location of native libs i.e. libhadoop.so for containers. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183188 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:27:10 +00:00
Jitendra Nath Pandey
002dd6968b MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:24:20 +00:00
Arun Murthy
c7fb49b3c5 MAPREDUCE-3170. Fixed job output commit for deep hierarchies. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183185 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-14 01:16:30 +00:00
Alejandro Abdelnur
59df2d48c3 MAPREDUCE-3183. hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml missing license header. (Hitesh Shah via tucu). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183160 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 23:16:07 +00:00
Alejandro Abdelnur
e9544ef3d2 HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183068 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-13 20:23:59 +00:00