big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,825 Commits 2 Branches 2 Tags 264 MiB
1447274693
Commit Graph

433 Commits

Author SHA1 Message Date
Harsh J
2f19c59f1d MAPREDUCE-3610. Remove use of the 'dfs.block.size' config for default block size fetching. Use FS#getDefaultBlocksize instead. (Sho Shimauchi via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227091 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 09:39:14 +00:00
Amar Kamat
4c0bac5670 MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227051 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-04 05:38:17 +00:00
Arun Murthy
4ab6ae543e MAPREDUCE-3608. Fixed compile issue with MAPREDUCE-3522. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225726 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-30 02:24:14 +00:00
Arun Murthy
743a5b78e3 MAPREDUCE-3522. Ensure queues inherit ACLs from parent if they aren't explicitly specified. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225618 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 19:06:34 +00:00
Arun Murthy
7afb9aca70 MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225471 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 08:24:09 +00:00
Arun Murthy
f025652fda MAPREDUCE-3547. Added a bunch of unit tests for the the RM/NM webservices. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225463 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 08:06:04 +00:00
Arun Murthy
919f56c3d4 MAPREDUCE-3604. Fixed streaming to use new mapreduce.framework.name to check for local mode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225259 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 18:23:12 +00:00
Harsh J
a9ffbdd0d7 MAPREDUCE-2944. Improve checking of input for JobClient.displayTasks() (XieXianshan via harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225188 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 14:11:02 +00:00
Vinod Kumar Vavilapalli
fcbad14a3d MAPREDUCE-3568. Optimized Job's progress calculations in MR AM. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224995 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 19:54:51 +00:00
Vinod Kumar Vavilapalli
cd90b82227 MAPREDUCE-3399. Modifying ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second. Contributed by Siddarth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1224970 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-27 18:26:21 +00:00
Amar Kamat
1dcc4b57ee MAPREDUCE-3597. [Rumen] Rumen should provide APIs to access all the job-history related information. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1222695 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-23 14:47:23 +00:00
Siddharth Seth
8fa0a3c737 MAPREDUCE-3567. Extraneous JobConf objects in AM heap. Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1222498 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-22 22:34:40 +00:00
Vinod Kumar Vavilapalli
ef9b974879 MAPREDUCE-3586. Modified CompositeService to avoid duplicate stop operations thereby solving race conditions in MR AM shutdown. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221950 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 23:47:54 +00:00
Amar Kamat
264d3b7dd0 MAPREDUCE-3349. Log rack-name in JobHistory for unsuccessful tasks. (Devaraj K and Amar Kamat via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221578 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 02:58:00 +00:00
Vinod Kumar Vavilapalli
8626f1bc6c MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221533 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-21 00:06:06 +00:00
Vinod Kumar Vavilapalli
e7543b944c MAPREDUCE-3339. Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221523 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 23:27:02 +00:00
Vinod Kumar Vavilapalli
4e1d5a0d71 MAPREDUCE-3391. Making a trivial change to correct a log message in DistributedShell app's AM. Contributed by Subroto Sanyal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221516 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 23:13:15 +00:00
Arun Murthy
96247ead03 MAPREDUCE-3376. Fixed Task to ensure it passes reporter to combiners using old MR api. Contributed by Subroto Sanyal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221501 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-20 22:01:13 +00:00
Arun Murthy
a61a18cc09 MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220996 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-19 23:07:17 +00:00
Harsh J
2cf4aca02e MAPREDUCE-3579. ConverterUtils shouldn't include a port in a path from a url without a port (Contributed by atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215528 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-17 17:10:12 +00:00
Vinod Kumar Vavilapalli
feb3a23c71 MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215345 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 23:41:36 +00:00
Amar Kamat
a238f931ea MAPREDUCE-778. Rumen Anonymizer. (Amar Kamat and Chris Douglas via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215141 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 14:20:58 +00:00
Mahadev Konar
6d551b83de MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215065 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 09:09:28 +00:00
Siddharth Seth
c4ff892520 MAPREDUCE-3422. Counter display names are not being picked up. Contributed by Jonathan Eagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215031 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 03:10:31 +00:00
Vinod Kumar Vavilapalli
f73bd5402e MAPREDUCE-3564. Fixed failures in TestStagingCleanup and TestJobEndNotifier tests. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215022 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 02:09:00 +00:00
Vinod Kumar Vavilapalli
c2fe4a7e83 MAPREDUCE-3487. Fixed JobHistory web-UI to display links to single task's counters' page. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215016 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 01:51:15 +00:00
Mahadev Konar
227fb568b8 MAPREDUCE-3560. TestRMNodeTransitions is failing on trunk. (Siddharth Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214668 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-15 09:11:18 +00:00
Mahadev Konar
beec374542 MAPREDUCE-3251. Network ACLs can prevent some clients to talk to MR ApplicationMaster (Anupam Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214662 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-15 08:58:51 +00:00
Siddharth Seth
14ba2e65c9 MAPREDUCE-3531. Fixed a race in ContainerTokenSecretManager. (Contributed by Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214593 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-15 02:09:16 +00:00
Vinod Kumar Vavilapalli
cfbde6ac0f MAPREDUCE-3484. Fixed JobEndNotifier to not get interrupted before completing all its retries. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214563 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 23:58:35 +00:00
Vinod Kumar Vavilapalli
c32ca00a75 MAPREDUCE-3530. Fixed an NPE occuring during scheduling in the ResourceManager. Contributed by Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214476 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 21:22:32 +00:00
Vinod Kumar Vavilapalli
50fa9b89f4 MAPREDUCE-3398. Fixed log aggregation to work correctly in secure mode. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214429 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 19:55:22 +00:00
Mahadev Konar
739f8871f2 MAPREDUCE-3541. Fix broken TestJobQueueClient test. (Ravi Prakash via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214421 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 19:45:59 +00:00
Alejandro Abdelnur
2e6c75a062 MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214354 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 17:21:43 +00:00
Suresh Srinivas
f7f5e51431 Missed deleting the files in r1214066 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214106 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 08:30:37 +00:00
Suresh Srinivas
ec4971a280 MAPREDUCE-3545. Remove Avro RPC. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214066 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 06:57:00 +00:00
Alejandro Abdelnur
a839f875e8 MAPREDUCE-3544. gridmix build is broken, requires hadoop-archives to be added as ivy dependency. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214017 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 01:18:14 +00:00
Vinod Kumar Vavilapalli
b7ae5a6cb7 MAPREDUCE-3426. Fixed MR AM in uber mode to write map intermediate outputs in the correct directory to work properly in secure mode. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213987 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:35:11 +00:00
Vinod Kumar Vavilapalli
0ea8570be5 MAPREDUCE-2863. Support web services for YARN and MR components. (Thomas Graves via vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213975 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 23:05:56 +00:00
Thomas White
37b8cc3f19 MAPREDUCE-3542. Support "FileSystemCounter" legacy counter group name for compatibility. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213971 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 22:59:49 +00:00
Alejandro Abdelnur
0201be46c2 HADOOP-7810. move hadoop archive to core from tools. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213907 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 20:17:59 +00:00
Arun Murthy
f611e1d1b1 MAPREDUCE-3537. Fix race condition in DefaultContainerExecutor which led to container localization occuring in wrong directories. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213575 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 06:33:30 +00:00
Mahadev Konar
e52291ea88 MAPREDUCE-3510. Capacity Scheduler inherited ACLs not displayed by mapred queue -showacls (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213511 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-13 00:20:01 +00:00
Mahadev Konar
9b75b05163 MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213504 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 23:56:26 +00:00
Mahadev Konar
14e6f1e796 MAPREDUCE-3518. mapred queue -info <queue> -showJobs throws NPE. (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213464 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 22:08:09 +00:00
Thomas White
6571d39a74 MAPREDUCE-3527. Fix minor API incompatibilities between 1.0 and 0.23. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213350 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 18:29:20 +00:00
Konstantin Shvachko
3128c78636 JDiff output for release 0.22.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213146 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 05:45:08 +00:00
Konstantin Shvachko
2c1ee1d342 Preparing for release 0.22.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213121 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 00:26:01 +00:00
Vinod Kumar Vavilapalli
b0d3781b64 MAPREDUCE-3519. Fixed a deadlock in NodeManager LocalDirectories's handling service. Contributed by Ravi Gummadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212680 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 23:16:15 +00:00
Tsz-wo Sze
9b1f47226b HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 09:26:33 +00:00