Commit Graph

7901 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
eff931a1b1 MAPREDUCE-3031. Proper handling of killed containers to prevent stuck containers/AMs on an external kill signal. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175960 13f79535-47bb-0310-9956-ffa450edef68
2011-09-26 17:27:15 +00:00
Vinod Kumar Vavilapalli
1e6dfa7472 MAPREDUCE-2646. Fixed AMRMProtocol to return containers based on priority. Contributed by Sharad Agarwal and Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175859 13f79535-47bb-0310-9956-ffa450edef68
2011-09-26 13:25:27 +00:00
Arun Murthy
c9a7d3dbf9 MAPREDUCE-3090. Fix MR AM to use ApplicationAttemptId rather than (ApplicationId, startCount) consistently.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175718 13f79535-47bb-0310-9956-ffa450edef68
2011-09-26 08:44:41 +00:00
Mahadev Konar
5a3040cad4 MAPREDUCE-3064. 27 unit test failures with Invalid mapreduce.jobtracker.address configuration value for JobTracker: local (Venu Gopala Rao via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175449 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 18:02:51 +00:00
Vinod Kumar Vavilapalli
a5c9ede143 MAPREDUCE-2952. Fixed ResourceManager/MR-client to consume diagnostics for AM failures in a couple of corner cases. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175403 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 14:46:59 +00:00
Arun Murthy
c285cf3114 MAPREDUCE-3053. Better diagnostic message for unknown methods in ProtoBuf RPCs. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175357 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 09:50:02 +00:00
Arun Murthy
5ace0cabe5 MAPREDUCE-2990. Fixed display of NodeHealthStatus. Contributed by Subroto Sanyal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175351 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 09:36:12 +00:00
Arun Murthy
d09ceac1f7 MAPREDUCE-2691. Increase threadpool size for launching containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175294 13f79535-47bb-0310-9956-ffa450edef68
2011-09-25 04:43:51 +00:00
Konstantin Shvachko
e7b63aebcb HADOOP-7663. Fix TestHDFSTrash failure. Contributed by Mayank Bansal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175207 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 18:00:48 +00:00
Konstantin Shvachko
029914af84 HADOOP-7457. Move to 0.22 branch section in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175206 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 17:57:08 +00:00
Konstantin Shvachko
5a6f8e38c0 HDFS-2290. Block with corrupt replica is not getting replicated. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175175 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 15:04:34 +00:00
Tsz-wo Sze
83a83d3b73 HDFS-2356. Support case insensitive query parameter names in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1175113 13f79535-47bb-0310-9956-ffa450edef68
2011-09-24 06:15:50 +00:00
Tsz-wo Sze
7e0a224a36 Add "target" to svn:ignore for hadoop-common-project and hadoop-hdfs-project.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174862 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 16:18:19 +00:00
Vinod Kumar Vavilapalli
b549c10782 MAPREDUCE-3055. Simplified ApplicationAttemptId passing to ApplicationMaster via environment variable. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174785 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 14:07:42 +00:00
Harsh J
272639877c Move the CHANGES.txt note for HADOOP-7542 to the right release section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174684 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 12:06:58 +00:00
Steve Loughran
864630b92f HADOOP-7669 Fix newly introduced release audit warning.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174653 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 11:04:28 +00:00
Steve Loughran
516fc91187 marking HADOOP-7542 as potentially incompatible
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174644 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 10:44:32 +00:00
Harsh J
36d7ab3489 HADOOP-7542. Change Configuration XML format to 1.1 to support for serializing additional characters Contributed by Christopher Egner.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174562 13f79535-47bb-0310-9956-ffa450edef68
2011-09-23 07:26:00 +00:00
Arun Murthy
1eb7008753 MAPREDUCE-3073. Fixed build issues in MR1. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174294 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 18:05:30 +00:00
Vinod Kumar Vavilapalli
4806d7ba74 MAPREDUCE-2754. Fixed MR AM stdout, stderr and syslog to redirect to correct log-files. Contributed by Ravi Teja Ch N V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1174194 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 15:14:31 +00:00
Tsz-wo Sze
d773bf0fb5 HDFS-46. Change default namespace quota of root directory from Integer.MAX_VALUE to Long.MAX_VALUE. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173990 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 08:25:20 +00:00
Vinod Kumar Vavilapalli
f553ff0ebd MAPREDUCE-3048. Fixed test-patch to run tests via "mvn clean install test" (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173962 13f79535-47bb-0310-9956-ffa450edef68
2011-09-22 06:32:35 +00:00
Mahadev Konar
3557202a92 MAPREDUCE-3044. Pipes jobs stuck without making progress. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173909 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 23:52:50 +00:00
Arun Murthy
ed7eda00cb MAPREDUCE-3066. Fixed default ResourceTracker address for the NodeManager. Contributed by Chris Riccomini.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173904 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 23:32:31 +00:00
Arun Murthy
32f28e6994 MAPREDUCE-3062. Fixed default RMAdmin address. Contributed by Chris Riccomini.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173838 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 20:37:08 +00:00
Vinod Kumar Vavilapalli
d00b3c49f6 MAPREDUCE-2880. Improved classpath-construction for mapreduce AM and containers. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173783 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 18:28:23 +00:00
Aaron Myers
83e4b2b469 HADOOP-7621. alfredo config should be in a file not readable by users (Alejandro Abdelnur via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173739 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 16:09:44 +00:00
Vinod Kumar Vavilapalli
d50ecc38a3 HADOOP-7575. Enhanced LocalDirAllocator to support fully-qualified paths. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173623 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 13:26:55 +00:00
Vinod Kumar Vavilapalli
af61f4ae15 MAPREDUCE-2970. Fixed NPEs in corner cases with different configurations for mapreduce.framework.name. Contributed by Venu Gopala Rao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173534 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 09:13:34 +00:00
Vinod Kumar Vavilapalli
01fbb0fb45 MAPREDUCE-2930. Added the ability to be able to generate graphs from the state-machine definitions. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173524 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 08:37:00 +00:00
Sanjay Radia
7d8e9d6960 HADOOP-7524 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173488 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 04:25:55 +00:00
Tsz-wo Sze
4dc4e9e63f HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173468 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 02:56:08 +00:00
Arun Murthy
0e870d7d18 MAPREDUCE-3023. Fixed clients to display queue state correctly. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173458 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:32:14 +00:00
Arun Murthy
1d067c6e2b MAPREDUCE-2998. Fixed a bug in TaskAttemptImpl which caused it to fork bin/mapred too many times. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173456 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:26:48 +00:00
Arun Murthy
339b85b88e MAPREDUCE-3036. Fixed metrics for reserved resources in CS. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173453 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:14:20 +00:00
Arun Murthy
b8e8b8da75 MAPREDUCE-3018. Fixed -file option for streaming. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173451 13f79535-47bb-0310-9956-ffa450edef68
2011-09-21 01:10:49 +00:00
Matthew Foley
8cd6eb67f3 HADOOP-7633. Missed this file in previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173411 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 22:40:14 +00:00
Matthew Foley
adcebcbc03 HADOOP-7630. hadoop-metrics2.properties should have a property *.period set to a default value for metrics. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173402 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 22:09:06 +00:00
Vinod Kumar Vavilapalli
e49ef2e6c5 HADOOP-7639. Enhance HttpServer to allow passing path-specs for filtering, so that servers like Yarn WebApp can get filtered the paths served by their own injected servlets. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1173130 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 13:11:12 +00:00
Aaron Myers
c382e386b5 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1173012 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 07:40:04 +00:00
Arun Murthy
f0fedda8ef MAPREDUCE-3040. Fixed extra copy of Configuration in YarnClientProtocolProvider and ensured MiniMRYarnCluster sets JobHistory configuration for tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172929 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 00:46:22 +00:00
Matthew Foley
9d14f100c8 HDFS-2347. Fix checkpointTxnCount's comment about editlog size. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172916 13f79535-47bb-0310-9956-ffa450edef68
2011-09-20 00:26:32 +00:00
Mahadev Konar
bbfd81503c MAPREDUCE-3017. The Web UI shows FINISHED for killed/successful/failed jobs. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172906 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 23:56:52 +00:00
Arun Murthy
482d840bcf MAPREDUCE-3004. Fix ReduceTask to not assume 'local' mode in YARN. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172893 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 23:17:27 +00:00
Mahadev Konar
e16f8a9fdf MAPREDUCE-3038. job history server not starting because conf() missing HsController (Jeffrey Naisbitt via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172875 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 22:51:46 +00:00
Arun Murthy
8ae3cdeac7 MAPREDUCE-3042. Fixed default ResourceTracker address. Contributed by Chris Riccomini.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172847 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 21:31:15 +00:00
Vinod Kumar Vavilapalli
b7660f2bc9 MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172704 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 17:01:50 +00:00
Vinod Kumar Vavilapalli
2e61ed306f MAPREDUCE-3030. Fixed a bug in NodeId.equals() that was causing RM to reject all NMs. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172638 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 14:17:56 +00:00
Vinod Kumar Vavilapalli
29552eeb36 MAPREDUCE-2925. Fixed Yarn+MR client code to behave saner with completed jobs. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172587 13f79535-47bb-0310-9956-ffa450edef68
2011-09-19 12:26:14 +00:00
Tsz-wo Sze
e34d2c075d HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1172219 13f79535-47bb-0310-9956-ffa450edef68
2011-09-18 08:30:47 +00:00