big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,658 Commits 2 Branches 2 Tags 264 MiB
5f5b3bbdcd
Commit Graph

313 Commits

Author SHA1 Message Date
Mahadev Konar
88b82a0f66 MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext (Arun Murthy via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170459 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-14 07:26:37 +00:00
Mahadev Konar
a3e8f6836b MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170379 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 22:55:22 +00:00
Arun Murthy
88ff272cfd MAPREDUCE-2995. Fixed race condition in ContainerLauncher. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170281 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 18:15:14 +00:00
Arun Murthy
53f921418d MAPREDUCE-2995. Better handling of expired containers in MapReduce ApplicationMaster. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1170279 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 18:12:02 +00:00
Arun Murthy
6165875dc6 MAPREDUCE-2896. Simplify all apis to in org.apache.hadoop.yarn.api.records.* to be get/set only. Added javadocs to all public records. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169980 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-13 00:05:51 +00:00
Arun Murthy
7fa0bf3558 MAPREDUCE-2874. Fix formatting of ApplicationId in web-ui. Contributed by Eric Payne. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169973 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 23:17:27 +00:00
Arun Murthy
c8383a5f49 MAPREDUCE-2985. Fixed findbugs warnings in ResourceLocalizationService. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169955 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 21:53:51 +00:00
Konstantin Shvachko
1c01951264 MAPREDUCE-2669. Add new examples for Mean, Median, and Standard Deviation. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169874 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 19:13:41 +00:00
Vinod Kumar Vavilapalli
fb65bfc661 MAPREDUCE-2979. Removed the needless ClientProtocolProvider configuration from the hadoop-mapreduce-client-core module. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169808 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 16:00:40 +00:00
Vinod Kumar Vavilapalli
be32d25c54 MAPREDUCE-2675. Reformat JobHistory Server main page to be more useful. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169763 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 14:24:32 +00:00
Vinod Kumar Vavilapalli
e14da3a72e MAPREDUCE-2978. Fixed test-patch to make Jenkins report findbugs warnings properly. Contributed by Tom White. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169696 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 11:22:38 +00:00
Arun Murthy
6b2f2efe4d MAPREDUCE-2749. Ensure NM registers with RM after starting all its services correctly. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169621 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-12 07:11:43 +00:00
Arun Murthy
817ead65b9 MAPREDUCE-2933. Change allocate call to return ContainerStatus for completed containers rather than Container. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169484 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-11 17:26:06 +00:00
Vinod Kumar Vavilapalli
8fb67650b1 MAPREDUCE-2691. Finish up the cleanup of distributed cache file resources and related tests. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167676 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-11 06:21:39 +00:00
Mahadev Konar
b982e6205f MAPREDUCE-2971. ant build mapreduce fails protected access jc.displayJobList (jobs) (Thomas Graves via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167383 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 22:42:57 +00:00
Arun Murthy
fbf0035ee6 MAPREDUCE-2975. Fixed YARNRunner to use YarnConfiguration rather than Configuration. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167331 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 19:01:08 +00:00
Aaron Myers
68cb2b01b6 HADOOP-7607 and MAPREDUCE-2934. Simplify the RPC proxy cleanup process. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167318 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 18:12:14 +00:00
Vinod Kumar Vavilapalli
1d84d983a2 MAPREDUCE-2954. Fixed a deadlock in NM caused due to wrong synchronization in protocol buffer records. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167061 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 09:47:15 +00:00
Tsz-wo Sze
85e17fd2df MAPREDUCE-2711. Update TestBlockPlacementPolicyRaid for the new namesystem and block management APIs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167001 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 04:48:35 +00:00
Arun Murthy
71e0515433 MAPREDUCE-2963. Fix hang in TestMRJobs. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166975 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 03:01:08 +00:00
Arun Murthy
ca853445e9 MAPREDUCE-2953. Fix a race condition on submission which caused client to incorrectly assume application was gone by making submission synchronous for RMAppManager. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166968 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 02:19:24 +00:00
Arun Murthy
a0ef2d7503 MAPREDUCE-2937. Ensure reason for application failure is displayed to the user. Contributed by Mahadev Konar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166966 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 02:14:33 +00:00
Arun Murthy
035937bee8 MAPREDUCE-2690. Web-page for FifoScheduler. Contributed by Eric Payne. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166958 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 02:04:55 +00:00
Arun Murthy
fafe8cd28e MAPREDUCE-2864. Normalize configuration variable names for YARN. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166955 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-09 01:44:58 +00:00
Arun Murthy
b3c9c3c182 MAPREDUCE-2677. Fixed 404 for some links from HistoryServer. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166901 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 20:59:34 +00:00
Arun Murthy
1b294f206b MAPREDUCE-2844. Fixed display of nodes in UI. Contributed by Ravi Teja Ch N V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166855 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 18:48:10 +00:00
Arun Murthy
6b6ef7b8e3 MAPREDUCE-2947. Fixed race condition in AuxiliaryServices. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166849 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 18:40:27 +00:00
Mahadev Konar
8ac20f92f5 MAPREDUCE-2942. TestNMAuditLogger.testNMAuditLoggerWithIP failing (Thomas Graves via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166842 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 18:29:49 +00:00
Arun Murthy
1f46b991da MAPREDUCE-2908. Fix all findbugs warnings. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166838 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 18:26:20 +00:00
Amar Kamat
ae5e8e0104 MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and ResourceUsageMatcher. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166636 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-08 11:29:55 +00:00
Mahadev Konar
1c15670d53 MAPREDUCE-2948. Hadoop streaming test failure, post MR-2767 (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166402 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 21:18:09 +00:00
Arun Murthy
0ecba04727 MAPREDUCE-2938. Log application submission failure in CapacityScheduler 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166006 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 05:54:25 +00:00
Arun Murthy
cdfabf5ae2 MAPREDUCE-2655. Add audit logs to ResourceManager and NodeManager. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165949 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-07 01:24:21 +00:00
Arun Murthy
d51078eb7e MAPREDUCE-2774. Add startup message to ResourceManager & NodeManager on startup. Contributed by Venu Gopala Rao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165933 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 23:40:49 +00:00
Arun Murthy
03c1015d6e MAPREDUCE-2800. Set final progress for tasks to ensure all task information is correctly logged to JobHistory. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165930 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 23:36:19 +00:00
Konstantin Shvachko
3a3f277017 MAPREDUCE-2767. CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165894 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 21:59:09 +00:00
Arun Murthy
f560a1066f MAPREDUCE-2687. Fix NodeManager to use the right version of LocalDirAllocator.getLocalPathToWrite. Contributed by mahadev & acmurthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165890 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 21:49:46 +00:00
Vinod Kumar Vavilapalli
e20f135174 MAPREDUCE-2936. Contrib Raid compilation broken after HDFS-1620. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165657 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 13:19:10 +00:00
Todd Lipcon
ae367be8f3 MAPREDUCE-2882. TestLineRecordReader depends on ant jars. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165449 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-05 23:23:35 +00:00
Arun Murthy
6b608aad7d MAPREDUCE-2697. Enhance CapacityScheduler to cap concurrently running applications per-queue & per-user. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165403 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-05 19:49:47 +00:00
Vinod Kumar Vavilapalli
6bdf5746d5 MAPREDUCE-2716. MRReliabilityTest job fails because of missing job-file. Contributed by Jeffrey Naisbitt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164805 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 06:22:03 +00:00
Sanjay Radia
b97a4d40c8 HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164771 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 00:31:05 +00:00
Arun Murthy
5d4f16b93c MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164301 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 23:58:12 +00:00
Arun Murthy
a9bf33445e MAPREDUCE-2756. Better error handling in JobControl for failed jobs. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164255 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 20:24:38 +00:00
Arun Murthy
b9a5fd5190 MAPREDUCE-2917. Fixed corner case in container reservation which led to starvation and hung jobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163768 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 19:52:20 +00:00
Vinod Kumar Vavilapalli
ade0f0560f MAPREDUCE-2652. Enabled multiple NMs to be runnable on a single node by making shuffle service port to be truely configurable. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163585 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 11:38:32 +00:00
Mahadev Konar
5786efbfa6 MAPREDUCE-2916. Ivy build for MRv1 fails with bad organization for common daemon. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163490 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 05:48:02 +00:00
Arun Murthy
c2b851b0f2 MAPREDUCE-2897. Javadoc for ClientRMProtocol protocol and related records. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163069 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-30 01:22:28 +00:00
Mahadev Konar
fb6ecb9b27 MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163050 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 23:27:47 +00:00
Mahadev Konar
aad81a15ec MAPREDUCE-2737. Update the progress of jobs on client side. (Siddharth Seth and Mahadev Konar via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162979 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 20:23:17 +00:00
Arun Murthy
3380d8f70c MAPREDUCE-2904. Fixed bin/yarn to correctly include HDFS jars and clean up of stale refs to pre-mavenized Hadoop Common and HDFS. Contributed by Sharad Agarwal and Arun C. Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162954 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 19:36:26 +00:00
Arun Murthy
b9259a2710 MAPREDUCE-2898. Javadoc for ContainerManager protocol and related records. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162613 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 00:04:06 +00:00
Arun Murthy
00d2263908 MAPREDUCE-2891. Javadoc for AMRMProtocol and related records. Contributed by acmurthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162499 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-28 11:41:36 +00:00
Arun Murthy
c9cbd8e4e6 MAPREDUCE-2893. Remove duplicate entry of YarnClientProtocolProvider in ClientProtocolProvider services file. Contributed by Liang-Chi Hsieh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162491 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-28 10:37:24 +00:00
Arun Murthy
d8c3e63dce MAPREDUCE-2885. Fix mapred-config.sh to look for hadoop-config.sh in HADOOP_COMMON_HOME/libexec. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162188 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 17:55:53 +00:00
Giridharan Kesavan
0ee0fa45d2 MAPREDUCE-2881. Fix to include log4j 1.2.16 depenency. Contributed by Giridharan Kesavan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161782 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 22:30:42 +00:00
Arun Murthy
a44ffcc0be Preparing for hadoop-0.24.0 development. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 20:32:04 +00:00
Arun Murthy
ee05510c42 Preparing for release 0.23.0 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161716 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 19:39:15 +00:00
Arun Murthy
58676edf98 MAPREDUCE-2879. Fix version for MR-279 to 0.23.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161705 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 19:13:50 +00:00
Arun Murthy
1dd113b24a MAPREDUCE-2796. Set start times for MR applications for clients to see. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161704 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 19:12:35 +00:00
Mahadev Konar
7c85f33ce1 MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161650 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 17:16:36 +00:00
Sharad Agarwal
f2b91a8367 MAPREDUCE-2807. Fix AM restart and client redirection. Contributed by Sharad Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161408 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 06:35:58 +00:00
Arun Murthy
cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-25 00:14:24 +00:00