Commit Graph

3453 Commits

Author SHA1 Message Date
Arun Murthy
817ead65b9 MAPREDUCE-2933. Change allocate call to return ContainerStatus for completed containers rather than Container.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1169484 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 17:26:06 +00:00
Vinod Kumar Vavilapalli
8fb67650b1 MAPREDUCE-2691. Finish up the cleanup of distributed cache file resources and related tests. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167676 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 06:21:39 +00:00
Tsz-wo Sze
61d0b7530c HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http access to HDFS.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167662 13f79535-47bb-0310-9956-ffa450edef68
2011-09-11 01:41:42 +00:00
Giridharan Kesavan
a3df5d0b26 HADOOP-7610. Fix for hadoop debian package. Contributed by Eric Yang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167428 13f79535-47bb-0310-9956-ffa450edef68
2011-09-10 01:08:00 +00:00
Mahadev Konar
b982e6205f MAPREDUCE-2971. ant build mapreduce fails protected access jc.displayJobList (jobs) (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167383 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 22:42:57 +00:00
Todd Lipcon
146c170571 Add autoconf-related side-effect files to svn:ignore for container-executor
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167370 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 21:45:59 +00:00
Todd Lipcon
592aaa1f06 HADOOP-7328. When a serializer class is missing, return null, not throw an NPE. Contributed by Harsh J Chouraria.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167363 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 21:18:06 +00:00
Arun Murthy
fbf0035ee6 MAPREDUCE-2975. Fixed YARNRunner to use YarnConfiguration rather than Configuration. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167331 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 19:01:08 +00:00
Aaron Myers
68cb2b01b6 HADOOP-7607 and MAPREDUCE-2934. Simplify the RPC proxy cleanup process. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167318 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 18:12:14 +00:00
Vinod Kumar Vavilapalli
1d84d983a2 MAPREDUCE-2954. Fixed a deadlock in NM caused due to wrong synchronization in protocol buffer records. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167061 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 09:47:15 +00:00
Tsz-wo Sze
85e17fd2df MAPREDUCE-2711. Update TestBlockPlacementPolicyRaid for the new namesystem and block management APIs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1167001 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 04:48:35 +00:00
Arun Murthy
71e0515433 MAPREDUCE-2963. Fix hang in TestMRJobs. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166975 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 03:01:08 +00:00
Arun Murthy
a0f13a28f7 Adding back hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources which was missed during the merge of MAPREDUCE-279.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166972 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:52:22 +00:00
Arun Murthy
ca853445e9 MAPREDUCE-2953. Fix a race condition on submission which caused client to incorrectly assume application was gone by making submission synchronous for RMAppManager. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166968 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:19:24 +00:00
Arun Murthy
a0ef2d7503 MAPREDUCE-2937. Ensure reason for application failure is displayed to the user. Contributed by Mahadev Konar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166966 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:14:33 +00:00
Arun Murthy
035937bee8 MAPREDUCE-2690. Web-page for FifoScheduler. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166958 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 02:04:55 +00:00
Arun Murthy
fafe8cd28e MAPREDUCE-2864. Normalize configuration variable names for YARN. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166955 13f79535-47bb-0310-9956-ffa450edef68
2011-09-09 01:44:58 +00:00
Arun Murthy
96a5bef79e HADOOP-7598. Fix smart-apply-patch.sh to handle patching from a sub directory correctly. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166913 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 21:31:46 +00:00
Arun Murthy
b3c9c3c182 MAPREDUCE-2677. Fixed 404 for some links from HistoryServer. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166901 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 20:59:34 +00:00
Arun Murthy
dd34c4e24f MAPREDUCE-2844. Fixed display of nodes in UI.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166856 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:49:28 +00:00
Arun Murthy
1b294f206b MAPREDUCE-2844. Fixed display of nodes in UI. Contributed by Ravi Teja Ch N V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166855 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:48:10 +00:00
Arun Murthy
6b6ef7b8e3 MAPREDUCE-2947. Fixed race condition in AuxiliaryServices. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166849 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:40:27 +00:00
Thomas White
70f9ace412 HADOOP-7612. Change test-patch to run tests for all nested modules.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166848 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:39:11 +00:00
Mahadev Konar
8ac20f92f5 MAPREDUCE-2942. TestNMAuditLogger.testNMAuditLoggerWithIP failing (Thomas Graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166842 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:29:49 +00:00
Arun Murthy
1f46b991da MAPREDUCE-2908. Fix all findbugs warnings. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166838 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 18:26:20 +00:00
Amar Kamat
ae5e8e0104 MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and ResourceUsageMatcher. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166636 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 11:29:55 +00:00
Todd Lipcon
d10631f728 Merge trunk into HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1166495 13f79535-47bb-0310-9956-ffa450edef68
2011-09-08 01:39:07 +00:00
Konstantin Shvachko
8b9a2c7487 HDFS-2232. Generalize regular expressions in TestHDFSCLI. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166470 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 23:37:56 +00:00
Todd Lipcon
06e84a1bca HDFS-2223. Untangle depencencies between NN components. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166466 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 23:23:24 +00:00
Todd Lipcon
2ca9c8d926 HADOOP-7507. Allow ganglia metrics to include the metrics system tags in the gmetric names. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166460 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 22:59:22 +00:00
Mahadev Konar
1c15670d53 MAPREDUCE-2948. Hadoop streaming test failure, post MR-2767 (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166402 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 21:18:09 +00:00
Tsz-wo Sze
1d6793d0b7 Commit the test and the conf changes in common for HDFS-2284.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166009 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 06:05:04 +00:00
Arun Murthy
0ecba04727 MAPREDUCE-2938. Log application submission failure in CapacityScheduler
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1166006 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 05:54:25 +00:00
Arun Murthy
8815bdf304 Adding new files for MAPREDUCE-2655.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165950 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 01:26:21 +00:00
Arun Murthy
cdfabf5ae2 MAPREDUCE-2655. Add audit logs to ResourceManager and NodeManager. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165949 13f79535-47bb-0310-9956-ffa450edef68
2011-09-07 01:24:21 +00:00
Arun Murthy
d51078eb7e MAPREDUCE-2774. Add startup message to ResourceManager & NodeManager on startup. Contributed by Venu Gopala Rao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165933 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:40:49 +00:00
Arun Murthy
03c1015d6e MAPREDUCE-2800. Set final progress for tasks to ensure all task information is correctly logged to JobHistory. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165930 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 23:36:19 +00:00
Konstantin Shvachko
3a3f277017 MAPREDUCE-2767. CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165894 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:59:09 +00:00
Arun Murthy
f560a1066f MAPREDUCE-2687. Fix NodeManager to use the right version of LocalDirAllocator.getLocalPathToWrite. Contributed by mahadev & acmurthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165890 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:49:46 +00:00
Konstantin Shvachko
fd804b5993 MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165864 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:29:26 +00:00
Todd Lipcon
42d443fb79 HDFS-2314. MRV1 test compilation broken after HDFS-2197. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165860 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 21:25:35 +00:00
Jitendra Nath Pandey
bdc3720d5b HDFS-2018. Move all journal stream management code into one place. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165826 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 20:27:38 +00:00
Vinod Kumar Vavilapalli
e20f135174 MAPREDUCE-2936. Contrib Raid compilation broken after HDFS-1620. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165657 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 13:19:10 +00:00
Aaron Myers
9e95326a2c HDFS-2313. Rat excludes has a typo for excluding editsStored files. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165477 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 01:51:30 +00:00
Arun Murthy
c2e1756d7a HADOOP-7580. Add a version of getLocalPathForWrite to LocalDirAllocator which doesn't create dirs. Contributed by Chris Douglas & Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165473 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 01:36:34 +00:00
Todd Lipcon
b0632df93a HDFS-2197. Refactor RPC call implementations out of NameNode class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165463 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 00:41:47 +00:00
Todd Lipcon
d1438b501d HDFS-2310. TestBackupNode fails since HADOOP-7524 went in. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165461 13f79535-47bb-0310-9956-ffa450edef68
2011-09-06 00:34:57 +00:00
Todd Lipcon
ae367be8f3 MAPREDUCE-2882. TestLineRecordReader depends on ant jars. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165449 13f79535-47bb-0310-9956-ffa450edef68
2011-09-05 23:23:35 +00:00
Arun Murthy
6b608aad7d MAPREDUCE-2697. Enhance CapacityScheduler to cap concurrently running applications per-queue & per-user.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165403 13f79535-47bb-0310-9956-ffa450edef68
2011-09-05 19:49:47 +00:00
Aaron Myers
458c34a2ab Follow-up commit for HDFS-1620 since I missed some files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165103 13f79535-47bb-0310-9956-ffa450edef68
2011-09-04 19:38:50 +00:00