Commit Graph

981 Commits

Author SHA1 Message Date
Todd Lipcon
ec559db68e HDFS-1480. All replicas of a block can end up on the same rack when some datanodes are decommissioning. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160897 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:04:15 +00:00
Arun Murthy
61cbfa5fde MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160896 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:04:10 +00:00
Todd Lipcon
b04aafee50 HDFS-2267. DataXceiver thread name incorrect while waiting on op during keepalive. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160873 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 19:47:14 +00:00
Arun Murthy
8af5c4b24a MAPREDUCE-2649. Handling of finished applications in RM. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160521 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 01:32:32 +00:00
Tsz-wo Sze
2892f6d817 HDFS-2266. Add Namesystem and SafeMode interfaces to avoid directly referring to FSNamesystem in BlockManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160493 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 23:14:24 +00:00
Tsz-wo Sze
513f17d115 HDFS-2273. Refactor BlockManager.recentInvalidateSets to a new class.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160475 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 22:28:17 +00:00
Mahadev Konar
fdef052d35 HADOOP-7566. MR tests are failing webapps/hdfs not found in CLASSPATH. (Alejandro Abdelnur via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160473 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 22:24:00 +00:00
Mahadev Konar
8c8f3b7782 MAPREDUCE-2868. ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160456 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 21:44:46 +00:00
Konstantin Shvachko
fa625674f0 HADOOP-7390. Move changes under 0.22 branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160424 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 20:44:20 +00:00
Mahadev Konar
7c8fcbecf1 MAPREDUCE-2701. app/Job.java needs UGI for the user that launched it. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160392 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 19:36:40 +00:00
Thomas White
14b97a91d9 HADOOP-7496. Break Maven TAR & bintar profiles into just LAYOUT & TAR proper. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160344 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 17:40:58 +00:00
Thomas White
8d34a17407 HADOOP-7498. Remove legacy TAR layout creation. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160341 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 17:19:46 +00:00
Mahadev Konar
272c6ebe23 MAPREDUCE-2867. Remove Unused TestApplicaitonCleanup in resourcemanager/applicationsmanager. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160340 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 17:15:49 +00:00
Aaron Myers
b77bc477b5 Follow-up to HADOOP-7119 - removing two files which were moved.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159806 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 22:36:04 +00:00
Aaron Myers
a0f120ce68 HADOOP-7119. add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles. (Alejandro Abdelnur via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159804 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 22:31:06 +00:00
Thomas White
f6d24536ba Fix svn:ignore following integration of MR-279 and HDFS mavenization.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159738 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 18:49:24 +00:00
Thomas White
d86f3183d9 HDFS-2096. Mavenization of hadoop-hdfs. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159702 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 17:36:23 +00:00
Thomas White
6ee5a73e0e HADOOP-7264. Bump avro version to at least 1.4.1. Contributed by Alejandro Abdelnur
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159699 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 17:26:42 +00:00
Mahadev Konar
9a6122141a MAPREDUCE-2860. Fix log4j logging in the maven test cases. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159687 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 17:14:00 +00:00
Mahadev Konar
1ac6c0c57f Missing findbugs exclude file from MR-279 branch merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159424 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 21:42:15 +00:00
Mahadev Konar
fe87d6a085 MAPREDUCE-2854. update INSTALL with config necessary run mapred on yarn. (thomas graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159421 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 21:25:45 +00:00
Aaron Myers
a027cbf7ce HADOOP-7555. Add a eclipse-generated files to .gitignore. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159350 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 18:28:44 +00:00
Vinod Kumar Vavilapalli
42b49c2b6d Updating CHANGES.txt to reflect fixes from MR-279 branch that came into trunk when merging the two of them.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159232 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 14:10:12 +00:00
Vinod Kumar Vavilapalli
dbecbe5dfe MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 11:07:10 +00:00
Todd Lipcon
dd86860633 HDFS-2260. Refactor BlockReader into an interface and implementation. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159004 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 03:02:19 +00:00
Tsz-wo Sze
cc875f0124 DFS-1257. Fix a race condition on BlockManager.recentInvalidateSets. Contributed by Eric Payne
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158933 13f79535-47bb-0310-9956-ffa450edef68
2011-08-17 22:00:27 +00:00
Tsz-wo Sze
b094465168 HDFS-2265. Remove unnecessary BlockTokenSecretManager fields/methods from BlockManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158743 13f79535-47bb-0310-9956-ffa450edef68
2011-08-17 14:34:29 +00:00
Tsz-wo Sze
9c7e27cd2d HADOOP-7493. Add ShortWritable. Constributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158733 13f79535-47bb-0310-9956-ffa450edef68
2011-08-17 14:23:23 +00:00
Thomas White
86ef57ff07 HADOOP-7536. Correct the dependency version regressions introduced in HADOOP-6671. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158347 13f79535-47bb-0310-9956-ffa450edef68
2011-08-16 16:12:04 +00:00
Todd Lipcon
e5508496dc HADOOP-7545. Common -tests JAR should not include properties and configs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158048 13f79535-47bb-0310-9956-ffa450edef68
2011-08-15 22:42:49 +00:00
Eli Collins
2ab3433e0e HDFS-2233. Add WebUI tests with URI reserved chars. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158025 13f79535-47bb-0310-9956-ffa450edef68
2011-08-15 21:47:00 +00:00
Arun Murthy
b2b976a03b Fixed bad commit for MAPREDUCE-901.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157454 13f79535-47bb-0310-9956-ffa450edef68
2011-08-14 01:52:31 +00:00
Arun Murthy
cb98b81851 MAPREDUCE-2727. Fix divide-by-zero error in SleepJob for sleepCount equals 0. Contributed by Jeffrey Naisbitt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157422 13f79535-47bb-0310-9956-ffa450edef68
2011-08-13 20:25:53 +00:00
Arun Murthy
a464402cb8 MAPREDUCE-2839. Fixed TokenCache to get delegation tokens using both new and old apis. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157420 13f79535-47bb-0310-9956-ffa450edef68
2011-08-13 20:20:07 +00:00
Arun Murthy
2cd4c6ad6d MAPREDUCE-2541. Fixed a race condition in IndexCache.removeMap. Contributed by Binglin Chang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157346 13f79535-47bb-0310-9956-ffa450edef68
2011-08-13 08:16:28 +00:00
Arun Murthy
24676e8c2e MAPREDUCE-901. Efficient framework counters. Contributed by Luke Lu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157290 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 23:25:51 +00:00
Arun Murthy
989c5e90a5 MAPREDUCE-2037. Capture intermediate progress, CPU and memory usage for tasks. Contributed by Dick King.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157253 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 21:05:10 +00:00
Arun Murthy
ded6f225a5 MAPREDUCE-2837. Ported bug fixes from y-merge to prepare for MAPREDUCE-279 merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157249 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 21:00:17 +00:00
Eli Collins
504b801ca0 HDFS-73. DFSOutputStream does not close all the sockets. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157232 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 19:57:15 +00:00
Luke Lu
7d612e9325 HADOOP-7529. Fix lock cycles in metrics system. (llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157187 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 16:57:23 +00:00
Tsz-wo Sze
d5ef72e8c1 HDFS-2240. Fix a deadlock in LeaseRenewer by enforcing lock acquisition ordering.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156977 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 06:26:35 +00:00
Eli Collins
1c2ab728f5 HDFS-2186. DN volume failures on startup are not counted. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156974 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 06:09:35 +00:00
Eli Collins
8061bb59c0 Fix HDFS-2235 FI test failure.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156972 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 05:51:50 +00:00
Eli Collins
4673ab17b0 HDFS-2235. Encode servlet paths. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156967 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 05:03:05 +00:00
Arun Murthy
a9a4f25762 MAPREDUCE-2187 - Missed adding the file
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156962 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 04:14:41 +00:00
Eli Collins
96a87ae7b0 HADOOP-7531. Add servlet util methods for handling paths in requests. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156947 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 03:17:33 +00:00
Eli Collins
961bae4ec5 Fix bad import in HADOOP-615.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156860 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 00:02:56 +00:00
Eli Collins
28fd74c4cc HADOOP-7526. Add TestPath tests for URI conversion and reserved characters. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156857 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 23:02:10 +00:00
Eli Collins
7153d50108 HADOOP-6622. Token should not print the password in toString.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156855 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 22:57:51 +00:00
Eli Collins
fdd81b2224 HADOOP-6158. Move CyclicIteration to HDFS. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156854 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 22:50:19 +00:00