Commit Graph

8565 Commits

Author SHA1 Message Date
Hairong Kuang
e680023f8b Revert 1161976 since the log message was incorrectly marked the issue as HDFS-349.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161991 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 04:41:52 +00:00
Hairong Kuang
522fe14a89 Move change log for HDFS-395 from 0.23 section to trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161987 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 04:16:20 +00:00
Hairong Kuang
e6339be188 HDFS-349. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161976 13f79535-47bb-0310-9956-ffa450edef68
2011-08-26 03:10:13 +00:00
Giridharan Kesavan
0ee0fa45d2 MAPREDUCE-2881. Fix to include log4j 1.2.16 depenency. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161782 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 22:30:42 +00:00
Mahadev Konar
a415733cf6 HADOOP-7578. Adding needed files in svn (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161781 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 22:27:24 +00:00
Mahadev Konar
e096d0b225 HADOOP-7578. Fix a mess up in svn move (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161777 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 22:12:27 +00:00
Arun Murthy
a44ffcc0be Preparing for hadoop-0.24.0 development.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161736 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 20:32:04 +00:00
Arun Murthy
5675dad8b7 MAPREDUCE-2879. Fix version for MR-279 to 0.23.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161722 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 20:01:59 +00:00
Arun Murthy
ee05510c42 Preparing for release 0.23.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161716 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:39:15 +00:00
Mahadev Konar
01f24e1af7 HADOOP-7578. Fix test-patch to be able to run on MR patches. (mahadev and tom white)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161711 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:31:02 +00:00
Arun Murthy
58676edf98 MAPREDUCE-2879. Fix version for MR-279 to 0.23.0.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161705 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:13:50 +00:00
Arun Murthy
1dd113b24a MAPREDUCE-2796. Set start times for MR applications for clients to see. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161704 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 19:12:35 +00:00
Mahadev Konar
7c85f33ce1 MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161650 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 17:16:36 +00:00
Tsz-wo Sze
31903fec4e Setup svn:ignore in hadoop-auth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161526 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 11:54:58 +00:00
Sharad Agarwal
f2b91a8367 MAPREDUCE-2807. Fix AM restart and client redirection. Contributed by Sharad Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161408 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 06:35:58 +00:00
Arun Murthy
6316e66279 HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161335 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:20:52 +00:00
Arun Murthy
cd7157784e HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161332 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:14:24 +00:00
Arun Murthy
bb0005cfec HADOOP-7563. Setup HADOOP_HDFS_HOME, HADOOP_MAPRED_HOME and classpath correction. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161329 13f79535-47bb-0310-9956-ffa450edef68
2011-08-25 00:06:53 +00:00
Owen O'Malley
ebf61db566 MAPREDUCE-2846. Fix missing synchronization in the task log management.
(omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161324 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 23:52:08 +00:00
Thomas White
fdae3cda85 HADOOP-7567. 'mvn eclipse:eclipse' fails for hadoop-alfredo (auth). Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161304 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 22:28:54 +00:00
Thomas White
71c2f73175 HADOOP-7561. Make test-patch only run tests for changed modules.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1161291 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 21:35:38 +00:00
Giridharan Kesavan
1eb272051d MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160987 13f79535-47bb-0310-9956-ffa450edef68
2011-08-24 06:47:01 +00:00
Todd Lipcon
ec559db68e HDFS-1480. All replicas of a block can end up on the same rack when some datanodes are decommissioning. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160897 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:04:15 +00:00
Arun Murthy
61cbfa5fde MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160896 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 22:04:10 +00:00
Todd Lipcon
b04aafee50 HDFS-2267. DataXceiver thread name incorrect while waiting on op during keepalive. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160873 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 19:47:14 +00:00
Arun Murthy
8af5c4b24a MAPREDUCE-2649. Handling of finished applications in RM. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160521 13f79535-47bb-0310-9956-ffa450edef68
2011-08-23 01:32:32 +00:00
Tsz-wo Sze
2892f6d817 HDFS-2266. Add Namesystem and SafeMode interfaces to avoid directly referring to FSNamesystem in BlockManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160493 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 23:14:24 +00:00
Tsz-wo Sze
513f17d115 HDFS-2273. Refactor BlockManager.recentInvalidateSets to a new class.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160475 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 22:28:17 +00:00
Mahadev Konar
fdef052d35 HADOOP-7566. MR tests are failing webapps/hdfs not found in CLASSPATH. (Alejandro Abdelnur via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160473 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 22:24:00 +00:00
Mahadev Konar
8c8f3b7782 MAPREDUCE-2868. ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160456 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 21:44:46 +00:00
Konstantin Shvachko
fa625674f0 HADOOP-7390. Move changes under 0.22 branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160424 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 20:44:20 +00:00
Mahadev Konar
7c8fcbecf1 MAPREDUCE-2701. app/Job.java needs UGI for the user that launched it. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160392 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 19:36:40 +00:00
Thomas White
14b97a91d9 HADOOP-7496. Break Maven TAR & bintar profiles into just LAYOUT & TAR proper. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160344 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 17:40:58 +00:00
Thomas White
8d34a17407 HADOOP-7498. Remove legacy TAR layout creation. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160341 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 17:19:46 +00:00
Mahadev Konar
272c6ebe23 MAPREDUCE-2867. Remove Unused TestApplicaitonCleanup in resourcemanager/applicationsmanager. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1160340 13f79535-47bb-0310-9956-ffa450edef68
2011-08-22 17:15:49 +00:00
Aaron Myers
b77bc477b5 Follow-up to HADOOP-7119 - removing two files which were moved.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159806 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 22:36:04 +00:00
Aaron Myers
a0f120ce68 HADOOP-7119. add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles. (Alejandro Abdelnur via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159804 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 22:31:06 +00:00
Todd Lipcon
b0ea4b71c9 Merge trunk into HDFS-1623 post-mavenization.
- added CHANGES.HDFS-1623.txt to findbugs exclude
- added jsch dependency


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1159782 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 20:47:40 +00:00
Thomas White
f6d24536ba Fix svn:ignore following integration of MR-279 and HDFS mavenization.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159738 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 18:49:24 +00:00
Thomas White
d86f3183d9 HDFS-2096. Mavenization of hadoop-hdfs. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159702 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 17:36:23 +00:00
Thomas White
6ee5a73e0e HADOOP-7264. Bump avro version to at least 1.4.1. Contributed by Alejandro Abdelnur
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159699 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 17:26:42 +00:00
Mahadev Konar
9a6122141a MAPREDUCE-2860. Fix log4j logging in the maven test cases. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159687 13f79535-47bb-0310-9956-ffa450edef68
2011-08-19 17:14:00 +00:00
Mahadev Konar
1ac6c0c57f Missing findbugs exclude file from MR-279 branch merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159424 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 21:42:15 +00:00
Mahadev Konar
fe87d6a085 MAPREDUCE-2854. update INSTALL with config necessary run mapred on yarn. (thomas graves via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159421 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 21:25:45 +00:00
Aaron Myers
a027cbf7ce HADOOP-7555. Add a eclipse-generated files to .gitignore. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159350 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 18:28:44 +00:00
Vinod Kumar Vavilapalli
42b49c2b6d Updating CHANGES.txt to reflect fixes from MR-279 branch that came into trunk when merging the two of them.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159232 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 14:10:12 +00:00
Vinod Kumar Vavilapalli
dbecbe5dfe MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 11:07:10 +00:00
Todd Lipcon
dd86860633 HDFS-2260. Refactor BlockReader into an interface and implementation. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159004 13f79535-47bb-0310-9956-ffa450edef68
2011-08-18 03:02:19 +00:00
Tsz-wo Sze
cc875f0124 DFS-1257. Fix a race condition on BlockManager.recentInvalidateSets. Contributed by Eric Payne
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158933 13f79535-47bb-0310-9956-ffa450edef68
2011-08-17 22:00:27 +00:00
Tsz-wo Sze
b094465168 HDFS-2265. Remove unnecessary BlockTokenSecretManager fields/methods from BlockManager.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158743 13f79535-47bb-0310-9956-ffa450edef68
2011-08-17 14:34:29 +00:00