big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,119 Commits 2 Branches 2 Tags 264 MiB
0b11245d34
Commit Graph

4119 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vinod Kumar Vavilapalli
dbecbe5dfe MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159166 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-18 11:07:10 +00:00
Todd Lipcon
dd86860633 HDFS-2260. Refactor BlockReader into an interface and implementation. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1159004 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-18 03:02:19 +00:00
Tsz-wo Sze
cc875f0124 DFS-1257. Fix a race condition on BlockManager.recentInvalidateSets. Contributed by Eric Payne 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158933 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-17 22:00:27 +00:00
Tsz-wo Sze
b094465168 HDFS-2265. Remove unnecessary BlockTokenSecretManager fields/methods from BlockManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158743 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-17 14:34:29 +00:00
Tsz-wo Sze
9c7e27cd2d HADOOP-7493. Add ShortWritable. Constributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158733 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-17 14:23:23 +00:00
Thomas White
86ef57ff07 HADOOP-7536. Correct the dependency version regressions introduced in HADOOP-6671. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158347 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-16 16:12:04 +00:00
Todd Lipcon
c65a01ea12 Merge trunk into HDFS-1623 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1158072 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-16 00:37:15 +00:00
Todd Lipcon
e5508496dc HADOOP-7545. Common -tests JAR should not include properties and configs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158048 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-15 22:42:49 +00:00
Eli Collins
2ab3433e0e HDFS-2233. Add WebUI tests with URI reserved chars. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1158025 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-15 21:47:00 +00:00
Arun Murthy
b2b976a03b Fixed bad commit for MAPREDUCE-901. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157454 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-14 01:52:31 +00:00
Arun Murthy
cb98b81851 MAPREDUCE-2727. Fix divide-by-zero error in SleepJob for sleepCount equals 0. Contributed by Jeffrey Naisbitt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157422 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-13 20:25:53 +00:00
Arun Murthy
a464402cb8 MAPREDUCE-2839. Fixed TokenCache to get delegation tokens using both new and old apis. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157420 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-13 20:20:07 +00:00
Arun Murthy
2cd4c6ad6d MAPREDUCE-2541. Fixed a race condition in IndexCache.removeMap. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157346 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-13 08:16:28 +00:00
Arun Murthy
24676e8c2e MAPREDUCE-901. Efficient framework counters. Contributed by Luke Lu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157290 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 23:25:51 +00:00
Arun Murthy
989c5e90a5 MAPREDUCE-2037. Capture intermediate progress, CPU and memory usage for tasks. Contributed by Dick King. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157253 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 21:05:10 +00:00
Arun Murthy
ded6f225a5 MAPREDUCE-2837. Ported bug fixes from y-merge to prepare for MAPREDUCE-279 merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157249 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 21:00:17 +00:00
Eli Collins
504b801ca0 HDFS-73. DFSOutputStream does not close all the sockets. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157232 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 19:57:15 +00:00
Luke Lu
7d612e9325 HADOOP-7529. Fix lock cycles in metrics system. (llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157187 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 16:57:23 +00:00
Tsz-wo Sze
d5ef72e8c1 HDFS-2240. Fix a deadlock in LeaseRenewer by enforcing lock acquisition ordering. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156977 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 06:26:35 +00:00
Eli Collins
1c2ab728f5 HDFS-2186. DN volume failures on startup are not counted. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156974 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 06:09:35 +00:00
Eli Collins
8061bb59c0 Fix HDFS-2235 FI test failure. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156972 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 05:51:50 +00:00
Eli Collins
4673ab17b0 HDFS-2235. Encode servlet paths. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156967 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 05:03:05 +00:00
Arun Murthy
a9a4f25762 MAPREDUCE-2187 - Missed adding the file 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156962 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 04:14:41 +00:00
Eli Collins
96a87ae7b0 HADOOP-7531. Add servlet util methods for handling paths in requests. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156947 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 03:17:33 +00:00
Eli Collins
961bae4ec5 Fix bad import in HADOOP-615. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156860 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-12 00:02:56 +00:00
Eli Collins
28fd74c4cc HADOOP-7526. Add TestPath tests for URI conversion and reserved characters. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156857 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 23:02:10 +00:00
Eli Collins
7153d50108 HADOOP-6622. Token should not print the password in toString. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156855 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 22:57:51 +00:00
Eli Collins
fdd81b2224 HADOOP-6158. Move CyclicIteration to HDFS. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156854 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 22:50:19 +00:00
Tsz-wo Sze
1dd48b1aee HDFS-2229. Fix a deadlock in namenode by enforcing lock acquisition ordering. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156847 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 22:16:16 +00:00
Eli Collins
7528853197 HADOOP-7357. hadoop.io.compress.TestCodec#main() should exit with non-zero exit code if test failed. Contributed by Philip Zeyliger 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156839 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 21:30:59 +00:00
Eli Collins
ba0b61cf39 HADOOP-7512. Fix example mistake in WritableComparable javadocs. Contributed by Harsh J 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156833 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 21:15:49 +00:00
Mahadev Konar
3228351856 MAPREDUCE-2489. Jobsplits with random hostnames can make the queue unusable (jeffrey naisbit via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156821 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 20:42:28 +00:00
Mahadev Konar
86195ceb18 HADOOP-7499. Add method for doing a sanity check on hostnames in NetUtils. (Jeffrey Naisbit via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156809 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 20:28:52 +00:00
Thomas White
5c8f4964cd HADOOP-7533. Allow test-patch to be run from any subproject directory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156673 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 16:49:59 +00:00
Tsz-wo Sze
5b7c0b6a45 MAPREDUCE-2805. Update RAID for HDFS-2241. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156513 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 07:09:27 +00:00
Tsz-wo Sze
6a7c0306bd HDFS-2245. Fix a NullPointerException in BlockManager.chooseTarget(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156490 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 05:24:55 +00:00
Tsz-wo Sze
cde987996a HDFS-2237. Change UnderReplicatedBlocks from public to package private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156424 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 01:05:45 +00:00
Suresh Srinivas
95ecc91463 Ignore CHANGES.HDFS-1623.txt from release audit warnings 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1156421 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 00:48:16 +00:00
Suresh Srinivas
ef223e8e8e HDFS-2241. Remove implementing FSConstants interface to just get the constants from the interface. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156420 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 00:46:31 +00:00
Suresh Srinivas
73f2092b73 HDFS-1974. Introduce active and standy states to the namenode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1156418 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-11 00:44:05 +00:00
Suresh Srinivas
2a990ed646 HADOOP-7472. RPC client should deal with IP address change. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156350 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 20:22:55 +00:00
Tsz-wo Sze
2d653c994c MAPREDUCE-2797. Update mapreduce tests and RAID for HDFS-2239. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156215 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 15:10:20 +00:00
Tsz-wo Sze
5d5b1c6c10 HDFS-2239. Reduce access levels of the fields and methods in FSNamesystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155998 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 01:50:51 +00:00
Todd Lipcon
eb6e44b1ba HDFS-2227. getRemoteEditLogManifest should pull its information from FileJournalManager during checkpoint process. Contributed by Ivan Kelly and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155977 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-10 00:01:39 +00:00
Thomas White
27b66e2bba HADOOP-7525. Make arguments to test-patch optional. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155551 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-09 20:28:48 +00:00
Thomas White
0a2b40fad5 HADOOP-7528. Maven build fails in Windows. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155448 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-09 18:03:00 +00:00
Giridharan Kesavan
a523fbdb6c HDFS-2230. Fix ivy conf to resolve/retrieve latest common-tests jar published by hadoop common maven build. (gkesavan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155123 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 22:09:28 +00:00
Tsz-wo Sze
498e290103 HDFS-2238. In NamenodeFsck.toString(), uses StringBuilder.(..) instead of string concatenation. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154973 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 14:27:53 +00:00
Tsz-wo Sze
371f4a5905 HDFS-2228. Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154899 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 10:06:45 +00:00
Thomas White
8dc420ba36 HADOOP-7523. Test org.apache.hadoop.fs.TestFilterFileSystem fails due to java.lang.NoSuchMethodException. Contributed by John Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154817 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-08 04:36:46 +00:00