Commit Graph

1095 Commits

Author SHA1 Message Date
Arun Murthy
989c5e90a5 MAPREDUCE-2037. Capture intermediate progress, CPU and memory usage for tasks. Contributed by Dick King.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157253 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 21:05:10 +00:00
Arun Murthy
ded6f225a5 MAPREDUCE-2837. Ported bug fixes from y-merge to prepare for MAPREDUCE-279 merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157249 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 21:00:17 +00:00
Eli Collins
504b801ca0 HDFS-73. DFSOutputStream does not close all the sockets. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157232 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 19:57:15 +00:00
Luke Lu
7d612e9325 HADOOP-7529. Fix lock cycles in metrics system. (llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1157187 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 16:57:23 +00:00
Tsz-wo Sze
d5ef72e8c1 HDFS-2240. Fix a deadlock in LeaseRenewer by enforcing lock acquisition ordering.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156977 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 06:26:35 +00:00
Eli Collins
1c2ab728f5 HDFS-2186. DN volume failures on startup are not counted. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156974 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 06:09:35 +00:00
Eli Collins
8061bb59c0 Fix HDFS-2235 FI test failure.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156972 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 05:51:50 +00:00
Eli Collins
4673ab17b0 HDFS-2235. Encode servlet paths. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156967 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 05:03:05 +00:00
Arun Murthy
a9a4f25762 MAPREDUCE-2187 - Missed adding the file
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156962 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 04:14:41 +00:00
Eli Collins
96a87ae7b0 HADOOP-7531. Add servlet util methods for handling paths in requests. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156947 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 03:17:33 +00:00
Eli Collins
961bae4ec5 Fix bad import in HADOOP-615.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156860 13f79535-47bb-0310-9956-ffa450edef68
2011-08-12 00:02:56 +00:00
Eli Collins
28fd74c4cc HADOOP-7526. Add TestPath tests for URI conversion and reserved characters. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156857 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 23:02:10 +00:00
Eli Collins
7153d50108 HADOOP-6622. Token should not print the password in toString.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156855 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 22:57:51 +00:00
Eli Collins
fdd81b2224 HADOOP-6158. Move CyclicIteration to HDFS. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156854 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 22:50:19 +00:00
Tsz-wo Sze
1dd48b1aee HDFS-2229. Fix a deadlock in namenode by enforcing lock acquisition ordering.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156847 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 22:16:16 +00:00
Eli Collins
7528853197 HADOOP-7357. hadoop.io.compress.TestCodec#main() should exit with non-zero exit code if test failed. Contributed by Philip Zeyliger
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156839 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 21:30:59 +00:00
Eli Collins
ba0b61cf39 HADOOP-7512. Fix example mistake in WritableComparable javadocs. Contributed by Harsh J
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156833 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 21:15:49 +00:00
Mahadev Konar
3228351856 MAPREDUCE-2489. Jobsplits with random hostnames can make the queue unusable (jeffrey naisbit via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156821 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 20:42:28 +00:00
Mahadev Konar
86195ceb18 HADOOP-7499. Add method for doing a sanity check on hostnames in NetUtils. (Jeffrey Naisbit via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156809 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 20:28:52 +00:00
Thomas White
5c8f4964cd HADOOP-7533. Allow test-patch to be run from any subproject directory.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156673 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 16:49:59 +00:00
Tsz-wo Sze
5b7c0b6a45 MAPREDUCE-2805. Update RAID for HDFS-2241.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156513 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 07:09:27 +00:00
Tsz-wo Sze
6a7c0306bd HDFS-2245. Fix a NullPointerException in BlockManager.chooseTarget(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156490 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 05:24:55 +00:00
Tsz-wo Sze
cde987996a HDFS-2237. Change UnderReplicatedBlocks from public to package private.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156424 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 01:05:45 +00:00
Suresh Srinivas
ef223e8e8e HDFS-2241. Remove implementing FSConstants interface to just get the constants from the interface. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156420 13f79535-47bb-0310-9956-ffa450edef68
2011-08-11 00:46:31 +00:00
Suresh Srinivas
2a990ed646 HADOOP-7472. RPC client should deal with IP address change. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156350 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 20:22:55 +00:00
Tsz-wo Sze
2d653c994c MAPREDUCE-2797. Update mapreduce tests and RAID for HDFS-2239.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1156215 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 15:10:20 +00:00
Tsz-wo Sze
5d5b1c6c10 HDFS-2239. Reduce access levels of the fields and methods in FSNamesystem.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155998 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 01:50:51 +00:00
Todd Lipcon
eb6e44b1ba HDFS-2227. getRemoteEditLogManifest should pull its information from FileJournalManager during checkpoint process. Contributed by Ivan Kelly and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155977 13f79535-47bb-0310-9956-ffa450edef68
2011-08-10 00:01:39 +00:00
Thomas White
27b66e2bba HADOOP-7525. Make arguments to test-patch optional.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155551 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 20:28:48 +00:00
Thomas White
0a2b40fad5 HADOOP-7528. Maven build fails in Windows. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155448 13f79535-47bb-0310-9956-ffa450edef68
2011-08-09 18:03:00 +00:00
Giridharan Kesavan
a523fbdb6c HDFS-2230. Fix ivy conf to resolve/retrieve latest common-tests jar published by hadoop common maven build. (gkesavan)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1155123 13f79535-47bb-0310-9956-ffa450edef68
2011-08-08 22:09:28 +00:00
Tsz-wo Sze
498e290103 HDFS-2238. In NamenodeFsck.toString(), uses StringBuilder.(..) instead of string concatenation. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154973 13f79535-47bb-0310-9956-ffa450edef68
2011-08-08 14:27:53 +00:00
Tsz-wo Sze
371f4a5905 HDFS-2228. Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager. (szetszwo)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154899 13f79535-47bb-0310-9956-ffa450edef68
2011-08-08 10:06:45 +00:00
Thomas White
8dc420ba36 HADOOP-7523. Test org.apache.hadoop.fs.TestFilterFileSystem fails due to java.lang.NoSuchMethodException. Contributed by John Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154817 13f79535-47bb-0310-9956-ffa450edef68
2011-08-08 04:36:46 +00:00
Todd Lipcon
62f27b5729 Edit change log entry for HDFS-2225 by request of Nicholas
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154414 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 23:42:09 +00:00
Giridharan Kesavan
3864369a58 HADOOP-7520. Fix to add distribution management info to hadoop-main. Contributed by Alejandro Abdelnur
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154350 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 18:47:53 +00:00
Thomas White
ca4b2f108a HADOOP-7515. test-patch reports the wrong number of javadoc warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154240 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 14:28:30 +00:00
Todd Lipcon
a61b24a6da HDFS-2226. Clean up counting of operations in FSEditLogLoader. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154098 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 06:03:19 +00:00
Thomas White
acd3ab521f Fix svn:ignore properties following HADOOP-6671.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154052 13f79535-47bb-0310-9956-ffa450edef68
2011-08-05 00:37:57 +00:00
Todd Lipcon
e639c3357b HADOOP-7445. Implement bulk checksum verification using efficient native code. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154043 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 22:57:01 +00:00
Tsz-wo Sze
7fac946ac9 HDFS-2108. Move datanode heartbeat handling from namenode package to blockmanagement package.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154042 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 22:55:48 +00:00
Todd Lipcon
23762da4fa HDFS-2225. Refactor file management so it's not in classes which should be generic. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1154029 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 21:56:17 +00:00
Todd Lipcon
53190cfa1d HDFS-2187. Make EditLogInputStream act like an iterator over FSEditLogOps. Contributed by Ivan Kelly and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153996 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 20:22:13 +00:00
Thomas White
924ed13664 HDFS-2196. Make ant build system work with hadoop-common JAR generated by Maven. Fix for fusedfs contributed by szetszwo
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153928 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 17:01:41 +00:00
Devaraj Das
703b5f412c MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153720 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 01:31:05 +00:00
Devaraj Das
44b7e03114 MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153717 13f79535-47bb-0310-9956-ffa450edef68
2011-08-04 01:15:33 +00:00
Thomas White
2025d4e032 HADOOP-7508. Compiled nativelib is in wrong directory and it is not picked up by surefire setup. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153689 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 22:22:49 +00:00
Thomas White
2db9aab9d7 HADOOP-7501. Publish Hadoop Common artifacts (post HADOOP-6671) to Apache SNAPSHOTs repo. Contributed by Alejandro Abdelnur
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153597 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 17:52:00 +00:00
Luke Lu
12e09b229f HADOOP-7502. Make generated sources IDE friendly. (Alejandro Abdelnur via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153586 13f79535-47bb-0310-9956-ffa450edef68
2011-08-03 17:13:24 +00:00
Eli Collins
102b94d3a8 MAPREDUCE-2760. mapreduce.jobtracker.split.metainfo.maxsize typoed in mapred-default.xml. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1153260 13f79535-47bb-0310-9956-ffa450edef68
2011-08-02 20:05:20 +00:00