Commit Graph

18140 Commits

Author SHA1 Message Date
Christopher Douglas
1ecee2e062 HADOOP-6312. Remove unnecessary debug logging in Configuration constructor. Contributed by Aaron Kimball
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826141 13f79535-47bb-0310-9956-ffa450edef68
2009-10-17 00:22:39 +00:00
Christopher Douglas
c5bce7be47 HADOOP-6293. Fix FsShell -text to work on filesystems other than the default.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826120 13f79535-47bb-0310-9956-ffa450edef68
2009-10-16 22:41:54 +00:00
Konstantin Boudnik
3e9ba35841 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824942 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 21:54:48 +00:00
Tsz-wo Sze
512a39264f HADOOP-6309. Change build.xml to run tests with java asserts. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824899 13f79535-47bb-0310-9956-ffa450edef68
2009-10-13 19:59:17 +00:00
Devaraj Das
fed32afd17 HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824516 13f79535-47bb-0310-9956-ffa450edef68
2009-10-12 22:07:17 +00:00
Konstantin Boudnik
d3c314e450 HADOOP-6305. Unify build property names to facilitate cross-projects modifications. Contributed by Konstantin Boudnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823756 13f79535-47bb-0310-9956-ffa450edef68
2009-10-10 01:10:41 +00:00
Konstantin Boudnik
780efea7ae Eclipse .classpath template has outdated jar files and is missing some new
ones. Contributed by Konstantin Boudnik


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823355 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 23:08:59 +00:00
Christopher Douglas
b903b25072 HADOOP-6279. Add Runtime::maxMemory to JVM metrics. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823271 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 18:54:04 +00:00
Tsz-wo Sze
710d517768 HADOOP-6283. Improve the exception messages thrown by FileUtil$HardLink.getLinkCount(..).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823263 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 18:37:37 +00:00
Suresh Srinivas
64f537da0a HADOOP-6286. Fix bugs in related to URI handling in glob methods in FileContext. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@822805 13f79535-47bb-0310-9956-ffa450edef68
2009-10-07 17:07:37 +00:00
Tsz-wo Sze
59ab2c5d31 HADOOP-6284. Add a new parameter, HADOOP_JAVA_PLATFORM_OPTS, to hadoop-config.sh so that it allows setting java command options for JAVA_PLATFORM. Contributed by Koji Noguchi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@820094 13f79535-47bb-0310-9956-ffa450edef68
2009-09-29 21:26:06 +00:00
Owen O'Malley
2031231edb HADOOP-6285. Fix the result type of the getParameterMap method in the
HttpServer.QuotingInputFilter. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@819670 13f79535-47bb-0310-9956-ffa450edef68
2009-09-28 19:03:45 +00:00
Owen O'Malley
9de98c42cb HADOOP-6281. Avoid null pointer exceptions when the jsps don't have
paramaters (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@818543 13f79535-47bb-0310-9956-ffa450edef68
2009-09-24 16:47:59 +00:00
Owen O'Malley
779e2a5753 Add build.properties to svnignore and gitignore.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@818530 13f79535-47bb-0310-9956-ffa450edef68
2009-09-24 16:09:17 +00:00
Suresh Srinivas
0243cf3672 HADOOP-6261. Add URI based tests for FileContext. Contributed by Ravi Pulari.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817823 13f79535-47bb-0310-9956-ffa450edef68
2009-09-22 20:26:43 +00:00
Suresh Srinivas
373bf85f56 HADOOP-6274. Fix TestLocalFSFileContextMainOperations test failure. Contributed by Gary Murry.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817496 13f79535-47bb-0310-9956-ffa450edef68
2009-09-22 04:12:45 +00:00
Owen O'Malley
277dd0e2a3 Fix up formatting of header after branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817416 13f79535-47bb-0310-9956-ffa450edef68
2009-09-21 21:36:13 +00:00
Owen O'Malley
4342710434 Branching for 0.21
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816847 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 01:24:39 +00:00
Suresh Srinivas
7cc6a8e8ce HADOOP-6260. Add additional unit tests for FileContext util methods. Contributed by Gary Murray.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816841 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 01:02:35 +00:00
Suresh Srinivas
6ef2552953 HADOOP-6233. Rename configuration keys towards API standardization and backward compatibility. Contributed by Jithendra Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816830 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 00:26:01 +00:00
Suresh Srinivas
fa48d9ea17 HADOOP-6271. Add recursive and non recursive create and mkdir to FileContext. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816818 13f79535-47bb-0310-9956-ffa450edef68
2009-09-19 00:03:04 +00:00
Suresh Srinivas
1695ecd1a3 HADOOP-6240. Add new FileContext rename operation that posix compliant that allows overwriting existing destination. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816794 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 21:52:59 +00:00
Doug Cutting
c722a45f47 HADOOP-6267. Permit building contrib modules located in external source trees. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816752 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 19:22:10 +00:00
Tsz-wo Sze
758f8a5abe HADOOP-6270. Support deleteOnExit in FileContext. Contributed by Suresh Srinivas
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816751 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 19:13:29 +00:00
Doug Cutting
ea50f15407 HADOOP-6170. Add facility to tunnel Avro RPCs through Hadoop RPCs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816727 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 17:47:08 +00:00
Owen O'Malley
366b1b1dd6 HADOOP-6151. Added a input filter to all of the http servlets that quotes
html characters in the parameters, to prevent cross site scripting 
attacks. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816703 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 16:31:34 +00:00
Christopher Douglas
446309b039 HADOOP-6268. Add ivy jar to .gitignore. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816532 13f79535-47bb-0310-9956-ffa450edef68
2009-09-18 08:31:02 +00:00
Owen O'Malley
bec1f274cc HADOOP-6217. Update documentation for project split. (Corinne Chandel via
omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816409 13f79535-47bb-0310-9956-ffa450edef68
2009-09-17 23:24:38 +00:00
Suresh Srinivas
0294c49df6 HADOOP-4952. Add new improved file system interface FileContext for the application writer. Contributed by Sanjay Radia.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816398 13f79535-47bb-0310-9956-ffa450edef68
2009-09-17 22:27:15 +00:00
Thomas White
7ee09e0939 HADOOP-6257. Two TestFileSystem classes are confusing hadoop-hdfs-hdfwithmr. Contributed by Philip Zeyliger.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815809 13f79535-47bb-0310-9956-ffa450edef68
2009-09-16 14:41:08 +00:00
Tsz-wo Sze
9164c6319e HADOOP-6216. Support comments in host files. Contributed by Ravi Phulari and Dmytro Molkov
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815524 13f79535-47bb-0310-9956-ffa450edef68
2009-09-15 22:18:21 +00:00
Hemanth Yamijala
78cff65f33 HADOOP-6250. Modify test-patch to delete copied XML files before running patch build. Contributed by Rahul Kumar Singh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815317 13f79535-47bb-0310-9956-ffa450edef68
2009-09-15 13:17:07 +00:00
Owen O'Malley
7612b78838 Reverted files from my last commit that should have just updated the jdiff for
0.20.1.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814874 13f79535-47bb-0310-9956-ffa450edef68
2009-09-14 21:43:36 +00:00
Owen O'Malley
2cf010bf41 Jdiff output for release 0.20.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814872 13f79535-47bb-0310-9956-ffa450edef68
2009-09-14 21:40:57 +00:00
Christopher Douglas
254afbfe96 HADOOP-5879. Read compression level and strategy from Configuration for
gzip compression. Contributed by He Yongqiang


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814455 13f79535-47bb-0310-9956-ffa450edef68
2009-09-14 00:45:01 +00:00
Suresh Srinivas
3617ed0bad HADOOP-6246. Add backward compatibility support to use deprecated decimal umask from old configuration. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814080 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 23:28:08 +00:00
Christopher Douglas
c9cc61e853 HADOOP-6196. Fix a bug in SequenceFile.Reader where syncing within the header
would cause the reader to read the sync marker as a record. Contributed by Jay Booth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813698 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 07:38:01 +00:00
Suresh Srinivas
ae6721a85a HADOOP-6252. Provide a method to determine if a deprecated key is set in config file. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813639 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 00:14:22 +00:00
Christopher Douglas
86724941c5 HADOOP-4012. Provide splitting support for bzip2 compressed files. Contributed by Abdul Qadeer
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813581 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 20:51:48 +00:00
Tsz-wo Sze
efb3e17bed HADOOP-6181. Fix .eclipse.templates/.classpath for avro and jets3t jar files. Contributed by Carlos Valiente
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813179 13f79535-47bb-0310-9956-ffa450edef68
2009-09-10 00:11:52 +00:00
Suresh Srinivas
d9e6a9b15f HADOOP-5073. Add annotation mechanism for interface classification. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812740 13f79535-47bb-0310-9956-ffa450edef68
2009-09-09 00:43:47 +00:00
Suresh Srinivas
cdbb724edb HADOOP-6234. Add new option dfs.umaskmode to set umask in configuration to use octal or symbolic instead of decimal. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812652 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 19:08:08 +00:00
Suresh Srinivas
3f384b42d2 HADOOP-6235. Adds new method to FileSystem for clients to get server defaults. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812597 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 17:54:16 +00:00
Thomas White
174b3e8a74 HADOOP-6009. S3N listStatus incorrectly returns null instead of empty array when called on empty root. Contributed by Ian Nowland.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812479 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 12:18:06 +00:00
Hemanth Yamijala
4a4dd27571 HADOOP-6243. Fix a NullPointerException in processing deprecated keys. Contributed by Sreekanth Ramakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812455 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 10:56:15 +00:00
Suresh Srinivas
d09ade4d0b HADOOP-6203. FsShell rm/rmr error message indicates exceeding Trash quota and suggests using -skpTrash, when moving to trash fails. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812317 13f79535-47bb-0310-9956-ffa450edef68
2009-09-08 01:41:17 +00:00
Christopher Douglas
f95ec3f5bf HADOOP-6133. Add a caching layer to Configuration::getClassByName to
alleviate a performance regression introduced in a compatibility layer.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812285 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 21:54:45 +00:00
Thomas White
9b0b37e410 HADOOP-6229. Attempt to make a directory under an existing file on LocalFileSystem should throw an Exception. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812127 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 13:25:48 +00:00
Hemanth Yamijala
e24071be0a HADOOP-6105. Adds support for automatically handling deprecation of configuration keys. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812078 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 11:04:17 +00:00
Hemanth Yamijala
e324c20692 HADOOP-6230. Moved process tree and memory calculator related classes from Common to Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812031 13f79535-47bb-0310-9956-ffa450edef68
2009-09-07 08:16:09 +00:00