Commit Graph

47 Commits

Author SHA1 Message Date
Thomas White
2aee3eda33 HADOOP-6231. Allow caching of filesystem instances to be disabled on a per-instance basis.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@811572 13f79535-47bb-0310-9956-ffa450edef68
2009-09-04 23:38:00 +00:00
Thomas White
d6428581ff HADOOP-6165. Add metadata to Serializations.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810756 13f79535-47bb-0310-9956-ffa450edef68
2009-09-03 01:36:33 +00:00
Michael Stack
e5fef21b18 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 -- reversing this patch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810714 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:19:42 +00:00
Michael Stack
412efb84f2 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810710 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:02:04 +00:00
Michael Stack
51d1c6ffa7 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810709 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 22:01:34 +00:00
Devaraj Das
a3c52b93ea HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810451 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 11:07:27 +00:00
Christopher Douglas
9ea11c5fb3 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an
encoded String. Contributed by Jothi Padmanabhan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810384 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 07:07:21 +00:00
Christopher Douglas
faf9fe98ae HADOOP-6199. Move io.map.skip.index property to core-default from mapred.
Contributed by Amareshwari Sriramadasu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810329 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 01:26:40 +00:00
Christopher Douglas
6145503acf Revert HADOOP-6224
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810325 13f79535-47bb-0310-9956-ffa450edef68
2009-09-02 01:00:34 +00:00
Hemanth Yamijala
75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
2009-09-01 15:24:56 +00:00
Devaraj Das
4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
2009-08-31 07:56:39 +00:00
Sharad Agarwal
aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 13:55:19 +00:00
Christopher Douglas
8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
2009-08-25 18:34:57 +00:00
Hemanth Yamijala
280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 11:21:18 +00:00
Christopher Douglas
76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 22:50:04 +00:00
Devaraj Das
0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 06:59:45 +00:00
Hemanth Yamijala
e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 10:06:36 +00:00
Giridharan Kesavan
07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
2009-08-17 03:53:27 +00:00
Tsz-wo Sze
a7303bd279 Delete the empty file src/core/org/apache/hadoop/fs/LengthFileChecksum.java which was removed by HADOOP-3981.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804352 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 20:05:35 +00:00
Arun Murthy
7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 18:22:41 +00:00
Giridharan Kesavan
2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 10:23:41 +00:00
Arun Murthy
ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 08:16:10 +00:00
Hairong Kuang
d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 16:26:55 +00:00
Tsz-wo Sze
5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 21:40:01 +00:00
Hairong Kuang
09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:59:57 +00:00
Mahadev Konar
7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 05:06:59 +00:00
Raghu Angadi
e4450e5487 HADOOP-6150. Users should be able to instantiate comparator using TFile
API. (Hong Tang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797274 13f79535-47bb-0310-9956-ffa450edef68
2009-07-24 00:11:20 +00:00
Raghu Angadi
53c127013c HADOOP-6132. RPC client create an extra connection because of incorrect
key for connection cache. (Kan Zhang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797248 13f79535-47bb-0310-9956-ffa450edef68
2009-07-23 22:28:26 +00:00
Doug Cutting
8296413d49 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797197 13f79535-47bb-0310-9956-ffa450edef68
2009-07-23 19:21:21 +00:00
Christopher Douglas
3200b2ec58 HADOOP-6161. Add get/setEnum methods to Configuration.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@796052 13f79535-47bb-0310-9956-ffa450edef68
2009-07-20 22:58:21 +00:00
Tsz-wo Sze
391112f6ce HADOOP-6138. Eliminate the depracate warnings introduced by H-5438. Contributed by He Yongqiang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795172 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 18:01:15 +00:00
Tsz-wo Sze
8bd2486b51 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794944 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 02:18:06 +00:00
Tsz-wo Sze
466f93c8b6 HADOOP-6145. Fix FsShell rm/rmr error messages when there is a FNFE. Contributed by Jakob Homan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793987 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 17:39:33 +00:00
Tsz-wo Sze
d074c686b3 HADOOP-6139. Fix the FsShell help messages for rm and rmr. Contributed by Jakob Homan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793098 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 20:26:30 +00:00
Dhruba Borthakur
c38c5a43ff HADOOP-6099. The RPC module can be configured to not send period pings.
The default behaviour remains unchanged. (dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792812 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 06:17:55 +00:00
Dhruba Borthakur
cf3d3a0643 HADOOP-6114. Fix javadoc documentation for FileStatus.getLen.
(Dmitry Rzhevskiy via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790277 13f79535-47bb-0310-9956-ffa450edef68
2009-07-01 17:20:42 +00:00
Tsz-wo Sze
a13237975d HADOOP-2366. Support trimmed strings in Configuration. Contributed by Michele Catasta
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789973 13f79535-47bb-0310-9956-ffa450edef68
2009-06-30 21:45:00 +00:00
Konstantin Shvachko
4824a54419 HADOOP-6080. Introduce -skipTrash option to rm and rmr. Contributed by Jakob Homan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789875 13f79535-47bb-0310-9956-ffa450edef68
2009-06-30 18:48:45 +00:00
Christopher Douglas
e93ebeae51 HADOOP-6109. Change Text to grow its internal buffer exponentially, rather
than the max of the current length and the proposed length to improve
performance reading large values. Contributed by thushara wijeratna


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789242 13f79535-47bb-0310-9956-ffa450edef68
2009-06-29 07:16:56 +00:00
Hemanth Yamijala
b089f4448d HADOOP-6106. Provides an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. Contributed by Sreekanth Ramakrishnan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788600 13f79535-47bb-0310-9956-ffa450edef68
2009-06-26 06:18:04 +00:00
Christopher Douglas
8246aa28ff HADOOP-3315. Add a new, binary file foramt, TFile. Contributed by Hong Tang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787913 13f79535-47bb-0310-9956-ffa450edef68
2009-06-24 05:48:25 +00:00
Owen O'Malley
fb6308f280 HADOOP-4687. More merges from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786712 13f79535-47bb-0310-9956-ffa450edef68
2009-06-19 23:12:41 +00:00
Owen O'Malley
b12d765467 HADOOP-4687. Merge -r 784663:785643 from trunk to branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785794 13f79535-47bb-0310-9956-ffa450edef68
2009-06-17 20:55:51 +00:00
Owen O'Malley
bcd64325a1 Merged src/core, src/test/core, src/contrib/eclipse-plugin, and
src/contrib/ec2 from trunk 776174:784663


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@784965 13f79535-47bb-0310-9956-ffa450edef68
2009-06-15 20:28:06 +00:00
Owen O'Malley
5c7b7adacb HADOOP-4687. Fix some of the remaining javadoc warnings.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780833 13f79535-47bb-0310-9956-ffa450edef68
2009-06-01 21:10:16 +00:00
Giridharan Kesavan
ac670cc47f Fixed basic hadoop core targets
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@778829 13f79535-47bb-0310-9956-ffa450edef68
2009-05-26 18:27:23 +00:00
Owen O'Malley
5128a9a453 HADOOP-4687 Moving src directories on branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776174 13f79535-47bb-0310-9956-ffa450edef68
2009-05-19 04:20:40 +00:00