big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
678 Commits 2 Branches 2 Tags 264 MiB
ef543e386d
Commit Graph

565 Commits

Author SHA1 Message Date
Michael Stack
51d1c6ffa7 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810709 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 22:01:34 +00:00
Devaraj Das
a3c52b93ea HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810451 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 11:07:27 +00:00
Christopher Douglas
9ea11c5fb3 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an 
encoded String. Contributed by Jothi Padmanabhan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810384 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 07:07:21 +00:00
Christopher Douglas
faf9fe98ae HADOOP-6199. Move io.map.skip.index property to core-default from mapred. 
Contributed by Amareshwari Sriramadasu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810329 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 01:26:40 +00:00
Christopher Douglas
6145503acf Revert HADOOP-6224 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810325 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 01:00:34 +00:00
Hemanth Yamijala
75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-01 15:24:56 +00:00
Devaraj Das
4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-31 07:56:39 +00:00
Sharad Agarwal
aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-27 13:55:19 +00:00
Christopher Douglas
8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32 
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-25 18:34:57 +00:00
Hemanth Yamijala
280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-24 11:21:18 +00:00
Christopher Douglas
76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw 
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 22:50:04 +00:00
Devaraj Das
0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 06:59:45 +00:00
Tsz-wo Sze
1f3337996e HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806368 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-20 21:28:09 +00:00
Hemanth Yamijala
e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 10:06:36 +00:00
Giridharan Kesavan
07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 03:53:27 +00:00
Tsz-wo Sze
a7303bd279 Delete the empty file src/core/org/apache/hadoop/fs/LengthFileChecksum.java which was removed by HADOOP-3981. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804352 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 20:05:35 +00:00
Arun Murthy
7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 18:22:41 +00:00
Giridharan Kesavan
43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 17:00:03 +00:00
Giridharan Kesavan
2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 10:23:41 +00:00
Arun Murthy
ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 08:16:10 +00:00
Tsz-wo Sze
38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 21:03:50 +00:00
Hairong Kuang
d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 16:26:55 +00:00
Tsz-wo Sze
5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 21:40:01 +00:00
Hairong Kuang
09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 17:59:57 +00:00
Tsz-wo Sze
5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-04 19:01:51 +00:00
Mahadev Konar
7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-03 05:06:59 +00:00
Raghu Angadi
e4450e5487 HADOOP-6150. Users should be able to instantiate comparator using TFile 
API. (Hong Tang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797274 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-24 00:11:20 +00:00
Raghu Angadi
53c127013c HADOOP-6132. RPC client create an extra connection because of incorrect 
key for connection cache. (Kan Zhang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797248 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 22:28:26 +00:00
Doug Cutting
8296413d49 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797197 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 19:21:21 +00:00
Christopher Douglas
3200b2ec58 HADOOP-6161. Add get/setEnum methods to Configuration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@796052 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 22:58:21 +00:00
Giridharan Kesavan
cd86632a70 HADOOP-5935. Fix the releaseaudit warning link with test-patch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795772 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 11:37:45 +00:00
Tsz-wo Sze
391112f6ce HADOOP-6138. Eliminate the depracate warnings introduced by H-5438. Contributed by He Yongqiang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795172 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 18:01:15 +00:00
Tsz-wo Sze
8bd2486b51 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794944 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:18:06 +00:00
Christopher Douglas
fc1bf705e9 HADOOP-6142. Update documentation and use of harchives for relative paths added 
in MAPREDUCE-739. Contributed by Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794943 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:06:42 +00:00
Tsz-wo Sze
466f93c8b6 HADOOP-6145. Fix FsShell rm/rmr error messages when there is a FNFE. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793987 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-14 17:39:33 +00:00
Tsz-wo Sze
d074c686b3 HADOOP-6139. Fix the FsShell help messages for rm and rmr. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793098 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 20:26:30 +00:00
Dhruba Borthakur
c38c5a43ff HADOOP-6099. The RPC module can be configured to not send period pings. 
The default behaviour remains unchanged. (dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792812 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 06:17:55 +00:00
Giridharan Kesavan
127254f4a5 HADOOP-6137. Fix project specific test-patch requirements 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792440 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-09 08:10:18 +00:00
Tsz-wo Sze
708f3fc781 HADOOP-5976. Add a new command, classpath, to the hadoop script. Contributed by Owen O'Malley and Gary Murry 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@791937 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-07 18:48:32 +00:00
Giridharan Kesavan
aa471150ea Move eclipse-plugin from common to mapreduce 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790831 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-03 08:54:20 +00:00
Dhruba Borthakur
cf3d3a0643 HADOOP-6114. Fix javadoc documentation for FileStatus.getLen. 
(Dmitry Rzhevskiy via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790277 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 17:20:42 +00:00
Tsz-wo Sze
b8d9ca281d HADOOP-6122. The great than operator in test-patch.sh should be "-gt" but not ">". 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790009 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 00:56:15 +00:00
Tsz-wo Sze
a13237975d HADOOP-2366. Support trimmed strings in Configuration. Contributed by Michele Catasta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789973 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 21:45:00 +00:00
Konstantin Shvachko
4824a54419 HADOOP-6080. Introduce -skipTrash option to rm and rmr. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789875 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 18:48:45 +00:00
Christopher Douglas
e93ebeae51 HADOOP-6109. Change Text to grow its internal buffer exponentially, rather 
than the max of the current length and the proposed length to improve
performance reading large values. Contributed by thushara wijeratna


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789242 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-29 07:16:56 +00:00
Thomas White
efc6df7a11 HADOOP-5925. EC2 scripts should exit on error. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788699 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-26 13:40:07 +00:00
Hemanth Yamijala
b089f4448d HADOOP-6106. Provides an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. Contributed by Sreekanth Ramakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788600 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-26 06:18:04 +00:00
Christopher Douglas
8246aa28ff HADOOP-3315. Add a new, binary file foramt, TFile. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787913 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-24 05:48:25 +00:00
Tsz-wo Sze
2c372c70cf HADOOP-5952. Change "-1 tests included" wording in test-patch.sh. Contributed by Gary Murry 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787541 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-23 04:45:15 +00:00
Owen O'Malley
cfb9636781 HADOOP-4687. Pulling trunk docs to branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786720 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-19 23:39:51 +00:00
Owen O'Malley
ff11be5426 HADOOP-4687 updating docs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786719 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-19 23:39:09 +00:00
Owen O'Malley
fb6308f280 HADOOP-4687. More merges from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786712 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-19 23:12:41 +00:00
Owen O'Malley
b12d765467 HADOOP-4687. Merge -r 784663:785643 from trunk to branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785794 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-17 20:55:51 +00:00
Owen O'Malley
bcd64325a1 Merged src/core, src/test/core, src/contrib/eclipse-plugin, and 
src/contrib/ec2 from trunk 776174:784663


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@784965 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-15 20:28:06 +00:00
Giridharan Kesavan
244380a885 Fix core test failrues 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780977 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-02 09:11:13 +00:00
Owen O'Malley
5c7b7adacb HADOOP-4687. Fix some of the remaining javadoc warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780833 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-01 21:10:16 +00:00
Giridharan Kesavan
bb957bd2cd Fix test-patch.sh script for eclipse classpath verification 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780701 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-01 16:06:19 +00:00
Giridharan Kesavan
7e7fd2ce5b fixed test test-core and test-contrib targets 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@779613 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-28 14:55:35 +00:00
Giridharan Kesavan
bd524bd960 move test and xml files 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@779196 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-27 14:48:04 +00:00
Giridharan Kesavan
ac670cc47f Fixed basic hadoop core targets 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@778829 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-26 18:27:23 +00:00
Owen O'Malley
95a0db602b HADOOP-4687. move test dirs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776186 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-19 04:56:52 +00:00
Owen O'Malley
c967cef4d3 HADOOP-4687 move more src dirs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776183 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-19 04:53:47 +00:00
Owen O'Malley
cab0a4bf54 HADOOP-4687 split the contrib dirs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776180 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-19 04:45:07 +00:00
Owen O'Malley
abe7be9134 HADOOP-4687 Moving directories around 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776176 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-19 04:35:56 +00:00
Owen O'Malley
5128a9a453 HADOOP-4687 Moving src directories on branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776174 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-19 04:20:40 +00:00