big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,634 Commits 2 Branches 2 Tags 264 MiB
8ef3bc8113
Commit Graph

21634 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Christopher Douglas
9ea11c5fb3 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an 
encoded String. Contributed by Jothi Padmanabhan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810384 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 07:07:21 +00:00
Christopher Douglas
faf9fe98ae HADOOP-6199. Move io.map.skip.index property to core-default from mapred. 
Contributed by Amareshwari Sriramadasu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810329 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 01:26:40 +00:00
Christopher Douglas
6145503acf Revert HADOOP-6224 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810325 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 01:00:34 +00:00
Hemanth Yamijala
75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-01 15:24:56 +00:00
Devaraj Das
4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-31 07:56:39 +00:00
Sharad Agarwal
aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-27 13:55:19 +00:00
Christopher Douglas
8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32 
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-25 18:34:57 +00:00
Tsz-wo Sze
a72edd2b10 HADOOP-6152. Fix classpath variables in bin/hadoop-config.sh and some other scripts. Contributed by Aaron Kimball 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807404 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-24 22:06:54 +00:00
Hemanth Yamijala
280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-24 11:21:18 +00:00
Christopher Douglas
76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw 
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 22:50:04 +00:00
Devaraj Das
0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 06:59:45 +00:00
Tsz-wo Sze
1f3337996e HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806368 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-20 21:28:09 +00:00
Hemanth Yamijala
e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 10:06:36 +00:00
Giridharan Kesavan
07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 03:53:27 +00:00
Tsz-wo Sze
a7303bd279 Delete the empty file src/core/org/apache/hadoop/fs/LengthFileChecksum.java which was removed by HADOOP-3981. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804352 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 20:05:35 +00:00
Arun Murthy
7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 18:22:41 +00:00
Giridharan Kesavan
43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 17:00:03 +00:00
Giridharan Kesavan
2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 10:23:41 +00:00
Arun Murthy
ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 08:16:10 +00:00
Tsz-wo Sze
38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 21:03:50 +00:00
Hairong Kuang
d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 16:26:55 +00:00
Tsz-wo Sze
5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 21:40:01 +00:00
Hairong Kuang
09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 17:59:57 +00:00
Tsz-wo Sze
5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-04 19:01:51 +00:00
Thomas White
ada9e3d79e JDiff output for release 0.19.2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800338 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-03 12:38:40 +00:00
Mahadev Konar
7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-03 05:06:59 +00:00
Tsz-wo Sze
e5ea0ce4a6 HADOOP-6172. Fix jar file names in hadoop-config.sh and include ${build.src} as a part of the source list in build.xml. Contributed by Hong Tang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@799751 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-31 21:37:23 +00:00
Tsz-wo Sze
638a211067 HADOOP-6123. Add missing classpaths in hadoop-config.sh. Contributed by Sharad Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798247 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-27 18:34:57 +00:00
Giridharan Kesavan
6c12fd3335 HADOOP-6160. Fix ant releaseaudit target to run on specific directories. (Contributed by Giridharan Kesavan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@798093 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-27 10:09:38 +00:00
Raghu Angadi
f4166ddfad move the last change long from trunk to 0.20. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797300 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-24 01:14:52 +00:00
Raghu Angadi
e4450e5487 HADOOP-6150. Users should be able to instantiate comparator using TFile 
API. (Hong Tang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797274 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-24 00:11:20 +00:00
Raghu Angadi
53c127013c HADOOP-6132. RPC client create an extra connection because of incorrect 
key for connection cache. (Kan Zhang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797248 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 22:28:26 +00:00
Doug Cutting
8296413d49 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797197 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 19:21:21 +00:00
Christopher Douglas
3200b2ec58 HADOOP-6161. Add get/setEnum methods to Configuration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@796052 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 22:58:21 +00:00
Giridharan Kesavan
cd86632a70 HADOOP-5935. Fix the releaseaudit warning link with test-patch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795772 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 11:37:45 +00:00
Tsz-wo Sze
391112f6ce HADOOP-6138. Eliminate the depracate warnings introduced by H-5438. Contributed by He Yongqiang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795172 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 18:01:15 +00:00
Thomas White
5478e9a188 HADOOP-6146. Upgrade to JetS3t version 0.7.1. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795028 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 10:20:00 +00:00
Tsz-wo Sze
8bd2486b51 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794944 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:18:06 +00:00
Christopher Douglas
fc1bf705e9 HADOOP-6142. Update documentation and use of harchives for relative paths added 
in MAPREDUCE-739. Contributed by Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794943 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:06:42 +00:00
Tsz-wo Sze
466f93c8b6 HADOOP-6145. Fix FsShell rm/rmr error messages when there is a FNFE. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793987 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-14 17:39:33 +00:00
Christopher Douglas
c02527fd04 Move HADOOP-3315 from 0.21 to 0.20.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793162 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-11 01:21:43 +00:00
Tsz-wo Sze
d074c686b3 HADOOP-6139. Fix the FsShell help messages for rm and rmr. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793098 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 20:26:30 +00:00
Dhruba Borthakur
c38c5a43ff HADOOP-6099. The RPC module can be configured to not send period pings. 
The default behaviour remains unchanged. (dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792812 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 06:17:55 +00:00
Owen O'Malley
34d67b1cc2 HADOOP-5170. Removed change log entry because HADOOP-5170 was reverted from 
mapreduce.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792701 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-09 21:17:22 +00:00
Giridharan Kesavan
127254f4a5 HADOOP-6137. Fix project specific test-patch requirements 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792440 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-09 08:10:18 +00:00
Mahadev Konar
da8cf6702a HADOOP-6131. A sysproperty should not be set unless the property is set on the ant command line in build.xml (hong tang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792302 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-08 20:35:26 +00:00
Tsz-wo Sze
708f3fc781 HADOOP-5976. Add a new command, classpath, to the hadoop script. Contributed by Owen O'Malley and Gary Murry 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@791937 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-07 18:48:32 +00:00
Giridharan Kesavan
aa471150ea Move eclipse-plugin from common to mapreduce 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790831 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-03 08:54:20 +00:00
Dhruba Borthakur
cf3d3a0643 HADOOP-6114. Fix javadoc documentation for FileStatus.getLen. 
(Dmitry Rzhevskiy via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790277 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 17:20:42 +00:00
Tsz-wo Sze
b8d9ca281d HADOOP-6122. The great than operator in test-patch.sh should be "-gt" but not ">". 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790009 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 00:56:15 +00:00