big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
428 Commits 2 Branches 2 Tags 264 MiB
bd121ed635
Commit Graph

226 Commits

Author SHA1 Message Date
Suresh Srinivas
9871771bb5 HADOOP-6577. Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912056 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 01:23:26 +00:00
Owen O'Malley
a417a8faea HADOOP-6551. Delegation token renewing and cancelling should provide 
meaningful exceptions when there are failures instead of returning 
false. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911743 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 08:49:22 +00:00
Tsz-wo Sze
50dcc335be HADOOP-6558. Return null in HarFileSystem.getFileChecksum(..) since no checksum algorithm is implemented. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911646 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-18 23:22:52 +00:00
Hairong Kuang
4b4e9d741e HADOOP-6570. RPC#stopProxy throws NPE if getProxyEngine(proxy) returns null. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911134 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-17 18:22:40 +00:00
Boris Shkolnik
3a7841aeb8 HADOOP-6549. TestDoAsEffectiveUser should use ip address of the host for superuser ip check 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910741 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:46:36 +00:00
Tsz-wo Sze
18c6d65749 HADOOP-6560. Handle invalid har:// uri in HarFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910726 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:17:54 +00:00
Sanjay Radia
ea605b8cd7 HADOOP-6421 Adds Symbolic links to FileContext, AbstractFileSystem. 
It also adds a limited implementation for the local file system
     (RawLocalFs) that allows local symlinks. (Eli Collins via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910706 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 21:43:30 +00:00
Doug Cutting
8061821ca2 HADOOP-6522. Fix decoding of codepoint zero in UTF8. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908661 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 21:58:11 +00:00
Owen O'Malley
38c59c0af7 HADOOP-6547. Move DelegationToken into Common, so that it can be used by 
MapReduce also. (devaraj via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907956 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 08:10:37 +00:00
Devaraj Das
1793e7d909 HADOOP-6510. Adds a way for superusers to impersonate other users in a secure environment. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907549 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-08 04:55:11 +00:00
Hemanth Yamijala
9f7a07f908 HADOOP-6531. Enhance FileUtil with an API to delete all contents of a directory. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906177 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 19:04:36 +00:00
Devaraj Das
940389afce HADOOP-6419. Adds SASL based authentication to RPC. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@905860 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 01:30:25 +00:00
Devaraj Das
96cd62f8d5 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904862 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-30 19:58:09 +00:00
Devaraj Das
611340714b HADOOP-6517. Fix UserGroupInformation so that tokens are saved/retrieved to/from the embedded Subject. Contributed by Owen O'Malley & Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904339 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-29 01:56:57 +00:00
Owen O'Malley
0c5734e4ac HADOOP-6299. Reimplement the UserGroupInformation to use the OS 
specific and Kerberos JAAS login. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903560 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-27 08:08:29 +00:00
Hairong Kuang
34d1b39c75 HADOOP-6498. IPC client bug may cause rpc call hang. Contributed by Ruyue Ma and Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903471 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:55:17 +00:00
Hairong Kuang
d6f4cf3dfe Revert commit 903015 because it was tagged with the wrong jira number HADOOP-6459. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903468 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:52:05 +00:00
Hairong Kuang
3ef40e1344 HADOOP-6459. IPC client bug may cause rpc call hang. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903015 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-25 23:51:13 +00:00
Doug Cutting
f3477eb324 HADOOP-6497. Add an adapter for Avro's SeekableInput interface, so that Avro can read FileSystem data. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@900607 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-18 23:39:04 +00:00
Christopher Douglas
4cecab7c10 HADOOP-6315. Avoid incorrect use of BuiltInflater/BuiltInDeflater in 
GzipCodec. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898711 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 10:46:39 +00:00
Christopher Douglas
1ca1bfb2e5 HADOOP-6420. Add functionality permitting subsets of Configuration to be 
interpreted as Map<String,String>. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896966 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 18:55:45 +00:00
Thomas White
dec4c1614e HADOOP-6479. TestUTF8 assertions could fail with better text. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896691 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 22:03:33 +00:00
Thomas White
889528e387 HADOOP-6408. Add a /conf servlet to dump running configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896641 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 19:44:07 +00:00
Thomas White
ae91b5d0f4 HADOOP-3205. Read multiple chunks directly from FSInputChecker subclass into user buffers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896243 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:14:17 +00:00
Thomas White
efcad06506 HADOOP-6443. Serialization classes accept invalid metadata. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895831 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 00:06:09 +00:00
Boris Shkolnik
3cb2e3112b HADOOP-6472. add tokenCache option to GenericOptionsParser for passing 
file with secret keys to a map reduce job. (boryas)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895801 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-04 22:14:34 +00:00
Thomas White
7d2440515c HADOOP-6402. testConf.xsl is not well-formed XML. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@894706 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-30 20:32:42 +00:00
Suresh Srinivas
29a1ba1e8f HADOOP-6460. Reinitializes buffers used for serializing responses in ipc server on exceeding maximum response size to free up Java heap. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893666 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-24 00:47:20 +00:00
Steve Loughran
cc2f077d43 HADOOP-6452 Hadoop JSP pages don't work under a security manager 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893490 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 12:11:51 +00:00
Steve Loughran
583c41bfac HADOOP-6434 Make HttpServer slightly easier to manage/diagnose faults with 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893485 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 12:02:04 +00:00
Devaraj Das
fe479755c3 HADOOP-6415. Adds a common token interface for both job token and delegation token. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892113 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-18 02:33:11 +00:00
Boris Shkolnik
ae93ba7501 HADOOP-4656. Add a user to groups mapping service (boryas and acmurthy_) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892066 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-18 01:29:05 +00:00
Suresh Srinivas
ea5db0c5ab HADOOP-6394. Add a helper class to simplify FileContext related tests and improve code reusability. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891511 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-17 01:30:33 +00:00
Konstantin Boudnik
e8d9bf47ab HADOOP-6222. Core doesn't have TestCommonCLI facility. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890964 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 19:59:20 +00:00
Thomas White
7a9ec5d90b Reverting HADOOP-5901. FileSystem.fixName() has unexpected behaviour. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890941 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 18:59:04 +00:00
Thomas White
74b46cf87e HADOOP-5901. FileSystem.fixName() has unexpected behaviour. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890651 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 05:43:03 +00:00
Thomas White
1a2ab63f87 Add missing file for HADOOP-6413. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890588 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 00:51:07 +00:00
Thomas White
ee6468b8a1 HADOOP-5958. Use JDK 1.6 File APIs in DF.java wherever possible. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890576 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 00:10:13 +00:00
Dhruba Borthakur
c4e1126980 HADOOP-6433. Introduce asychronous deletion of files via a pool of 
threads. This can be used to delete files in the Distributed Cache. 
(Zheng Shao via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890502 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 22:17:19 +00:00
Doug Cutting
6c842ad4b5 AVRO-6422. Make RPC backend plugable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889889 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-12 04:37:06 +00:00
Doug Cutting
843ac12f7a HADOOP-6323. Add comparators to the serialization API. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889877 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-12 01:26:22 +00:00
Thomas White
a473f37733 HADOOP-6346. Add support for specifying unpack pattern regex to RunJar.unJar. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889018 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 23:25:51 +00:00
Thomas White
368b6cc85b HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888697 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 04:17:02 +00:00
Jakob Homan
934deda190 HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887472 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-05 00:46:08 +00:00
Konstantin Boudnik
3549d30d7e HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887047 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-04 03:18:27 +00:00
Tsz-wo Sze
98beeca09d HADOOP-6307. Add a new SequenceFile.Reader constructor in order to support reading on un-closed file. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886003 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-01 23:25:56 +00:00
Konstantin Boudnik
36700348c1 HADOOP-6398. Build is broken after HADOOP-6395 patch has been applied. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885534 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-30 18:52:34 +00:00
Devaraj Das
bd92322d22 HADOOP-6367. Removes Access Token implementation from common. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@881509 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-17 20:59:46 +00:00
Devaraj Das
ad88440651 HADOOP-6337. Updates FilterInitializer class to be more visible, and the init of the class is made to take a Configuration argument. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@833553 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-06 20:54:40 +00:00
Giridharan Kesavan
af59233ce1 HADOOP-6341. Fix test-patch.sh for checkTests function. ( gkesavan ) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832590 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-03 22:53:08 +00:00
Konstantin Boudnik
408117957e HADOOP-6347. run-test-core-fault-inject runs a test case twice if -Dtestcase is set. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832157 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-02 22:26:56 +00:00
Suresh Srinivas
3f371a0a64 Hadoop-6223. Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831475 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 22:24:22 +00:00
Suresh Srinivas
b5c31f4ee6 HADOOP-6313. Implement Syncable interface in FSDataOutputStream to expose flush APIs to application users. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831416 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 18:33:00 +00:00
Tsz-wo Sze
a5427fc7eb HADOOP-6334. Fix GenericOptionsParser and Path to have a better URI support. Contributed by Amareshwari Sriramadasu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831412 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 18:21:26 +00:00
Konstantin Boudnik
d7a7f02c3e HADOOP-6326. Hundson runs should check for AspectJ warnings and report failure if any is present. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829269 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-23 22:33:57 +00:00
Tsz-wo Sze
4f4c74f76e HADOOP-6327. FileContext tests should not use /tmp and should clean up files. Contributed by Sanjay Radia 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828886 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-22 22:46:39 +00:00
Konstantin Boudnik
3e9ba35841 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824942 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-13 21:54:48 +00:00
Devaraj Das
fed32afd17 HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824516 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-12 22:07:17 +00:00
Owen O'Malley
2031231edb HADOOP-6285. Fix the result type of the getParameterMap method in the 
HttpServer.QuotingInputFilter. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@819670 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-28 19:03:45 +00:00
Owen O'Malley
9de98c42cb HADOOP-6281. Avoid null pointer exceptions when the jsps don't have 
paramaters (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@818543 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-24 16:47:59 +00:00
Suresh Srinivas
0243cf3672 HADOOP-6261. Add URI based tests for FileContext. Contributed by Ravi Pulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817823 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-22 20:26:43 +00:00
Suresh Srinivas
373bf85f56 HADOOP-6274. Fix TestLocalFSFileContextMainOperations test failure. Contributed by Gary Murry. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817496 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-22 04:12:45 +00:00
Suresh Srinivas
7cc6a8e8ce HADOOP-6260. Add additional unit tests for FileContext util methods. Contributed by Gary Murray. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816841 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 01:02:35 +00:00
Suresh Srinivas
6ef2552953 HADOOP-6233. Rename configuration keys towards API standardization and backward compatibility. Contributed by Jithendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816830 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 00:26:01 +00:00
Suresh Srinivas
fa48d9ea17 HADOOP-6271. Add recursive and non recursive create and mkdir to FileContext. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816818 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 00:03:04 +00:00
Suresh Srinivas
1695ecd1a3 HADOOP-6240. Add new FileContext rename operation that posix compliant that allows overwriting existing destination. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816794 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 21:52:59 +00:00
Tsz-wo Sze
758f8a5abe HADOOP-6270. Support deleteOnExit in FileContext. Contributed by Suresh Srinivas 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816751 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 19:13:29 +00:00
Doug Cutting
ea50f15407 HADOOP-6170. Add facility to tunnel Avro RPCs through Hadoop RPCs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816727 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 17:47:08 +00:00
Owen O'Malley
366b1b1dd6 HADOOP-6151. Added a input filter to all of the http servlets that quotes 
html characters in the parameters, to prevent cross site scripting 
attacks. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816703 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 16:31:34 +00:00
Suresh Srinivas
0294c49df6 HADOOP-4952. Add new improved file system interface FileContext for the application writer. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816398 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-17 22:27:15 +00:00
Thomas White
7ee09e0939 HADOOP-6257. Two TestFileSystem classes are confusing hadoop-hdfs-hdfwithmr. Contributed by Philip Zeyliger. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815809 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-16 14:41:08 +00:00
Tsz-wo Sze
9164c6319e HADOOP-6216. Support comments in host files. Contributed by Ravi Phulari and Dmytro Molkov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815524 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-15 22:18:21 +00:00
Hemanth Yamijala
78cff65f33 HADOOP-6250. Modify test-patch to delete copied XML files before running patch build. Contributed by Rahul Kumar Singh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815317 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-15 13:17:07 +00:00
Christopher Douglas
254afbfe96 HADOOP-5879. Read compression level and strategy from Configuration for 
gzip compression. Contributed by He Yongqiang


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814455 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-14 00:45:01 +00:00
Suresh Srinivas
3617ed0bad HADOOP-6246. Add backward compatibility support to use deprecated decimal umask from old configuration. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814080 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 23:28:08 +00:00
Christopher Douglas
c9cc61e853 HADOOP-6196. Fix a bug in SequenceFile.Reader where syncing within the header 
would cause the reader to read the sync marker as a record. Contributed by Jay Booth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813698 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 07:38:01 +00:00
Suresh Srinivas
ae6721a85a HADOOP-6252. Provide a method to determine if a deprecated key is set in config file. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813639 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 00:14:22 +00:00
Christopher Douglas
86724941c5 HADOOP-4012. Provide splitting support for bzip2 compressed files. Contributed by Abdul Qadeer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813581 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-10 20:51:48 +00:00
Suresh Srinivas
cdbb724edb HADOOP-6234. Add new option dfs.umaskmode to set umask in configuration to use octal or symbolic instead of decimal. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812652 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 19:08:08 +00:00
Thomas White
174b3e8a74 HADOOP-6009. S3N listStatus incorrectly returns null instead of empty array when called on empty root. Contributed by Ian Nowland. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812479 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 12:18:06 +00:00
Hemanth Yamijala
4a4dd27571 HADOOP-6243. Fix a NullPointerException in processing deprecated keys. Contributed by Sreekanth Ramakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812455 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 10:56:15 +00:00
Thomas White
9b0b37e410 HADOOP-6229. Attempt to make a directory under an existing file on LocalFileSystem should throw an Exception. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812127 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 13:25:48 +00:00
Hemanth Yamijala
e24071be0a HADOOP-6105. Adds support for automatically handling deprecation of configuration keys. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812078 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 11:04:17 +00:00
Hemanth Yamijala
e324c20692 HADOOP-6230. Moved process tree and memory calculator related classes from Common to Map/Reduce. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812031 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 08:16:09 +00:00
Thomas White
2aee3eda33 HADOOP-6231. Allow caching of filesystem instances to be disabled on a per-instance basis. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@811572 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-04 23:38:00 +00:00
Thomas White
d6428581ff HADOOP-6165. Add metadata to Serializations. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810756 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-03 01:36:33 +00:00
Devaraj Das
a3c52b93ea HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810451 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 11:07:27 +00:00
Hemanth Yamijala
75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-01 15:24:56 +00:00
Sharad Agarwal
aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-27 13:55:19 +00:00
Christopher Douglas
8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32 
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-25 18:34:57 +00:00
Hemanth Yamijala
280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-24 11:21:18 +00:00
Christopher Douglas
76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw 
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 22:50:04 +00:00
Devaraj Das
0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 06:59:45 +00:00
Hemanth Yamijala
e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 10:06:36 +00:00
Giridharan Kesavan
07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 03:53:27 +00:00
Arun Murthy
7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 18:22:41 +00:00
Giridharan Kesavan
43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 17:00:03 +00:00
Giridharan Kesavan
2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 10:23:41 +00:00
Tsz-wo Sze
38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 21:03:50 +00:00
Hairong Kuang
d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 16:26:55 +00:00
Tsz-wo Sze
5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 21:40:01 +00:00
Hairong Kuang
09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 17:59:57 +00:00
Tsz-wo Sze
5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-04 19:01:51 +00:00
Mahadev Konar
7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-03 05:06:59 +00:00
Doug Cutting
8296413d49 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797197 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 19:21:21 +00:00
Christopher Douglas
3200b2ec58 HADOOP-6161. Add get/setEnum methods to Configuration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@796052 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 22:58:21 +00:00
Giridharan Kesavan
cd86632a70 HADOOP-5935. Fix the releaseaudit warning link with test-patch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795772 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 11:37:45 +00:00
Tsz-wo Sze
8bd2486b51 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794944 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:18:06 +00:00
Dhruba Borthakur
c38c5a43ff HADOOP-6099. The RPC module can be configured to not send period pings. 
The default behaviour remains unchanged. (dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792812 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 06:17:55 +00:00
Giridharan Kesavan
127254f4a5 HADOOP-6137. Fix project specific test-patch requirements 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792440 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-09 08:10:18 +00:00
Tsz-wo Sze
b8d9ca281d HADOOP-6122. The great than operator in test-patch.sh should be "-gt" but not ">". 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790009 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 00:56:15 +00:00
Tsz-wo Sze
a13237975d HADOOP-2366. Support trimmed strings in Configuration. Contributed by Michele Catasta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789973 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 21:45:00 +00:00
Konstantin Shvachko
4824a54419 HADOOP-6080. Introduce -skipTrash option to rm and rmr. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789875 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 18:48:45 +00:00
Hemanth Yamijala
b089f4448d HADOOP-6106. Provides an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. Contributed by Sreekanth Ramakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788600 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-26 06:18:04 +00:00
Christopher Douglas
8246aa28ff HADOOP-3315. Add a new, binary file foramt, TFile. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787913 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-24 05:48:25 +00:00
Tsz-wo Sze
2c372c70cf HADOOP-5952. Change "-1 tests included" wording in test-patch.sh. Contributed by Gary Murry 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787541 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-23 04:45:15 +00:00
Owen O'Malley
fb6308f280 HADOOP-4687. More merges from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786712 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-19 23:12:41 +00:00
Owen O'Malley
b12d765467 HADOOP-4687. Merge -r 784663:785643 from trunk to branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785794 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-17 20:55:51 +00:00
Owen O'Malley
bcd64325a1 Merged src/core, src/test/core, src/contrib/eclipse-plugin, and 
src/contrib/ec2 from trunk 776174:784663


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@784965 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-15 20:28:06 +00:00
Giridharan Kesavan
244380a885 Fix core test failrues 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780977 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-02 09:11:13 +00:00
Giridharan Kesavan
bb957bd2cd Fix test-patch.sh script for eclipse classpath verification 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780701 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-01 16:06:19 +00:00
Giridharan Kesavan
7e7fd2ce5b fixed test test-core and test-contrib targets 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@779613 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-28 14:55:35 +00:00
Giridharan Kesavan
bd524bd960 move test and xml files 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@779196 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-27 14:48:04 +00:00
Giridharan Kesavan
ac670cc47f Fixed basic hadoop core targets 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@778829 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-26 18:27:23 +00:00
Owen O'Malley
95a0db602b HADOOP-4687. move test dirs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776186 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-19 04:56:52 +00:00
Owen O'Malley
abe7be9134 HADOOP-4687 Moving directories around 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@776176 13f79535-47bb-0310-9956-ffa450edef68
 2009-05-19 04:35:56 +00:00