big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
434 Commits 2 Branches 2 Tags 264 MiB
76e22cc8bf
Commit Graph

360 Commits

Author SHA1 Message Date
Konstantin Shvachko
27ab7f3db9 HADOOP-6573. Support for persistent delegation tokens. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916468 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 21:43:20 +00:00
Devaraj Das
7785232da5 HADOOP-6568. Adds authorization for the default servlets. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916467 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 21:39:38 +00:00
Owen O'Malley
37214591e9 HADOOP-6596. Add a version field to the AbstractDelegationTokenIdentifier's 
serialized value. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916390 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 18:34:05 +00:00
Owen O'Malley
831da66493 HADOOP-6579. Provide a mechanism for encoding/decoding Tokens from 
a url-safe string and change the commons-code library to 1.4. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916290 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 14:14:18 +00:00
Tsz-wo Sze
4eedc77275 HADOOP-6467. Improve the performance on HarFileSystem.listStatus(..). Contributed by mahadev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915168 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-23 03:54:14 +00:00
Devaraj Das
c5622e5d4d HADOOP-6543. Allows secure clients to talk to unsecure clusters. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915097 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-22 22:28:29 +00:00
Devaraj Das
ffdde40b9f HADOOP-6583. Captures authentication and authorization metrics. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915095 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-22 22:26:03 +00:00
Devaraj Das
115ef5b8c7 HADOOP-6545. Changes the Key for the FileSystem cache to be UGI. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912207 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 20:13:26 +00:00
Suresh Srinivas
9871771bb5 HADOOP-6577. Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912056 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 01:23:26 +00:00
Devaraj Das
d099c1c78a HADOOP-6572. Makes sure that SASL encryption and push to responder queue for the RPC response happens atomically. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911748 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 09:04:47 +00:00
Owen O'Malley
a417a8faea HADOOP-6551. Delegation token renewing and cancelling should provide 
meaningful exceptions when there are failures instead of returning 
false. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911743 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 08:49:22 +00:00
Tsz-wo Sze
50dcc335be HADOOP-6558. Return null in HarFileSystem.getFileChecksum(..) since no checksum algorithm is implemented. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911646 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-18 23:22:52 +00:00
Hairong Kuang
4b4e9d741e HADOOP-6570. RPC#stopProxy throws NPE if getProxyEngine(proxy) returns null. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911134 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-17 18:22:40 +00:00
Boris Shkolnik
3a7841aeb8 HADOOP-6549. TestDoAsEffectiveUser should use ip address of the host for superuser ip check 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910741 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:46:36 +00:00
Tsz-wo Sze
18c6d65749 HADOOP-6560. Handle invalid har:// uri in HarFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910726 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:17:54 +00:00
Sanjay Radia
ea605b8cd7 HADOOP-6421 Adds Symbolic links to FileContext, AbstractFileSystem. 
It also adds a limited implementation for the local file system
     (RawLocalFs) that allows local symlinks. (Eli Collins via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910706 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 21:43:30 +00:00
Devaraj Das
8b4b190cbd HADOOP-6559. Makes the RPC client automatically re-login when the SASL connection setup fails. This is applicable only to keytab based logins. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910169 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-15 07:28:17 +00:00
Christopher Douglas
96a1477d02 HADOOP-6534. Trim whitespace from directory lists initializing 
LocalDirAllocator. Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909806 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:46:38 +00:00
Christopher Douglas
fc83909c3f HADOOP-6548. Replace mortbay imports with commons logging. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909802 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:21:26 +00:00
Doug Cutting
8061821ca2 HADOOP-6522. Fix decoding of codepoint zero in UTF8. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908661 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 21:58:11 +00:00
Devaraj Das
cfbdd1aff4 HADOOP-6552. Puts renewTGT=true and useTicketCache=true for the keytab kerberos options. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908353 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 05:01:27 +00:00
Owen O'Malley
38c59c0af7 HADOOP-6547. Move DelegationToken into Common, so that it can be used by 
MapReduce also. (devaraj via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907956 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 08:10:37 +00:00
Thomas White
5b0d8a0162 HADOOP-6540. Contrib unit tests have invalid XML for core-site, etc. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907939 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 06:03:59 +00:00
Devaraj Das
1793e7d909 HADOOP-6510. Adds a way for superusers to impersonate other users in a secure environment. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907549 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-08 04:55:11 +00:00
Devaraj Das
f786508cd3 HADOOP-6538. Sets hadoop.security.authentication to simple by default. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906388 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-04 07:46:20 +00:00
Hemanth Yamijala
9f7a07f908 HADOOP-6531. Enhance FileUtil with an API to delete all contents of a directory. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906177 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 19:04:36 +00:00
Devaraj Das
940389afce HADOOP-6419. Adds SASL based authentication to RPC. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@905860 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 01:30:25 +00:00
Devaraj Das
fe0ddc03e1 HADOOP-6518. Makes the UGI honor the env var KRB5CCNAME. Contributed by Owen O'Malley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904975 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-31 04:04:38 +00:00
Devaraj Das
96cd62f8d5 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904862 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-30 19:58:09 +00:00
Devaraj Das
ba8647f511 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904861 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-30 19:57:39 +00:00
Devaraj Das
611340714b HADOOP-6517. Fix UserGroupInformation so that tokens are saved/retrieved to/from the embedded Subject. Contributed by Owen O'Malley & Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904339 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-29 01:56:57 +00:00
Owen O'Malley
0c5734e4ac HADOOP-6299. Reimplement the UserGroupInformation to use the OS 
specific and Kerberos JAAS login. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903560 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-27 08:08:29 +00:00
Hairong Kuang
34d1b39c75 HADOOP-6498. IPC client bug may cause rpc call hang. Contributed by Ruyue Ma and Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903471 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:55:17 +00:00
Hairong Kuang
d6f4cf3dfe Revert commit 903015 because it was tagged with the wrong jira number HADOOP-6459. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903468 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:52:05 +00:00
Hairong Kuang
3ef40e1344 HADOOP-6459. IPC client bug may cause rpc call hang. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903015 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-25 23:51:13 +00:00
Boris Shkolnik
aaf3b6c6ff HADOOP-6495. Identifier should be serialized after the password is 
created In Token constructor (jnp via boryas)  


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@901924 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-21 23:36:13 +00:00
Doug Cutting
f3477eb324 HADOOP-6497. Add an adapter for Avro's SeekableInput interface, so that Avro can read FileSystem data. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@900607 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-18 23:39:04 +00:00
Doug Cutting
4cd159e83e HADOOP-6492. Make some Avro serialization APIs public. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899866 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-16 01:06:57 +00:00
Suresh Srinivas
a90d3205d2 HADOOP-6489. Fix 3 findbugs warnings. Contributed by Erik Steffl. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899856 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-16 00:44:40 +00:00
Christopher Douglas
08561f76db HADOOP-6155. Deprecate RecordIO anticipating Avro. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898740 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 13:26:11 +00:00
Christopher Douglas
daed679fc1 HADOOP-6451. Fix build to run contrib unit tests. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898736 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 13:14:29 +00:00
Christopher Douglas
4cecab7c10 HADOOP-6315. Avoid incorrect use of BuiltInflater/BuiltInDeflater in 
GzipCodec. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898711 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 10:46:39 +00:00
Thomas White
8942119b04 HADOOP-6464. Write a Rackspace cloud provider. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@897023 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 21:43:38 +00:00
Christopher Douglas
1ca1bfb2e5 HADOOP-6420. Add functionality permitting subsets of Configuration to be 
interpreted as Map<String,String>. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896966 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 18:55:45 +00:00
Thomas White
dec4c1614e HADOOP-6479. TestUTF8 assertions could fail with better text. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896691 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 22:03:33 +00:00
Thomas White
889528e387 HADOOP-6408. Add a /conf servlet to dump running configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896641 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 19:44:07 +00:00
Thomas White
b55377a30d HADOOP-6466. Add a ZooKeeper service to the cloud scripts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896259 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:54:51 +00:00
Thomas White
ae91b5d0f4 HADOOP-3205. Read multiple chunks directly from FSInputChecker subclass into user buffers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896243 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:14:17 +00:00
Thomas White
efcad06506 HADOOP-6443. Serialization classes accept invalid metadata. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895831 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 00:06:09 +00:00
Boris Shkolnik
3cb2e3112b HADOOP-6472. add tokenCache option to GenericOptionsParser for passing 
file with secret keys to a map reduce job. (boryas)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895801 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-04 22:14:34 +00:00
Thomas White
7d2440515c HADOOP-6402. testConf.xsl is not well-formed XML. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@894706 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-30 20:32:42 +00:00
Suresh Srinivas
29a1ba1e8f HADOOP-6460. Reinitializes buffers used for serializing responses in ipc server on exceeding maximum response size to free up Java heap. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893666 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-24 00:47:20 +00:00
Thomas White
d115e2cc3a HADOOP-6435. Make RPC.waitForProxy with timeout public. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893612 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 19:36:14 +00:00
Steve Loughran
cc2f077d43 HADOOP-6452 Hadoop JSP pages don't work under a security manager 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893490 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 12:11:51 +00:00
Steve Loughran
583c41bfac HADOOP-6434 Make HttpServer slightly easier to manage/diagnose faults with 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893485 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 12:02:04 +00:00
Thomas White
0ebcb62515 HADOOP-6454. Create setup.py for EC2 cloud scripts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893262 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:33:48 +00:00
Thomas White
d2bae8756c HADOOP-6444. Support additional security group option in hadoop-ec2 script. Contributed by Paul Egan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893251 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:06:02 +00:00
Thomas White
3d3e1ff3f8 HADOOP-6462. Target compile does not exist in contrib/cloud. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893248 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:02:45 +00:00
Devaraj Das
fe479755c3 HADOOP-6415. Adds a common token interface for both job token and delegation token. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892113 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-18 02:33:11 +00:00
Boris Shkolnik
ae93ba7501 HADOOP-4656. Add a user to groups mapping service (boryas and acmurthy_) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892066 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-18 01:29:05 +00:00
Suresh Srinivas
ea5db0c5ab HADOOP-6394. Add a helper class to simplify FileContext related tests and improve code reusability. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891511 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-17 01:30:33 +00:00
Thomas White
6a1e8bf452 HADOOP-6426. Create ant build for running EC2 unit tests. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891497 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-17 00:49:01 +00:00
Owen O'Malley
875c9d62c6 HADOOP-6441. Protect web ui from cross site scripting attacks (XSS) on 
the host http header and using encoded utf-7. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891132 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-16 06:31:51 +00:00
Konstantin Boudnik
e8d9bf47ab HADOOP-6222. Core doesn't have TestCommonCLI facility. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890964 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 19:59:20 +00:00
Thomas White
7a9ec5d90b Reverting HADOOP-5901. FileSystem.fixName() has unexpected behaviour. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890941 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 18:59:04 +00:00
Thomas White
74b46cf87e HADOOP-5901. FileSystem.fixName() has unexpected behaviour. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890651 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 05:43:03 +00:00
Thomas White
1a2ab63f87 Add missing file for HADOOP-6413. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890588 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 00:51:07 +00:00
Thomas White
ee6468b8a1 HADOOP-5958. Use JDK 1.6 File APIs in DF.java wherever possible. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890576 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 00:10:13 +00:00
Thomas White
22fb49704b HADOOP-6414. Add command line help for -expunge command. Contributed by Ravi Phulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890551 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 23:28:40 +00:00
Dhruba Borthakur
c4e1126980 HADOOP-6433. Introduce asychronous deletion of files via a pool of 
threads. This can be used to delete files in the Distributed Cache. 
(Zheng Shao via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890502 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 22:17:19 +00:00
Doug Cutting
2ee80854a5 HADOOP-6422. Remove log line. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890410 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 17:45:51 +00:00
Doug Cutting
6c842ad4b5 AVRO-6422. Make RPC backend plugable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889889 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-12 04:37:06 +00:00
Doug Cutting
843ac12f7a HADOOP-6323. Add comparators to the serialization API. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889877 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-12 01:26:22 +00:00
Thomas White
f9cb8b0d45 Add pyAntTasks jar for HADOOP 6426. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889845 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-11 22:49:41 +00:00
Konstantin Boudnik
d7fb2d3c85 HADOOP-6428. HttpServer sleeps with negative values. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889378 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-10 19:26:07 +00:00
Thomas White
a473f37733 HADOOP-6346. Add support for specifying unpack pattern regex to RunJar.unJar. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889018 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 23:25:51 +00:00
Thomas White
2e5fd1c0ab HADOOP-6392. Run namenode and jobtracker on separate EC2 instances. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888998 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 21:57:10 +00:00
Thomas White
368b6cc85b HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888697 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 04:17:02 +00:00
Konstantin Boudnik
929e91a08c HADOOP-6386. NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888565 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-08 20:50:47 +00:00
Jakob Homan
934deda190 HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887472 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-05 00:46:08 +00:00
Konstantin Boudnik
3549d30d7e HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887047 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-04 03:18:27 +00:00
Thomas White
8d6c5c41f2 HADOOP-6400. Log errors getting Unix UGI. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886645 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-03 01:14:15 +00:00
Tsz-wo Sze
98beeca09d HADOOP-6307. Add a new SequenceFile.Reader constructor in order to support reading on un-closed file. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886003 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-01 23:25:56 +00:00
Thomas White
ff6c0ef547 HADOOP-6108. Add support for EBS storage on EC2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885888 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-01 19:33:10 +00:00
Konstantin Boudnik
36700348c1 HADOOP-6398. Build is broken after HADOOP-6395 patch has been applied. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885534 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-30 18:52:34 +00:00
Christopher Douglas
f6990e06b4 HADOOP-6375. Sync documentation for FsShell du with its implementation. 
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@883206 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-23 00:59:29 +00:00
Christopher Douglas
09ec9c4ffc HADOOP-6269. Fix threading issue with defaultResource in Configuration. 
Contributed by Sreekanth Ramakrishnan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@882831 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-21 04:22:02 +00:00
Devaraj Das
bd92322d22 HADOOP-6367. Removes Access Token implementation from common. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@881509 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-17 20:59:46 +00:00
Tsz-wo Sze
cdcb8514a0 HADOOP-6314. Fix "fs -help" for the "-count" commond. Contributed by Ravi Phulari 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@836019 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-13 22:10:01 +00:00
Devaraj Das
ad88440651 HADOOP-6337. Updates FilterInitializer class to be more visible, and the init of the class is made to take a Configuration argument. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@833553 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-06 20:54:40 +00:00
Giridharan Kesavan
af59233ce1 HADOOP-6341. Fix test-patch.sh for checkTests function. ( gkesavan ) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832590 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-03 22:53:08 +00:00
Tsz-wo Sze
f5f95fe43a HADOOP-6343. Log unexpected throwable object caught in RPC. Contributed by Jitendra Nath Pandey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832249 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-03 01:30:11 +00:00
Konstantin Boudnik
408117957e HADOOP-6347. run-test-core-fault-inject runs a test case twice if -Dtestcase is set. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832157 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-02 22:26:56 +00:00
Suresh Srinivas
382af3f627 HADOOP-6344. Fix rm and rmr immediately delete files rather than sending to trash, if a user is over-quota. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831478 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 22:39:01 +00:00
Suresh Srinivas
3f371a0a64 Hadoop-6223. Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831475 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 22:24:22 +00:00
Suresh Srinivas
b5c31f4ee6 HADOOP-6313. Implement Syncable interface in FSDataOutputStream to expose flush APIs to application users. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831416 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 18:33:00 +00:00
Tsz-wo Sze
a5427fc7eb HADOOP-6334. Fix GenericOptionsParser and Path to have a better URI support. Contributed by Amareshwari Sriramadasu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831412 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 18:21:26 +00:00
Doug Cutting
a13a0f3fba HADOOP-6318. Upgrade to Avro 1.2.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829279 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-23 23:36:29 +00:00
Konstantin Boudnik
d7a7f02c3e HADOOP-6326. Hundson runs should check for AspectJ warnings and report failure if any is present. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829269 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-23 22:33:57 +00:00
Tsz-wo Sze
4f4c74f76e HADOOP-6327. FileContext tests should not use /tmp and should clean up files. Contributed by Sanjay Radia 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828886 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-22 22:46:39 +00:00
Christopher Douglas
449ac4ab87 HADOOP-6292. Update native libraries guide. Contributed by Corinne Chandel 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827855 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-21 00:32:20 +00:00
Christopher Douglas
7313955d04 HADOOP-6097. Fix Path conversion in makeQualified and reset LineReader byte 
count at the start of each block in Hadoop archives. Contributed by Ben Slusky,
Tom White, and Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827837 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-20 23:39:49 +00:00
Christopher Douglas
1ecee2e062 HADOOP-6312. Remove unnecessary debug logging in Configuration constructor. Contributed by Aaron Kimball 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826141 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-17 00:22:39 +00:00
Christopher Douglas
c5bce7be47 HADOOP-6293. Fix FsShell -text to work on filesystems other than the default. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826120 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-16 22:41:54 +00:00
Konstantin Boudnik
3e9ba35841 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824942 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-13 21:54:48 +00:00
Devaraj Das
fed32afd17 HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824516 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-12 22:07:17 +00:00
Christopher Douglas
b903b25072 HADOOP-6279. Add Runtime::maxMemory to JVM metrics. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823271 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-08 18:54:04 +00:00
Tsz-wo Sze
710d517768 HADOOP-6283. Improve the exception messages thrown by FileUtil$HardLink.getLinkCount(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823263 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-08 18:37:37 +00:00
Suresh Srinivas
64f537da0a HADOOP-6286. Fix bugs in related to URI handling in glob methods in FileContext. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@822805 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-07 17:07:37 +00:00
Owen O'Malley
2031231edb HADOOP-6285. Fix the result type of the getParameterMap method in the 
HttpServer.QuotingInputFilter. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@819670 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-28 19:03:45 +00:00
Owen O'Malley
9de98c42cb HADOOP-6281. Avoid null pointer exceptions when the jsps don't have 
paramaters (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@818543 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-24 16:47:59 +00:00
Suresh Srinivas
0243cf3672 HADOOP-6261. Add URI based tests for FileContext. Contributed by Ravi Pulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817823 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-22 20:26:43 +00:00
Suresh Srinivas
373bf85f56 HADOOP-6274. Fix TestLocalFSFileContextMainOperations test failure. Contributed by Gary Murry. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@817496 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-22 04:12:45 +00:00
Suresh Srinivas
7cc6a8e8ce HADOOP-6260. Add additional unit tests for FileContext util methods. Contributed by Gary Murray. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816841 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 01:02:35 +00:00
Suresh Srinivas
6ef2552953 HADOOP-6233. Rename configuration keys towards API standardization and backward compatibility. Contributed by Jithendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816830 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 00:26:01 +00:00
Suresh Srinivas
fa48d9ea17 HADOOP-6271. Add recursive and non recursive create and mkdir to FileContext. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816818 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-19 00:03:04 +00:00
Suresh Srinivas
1695ecd1a3 HADOOP-6240. Add new FileContext rename operation that posix compliant that allows overwriting existing destination. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816794 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 21:52:59 +00:00
Doug Cutting
c722a45f47 HADOOP-6267. Permit building contrib modules located in external source trees. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816752 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 19:22:10 +00:00
Tsz-wo Sze
758f8a5abe HADOOP-6270. Support deleteOnExit in FileContext. Contributed by Suresh Srinivas 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816751 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 19:13:29 +00:00
Doug Cutting
ea50f15407 HADOOP-6170. Add facility to tunnel Avro RPCs through Hadoop RPCs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816727 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 17:47:08 +00:00
Owen O'Malley
366b1b1dd6 HADOOP-6151. Added a input filter to all of the http servlets that quotes 
html characters in the parameters, to prevent cross site scripting 
attacks. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816703 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-18 16:31:34 +00:00
Owen O'Malley
bec1f274cc HADOOP-6217. Update documentation for project split. (Corinne Chandel via 
omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816409 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-17 23:24:38 +00:00
Suresh Srinivas
0294c49df6 HADOOP-4952. Add new improved file system interface FileContext for the application writer. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@816398 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-17 22:27:15 +00:00
Thomas White
7ee09e0939 HADOOP-6257. Two TestFileSystem classes are confusing hadoop-hdfs-hdfwithmr. Contributed by Philip Zeyliger. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815809 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-16 14:41:08 +00:00
Tsz-wo Sze
9164c6319e HADOOP-6216. Support comments in host files. Contributed by Ravi Phulari and Dmytro Molkov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815524 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-15 22:18:21 +00:00
Hemanth Yamijala
78cff65f33 HADOOP-6250. Modify test-patch to delete copied XML files before running patch build. Contributed by Rahul Kumar Singh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@815317 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-15 13:17:07 +00:00
Christopher Douglas
254afbfe96 HADOOP-5879. Read compression level and strategy from Configuration for 
gzip compression. Contributed by He Yongqiang


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814455 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-14 00:45:01 +00:00
Suresh Srinivas
3617ed0bad HADOOP-6246. Add backward compatibility support to use deprecated decimal umask from old configuration. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@814080 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 23:28:08 +00:00
Christopher Douglas
c9cc61e853 HADOOP-6196. Fix a bug in SequenceFile.Reader where syncing within the header 
would cause the reader to read the sync marker as a record. Contributed by Jay Booth


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813698 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 07:38:01 +00:00
Suresh Srinivas
ae6721a85a HADOOP-6252. Provide a method to determine if a deprecated key is set in config file. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813639 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-11 00:14:22 +00:00
Christopher Douglas
86724941c5 HADOOP-4012. Provide splitting support for bzip2 compressed files. Contributed by Abdul Qadeer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@813581 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-10 20:51:48 +00:00
Suresh Srinivas
d9e6a9b15f HADOOP-5073. Add annotation mechanism for interface classification. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812740 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-09 00:43:47 +00:00
Suresh Srinivas
cdbb724edb HADOOP-6234. Add new option dfs.umaskmode to set umask in configuration to use octal or symbolic instead of decimal. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812652 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 19:08:08 +00:00
Suresh Srinivas
3f384b42d2 HADOOP-6235. Adds new method to FileSystem for clients to get server defaults. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812597 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 17:54:16 +00:00
Thomas White
174b3e8a74 HADOOP-6009. S3N listStatus incorrectly returns null instead of empty array when called on empty root. Contributed by Ian Nowland. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812479 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 12:18:06 +00:00
Hemanth Yamijala
4a4dd27571 HADOOP-6243. Fix a NullPointerException in processing deprecated keys. Contributed by Sreekanth Ramakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812455 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 10:56:15 +00:00
Suresh Srinivas
d09ade4d0b HADOOP-6203. FsShell rm/rmr error message indicates exceeding Trash quota and suggests using -skpTrash, when moving to trash fails. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812317 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-08 01:41:17 +00:00
Christopher Douglas
f95ec3f5bf HADOOP-6133. Add a caching layer to Configuration::getClassByName to 
alleviate a performance regression introduced in a compatibility layer.
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812285 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 21:54:45 +00:00
Thomas White
9b0b37e410 HADOOP-6229. Attempt to make a directory under an existing file on LocalFileSystem should throw an Exception. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812127 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 13:25:48 +00:00
Hemanth Yamijala
e24071be0a HADOOP-6105. Adds support for automatically handling deprecation of configuration keys. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812078 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 11:04:17 +00:00
Hemanth Yamijala
e324c20692 HADOOP-6230. Moved process tree and memory calculator related classes from Common to Map/Reduce. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@812031 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-07 08:16:09 +00:00
Thomas White
2aee3eda33 HADOOP-6231. Allow caching of filesystem instances to be disabled on a per-instance basis. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@811572 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-04 23:38:00 +00:00
Thomas White
d6428581ff HADOOP-6165. Add metadata to Serializations. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810756 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-03 01:36:33 +00:00
Michael Stack
e5fef21b18 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 -- reversing this patch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810714 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 22:19:42 +00:00
Michael Stack
412efb84f2 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810710 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 22:02:04 +00:00
Michael Stack
51d1c6ffa7 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810709 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 22:01:34 +00:00
Devaraj Das
a3c52b93ea HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810451 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 11:07:27 +00:00
Christopher Douglas
9ea11c5fb3 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an 
encoded String. Contributed by Jothi Padmanabhan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810384 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 07:07:21 +00:00
Christopher Douglas
faf9fe98ae HADOOP-6199. Move io.map.skip.index property to core-default from mapred. 
Contributed by Amareshwari Sriramadasu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810329 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 01:26:40 +00:00
Christopher Douglas
6145503acf Revert HADOOP-6224 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810325 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-02 01:00:34 +00:00
Hemanth Yamijala
75103dc925 HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@810097 13f79535-47bb-0310-9956-ffa450edef68
 2009-09-01 15:24:56 +00:00
Devaraj Das
4c66882a69 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@809491 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-31 07:56:39 +00:00
Sharad Agarwal
aa10f303e3 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@808415 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-27 13:55:19 +00:00
Christopher Douglas
8621b830f8 HADOOP-6166. Further improve the performance of the pure-Java CRC32 
implementation. Contributed by Tsz Wo (Nicholas), SZE


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807753 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-25 18:34:57 +00:00
Hemanth Yamijala
280ab0cf7d HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@807149 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-24 11:21:18 +00:00
Christopher Douglas
76a77aea78 HADOOP-6201. Change FileSystem::listStatus contract to throw 
FileNotFoundException if the directory does not exist, rather than letting
this be implementation-specific. Contributed by Jakob Homan.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806745 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 22:50:04 +00:00
Devaraj Das
0a8e65c23b HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806430 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-21 06:59:45 +00:00
Tsz-wo Sze
1f3337996e HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@806368 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-20 21:28:09 +00:00
Hemanth Yamijala
e5b7248682 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804918 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 10:06:36 +00:00
Giridharan Kesavan
07b43463b8 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804842 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-17 03:53:27 +00:00
Tsz-wo Sze
a7303bd279 Delete the empty file src/core/org/apache/hadoop/fs/LengthFileChecksum.java which was removed by HADOOP-3981. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804352 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 20:05:35 +00:00
Arun Murthy
7ffe5b7f87 Reverting HADOOP-6182 and HADOOP-6195 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804317 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 18:22:41 +00:00
Giridharan Kesavan
43f95b50f2 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804297 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 17:00:03 +00:00
Giridharan Kesavan
2e34ced206 HADOOP-6182. Fix releaseaudit warnings by adding AL Headers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804157 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 10:23:41 +00:00
Arun Murthy
ec8208f5d3 HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@804115 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-14 08:16:10 +00:00
Tsz-wo Sze
38a84a6c98 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803296 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 21:03:50 +00:00
Hairong Kuang
d70dd1a2df HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@803190 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-11 16:26:55 +00:00
Tsz-wo Sze
5fe6906f2a HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802224 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 21:40:01 +00:00
Hairong Kuang
09d826ebed HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@802107 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-07 17:59:57 +00:00
Tsz-wo Sze
5f53fd8ead HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800919 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-04 19:01:51 +00:00
Mahadev Konar
7be6fc4e5d HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@800199 13f79535-47bb-0310-9956-ffa450edef68
 2009-08-03 05:06:59 +00:00
Raghu Angadi
e4450e5487 HADOOP-6150. Users should be able to instantiate comparator using TFile 
API. (Hong Tang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797274 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-24 00:11:20 +00:00
Raghu Angadi
53c127013c HADOOP-6132. RPC client create an extra connection because of incorrect 
key for connection cache. (Kan Zhang via rangadi)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797248 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 22:28:26 +00:00
Doug Cutting
8296413d49 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@797197 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-23 19:21:21 +00:00
Christopher Douglas
3200b2ec58 HADOOP-6161. Add get/setEnum methods to Configuration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@796052 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 22:58:21 +00:00
Giridharan Kesavan
cd86632a70 HADOOP-5935. Fix the releaseaudit warning link with test-patch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795772 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-20 11:37:45 +00:00
Tsz-wo Sze
391112f6ce HADOOP-6138. Eliminate the depracate warnings introduced by H-5438. Contributed by He Yongqiang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@795172 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 18:01:15 +00:00
Tsz-wo Sze
8bd2486b51 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794944 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:18:06 +00:00
Christopher Douglas
fc1bf705e9 HADOOP-6142. Update documentation and use of harchives for relative paths added 
in MAPREDUCE-739. Contributed by Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@794943 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-17 02:06:42 +00:00
Tsz-wo Sze
466f93c8b6 HADOOP-6145. Fix FsShell rm/rmr error messages when there is a FNFE. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793987 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-14 17:39:33 +00:00
Tsz-wo Sze
d074c686b3 HADOOP-6139. Fix the FsShell help messages for rm and rmr. Contributed by Jakob Homan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@793098 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 20:26:30 +00:00
Dhruba Borthakur
c38c5a43ff HADOOP-6099. The RPC module can be configured to not send period pings. 
The default behaviour remains unchanged. (dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792812 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-10 06:17:55 +00:00
Giridharan Kesavan
127254f4a5 HADOOP-6137. Fix project specific test-patch requirements 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@792440 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-09 08:10:18 +00:00
Tsz-wo Sze
708f3fc781 HADOOP-5976. Add a new command, classpath, to the hadoop script. Contributed by Owen O'Malley and Gary Murry 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@791937 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-07 18:48:32 +00:00
Giridharan Kesavan
aa471150ea Move eclipse-plugin from common to mapreduce 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790831 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-03 08:54:20 +00:00
Dhruba Borthakur
cf3d3a0643 HADOOP-6114. Fix javadoc documentation for FileStatus.getLen. 
(Dmitry Rzhevskiy via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790277 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 17:20:42 +00:00
Tsz-wo Sze
b8d9ca281d HADOOP-6122. The great than operator in test-patch.sh should be "-gt" but not ">". 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@790009 13f79535-47bb-0310-9956-ffa450edef68
 2009-07-01 00:56:15 +00:00
Tsz-wo Sze
a13237975d HADOOP-2366. Support trimmed strings in Configuration. Contributed by Michele Catasta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789973 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 21:45:00 +00:00
Konstantin Shvachko
4824a54419 HADOOP-6080. Introduce -skipTrash option to rm and rmr. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789875 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-30 18:48:45 +00:00
Christopher Douglas
e93ebeae51 HADOOP-6109. Change Text to grow its internal buffer exponentially, rather 
than the max of the current length and the proposed length to improve
performance reading large values. Contributed by thushara wijeratna


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@789242 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-29 07:16:56 +00:00
Thomas White
efc6df7a11 HADOOP-5925. EC2 scripts should exit on error. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788699 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-26 13:40:07 +00:00
Hemanth Yamijala
b089f4448d HADOOP-6106. Provides an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. Contributed by Sreekanth Ramakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@788600 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-26 06:18:04 +00:00
Christopher Douglas
8246aa28ff HADOOP-3315. Add a new, binary file foramt, TFile. Contributed by Hong Tang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787913 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-24 05:48:25 +00:00
Tsz-wo Sze
2c372c70cf HADOOP-5952. Change "-1 tests included" wording in test-patch.sh. Contributed by Gary Murry 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@787541 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-23 04:45:15 +00:00
Owen O'Malley
cfb9636781 HADOOP-4687. Pulling trunk docs to branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786720 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-19 23:39:51 +00:00
Owen O'Malley
ff11be5426 HADOOP-4687 updating docs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786719 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-19 23:39:09 +00:00
Owen O'Malley
fb6308f280 HADOOP-4687. More merges from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@786712 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-19 23:12:41 +00:00
Owen O'Malley
b12d765467 HADOOP-4687. Merge -r 784663:785643 from trunk to branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@785794 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-17 20:55:51 +00:00
Owen O'Malley
bcd64325a1 Merged src/core, src/test/core, src/contrib/eclipse-plugin, and 
src/contrib/ec2 from trunk 776174:784663


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@784965 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-15 20:28:06 +00:00
Giridharan Kesavan
244380a885 Fix core test failrues 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/branches/HADOOP-4687/core@780977 13f79535-47bb-0310-9956-ffa450edef68
 2009-06-02 09:11:13 +00:00