big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,807 Commits 2 Branches 2 Tags 264 MiB
7affa3053c
Commit Graph

20807 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsz-wo Sze
4eedc77275 HADOOP-6467. Improve the performance on HarFileSystem.listStatus(..). Contributed by mahadev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915168 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-23 03:54:14 +00:00
Devaraj Das
c5622e5d4d HADOOP-6543. Allows secure clients to talk to unsecure clusters. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915097 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-22 22:28:29 +00:00
Devaraj Das
ffdde40b9f HADOOP-6583. Captures authentication and authorization metrics. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915095 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-22 22:26:03 +00:00
Devaraj Das
115ef5b8c7 HADOOP-6545. Changes the Key for the FileSystem cache to be UGI. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912207 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 20:13:26 +00:00
Suresh Srinivas
9871771bb5 HADOOP-6577. Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912056 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 01:23:26 +00:00
Devaraj Das
d099c1c78a HADOOP-6572. Makes sure that SASL encryption and push to responder queue for the RPC response happens atomically. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911748 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 09:04:47 +00:00
Owen O'Malley
a417a8faea HADOOP-6551. Delegation token renewing and cancelling should provide 
meaningful exceptions when there are failures instead of returning 
false. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911743 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 08:49:22 +00:00
Tsz-wo Sze
50dcc335be HADOOP-6558. Return null in HarFileSystem.getFileChecksum(..) since no checksum algorithm is implemented. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911646 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-18 23:22:52 +00:00
Hairong Kuang
4b4e9d741e HADOOP-6570. RPC#stopProxy throws NPE if getProxyEngine(proxy) returns null. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911134 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-17 18:22:40 +00:00
Boris Shkolnik
3a7841aeb8 HADOOP-6549. TestDoAsEffectiveUser should use ip address of the host for superuser ip check 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910741 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:46:36 +00:00
Tsz-wo Sze
18c6d65749 HADOOP-6560. Handle invalid har:// uri in HarFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910726 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:17:54 +00:00
Owen O'Malley
44185c3874 prep for making 0.20.2 rc2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910709 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 21:53:15 +00:00
Sanjay Radia
ea605b8cd7 HADOOP-6421 Adds Symbolic links to FileContext, AbstractFileSystem. 
It also adds a limited implementation for the local file system
     (RawLocalFs) that allows local symlinks. (Eli Collins via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910706 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 21:43:30 +00:00
Devaraj Das
8b4b190cbd HADOOP-6559. Makes the RPC client automatically re-login when the SASL connection setup fails. This is applicable only to keytab based logins. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910169 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-15 07:28:17 +00:00
Christopher Douglas
96a1477d02 HADOOP-6534. Trim whitespace from directory lists initializing 
LocalDirAllocator. Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909806 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:46:38 +00:00
Christopher Douglas
fc83909c3f HADOOP-6548. Replace mortbay imports with commons logging. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909802 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:21:26 +00:00
Christopher Douglas
e0a0e6b9f5 HADOOP-6505. Use tr rather than sed to effect literal substitution in the 
build script. Contributed by Allen Wittenauer


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909801 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:16:52 +00:00
Christopher Douglas
139b2ea1a2 HADOOP-5612. Commit to branch 0.20 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909721 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 04:05:08 +00:00
Christopher Douglas
e9ff6510bd HADOOP-5611. Commit to branch 0.20 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909242 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-12 05:28:35 +00:00
Doug Cutting
8061821ca2 HADOOP-6522. Fix decoding of codepoint zero in UTF8. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908661 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 21:58:11 +00:00
Devaraj Das
cfbdd1aff4 HADOOP-6552. Puts renewTGT=true and useTicketCache=true for the keytab kerberos options. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908353 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 05:01:27 +00:00
Owen O'Malley
38c59c0af7 HADOOP-6547. Move DelegationToken into Common, so that it can be used by 
MapReduce also. (devaraj via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907956 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 08:10:37 +00:00
Thomas White
5b0d8a0162 HADOOP-6540. Contrib unit tests have invalid XML for core-site, etc. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907939 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 06:03:59 +00:00
Devaraj Das
1793e7d909 HADOOP-6510. Adds a way for superusers to impersonate other users in a secure environment. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907549 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-08 04:55:11 +00:00
Devaraj Das
f786508cd3 HADOOP-6538. Sets hadoop.security.authentication to simple by default. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906388 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-04 07:46:20 +00:00
Hemanth Yamijala
9f7a07f908 HADOOP-6531. Enhance FileUtil with an API to delete all contents of a directory. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906177 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 19:04:36 +00:00
Devaraj Das
940389afce HADOOP-6419. Adds SASL based authentication to RPC. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@905860 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 01:30:25 +00:00
Devaraj Das
fe0ddc03e1 HADOOP-6518. Makes the UGI honor the env var KRB5CCNAME. Contributed by Owen O'Malley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904975 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-31 04:04:38 +00:00
Devaraj Das
96cd62f8d5 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904862 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-30 19:58:09 +00:00
Devaraj Das
ba8647f511 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904861 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-30 19:57:39 +00:00
Devaraj Das
611340714b HADOOP-6517. Fix UserGroupInformation so that tokens are saved/retrieved to/from the embedded Subject. Contributed by Owen O'Malley & Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904339 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-29 01:56:57 +00:00
Owen O'Malley
0c5734e4ac HADOOP-6299. Reimplement the UserGroupInformation to use the OS 
specific and Kerberos JAAS login. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903560 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-27 08:08:29 +00:00
Hairong Kuang
34d1b39c75 HADOOP-6498. IPC client bug may cause rpc call hang. Contributed by Ruyue Ma and Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903471 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:55:17 +00:00
Hairong Kuang
d6f4cf3dfe Revert commit 903015 because it was tagged with the wrong jira number HADOOP-6459. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903468 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:52:05 +00:00
Hairong Kuang
3ef40e1344 HADOOP-6459. IPC client bug may cause rpc call hang. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903015 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-25 23:51:13 +00:00
Christopher Douglas
f38a996b4c HADOOP-6290. Prevent duplicate slf4j-simple jar via Avro's classpath. 
Contributed by Owen O'Malley


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@902745 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-25 09:29:09 +00:00
Boris Shkolnik
aaf3b6c6ff HADOOP-6495. Identifier should be serialized after the password is 
created In Token constructor (jnp via boryas)  


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@901924 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-21 23:36:13 +00:00
Konstantin Boudnik
c7a3c785f8 HADOOP-6374. JUnit tests should never depend on anything in conf. Contributed by Anatoli Fomenko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@901540 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-21 05:57:30 +00:00
Doug Cutting
f3477eb324 HADOOP-6497. Add an adapter for Avro's SeekableInput interface, so that Avro can read FileSystem data. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@900607 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-18 23:39:04 +00:00
Doug Cutting
4cd159e83e HADOOP-6492. Make some Avro serialization APIs public. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899866 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-16 01:06:57 +00:00
Suresh Srinivas
a90d3205d2 HADOOP-6489. Fix 3 findbugs warnings. Contributed by Erik Steffl. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899856 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-16 00:44:40 +00:00
Christopher Douglas
08561f76db HADOOP-6155. Deprecate RecordIO anticipating Avro. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898740 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 13:26:11 +00:00
Christopher Douglas
daed679fc1 HADOOP-6451. Fix build to run contrib unit tests. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898736 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 13:14:29 +00:00
Christopher Douglas
4cecab7c10 HADOOP-6315. Avoid incorrect use of BuiltInflater/BuiltInDeflater in 
GzipCodec. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898711 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 10:46:39 +00:00
Thomas White
8942119b04 HADOOP-6464. Write a Rackspace cloud provider. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@897023 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 21:43:38 +00:00
Christopher Douglas
1ca1bfb2e5 HADOOP-6420. Add functionality permitting subsets of Configuration to be 
interpreted as Map<String,String>. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896966 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 18:55:45 +00:00
Thomas White
dec4c1614e HADOOP-6479. TestUTF8 assertions could fail with better text. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896691 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 22:03:33 +00:00
Thomas White
889528e387 HADOOP-6408. Add a /conf servlet to dump running configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896641 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 19:44:07 +00:00
Thomas White
b55377a30d HADOOP-6466. Add a ZooKeeper service to the cloud scripts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896259 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:54:51 +00:00
Thomas White
ae91b5d0f4 HADOOP-3205. Read multiple chunks directly from FSInputChecker subclass into user buffers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896243 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:14:17 +00:00