big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
678 Commits 2 Branches 2 Tags 264 MiB
ef543e386d
Commit Graph

565 Commits

Author SHA1 Message Date
Eli Collins
ee08b2c803 HADOOP-7032. Assert type constraints in the FileStatus constructor. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1035147 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-15 05:05:42 +00:00
Eli Collins
05a497f35a HADOOP-7034. Add TestPath tests to cover dot, dot dot, and slash normalization. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1035142 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-15 04:57:05 +00:00
Sanjay Radia
946eac3dac HADOOP-6903 Make AbstractFSileSystem methods and some FileContext methods to be public 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1034480 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-12 17:23:53 +00:00
Jakob Homan
ca3ef069cb HADOOP-7024. Create a test method for adding file systems during tests. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1034184 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-11 22:34:52 +00:00
Konstantin Boudnik
50659f1a76 HADOOP-6977. Herriot daemon clients should vend statistics. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1033812 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-11 03:40:33 +00:00
Thomas White
fa87ae8058 HADOOP-4675. Current Ganglia metrics implementation is incompatible with Ganglia 3.1. Contributed by Brian Bockelman. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1033758 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-10 22:19:42 +00:00
Sanjay Radia
c979e30875 HADOOP-6899 RawLocalFileSystem#setWorkingDir() does not work for relative names 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1032730 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-08 21:29:05 +00:00
Thomas White
f1894a3c5b HADOOP-6926. SocketInputStream incorrectly implements read(). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1031948 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-06 03:13:42 +00:00
Thomas White
3460a5e345 HADOOP-6758. MapFile.fix does not allow index interval definition. Contributed by Gianmarco De Francisci Morales. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1031743 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-05 19:36:06 +00:00
Thomas White
cf65399043 HADOOP-6943. The GroupMappingServiceProvider interface should be public. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1031675 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-05 17:28:58 +00:00
Nigel Daley
9ea883e083 HADOOP-7008. Fix bug and missing license header in test-patch files. (nigel) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1031422 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-05 03:48:48 +00:00
Devaraj Das
dfe57e0b1a HADOOP-6818. Provides a JNI implementation of group resolution. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1030646 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-03 20:20:33 +00:00
Nigel Daley
7daf9a3d3d HADOOP-7008. Enable test-patch.sh to have a configured number of acceptable findbugs and javadoc warnings. Contributed by nigel and gkesavan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1029958 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-02 05:33:05 +00:00
Thomas White
1a865e30ea HADOOP-6975. Integer overflow in S3InputStream for blocks > 2GB. Contributed by Patrick Kling. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1029867 13f79535-47bb-0310-9956-ffa450edef68
 2010-11-01 22:25:54 +00:00
Doug Cutting
6285cbb499 HADOOP-7011. Fix KerberosName.main() to not throw an NPE. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1028938 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-29 22:55:53 +00:00
Owen O'Malley
0c462b223f HADOOP-6991. Fix SequenceFile::Reader to honor file lengths and call 
openFile (cdouglas via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1028473 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-28 20:54:17 +00:00
Owen O'Malley
7afa9466f7 HADOOP-6991. Move testcase from mapreduce to common, since it tests 
SequenceFile.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1028430 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-28 19:00:38 +00:00
Hairong Kuang
f6a6c6e577 HADOOP-7009. MD5Hash provides a public factory method that creates an instance of MessageDigest. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1028427 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-28 18:49:39 +00:00
Thomas White
4be1688c53 HADOOP-6663. BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file. Contributed by Kang Xiao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1028390 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-28 17:16:59 +00:00
Eli Collins
c4e049e0ba HADOOP-7010. Typo in FileSystem.java. Contributed by Jingguo Yao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1028167 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-28 01:53:36 +00:00
Doug Cutting
0d8d3d03e4 HADOOP-7006. Fix 'fs -getmerge' command to not be a no-op. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1027748 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-26 21:15:36 +00:00
Thomas White
da234df25d HADOOP-6947. Kerberos relogin should set refreshKrb5Config to true. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1027654 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-26 17:04:51 +00:00
Thomas White
3d27eaad25 Reverting HADOOP-6663. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1027316 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-25 23:50:05 +00:00
Thomas White
17f9e57f7c HADOOP-6663. BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file. Contributed by Kang Xiao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1027312 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-25 23:34:18 +00:00
Giridharan Kesavan
768cf339f3 HADOOP-7007: Update the hudson-test-patch ant target. Contributed by Giridharan Kesavan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1027296 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-25 23:07:57 +00:00
Nigel Daley
217ce2dcf3 HADOOP-7005: Update test-patch.sh to remove callback to Hudson master. Contributed by nigel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1027235 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-25 18:59:28 +00:00
Hairong Kuang
13fcef246e HADOOP-6996. Allow CodecFactory to return a codec object given a codec' class name. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1022697 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-14 20:35:53 +00:00
Konstantin Boudnik
e050832c93 HADOOP-6944. [Herriot] Implement a functionality for getting proxy users 
definitions like groups and hosts. Contributed by Vinay Thota.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1006356 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-10 21:51:03 +00:00
Jakob Homan
5fe802ea0a HADOOP-6987. Use JUnit Rule to optionally fail test cases that run more than 10 seconds. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1005977 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-08 19:21:42 +00:00
Thomas White
a503521a2c HADOOP-6933. TestListFiles is flaky. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1005581 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-07 19:11:45 +00:00
Eli Collins
bf9fccca0c HADOOP-6993. Broken link on cluster setup page of docs. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1005545 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-07 17:54:18 +00:00
Owen O'Malley
5001565459 HADOOP-6984. Combine the compress kind and the codec in the same option 
for SequenceFiles. (cdouglas via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1004900 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-06 06:16:31 +00:00
Owen O'Malley
4bb06fbd0a HADOOP-6989. Correct the parameter for SetFile to set the value type 
for SetFile to be NullWritable instead of the key. (jghoman via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1004539 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-05 06:54:38 +00:00
Konstantin Boudnik
95649aca30 HADOOP-6879. Provide SSH based (Jsch) remote execution API for system tests. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1004118 13f79535-47bb-0310-9956-ffa450edef68
 2010-10-04 05:10:06 +00:00
Owen O'Malley
c7e1a1c4c1 HADOOP-6856. Simplify constructors for SequenceFile, and MapFile. (omalley) 
-- Missed some files


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1002940 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-30 03:13:29 +00:00
Owen O'Malley
6333b3e485 HADOOP-6856. Simplify constructors for SequenceFile, and MapFile. (omalley) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1002937 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-30 02:59:32 +00:00
Thomas White
642ed17a48 HADOOP-6951. Distinct minicluster services (e.g. NN and JT) overwrite each other's service policies. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1002896 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-29 23:49:32 +00:00
Devaraj Das
8db4b543b9 HADOOP-6965. Introduces checks for whether the original tgt is valid in the reloginFromKeytab method. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1002343 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-28 20:18:37 +00:00
Thomas White
47d4ebebac Reverting commit 1001067 while related HDFS and MR JIRAs are tested (HADOOP-6951). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1001127 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-25 02:41:10 +00:00
Thomas White
0fd49b3537 HADOOP-6951. Distinct minicluster services (e.g. NN and JT) overwrite each other's service policies. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1001067 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-24 20:48:59 +00:00
Vinod Kumar Vavilapalli
e9c1efd4cc HADOOP-6922. COMMON part of MAPREDUCE-1664. Makes AccessControlList a writable and updates documentation for Job ACLs. Contributed by Ravi Gummadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@998001 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-17 07:25:57 +00:00
Eli Collins
8a85347554 HADOOP-6940. RawLocalFileSystem's markSupported method misnamed markSupport. Contributed by Tom White. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@995285 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-08 23:47:28 +00:00
Sharad Agarwal
086223892e HADOOP-6930. AvroRpcEngine doesn't work with generated Avro code. Contributed by Sharad Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@993529 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-07 20:49:23 +00:00
Hairong Kuang
becf8e919a HADOOP-6938. ConnectionId.getRemotePrincipal() should check if security is enabled. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@992479 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-03 21:24:29 +00:00
Eli Collins
fa75e35f9e HADOOP-6934. Test for ByteWritable comparator. Contributed by Johannes Zillmann. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@991821 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-02 06:26:43 +00:00
Hairong Kuang
1c75bcc76b HADOOP-6907. Rpc client doesn't use the per-connection conf to figure out server's Kerberos principal. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@991780 13f79535-47bb-0310-9956-ffa450edef68
 2010-09-02 00:35:30 +00:00
Boris Shkolnik
5c8d9aecf7 HADOOP-6913. Circular initialization between UserGroupInformation and KerberosName 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@991038 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-31 00:10:05 +00:00
Boris Shkolnik
4f79b07e17 HADOOP-6932. Namenode start (init) fails because of invalid kerberos key, even when security set to simple 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@991030 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-30 23:42:17 +00:00
Konstantin Boudnik
a89fb4dcdc HADOOP-6786. test-patch needs to verify Herriot integrity. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@990681 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-30 01:31:56 +00:00
Tsz-wo Sze
7efb9640be HADOOP-6884. Add LOG.isDebugEnabled() guard for each LOG.debug(..). Contributed by Erik Steffl 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@990460 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-28 22:44:10 +00:00
Eli Collins
97ce72a97e HADOOP-6833. IPC leaks call parameters when exceptions thrown. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@989999 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-27 02:53:20 +00:00
Eli Collins
19e46e358e HADOOP-6925. BZip2Codec incorrectly implements read(). Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@988748 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-24 22:40:05 +00:00
Mahadev Konar
ad5306f24c HADOOP-6906. FileContext copy() utility doesn't work with recursive copying of directories. (vinod k v via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@987374 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-20 03:46:07 +00:00
Jakob Homan
0acb205a4b HADOOP-6482. GenericOptionsParser constructor that takes Options and String[] ignores options. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@986971 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-18 22:50:57 +00:00
Thomas White
f74a3e4f60 HADOOP-6803. Add native gzip read/write coverage to TestCodec. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@986964 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-18 21:57:18 +00:00
Jakob Homan
76e22cc8bf HADOOP-6885. Fix java doc warnings in Groups and RefreshUserMappingsProtocol. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@986961 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-18 21:50:11 +00:00
Suresh Srinivas
6fe92180fa HADOOP-6693. Add metrics to track kerberol login activity. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@986469 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-17 20:03:39 +00:00
Jakob Homan
9950db1817 HADOOP-6905. Better logging messages when a delegation token is invalid. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@986172 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-17 02:37:26 +00:00
Amareshwari Sri Ramadasu
4c940af714 HADOOP-6715. Fixes AccessControlList.toString() to return a descriptive String representation of the ACL. Contributed by Ravi Gummadi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@984652 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-12 06:34:53 +00:00
Hairong Kuang
dc2a3d1ca3 HADOOP-6900. Make the iterator returned by FileSystem#listLocatedStatus to throw IOException rather than RuntimeException when there is an IO error fetching the next file. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@984301 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-11 04:43:26 +00:00
Boris Shkolnik
ccbdfba7d1 HADOOP-6911. doc update for DelegationTokenFetcher 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@984250 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-10 22:35:15 +00:00
Amareshwari Sri Ramadasu
bd121ed635 HADOOP-6862. Adds api to add/remove user and group to AccessControlList. Contributed by Amareshwari Sriramadasu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@983877 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-10 08:10:40 +00:00
Hairong Kuang
714e5f7165 HADOOP-6889. Make RPC to have an option to timeout. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@982681 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-05 16:39:10 +00:00
Devaraj Das
c47d34a866 HADOOP-6706. Improves the sasl failure handling due to expired tickets, and other server detected failures. Contributed by Jitendra Pandey and Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@981714 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-03 00:51:57 +00:00
Jakob Homan
1035138b4c HADOOP-6892. Common component of HDFS-1150 (Verify datanodes' identities to clients in secure clusters). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@981688 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-02 21:10:21 +00:00
Hairong Kuang
666a8e1600 HADOOP-6890. Part 2: Incoport the change made in FileContext into FileSystem. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@981676 13f79535-47bb-0310-9956-ffa450edef68
 2010-08-02 20:25:44 +00:00
Hairong Kuang
d0ba178800 HADOOP-6890. Improve listFiles API introduced by HADOOP-6870. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980953 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-30 20:52:08 +00:00
Boris Shkolnik
c15ae29a90 HADOOP-6873. using delegation token over hftp for long running clients 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980648 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-30 04:55:23 +00:00
Tsz-wo Sze
ff8b7bc253 HADOOP-6888. Add a new FileSystem API closeAllForUGI(..) for closing all file systems associated with a particular UGI. Contributed by Kan Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980523 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-29 17:58:55 +00:00
Devaraj Das
1a6ed79ebf HADOOP-6656. Adds a thread in the UserGroupInformation to renew TGTs periodically. Contributed by Owen O'Malley and Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980518 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-29 17:29:51 +00:00
Hairong Kuang
19eea554e3 HADOOP-6870. Add a new API getFiles to FileSystem and FileContext. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980271 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-29 00:14:36 +00:00
Konstantin Boudnik
d010dd60e1 HADOOP-6869. Functionality to creating file or folder on a remote daemon side. Contributed by Vinay Thota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979942 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-28 03:19:02 +00:00
Jakob Homan
5c5c163aa3 HADOOP-6475. Adding some javadoc to Server.RpcMetrics, UGI. Contributed by Jitendra Pandey and borya. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979919 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-28 00:56:50 +00:00
Doug Cutting
ba54f8b7e7 HADOOP-6881. Make WritableComparator initialize classes when looking for their raw comparator, as classes often register raw comparators in their initializer, which are no longer automatically run in Java 6 when a class is referenced. Contributed by omalley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979485 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-26 23:17:05 +00:00
Jakob Homan
0d005c52ae HADOOP-6877. Common part of HDFS-1178. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979387 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-26 17:54:01 +00:00
Konstantin Boudnik
f22e332ddd HADOOP-6875. [Herriot] Cleanup of temp. configurations is needed upon restart of a cluster. Contributed by Vinay Thota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@967220 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-23 19:37:08 +00:00
Devaraj Das
eb10b152fe HADOOP-6861. Adds new non-static methods in Credentials to read and write token storage file. Contributed by Jitendra Pandey & Owen O'Malley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@966911 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-23 00:05:32 +00:00
Konstantin Boudnik
bd802429c1 HADOOP-6790. Instrumented (Herriot) build uses too wide mask to include aspect files. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@966508 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-22 05:48:10 +00:00
Amareshwari Sri Ramadasu
2c0598a964 HADOOP-6536. Fixes FileUtil.fullyDelete() not to delete the contents of the sym-linked directory. Contributed by Ravi Gummadi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@965725 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-20 05:21:56 +00:00
Devaraj Das
fa3a3bf5d8 HADOOP-6632. Adds support for using different keytabs for different servers in a Hadoop cluster. In the earier implementation, all servers of a certain type \(like TaskTracker\), would have the same keytab and the same principal. Now the principal name is a pattern that has _HOST in it. Contributed by Kan Zhang & Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@965696 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-20 00:46:19 +00:00
Boris Shkolnik
75e78e0484 HADOOP-6805. add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@965556 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-19 16:51:16 +00:00
Devaraj Das
02b87fc6b3 HADOOP-6670. Use the UserGroupInformation's Subject as the criteria for equals and hashCode. Contributed by Owen O'Malley and Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964993 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-17 01:42:22 +00:00
Konstantin Boudnik
44c364d632 HADOOP-6860. 'compile-fault-inject' should never be called directly. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964939 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-16 20:26:05 +00:00
Mahadev Konar
1b354e2bd5 HADOOP-6834. TFile.append compares initial key against null lastKey (hong tang via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964897 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-16 18:37:50 +00:00
Suresh Srinivas
0ac05814c2 HADOOP-6859 - Introduce additional statistics to FileSystem to track file system operations. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964689 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-16 06:07:06 +00:00
Konstantin Boudnik
7f14e37076 HADOOP-6836. [Herriot]: Generic method for adding/modifying the attributes for new configuration. Contributed by Vinay Thota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964134 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-14 18:48:35 +00:00
Konstantin Boudnik
a73dfef140 HADOOP-6839. [Herriot] Implement a functionality for getting the user list for creating proxy users. Contributed by Vinay Thota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964130 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-14 18:44:12 +00:00
Eli Collins
167bbd1c6e HADOOP-6825. FileStatus needs unit tests. Contributed by Rodrigo Schmidt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@963587 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-13 02:29:59 +00:00
Boris Shkolnik
6ba9b70d85 HADOOP-6647. balancer fails with "is not authorized for protocol interface NamenodeProtocol" in secure environment 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@963490 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-12 21:18:47 +00:00
Devaraj Das
4ff2991849 HADOOP-6648. Adds a check for null tokens in Credentials.addToken api. Contributed by Owen O'Malley and Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@962998 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-11 06:43:18 +00:00
Konstantin Boudnik
0ae9cbb3a4 HADOOP-6819. [Herriot] Shell command for getting the new exceptions in 
the logs returning exitcode 1 after executing successfully. Contributed
by Vinay Thota.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@962914 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-10 20:55:45 +00:00
Devaraj Das
d2ade6aec5 HADOOP-6845. Renames the TokenStorage class to Credentials. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@962677 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-09 20:07:45 +00:00
Jakob Homan
86e833858c HADOOP-6853. Common component of HDFS-1045. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@961911 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-08 20:02:29 +00:00
Konstantin Boudnik
038d399389 HADOOP-6847. Problem staging 0.21.0 artifacts to Apache Nexus Maven Repository. Contributed by Giridharan Kesavan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@961559 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-08 02:29:15 +00:00
Christopher Douglas
2a248dfc32 HADOOP-6835. Add support for concatenated gzip input. Contributed by Greg Roelofs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@961532 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-07 23:22:28 +00:00
Jakob Homan
4b34109a72 HADOOP-6584. Provide Kerberized SSL encryption for webservices. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@960137 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-03 00:02:03 +00:00
Konstantin Shvachko
05b1f87909 HADOOP-6756. Documentation for common configuration keys. Contributed by Erik Steffl. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@960079 13f79535-47bb-0310-9956-ffa450edef68
 2010-07-02 18:16:30 +00:00
Boris Shkolnik
8970e93b01 HADOOP-6815. refreshSuperUserGroupsConfiguration should use server side configuration for the refresh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@957074 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-22 23:04:33 +00:00
Thomas White
35a4624771 HADOOP-6826. Revert FileSystem create method that takes CreateFlags. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@956710 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-21 21:45:47 +00:00
Amareshwari Sri Ramadasu
4b8e1bda2d HADOOP-6748. Removes hadoop.cluster.administrators, cluster administrators acl is passed as parameter in constructor. Contributed by Amareshwari Sriramadasu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@955975 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-18 12:30:36 +00:00
Konstantin Boudnik
5807065a5b HADOOP-6828. Herrior uses old way of accessing logs directories. Contributed by Sreekanth Ramakrishnan 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@955438 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-17 01:34:08 +00:00
Thomas White
c6b8095b02 HADOOP-6821. Document changes to memory monitoring. Contributed by Hemanth Yamijala. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@954647 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-14 21:16:47 +00:00
Devaraj Das
e89ac4b077 HADOOP-6652. Removes the unnecessary cache from ShellBasedUnixGroupsMapping. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@954612 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-14 20:02:56 +00:00
Eli Collins
6749f0275c HADOOP-6796. Reverting the patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@954165 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-13 04:38:37 +00:00
Jakob Homan
687d4dbd1d HADOOP-6682. NetUtils:normalizeHostName does not process hostnames starting with [a-f] correctly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953929 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-12 02:12:16 +00:00
Devaraj Das
8fa094ad6a HADOOP-6613. Moves the RPC version check ahead of the AuthMethod check. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953910 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-12 00:13:15 +00:00
Jakob Homan
fbdb249460 HADOOP-6620. NPE if renewer is passed as null in getDelegationToken. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953896 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-11 22:48:15 +00:00
Thomas White
6378822a67 HADOOP-6668. Apply audience and stability annotations to classes in common. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953881 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-11 21:34:56 +00:00
Devaraj Das
755a5d8c9b HADOOP-6814. Adds an API in UserGroupInformation to get the real authentication method of a passed UGI. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953863 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-11 20:32:26 +00:00
Jakob Homan
754ea912b9 HADOOP-6603. Provide workaround for issue with Kerberos not resolving cross-realm principal. Contributed by Kan Zhang and Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953517 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-11 00:40:05 +00:00
Thomas White
222bd68293 HADOOP-6403. Deprecate EC2 bash scripts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953504 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-10 23:52:34 +00:00
Boris Shkolnik
f07af58599 HADOOP-6526. Need mapping from long principal names to local OS user names 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953388 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-10 16:54:06 +00:00
Eli Collins
b78612c4e2 HADOOP-6796. FileStatus allows null srcPath but crashes if that's done. Contributed by Rodrigo Schmidt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@953100 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-09 17:57:49 +00:00
Boris Shkolnik
2232093326 HADOOP-6813. Add a new newInstance method in FileSystem that takes a user as argument 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@952471 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-07 22:55:13 +00:00
Boris Shkolnik
42a38a4b58 HADOOP-6687. user object in the subject in UGI should be reused in case of a relogin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@952454 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-07 21:50:05 +00:00
Devaraj Das
4b9c956bc5 HADOOP-6674. Makes use of the SASL authentication options in the SASL RPC. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951624 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-05 00:34:36 +00:00
Boris Shkolnik
56b15e9e8f HADOOP-6649. login object in UGI should be inside the subject (jnp via boryas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951618 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-05 00:10:13 +00:00
Thomas White
ff1fe0803a HADOOP-6780. Move Hadoop cloud scripts to Whirr. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951597 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-04 22:24:53 +00:00
Thomas White
ea5200d922 HADOOP-6738. Move cluster_setup.xml, hod_scheduler, commands_manual from MapReduce to Common. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951480 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-04 16:34:18 +00:00
Konstantin Boudnik
04a00b74f5 HADOOP-6788. [Herriot] Exception exclusion functionality is not working 
correctly. Contributed by Vinay Kumar Thota.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951259 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-04 04:10:17 +00:00
Jakob Homan
908fd4506f HADOOP-6661. User document for UserGroupInformation.doAs. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951227 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-04 00:41:13 +00:00
Eli Collins
c6bc36580a HADOOP-6787. Factor out glob pattern code from FileContext and FileSystem. Contributed by Luke Lu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951207 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-03 23:39:33 +00:00
Boris Shkolnik
9e2c3bf9ed HADOOP-6791. Refresh for proxy superuser config 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951081 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-03 17:32:35 +00:00
Thomas White
da60eca889 HADOOP-6461. Webapps aren't located correctly post-split. Contributed by Todd Lipcon and Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@950605 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-02 15:43:51 +00:00
Thomas White
7578282edc HADOOP-6585. Add FileStatus#isDirectory and isFile. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@949658 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-31 03:14:18 +00:00
Jakob Homan
aecf7afba6 HADOOP-6747. TestNetUtils fails on Mac OS X (Todd Lipcon via jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@949330 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-29 00:49:54 +00:00
Thomas White
9dd25df80e HADOOP-6404. Rename the generated artifacts to common instead of core. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@949032 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-27 22:46:48 +00:00
Jakob Homan
24a2f1fafe HADOOP-6581. Add authenticated TokenIdentifiers to UGI so that they can be used for authorization. Kan Zhang and Jitendra Pandey via jghoman. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948573 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-26 20:31:48 +00:00
Boris Shkolnik
e346c2f4e0 HADOOP-6644. util.Shell getGROUPS_FOR_USER_COMMAND method name - should use common naming convention 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948528 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-26 18:35:50 +00:00
Boris Shkolnik
a7aacdc2d6 HADOOP6638. try to relogin in a case of failed RPC connection (expired tgt) only in case the subject is loginUser or proxyUgi.realUser. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948523 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-26 18:29:30 +00:00
Konstantin Boudnik
73643f4211 HADOOP-6777. Implement a functionality for suspend and resume a process. Contributed by Vinay Thota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948242 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-25 23:00:40 +00:00
Konstantin Boudnik
5392319a24 HADOOP-6772. Utilities for system tests specific. Contributed by Vinay Thota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948237 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-25 22:54:40 +00:00
Konstantin Boudnik
8a98e683ed HADOOP-6771. Herriot's artifact id for Maven deployment should be set to 
hadoop-core-instrumented. Contributed by Konstantin Boudnik.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@947882 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-25 01:00:14 +00:00
Thomas White
2786e80436 HADOOP-6723. Unchecked exceptions thrown in IPC Connection should not orphan clients. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@947747 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-24 18:24:16 +00:00
Konstantin Boudnik
4e5bdc46bc HADOOP-6760. WebServer shouldn't increase port number in case of 
negative port setting caused by Jetty's race. Contributed by Konstantin
Boudnik.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@947218 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-22 00:27:05 +00:00
Boris Shkolnik
ec1a112a1d HADOOP-6778. add isRunning() method to AbstractDelegationTokenSecretManager (for HDFS-1044) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@947203 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-21 22:21:13 +00:00
Christopher Douglas
af3fef3463 HADOOP-6714. Resolve compressed files using CodecFactory in FsShell::text. Contributed by Patrick Angeles 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@946976 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-21 11:45:12 +00:00
Boris Shkolnik
f4998a7813 HADOOP-6781. security audit log shouldn't have exception in it. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@946815 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-20 23:11:08 +00:00
Boris Shkolnik
78778a158c HADOOP-6633. normalize property names for JT/NN kerberos principal names in configuration 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@946487 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-20 00:03:22 +00:00
Konstantin Boudnik
578ea5580f HADOOP-6752. Remote cluster control functionality needs JavaDocs improvement. Contributed by Balaji Rajagopalan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@945949 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-18 23:16:20 +00:00
Boris Shkolnik
0b14427e6c HADOOP-6627. 'Bad Connection to FS' message in FSShell should print message from the exception 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@945940 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-18 22:38:07 +00:00
Boris Shkolnik
759494f3a1 HADOOP-6769. Add an API in FileSystem to get FileSystem instances based on users 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@945735 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-18 16:21:24 +00:00
Dhruba Borthakur
175a92850d HADOOP-6761. The Trash Emptier has the ability to run more frequently. 
(Dmytro Molkov via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@945439 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-17 23:51:56 +00:00
Konstantin Boudnik
69693b6a86 HADOOP-6332. Large-scale Automated Test Framework. Contributed by Sharad Agarwal, Sreekanth Ramakrishnan, Konstantin Boudnik, at all. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@944521 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-14 23:56:34 +00:00
Boris Shkolnik
1e15cf0355 HADOOP-6612. Protocols RefreshUserToGroupMappingsProtocol and RefreshAuthorizationPolicyProtocol will fail with security enabled (boryas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@944397 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-14 19:00:18 +00:00
Boris Shkolnik
d9b6103f8f HADOOP-6600. mechanism for authorization check for inter-server protocols 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@944012 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-13 20:52:59 +00:00
Boris Shkolnik
21476f0b09 HADOOP-6763. Remove verbose logging from the Groups class 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@944009 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-13 20:44:52 +00:00
Sharad Agarwal
44ebf5db23 HADOOP-6631. Fix FileUtil.fullyDelete() to continue deleting other files despite failure at any level. Contributed by Ravi Gummadi and Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@941662 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-06 11:18:12 +00:00
Thomas White
fe34ccdda8 HADOOP-6623. Add StringUtils.split for non-escaped single-character separator. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@941508 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-05 21:46:31 +00:00
Christopher Douglas
06a13750a5 HADOOP-6669. Respect compression configuration when creating DefaultCodec 
instances. Contributed by Koji Noguchi


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940989 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-04 18:21:48 +00:00
Thomas White
322f9ac7b1 HADOOP-6727. Remove UnresolvedLinkException from public FileContext APIs. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940527 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-03 17:36:07 +00:00
Jakob Homan
fe49f6e473 HADOOP-6730. Bug in FileContext#copy and provide base class for FileContext tests. (Ravi Phulari via jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940112 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-01 21:08:34 +00:00
Thomas White
14f02ef0f5 Preparing for 0.22.0 development 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939917 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-01 04:53:36 +00:00
Thomas White
494ef1e48c HADOOP-6742. Add methods HADOOP-6709 from to TestFilterFileSystem. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939864 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-30 22:49:08 +00:00
Suresh Srinivas
704e919a9b HADOOP-6563. Add more symlink tests to cover intermediate symlinks in paths. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939827 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-30 21:40:56 +00:00
Zheng Shao
f6acb32e06 HADOOP-6515. Make maximum number of http threads configurable (Scott Chen via zshao) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939486 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 21:32:54 +00:00
Thomas White
b56827c591 HADOOP-6709. Re-instate deprecated FileSystem methods that were removed after 0.20. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939470 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 19:55:44 +00:00
Thomas White
750fb2dbc1 HADOOP-6698. Revert the io.serialization package to 0.20.2's api. Reverted HADOOP-6165, HADOOP-6443, HADOOP-6323, and HADOOP-6420. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939412 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 18:09:56 +00:00
Sharad Agarwal
00cb892150 HADOOP-6634. Fix AccessControlList to use short names to verify access control. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939242 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 09:31:30 +00:00
Hairong Kuang
8991eb7959 HADOOP-6678. Remove FileContext#isFile, isDirectory and exists. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939140 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 23:58:25 +00:00
Thomas White
c59b4cd966 HADOOP-6722. NetUtils.connect should check that it hasn't connected a socket to itself. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939026 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:46:06 +00:00
Thomas White
cd85fc46dc HADOOP-6724. IPC doesn't properly handle IOEs thrown by socket factory. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939018 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:34:55 +00:00
Suresh Srinivas
d2ca51b859 HADOOP-6701. Fix incorrect exit codes returned from chgrp, chown and chgrp commands from FsShell. Contributed by Ravi Phulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939016 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:27:01 +00:00
Suresh Srinivas
e333072144 HADOOP-6703. Prevent renaming a file, directory or symbolic link to itself. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938788 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 05:45:40 +00:00
Hairong Kuang
b212ed99c5 HADOOP-6713. The RPC server Listener thread is a scalability bottleneck. Contributed by Dmytro Molkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938590 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 18:13:12 +00:00
Thomas White
9ad633f011 HADOOP-6677. InterfaceAudience.LimitedPrivate should take a string not an enum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938563 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 16:53:40 +00:00
Thomas White
2bec54de58 HADOOP-6667. RPC.waitForProxy should retry through NoRouteToHostException. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938322 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 04:38:23 +00:00
Hairong Kuang
33e3f7949b HADOOP-6692. Add FileContext#listStatus that returns an iterator. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938136 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-26 17:32:17 +00:00
Jakob Homan
5075d7dbde HADOOP-6717. Log levels in o.a.h.security.Groups too high. Todd Lipcon via jghoman. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937881 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-25 21:23:30 +00:00
Suresh Srinivas
27a9fce10d HADOOP-6710. Symbolic umask for file creation is not conformant with posix. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937577 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-24 02:04:20 +00:00
Suresh Srinivas
67c006c322 HADOOP-6521. User specified umask using deprecated dfs.umask must override server configured using new dfs.umaskmode for backward compatibility. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937559 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-24 00:01:27 +00:00
Suresh Srinivas
50f24d774e HADOOP-6686. Remove redundant exception class name from the exception message for the exceptions thrown at RPC client. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937183 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-23 08:05:30 +00:00
Dhruba Borthakur
1e82194428 HADOOP-6719. Insert all missing methods in FilterFs. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937093 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 22:47:44 +00:00
Dhruba Borthakur
b183665c7f HADOOP-6690. FilterFileSystem correctly handles setTimes call. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937092 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 22:40:23 +00:00
Thomas White
980f99bfb7 HADOOP-6658. Exclude Private elements from generated Javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937052 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 20:48:04 +00:00
Hemanth Yamijala
97c38f94f5 HADOOP-6439. Fixes handling of deprecated keys to follow order in which keys are defined. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@936463 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-21 19:32:32 +00:00
Steve Loughran
6f89a64657 HADOOP-6657. Add a capitalization method to StringUtils for MAPREDUCE-1545 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@934619 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-15 22:06:52 +00:00
Giridharan Kesavan
a0ef69df26 HADOOP-6705. Fix to work with 1.5 version of jiracli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@934273 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-15 03:08:09 +00:00
Boris Shkolnik
b802476d9d HADOOP-6580. UGI should contain authentication method. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933810 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-13 23:01:43 +00:00
Suresh Srinivas
87c788d2e1 HADOOP-6689. Add directory renaming test to existing FileContext tests. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933705 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-13 17:00:26 +00:00
Thomas White
631f45618d HADOOP-6507. Hadoop Common Docs - delete 3 doc files that do not belong under Common. Contributed by Corinne Chandel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933406 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-12 20:57:27 +00:00
Hairong Kuang
fb154e3a03 HADOOP-6691. TestFileSystemCaching sometimes hangs. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@932115 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-08 21:13:58 +00:00
Thomas White
4c062c79c3 HADOOP-6680. hadoop-cloud push command invokes proxy creation. Contributed by Andrew Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@931226 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-06 17:05:11 +00:00
Hairong Kuang
7b1ac5ac13 HADOOP-6640. FileSystem.get() does RPC retries within a static synchronized block. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@930096 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-01 20:58:10 +00:00
Tsz-wo Sze
6f35c10aab HADOOP-6654. Fix code example in WritableComparable javadoc. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927979 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-26 17:38:47 +00:00
Christopher Douglas
f4d31cd029 HADOOP-6566. Add methods supporting, enforcing narrower permissions on local daemon directories. 
Contributed by Arun Murthy and Luke Lu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927728 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-26 08:25:00 +00:00
Mahadev Konar
980f819047 HADOOP-6646. Move HarfileSystem out of Hadoop Common. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927193 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-24 21:43:24 +00:00
Mahadev Konar
e381af1e1e HADOOP-6645. Re: Bugs on listStatus for HarFileSystem (rodrigo via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927134 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-24 17:51:38 +00:00
Mahadev Konar
35de12b8ed HADOOP-6645. Bugs on listStatus for HarFileSystem (rodrigo via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926421 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-23 01:16:03 +00:00
Thomas White
0485fe23ba HADOOP-6471. StringBuffer -> StringBuilder - conversion of references as necessary. Contributed by Kay Kay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926256 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-22 19:08:03 +00:00
Thomas White
124137ff01 HADOOP-6175. Incorrect version compilation with es_ES.ISO8859-15 locale on Solaris 10. Contributed by Urko Benito. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926252 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-22 18:46:44 +00:00
Konstantin Shvachko
81c448ae85 HADOOP-6637. Benchmark for establishing RPC session. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925528 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-20 02:17:38 +00:00
Thomas White
f32ffc750a HADOOP-6593. TextRecordInputStream doesn't close SequenceFile.Reader. Contributed by Chase Bradford. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925487 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 23:52:51 +00:00
Thomas White
c8ffb2249a HADOOP-6546. BloomMapFile can return false negatives. Contributed by Clark Jefcoat. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925479 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 23:19:13 +00:00
Thomas White
a0a4bf08d3 HADOOP-3659. Patch to allow hadoop native to compile on Mac OS X. Contributed by Colin Evans and Allen Wittenauer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925468 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 22:51:29 +00:00
Dhruba Borthakur
637cf89e18 HADOOP-6591. HarFileSystem can handle paths with the whitespace characters. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@923619 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-16 08:03:38 +00:00
Thomas White
74d409c4bb HADOOP-6486. fix common classes to work with Avro 1.3 reflection. Contributed by cutting. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921577 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-10 21:24:13 +00:00
Thomas White
fe01f920a1 HADOOP-6504. Invalid example in the documentation of org.apache.hadoop.util.Tool. Contributed by Benoit Sigoure. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921542 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-10 20:06:07 +00:00
Owen O'Malley
b1ec35e60c HADOOP-6609. Fixed deadlock in RPC by replacing shared static 
DataOutputBuffer in the UTF8 class with a thread local variable. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918880 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-04 07:20:29 +00:00
Hairong Kuang
393baff732 HADOOP-6569. FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918624 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-03 18:49:26 +00:00