big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
538 Commits 2 Branches 2 Tags 264 MiB
a42c891055
Commit Graph

451 Commits

Author SHA1 Message Date
Boris Shkolnik
42a38a4b58 HADOOP-6687. user object in the subject in UGI should be reused in case of a relogin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@952454 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-07 21:50:05 +00:00
Devaraj Das
4b9c956bc5 HADOOP-6674. Makes use of the SASL authentication options in the SASL RPC. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951624 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-05 00:34:36 +00:00
Boris Shkolnik
56b15e9e8f HADOOP-6649. login object in UGI should be inside the subject (jnp via boryas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951618 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-05 00:10:13 +00:00
Thomas White
ff1fe0803a HADOOP-6780. Move Hadoop cloud scripts to Whirr. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951597 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-04 22:24:53 +00:00
Thomas White
ea5200d922 HADOOP-6738. Move cluster_setup.xml, hod_scheduler, commands_manual from MapReduce to Common. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951480 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-04 16:34:18 +00:00
Konstantin Boudnik
04a00b74f5 HADOOP-6788. [Herriot] Exception exclusion functionality is not working 
correctly. Contributed by Vinay Kumar Thota.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951259 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-04 04:10:17 +00:00
Jakob Homan
908fd4506f HADOOP-6661. User document for UserGroupInformation.doAs. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951227 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-04 00:41:13 +00:00
Eli Collins
c6bc36580a HADOOP-6787. Factor out glob pattern code from FileContext and FileSystem. Contributed by Luke Lu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951207 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-03 23:39:33 +00:00
Boris Shkolnik
9e2c3bf9ed HADOOP-6791. Refresh for proxy superuser config 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@951081 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-03 17:32:35 +00:00
Thomas White
da60eca889 HADOOP-6461. Webapps aren't located correctly post-split. Contributed by Todd Lipcon and Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@950605 13f79535-47bb-0310-9956-ffa450edef68
 2010-06-02 15:43:51 +00:00
Thomas White
7578282edc HADOOP-6585. Add FileStatus#isDirectory and isFile. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@949658 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-31 03:14:18 +00:00
Jakob Homan
aecf7afba6 HADOOP-6747. TestNetUtils fails on Mac OS X (Todd Lipcon via jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@949330 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-29 00:49:54 +00:00
Thomas White
9dd25df80e HADOOP-6404. Rename the generated artifacts to common instead of core. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@949032 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-27 22:46:48 +00:00
Jakob Homan
24a2f1fafe HADOOP-6581. Add authenticated TokenIdentifiers to UGI so that they can be used for authorization. Kan Zhang and Jitendra Pandey via jghoman. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948573 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-26 20:31:48 +00:00
Boris Shkolnik
e346c2f4e0 HADOOP-6644. util.Shell getGROUPS_FOR_USER_COMMAND method name - should use common naming convention 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948528 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-26 18:35:50 +00:00
Boris Shkolnik
a7aacdc2d6 HADOOP6638. try to relogin in a case of failed RPC connection (expired tgt) only in case the subject is loginUser or proxyUgi.realUser. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948523 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-26 18:29:30 +00:00
Konstantin Boudnik
73643f4211 HADOOP-6777. Implement a functionality for suspend and resume a process. Contributed by Vinay Thota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948242 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-25 23:00:40 +00:00
Konstantin Boudnik
5392319a24 HADOOP-6772. Utilities for system tests specific. Contributed by Vinay Thota. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@948237 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-25 22:54:40 +00:00
Konstantin Boudnik
8a98e683ed HADOOP-6771. Herriot's artifact id for Maven deployment should be set to 
hadoop-core-instrumented. Contributed by Konstantin Boudnik.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@947882 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-25 01:00:14 +00:00
Thomas White
2786e80436 HADOOP-6723. Unchecked exceptions thrown in IPC Connection should not orphan clients. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@947747 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-24 18:24:16 +00:00
Konstantin Boudnik
4e5bdc46bc HADOOP-6760. WebServer shouldn't increase port number in case of 
negative port setting caused by Jetty's race. Contributed by Konstantin
Boudnik.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@947218 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-22 00:27:05 +00:00
Boris Shkolnik
ec1a112a1d HADOOP-6778. add isRunning() method to AbstractDelegationTokenSecretManager (for HDFS-1044) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@947203 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-21 22:21:13 +00:00
Christopher Douglas
af3fef3463 HADOOP-6714. Resolve compressed files using CodecFactory in FsShell::text. Contributed by Patrick Angeles 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@946976 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-21 11:45:12 +00:00
Boris Shkolnik
f4998a7813 HADOOP-6781. security audit log shouldn't have exception in it. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@946815 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-20 23:11:08 +00:00
Boris Shkolnik
78778a158c HADOOP-6633. normalize property names for JT/NN kerberos principal names in configuration 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@946487 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-20 00:03:22 +00:00
Konstantin Boudnik
578ea5580f HADOOP-6752. Remote cluster control functionality needs JavaDocs improvement. Contributed by Balaji Rajagopalan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@945949 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-18 23:16:20 +00:00
Boris Shkolnik
0b14427e6c HADOOP-6627. 'Bad Connection to FS' message in FSShell should print message from the exception 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@945940 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-18 22:38:07 +00:00
Boris Shkolnik
759494f3a1 HADOOP-6769. Add an API in FileSystem to get FileSystem instances based on users 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@945735 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-18 16:21:24 +00:00
Dhruba Borthakur
175a92850d HADOOP-6761. The Trash Emptier has the ability to run more frequently. 
(Dmytro Molkov via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@945439 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-17 23:51:56 +00:00
Konstantin Boudnik
69693b6a86 HADOOP-6332. Large-scale Automated Test Framework. Contributed by Sharad Agarwal, Sreekanth Ramakrishnan, Konstantin Boudnik, at all. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@944521 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-14 23:56:34 +00:00
Boris Shkolnik
1e15cf0355 HADOOP-6612. Protocols RefreshUserToGroupMappingsProtocol and RefreshAuthorizationPolicyProtocol will fail with security enabled (boryas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@944397 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-14 19:00:18 +00:00
Boris Shkolnik
d9b6103f8f HADOOP-6600. mechanism for authorization check for inter-server protocols 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@944012 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-13 20:52:59 +00:00
Boris Shkolnik
21476f0b09 HADOOP-6763. Remove verbose logging from the Groups class 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@944009 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-13 20:44:52 +00:00
Sharad Agarwal
44ebf5db23 HADOOP-6631. Fix FileUtil.fullyDelete() to continue deleting other files despite failure at any level. Contributed by Ravi Gummadi and Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@941662 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-06 11:18:12 +00:00
Thomas White
fe34ccdda8 HADOOP-6623. Add StringUtils.split for non-escaped single-character separator. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@941508 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-05 21:46:31 +00:00
Christopher Douglas
06a13750a5 HADOOP-6669. Respect compression configuration when creating DefaultCodec 
instances. Contributed by Koji Noguchi


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940989 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-04 18:21:48 +00:00
Thomas White
322f9ac7b1 HADOOP-6727. Remove UnresolvedLinkException from public FileContext APIs. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940527 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-03 17:36:07 +00:00
Jakob Homan
fe49f6e473 HADOOP-6730. Bug in FileContext#copy and provide base class for FileContext tests. (Ravi Phulari via jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@940112 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-01 21:08:34 +00:00
Thomas White
14f02ef0f5 Preparing for 0.22.0 development 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939917 13f79535-47bb-0310-9956-ffa450edef68
 2010-05-01 04:53:36 +00:00
Thomas White
494ef1e48c HADOOP-6742. Add methods HADOOP-6709 from to TestFilterFileSystem. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939864 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-30 22:49:08 +00:00
Suresh Srinivas
704e919a9b HADOOP-6563. Add more symlink tests to cover intermediate symlinks in paths. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939827 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-30 21:40:56 +00:00
Zheng Shao
f6acb32e06 HADOOP-6515. Make maximum number of http threads configurable (Scott Chen via zshao) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939486 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 21:32:54 +00:00
Thomas White
b56827c591 HADOOP-6709. Re-instate deprecated FileSystem methods that were removed after 0.20. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939470 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 19:55:44 +00:00
Thomas White
750fb2dbc1 HADOOP-6698. Revert the io.serialization package to 0.20.2's api. Reverted HADOOP-6165, HADOOP-6443, HADOOP-6323, and HADOOP-6420. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939412 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 18:09:56 +00:00
Sharad Agarwal
00cb892150 HADOOP-6634. Fix AccessControlList to use short names to verify access control. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939242 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-29 09:31:30 +00:00
Hairong Kuang
8991eb7959 HADOOP-6678. Remove FileContext#isFile, isDirectory and exists. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939140 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 23:58:25 +00:00
Thomas White
c59b4cd966 HADOOP-6722. NetUtils.connect should check that it hasn't connected a socket to itself. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939026 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:46:06 +00:00
Thomas White
cd85fc46dc HADOOP-6724. IPC doesn't properly handle IOEs thrown by socket factory. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939018 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:34:55 +00:00
Suresh Srinivas
d2ca51b859 HADOOP-6701. Fix incorrect exit codes returned from chgrp, chown and chgrp commands from FsShell. Contributed by Ravi Phulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@939016 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 17:27:01 +00:00
Suresh Srinivas
e333072144 HADOOP-6703. Prevent renaming a file, directory or symbolic link to itself. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938788 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-28 05:45:40 +00:00
Hairong Kuang
b212ed99c5 HADOOP-6713. The RPC server Listener thread is a scalability bottleneck. Contributed by Dmytro Molkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938590 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 18:13:12 +00:00
Thomas White
9ad633f011 HADOOP-6677. InterfaceAudience.LimitedPrivate should take a string not an enum. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938563 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 16:53:40 +00:00
Thomas White
2bec54de58 HADOOP-6667. RPC.waitForProxy should retry through NoRouteToHostException. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938322 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-27 04:38:23 +00:00
Hairong Kuang
33e3f7949b HADOOP-6692. Add FileContext#listStatus that returns an iterator. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@938136 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-26 17:32:17 +00:00
Jakob Homan
5075d7dbde HADOOP-6717. Log levels in o.a.h.security.Groups too high. Todd Lipcon via jghoman. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937881 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-25 21:23:30 +00:00
Suresh Srinivas
27a9fce10d HADOOP-6710. Symbolic umask for file creation is not conformant with posix. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937577 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-24 02:04:20 +00:00
Suresh Srinivas
67c006c322 HADOOP-6521. User specified umask using deprecated dfs.umask must override server configured using new dfs.umaskmode for backward compatibility. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937559 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-24 00:01:27 +00:00
Suresh Srinivas
50f24d774e HADOOP-6686. Remove redundant exception class name from the exception message for the exceptions thrown at RPC client. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937183 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-23 08:05:30 +00:00
Dhruba Borthakur
1e82194428 HADOOP-6719. Insert all missing methods in FilterFs. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937093 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 22:47:44 +00:00
Dhruba Borthakur
b183665c7f HADOOP-6690. FilterFileSystem correctly handles setTimes call. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937092 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 22:40:23 +00:00
Thomas White
980f99bfb7 HADOOP-6658. Exclude Private elements from generated Javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@937052 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-22 20:48:04 +00:00
Hemanth Yamijala
97c38f94f5 HADOOP-6439. Fixes handling of deprecated keys to follow order in which keys are defined. Contributed by V.V.Chaitanya Krishna. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@936463 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-21 19:32:32 +00:00
Steve Loughran
6f89a64657 HADOOP-6657. Add a capitalization method to StringUtils for MAPREDUCE-1545 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@934619 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-15 22:06:52 +00:00
Giridharan Kesavan
a0ef69df26 HADOOP-6705. Fix to work with 1.5 version of jiracli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@934273 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-15 03:08:09 +00:00
Boris Shkolnik
b802476d9d HADOOP-6580. UGI should contain authentication method. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933810 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-13 23:01:43 +00:00
Suresh Srinivas
87c788d2e1 HADOOP-6689. Add directory renaming test to existing FileContext tests. Contributed by Eli Collins. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933705 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-13 17:00:26 +00:00
Thomas White
631f45618d HADOOP-6507. Hadoop Common Docs - delete 3 doc files that do not belong under Common. Contributed by Corinne Chandel. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@933406 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-12 20:57:27 +00:00
Hairong Kuang
fb154e3a03 HADOOP-6691. TestFileSystemCaching sometimes hangs. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@932115 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-08 21:13:58 +00:00
Thomas White
4c062c79c3 HADOOP-6680. hadoop-cloud push command invokes proxy creation. Contributed by Andrew Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@931226 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-06 17:05:11 +00:00
Hairong Kuang
7b1ac5ac13 HADOOP-6640. FileSystem.get() does RPC retries within a static synchronized block. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@930096 13f79535-47bb-0310-9956-ffa450edef68
 2010-04-01 20:58:10 +00:00
Tsz-wo Sze
6f35c10aab HADOOP-6654. Fix code example in WritableComparable javadoc. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927979 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-26 17:38:47 +00:00
Christopher Douglas
f4d31cd029 HADOOP-6566. Add methods supporting, enforcing narrower permissions on local daemon directories. 
Contributed by Arun Murthy and Luke Lu


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927728 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-26 08:25:00 +00:00
Mahadev Konar
980f819047 HADOOP-6646. Move HarfileSystem out of Hadoop Common. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927193 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-24 21:43:24 +00:00
Mahadev Konar
e381af1e1e HADOOP-6645. Re: Bugs on listStatus for HarFileSystem (rodrigo via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@927134 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-24 17:51:38 +00:00
Mahadev Konar
35de12b8ed HADOOP-6645. Bugs on listStatus for HarFileSystem (rodrigo via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926421 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-23 01:16:03 +00:00
Thomas White
0485fe23ba HADOOP-6471. StringBuffer -> StringBuilder - conversion of references as necessary. Contributed by Kay Kay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926256 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-22 19:08:03 +00:00
Thomas White
124137ff01 HADOOP-6175. Incorrect version compilation with es_ES.ISO8859-15 locale on Solaris 10. Contributed by Urko Benito. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@926252 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-22 18:46:44 +00:00
Konstantin Shvachko
81c448ae85 HADOOP-6637. Benchmark for establishing RPC session. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925528 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-20 02:17:38 +00:00
Thomas White
f32ffc750a HADOOP-6593. TextRecordInputStream doesn't close SequenceFile.Reader. Contributed by Chase Bradford. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925487 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 23:52:51 +00:00
Thomas White
c8ffb2249a HADOOP-6546. BloomMapFile can return false negatives. Contributed by Clark Jefcoat. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925479 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 23:19:13 +00:00
Thomas White
a0a4bf08d3 HADOOP-3659. Patch to allow hadoop native to compile on Mac OS X. Contributed by Colin Evans and Allen Wittenauer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@925468 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-19 22:51:29 +00:00
Dhruba Borthakur
637cf89e18 HADOOP-6591. HarFileSystem can handle paths with the whitespace characters. 
(Rodrigo Schmidt via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@923619 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-16 08:03:38 +00:00
Thomas White
74d409c4bb HADOOP-6486. fix common classes to work with Avro 1.3 reflection. Contributed by cutting. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921577 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-10 21:24:13 +00:00
Thomas White
fe01f920a1 HADOOP-6504. Invalid example in the documentation of org.apache.hadoop.util.Tool. Contributed by Benoit Sigoure. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@921542 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-10 20:06:07 +00:00
Owen O'Malley
b1ec35e60c HADOOP-6609. Fixed deadlock in RPC by replacing shared static 
DataOutputBuffer in the UTF8 class with a thread local variable. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918880 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-04 07:20:29 +00:00
Hairong Kuang
393baff732 HADOOP-6569. FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918624 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-03 18:49:26 +00:00
Sanjay Radia
1ab5aa5279 HADOOP-6537 Declare more detailed exceptions in FileContext and AbstractFileSystem 
(Suresh Srinivas via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@918309 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-03 02:48:49 +00:00
Sanjay Radia
6b9fb8c78b HADOOP-6599 Split existing RpcMetrics into RpcMetrics & RpcDetailedMetrics. 
(Suresh Srinivas via Sanjay Radia)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@917737 13f79535-47bb-0310-9956-ffa450edef68
 2010-03-01 21:36:23 +00:00
Owen O'Malley
c93a9128ff HADOOP-6589. Provide better error messages when RPC authentication fails. 
(Kan Zhang via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916915 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-27 06:17:00 +00:00
Boris Shkolnik
c4c122a0de HADOOP-6586. Log authentication and authorization failures and successes for RPC 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916779 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-26 18:35:54 +00:00
Konstantin Shvachko
ea650d8d6c HADOOP-1849. Add undocumented configuration parameter for per handler call queue size in IPC Server. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916529 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-26 01:37:57 +00:00
Konstantin Shvachko
27ab7f3db9 HADOOP-6573. Support for persistent delegation tokens. Contributed by Jitendra Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916468 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 21:43:20 +00:00
Devaraj Das
7785232da5 HADOOP-6568. Adds authorization for the default servlets. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916467 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 21:39:38 +00:00
Owen O'Malley
37214591e9 HADOOP-6596. Add a version field to the AbstractDelegationTokenIdentifier's 
serialized value. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916390 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 18:34:05 +00:00
Owen O'Malley
831da66493 HADOOP-6579. Provide a mechanism for encoding/decoding Tokens from 
a url-safe string and change the commons-code library to 1.4. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@916290 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-25 14:14:18 +00:00
Tsz-wo Sze
4eedc77275 HADOOP-6467. Improve the performance on HarFileSystem.listStatus(..). Contributed by mahadev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915168 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-23 03:54:14 +00:00
Devaraj Das
c5622e5d4d HADOOP-6543. Allows secure clients to talk to unsecure clusters. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915097 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-22 22:28:29 +00:00
Devaraj Das
ffdde40b9f HADOOP-6583. Captures authentication and authorization metrics. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@915095 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-22 22:26:03 +00:00
Devaraj Das
115ef5b8c7 HADOOP-6545. Changes the Key for the FileSystem cache to be UGI. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912207 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 20:13:26 +00:00
Suresh Srinivas
9871771bb5 HADOOP-6577. Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@912056 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-20 01:23:26 +00:00
Devaraj Das
d099c1c78a HADOOP-6572. Makes sure that SASL encryption and push to responder queue for the RPC response happens atomically. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911748 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 09:04:47 +00:00
Owen O'Malley
a417a8faea HADOOP-6551. Delegation token renewing and cancelling should provide 
meaningful exceptions when there are failures instead of returning 
false. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911743 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-19 08:49:22 +00:00
Tsz-wo Sze
50dcc335be HADOOP-6558. Return null in HarFileSystem.getFileChecksum(..) since no checksum algorithm is implemented. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911646 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-18 23:22:52 +00:00
Hairong Kuang
4b4e9d741e HADOOP-6570. RPC#stopProxy throws NPE if getProxyEngine(proxy) returns null. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@911134 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-17 18:22:40 +00:00
Boris Shkolnik
3a7841aeb8 HADOOP-6549. TestDoAsEffectiveUser should use ip address of the host for superuser ip check 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910741 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:46:36 +00:00
Tsz-wo Sze
18c6d65749 HADOOP-6560. Handle invalid har:// uri in HarFileSystem. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910726 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 22:17:54 +00:00
Sanjay Radia
ea605b8cd7 HADOOP-6421 Adds Symbolic links to FileContext, AbstractFileSystem. 
It also adds a limited implementation for the local file system
     (RawLocalFs) that allows local symlinks. (Eli Collins via Sanjay Radia)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910706 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-16 21:43:30 +00:00
Devaraj Das
8b4b190cbd HADOOP-6559. Makes the RPC client automatically re-login when the SASL connection setup fails. This is applicable only to keytab based logins. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@910169 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-15 07:28:17 +00:00
Christopher Douglas
96a1477d02 HADOOP-6534. Trim whitespace from directory lists initializing 
LocalDirAllocator. Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909806 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:46:38 +00:00
Christopher Douglas
fc83909c3f HADOOP-6548. Replace mortbay imports with commons logging. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@909802 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-13 12:21:26 +00:00
Doug Cutting
8061821ca2 HADOOP-6522. Fix decoding of codepoint zero in UTF8. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908661 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 21:58:11 +00:00
Devaraj Das
cfbdd1aff4 HADOOP-6552. Puts renewTGT=true and useTicketCache=true for the keytab kerberos options. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@908353 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-10 05:01:27 +00:00
Owen O'Malley
38c59c0af7 HADOOP-6547. Move DelegationToken into Common, so that it can be used by 
MapReduce also. (devaraj via omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907956 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 08:10:37 +00:00
Thomas White
5b0d8a0162 HADOOP-6540. Contrib unit tests have invalid XML for core-site, etc. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907939 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-09 06:03:59 +00:00
Devaraj Das
1793e7d909 HADOOP-6510. Adds a way for superusers to impersonate other users in a secure environment. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@907549 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-08 04:55:11 +00:00
Devaraj Das
f786508cd3 HADOOP-6538. Sets hadoop.security.authentication to simple by default. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906388 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-04 07:46:20 +00:00
Hemanth Yamijala
9f7a07f908 HADOOP-6531. Enhance FileUtil with an API to delete all contents of a directory. Contributed by Amareshwari Sriramadasu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@906177 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 19:04:36 +00:00
Devaraj Das
940389afce HADOOP-6419. Adds SASL based authentication to RPC. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@905860 13f79535-47bb-0310-9956-ffa450edef68
 2010-02-03 01:30:25 +00:00
Devaraj Das
fe0ddc03e1 HADOOP-6518. Makes the UGI honor the env var KRB5CCNAME. Contributed by Owen O'Malley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904975 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-31 04:04:38 +00:00
Devaraj Das
96cd62f8d5 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904862 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-30 19:58:09 +00:00
Devaraj Das
ba8647f511 HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904861 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-30 19:57:39 +00:00
Devaraj Das
611340714b HADOOP-6517. Fix UserGroupInformation so that tokens are saved/retrieved to/from the embedded Subject. Contributed by Owen O'Malley & Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@904339 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-29 01:56:57 +00:00
Owen O'Malley
0c5734e4ac HADOOP-6299. Reimplement the UserGroupInformation to use the OS 
specific and Kerberos JAAS login. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903560 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-27 08:08:29 +00:00
Hairong Kuang
34d1b39c75 HADOOP-6498. IPC client bug may cause rpc call hang. Contributed by Ruyue Ma and Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903471 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:55:17 +00:00
Hairong Kuang
d6f4cf3dfe Revert commit 903015 because it was tagged with the wrong jira number HADOOP-6459. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903468 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-26 22:52:05 +00:00
Hairong Kuang
3ef40e1344 HADOOP-6459. IPC client bug may cause rpc call hang. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@903015 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-25 23:51:13 +00:00
Boris Shkolnik
aaf3b6c6ff HADOOP-6495. Identifier should be serialized after the password is 
created In Token constructor (jnp via boryas)  


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@901924 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-21 23:36:13 +00:00
Doug Cutting
f3477eb324 HADOOP-6497. Add an adapter for Avro's SeekableInput interface, so that Avro can read FileSystem data. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@900607 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-18 23:39:04 +00:00
Doug Cutting
4cd159e83e HADOOP-6492. Make some Avro serialization APIs public. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899866 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-16 01:06:57 +00:00
Suresh Srinivas
a90d3205d2 HADOOP-6489. Fix 3 findbugs warnings. Contributed by Erik Steffl. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@899856 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-16 00:44:40 +00:00
Christopher Douglas
08561f76db HADOOP-6155. Deprecate RecordIO anticipating Avro. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898740 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 13:26:11 +00:00
Christopher Douglas
daed679fc1 HADOOP-6451. Fix build to run contrib unit tests. Contributed by Tom White 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898736 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 13:14:29 +00:00
Christopher Douglas
4cecab7c10 HADOOP-6315. Avoid incorrect use of BuiltInflater/BuiltInDeflater in 
GzipCodec. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@898711 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-13 10:46:39 +00:00
Thomas White
8942119b04 HADOOP-6464. Write a Rackspace cloud provider. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@897023 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 21:43:38 +00:00
Christopher Douglas
1ca1bfb2e5 HADOOP-6420. Add functionality permitting subsets of Configuration to be 
interpreted as Map<String,String>. Contributed by Aaron Kimball


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896966 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-07 18:55:45 +00:00
Thomas White
dec4c1614e HADOOP-6479. TestUTF8 assertions could fail with better text. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896691 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 22:03:33 +00:00
Thomas White
889528e387 HADOOP-6408. Add a /conf servlet to dump running configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896641 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-06 19:44:07 +00:00
Thomas White
b55377a30d HADOOP-6466. Add a ZooKeeper service to the cloud scripts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896259 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:54:51 +00:00
Thomas White
ae91b5d0f4 HADOOP-3205. Read multiple chunks directly from FSInputChecker subclass into user buffers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@896243 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 22:14:17 +00:00
Thomas White
efcad06506 HADOOP-6443. Serialization classes accept invalid metadata. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895831 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-05 00:06:09 +00:00
Boris Shkolnik
3cb2e3112b HADOOP-6472. add tokenCache option to GenericOptionsParser for passing 
file with secret keys to a map reduce job. (boryas)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@895801 13f79535-47bb-0310-9956-ffa450edef68
 2010-01-04 22:14:34 +00:00
Thomas White
7d2440515c HADOOP-6402. testConf.xsl is not well-formed XML. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@894706 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-30 20:32:42 +00:00
Suresh Srinivas
29a1ba1e8f HADOOP-6460. Reinitializes buffers used for serializing responses in ipc server on exceeding maximum response size to free up Java heap. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893666 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-24 00:47:20 +00:00
Thomas White
d115e2cc3a HADOOP-6435. Make RPC.waitForProxy with timeout public. Contributed by Steve Loughran. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893612 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 19:36:14 +00:00
Steve Loughran
cc2f077d43 HADOOP-6452 Hadoop JSP pages don't work under a security manager 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893490 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 12:11:51 +00:00
Steve Loughran
583c41bfac HADOOP-6434 Make HttpServer slightly easier to manage/diagnose faults with 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893485 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-23 12:02:04 +00:00
Thomas White
0ebcb62515 HADOOP-6454. Create setup.py for EC2 cloud scripts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893262 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:33:48 +00:00
Thomas White
d2bae8756c HADOOP-6444. Support additional security group option in hadoop-ec2 script. Contributed by Paul Egan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893251 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:06:02 +00:00
Thomas White
3d3e1ff3f8 HADOOP-6462. Target compile does not exist in contrib/cloud. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@893248 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-22 18:02:45 +00:00
Devaraj Das
fe479755c3 HADOOP-6415. Adds a common token interface for both job token and delegation token. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892113 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-18 02:33:11 +00:00
Boris Shkolnik
ae93ba7501 HADOOP-4656. Add a user to groups mapping service (boryas and acmurthy_) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@892066 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-18 01:29:05 +00:00
Suresh Srinivas
ea5db0c5ab HADOOP-6394. Add a helper class to simplify FileContext related tests and improve code reusability. Contributed by Jitendra Nath Pandey. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891511 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-17 01:30:33 +00:00
Thomas White
6a1e8bf452 HADOOP-6426. Create ant build for running EC2 unit tests. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891497 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-17 00:49:01 +00:00
Owen O'Malley
875c9d62c6 HADOOP-6441. Protect web ui from cross site scripting attacks (XSS) on 
the host http header and using encoded utf-7. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@891132 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-16 06:31:51 +00:00
Konstantin Boudnik
e8d9bf47ab HADOOP-6222. Core doesn't have TestCommonCLI facility. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890964 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 19:59:20 +00:00
Thomas White
7a9ec5d90b Reverting HADOOP-5901. FileSystem.fixName() has unexpected behaviour. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890941 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 18:59:04 +00:00
Thomas White
74b46cf87e HADOOP-5901. FileSystem.fixName() has unexpected behaviour. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890651 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 05:43:03 +00:00
Thomas White
1a2ab63f87 Add missing file for HADOOP-6413. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890588 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 00:51:07 +00:00
Thomas White
ee6468b8a1 HADOOP-5958. Use JDK 1.6 File APIs in DF.java wherever possible. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890576 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-15 00:10:13 +00:00
Thomas White
22fb49704b HADOOP-6414. Add command line help for -expunge command. Contributed by Ravi Phulari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890551 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 23:28:40 +00:00
Dhruba Borthakur
c4e1126980 HADOOP-6433. Introduce asychronous deletion of files via a pool of 
threads. This can be used to delete files in the Distributed Cache. 
(Zheng Shao via dhruba)



git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890502 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 22:17:19 +00:00
Doug Cutting
2ee80854a5 HADOOP-6422. Remove log line. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@890410 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-14 17:45:51 +00:00
Doug Cutting
6c842ad4b5 AVRO-6422. Make RPC backend plugable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889889 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-12 04:37:06 +00:00
Doug Cutting
843ac12f7a HADOOP-6323. Add comparators to the serialization API. Contributed by Aaron Kimball. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889877 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-12 01:26:22 +00:00
Thomas White
f9cb8b0d45 Add pyAntTasks jar for HADOOP 6426. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889845 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-11 22:49:41 +00:00
Konstantin Boudnik
d7fb2d3c85 HADOOP-6428. HttpServer sleeps with negative values. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889378 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-10 19:26:07 +00:00
Thomas White
a473f37733 HADOOP-6346. Add support for specifying unpack pattern regex to RunJar.unJar. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@889018 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 23:25:51 +00:00
Thomas White
2e5fd1c0ab HADOOP-6392. Run namenode and jobtracker on separate EC2 instances. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888998 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 21:57:10 +00:00
Thomas White
368b6cc85b HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888697 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-09 04:17:02 +00:00
Konstantin Boudnik
929e91a08c HADOOP-6386. NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@888565 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-08 20:50:47 +00:00
Jakob Homan
934deda190 HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887472 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-05 00:46:08 +00:00
Konstantin Boudnik
3549d30d7e HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@887047 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-04 03:18:27 +00:00
Thomas White
8d6c5c41f2 HADOOP-6400. Log errors getting Unix UGI. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886645 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-03 01:14:15 +00:00
Tsz-wo Sze
98beeca09d HADOOP-6307. Add a new SequenceFile.Reader constructor in order to support reading on un-closed file. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@886003 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-01 23:25:56 +00:00
Thomas White
ff6c0ef547 HADOOP-6108. Add support for EBS storage on EC2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885888 13f79535-47bb-0310-9956-ffa450edef68
 2009-12-01 19:33:10 +00:00
Konstantin Boudnik
36700348c1 HADOOP-6398. Build is broken after HADOOP-6395 patch has been applied. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@885534 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-30 18:52:34 +00:00
Christopher Douglas
f6990e06b4 HADOOP-6375. Sync documentation for FsShell du with its implementation. 
Contributed by Todd Lipcon


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@883206 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-23 00:59:29 +00:00
Christopher Douglas
09ec9c4ffc HADOOP-6269. Fix threading issue with defaultResource in Configuration. 
Contributed by Sreekanth Ramakrishnan


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@882831 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-21 04:22:02 +00:00
Devaraj Das
bd92322d22 HADOOP-6367. Removes Access Token implementation from common. Contributed by Kan Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@881509 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-17 20:59:46 +00:00
Tsz-wo Sze
cdcb8514a0 HADOOP-6314. Fix "fs -help" for the "-count" commond. Contributed by Ravi Phulari 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@836019 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-13 22:10:01 +00:00
Devaraj Das
ad88440651 HADOOP-6337. Updates FilterInitializer class to be more visible, and the init of the class is made to take a Configuration argument. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@833553 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-06 20:54:40 +00:00
Giridharan Kesavan
af59233ce1 HADOOP-6341. Fix test-patch.sh for checkTests function. ( gkesavan ) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832590 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-03 22:53:08 +00:00
Tsz-wo Sze
f5f95fe43a HADOOP-6343. Log unexpected throwable object caught in RPC. Contributed by Jitendra Nath Pandey 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832249 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-03 01:30:11 +00:00
Konstantin Boudnik
408117957e HADOOP-6347. run-test-core-fault-inject runs a test case twice if -Dtestcase is set. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@832157 13f79535-47bb-0310-9956-ffa450edef68
 2009-11-02 22:26:56 +00:00
Suresh Srinivas
382af3f627 HADOOP-6344. Fix rm and rmr immediately delete files rather than sending to trash, if a user is over-quota. Contributed by Jakob Homan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831478 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 22:39:01 +00:00
Suresh Srinivas
3f371a0a64 Hadoop-6223. Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem. Contributed by Sanjay Radia. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831475 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 22:24:22 +00:00
Suresh Srinivas
b5c31f4ee6 HADOOP-6313. Implement Syncable interface in FSDataOutputStream to expose flush APIs to application users. Contributed by Hairong Kuang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831416 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 18:33:00 +00:00
Tsz-wo Sze
a5427fc7eb HADOOP-6334. Fix GenericOptionsParser and Path to have a better URI support. Contributed by Amareshwari Sriramadasu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@831412 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-30 18:21:26 +00:00
Doug Cutting
a13a0f3fba HADOOP-6318. Upgrade to Avro 1.2.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829279 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-23 23:36:29 +00:00
Konstantin Boudnik
d7a7f02c3e HADOOP-6326. Hundson runs should check for AspectJ warnings and report failure if any is present. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@829269 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-23 22:33:57 +00:00
Tsz-wo Sze
4f4c74f76e HADOOP-6327. FileContext tests should not use /tmp and should clean up files. Contributed by Sanjay Radia 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@828886 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-22 22:46:39 +00:00
Christopher Douglas
449ac4ab87 HADOOP-6292. Update native libraries guide. Contributed by Corinne Chandel 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827855 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-21 00:32:20 +00:00
Christopher Douglas
7313955d04 HADOOP-6097. Fix Path conversion in makeQualified and reset LineReader byte 
count at the start of each block in Hadoop archives. Contributed by Ben Slusky,
Tom White, and Mahadev Konar


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@827837 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-20 23:39:49 +00:00
Christopher Douglas
1ecee2e062 HADOOP-6312. Remove unnecessary debug logging in Configuration constructor. Contributed by Aaron Kimball 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826141 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-17 00:22:39 +00:00
Christopher Douglas
c5bce7be47 HADOOP-6293. Fix FsShell -text to work on filesystems other than the default. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@826120 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-16 22:41:54 +00:00
Konstantin Boudnik
3e9ba35841 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824942 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-13 21:54:48 +00:00
Devaraj Das
fed32afd17 HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@824516 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-12 22:07:17 +00:00
Christopher Douglas
b903b25072 HADOOP-6279. Add Runtime::maxMemory to JVM metrics. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823271 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-08 18:54:04 +00:00
Tsz-wo Sze
710d517768 HADOOP-6283. Improve the exception messages thrown by FileUtil$HardLink.getLinkCount(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@823263 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-08 18:37:37 +00:00
Suresh Srinivas
64f537da0a HADOOP-6286. Fix bugs in related to URI handling in glob methods in FileContext. Contributed by Boris Shkolnik. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@822805 13f79535-47bb-0310-9956-ffa450edef68
 2009-10-07 17:07:37 +00:00