Commit Graph

3180 Commits

Author SHA1 Message Date
Hairong Kuang
dc2a3d1ca3 HADOOP-6900. Make the iterator returned by FileSystem#listLocatedStatus to throw IOException rather than RuntimeException when there is an IO error fetching the next file. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@984301 13f79535-47bb-0310-9956-ffa450edef68
2010-08-11 04:43:26 +00:00
Boris Shkolnik
ccbdfba7d1 HADOOP-6911. doc update for DelegationTokenFetcher
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@984250 13f79535-47bb-0310-9956-ffa450edef68
2010-08-10 22:35:15 +00:00
Amareshwari Sri Ramadasu
bd121ed635 HADOOP-6862. Adds api to add/remove user and group to AccessControlList. Contributed by Amareshwari Sriramadasu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@983877 13f79535-47bb-0310-9956-ffa450edef68
2010-08-10 08:10:40 +00:00
Hairong Kuang
714e5f7165 HADOOP-6889. Make RPC to have an option to timeout. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@982681 13f79535-47bb-0310-9956-ffa450edef68
2010-08-05 16:39:10 +00:00
Devaraj Das
c47d34a866 HADOOP-6706. Improves the sasl failure handling due to expired tickets, and other server detected failures. Contributed by Jitendra Pandey and Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@981714 13f79535-47bb-0310-9956-ffa450edef68
2010-08-03 00:51:57 +00:00
Jakob Homan
1035138b4c HADOOP-6892. Common component of HDFS-1150 (Verify datanodes' identities to clients in secure clusters).
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@981688 13f79535-47bb-0310-9956-ffa450edef68
2010-08-02 21:10:21 +00:00
Hairong Kuang
666a8e1600 HADOOP-6890. Part 2: Incoport the change made in FileContext into FileSystem. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@981676 13f79535-47bb-0310-9956-ffa450edef68
2010-08-02 20:25:44 +00:00
Hairong Kuang
d0ba178800 HADOOP-6890. Improve listFiles API introduced by HADOOP-6870. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980953 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 20:52:08 +00:00
Boris Shkolnik
c15ae29a90 HADOOP-6873. using delegation token over hftp for long running clients
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980648 13f79535-47bb-0310-9956-ffa450edef68
2010-07-30 04:55:23 +00:00
Tsz-wo Sze
7e7aff5c90 Added Devaraj Das as a contributor of HADOOP-6888.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980533 13f79535-47bb-0310-9956-ffa450edef68
2010-07-29 18:29:13 +00:00
Tsz-wo Sze
ff8b7bc253 HADOOP-6888. Add a new FileSystem API closeAllForUGI(..) for closing all file systems associated with a particular UGI. Contributed by Kan Zhang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980523 13f79535-47bb-0310-9956-ffa450edef68
2010-07-29 17:58:55 +00:00
Devaraj Das
1a6ed79ebf HADOOP-6656. Adds a thread in the UserGroupInformation to renew TGTs periodically. Contributed by Owen O'Malley and Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980518 13f79535-47bb-0310-9956-ffa450edef68
2010-07-29 17:29:51 +00:00
Hairong Kuang
19eea554e3 HADOOP-6870. Add a new API getFiles to FileSystem and FileContext. Contributed by Hairong Kuang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@980271 13f79535-47bb-0310-9956-ffa450edef68
2010-07-29 00:14:36 +00:00
Konstantin Boudnik
c539588672 Fixing a typo in the JIRA name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979944 13f79535-47bb-0310-9956-ffa450edef68
2010-07-28 03:21:34 +00:00
Konstantin Boudnik
d010dd60e1 HADOOP-6869. Functionality to creating file or folder on a remote daemon side. Contributed by Vinay Thota.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979942 13f79535-47bb-0310-9956-ffa450edef68
2010-07-28 03:19:02 +00:00
Jakob Homan
5c5c163aa3 HADOOP-6475. Adding some javadoc to Server.RpcMetrics, UGI. Contributed by Jitendra Pandey and borya.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979919 13f79535-47bb-0310-9956-ffa450edef68
2010-07-28 00:56:50 +00:00
Doug Cutting
fa49f7349d HADOOP-6881. Move change message to section for earliest version it
will appear in, 0.20.3.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979785 13f79535-47bb-0310-9956-ffa450edef68
2010-07-27 17:58:37 +00:00
Doug Cutting
ba54f8b7e7 HADOOP-6881. Make WritableComparator initialize classes when looking for their raw comparator, as classes often register raw comparators in their initializer, which are no longer automatically run in Java 6 when a class is referenced. Contributed by omalley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979485 13f79535-47bb-0310-9956-ffa450edef68
2010-07-26 23:17:05 +00:00
Jakob Homan
0d005c52ae HADOOP-6877. Common part of HDFS-1178. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@979387 13f79535-47bb-0310-9956-ffa450edef68
2010-07-26 17:54:01 +00:00
Konstantin Boudnik
f22e332ddd HADOOP-6875. [Herriot] Cleanup of temp. configurations is needed upon restart of a cluster. Contributed by Vinay Thota.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@967220 13f79535-47bb-0310-9956-ffa450edef68
2010-07-23 19:37:08 +00:00
Konstantin Boudnik
d6ef66abb7 Fixing the order of records in the file
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@966919 13f79535-47bb-0310-9956-ffa450edef68
2010-07-23 00:56:39 +00:00
Devaraj Das
eb10b152fe HADOOP-6861. Adds new non-static methods in Credentials to read and write token storage file. Contributed by Jitendra Pandey & Owen O'Malley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@966911 13f79535-47bb-0310-9956-ffa450edef68
2010-07-23 00:05:32 +00:00
Konstantin Boudnik
bd802429c1 HADOOP-6790. Instrumented (Herriot) build uses too wide mask to include aspect files. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@966508 13f79535-47bb-0310-9956-ffa450edef68
2010-07-22 05:48:10 +00:00
Amareshwari Sri Ramadasu
2c0598a964 HADOOP-6536. Fixes FileUtil.fullyDelete() not to delete the contents of the sym-linked directory. Contributed by Ravi Gummadi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@965725 13f79535-47bb-0310-9956-ffa450edef68
2010-07-20 05:21:56 +00:00
Devaraj Das
fa3a3bf5d8 HADOOP-6632. Adds support for using different keytabs for different servers in a Hadoop cluster. In the earier implementation, all servers of a certain type \(like TaskTracker\), would have the same keytab and the same principal. Now the principal name is a pattern that has _HOST in it. Contributed by Kan Zhang & Jitendra Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@965696 13f79535-47bb-0310-9956-ffa450edef68
2010-07-20 00:46:19 +00:00
Boris Shkolnik
75e78e0484 HADOOP-6805. add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@965556 13f79535-47bb-0310-9956-ffa450edef68
2010-07-19 16:51:16 +00:00
Devaraj Das
02b87fc6b3 HADOOP-6670. Use the UserGroupInformation's Subject as the criteria for equals and hashCode. Contributed by Owen O'Malley and Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964993 13f79535-47bb-0310-9956-ffa450edef68
2010-07-17 01:42:22 +00:00
Konstantin Boudnik
44c364d632 HADOOP-6860. 'compile-fault-inject' should never be called directly. Contributed by Konstantin Boudnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964939 13f79535-47bb-0310-9956-ffa450edef68
2010-07-16 20:26:05 +00:00
Mahadev Konar
1b354e2bd5 HADOOP-6834. TFile.append compares initial key against null lastKey (hong tang via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964897 13f79535-47bb-0310-9956-ffa450edef68
2010-07-16 18:37:50 +00:00
Suresh Srinivas
0ac05814c2 HADOOP-6859 - Introduce additional statistics to FileSystem to track file system operations. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964689 13f79535-47bb-0310-9956-ffa450edef68
2010-07-16 06:07:06 +00:00
Konstantin Boudnik
7f14e37076 HADOOP-6836. [Herriot]: Generic method for adding/modifying the attributes for new configuration. Contributed by Vinay Thota.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964134 13f79535-47bb-0310-9956-ffa450edef68
2010-07-14 18:48:35 +00:00
Konstantin Boudnik
a73dfef140 HADOOP-6839. [Herriot] Implement a functionality for getting the user list for creating proxy users. Contributed by Vinay Thota.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@964130 13f79535-47bb-0310-9956-ffa450edef68
2010-07-14 18:44:12 +00:00
Eli Collins
c757b9bf8a Update CHANGES.txt to reflect previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@963593 13f79535-47bb-0310-9956-ffa450edef68
2010-07-13 03:47:48 +00:00
Eli Collins
167bbd1c6e HADOOP-6825. FileStatus needs unit tests. Contributed by Rodrigo Schmidt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@963587 13f79535-47bb-0310-9956-ffa450edef68
2010-07-13 02:29:59 +00:00
Boris Shkolnik
6ba9b70d85 HADOOP-6647. balancer fails with "is not authorized for protocol interface NamenodeProtocol" in secure environment
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@963490 13f79535-47bb-0310-9956-ffa450edef68
2010-07-12 21:18:47 +00:00
Devaraj Das
4ff2991849 HADOOP-6648. Adds a check for null tokens in Credentials.addToken api. Contributed by Owen O'Malley and Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@962998 13f79535-47bb-0310-9956-ffa450edef68
2010-07-11 06:43:18 +00:00
Konstantin Boudnik
0ae9cbb3a4 HADOOP-6819. [Herriot] Shell command for getting the new exceptions in
the logs returning exitcode 1 after executing successfully. Contributed
by Vinay Thota.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@962914 13f79535-47bb-0310-9956-ffa450edef68
2010-07-10 20:55:45 +00:00
Devaraj Das
d2ade6aec5 HADOOP-6845. Renames the TokenStorage class to Credentials. Contributed by Jitendra Pandey.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@962677 13f79535-47bb-0310-9956-ffa450edef68
2010-07-09 20:07:45 +00:00
Jakob Homan
86e833858c HADOOP-6853. Common component of HDFS-1045.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@961911 13f79535-47bb-0310-9956-ffa450edef68
2010-07-08 20:02:29 +00:00
Konstantin Boudnik
038d399389 HADOOP-6847. Problem staging 0.21.0 artifacts to Apache Nexus Maven Repository. Contributed by Giridharan Kesavan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@961559 13f79535-47bb-0310-9956-ffa450edef68
2010-07-08 02:29:15 +00:00
Christopher Douglas
2a248dfc32 HADOOP-6835. Add support for concatenated gzip input. Contributed by Greg Roelofs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@961532 13f79535-47bb-0310-9956-ffa450edef68
2010-07-07 23:22:28 +00:00
Jakob Homan
4b34109a72 HADOOP-6584. Provide Kerberized SSL encryption for webservices.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@960137 13f79535-47bb-0310-9956-ffa450edef68
2010-07-03 00:02:03 +00:00
Konstantin Shvachko
05b1f87909 HADOOP-6756. Documentation for common configuration keys. Contributed by Erik Steffl.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@960079 13f79535-47bb-0310-9956-ffa450edef68
2010-07-02 18:16:30 +00:00
Thomas White
451c8ae5e8 HADOOP-6800. Harmonize JAR library versions.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@959501 13f79535-47bb-0310-9956-ffa450edef68
2010-07-01 04:32:47 +00:00
Boris Shkolnik
8970e93b01 HADOOP-6815. refreshSuperUserGroupsConfiguration should use server side configuration for the refresh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@957074 13f79535-47bb-0310-9956-ffa450edef68
2010-06-22 23:04:33 +00:00
Thomas White
35a4624771 HADOOP-6826. Revert FileSystem create method that takes CreateFlags.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@956710 13f79535-47bb-0310-9956-ffa450edef68
2010-06-21 21:45:47 +00:00
Amareshwari Sri Ramadasu
4b8e1bda2d HADOOP-6748. Removes hadoop.cluster.administrators, cluster administrators acl is passed as parameter in constructor. Contributed by Amareshwari Sriramadasu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@955975 13f79535-47bb-0310-9956-ffa450edef68
2010-06-18 12:30:36 +00:00
Konstantin Boudnik
5807065a5b HADOOP-6828. Herrior uses old way of accessing logs directories. Contributed by Sreekanth Ramakrishnan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@955438 13f79535-47bb-0310-9956-ffa450edef68
2010-06-17 01:34:08 +00:00
Thomas White
c6b8095b02 HADOOP-6821. Document changes to memory monitoring. Contributed by Hemanth Yamijala.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@954647 13f79535-47bb-0310-9956-ffa450edef68
2010-06-14 21:16:47 +00:00
Devaraj Das
e89ac4b077 HADOOP-6652. Removes the unnecessary cache from ShellBasedUnixGroupsMapping. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@954612 13f79535-47bb-0310-9956-ffa450edef68
2010-06-14 20:02:56 +00:00