Commit Graph

741 Commits

Author SHA1 Message Date
Chris Nauroth
3628553736 HADOOP-9681. FileUtil.unTarUsingJava() should close the InputStream upon finishing. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499069 13f79535-47bb-0310-9956-ffa450edef68
2013-07-02 19:22:17 +00:00
Colin McCabe
805e9b5b6d HADOOP-9676. Make maximum RPC buffer size configurable (Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498737 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 23:17:13 +00:00
Colin McCabe
6735b70b4a HADOOP-9414. Refactor out FSLinkResolver and relevant helper methods.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498720 13f79535-47bb-0310-9956-ffa450edef68
2013-07-01 22:09:52 +00:00
Arun Murthy
1773893c9a HADOOP-9665. Fixed BlockDecompressorStream#decompress to return -1 rather than throw EOF at end of file. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497922 13f79535-47bb-0310-9956-ffa450edef68
2013-06-28 21:05:43 +00:00
Colin McCabe
b6c7de68bc HADOOP-9673. NetworkTopology: When a node cannot be added, print out its location for diagnostic purposes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497176 13f79535-47bb-0310-9956-ffa450edef68
2013-06-27 01:22:43 +00:00
Vinod Kumar Vavilapalli
b3a8d99817 YARN-874. Making common RPC to switch to not switch to simple when other mechanisms are enabled and thus fix YARN/MR test failures after HADOOP-9421. Contributed by Daryn Sharp and Vinod Kumar Vavilapalli.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496692 13f79535-47bb-0310-9956-ffa450edef68
2013-06-26 00:42:26 +00:00
Alejandro Abdelnur
2c6a4e1a75 HADOOP-9661. Allow metrics sources to be extended. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496227 13f79535-47bb-0310-9956-ffa450edef68
2013-06-24 21:41:25 +00:00
Colin McCabe
ca35235b04 HADOOP-9439. JniBasedUnixGroupsMapping: fix some crash bugs (Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496112 13f79535-47bb-0310-9956-ffa450edef68
2013-06-24 16:21:18 +00:00
Daryn Sharp
5f9b4c14a1 HADOOP-9421. [RPC v9] Convert SASL to use ProtoBuf and provide negotiation capabilities (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495577 13f79535-47bb-0310-9956-ffa450edef68
2013-06-21 20:09:31 +00:00
Aaron Myers
9550b1a78b Clean up an IPC error message. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494702 13f79535-47bb-0310-9956-ffa450edef68
2013-06-19 17:31:20 +00:00
Chris Nauroth
2e99da4853 HADOOP-9637. Adding Native Fstat for Windows as needed by YARN. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494341 13f79535-47bb-0310-9956-ffa450edef68
2013-06-18 22:15:26 +00:00
Jason Darrell Lowe
3ab7f86c16 HADOOP-9582. Non-existent file to "hadoop fs -conf" doesn't throw error. Contributed by Ashwin Shankar
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494331 13f79535-47bb-0310-9956-ffa450edef68
2013-06-18 21:56:25 +00:00
Aaron Myers
1c309f763b HDFS-4906. HDFS Output streams should not accept writes after being closed. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494303 13f79535-47bb-0310-9956-ffa450edef68
2013-06-18 21:05:16 +00:00
Vinod Kumar Vavilapalli
b9efe6bd4a HADOOP-9649. Promoted YARN service life-cycle libraries into Hadoop Common for usage across all Hadoop projects. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493650 13f79535-47bb-0310-9956-ffa450edef68
2013-06-17 06:39:33 +00:00
Colin McCabe
5e72bfc521 revert HADOOP-9646 to fix hadoop-streaming compile issue
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493252 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 21:23:23 +00:00
Colin McCabe
65b225c06f HADOOP-9646: Inconsistent exception specifications in FileUtils#chmod
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493241 13f79535-47bb-0310-9956-ffa450edef68
2013-06-14 20:57:07 +00:00
Luke Lu
a841be808a HADOOP-9630. [RPC v9] Remove IpcSerializationType. (Junping Du via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491682 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 03:30:41 +00:00
Aaron Myers
5ab67b5c07 HADOOP-9604. Javadoc of FSDataOutputStream is slightly inaccurate. Contributed by Jingguo Yao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491668 13f79535-47bb-0310-9956-ffa450edef68
2013-06-11 01:19:20 +00:00
Colin McCabe
a7bfb25d2b HDFS-3934. duplicative dfs_hosts entries handled wrong. (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489065 13f79535-47bb-0310-9956-ffa450edef68
2013-06-03 17:14:27 +00:00
Vinod Kumar Vavilapalli
131bfc91a6 MAPREDUCE-5261. Reverting the patch as it is no longer needed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1488032 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 21:53:34 +00:00
Konstantin Boudnik
2fb2a5ab42 HADOOP-9607. Fixes in Javadoc build. Contributed by Timothy St. Clair
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487979 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 19:06:49 +00:00
Vinod Kumar Vavilapalli
fdfedf4c31 HADOOP-9574. Added new methods in AbstractDelegationTokenSecretManager for helping YARN ResourceManager to reuse code for RM restart. Contributed by Jian He.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487692 13f79535-47bb-0310-9956-ffa450edef68
2013-05-30 00:52:53 +00:00
Jonathan Turner Eagles
52cbb906d9 YARN-548. Add tests for YarnUncaughtExceptionHandler (Vadim Bondarev via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485877 13f79535-47bb-0310-9956-ffa450edef68
2013-05-23 22:21:56 +00:00
Steve Loughran
10d21ac779 HADOOP-9593 stack trace printed at ERROR for all yarn clients without hadoop.home set
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485842 13f79535-47bb-0310-9956-ffa450edef68
2013-05-23 20:08:25 +00:00
Vinod Kumar Vavilapalli
27e6673ec3 MAPREDUCE-5156. Change hadoop examples ProgramDriver to be able to run 1.x examples jar on top of YARN. This change breaks 0.23.x direct usages of ProgramDriver. Contributed by Zhijie Shen.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485085 13f79535-47bb-0310-9956-ffa450edef68
2013-05-22 06:36:24 +00:00
Vinod Kumar Vavilapalli
4a4e42d919 MAPREDUCE-5261. Fix issues in TestRMContainerAllocator after YARN-617. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485079 13f79535-47bb-0310-9956-ffa450edef68
2013-05-22 06:24:17 +00:00
Suresh Srinivas
c9ace69cff HADOOP-9563. Fix incompatibility introduced by HADOOP-9523. Contributed by Tian Hong Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482709 13f79535-47bb-0310-9956-ffa450edef68
2013-05-15 07:42:06 +00:00
Todd Lipcon
d5a6e764dc HADOOP-9220. Unnecessary transition to standby in ActiveStandbyElector. Contributed by Tom White and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482401 13f79535-47bb-0310-9956-ffa450edef68
2013-05-14 15:37:12 +00:00
Todd Lipcon
e29170e771 HADOOP-9307. BufferedFSInputStream.read returns wrong results after certain seeks. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482377 13f79535-47bb-0310-9956-ffa450edef68
2013-05-14 15:16:12 +00:00
Suresh Srinivas
d89fd7b84f HADOOP-9560. metrics2#JvmMetrics should have max memory size of JVM. Contributed by Tsuyoshi Ozawa.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482372 13f79535-47bb-0310-9956-ffa450edef68
2013-05-14 15:09:55 +00:00
Todd Lipcon
8a4ff65b3c HADOOP-9459. ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb. Contributed by Vinay and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482227 13f79535-47bb-0310-9956-ffa450edef68
2013-05-14 06:43:47 +00:00
Kihwal Lee
d027b947d6 HDFS-4805. Webhdfs client is fragile to token renewal errors. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482121 13f79535-47bb-0310-9956-ffa450edef68
2013-05-13 22:03:43 +00:00
Aaron Myers
945cb2ecaa HADOOP-9485. No default value in the code for hadoop.rpc.socket.factory.class.default. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481200 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 21:45:32 +00:00
Kihwal Lee
a96780013e HADOOP-9549. WebHdfsFileSystem hangs on close(). Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481075 13f79535-47bb-0310-9956-ffa450edef68
2013-05-10 16:22:54 +00:00
Tsz-wo Sze
393188c445 Merge r1477868 through r1479732 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479733 13f79535-47bb-0310-9956-ffa450edef68
2013-05-07 00:17:50 +00:00
Sanjay Radia
725623534c HADOOP-9425 Add error codes to rpc-response (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479143 13f79535-47bb-0310-9956-ffa450edef68
2013-05-04 17:51:22 +00:00
Vinod Kumar Vavilapalli
bfc73613fc HADOOP-9511. Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils so as to help YARN-578. Contributed by Omkar Vinit Joshi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479010 13f79535-47bb-0310-9956-ffa450edef68
2013-05-03 23:43:12 +00:00
Suresh Srinivas
776eb119ac HADOOP-9523. Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs. Contributed by Tian Hong Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478634 13f79535-47bb-0310-9956-ffa450edef68
2013-05-03 03:36:51 +00:00
Suresh Srinivas
1c762c01c4 HADOOP-9043. Disallow in winutils creating symlinks with forwards slashes. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478577 13f79535-47bb-0310-9956-ffa450edef68
2013-05-02 21:40:36 +00:00
Christopher Douglas
0728f00282 HADOOP-8608. Add Configuration API for parsing time durations.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477869 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 23:07:21 +00:00
Tsz-wo Sze
faca77f227 Merge r1476453 through r1477867 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477868 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 23:02:35 +00:00
Aaron Myers
bfef63719d HADOOP-9338. FsShell Copy Commands Should Optionally Preserve File Attributes. Contributed by Nick White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477714 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 16:27:58 +00:00
Harsh J
3dc9aa480a HADOOP-9322. LdapGroupsMapping doesn't seem to set a timeout for its directory search. Contributed by Harsh J. (harsh)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477458 13f79535-47bb-0310-9956-ffa450edef68
2013-04-30 03:06:06 +00:00
Suresh Srinivas
30b7a9c49f HADOOP-9413. Add common utils for File#setReadable/Writable/Executable & File#canRead/Write/Execute that work cross-platform. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477376 13f79535-47bb-0310-9956-ffa450edef68
2013-04-29 22:12:57 +00:00
Suresh Srinivas
293fb1ec1e HADOOP-9524. Fix ShellCommandFencer to work on Windows. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476856 13f79535-47bb-0310-9956-ffa450edef68
2013-04-28 23:16:47 +00:00
Suresh Srinivas
e2d901f4da HADOOP-9490. LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476609 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 16:10:31 +00:00
Jason Darrell Lowe
fc45cbf8df HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo. Contributed by Liang Xie
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476487 13f79535-47bb-0310-9956-ffa450edef68
2013-04-27 04:11:23 +00:00
Tsz-wo Sze
60341dae19 Merge r1476010 through r1476452 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476453 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 23:50:17 +00:00
Devaraj Das
5d2ffde68e HDFS-2576. Enhances the DistributedFileSystem's create API so that clients can specify favored datanodes for a file's blocks. Contributed by Devaraj Das and Pritam Damania.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476395 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 20:39:51 +00:00
Tsz-wo Sze
fa500825fa Merge r1471229 through r1476009 from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476011 13f79535-47bb-0310-9956-ffa450edef68
2013-04-26 01:19:00 +00:00