Commit Graph

1664 Commits

Author SHA1 Message Date
Ivan Mitic
53bc888f0b HADOOP-10090. Jobtracker metrics not updated properly after execution of a mapreduce job. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553561 13f79535-47bb-0310-9956-ffa450edef68
2013-12-26 19:42:24 +00:00
Chris Nauroth
150440c607 HADOOP-10175. Har files system authority should preserve userinfo. Contributed by Chuan Liu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553169 13f79535-47bb-0310-9956-ffa450edef68
2013-12-23 18:33:19 +00:00
Jing Zhao
e8de319789 HDFS-5690. DataNode fails to start in secure mode when dfs.http.policy equals to HTTP_ONLY. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553167 13f79535-47bb-0310-9956-ffa450edef68
2013-12-23 18:23:43 +00:00
Karthik Kambatla
624703ed7b YARN-1028. Addendum patch. Added FailoverProxyProvider capability to ResourceManager to help with RM failover.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552920 13f79535-47bb-0310-9956-ffa450edef68
2013-12-21 16:29:10 +00:00
Jing Zhao
71b4903ea4 HADOOP-10169. Remove the unnecessary synchronized in JvmMetrics class. Contributed by Liang Xie.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552820 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 22:06:48 +00:00
Owen O'Malley
7730629164 HADOOP-10141. Create KeyProvider API to separate encryption key storage
from the applications. (omalley)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552462 13f79535-47bb-0310-9956-ffa450edef68
2013-12-20 00:25:42 +00:00
Daryn Sharp
011a7b210d HADOOP-10172. Cache SASL server factories (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552389 13f79535-47bb-0310-9956-ffa450edef68
2013-12-19 18:21:33 +00:00
Robert Joseph Evans
c9d74139bc HADOOP-10164. Allow UGI to login with a known Subject (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552104 13f79535-47bb-0310-9956-ffa450edef68
2013-12-18 21:20:56 +00:00
Jonathan Turner Eagles
a5ec6df324 HADOOP-10171. TestRPC fails intermittently on jkd7 (Mit Desai via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552024 13f79535-47bb-0310-9956-ffa450edef68
2013-12-18 17:02:58 +00:00
Steve Loughran
af367d1409 HADOOP-9611 mvn-rpmbuild against google-guice > 3.0 yields missing cglib dependency
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551916 13f79535-47bb-0310-9956-ffa450edef68
2013-12-18 11:16:57 +00:00
Vinod Kumar Vavilapalli
ca125153b3 YARN-1028. Added FailoverProxyProvider capability to ResourceManager to help with RM failover. Contributed by Karthik Kambatla.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551739 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 22:32:38 +00:00
Suresh Srinivas
926a86780d HADOOP-10168. fix javadoc of ReflectionUtils#copy. Contributed by Thejas Nair.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551646 13f79535-47bb-0310-9956-ffa450edef68
2013-12-17 18:18:15 +00:00
Hitesh Shah
0d7b6dfa97 Fix CHANGES.txt for HADOOP-8753. Moved entry to correct 2.4.0 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551374 13f79535-47bb-0310-9956-ffa450edef68
2013-12-16 22:10:26 +00:00
Jing Zhao
763f073f41 HADOOP-10106. Incorrect thread name in RPC log messages. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551369 13f79535-47bb-0310-9956-ffa450edef68
2013-12-16 21:57:47 +00:00
Hitesh Shah
288506022f HADOOP-8753. LocalDirAllocator throws ArithmeticException: divide by zero when there is no available space on configured local dir. Contributed by Benoy Antony.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550570 13f79535-47bb-0310-9956-ffa450edef68
2013-12-12 22:55:06 +00:00
Sanjay Radia
a4819e70db HADOOP-10044 Improve the javadoc of rpc code (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550486 13f79535-47bb-0310-9956-ffa450edef68
2013-12-12 18:56:45 +00:00
Colin McCabe
002840f605 HADOOP-10087. UserGroupInformation.getGroupNames() fails to return primary group first when JniBasedUnixGroupsMappingWithFallback is used (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550229 13f79535-47bb-0310-9956-ffa450edef68
2013-12-11 18:58:30 +00:00
Jason Darrell Lowe
18d99c12c3 MAPREDUCE-5656. bzip2 codec can drop records when reading data in splits. Contributed by Jason Lowe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1549705 13f79535-47bb-0310-9956-ffa450edef68
2013-12-09 23:31:30 +00:00
Colin McCabe
7f059104d2 HADOOP-10142. Avoid groups lookup for unprivileged users such as dr.who (vinay via cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548763 13f79535-47bb-0310-9956-ffa450edef68
2013-12-07 00:11:15 +00:00
Jonathan Turner Eagles
ca9a32c951 HADOOP-10058. TestMetricsSystemImpl#testInitFirstVerifyStopInvokedImmediately fails on trunk (Chen He via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548215 13f79535-47bb-0310-9956-ffa450edef68
2013-12-05 17:37:13 +00:00
Daryn Sharp
13c5d3eb34 Move HADOOP-10129 from 0.23.10 to 0.23.11 in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548194 13f79535-47bb-0310-9956-ffa450edef68
2013-12-05 16:26:43 +00:00
Jason Darrell Lowe
419783d992 HADOOP-10081. Client.setupIOStreams can leak socket resources on exception or error. Contributed by Tsuyoshi OZAWA
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548179 13f79535-47bb-0310-9956-ffa450edef68
2013-12-05 16:00:40 +00:00
Daryn Sharp
9ea61e4415 HADOOP-10129. Distcp may succeed when it fails (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548175 13f79535-47bb-0310-9956-ffa450edef68
2013-12-05 15:47:55 +00:00
Brandon Li
aa4fba6d92 HDFS-5587. add debug information when NFS fails to start with duplicate user or group names. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548028 13f79535-47bb-0310-9956-ffa450edef68
2013-12-05 07:13:21 +00:00
Jing Zhao
d02baff9a0 HDFS-5536. Implement HTTP policy for Namenode and DataNode. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547925 13f79535-47bb-0310-9956-ffa450edef68
2013-12-04 21:40:57 +00:00
Steve Loughran
59a2139093 HADOOP-10102. Update commons IO from 2.1 to 2.4
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547759 13f79535-47bb-0310-9956-ffa450edef68
2013-12-04 10:49:51 +00:00
Sanford Ryza
f7fe50d55f HADOOP-10127. Add ipc.client.connect.retry.interval to control the frequency of connection retries (Karthik Kambatla via Sandy Ryza)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547626 13f79535-47bb-0310-9956-ffa450edef68
2013-12-03 22:44:46 +00:00
Andrew Wang
9b08654536 HDFS-5560. Trash configuration log statements prints incorrect units. Contributed by Josh Elser.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547266 13f79535-47bb-0310-9956-ffa450edef68
2013-12-03 03:31:21 +00:00
Arun Murthy
a4e473c6a9 Renamed releases. 2.2.1 -> 2.3.0 & 2.3.0 -> 2.4.0
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547136 13f79535-47bb-0310-9956-ffa450edef68
2013-12-02 18:37:39 +00:00
Colin McCabe
08d6213083 HADOOP-10130. RawLocalFS pread does not track FileSystem Statistics (Binglin Chang via Colin Patrick McCabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547117 13f79535-47bb-0310-9956-ffa450edef68
2013-12-02 17:28:53 +00:00
Steve Loughran
7b60e94c09 HADOOP-10135 writes to swift fs over partition size leave temp files and empty output file
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546959 13f79535-47bb-0310-9956-ffa450edef68
2013-12-02 11:03:00 +00:00
Andrew Wang
bb11d47758 HDFS-5562. TestCacheDirectives and TestFsDatasetCache should stub out native mlock. Contributed by Colin Patrick McCabe and Akira Ajisaka.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546246 13f79535-47bb-0310-9956-ffa450edef68
2013-11-28 00:44:54 +00:00
Uma Maheswara Rao G
eed47f20ef HADOOP-10132. RPC#stopProxy() should log the class of proxy when IllegalArgumentException is encountered. Contributed by Ted Yu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546192 13f79535-47bb-0310-9956-ffa450edef68
2013-11-27 20:56:22 +00:00
Jing Zhao
2214871d91 HDFS-5545. Allow specifying endpoints for listeners in HttpServer. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546151 13f79535-47bb-0310-9956-ffa450edef68
2013-11-27 18:20:14 +00:00
Brandon Li
4a1acfc96f HDFS-5548. Use ConcurrentHashMap in portmap. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545756 13f79535-47bb-0310-9956-ffa450edef68
2013-11-26 18:13:04 +00:00
Jing Zhao
d8a2383461 HDFS-5538. URLConnectionFactory should pick up the SSL related configuration by default. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545491 13f79535-47bb-0310-9956-ffa450edef68
2013-11-26 01:16:51 +00:00
Suresh Srinivas
b1d6574a11 HADOOP-10126. LightWeightGSet log message is confusing. Contributed by Vinay.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545376 13f79535-47bb-0310-9956-ffa450edef68
2013-11-25 19:42:19 +00:00
Brandon Li
a379a7bbb9 HDFS-5288. Close idle connections in portmap. Contributed by Haohui Mai
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544352 13f79535-47bb-0310-9956-ffa450edef68
2013-11-21 22:43:55 +00:00
Jonathan Turner Eagles
18b53b780d HADOOP-10111. Allow DU to be initialized with an initial value (Kihwal Lee via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544239 13f79535-47bb-0310-9956-ffa450edef68
2013-11-21 16:13:16 +00:00
Uma Maheswara Rao G
709b74e515 HADOOP-9114. After defined the dfs.checksum.type as the NULL, write file and hflush will through java.lang.ArrayIndexOutOfBoundsException. Contributed by Sathish.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544189 13f79535-47bb-0310-9956-ffa450edef68
2013-11-21 14:05:28 +00:00
Steve Loughran
0aa088e336 HADOOP-10103 commons-lang->2.6
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544174 13f79535-47bb-0310-9956-ffa450edef68
2013-11-21 13:39:23 +00:00
Jing Zhao
3cae2ba63f HDFS-3987. Support webhdfs over HTTPS. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543962 13f79535-47bb-0310-9956-ffa450edef68
2013-11-20 21:51:58 +00:00
Colin McCabe
efea68dc35 HDFS-5511. improve CacheManipulator interface to allow better unit testing (cmccabe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543676 13f79535-47bb-0310-9956-ffa450edef68
2013-11-20 00:48:05 +00:00
Arun Murthy
d9ba056bdb HADOOP-10047. Add a direct-buffer based apis for compression. Contributed by Gopal V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543542 13f79535-47bb-0310-9956-ffa450edef68
2013-11-19 19:29:30 +00:00
Arun Murthy
a6acf72aaa Revert HADOOP-10047, wrong patch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543538 13f79535-47bb-0310-9956-ffa450edef68
2013-11-19 19:25:31 +00:00
Arun Murthy
b96cc8fdbf HADOOP-10047. Add a direct-buffer based apis for compression. Contributed by Gopal V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543456 13f79535-47bb-0310-9956-ffa450edef68
2013-11-19 15:38:27 +00:00
Jing Zhao
229472cea7 HADOOP-10107. Server.getNumOpenConnections may throw NPE. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543335 13f79535-47bb-0310-9956-ffa450edef68
2013-11-19 07:42:02 +00:00
Arpit Agarwal
9bb905115d HADOOP-10110. hadoop-auth has a build break due to missing dependency. (Contributed by Chuan Liu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543190 13f79535-47bb-0310-9956-ffa450edef68
2013-11-18 22:11:11 +00:00
Jing Zhao
fef8f49c58 HDFS-5502. Fix HTTPS support in HsftpFileSystem. Contributed by Haohui Mai.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542438 13f79535-47bb-0310-9956-ffa450edef68
2013-11-16 01:00:42 +00:00
Alejandro Abdelnur
6141d2ed27 HADOOP-10100. MiniKDC shouldn't use apacheds-all artifact. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542123 13f79535-47bb-0310-9956-ffa450edef68
2013-11-14 23:52:53 +00:00