Commit Graph

798 Commits

Author SHA1 Message Date
Aaron Myers
b7aaa1b74c Merge trunk into the HDFS-347 branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1467511 13f79535-47bb-0310-9956-ffa450edef68
2013-04-12 23:05:28 +00:00
Konstantin Shvachko
2dfc42d613 HADOOP-9211. Set default max heap size in HADOOP_CLIENT_OPTS to 512m in order to avoid OOME. Contributed by Plamen Jeliazkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467380 13f79535-47bb-0310-9956-ffa450edef68
2013-04-12 17:51:30 +00:00
Kihwal Lee
f863543206 HDFS-4477. Secondary namenode may retain old tokens. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467307 13f79535-47bb-0310-9956-ffa450edef68
2013-04-12 15:18:07 +00:00
Luke Lu
4edf48c7ad HADOOP-9467. Metrics2 record filter should check name as well as tags. (Ganeshan Iyler via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466377 13f79535-47bb-0310-9956-ffa450edef68
2013-04-10 08:25:37 +00:00
Suresh Srinivas
2b19054c92 HADOOP-9437. TestNativeIO#testRenameTo fails on Windows due to assumption that POSIX errno is embedded in NativeIOException. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466306 13f79535-47bb-0310-9956-ffa450edef68
2013-04-10 00:45:47 +00:00
Luke Lu
ab850368e8 HADOOP-9451. Fault single-layer config if node group topology is enabled. (Junping Du via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464301 13f79535-47bb-0310-9956-ffa450edef68
2013-04-04 07:07:59 +00:00
Alejandro Abdelnur
da0e779e4b HADOOP-9401. CodecPool: Add counters for number of (de)compressors leased out. (kkambatl via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464219 13f79535-47bb-0310-9956-ffa450edef68
2013-04-03 22:26:47 +00:00
Eli Collins
0e9f61addc Revert initial HADOOP-9357 patch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464182 13f79535-47bb-0310-9956-ffa450edef68
2013-04-03 19:43:29 +00:00
Todd Lipcon
c45c8ee720 Complete commit of prior merge.
The previous merge accidentally only committed the hdfs project instead of common and MR
as well.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1463203 13f79535-47bb-0310-9956-ffa450edef68
2013-04-01 16:47:16 +00:00
Vinod Kumar Vavilapalli
1b87baa06f HADOOP-9444. Modify hadoop-policy.xml to replace unexpanded variables to a default value of '*'. Contributed by Roman Shaposhnik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1462417 13f79535-47bb-0310-9956-ffa450edef68
2013-03-29 06:29:22 +00:00
Todd Lipcon
1611b51a97 HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1462303 13f79535-47bb-0310-9956-ffa450edef68
2013-03-28 20:58:45 +00:00
Eli Collins
799e3c344e HADOOP-9357. Fallback to default authority if not specified in FileContext. Contributed by Andrew Wang
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461898 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 23:43:45 +00:00
Aaron Myers
fc5fd80e9f HADOOP-9125. LdapGroupsMapping threw CommunicationException after some idle time. Contributed by Kai Zheng.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461863 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 21:49:43 +00:00
Todd Lipcon
fc0a4de670 HADOOP-9358. "Auth failed" log should include exception string. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461788 13f79535-47bb-0310-9956-ffa450edef68
2013-03-27 18:51:06 +00:00
Luke Lu
5319818487 HADOOP-9194. RPC Support for QoS. (Junping Du via llu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461370 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 23:29:09 +00:00
Suresh Srinivas
af7b7667f5 HADOOP-9430. TestSSLFactory fails on IBM JVM. Contributed by Amir Sanjar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461268 13f79535-47bb-0310-9956-ffa450edef68
2013-03-26 18:57:47 +00:00
Steve Loughran
a10055cf6d HADOOP-9258 Add stricter tests to FileSystemContractTestBase (includes fixes for production code HADOOP-9261 & HADOOP-9265 and test enhancements HADOOP-9228, HADOOP-9227 & HADOOP-9259)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460646 13f79535-47bb-0310-9956-ffa450edef68
2013-03-25 13:12:27 +00:00
Tsz-wo Sze
883601a1d6 HADOOP-9387. Fix DF so that it won't execute a shell command on Windows to compute the file system/mount point. Contributed by Ivan Mitic
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459642 13f79535-47bb-0310-9956-ffa450edef68
2013-03-22 06:26:52 +00:00
Sanjay Radia
3574720017 HADOOP-9380 Add totalLength to rpc response (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459392 13f79535-47bb-0310-9956-ffa450edef68
2013-03-21 16:41:28 +00:00
Aaron Myers
64741f4635 HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457878 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 17:20:13 +00:00
Daryn Sharp
7eb7b3b723 HADOOP-9299. kerberos name resolution is kicking in even when kerberos is not configured (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457763 13f79535-47bb-0310-9956-ffa450edef68
2013-03-18 13:46:52 +00:00
Aaron Myers
c2003ab56b HADOOP-9318. When exiting on a signal, print the signal name first. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457122 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 21:16:41 +00:00
Suresh Srinivas
70aa08f5e3 HADOOP-9408. misleading description for net.topology.table.file.name property in core-default.xml. Contributed by rajeshbabu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457015 13f79535-47bb-0310-9956-ffa450edef68
2013-03-15 16:50:00 +00:00
Suresh Srinivas
6a9ccd809b HADOOP-9388. TestFsShellCopy fails on Windows. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455637 13f79535-47bb-0310-9956-ffa450edef68
2013-03-12 17:26:38 +00:00
Suresh Srinivas
5865ec1c37 HADOOP-9379. capture the ulimit info after printing the log to the console. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455316 13f79535-47bb-0310-9956-ffa450edef68
2013-03-11 20:31:17 +00:00
Suresh Srinivas
f5227eb51c HADOOP-8973. DiskChecker cannot reliably detect an inaccessible disk on Windows with NTFS ACLs. Contributed by Chris Nauroth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454889 13f79535-47bb-0310-9956-ffa450edef68
2013-03-10 18:17:41 +00:00
Sanjay Radia
a4c20088b5 HADOOP-9151 Include RPC error info in RpcResponseHeader instead of sending it separately (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454593 13f79535-47bb-0310-9956-ffa450edef68
2013-03-08 21:47:57 +00:00
Aaron Myers
21a1c8acba HADOOP-9369. DNS#reverseDns() can return hostname with . appended at the end. Contributed by Karthik Kambatla.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454172 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 23:50:40 +00:00
Suresh Srinivas
a3c4488efd HADOOP-9364. PathData#expandAsGlob does not return correct results for absolute paths on Windows. Contributed by Ivan Mitic.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454108 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 21:32:12 +00:00
Daryn Sharp
6d4ab86412 HADOOP-9374. Add tokens from -tokenCacheFile into UGI (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454019 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 19:22:44 +00:00
Jonathan Turner Eagles
b427fe9de8 HADOOP-9209. Add shell command to dump file checksums (Todd Lipcon via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453613 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 23:17:14 +00:00
Jason Darrell Lowe
85470f0a33 HADOOP-8462. Native-code implementation of bzip2 codec. Contributed by Govind Kamat
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453608 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 23:10:12 +00:00
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 19:15:18 +00:00
Siddharth Seth
52703c2d0d HADOOP-9343. Allow additional exceptions through the RPC layer. (sseth)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452918 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 17:56:17 +00:00
Aaron Myers
cc15fff263 HADOOP-9337. org.apache.hadoop.fs.DF.getMount() does not work on Mac OS. Contributed by Ivan A. Veselovsky.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452622 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 01:30:05 +00:00
Sanjay Radia
ead90cc1a8 HADOOP-9163 The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy (Sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452581 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 22:55:22 +00:00
Daryn Sharp
84567faa92 HADOOP-9352. Expose UGI.setLoginUser for tests (daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452338 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 14:59:41 +00:00
Alejandro Abdelnur
892e088773 HADOOP-9349. Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451448 13f79535-47bb-0310-9956-ffa450edef68
2013-03-01 01:20:53 +00:00
Kihwal Lee
c5368561f9 HADOOP-9336. Allow UGI of current connection to be queried. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451376 13f79535-47bb-0310-9956-ffa450edef68
2013-02-28 22:01:51 +00:00
Kihwal Lee
eb1cc863d2 HADOOP-9339. IPC.Server incorrectly sets UGI auth type. Contributed by Daryn Sharp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450963 13f79535-47bb-0310-9956-ffa450edef68
2013-02-27 21:16:09 +00:00
Suresh Srinivas
9e87bcb3ad HADOOP-8917. add LOCALE.US to toLowerCase in SecurityUtil.replacePattern. Contributed by Arpit Agarwal.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450571 13f79535-47bb-0310-9956-ffa450edef68
2013-02-27 01:34:39 +00:00
Aaron Myers
9397260411 HADOOP-7487. DF should throw a more reasonable exception when mount cannot be determined. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449992 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 01:37:28 +00:00
Suresh Srinivas
4840775e3d HADOOP-9323. Fix typos in API documentation. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449977 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 00:10:35 +00:00
Aaron Myers
8271fae921 HADOOP-9267. hadoop -help, -h, --help should show usage instructions. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449161 13f79535-47bb-0310-9956-ffa450edef68
2013-02-22 18:36:24 +00:00
Aaron Myers
f61581501a Merge trunk into HDFS-347 branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446832 13f79535-47bb-0310-9956-ffa450edef68
2013-02-16 01:12:07 +00:00
Aaron Myers
3a417cbf1d HDFS-347: style cleanups. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446830 13f79535-47bb-0310-9956-ffa450edef68
2013-02-16 00:59:01 +00:00
Sanjay Radia
461e614a3a HADOOP-9218 Document the Rpc-wrappers used internally (sanjay Radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446428 13f79535-47bb-0310-9956-ffa450edef68
2013-02-15 02:26:46 +00:00
Thomas White
c01827aa48 HADOOP-9154. SortedMapWritable#putAll() doesn't add key/value classes to the map. Contributed by Karthik Kambatla.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446183 13f79535-47bb-0310-9956-ffa450edef68
2013-02-14 14:07:33 +00:00
Aaron Myers
a3ddc8ef96 HADOOP-9305. Add support for running the Hadoop client on 64-bit AIX. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445884 13f79535-47bb-0310-9956-ffa450edef68
2013-02-13 19:42:13 +00:00
Alejandro Abdelnur
7e615c7f75 MAPREDUCE-4994. -jt generic command line option does not work. (sandyr via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445330 13f79535-47bb-0310-9956-ffa450edef68
2013-02-12 20:16:08 +00:00