Suresh Srinivas
f5227eb51c
HADOOP-8973. DiskChecker cannot reliably detect an inaccessible disk on Windows with NTFS ACLs. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454889 13f79535-47bb-0310-9956-ffa450edef68
2013-03-10 18:17:41 +00:00
Suresh Srinivas
a3c4488efd
HADOOP-9364. PathData#expandAsGlob does not return correct results for absolute paths on Windows. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454108 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 21:32:12 +00:00
Daryn Sharp
6d4ab86412
HADOOP-9374. Add tokens from -tokenCacheFile into UGI (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454019 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 19:22:44 +00:00
Suresh Srinivas
33b3bcd357
HADOOP-9365. TestHAZKUtil fails on Windows. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453676 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 03:42:18 +00:00
Suresh Srinivas
97605f27e7
HADOOP-9376. TestProxyUserFromEnv fails on a Windows domain joined machine. Contributed by Ivan Mitic.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453675 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 03:34:44 +00:00
Suresh Srinivas
6942fd1db5
HADOOP-9372. Fix bad timeout annotations on tests. Contributed by Arpit Agarwal.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453637 13f79535-47bb-0310-9956-ffa450edef68
2013-03-07 01:09:53 +00:00
Jonathan Turner Eagles
b427fe9de8
HADOOP-9209. Add shell command to dump file checksums (Todd Lipcon via jeagles)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453613 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 23:17:14 +00:00
Jason Darrell Lowe
85470f0a33
HADOOP-8462. Native-code implementation of bzip2 codec. Contributed by Govind Kamat
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453608 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 23:10:12 +00:00
Suresh Srinivas
638801cce1
HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
2013-03-06 19:15:18 +00:00
Siddharth Seth
52703c2d0d
HADOOP-9343. Allow additional exceptions through the RPC layer. (sseth)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452918 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 17:56:17 +00:00
Aaron Myers
cc15fff263
HADOOP-9337. org.apache.hadoop.fs.DF.getMount() does not work on Mac OS. Contributed by Ivan A. Veselovsky.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452622 13f79535-47bb-0310-9956-ffa450edef68
2013-03-05 01:30:05 +00:00
Daryn Sharp
84567faa92
HADOOP-9352. Expose UGI.setLoginUser for tests (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452338 13f79535-47bb-0310-9956-ffa450edef68
2013-03-04 14:59:41 +00:00
Alejandro Abdelnur
892e088773
HADOOP-9349. Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another. (sandyr via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451448 13f79535-47bb-0310-9956-ffa450edef68
2013-03-01 01:20:53 +00:00
Kihwal Lee
c5368561f9
HADOOP-9336. Allow UGI of current connection to be queried. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451376 13f79535-47bb-0310-9956-ffa450edef68
2013-02-28 22:01:51 +00:00
Kihwal Lee
eb1cc863d2
HADOOP-9339. IPC.Server incorrectly sets UGI auth type. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1450963 13f79535-47bb-0310-9956-ffa450edef68
2013-02-27 21:16:09 +00:00
Aaron Myers
9397260411
HADOOP-7487. DF should throw a more reasonable exception when mount cannot be determined. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449992 13f79535-47bb-0310-9956-ffa450edef68
2013-02-26 01:37:28 +00:00
Aaron Myers
f61581501a
Merge trunk into HDFS-347 branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446832 13f79535-47bb-0310-9956-ffa450edef68
2013-02-16 01:12:07 +00:00
Aaron Myers
3a417cbf1d
HDFS-347: style cleanups. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446830 13f79535-47bb-0310-9956-ffa450edef68
2013-02-16 00:59:01 +00:00
Thomas White
c01827aa48
HADOOP-9154. SortedMapWritable#putAll() doesn't add key/value classes to the map. Contributed by Karthik Kambatla.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446183 13f79535-47bb-0310-9956-ffa450edef68
2013-02-14 14:07:33 +00:00
Alejandro Abdelnur
4ad1279b2e
HADOOP-9297. remove old record IO generation and tests. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1446044 13f79535-47bb-0310-9956-ffa450edef68
2013-02-14 04:27:07 +00:00
Suresh Srinivas
6e72c6731a
HADOOP-9294. GetGroupsTestBase fails on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1444415 13f79535-47bb-0310-9956-ffa450edef68
2013-02-09 19:53:36 +00:00
Suresh Srinivas
7114a61318
HDFS-4470. Several HDFS tests attempt file operations on invalid HDFS paths when running on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443744 13f79535-47bb-0310-9956-ffa450edef68
2013-02-07 21:52:55 +00:00
Suresh Srinivas
8159dad856
HADOOP-9289. FsShell rm -f fails for non-matching globs. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443108 13f79535-47bb-0310-9956-ffa450edef68
2013-02-06 18:20:54 +00:00
Tsz-wo Sze
0b565a967d
HADOOP-9278. Fix the file handle leak in HarMetaData.parseMetaData() in HarFileSystem. Contributed by Chris Nauroth
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442755 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 21:23:29 +00:00
Aaron Myers
5a0b746639
HDFS-4404. Create file failure when the machine of first attempted NameNode is down. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442461 13f79535-47bb-0310-9956-ffa450edef68
2013-02-05 03:18:14 +00:00
Tsz-wo Sze
ef2ff99d36
HADOOP-9252. In StringUtils, humanReadableInt(..) has a race condition and the synchronization of limitDecimalTo2(double) can be avoided.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442386 13f79535-47bb-0310-9956-ffa450edef68
2013-02-04 21:40:59 +00:00
Hitesh Shah
114e23f7bd
HADOOP-9276. Allow BoundedByteArrayOutputStream to be resettable. Contributed by Arun Murthy
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1442312 13f79535-47bb-0310-9956-ffa450edef68
2013-02-04 19:42:51 +00:00
Robert Joseph Evans
5c791948de
HADOOP-9067. provide test for LocalFileSystem.reportChecksumFailure (Ivan A. Veselovsky via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441628 13f79535-47bb-0310-9956-ffa450edef68
2013-02-01 21:09:05 +00:00
Thomas White
af8553b9fe
HADOOP-9124. SortedMapWritable violates contract of Map interface for equals() and hashCode(). Contributed by Surenkumar Nihalani
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441475 13f79535-47bb-0310-9956-ffa450edef68
2013-02-01 15:03:35 +00:00
Suresh Srinivas
71a57ded39
HADOOP-9264. Port change to use Java untar API on Windows from branch-1-win to trunk. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441172 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 20:13:01 +00:00
Suresh Srinivas
b04586e7eb
HADOOP-9264. Reverting r1441164 and wait for Jenkins results before committing the patch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441166 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 19:49:06 +00:00
Suresh Srinivas
e6ef76999f
HADOOP-9264. Port change to use Java untar API on Windows from branch-1-win to trunk. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1441164 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 19:45:28 +00:00
Aaron Myers
e7380b4f9c
HDFS-4428. FsDatasetImpl should disclose what the error is when a rename fails. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440865 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 07:29:46 +00:00
Suresh Srinivas
e668c16975
HADOOP-8981. Merge r1422279 from branch-trunk-win to trunk
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440780 13f79535-47bb-0310-9956-ffa450edef68
2013-01-31 01:37:16 +00:00
Harsh J
159b991e72
Reverting HADOOP-9241. To be fixed and reviewed.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439748 13f79535-47bb-0310-9956-ffa450edef68
2013-01-29 05:33:02 +00:00
Harsh J
96d724b441
HADOOP-9241. DU refresh interval is not configurable. Contributed by Harsh J. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439129 13f79535-47bb-0310-9956-ffa450edef68
2013-01-27 17:52:16 +00:00
Aaron Myers
554774c6d1
HDFS-4438. TestDomainSocket fails when system umask is set to 0002. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1438279 13f79535-47bb-0310-9956-ffa450edef68
2013-01-25 00:39:02 +00:00
Todd Lipcon
797465820b
Merge trunk into branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437623 13f79535-47bb-0310-9956-ffa450edef68
2013-01-23 18:51:24 +00:00
Todd Lipcon
89bd14913a
HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1436568 13f79535-47bb-0310-9956-ffa450edef68
2013-01-21 19:29:06 +00:00
Robert Joseph Evans
5c5e6ed13a
HADOOP-8849. FileUtil#fullyDelete should grant the target directories +rwx permissions (Ivan A. Veselovsky via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434868 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 19:19:10 +00:00
Todd Lipcon
db17fadd38
HADOOP-9216. CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. Contributed by Tsuyoshi Ozawa.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434569 13f79535-47bb-0310-9956-ffa450edef68
2013-01-17 07:19:41 +00:00
Suresh Srinivas
06f086dd23
HADOOP-9106. Allow configuration of IPC connect timeout. Contributed by Rober Parker.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433747 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 23:54:21 +00:00
Alejandro Abdelnur
8ab69eb0c3
HADOOP-8816. HTTP Error 413 full HEAD if using kerberos authentication. (moritzmoeller via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433567 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 18:27:30 +00:00
Todd Lipcon
2f4e2c607e
Merge trunk into branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433249 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 00:42:06 +00:00
Todd Lipcon
35a145d92f
HDFS-4401. Fix bug in DomainSocket path validation. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433229 13f79535-47bb-0310-9956-ffa450edef68
2013-01-15 00:12:47 +00:00
Suresh Srinivas
6d807fcab1
HADOOP-9203. RPCCallBenchmark should find a random available port. Contributec by Andrew Purtell.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433220 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 23:48:50 +00:00
Todd Lipcon
12bf674e8e
Merge trunk into branch.
...
Fixed a couple trivial conflicts due to HDFS-4363, which moved some methods
from HdfsProtoUtil to PBHelper
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433133 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 21:12:16 +00:00
Thomas Graves
ab0e94d2a5
HADOOP-9097. Maven RAT plugin is not checking all source files (tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432934 13f79535-47bb-0310-9956-ffa450edef68
2013-01-14 14:37:12 +00:00
Todd Lipcon
d2737575ad
HDFS-4390. Bypass UNIX domain socket unit tests when they cannot be run. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432350 13f79535-47bb-0310-9956-ffa450edef68
2013-01-12 01:19:27 +00:00
Todd Lipcon
6f8ee865de
HDFS-4388. DomainSocket should throw AsynchronousCloseException when appropriate. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432339 13f79535-47bb-0310-9956-ffa450edef68
2013-01-12 00:12:30 +00:00
Robert Joseph Evans
6b3006cb32
HADOOP-9139 improve killKdc.sh (Ivan A. Veselovsky via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432151 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 16:59:32 +00:00
Eric Yang
8064849203
HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431740 13f79535-47bb-0310-9956-ffa450edef68
2013-01-11 00:00:13 +00:00
Aaron Myers
7e599d9e3b
HADOOP-9155. FsPermission should have different default value, 777 for directory and 666 for file. Contributed by Binglin Chang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431148 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 23:30:41 +00:00
Todd Lipcon
d94621a0cd
HDFS-4354. Create DomainSocket and DomainPeer and associated unit tests. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431102 13f79535-47bb-0310-9956-ffa450edef68
2013-01-09 21:37:34 +00:00
Suresh Srinivas
54221aa26a
HADOOP-9119. Add test to FileSystemContractBaseTest to verify integrity of overwritten files. Contributed by Steve Loughran.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430387 13f79535-47bb-0310-9956-ffa450edef68
2013-01-08 16:59:29 +00:00
Suresh Srinivas
9ad8639e1c
HADOOP-9162. Add utility to check native library availability. Contributed by Binglin Chang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425390 13f79535-47bb-0310-9956-ffa450edef68
2012-12-23 02:08:50 +00:00
Robert Joseph Evans
557b022406
HADOOP-9105. FsShell -moveFromLocal erroneously fails (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424566 13f79535-47bb-0310-9956-ffa450edef68
2012-12-20 16:19:48 +00:00
Thomas White
834e941044
HADOOP-9153. Support createNonRecursive in ViewFileSystem. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423824 13f79535-47bb-0310-9956-ffa450edef68
2012-12-19 11:14:15 +00:00
Aaron Myers
371abd6e21
HADOOP-9152. HDFS can report negative DFS Used on clusters with very small amounts of data. Contributed by Brock Noland.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423602 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 19:49:14 +00:00
Suresh Srinivas
7d8057707f
HADOOP-9147. Add missing fields to FIleStatus.toString. Contributed by Jonathan Allen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423444 13f79535-47bb-0310-9956-ffa450edef68
2012-12-18 14:23:53 +00:00
Luke Lu
3689933b26
HADOOP-9041. FsUrlStreamHandlerFactory could cause an infinite loop in FileSystem initialization. (Yanbo Liang and Radim Kolar via llu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422430 13f79535-47bb-0310-9956-ffa450edef68
2012-12-16 00:39:17 +00:00
Luke Lu
db09dba7ae
HADOOP-8561. Introduce HADOOP_PROXY_USER for secure impersonation in child hadoop client processes. (Yu Gao via llu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422429 13f79535-47bb-0310-9956-ffa450edef68
2012-12-16 00:38:59 +00:00
Sanjay Radia
cd80628ec4
HADOOP-8957 AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs (Chris Nauroth via Sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420965 13f79535-47bb-0310-9956-ffa450edef68
2012-12-12 20:54:30 +00:00
Eli Collins
8c2846510e
HADOOP-9113. o.a.h.fs.TestDelegationTokenRenewer is failing intermittently. Contributed by Karthik Kambatla
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420490 13f79535-47bb-0310-9956-ffa450edef68
2012-12-12 00:10:37 +00:00
Suresh Srinivas
ea3af26188
HADOOP-9131. Turn off TestLocalFileSystem#testListStatusWithColons on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420366 13f79535-47bb-0310-9956-ffa450edef68
2012-12-11 19:52:22 +00:00
Todd Lipcon
22a78a75b4
HADOOP-9126. FormatZK and ZKFC startup can fail due to zkclient connection establishment delay. Contributed by Rakesh R and Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419831 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 22:09:20 +00:00
Todd Lipcon
7ba12a628a
HADOOP-6762. Exception while doing RPC I/O closes channel. Contributed by Sam Rash and Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419782 13f79535-47bb-0310-9956-ffa450edef68
2012-12-10 21:25:29 +00:00
Sanjay Radia
ad619d34d0
HDFS-4260 Fix HDFS tests to set test dir to a valid HDFS path as opposed to the local build path (Chris Nauroth via Sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418424 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 18:32:27 +00:00
Todd Lipcon
6681523c87
HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418214 13f79535-47bb-0310-9956-ffa450edef68
2012-12-07 08:18:14 +00:00
Todd Lipcon
bd239a8d97
HADOOP-9103. UTF8 class does not properly decode Unicode characters outside the basic multilingual plane. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417649 13f79535-47bb-0310-9956-ffa450edef68
2012-12-05 21:13:46 +00:00
Suresh Srinivas
e5d54ac89a
HADOOP-9090. Support on-demand publish of metrics. Contributed by Mostafa Elhemali.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416538 13f79535-47bb-0310-9956-ffa450edef68
2012-12-03 14:23:16 +00:00
Suresh Srinivas
bf7d772b79
HADOOP-8958. ViewFs:Non absolute mount name failures when running multiple tests on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415784 13f79535-47bb-0310-9956-ffa450edef68
2012-11-30 18:38:53 +00:00
Alejandro Abdelnur
f6230b1c8c
HADOOP-9084. Augment DelegationTokenRenewer API to cancel the tokens on calls to removeRenewAction. (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414326 13f79535-47bb-0310-9956-ffa450edef68
2012-11-27 19:23:05 +00:00
Suresh Srinivas
3b3a72e622
HADOOP-9093. Move all the Exception in PathExceptions to o.a.h.fs package. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413960 13f79535-47bb-0310-9956-ffa450edef68
2012-11-27 00:40:55 +00:00
Robert Joseph Evans
68bc61ab5c
HADOOP-9038. unit-tests for AllocatorPerContext.PathIterator (Ivan A. Veselovsky via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413776 13f79535-47bb-0310-9956-ffa450edef68
2012-11-26 18:47:20 +00:00
Robert Joseph Evans
0d92f54e82
HADOOP-8992. Enhance unit-test coverage of class HarFileSystem (Ivan A. Veselovsky via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413743 13f79535-47bb-0310-9956-ffa450edef68
2012-11-26 17:45:57 +00:00
Thomas White
d6af507199
HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412077 13f79535-47bb-0310-9956-ffa450edef68
2012-11-21 12:29:37 +00:00
Eli Collins
c3f13a7fef
HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Contributed by Colin McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411879 13f79535-47bb-0310-9956-ffa450edef68
2012-11-20 21:13:48 +00:00
Robert Joseph Evans
86ce5f6c91
HADOOP-9035. Generalize setup of LoginContext (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410018 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 21:14:37 +00:00
Alejandro Abdelnur
ce2067fb15
HADOOP-6607. Add different variants of non caching HTTP headers. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409921 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 18:45:58 +00:00
Eli Collins
03bf9d6f20
Revert HADOOP-9042.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409902 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 18:12:46 +00:00
Eli Collins
423cb2a1f8
HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409635 13f79535-47bb-0310-9956-ffa450edef68
2012-11-15 01:51:15 +00:00
Alejandro Abdelnur
ec8ed4e951
HADOO-8998. set Cache-Control no-cache header on all dynamic content. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409095 13f79535-47bb-0310-9956-ffa450edef68
2012-11-14 06:22:11 +00:00
Robert Joseph Evans
4755ef989a
HADOOP-9021. Enforce configured SASL method on the server (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408473 13f79535-47bb-0310-9956-ffa450edef68
2012-11-12 22:13:00 +00:00
Robert Joseph Evans
de1f33dc35
HADOOP-9020. Add a SASL PLAIN server (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407622 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 20:40:09 +00:00
Alejandro Abdelnur
f8c486fbc8
HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407577 13f79535-47bb-0310-9956-ffa450edef68
2012-11-09 18:25:49 +00:00
Suresh Srinivas
1813fb0132
HADOOP-8974. TestDFVariations fails on Windows. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407222 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 19:12:42 +00:00
Sanjay Radia
76d43a08ed
HADOOP-8589 ViewFs tests fail when tests and home dirs are nested (sanjay Radia)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406939 13f79535-47bb-0310-9956-ffa450edef68
2012-11-08 06:16:02 +00:00
Robert Joseph Evans
1594dd6965
HADOOP-9015. Standardize creation of SaslRpcServers (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406851 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 22:50:48 +00:00
Robert Joseph Evans
cb293a62a5
HADOOP-9013. UGI should not hardcode loginUser's authenticationType (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406684 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 15:56:46 +00:00
Suresh Srinivas
c013142a12
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406413 13f79535-47bb-0310-9956-ffa450edef68
2012-11-07 00:48:17 +00:00
Suresh Srinivas
251230a126
HADOOP-9004. Reverting the commit r1406202 to address patch issue
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406379 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 22:23:51 +00:00
Suresh Srinivas
b13a5cdcb7
HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406202 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 16:12:43 +00:00
Daryn Sharp
3a698e6aea
HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 15:57:58 +00:00
Robert Joseph Evans
5605b54010
HADOOP-9012. IPC Client sends wrong connection context (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406184 13f79535-47bb-0310-9956-ffa450edef68
2012-11-06 15:37:14 +00:00
Robert Joseph Evans
b1aa62a848
HADOOP-9010. Map UGI authenticationMethod to RPC authMethod (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405910 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 18:37:39 +00:00
Robert Joseph Evans
8303175db8
HADOOP-9009. Add SecurityUtil methods to get/set authentication method (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405904 13f79535-47bb-0310-9956-ffa450edef68
2012-11-05 18:26:49 +00:00
Suresh Srinivas
22377ebae5
HADOOP-8985. Add namespace declarations in .proto files for languages other than java. Thank you Binglin Chan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402845 13f79535-47bb-0310-9956-ffa450edef68
2012-10-27 18:44:15 +00:00
Thomas Graves
a577f757f7
HADOOP-8713. TestRPCCompatibility fails intermittently with JDK7 Trevor Robinson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402660 13f79535-47bb-0310-9956-ffa450edef68
2012-10-26 21:03:29 +00:00
Daryn Sharp
61ffa3adb9
MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401473 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 21:01:03 +00:00
Robert Joseph Evans
b73903f6a7
HADOOP-8962. RawLocalFileSystem.listStatus fails when a child filename contains a colon (jlowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401325 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 15:47:26 +00:00
Robert Joseph Evans
13422461f3
HADOOP-8811. Compile hadoop native library in FreeBSD (Radim Kolar via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401321 13f79535-47bb-0310-9956-ffa450edef68
2012-10-23 15:32:25 +00:00
Suresh Srinivas
efd798b34b
HADOOP-8948. TestFileUtil.testGetDU fails on Windows due to incorrect assumption of line separator. Contributed by Chris Nauroth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400324 13f79535-47bb-0310-9956-ffa450edef68
2012-10-19 22:48:48 +00:00
Suresh Srinivas
6f79fffb86
HADOOP-8900. BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size. Contributed by Slavik Krassovsky.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399377 13f79535-47bb-0310-9956-ffa450edef68
2012-10-17 18:36:32 +00:00
Robert Joseph Evans
224de4f92c
HADOOP-8926. hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (Gopal V via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399005 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 21:52:10 +00:00
Robert Joseph Evans
6a059dc40e
HADOOP-8922. Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard (Damien Hardy via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398904 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 18:00:01 +00:00
Todd Lipcon
e0db1e9e10
HADOOP-8929. Add toString, other improvements for SampleQuantiles. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398658 13f79535-47bb-0310-9956-ffa450edef68
2012-10-16 06:06:20 +00:00
Daryn Sharp
22ef03bc76
HADOOP-8784. Improve IPC.Client's token use (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397634 13f79535-47bb-0310-9956-ffa450edef68
2012-10-12 16:27:26 +00:00
Todd Lipcon
ff8f84ccf6
Merge trunk into branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1396918 13f79535-47bb-0310-9956-ffa450edef68
2012-10-11 06:14:26 +00:00
Todd Lipcon
ad9bcb9e5a
HADOOP-8894. GenericTestUtils.waitFor should dump thread stacks on timeout. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395825 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 00:33:57 +00:00
Eli Collins
2115bd2ec7
HADOOP-8886. Remove KFS support. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395820 13f79535-47bb-0310-9956-ffa450edef68
2012-10-09 00:16:26 +00:00
Eli Collins
c50033d0c8
HADOOP-8804. Improve Web UIs when the wildcard address is used. Contributed by Senthil Kumar
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395703 13f79535-47bb-0310-9956-ffa450edef68
2012-10-08 18:17:39 +00:00
Todd Lipcon
10a0eaaf0a
HDFS-4004. TestJournalNode#testJournal fails because of test case execution order. Contributed by Chao Shi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1393870 13f79535-47bb-0310-9956-ffa450edef68
2012-10-04 01:40:12 +00:00
Daryn Sharp
a7d4f30131
HADOOP-8783. Improve RPC.Server's digest auth (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393483 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 13:43:53 +00:00
Eli Collins
fc54f57c59
HADOOP-8756. Fix SEGV when libsnappy is in java.library.path but not LD_LIBRARY_PATH. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393243 13f79535-47bb-0310-9956-ffa450edef68
2012-10-03 00:06:39 +00:00
Eli Collins
f8f79a02aa
HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393113 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 19:13:53 +00:00
Aaron Myers
ccabb684eb
HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392707 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 01:28:17 +00:00
Aaron Myers
c808caea75
Revert an errant commit of HADOOP-8616.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392705 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 01:26:27 +00:00
Aaron Myers
d1f4ec4ac8
HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392703 13f79535-47bb-0310-9956-ffa450edef68
2012-10-02 01:17:00 +00:00
Jason Darrell Lowe
6ddbb22567
HADOOP-8843. Old trash directories are never deleted on upgrade from 1.x. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390616 13f79535-47bb-0310-9956-ffa450edef68
2012-09-26 17:14:27 +00:00
Harsh J
a7e450c7cc
HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured. Contributed by Brahma Reddy Battula. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389799 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 11:10:11 +00:00
Harsh J
d50e06d9e0
HADOOP-7930. Kerberos relogin interval in UserGroupInformation should be configurable. Contributed by Robert Kanter. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389783 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 10:17:11 +00:00
Suresh Srinivas
44ae25a4e8
HADOOP-8815. RandomDatum needs to override hashCode(). Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389661 13f79535-47bb-0310-9956-ffa450edef68
2012-09-25 00:11:56 +00:00
Harsh J
28379070d4
HADOOP-8588. SerializationFactory shouldn't throw a NullPointerException if the serializations list is empty. Contributed by Sho Shimauchi. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389002 13f79535-47bb-0310-9956-ffa450edef68
2012-09-23 10:32:13 +00:00
Harsh J
28023b7759
HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388893 13f79535-47bb-0310-9956-ffa450edef68
2012-09-22 20:34:16 +00:00
Suresh Srinivas
4c56bccf5e
HADOOP-8814. Replace string equals by String#isEmpty(). Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387853 13f79535-47bb-0310-9956-ffa450edef68
2012-09-20 04:06:11 +00:00
Aaron Myers
d8e386f01a
HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384627 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 01:44:23 +00:00
Doug Cutting
de2efbe3ba
HADOOP-8597. Permit FsShell's text command to read Avro files. Contributed by Ivan Vladimirov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383607 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 20:38:45 +00:00
Todd Lipcon
bdcbc2d1ef
HADOOP-8786. HttpServer continues to start even if AuthenticationFilter fails to init. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383254 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 06:37:17 +00:00
Alejandro Abdelnur
11312adedb
HADOOP-8749. HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. (ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381703 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 18:15:37 +00:00
Aaron Myers
4d265345b7
HADOOP-8766. FileContextMainOperationsBaseTest should randomize the root dir. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381437 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 23:15:20 +00:00
Eli Collins
91e832e7b4
HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 19:42:09 +00:00
Suresh Srinivas
4911d9b1ff
HADOOP-8736. Add Builder for building RPC server. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379652 13f79535-47bb-0310-9956-ffa450edef68
2012-08-31 22:40:51 +00:00
Robert Joseph Evans
6f6e170325
HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 19:58:07 +00:00
Suresh Srinivas
e7b12c89e1
HADOOP-8619. WritableComparator must implement no-arg constructor. Contributed by Chris Douglas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378120 13f79535-47bb-0310-9956-ffa450edef68
2012-08-28 13:05:31 +00:00
Suresh Srinivas
deead78e35
HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377168 13f79535-47bb-0310-9956-ffa450edef68
2012-08-25 01:03:22 +00:00
Suresh Srinivas
7a1dc1ab70
HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377001 13f79535-47bb-0310-9956-ffa450edef68
2012-08-24 17:36:22 +00:00
Robert Joseph Evans
4f8e1f779b
HADOOP-8709. globStatus changed behavior from 0.20/1.x (Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376653 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 19:18:05 +00:00
Robert Joseph Evans
aeb364d8b5
HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 18:06:56 +00:00
Robert Joseph Evans
34bd9794f7
HADOOP-8655. Fix TextInputFormat for large deliminators. (Gelesh via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376592 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 16:58:36 +00:00
Robert Joseph Evans
42beb56a2e
HADOOP-8632. Configuration leaking class-loaders (Costin Leau via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376543 13f79535-47bb-0310-9956-ffa450edef68
2012-08-23 15:24:46 +00:00
Eli Collins
6316b0641d
HADOOP-8720. TestLocalFileSystem should use test root subdirectory. Contributed by Vlad Rozov
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376123 13f79535-47bb-0310-9956-ffa450edef68
2012-08-22 16:21:25 +00:00
Suresh Srinivas
e8477759ac
HADOOP-8711. IPC Server supports adding exceptions for which the message is printed and the stack trace is not printed to avoid chatter. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375790 13f79535-47bb-0310-9956-ffa450edef68
2012-08-21 21:01:28 +00:00
Robert Joseph Evans
d5f080825c
HADOOP-8611. Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails (Robert Parker via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375221 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 21:17:13 +00:00
Eli Collins
f58941f2ac
HADOOP-8614. IOUtils#skipFully hangs forever on EOF. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375216 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 21:10:44 +00:00
Tsz-wo Sze
b0ea77303b
HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374696 13f79535-47bb-0310-9956-ffa450edef68
2012-08-19 05:46:57 +00:00
Eli Collins
18c5bc86ca
HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374472 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 23:22:17 +00:00
Thomas Graves
31cb5a7fa5
HADOOP-8695. TestPathData fails intermittently with JDK7 (Trevor Robinson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374447 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 21:43:31 +00:00
Thomas Graves
9c060fe229
HADOOP-8697. TestWritableName fails intermittently with JDK7 (Trevor Robinson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374349 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 16:38:53 +00:00
Thomas Graves
8bd4a22a26
HADOOP-8693. TestSecurityUtil fails intermittently with JDK7 (Trevor Robinson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374322 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 15:32:50 +00:00
Thomas Graves
fb60303c8e
HADOOP-8692. TestLocalDirAllocator fails intermittently with JDK7 (Trevor Robinson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374312 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 15:18:53 +00:00
Daryn Sharp
8fa10b184e
HADOOP-7967. Need generalized multi-token filesystem support (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68
2012-08-17 14:05:11 +00:00
Thomas Graves
9b6dc1cb45
HADOOP-8390. TestFileSystemCanonicalization fails with JDK7 (Trevor Robinson via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374084 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 22:16:19 +00:00
Robert Joseph Evans
2926ae6ead
HADOOP-8654. TextInputFormat delimiter bug (Gelesh and Jason Lowe via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373859 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 14:23:28 +00:00
Tsz-wo Sze
3cab01ba6e
HADOOP-8700. Use enum to define the checksum constants in DataChecksum.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373683 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 01:32:10 +00:00
Thomas White
4e09b481e7
HADOOP-8278. Make sure components declare correct set of dependencies.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373574 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 19:10:52 +00:00
Alejandro Abdelnur
5aeabcdf6f
HADOOP-7754. Expose file descriptors from Hadoop-wrapped local FileSystems (todd and ahmed via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373235 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 06:40:29 +00:00
Alejandro Abdelnur
fd8ce04dc5
HADOOP-8699. some common testcases create core-site.xml in test-classes making other testcases to fail. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373206 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 04:21:04 +00:00
Suresh Srinivas
28e87740c5
HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68
2012-08-15 00:28:41 +00:00
Alejandro Abdelnur
4bca22005f
HADOOP-8681. add support for HTTPS to the web UIs. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 22:52:56 +00:00
Alejandro Abdelnur
5383694df9
HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370045 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 22:22:32 +00:00
Thomas Graves
12d0e02591
HADOOP-8633. Interrupted FsShell copies may leave tmp files (Daryn Sharp via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368002 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 14:02:22 +00:00
Robert Joseph Evans
75be1e0e76
HADOOP-8637. FilterFileSystem#setWriteChecksum is broken (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367702 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 18:58:43 +00:00
Robert Joseph Evans
7226dead1e
HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367296 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 20:58:44 +00:00
Robert Joseph Evans
d8584fde03
HADOOP-8634. Ensure FileSystem#close doesn't squawk for deleteOnExit paths (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367196 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 18:05:38 +00:00
Robert Joseph Evans
98f1523b20
HADOOP-8627. FS deleteOnExit may delete the wrong path (daryn via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367114 13f79535-47bb-0310-9956-ffa450edef68
2012-07-30 15:18:11 +00:00
Daryn Sharp
b3b72482e4
HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366440 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 16:39:51 +00:00
Aaron Myers
c1ea9b4490
HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 00:26:21 +00:00
Alejandro Abdelnur
9d16c9354b
MAPREDUCE-4417. add support for encrypted shuffle (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68
2012-07-26 13:23:05 +00:00
Todd Lipcon
972953bd77
HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68
2012-07-25 21:52:38 +00:00
Robert Joseph Evans
a2d5603106
HADOOP-8606. FileSystem.get may return the wrong filesystem (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365224 13f79535-47bb-0310-9956-ffa450edef68
2012-07-24 19:00:50 +00:00
Todd Lipcon
28ebdea81d
HADOOP-8537. Fix TFile tests to pass even when native zlib support is not compiled. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362729 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 00:51:32 +00:00
Todd Lipcon
30099efb35
HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362295 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 22:41:56 +00:00
Eli Collins
18f1feb64b
MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362204 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 19:09:33 +00:00
Robert Joseph Evans
612443951b
MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 14:19:36 +00:00
Harsh J
0f122c209d
HADOOP-8531. SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available. Contributed by Madhukara Phatak. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361933 13f79535-47bb-0310-9956-ffa450edef68
2012-07-16 08:33:13 +00:00
Harsh J
7351a01259
HADOOP-7818. DiskChecker#checkDir should fail if the directory is not executable. Contributed by Madhukara Phatak. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361717 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 15:33:27 +00:00
Harsh J
385f31ad85
HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. Contributed by Madhukara Phatak and Suresh Srinivas (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361712 13f79535-47bb-0310-9956-ffa450edef68
2012-07-15 15:07:02 +00:00
Eli Collins
4a5ba3b7bd
HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 19:01:49 +00:00
Aaron Myers
b5b0ac64a1
HADOOP-8541. Better high-percentile latency metrics. Contributed by Andrew Wang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360501 13f79535-47bb-0310-9956-ffa450edef68
2012-07-12 01:31:40 +00:00
Thomas Graves
58a8826fb5
HADOOP-8573. Configuration tries to read from an inputstream resource multiple times (Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359891 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 20:50:17 +00:00
Harsh J
caf9fe2f13
HADOOP-8423. MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data. Contributed by Todd Lipcon. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359866 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 19:58:49 +00:00
Robert Joseph Evans
0b7139d6bc
HADOOP-8525. Provide Improved Traceability for Configuration (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359775 13f79535-47bb-0310-9956-ffa450edef68
2012-07-10 16:49:24 +00:00
Alejandro Abdelnur
820be7cbef
MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68
2012-07-09 19:19:00 +00:00
Eli Collins
6dcf42262d
HDFS-3603. Decouple TestHDFSTrash from TestTrash. Contributed by Jason Lowe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358804 13f79535-47bb-0310-9956-ffa450edef68
2012-07-08 18:15:30 +00:00
Alejandro Abdelnur
0a2252bdda
HADOOP-8566. AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays). (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358454 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 22:27:13 +00:00
Robert Joseph Evans
0e7204c9e7
MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68
2012-07-06 17:19:13 +00:00
Suresh Srinivas
f5186dabb8
HADOOP-8434. Add tests for Configuration setter methods. Contributed by Madhukara Phatak.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356864 13f79535-47bb-0310-9956-ffa450edef68
2012-07-03 18:28:47 +00:00
Eli Collins
161ed29087
HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 22:46:55 +00:00
Suresh Srinivas
22822df7c3
HADOOP-8533. Remove parallel call ununsed capability in RPC. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356504 13f79535-47bb-0310-9956-ffa450edef68
2012-07-02 22:15:44 +00:00
Harsh J
511da1096a
HADOOP-3450. Add tests to Local Directory Allocator for asserting their URI-returning capability. Contributed by Sho Shimauchi. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355789 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 18:51:26 +00:00
Harsh J
cb5867573e
HADOOP-6802. Remove FS_CLIENT_BUFFER_DIR_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated). Contributed by Sho Shimauchi. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355784 13f79535-47bb-0310-9956-ffa450edef68
2012-06-30 18:40:34 +00:00
Todd Lipcon
802f885a55
HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68
2012-06-29 22:24:29 +00:00
Robert Joseph Evans
f455566982
HADOOP-8129. ViewFileSystemTestSetup setupForViewFileSystem is erring (Ahmed Radwan and Ravi Prakash via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354093 13f79535-47bb-0310-9956-ffa450edef68
2012-06-26 16:23:00 +00:00
Harsh J
d1138f0914
HADOOP-8524. Allow users to get source of a Configuration parameter. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352689 13f79535-47bb-0310-9956-ffa450edef68
2012-06-21 21:12:31 +00:00
Alejandro Abdelnur
a30456941d
HADOOP-8509. JarFinder duplicate entry: META-INF/MANIFEST.MF exception (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350008 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 20:47:51 +00:00
Eli Collins
07b8584431
HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68
2012-06-13 02:42:52 +00:00
Eli Collins
0199fe9763
HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349561 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 22:10:12 +00:00
Eli Collins
797c8548d0
Revert HADOOP-8491
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349133 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 06:22:06 +00:00
Tsz-wo Sze
45fafc2b8f
HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68
2012-06-12 05:27:15 +00:00
Eli Collins
6e3ebf4d73
HADOOP-8491. Check for short writes when using FileChannel#write and related methods. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349019 13f79535-47bb-0310-9956-ffa450edef68
2012-06-11 21:20:28 +00:00
Eli Collins
30807fec82
HADOOP-8450. Remove src/test/system. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345794 13f79535-47bb-0310-9956-ffa450edef68
2012-06-03 22:14:16 +00:00
Alejandro Abdelnur
2db30031d2
HADOOP-8368. Use CMake rather than autotools to build native code (ccccabe via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345421 13f79535-47bb-0310-9956-ffa450edef68
2012-06-02 02:34:38 +00:00
Tsz-wo Sze
83cf475050
HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
2012-05-30 19:10:09 +00:00
Harsh J
e576bac2f7
HADOOP-8444. Fix the tests FSMainOperationsBaseTest.java and FileContextMainOperationsBaseTest.java to avoid potential test failure. Contributed by Madhukara Phatak. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343732 13f79535-47bb-0310-9956-ffa450edef68
2012-05-29 14:12:17 +00:00
Harsh J
d2b57e00bc
HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343290 13f79535-47bb-0310-9956-ffa450edef68
2012-05-28 15:36:00 +00:00
Harsh J
4709160d75
HADOOP-6871. When the value of a configuration key is set to its unresolved form, it causes an IllegalStateException in Configuration.get() stating that substitution depth is too large. Contributed by Arvind Prabhakar (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342626 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 14:02:01 +00:00
Harsh J
e62a76a40c
HADOOP-8323. Add javadoc and tests for Text.clear() behavior (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342514 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 06:38:16 +00:00
Harsh J
458be39423
HADOOP-8415. Add getDouble() and setDouble() in org.apache.hadoop.conf.Configuration. Contributed by Jan van der Lugt. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342501 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 06:06:01 +00:00
Eli Collins
22cb0ec82a
HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 04:10:15 +00:00
Todd Lipcon
6c544adeb3
Merge HDFS-3042 (automatic failover) to trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:56:20 +00:00
Aaron Myers
23b96766ad
Amend HADOOP-8408 per Daryn's post-commit feedback.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341338 13f79535-47bb-0310-9956-ffa450edef68
2012-05-22 07:50:00 +00:00
Todd Lipcon
1a3bd5d42f
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 06:12:14 +00:00
Eli Collins
eae281c130
HADOOP-8408. MR doesn't work with a non-default ViewFS mount table and security enabled. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339970 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 04:20:28 +00:00
Harsh J
e1f09365ca
HADOOP-8360. empty-configuration.xml fails xml validation. Contributed by Radim Kolar. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339613 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 14:20:07 +00:00
Todd Lipcon
0600e834be
HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 00:36:13 +00:00
Todd Lipcon
52ecdb751e
HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1338817 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 18:16:49 +00:00
Todd Lipcon
4cd70e87be
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337645 13f79535-47bb-0310-9956-ffa450edef68
2012-05-12 20:52:34 +00:00
Thomas White
aea890f7d2
MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 15:00:48 +00:00
Eli Collins
dfd733401d
HADOOP-8388. Remove unused BlockLocation serialization. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336966 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:48:12 +00:00
Eli Collins
032216a3a7
HADOOP-8361. Avoid out-of-memory problems when deserializing strings. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336945 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:15:53 +00:00
Todd Lipcon
b75f0187c8
HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 00:30:53 +00:00
Suresh Srinivas
1ceecf2aa2
HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname starting with a numeric character. Contributed by Junping Du.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336446 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 23:18:15 +00:00
Robert Joseph Evans
c853a425a0
HADOOP-8373. Port RPC.getServerAddress to 0.23 (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336299 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 17:06:27 +00:00
Thomas White
35a33067bb
HADOOP-8328. Duplicate FileSystem Statistics object for 'file' scheme.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335085 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:00:56 +00:00
Harsh J
e7d03636a0
HADOOP-8323. Revert HADOOP-7940, cause it may cause a performance regression. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334603 13f79535-47bb-0310-9956-ffa450edef68
2012-05-06 11:20:16 +00:00
Aaron Myers
51e520c68a
HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334231 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 22:14:10 +00:00
Alejandro Abdelnur
a70587f368
HADOOP-8343. Allow configuration of authorization for JmxJsonServlet and MetricsServlet (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333750 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 03:31:44 +00:00
Todd Lipcon
03181022ab
HADOOP-8350. Improve NetUtils.getInputStream to return a stream which has a tunable timeout. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333649 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 21:57:10 +00:00
Todd Lipcon
f6c01e2f8e
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 02:14:01 +00:00
Todd Lipcon
9d5799553f
HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 01:56:33 +00:00
Thomas Graves
70c392df0e
HADOOP-8339. jenkins complaining about 16 javadoc warnings (Tom White and Robert Evans via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332853 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 21:46:58 +00:00
Eli Collins
bbfda83044
HADOOP-8275. Range check DelegationKey length. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332839 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 21:25:36 +00:00
Robert Joseph Evans
7d1b804d3a
HADOOP-8172. Configuration no longer sets all keys in a deprecated key list. (Anupam Seth via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332821 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 21:00:52 +00:00
Robert Joseph Evans
1e88c1f088
HADOOP-8335. Improve Configuration's address handling (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332427 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 21:55:26 +00:00
Tsz-wo Sze
f484a3c019
HADOOP-8330. Update TestSequenceFile.testCreateUsesFsArg() for HADOOP-8305. Contributed by John George
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332363 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 20:12:23 +00:00
Alejandro Abdelnur
8a0c7323ce
HADOOP-8325. Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332345 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 19:21:11 +00:00
Robert Joseph Evans
097a001b3f
HADOOP-8334. HttpServer sometimes returns incorrect port (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332336 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 18:56:42 +00:00
Aaron Myers
4b62c68292
HADOOP-8310. FileContext#checkPath should handle URIs with no port. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331007 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:19:01 +00:00
Alejandro Abdelnur
e29ede3f72
HADOOP-8314. HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 03:20:53 +00:00
Alejandro Abdelnur
706e861a85
HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329994 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 20:33:05 +00:00
Todd Lipcon
c6e1321245
HADOOP-8306. ZKFC: improve error message when ZK is not running. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1329960 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 19:34:51 +00:00
Sanjay Radia
589c68ae09
HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 16:34:21 +00:00
Thomas White
0363ca0489
HADOOP-7350. Use ServiceLoader to discover compression codec classes.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328083 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:20:31 +00:00
Todd Lipcon
ca49126e3d
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 23:35:30 +00:00
Harsh J
4e4ba4cd90
HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327618 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:44:18 +00:00
Harsh J
6b69ba6ba1
Reverting all commit booboos made on HADOOP-8290. Resetting to state before that. Sorry for so much noise. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327616 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:42:09 +00:00
Harsh J
d34fee4aa3
HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) (fixed commit after revert)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327615 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:36:35 +00:00
Harsh J
3ac28085a7
HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) (fixed commit)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327611 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:33:57 +00:00
Harsh J
14c61e6504
HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327609 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 18:29:11 +00:00
Aaron Myers
c21bd72a2f
HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 17:06:38 +00:00
Aaron Myers
1675c18ded
Revert HADOOP-8280 so it can be recommitted using `svn mv'
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 16:49:04 +00:00
Robert Joseph Evans
e8eed2f62d
HADOOP-8227. Allow RPC to limit ephemeral port range. (bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327127 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 15:04:20 +00:00
Robert Joseph Evans
a98ba41092
HADOOP-8286. Simplify getting a socket address from conf (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327108 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 14:21:11 +00:00
Aaron Myers
551468385c
HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 18:28:36 +00:00
Robert Joseph Evans
fccbc53357
HADOOP-8283. Allow tests to control token service value (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326668 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 16:08:44 +00:00
Robert Joseph Evans
047a7b276c
HADOOP-7510. Tokens should use original hostname provided instead of ip (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325500 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 20:43:18 +00:00
Todd Lipcon
41a014c31b
HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:40:26 +00:00
Todd Lipcon
693ec453d2
HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310919 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 23:24:57 +00:00
Todd Lipcon
ca6f0940fd
Merge trunk into auto-failover branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310905 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 22:53:55 +00:00
Todd Lipcon
3646705f7a
HADOOP-8260. Replace ClientBaseWithFixes with our own modified copy of the class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310888 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 22:17:17 +00:00
Todd Lipcon
c42a90bd9e
HADOOP-8257. TestZKFailoverControllerStress occasionally fails with Mockito error. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310616 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 22:16:33 +00:00
Robert Joseph Evans
534591697c
HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary (John George via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310507 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 17:54:40 +00:00
Todd Lipcon
b455e54749
Fix trivial mistake in test code in previous merge - tests were failing due to misuse of NodeFencer.create
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310176 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 05:32:02 +00:00
Todd Lipcon
30068a1d83
Merge trunk into auto-failover branch.
...
Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 05:07:33 +00:00
Todd Lipcon
d483b6f3fc
HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 04:56:26 +00:00
Tsz-wo Sze
bf5b508074
HADOOP-6963. In FileUtil.getDU(..), neither include the size of directories nor follow symbolic links. Contributed by Ravi Prakash
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309994 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 18:28:34 +00:00
Todd Lipcon
00a1548005
Merge trunk into auto-HA branch
...
Resolved some trivial conflicts in NNHAServiceTarget
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 20:00:15 +00:00
Todd Lipcon
b74d742785
HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 19:21:01 +00:00
Todd Lipcon
dae6daba8c
HADOOP-8007. Use substitution tokens for fencing argument. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309285 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 08:27:16 +00:00
Todd Lipcon
30e1b3bba8
HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 23:37:15 +00:00
Todd Lipcon
2fd05aa597
Merge trunk into auto-failover branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308260 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 07:28:42 +00:00
Todd Lipcon
a4ccb8f504
HADOOP-8236. haadmin should have configurable timeouts for failover commands. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308235 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 03:48:28 +00:00
Eli Collins
78e3568340
HADOOP-8238. NetUtils#getHostNameOfIP blows up if given ip:port string w/o port. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308192 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 20:07:03 +00:00
Todd Lipcon
543701387f
HADOOP-8228. Auto HA: Refactor tests and add stress tests. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307599 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 20:30:47 +00:00
Todd Lipcon
6693167028
HADOOP-8220. ZKFailoverController doesn't handle failure to become active correctly. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307596 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 20:23:59 +00:00
Todd Lipcon
04416861eb
Amend HADOOP-8212 (Improve ActiveStandbyElector's behavior when session expires)
...
Amendment patch incorporates following feedback from Bikas Saha:
- adds a new functional test for session expiration while in the standby state
- adds a safety check in the StatCallback for session expiration
- improves some comments
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307128 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 21:49:37 +00:00
Eli Collins
978404d1a8
HADOOP-8208. Disallow self failover. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306935 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 15:48:58 +00:00
Todd Lipcon
84a97fbcf6
HADOOP-8218. RPC.closeProxy shouldn't throw error when closing a mock. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306164 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 04:53:26 +00:00
Suresh Srinivas
600e327a56
HADOOP-8202. RPC stopProxy() does not close the proxy correctly. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305704 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 01:31:29 +00:00
Todd Lipcon
578f413778
HADOOP-8206. Common portion of a ZK-based failover controller. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305673 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 23:37:33 +00:00
Todd Lipcon
31c2e3f29c
HADOOP-8212. Improve ActiveStandbyElector's behavior when session expires. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305510 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 19:31:43 +00:00
Todd Lipcon
1d5e7dde95
HADOOP-8204. TestHealthMonitor fails occasionally. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305199 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 01:57:03 +00:00
Todd Lipcon
840df19cee
HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305195 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 01:54:14 +00:00
Todd Lipcon
39775dca68
Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305152 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 21:38:31 +00:00
Todd Lipcon
90ea037d21
HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304967 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 23:48:07 +00:00
Todd Lipcon
805c1280ce
HADOOP-8163. Improve ActiveStandbyElector to provide hooks for fencing old active. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304675 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 00:05:33 +00:00
Thomas White
1ff0359aa0
HADOOP-7030. Add TableMapping topology implementation to read host to rack mapping from a file. Contributed by Patrick Angeles and tomwhite.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304597 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 21:03:30 +00:00
Todd Lipcon
b795c65f49
HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 06:29:40 +00:00
Alejandro Abdelnur
a8ebdaeb08
HADOOP-8197. Configuration logs WARNs on every use of a deprecated key (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303884 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 16:46:48 +00:00
Todd Lipcon
19495b2f4b
HADOOP-7788. Add simple HealthMonitor class to watch an HAService. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303208 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 23:29:18 +00:00
Todd Lipcon
8fd473cf4c
HADOOP-8191. SshFenceByTcpPort uses netcat incorrectly. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303148 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 21:01:39 +00:00
Aaron Myers
21426e6e42
HADOOP-8121. Active Directory Group Mapping Service. Contributed by Jonathan Natkins.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302740 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 01:00:14 +00:00
Robert Joseph Evans
0ac5e89419
HADOOP-8088. User-group mapping cache incorrectly does negative caching on transient failures (Khiwal Lee via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302062 13f79535-47bb-0310-9956-ffa450edef68
2012-03-18 04:07:41 +00:00
Robert Joseph Evans
af3163d1d1
HADOOP-8176. Disambiguate the destination of FsShell copies (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301612 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 16:08:00 +00:00
Tsz-wo Sze
483ca92d9b
HADOOP-8175. Add -p option to mkdir in FsShell. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301303 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 01:28:38 +00:00
Alejandro Abdelnur
9180eca592
HADOOP-8167. Configuration deprecation logic breaks backwards compatibility (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300642 13f79535-47bb-0310-9956-ffa450edef68
2012-03-14 17:07:26 +00:00
Suresh Srinivas
03e036b51e
HADOOP-8164. Back slash as path separator is handled for Windows only. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300290 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 19:07:08 +00:00
Uma Maheswara Rao G
3c373405e0
HADOOP-8146. FsShell commands cannot be interrupted. Contributed by Daryn Shar
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298976 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 18:48:35 +00:00
Eli Collins
d8cc362350
HADOOP-8154. DNS#getIPs shouldn't silently return the local host IP for bogus interface names. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298696 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 03:51:15 +00:00
Robert Joseph Evans
bb86825d49
HADOOP-8140. dfs -getmerge should process its argments better (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297771 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 22:44:26 +00:00
Aaron Myers
ffa527138b
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296485 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 21:43:28 +00:00
Robert Joseph Evans
97d104767d
HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296386 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 19:03:05 +00:00
Todd Lipcon
1d3a0c9557
Fix two more issues from trunk merge just committed -- removal of VersionedProtocol
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295349 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 00:08:13 +00:00
Todd Lipcon
1ba357553a
Merge trunk into HA branch.
...
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 23:47:49 +00:00
Harsh J
e478bc4384
HADOOP-7940. The Text.clear() method does not clear the bytes as intended. Contributed by Csaba Miklos.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295061 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 10:52:22 +00:00
Aaron Myers
375c6b8f2e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294762 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:33:41 +00:00
Alejandro Abdelnur
e43656c711
HADOOP-8098. KerberosAuthenticatorHandler should use _HOST replacement to resolve principal name (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294757 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:26:53 +00:00
Jitendra Nath Pandey
4775adf036
HADOOP-8078. Add capability to turn on security in unit tests. Contributed by Jaimin Jetly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294478 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 06:19:29 +00:00
Aaron Myers
328702891e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293279 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 14:49:38 +00:00
Suresh Srinivas
22d5944c42
HADOOP-8085. Add RPC metrics to ProtobufRpcEngine. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293071 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 04:05:39 +00:00
Aaron Myers
f0db867292
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 18:33:37 +00:00
Steve Loughran
3f8d7dbde3
HADOOP-8046 Revert StaticMapping semantics to the existing ones, add DNS mapping diagnostics in progress
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245911 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 12:57:49 +00:00
Todd Lipcon
ef5d7156db
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:27:51 +00:00
Eli Collins
daf22e5f32
HADOOP-8036. TestViewFsTrash assumes the user's home directory is 2 levels deep. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245751 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 20:46:32 +00:00
Aaron Myers
53b7d6c6bc
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 18:19:31 +00:00
Robert Joseph Evans
1425c65b5e
HADOOP-8054. NPE with FilterFileSystem (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245637 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 16:27:27 +00:00
Aaron Myers
7933dc5838
HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245338 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 07:37:43 +00:00
Todd Lipcon
cdc8146bd4
HADOOP-8068. void methods can swallow exceptions when going through failover path. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244628 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:20:11 +00:00
Aaron Myers
011611c765
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 20:37:10 +00:00
Todd Lipcon
82ffe0e732
HADOOP-8070. Add a standalone benchmark for RPC call performance. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244185 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:29:42 +00:00
Aaron Myers
a0e4ae55f2
HDFS-2942. TestActiveStandbyElectorRealZK fails if build dir does not exist. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243827 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 08:43:58 +00:00
Todd Lipcon
db187cf40e
Merge trunk into HA branch.
...
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:00:37 +00:00
Matthew Foley
00ee0585ab
HADOOP-8052. Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's gmetad core. Contributed by Varun Kapoor.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-12 07:47:35 +00:00
Todd Lipcon
c14bb61a82
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 01:49:08 +00:00
Eli Collins
8af96c7b22
HDFS-2917. HA: haadmin should not work if run by regular user. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242626 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 00:46:17 +00:00
Thomas Graves
2a2faac0de
HADOOP-8048. Allow merging of Credentials (Daryn Sharp via tgraves)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242616 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 00:17:49 +00:00
Robert Joseph Evans
7f7b05226e
HADOOP-8042. When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242389 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 16:41:44 +00:00
Eli Collins
7b913180be
HDFS-2808. HA: haadmin should use namenode ids. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240600 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:12:51 +00:00
Robert Joseph Evans
cf897b6f3c
HADOOP-8013 ViewFileSystem does not honor setVerifyChecksum (Missed a file) (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240385 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 23:02:34 +00:00
Robert Joseph Evans
da00476fca
HADOOP-8013 ViewFileSystem does not honor setVerifyChecksum (Dayrn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240383 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 22:55:52 +00:00
Eli Collins
4324e1bcd7
HADOOP-7991. HA: the FailoverController should check the standby is ready before failing over. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239774 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 19:20:32 +00:00
Robert Joseph Evans
58ba16e85f
HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum files (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239727 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 17:12:44 +00:00
Eli Collins
6884348444
HADOOP-7938. HA: the FailoverController should optionally fence the active during failover. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238058 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 22:42:46 +00:00
Eli Collins
5c156519df
HADOOP-7983. HA: failover should be able to pass args to fencers. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238049 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 22:27:42 +00:00
Todd Lipcon
327c216c2f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:50:23 +00:00
Jitendra Nath Pandey
ed6a73140e
HADOOP-7988. Upper case in hostname part of the principals doesn't work with kerberos.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236960 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:24:08 +00:00
Aaron Myers
2b2e56056e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:21:07 +00:00
Robert Joseph Evans
cc8a2a29f1
HADOOP-7998 CheckFileSystem does not correctly honor setVerifyChecksum (Daryn Sharp via bobby)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236911 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 22:42:47 +00:00
Mahadev Konar
c8bb6f59b8
HADOOP-7993. Hadoop ignores old-style config options for enabling compressed output. (Anupam Seth via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236506 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 03:42:36 +00:00
Eli Collins
c5caed914d
HADOOP-7997. SequenceFile.createWriter(...createParent...) no longer works on existing file. Contributed by Gregory Chanan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236456 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 00:09:10 +00:00
Jitendra Nath Pandey
12289efa2b
HADOOP-7965. Support for protocol version and signature in PB.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236444 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 23:23:03 +00:00
Aaron Myers
1c95060a72
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:03:46 +00:00
Jitendra Nath Pandey
a00640a3db
HADOOP-7987. Support setting the run-as user in unsecure mode.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235945 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 21:02:47 +00:00
Suresh Srinivas
cbfe8fea0e
HADOOP-7992. Add ZKClient library to facilitate leader election. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235841 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 17:26:20 +00:00
Todd Lipcon
212678f036
HDFS-2767. ConfiguredFailoverProxyProvider should support NameNodeProtocol. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232284 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 03:10:25 +00:00
Aaron Myers
940eeb866c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:57:28 +00:00
Eli Collins
aee1bb81c6
HADOOP-7974. TestViewFsTrash incorrectly determines the user's home directory. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231640 13f79535-47bb-0310-9956-ffa450edef68
2012-01-15 08:51:48 +00:00
Eli Collins
1c24ae0cd8
HDFS-2789. TestHAAdmin.testFailover is failing. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1231577 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 20:19:55 +00:00
Aaron Myers
8610a9231a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 18:40:50 +00:00