big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,283 Commits 2 Branches 2 Tags
Commit Graph

1083 Commits

Author SHA1 Message Date
Tsz-wo Sze
37d6f14560 Merge r1479733 through r1480439 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480440 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 20:20:56 +00:00
Steve Loughran
fa56ccfd53 HADOOP-9540. Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing. Hari 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479985 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 17:21:14 +00:00
Tsz-wo Sze
393188c445 Merge r1477868 through r1479732 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479733 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 00:17:50 +00:00
Sanjay Radia
725623534c HADOOP-9425 Add error codes to rpc-response (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479143 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-04 17:51:22 +00:00
Vinod Kumar Vavilapalli
bfc73613fc HADOOP-9511. Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils so as to help YARN-578. Contributed by Omkar Vinit Joshi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1479010 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-03 23:43:12 +00:00
Suresh Srinivas
776eb119ac HADOOP-9523. Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs. Contributed by Tian Hong Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478634 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-03 03:36:51 +00:00
Suresh Srinivas
afa786098a HADOOP-9483. winutils support for readlink command. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478592 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 22:39:56 +00:00
Suresh Srinivas
1c762c01c4 HADOOP-9043. Disallow in winutils creating symlinks with forwards slashes. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478577 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 21:40:36 +00:00
Sanjay Radia
6096cb3435 HDFS-4659 Support setting execution bit for regular files (Brandon Li via sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477994 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-01 13:31:08 +00:00
Christopher Douglas
0728f00282 HADOOP-8608. Add Configuration API for parsing time durations. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477869 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 23:07:21 +00:00
Tsz-wo Sze
faca77f227 Merge r1476453 through r1477867 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477868 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 23:02:35 +00:00
Aaron Myers
bfef63719d HADOOP-9338. FsShell Copy Commands Should Optionally Preserve File Attributes. Contributed by Nick White. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477714 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 16:27:58 +00:00
Suresh Srinivas
30b7a9c49f HADOOP-9413. Add common utils for File#setReadable/Writable/Executable & File#canRead/Write/Execute that work cross-platform. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477376 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 22:12:57 +00:00
Suresh Srinivas
293fb1ec1e HADOOP-9524. Fix ShellCommandFencer to work on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476856 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-28 23:16:47 +00:00
Suresh Srinivas
f5ef2db500 HADOOP-9500. TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476606 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 15:44:33 +00:00
Suresh Srinivas
27b3f84fe5 Merge trunk to HDFS-2802 branch. This involves fixing many conflict with HDFS-4434. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470225 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 20:22:21 +00:00
Suresh Srinivas
0b101bd7e8 HDFS-4434. Reverting change r1470089 that merges trunk to HDFS-2802. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470194 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 16:57:44 +00:00
Suresh Srinivas
9af0babe7e Merging trunk after fixing conflict with HDFS-4434. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470089 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 00:02:43 +00:00
Bikas Saha
7c66645417 HADOOP-9488. FileUtil#createJarWithClassPath only substitutes environment variables from current process environment/does not support overriding when launching new process (Chris Nauroth via bikas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469996 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 19:23:35 +00:00
Tsz-wo Sze
0ad27ad3e3 HDFS-4707. Add snapshot methods to FilterFileSystem and fix findbugs warnings. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469119 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-18 01:28:00 +00:00
Aaron Myers
b7aaa1b74c Merge trunk into the HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1467511 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-12 23:05:28 +00:00
Jason Darrell Lowe
390deffbaf HADOOP-9233. Cover package org.apache.hadoop.io.compress.zlib with unit tests. Contributed by Vadim Bondarev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467090 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 21:17:56 +00:00
Jason Darrell Lowe
3131636249 HADOOP-9222. Cover package with org.apache.hadoop.io.lz4 unit tests. Contributed by Vadim Bondarev 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467072 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-11 20:16:49 +00:00
Luke Lu
4edf48c7ad HADOOP-9467. Metrics2 record filter should check name as well as tags. (Ganeshan Iyler via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466377 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 08:25:37 +00:00
Suresh Srinivas
2b19054c92 HADOOP-9437. TestNativeIO#testRenameTo fails on Windows due to assumption that POSIX errno is embedded in NativeIOException. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466306 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 00:45:47 +00:00
Todd Lipcon
f0351527d5 HDFS-4643. Fix flakiness in TestQuorumJournalManager. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466253 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 21:34:12 +00:00
Todd Lipcon
087acf8fd6 HDFS-3981. Fix handling of FSN lock in getBlockLocations. Contributed by Xiaobo Peng and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465751 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-08 19:57:16 +00:00
Aaron Myers
a9d515aed8 HDFS-1804. Add a new block-volume device choosing policy that looks at free space. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465183 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-06 04:08:09 +00:00
Suresh Srinivas
28c74a21ea HADOOP-9429. TestConfiguration fails with IBM JAVA. Contributed by Amir Sanjar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464725 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 20:26:20 +00:00
Luke Lu
ab850368e8 HADOOP-9451. Fault single-layer config if node group topology is enabled. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464301 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 07:07:59 +00:00
Alejandro Abdelnur
da0e779e4b HADOOP-9401. CodecPool: Add counters for number of (de)compressors leased out. (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464219 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-03 22:26:47 +00:00
Eli Collins
0e9f61addc Revert initial HADOOP-9357 patch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464182 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-03 19:43:29 +00:00
Todd Lipcon
c45c8ee720 Complete commit of prior merge. 
The previous merge accidentally only committed the hdfs project instead of common and MR
as well.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1463203 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-01 16:47:16 +00:00
Todd Lipcon
1611b51a97 HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1462303 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-28 20:58:45 +00:00
Eli Collins
799e3c344e HADOOP-9357. Fallback to default authority if not specified in FileContext. Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461898 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 23:43:45 +00:00
Aaron Myers
fc5fd80e9f HADOOP-9125. LdapGroupsMapping threw CommunicationException after some idle time. Contributed by Kai Zheng. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461863 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 21:49:43 +00:00
Luke Lu
5319818487 HADOOP-9194. RPC Support for QoS. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461370 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-26 23:29:09 +00:00
Sanjay Radia
5e325d4562 HADOOP-9433 TestLocalFileSystem#testHasFileDescriptor leaks file handle (Chris Nauroth via sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460922 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-25 22:30:30 +00:00
Steve Loughran
a10055cf6d HADOOP-9258 Add stricter tests to FileSystemContractTestBase (includes fixes for production code HADOOP-9261 & HADOOP-9265 and test enhancements HADOOP-9228, HADOOP-9227 & HADOOP-9259) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460646 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-25 13:12:27 +00:00
Sanjay Radia
1186572389 HADOOP-9431 TestSecurityUtil#testLocalHostNameForNullOrWild on systems where hostname contains capital letters (Chris Nauroth via sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1460181 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-23 16:07:48 +00:00
Tsz-wo Sze
883601a1d6 HADOOP-9387. Fix DF so that it won't execute a shell command on Windows to compute the file system/mount point. Contributed by Ivan Mitic 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459642 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-22 06:26:52 +00:00
Aaron Myers
64741f4635 HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457878 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 17:20:13 +00:00
Daryn Sharp
7eb7b3b723 HADOOP-9299. kerberos name resolution is kicking in even when kerberos is not configured (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457763 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 13:46:52 +00:00
Aaron Myers
c2003ab56b HADOOP-9318. When exiting on a signal, print the signal name first. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457122 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 21:16:41 +00:00
Aaron Myers
3bf09c5150 HDFS-4591. HA clients can fail to fail over while Standby NN is performing long checkpoint. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456107 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 19:51:19 +00:00
Suresh Srinivas
ebf2e6b363 HADOOP-9099. NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455629 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 17:11:35 +00:00
Aaron Myers
f75592f16e HADOOP-9393. TestRPC fails with JDK7. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455418 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 06:26:07 +00:00
Suresh Srinivas
f5227eb51c HADOOP-8973. DiskChecker cannot reliably detect an inaccessible disk on Windows with NTFS ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454889 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-10 18:17:41 +00:00
Suresh Srinivas
a3c4488efd HADOOP-9364. PathData#expandAsGlob does not return correct results for absolute paths on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454108 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 21:32:12 +00:00
Daryn Sharp
6d4ab86412 HADOOP-9374. Add tokens from -tokenCacheFile into UGI (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454019 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:22:44 +00:00