big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,974 Commits 2 Branches 2 Tags 264 MiB
4cd70e87be
Commit Graph

780 Commits

Author SHA1 Message Date
Todd Lipcon
4cd70e87be Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337645 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 20:52:34 +00:00
Tsz-wo Sze
3d18382285 Move HDFS-3211 to 2.0.0 in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337432 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-12 01:57:50 +00:00
Thomas White
aea890f7d2 MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 15:00:48 +00:00
Aaron Myers
5dbd09ee76 HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337030 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 05:57:37 +00:00
Eli Collins
8def56e51e HDFS-3400. DNs should be able start with jsvc even if security is disabled. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337017 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 03:15:54 +00:00
Tsz-wo Sze
ba6360e493 HDFS-3385. The last block of INodeFileUnderConstruction is not necessarily a BlockInfoUnderConstruction, so do not cast it in FSNamesystem.recoverLeaseInternal(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336976 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 00:25:48 +00:00
Eli Collins
fcb4b1995b HDFS-3401. Cleanup DatanodeDescriptor creation in the tests. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336972 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-11 00:03:37 +00:00
Eli Collins
98b00d7cc0 HDFS-3134. harden edit log loader against malformed or malicious input. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336943 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 23:13:02 +00:00
Tsz-wo Sze
7e8e983620 HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336909 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 21:41:25 +00:00
Eli Collins
6a0865440e HDFS-3230. Cleanup DatanodeID creation in the tests. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336815 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 17:58:55 +00:00
Aaron Myers
f5960f71d9 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336690 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 13:49:06 +00:00
Uma Maheswara Rao G
f1ff05bf47 Reverting (Need to re-do the patch. new BlockInfo does not set iNode ) HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336572 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 09:59:39 +00:00
Eli Collins
54303465a6 HDFS-3396. FUSE build fails on Ubuntu 12.04. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336495 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 06:28:56 +00:00
Eli Collins
a67054d7c3 HDFS-3328. NPE in DataNode.getIpcPort. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336480 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 04:52:46 +00:00
Todd Lipcon
b75f0187c8 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-10 00:30:53 +00:00
Aaron Myers
e3fbc52686 HDFS-3390. DFSAdmin should print full stack traces of errors when DEBUG logging is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336324 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-09 18:16:40 +00:00
Tsz-wo Sze
27ce5a6fb0 Remove the empty file FSInodeInfo.java for HDFS-3363. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335788 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 21:53:11 +00:00
Uma Maheswara Rao G
408e558d8d HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. Contributed by Ashish Singhi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335719 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 19:45:38 +00:00
Eli Collins
1d7b980592 HDFS-3378. Remove DFS_NAMENODE_SECONDARY_HTTPS_PORT_KEY and DEFAULT. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335309 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 00:25:34 +00:00
Tsz-wo Sze
f0f9a3631f HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileUnderConstruction do not have to be used in block management. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335304 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-08 00:06:09 +00:00
Todd Lipcon
7aa2889f82 HDFS-3375. Put client name in DataXceiver thread name for readBlock and keepalive. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335270 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 21:34:30 +00:00
Todd Lipcon
567aed4f2c HDFS-3365. Enable users to disable socket caching in DFS client configuration. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335222 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 19:56:23 +00:00
Todd Lipcon
eca2c850a5 HDFS-3376. DFSClient fails to make connection to DN if there are many unusable cached sockets. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335115 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-07 16:42:19 +00:00
Aaron Myers
51e520c68a HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334231 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 22:14:10 +00:00
Eli Collins
a2eb525ce1 Move HDFS-2617 commit message to the right place. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334223 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 22:01:57 +00:00
Eli Collins
5dbbe0e0a5 HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334216 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 21:58:44 +00:00
Tsz-wo Sze
0bf8f11860 HDFS-3303. Remove Writable implementation from RemoteEditLogManifest. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334156 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 20:16:23 +00:00
Todd Lipcon
a701c792f8 HDFS-3357. DataXceiver reads from client socket with incorrect/no timeout. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334116 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-04 18:50:54 +00:00
Tsz-wo Sze
dd8b7ae9d8 HDFS-3350. In INode, add final to compareTo(..), equals(..) and hashCode(), and remove synchronized from updatePermissionStatus(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333679 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 23:33:44 +00:00
Todd Lipcon
03181022ab HADOOP-8350. Improve NetUtils.getInputStream to return a stream which has a tunable timeout. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333649 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 21:57:10 +00:00
Todd Lipcon
25882b199b HDFS-3359. DFSClient.close should close cached sockets. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333624 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 21:13:43 +00:00
Uma Maheswara Rao G
9aae7c22ac HDFS-3332. NullPointerException in DN when directoryscanner is trying to report bad blocks. Contributed by Amith D K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333587 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 19:05:38 +00:00
Aaron Myers
470b1197be HDFS-3351. NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333299 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 03:00:10 +00:00
Todd Lipcon
f6c01e2f8e Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 02:14:01 +00:00
Todd Lipcon
9d5799553f HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 01:56:33 +00:00
Todd Lipcon
cbc2424290 HDFS-3330. If GetImageServlet throws an Error or RTE, response should not have HTTP "OK" status. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333286 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-03 01:44:22 +00:00
Alejandro Abdelnur
e1a961d1bc HDFS-3336. hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.logger (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333236 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-02 22:47:04 +00:00
Tsz-wo Sze
8620a99d1e HDFS-3339. Change INode to package private. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332876 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 23:02:53 +00:00
Uma Maheswara Rao G
d37ec9d09e HDFS-3286. When the threshold value for balancer is zero, unexpected output is displayed. Contributed by Ashish Singhi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332531 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 06:44:12 +00:00
Uma Maheswara Rao G
086fa860c0 HDFS-3275. Skip format for non-file based directories. Contributed by Amith D K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332527 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-01 05:47:27 +00:00
Tsz-wo Sze
2af70cb517 HDFS-3293. Add toString(), equals(..) and hashCode() to JournalInfo. Contributed by Hari Mankude 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332458 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 22:57:22 +00:00
Matthew Foley
c203c7628c HDFS-3265. PowerPc Build error. Contributed by Kumar Ravi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332107 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-30 08:27:34 +00:00
Uma Maheswara Rao G
d5edc04635 HDFS-2743. Streamline usage of bookkeeper journal manager. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331790 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-28 16:17:25 +00:00
Eli Collins
a22c138291 HDFS-3326. Append enabled log message uses the wrong variable. Contributed by Matthew Jacobs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331626 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 23:03:45 +00:00
Tsz-wo Sze
cd271773ac HDFS-3331. In namenode, check superuser privilege for setBalancerBandwidth and acquire the write lock for finalizeUpgrade. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331598 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 21:17:53 +00:00
Tsz-wo Sze
920b8fac18 HDFS-3334. Fix ByteRangeInputStream stream leakage. Contributed by Daryn Sharp 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331570 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 20:13:17 +00:00
Alejandro Abdelnur
84b36cfd80 HDFS-3309. HttpFS (Hoop) chmod not supporting octal and sticky bit permissions. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331493 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-27 16:30:22 +00:00
Tsz-wo Sze
3e835c47d1 HDFS-3181. Fix a test case in TestLeaseRecovery2. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331138 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 22:44:34 +00:00
Tsz-wo Sze
1a76c82a31 HDFS-3322. Use HdfsDataInputStream and HdfsDataOutputStream in Hdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331114 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 21:50:50 +00:00
Uma Maheswara Rao G
d28b982428 HDFS-3222. DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331061 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-26 20:18:01 +00:00