Uma Maheswara Rao G
e767845c36
HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342534 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 08:56:59 +00:00
Harsh J
befd45fcb1
HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342520 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 07:04:35 +00:00
Konstantin Shvachko
2e0a15c488
HDFS-3368. Missing blocks due to bad DataNodes coming up and down.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342512 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 06:29:17 +00:00
Eli Collins
22cb0ec82a
HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 04:10:15 +00:00
Eli Collins
39661c06f7
Revert HDFS-3058
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342493 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 03:56:12 +00:00
Uma Maheswara Rao G
64ec449010
HDFS-3058. HA: Bring BookKeeperJournalManager up to date with HA changes. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342483 13f79535-47bb-0310-9956-ffa450edef68
2012-05-25 01:31:23 +00:00
Todd Lipcon
6c544adeb3
Merge HDFS-3042 (automatic failover) to trunk.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:56:20 +00:00
Todd Lipcon
14bf2d4357
HDFS-1013. Miscellaneous improvements to HTML markup for web UIs. Contributed by Eugene Koontz.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342102 13f79535-47bb-0310-9956-ffa450edef68
2012-05-24 00:27:51 +00:00
Todd Lipcon
74dfa8f1f2
HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342042 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 20:42:48 +00:00
Tsz-wo Sze
ade42bce10
HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341961 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 17:59:30 +00:00
Eli Collins
445018cea8
HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341916 13f79535-47bb-0310-9956-ffa450edef68
2012-05-23 15:56:59 +00:00
Tsz-wo Sze
aa80e6895d
HDFS-3415. Make sure all layout versions are the same for all storage directories in the Namenode. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341676 13f79535-47bb-0310-9956-ffa450edef68
2012-05-22 23:18:04 +00:00
Tsz-wo Sze
d69510a7f8
HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341141 13f79535-47bb-0310-9956-ffa450edef68
2012-05-21 18:51:15 +00:00
Eli Collins
260dfa367e
HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 21:13:17 +00:00
Uma Maheswara Rao G
75041b9950
HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340750 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 15:14:53 +00:00
Todd Lipcon
1a3bd5d42f
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68
2012-05-20 06:12:14 +00:00
Todd Lipcon
d1a54b872d
HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340343 13f79535-47bb-0310-9956-ffa450edef68
2012-05-19 05:13:38 +00:00
Aaron Myers
ea0baa3609
HDFS-3444. hdfs groups command doesn't work with security enabled. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340260 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 21:25:21 +00:00
Todd Lipcon
7d1f97b821
HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339978 13f79535-47bb-0310-9956-ffa450edef68
2012-05-18 05:28:18 +00:00
Todd Lipcon
5258d6bf3f
HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339897 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 22:30:46 +00:00
Todd Lipcon
15ddb6634f
HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339745 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 17:49:48 +00:00
Eli Collins
5ef725eb53
HDFS-3434. InvalidProtocolBufferException when visiting DN browseDirectory.jsp. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339712 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 17:01:13 +00:00
Eli Collins
6d71407582
HDFS-1153. dfsnodelist.jsp should handle invalid input parameters. Contributed by Ravi Phulari
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339706 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 16:55:49 +00:00
Aaron Myers
1377709b4c
HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 10:23:18 +00:00
Todd Lipcon
ba1e4a823a
HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339452 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 02:45:47 +00:00
Todd Lipcon
0600e834be
HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68
2012-05-17 00:36:13 +00:00
Eli Collins
97e1d5c9ad
HDFS-860. fuse-dfs truncate behavior causes issues with scp. Contributed by Brian Bockelman
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339413 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 22:57:18 +00:00
Todd Lipcon
e14e10fb86
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339410 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 22:47:37 +00:00
Aaron Myers
7286e8a9da
HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339250 13f79535-47bb-0310-9956-ffa450edef68
2012-05-16 16:24:38 +00:00
Eli Collins
dac828de0f
HDFS-3197. Incorrect class comments in a few tests. Contributed by Andy Isaacson
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338880 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 20:37:12 +00:00
Eli Collins
7428aeca86
HDFS-3418. Rename BlockWithLocationsProto datanodeIDs field to storageIDs. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338830 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 19:03:14 +00:00
Todd Lipcon
52ecdb751e
HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1338817 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 18:16:49 +00:00
Eli Collins
c4e4e56160
HDFS-3419. Cleanup LocatedBlock. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338802 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 17:23:50 +00:00
Eli Collins
e9a7648f62
HDFS-3416. Cleanup DatanodeID and DatanodeRegistration constructors used by testing. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338784 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 16:23:52 +00:00
Eli Collins
e4df14f8f1
HDFS-3417. Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338767 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 16:01:44 +00:00
Todd Lipcon
95710c15b7
HDFS-3335. check for edit log corruption at the end of the log. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338492 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 00:41:37 +00:00
Aaron Myers
a8eef98f41
HDFS-3163. TestHDFSCLI.testAll fails if the user name is not all lowercase. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338486 13f79535-47bb-0310-9956-ffa450edef68
2012-05-15 00:14:51 +00:00
Todd Lipcon
bcdb125643
HDFS-3031. Fix complete() and getAdditionalBlock() RPCs to be idempotent. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338466 13f79535-47bb-0310-9956-ffa450edef68
2012-05-14 22:35:25 +00:00
Aaron Myers
05c5fcfb42
HDFS-3414. Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338275 13f79535-47bb-0310-9956-ffa450edef68
2012-05-14 16:25:17 +00:00
Harsh J
f1560d379d
HDFS-2312. FSNamesystem javadoc incorrectly says its for DNs. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337761 13f79535-47bb-0310-9956-ffa450edef68
2012-05-13 03:33:19 +00:00
Aaron Myers
f22341ab1a
HDFS-3404. Make putImage in GetImageServlet infer remote address to fetch from request. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337755 13f79535-47bb-0310-9956-ffa450edef68
2012-05-13 02:51:33 +00:00
Todd Lipcon
4cd70e87be
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337645 13f79535-47bb-0310-9956-ffa450edef68
2012-05-12 20:52:34 +00:00
Thomas White
aea890f7d2
MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 15:00:48 +00:00
Aaron Myers
5dbd09ee76
HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337030 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 05:57:37 +00:00
Eli Collins
8def56e51e
HDFS-3400. DNs should be able start with jsvc even if security is disabled. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337017 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 03:15:54 +00:00
Tsz-wo Sze
ba6360e493
HDFS-3385. The last block of INodeFileUnderConstruction is not necessarily a BlockInfoUnderConstruction, so do not cast it in FSNamesystem.recoverLeaseInternal(..).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336976 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 00:25:48 +00:00
Eli Collins
fcb4b1995b
HDFS-3401. Cleanup DatanodeDescriptor creation in the tests. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336972 13f79535-47bb-0310-9956-ffa450edef68
2012-05-11 00:03:37 +00:00
Eli Collins
98b00d7cc0
HDFS-3134. harden edit log loader against malformed or malicious input. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336943 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 23:13:02 +00:00
Tsz-wo Sze
7e8e983620
HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336909 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 21:41:25 +00:00
Eli Collins
6a0865440e
HDFS-3230. Cleanup DatanodeID creation in the tests. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336815 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 17:58:55 +00:00
Aaron Myers
f5960f71d9
HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336690 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 13:49:06 +00:00
Uma Maheswara Rao G
f1ff05bf47
Reverting (Need to re-do the patch. new BlockInfo does not set iNode ) HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336572 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 09:59:39 +00:00
Eli Collins
54303465a6
HDFS-3396. FUSE build fails on Ubuntu 12.04. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336495 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 06:28:56 +00:00
Eli Collins
a67054d7c3
HDFS-3328. NPE in DataNode.getIpcPort. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336480 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 04:52:46 +00:00
Todd Lipcon
b75f0187c8
HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68
2012-05-10 00:30:53 +00:00
Aaron Myers
e3fbc52686
HDFS-3390. DFSAdmin should print full stack traces of errors when DEBUG logging is enabled. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336324 13f79535-47bb-0310-9956-ffa450edef68
2012-05-09 18:16:40 +00:00
Tsz-wo Sze
27ce5a6fb0
Remove the empty file FSInodeInfo.java for HDFS-3363.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335788 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 21:53:11 +00:00
Uma Maheswara Rao G
408e558d8d
HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. Contributed by Ashish Singhi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335719 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 19:45:38 +00:00
Eli Collins
1d7b980592
HDFS-3378. Remove DFS_NAMENODE_SECONDARY_HTTPS_PORT_KEY and DEFAULT. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335309 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 00:25:34 +00:00
Tsz-wo Sze
f0f9a3631f
HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileUnderConstruction do not have to be used in block management. Contributed by John George
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335304 13f79535-47bb-0310-9956-ffa450edef68
2012-05-08 00:06:09 +00:00
Todd Lipcon
7aa2889f82
HDFS-3375. Put client name in DataXceiver thread name for readBlock and keepalive. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335270 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 21:34:30 +00:00
Todd Lipcon
567aed4f2c
HDFS-3365. Enable users to disable socket caching in DFS client configuration. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335222 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 19:56:23 +00:00
Todd Lipcon
eca2c850a5
HDFS-3376. DFSClient fails to make connection to DN if there are many unusable cached sockets. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1335115 13f79535-47bb-0310-9956-ffa450edef68
2012-05-07 16:42:19 +00:00
Aaron Myers
51e520c68a
HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334231 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 22:14:10 +00:00
Eli Collins
5dbbe0e0a5
HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334216 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 21:58:44 +00:00
Tsz-wo Sze
0bf8f11860
HDFS-3303. Remove Writable implementation from RemoteEditLogManifest. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334156 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 20:16:23 +00:00
Todd Lipcon
a701c792f8
HDFS-3357. DataXceiver reads from client socket with incorrect/no timeout. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1334116 13f79535-47bb-0310-9956-ffa450edef68
2012-05-04 18:50:54 +00:00
Tsz-wo Sze
dd8b7ae9d8
HDFS-3350. In INode, add final to compareTo(..), equals(..) and hashCode(), and remove synchronized from updatePermissionStatus(..).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333679 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 23:33:44 +00:00
Todd Lipcon
03181022ab
HADOOP-8350. Improve NetUtils.getInputStream to return a stream which has a tunable timeout. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333649 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 21:57:10 +00:00
Todd Lipcon
25882b199b
HDFS-3359. DFSClient.close should close cached sockets. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333624 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 21:13:43 +00:00
Uma Maheswara Rao G
9aae7c22ac
HDFS-3332. NullPointerException in DN when directoryscanner is trying to report bad blocks. Contributed by Amith D K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333587 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 19:05:38 +00:00
Aaron Myers
470b1197be
HDFS-3351. NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333299 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 03:00:10 +00:00
Todd Lipcon
f6c01e2f8e
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 02:14:01 +00:00
Todd Lipcon
9d5799553f
HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 01:56:33 +00:00
Todd Lipcon
cbc2424290
HDFS-3330. If GetImageServlet throws an Error or RTE, response should not have HTTP "OK" status. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333286 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 01:44:22 +00:00
Alejandro Abdelnur
e1a961d1bc
HDFS-3336. hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.logger (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333236 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 22:47:04 +00:00
Tsz-wo Sze
8620a99d1e
HDFS-3339. Change INode to package private. Contributed by John George
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332876 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 23:02:53 +00:00
Uma Maheswara Rao G
d37ec9d09e
HDFS-3286. When the threshold value for balancer is zero, unexpected output is displayed. Contributed by Ashish Singhi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332531 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 06:44:12 +00:00
Uma Maheswara Rao G
086fa860c0
HDFS-3275. Skip format for non-file based directories. Contributed by Amith D K.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332527 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 05:47:27 +00:00
Tsz-wo Sze
2af70cb517
HDFS-3293. Add toString(), equals(..) and hashCode() to JournalInfo. Contributed by Hari Mankude
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332458 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 22:57:22 +00:00
Matthew Foley
c203c7628c
HDFS-3265. PowerPc Build error. Contributed by Kumar Ravi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332107 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 08:27:34 +00:00
Uma Maheswara Rao G
d5edc04635
HDFS-2743. Streamline usage of bookkeeper journal manager. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331790 13f79535-47bb-0310-9956-ffa450edef68
2012-04-28 16:17:25 +00:00
Eli Collins
a22c138291
HDFS-3326. Append enabled log message uses the wrong variable. Contributed by Matthew Jacobs
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331626 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 23:03:45 +00:00
Tsz-wo Sze
cd271773ac
HDFS-3331. In namenode, check superuser privilege for setBalancerBandwidth and acquire the write lock for finalizeUpgrade.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331598 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 21:17:53 +00:00
Tsz-wo Sze
920b8fac18
HDFS-3334. Fix ByteRangeInputStream stream leakage. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331570 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 20:13:17 +00:00
Tsz-wo Sze
3e835c47d1
HDFS-3181. Fix a test case in TestLeaseRecovery2.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331138 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 22:44:34 +00:00
Tsz-wo Sze
1a76c82a31
HDFS-3322. Use HdfsDataInputStream and HdfsDataOutputStream in Hdfs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331114 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 21:50:50 +00:00
Uma Maheswara Rao G
d28b982428
HDFS-3222. DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331061 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 20:18:01 +00:00
Eli Collins
2b254dad2e
HDFS-3258. Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node). Contributed by Junping Du
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330613 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 00:47:16 +00:00
Tsz-wo Sze
3b773da036
HDFS-3319. Change DFSOutputStream to not to start a thread in constructors.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330535 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 20:17:20 +00:00
Tsz-wo Sze
2584779166
HDFS-3321. Fix safe mode turn off tip message. Contributed by Ravi Prakash
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330506 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 19:34:36 +00:00
Tsz-wo Sze
f86352c2df
HDFS-3318. Use BoundedInputStream in ByteRangeInputStream, otherwise, it hangs on transfers >2 GB. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330500 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 19:24:00 +00:00
Tsz-wo Sze
ea32198db4
HDFS-3298. Add HdfsDataOutputStream as a public API.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330064 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 23:39:43 +00:00
Alejandro Abdelnur
706e861a85
HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329994 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 20:33:05 +00:00
Tsz-wo Sze
93c5585d31
HDFS-3312. In HftpFileSystem, the namenode URI is non-secure but the delegation tokens have to use secure URI. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329462 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 21:27:01 +00:00
Sanjay Radia
589c68ae09
HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 16:34:21 +00:00
Tsz-wo Sze
cdbe15ccdc
HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328541 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 23:59:19 +00:00
Tsz-wo Sze
201af20406
Revert r1328482 for HDFS-3308.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328487 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 19:32:23 +00:00
Tsz-wo Sze
ab8f458742
HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328482 13f79535-47bb-0310-9956-ffa450edef68
2012-04-20 19:16:58 +00:00
Aaron Myers
49ed783a3a
HDFS-3305. GetImageServlet should consider SBN a valid requestor in a secure HA setup. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328115 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 20:43:03 +00:00
Uma Maheswara Rao G
ba4ec5f0aa
iHDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327790 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 02:41:32 +00:00
Uma Maheswara Rao G
c6d3537d33
HDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327788 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 02:34:44 +00:00
Eli Collins
4550627cab
HDFS-3169. TestFsck should test multiple -move operations in a row. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327776 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:51:13 +00:00
Eli Collins
54e61ffdc0
HDFS-3206. Miscellaneous xml cleanups for OEV. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327768 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:31:53 +00:00
Eli Collins
0c16ec4d6e
HDFS-891. DataNode no longer needs to check for dfs.network.script. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327762 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 01:09:12 +00:00
Todd Lipcon
ca49126e3d
Merge trunk into auto-HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 23:35:30 +00:00
Tsz-wo Sze
2bf8be3c72
HDFS-3292. Remove the deprecated DiskStatus, getDiskStatus(), getRawCapacity() and getRawUsed() from DistributedFileSystem. Contributed by Arpit Gupta
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327664 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 20:21:08 +00:00
Tsz-wo Sze
eeec4dc72a
HDFS-3294. Fix code indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327365 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 03:25:08 +00:00
Tsz-wo Sze
c80dbe5e09
HDFS-2652. Add support for host-based delegation tokens. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327309 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 22:21:33 +00:00
Aaron Myers
c21bd72a2f
HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 17:06:38 +00:00
Aaron Myers
1675c18ded
Revert HADOOP-8280 so it can be recommitted using `svn mv'
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 16:49:04 +00:00
Eli Collins
1d5861a8c4
HDFS-3165. HDFS Balancer scripts are refering to wrong path of hadoop-daemon.sh. Contributed by Amith D K
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326848 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 00:50:40 +00:00
Todd Lipcon
574f99bd6b
HDFS-3284. bootstrapStandby fails in secure cluster. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326813 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 21:51:52 +00:00
Tsz-wo Sze
f1667dee14
HDFS-3279. Move the FSEditLog constructor with @VisibleForTesting to TestEditLog. Contributed by Arpit Gupta
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326762 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 19:31:34 +00:00
Todd Lipcon
258da66cc7
HDFS-3268. FileContext API mishandles token service and incompatible with HA. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326747 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 19:08:29 +00:00
Aaron Myers
551468385c
HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 18:28:36 +00:00
Aaron Myers
15fe3ae61b
HDFS-2708. Stats for the # of blocks per DN. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326039 13f79535-47bb-0310-9956-ffa450edef68
2012-04-14 01:51:03 +00:00
Tsz-wo Sze
841fdc5628
HDFS-3273. Refactor BackupImage and FSEditLog, and rename JournalListener.rollLogs(..) to startLogSegment(..).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326016 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 23:41:01 +00:00
Eli Collins
5a20d446cf
HDFS-2799. Trim fs.checkpoint.dir values. Contributed by Amith D K
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325963 13f79535-47bb-0310-9956-ffa450edef68
2012-04-13 21:31:27 +00:00
Todd Lipcon
2ed825e66c
HDFS-3159. Document NN auto-failover setup and configuration. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325539 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:53:42 +00:00
Aaron Myers
4f230adc13
HDFS-3256. HDFS considers blocks under-replicated if topology script is configured with only 1 rack. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325531 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:28:44 +00:00
Aaron Myers
07a4367445
HDFS-3259. NameNode#initializeSharedEdits should populate shared edits dir with edit log segments. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325518 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:11:32 +00:00
Todd Lipcon
72406e940a
HDFS-3255. HA DFS returns wrong token service. Contributed by Daryn Sharp.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325414 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 18:08:00 +00:00
Todd Lipcon
989d65ab97
HDFS-3261. TestHASafeMode fails on HDFS-3042 branch. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325140 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 07:05:36 +00:00
Aaron Myers
4ea042666c
HDFS-3260. TestDatanodeRegistration should set minimum DN version in addition to minimum NN version. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325119 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 05:27:03 +00:00
Aaron Myers
7f427646df
HDFS-2983. Relax the build version check to permit rolling upgrades within a release. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325110 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 03:36:13 +00:00
Tsz-wo Sze
ed678e52ce
HDFS-3179. Improve the exception message thrown by DataStreamer when it failed to add a datanode.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324892 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 17:49:28 +00:00
Todd Lipcon
6f2aae046d
Resolve trivial compilation error after previous merge
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324570 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:52:31 +00:00
Todd Lipcon
2bf19979b3
Merge trunk into auto-failover branch.
...
Needs a few tweaks to fix compilation - will do in followup commit. This is just a straight merge
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324567 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:47:40 +00:00
Todd Lipcon
41a014c31b
HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:40:26 +00:00
Todd Lipcon
dab66bee55
HDFS-3249. Use ToolRunner.confirmPrompt in NameNode. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324564 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:28:58 +00:00
Todd Lipcon
21824d8232
HDFS-3247. Improve bootstrapStandby behavior when original NN is not active. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1324558 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:16:06 +00:00
Eli Collins
e235dd3760
HDFS-2696. Fix the fuse-fds build. Contributed by Bruno Mahé
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312068 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 01:55:05 +00:00
Eli Collins
80447bd35a
HDFS-3244. Remove dead writable code from hdfs/protocol. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312061 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 01:10:38 +00:00
Todd Lipcon
58228e4e7b
HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry Robinson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312029 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 22:31:18 +00:00
Todd Lipcon
7c2e10e0cd
HDFS-3248. bootstrapStandby repeated twice in hdfs namenode usage message. Contributed by Colin Patrick McCabe.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312028 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 22:28:25 +00:00
Todd Lipcon
3ffdb9152e
HDFS-3094. add -nonInteractive and -force option to namenode -format command. Contributed by Arpit Gupta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312025 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 22:22:38 +00:00
Eli Collins
926f0a5ae0
HDFS-3238. ServerCommand and friends don't need to be writables. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311774 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 15:03:17 +00:00
Todd Lipcon
df3e1a3158
HDFS-3240. Drop log level of "heartbeat: ..." in BPServiceActor to DEBUG. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311577 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 05:12:00 +00:00
Aaron Myers
53dc8546d4
HDFS-3235. MiniDFSClusterManager doesn't correctly support -format option. Contributed by Henry Robinson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311556 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 02:25:40 +00:00
Aaron Myers
9597c81f35
HDFS-3236. NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311554 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 02:17:17 +00:00
Todd Lipcon
91528ce9ed
HDFS-3234. Accidentally left log message in GetConf after HDFS-3226. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311541 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 00:59:38 +00:00
Eli Collins
706394d039
HDFS-3004. Implement Recovery Mode. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311394 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 19:39:58 +00:00
Uma Maheswara Rao G
3ced5ea066
HDFS-3119. Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file. Contributed by Ashish Singhi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311380 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 19:11:58 +00:00
Aaron Myers
909176c1fc
HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311133 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 05:56:22 +00:00
Todd Lipcon
ee5daee1b7
HDFS-3214. InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311125 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 03:22:41 +00:00
Todd Lipcon
693ec453d2
HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310919 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 23:24:57 +00:00
Todd Lipcon
ca6f0940fd
Merge trunk into auto-failover branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310905 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 22:53:55 +00:00
Tsz-wo Sze
74b4b45651
HDFS-3211. Add fence(..) and replace NamenodeRegistration with JournalInfo and epoch in JournalProtocol. Contributed by suresh
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310649 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 00:52:12 +00:00
Todd Lipcon
2ab67dce11
HDFS-3226. Allow GetConf tool to print arbitrary keys. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310648 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 00:15:30 +00:00
Suresh Srinivas
02f5e43686
HDFS-3121. Add HDFS tests for HADOOP-8014 change. Contributed by John George. Missed adding the file in the earlier commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310631 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 23:03:54 +00:00
Tsz-wo Sze
58e920d1a0
HDFS-2505. Add a test to verify getFileChecksum(..) with ViewFS. Contributed by Ravi Prakash
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310522 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 18:04:05 +00:00
Todd Lipcon
d166bd184d
HDFS-3110. Use directRead API to reduce the number of buffer copies in libhdfs. Contributed by Henry Robinson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310185 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 06:31:10 +00:00
Todd Lipcon
30068a1d83
Merge trunk into auto-failover branch.
...
Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 05:07:33 +00:00
Todd Lipcon
d483b6f3fc
HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 04:56:26 +00:00
Todd Lipcon
844faefd08
HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 04:27:44 +00:00
Eli Collins
e505b7e704
HDFS-3208. Bogus entries in hosts files are incorrectly displayed in the report. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310138 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 00:20:55 +00:00
Eli Collins
112c324151
HDFS-3210. JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name". Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310135 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 00:10:54 +00:00
Suresh Srinivas
861c872541
HDFS-3204. Minor modification to JournalProtocol.proto to make it generic. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310134 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 00:08:19 +00:00
Tsz-wo Sze
80bbefafaf
HDFS-3178. Add states and state handler for journal synchronization in JournalService.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310115 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 22:35:53 +00:00
Aaron Myers
8e739ff01e
HDFS-3202. NamespaceInfo PB translation drops build version. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309955 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 17:18:26 +00:00
Eli Collins
663fbd46a8
HDFS-3199. TestValidateConfigurationSettings is failing. Contributed by Todd Lipcon
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309641 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 03:31:03 +00:00
Eli Collins
4f6e0a5a65
HDFS-3050. rework OEV to share more code with the NameNode. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309629 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 00:02:11 +00:00
Aaron Myers
ba688e11c1
HDFS-3102. Add CLI tool to initialize the shared-edits dir. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309580 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 20:15:08 +00:00
Todd Lipcon
00a1548005
Merge trunk into auto-HA branch
...
Resolved some trivial conflicts in NNHAServiceTarget
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 20:00:15 +00:00
Todd Lipcon
b74d742785
HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 19:21:01 +00:00
Todd Lipcon
a7d6bdc63b
HDFS-3084. FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309526 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 18:40:43 +00:00
Aaron Myers
7525ee5b67
HDFS-3000. Add a public API for setting quotas. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309227 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 03:18:49 +00:00
Tsz-wo Sze
8c0366bf10
HDFS-3168. Remove unnecessary "throw IOException" and change fields to final in FSNamesystem and BlockManager.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309218 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 02:51:34 +00:00
Todd Lipcon
30e1b3bba8
HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 23:37:15 +00:00
Todd Lipcon
9972a9633d
HDFS-3187. Upgrade guava to 11.0.2. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309181 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 22:30:29 +00:00
Todd Lipcon
39a5fd5c71
Merge trunk into auto-failover branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309164 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 21:48:23 +00:00
Tsz-wo Sze
e561cb9e78
HDFS-3176. Use MD5MD5CRC32FileChecksum.readFields() in JsonUtil . Contributed by Kihwal Lee
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309114 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 19:44:53 +00:00
Tsz-wo Sze
0db8003e2e
HDFS-3166. Add timeout to Hftp connections. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309103 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 19:26:57 +00:00
Todd Lipcon
789ed57e71
HDFS-2185. HDFS portion of ZK-based FailoverController. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308637 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 00:59:02 +00:00
Suresh Srinivas
e449de0526
HDFS-3126. Journal stream from Namenode to BackupNode needs to have timeout. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308636 13f79535-47bb-0310-9956-ffa450edef68
2012-04-03 00:55:08 +00:00
Eli Collins
4f15b9dfed
HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308617 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 23:20:34 +00:00
Eli Collins
72b3f302dc
HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308614 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 23:13:06 +00:00
Tsz-wo Sze
bc13dfb142
HDFS-3130. Move fsdataset implementation to a package.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308437 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 17:38:56 +00:00
Eli Collins
be8a0d1e62
HDFS-3174. Fix assert in TestPendingDataNodeMessages. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308226 13f79535-47bb-0310-9956-ffa450edef68
2012-04-02 01:45:11 +00:00
Eli Collins
be7dd8333a
HDFS-3144. Refactor DatanodeID#getName by use. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308205 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 22:12:12 +00:00
Eli Collins
43afa4ee51
HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308174 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 18:41:58 +00:00
Aaron Myers
a232d5c791
HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308159 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 17:27:54 +00:00
Eli Collins
0663dbaac0
HDFS-3171. The DatanodeID "name" field is overloaded. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308014 13f79535-47bb-0310-9956-ffa450edef68
2012-04-01 03:41:41 +00:00
Eli Collins
8bd825bb6f
HDFS-3164. Move DatanodeInfo#hostName to DatanodeID. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307890 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 19:58:51 +00:00
Eli Collins
eeb687daa7
HDFS-3172. dfs.upgrade.permission is dead code. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307888 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 19:56:23 +00:00
Aaron Myers
ff897e75c9
HDFS-3070. HDFS balancer doesn't ensure that hdfs-site.xml is loaded. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307841 13f79535-47bb-0310-9956-ffa450edef68
2012-03-31 16:20:54 +00:00
Eli Collins
a8cbf19548
HDFS-3138. Move DatanodeInfo#ipcPort to DatanodeID. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307553 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 17:50:05 +00:00
Eli Collins
64641c28b5
HDFS-3137. Bump LAST_UPGRADABLE_LAYOUT_VERSION to -16. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307173 13f79535-47bb-0310-9956-ffa450edef68
2012-03-30 00:11:14 +00:00
Aaron Myers
51908783be
HDFS-3142. TestHDFSCLI.testAll is failing. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307134 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 22:00:39 +00:00
Eli Collins
da58921cf5
HDFS-3066. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307100 13f79535-47bb-0310-9956-ffa450edef68
2012-03-29 20:51:29 +00:00
Aaron Myers
17d22e6dc4
HDFS-3158. LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306635 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 22:59:52 +00:00
Tsz-wo Sze
99a68a1423
HDFS-3155. Clean up FSDataset implemenation related code.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306582 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 20:37:34 +00:00
Eli Collins
0475795066
HDFS-3139. Minor Datanode logging improvement. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306549 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 19:33:22 +00:00
Aaron Myers
aa8cb2287f
HDFS-3143. TestGetBlocks.testGetBlocks is failing. Contributed by Arpit Gupta.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306542 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 19:02:16 +00:00
Aaron Myers
1427468a72
HDFS-3156. TestDFSHAAdmin is failing post HADOOP-8202. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306517 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 17:58:23 +00:00
Arun Murthy
67a74198b1
Changed version in trunk to 3.0.0-SNAPSHOT.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306200 13f79535-47bb-0310-9956-ffa450edef68
2012-03-28 07:37:06 +00:00
Suresh Srinivas
940dac52a7
HDFS-3125. Add JournalService to enable Journal Daemon. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305726 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 04:02:03 +00:00
Aaron Myers
466908e67b
HDFS-3131. Improve TestStorageRestore. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305688 13f79535-47bb-0310-9956-ffa450edef68
2012-03-27 00:13:42 +00:00
Tsz-wo Sze
525ceb99ad
HDFS-2413. Add an API DistributedFileSystem.isInSafeMode() and change DistributedFileSystem to @InterfaceAudience.LimitedPrivate. Contributed by harsh
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305632 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 22:18:04 +00:00
Eli Collins
99a321419f
HDFS-3129. NetworkTopology: add test that getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305628 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 22:07:30 +00:00
Tsz-wo Sze
67bdbd60cd
(recommit) HDFS-3089. Move FSDatasetInterface and the related classes to a package.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305603 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:14:12 +00:00
Tsz-wo Sze
5e38a9acea
Revert 1305590 for HDFS-3089.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305598 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:09:14 +00:00
Tsz-wo Sze
1ebcc378af
HDFS-3089. Move FSDatasetInterface and the related classes to a package.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305590 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 21:01:47 +00:00
Aaron Myers
ce1a7ec975
HDFS-2941. Add an administrative command to download a copy of the fsimage from the NN. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305447 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 17:02:40 +00:00
Todd Lipcon
840df19cee
HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305195 13f79535-47bb-0310-9956-ffa450edef68
2012-03-26 01:54:14 +00:00
Todd Lipcon
39775dca68
Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305152 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 21:38:31 +00:00
Aaron Myers
ea868d3d8b
HDFS-3116. Typo in fetchdt error message. Contributed by AOE Takashi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304996 13f79535-47bb-0310-9956-ffa450edef68
2012-03-25 08:45:04 +00:00
Todd Lipcon
90ea037d21
HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304967 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 23:48:07 +00:00
Todd Lipcon
4cb809bf04
HDFS-3132. Fix findbugs warning on HDFS trunk. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304681 13f79535-47bb-0310-9956-ffa450edef68
2012-03-24 00:21:52 +00:00
Todd Lipcon
b795c65f49
HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
2012-03-23 06:29:40 +00:00
Eli Collins
4feef86372
HDFS-3044. fsck move should be non-destructive by default. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304063 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 21:11:18 +00:00
Tsz-wo Sze
0c4acdc176
HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303628 13f79535-47bb-0310-9956-ffa450edef68
2012-03-22 00:10:20 +00:00
Todd Lipcon
2f820dde17
HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303485 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 18:14:09 +00:00
Todd Lipcon
f55a1c0876
HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 17:30:37 +00:00
Tsz-wo Sze
9e108e61fb
HDFS-3086. Change Datanode not to send storage list in registration.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303318 13f79535-47bb-0310-9956-ffa450edef68
2012-03-21 09:07:33 +00:00
Aaron Myers
4ceca97606
HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303098 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 19:00:56 +00:00
Aaron Myers
21426e6e42
HADOOP-8121. Active Directory Group Mapping Service. Contributed by Jonathan Natkins.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302740 13f79535-47bb-0310-9956-ffa450edef68
2012-03-20 01:00:14 +00:00
Tsz-wo Sze
6326605acb
HDFS-3105. Add DatanodeStorage information to block recovery.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302683 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 22:09:14 +00:00
Uma Maheswara Rao G
f77b1a63ec
HDFS-3091. Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. Contributed by Nicholas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1302624 13f79535-47bb-0310-9956-ffa450edef68
2012-03-19 19:54:13 +00:00
Uma Maheswara Rao G
875080ce10
HDFS-3111. Missing license headers in trunk. Deleted this file from svn repositiry as this file was already empty. (Contributed by Uma MAheswara Rao G).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301876 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 07:06:42 +00:00
Uma Maheswara Rao G
3573d504e4
HDFS-3111. Missing license headers in trunk. (Contributed by Uma Maheswara Rao G).
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301871 13f79535-47bb-0310-9956-ffa450edef68
2012-03-17 06:50:36 +00:00
Tsz-wo Sze
2a0024403a
HDFS-3104. Add tests for HADOOP-8175. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301665 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 17:48:33 +00:00
Tsz-wo Sze
662b1887af
HDFS-3088. Move FSDatasetInterface inner classes to a package.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301661 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 17:32:57 +00:00
Tsz-wo Sze
9b2a324ba5
HDFS-3098. Update and add tests for HADOOP-8173. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301295 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:27:40 +00:00
Tsz-wo Sze
7e5b60116e
HDFS-3101. Cannot read empty file using WebHDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301287 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:01:23 +00:00
Todd Lipcon
49619e8997
HDFS-3062. Fix bug which prevented MR job submission from creating delegation tokens on an HA cluster. Contributed by Mingjie Lai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301285 13f79535-47bb-0310-9956-ffa450edef68
2012-03-16 00:00:29 +00:00
Aaron Myers
65425b0961
HDFS-3099. SecondaryNameNode does not properly initialize metrics system. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301222 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 21:51:23 +00:00
Aaron Myers
6d96a28a08
HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301182 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 20:26:29 +00:00
Tsz-wo Sze
1177d4edc2
HDFS-3005. FSVolume.decDfsUsed(..) should be synchronized.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301127 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 18:24:40 +00:00
Todd Lipcon
59eb544744
HDFS-3093. Fix bug where namenode -format interpreted the -force flag in reverse. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300814 13f79535-47bb-0310-9956-ffa450edef68
2012-03-15 05:36:03 +00:00
Tsz-wo Sze
3e582c690c
HDFS-3082. Clean up FSDatasetInterface and change DataNode.data to package private.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1300392 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 22:52:17 +00:00
Eli Collins
ab20dae519
HDFS-2303. Unbundle jsvc. Contributed by Roman Shaposhnik and Mingjie Lai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299963 13f79535-47bb-0310-9956-ffa450edef68
2012-03-13 03:38:57 +00:00
Todd Lipcon
1a75ec8288
HDFS-2731. Add command to bootstrap the Standby Node's name directories from the Active NameNode. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299807 13f79535-47bb-0310-9956-ffa450edef68
2012-03-12 19:41:21 +00:00
Tsz-wo Sze
c8f2889bde
HDFS-3056: add the new file for the previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299144 13f79535-47bb-0310-9956-ffa450edef68
2012-03-10 01:58:29 +00:00
Tsz-wo Sze
501a283986
HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1299139 13f79535-47bb-0310-9956-ffa450edef68
2012-03-10 01:52:17 +00:00
Steve Loughran
381a9b2d58
HDFS-2966
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298820 13f79535-47bb-0310-9956-ffa450edef68
2012-03-09 13:17:04 +00:00
Uma Maheswara Rao G
069fb57f4e
HDFS-2976 removed the unused imports that were missed in previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298508 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 18:56:43 +00:00
Uma Maheswara Rao G
6c0c140350
HDFS-2976 corrected the previous wrong commit for this issue.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298507 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 18:51:46 +00:00
Uma Maheswara Rao G
b19d1186ab
HDFS-2976. Remove unnecessary method (tokenRefetchNeeded) in DFSClient.
...
(Contributed by Uma Maheswara Rao G)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298495 13f79535-47bb-0310-9956-ffa450edef68
2012-03-08 18:31:33 +00:00
Tsz-wo Sze
22738ae1d0
HDFS-2038. Update TestHDFSCLI to handle relative paths with globs. Contributed by Kihwal Lee
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298066 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 19:44:47 +00:00
Eli Collins
0a2b413dff
HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298044 13f79535-47bb-0310-9956-ffa450edef68
2012-03-07 19:16:03 +00:00
Tsz-wo Sze
0ee71adeb4
HDFS-3032. Change DFSClient.renewLease() so that it only retries up to the lease soft-limit. Contributed by Kihwal Lee
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1297328 13f79535-47bb-0310-9956-ffa450edef68
2012-03-06 02:42:46 +00:00
Todd Lipcon
87d1c67944
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296025 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:48:32 +00:00
Aaron Myers
7be4e5bd22
HDFS-3039. Address findbugs and javadoc warnings on branch. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1296017 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:32:49 +00:00
Aaron Myers
6da670ce6a
HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296016 13f79535-47bb-0310-9956-ffa450edef68
2012-03-02 01:26:54 +00:00
Tsz-wo Sze
b2f67b4704
HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync().
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295999 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 23:51:19 +00:00
Aaron Myers
f22677ef8e
HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295961 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 22:52:05 +00:00
Tsz-wo Sze
9e31bf675d
HDFS-3021. Use generic type to declare FSDatasetInterface.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295929 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 21:58:39 +00:00
Todd Lipcon
55832c6c96
HDFS-3035. Fix failure of TestFileAppendRestart due to OP_UPDATE_BLOCKS. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295740 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 18:57:58 +00:00
Todd Lipcon
6e5e1e54bc
Amend HDFS-3023. Add new layout version number to ImageLoaderCurrent to fix TestOfflineImageViewer.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295721 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 18:23:19 +00:00
Aaron Myers
0d7de507a5
HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295473 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 08:50:10 +00:00
Aaron Myers
9318ff4250
Revert commit of HDFS-2979.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295435 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 07:03:40 +00:00
Todd Lipcon
30cffeb388
HDFS-3023. Optimize entries in edits log for persistBlocks call. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295356 13f79535-47bb-0310-9956-ffa450edef68
2012-03-01 00:37:09 +00:00
Todd Lipcon
1ba357553a
Merge trunk into HA branch.
...
Resolved some semantic conflicts in TestFileAppendRestart - we now log more OP_ADDs in the HA branch than we did in trunk.
Resolved some conflicts around removal of VersionedProtocol, etc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295342 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 23:47:49 +00:00
Aaron Myers
01b17c40cf
HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295340 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 23:42:52 +00:00
Aaron Myers
7b6b204924
HDFS-3027. Implement a simple NN health check. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1295300 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 21:57:56 +00:00
Todd Lipcon
28de3628f5
HDFS-3020. Fix editlog to automatically sync when buffer is full. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295239 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 19:57:18 +00:00
Jitendra Nath Pandey
ca9b4de772
HDFS-3012. Exception while renewing delegation token. Contributed by Bobby Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295232 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 19:36:17 +00:00
Eli Collins
fbf3a9ee3d
HDFS-2992. Edit log failure trace should include transaction ID of error. Contributed by Colin Patrick McCabe
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295227 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 19:31:36 +00:00
Todd Lipcon
34c73db5e1
HDFS-2991. Fix case where OP_ADD would not be logged in append(). Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295214 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 18:52:00 +00:00
Jitendra Nath Pandey
e57fd85fd4
HDFS-3030. Remove getProtocolVersion and getProtocolSignature from translators.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1295017 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 08:52:45 +00:00
Aaron Myers
e58b7e202b
HDFS-3014. FSEditLogOp and its subclasses should have toString() method. Contributed by Sho Shimauchi.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294926 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 01:17:37 +00:00
Aaron Myers
978a8050e2
HDFS-2920. fix remaining TODO items. Contributed by Aaron T. Myers and Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294923 13f79535-47bb-0310-9956-ffa450edef68
2012-02-29 01:09:07 +00:00
Aaron Myers
c69dfdd5e1
HDFS-2958. Sweep for remaining proxy construction which doesn't go through failover path.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294811 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 20:09:18 +00:00
Jitendra Nath Pandey
daf782ca7e
HDFS-3016. Security in unit tests. Contributed by Jaimin Jetly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294773 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:41:25 +00:00
Todd Lipcon
1ab31b1715
HDFS-3019. Fix silent failure of TestEditLogJournalFailures. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294772 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:38:40 +00:00
Aaron Myers
375c6b8f2e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294762 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:33:41 +00:00
Todd Lipcon
7decf112c0
HDFS-3024. Improve performance of stringification in addStoredBlock. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294754 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 18:04:13 +00:00
Todd Lipcon
da9aa34bec
HDFS-3013. HA: NameNode format doesn't pick up dfs.namenode.name.dir.NameServiceId configuration. Contributed by Mingjie Lai.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1294425 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 00:43:54 +00:00
Aaron Myers
ae9014ef6a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293742 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 04:57:17 +00:00
Aaron Myers
b57260f848
HDFS-2978. The NameNode should expose name dir statuses via JMX. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293707 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 22:14:53 +00:00
Tsz-wo Sze
dacbeb5f67
HDFS-3006. In WebHDFS, when the return body is empty, set the Content-Type to application/octet-stream instead of application/json.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293487 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 00:15:37 +00:00
Todd Lipcon
481f84597b
HDFS-2904. Client support for getting delegation tokens. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1293486 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 00:03:26 +00:00
Suresh Srinivas
5293e5d1c5
HDFS-3002. TestNameNodeMetrics need not wait for metrics update. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:52:20 +00:00
Eli Collins
78f22bc525
HDFS-3008. Negative caching of local addrs doesn't work. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293419 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:14:04 +00:00
Suresh Srinivas
0e79131981
HDFS-3009. Remove duplicate code in DFSClient#isLocalAddress by using NetUtils. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293390 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 19:29:41 +00:00
Aaron Myers
62c7e2edfc
HDFS-3003. Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString(). Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293338 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 17:03:17 +00:00
Aaron Myers
f3026e1085
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292838 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 16:06:53 +00:00
Eli Collins
2e9b8df963
HDFS-2993. HA: BackupNode#checkOperation should permit CHECKPOINT operations. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292688 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 07:58:33 +00:00
Tsz-wo Sze
f11b0788df
HDFS-2981. In hdfs-default.xml, the default value of dfs.client.block.write.replace-datanode-on-failure.enable should be true.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292626 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 02:27:07 +00:00
Eli Collins
8db31c5972
HDFS-2922. HA: close out operation categories. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292620 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 02:08:54 +00:00
Todd Lipcon
90a14f89e1
HDFS-2973. Re-enable NO_ACK optimization for block deletion. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292611 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 01:25:14 +00:00
Todd Lipcon
475db83b87
HDFS-2985. Improve logging when replicas are marked as corrupt. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292609 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 01:16:33 +00:00
Todd Lipcon
7527e943e6
HDFS-2972. Small optimization building incremental block report. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292497 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 20:37:28 +00:00
Todd Lipcon
c14912785d
HDFS-2929. Stress test and fixes for block synchronization. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1292494 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 20:31:52 +00:00
Tsz-wo Sze
efbc58f30c
HDFS-2907. Add a conf property dfs.datanode.fsdataset.factory to make FSDataset in Datanode pluggable.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292419 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:47:39 +00:00
Aaron Myers
f0db867292
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291400 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 18:33:37 +00:00
Aaron Myers
d03dac7432
HDFS-2974. MiniDFSCluster does not delete standby NN name dirs during format. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1291126 13f79535-47bb-0310-9956-ffa450edef68
2012-02-20 04:12:01 +00:00
Steve Loughran
a57b9b8335
HDFS-2725 script to mention dfs command
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245943 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 15:25:11 +00:00
Aaron Myers
41e56dfece
HDFS-2952. NN should not start with upgrade option or with a pending an unfinalized upgrade. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245875 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 07:12:27 +00:00
Todd Lipcon
ef5d7156db
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245834 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:27:51 +00:00
Todd Lipcon
9ae4fac8dd
HDFS-2968. Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245832 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:18:01 +00:00
Todd Lipcon
a8e7f745cd
HDFS-2969. ExtendedBlock.equals is incorrectly implemented. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245830 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:13:09 +00:00
Eli Collins
dd732d5a24
Fix TestViewFsFileStatusHdfs per previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245762 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:04:20 +00:00
Aaron Myers
53b7d6c6bc
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245690 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 18:19:31 +00:00
Aaron Myers
7933dc5838
HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245338 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 07:37:43 +00:00
Suresh Srinivas
1a03127385
HDFS-2937. TestDFSHAAdmin needs tests with MiniDFSCluster. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245326 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 06:40:40 +00:00
Aaron Myers
153e0cc37a
HDFS-2955. IllegalStateException during standby startup in getCurSegmentTxId. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245230 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 22:45:40 +00:00
Jitendra Nath Pandey
b8448dea82
HDFS-2655. BlockReaderLocal#skip performs unnecessary IO. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245118 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 18:58:19 +00:00
Aaron Myers
833e96534f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1245117 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 18:35:32 +00:00
Aaron Myers
83a922b55e
ConfiguredFailoverProxyProvider should not create a NameNode proxy with an underlying retry proxy. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244845 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 03:59:09 +00:00
Todd Lipcon
0663b51ed4
Amend HDFS-2948. NN throws NPE during shutdown if it fails to startup
...
Previous patch missed the case where the NN fails to start up when it's starting in standby state.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244813 13f79535-47bb-0310-9956-ffa450edef68
2012-02-16 00:58:03 +00:00
Todd Lipcon
f7f2ef4447
HDFS-2935. Shared edits dir property should be suffixed with nameservice and namenodeID. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244761 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:20:37 +00:00
Todd Lipcon
05151ecf79
HDFS-2934. Allow configs to be scoped to all NNs in the nameservice. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244759 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:19:12 +00:00
Jitendra Nath Pandey
3c145d3492
HDFS-2909. HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244753 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:00:18 +00:00
Suresh Srinivas
ff91453227
HDFS-2938. Recursive delete of a large directory make namenode unresponsive. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244752 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 22:00:08 +00:00
Aaron Myers
1fb0ab92f8
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244645 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 19:04:17 +00:00
Jitendra Nath Pandey
f82e862e1f
HDFS-2525. Race between BlockPoolSliceScanner and append. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244640 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:43:01 +00:00
Todd Lipcon
3bd230af11
HDFS-2950. Secondary NN HTTPS address should be listed as a NAMESERVICE_SPECIFIC_KEY. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1244635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-15 18:27:37 +00:00
Aaron Myers
011611c765
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244202 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 20:37:10 +00:00
Todd Lipcon
439490f915
HDFS-2948. NN throws NPE during shutdown if it fails to startup. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1244186 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 19:38:02 +00:00
Aaron Myers
1b2ecc6336
HDFS-2947. On startup NN throws an NPE in the metrics system. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243826 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 08:42:25 +00:00
Aaron Myers
a87328dfab
HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243822 13f79535-47bb-0310-9956-ffa450edef68
2012-02-14 08:27:15 +00:00
Todd Lipcon
db187cf40e
Merge trunk into HA branch.
...
Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243691 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 21:00:37 +00:00
Aaron Myers
2acafd1783
HDFS-2944. Typo in hdfs-default.xml causes dfs.client.block.write.replace-datanode-on-failure.enable to be mistakenly disabled. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243690 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 20:57:48 +00:00
Suresh Srinivas
a70bc6c6a2
HDFS-2815. Namenode sometimes oes not come out of safemode during NN crash + restart. Contributed by Uma Maheswara Rao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243673 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 20:11:43 +00:00
Tsz-wo Sze
52004aa8e9
HDFS-776. Fix exception handling in Balancer. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243654 13f79535-47bb-0310-9956-ffa450edef68
2012-02-13 19:07:04 +00:00
Aaron Myers
f6e407b436
HDFS-2939. TestHAStateTransitions fails on Windows. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1243293 13f79535-47bb-0310-9956-ffa450edef68
2012-02-12 18:43:39 +00:00
Harsh J
8b730c867f
HDFS-2869. Fix an error in the webhdfs docs for the mkdir op (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1243104 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 17:13:30 +00:00
Todd Lipcon
8be9441b9b
HDFS-2878. Fix TestBlockRecovery and move it back into main test directory. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242995 13f79535-47bb-0310-9956-ffa450edef68
2012-02-11 01:20:59 +00:00
Tsz-wo Sze
83fd3160da
HDFS-2931. Switch DataNode's BlockVolumeChoosingPolicy to private-audience. Contributed by harsh
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242891 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 19:15:15 +00:00
Todd Lipcon
a626fa04f9
Revert HDFS-2922 via svn merge -c -1242572
...
The patch broke a lot of unit tests in the nightly build. Will recommit after it is fixed.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242874 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:17:21 +00:00
Aaron Myers
05d56e5e7e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242871 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 18:01:01 +00:00
Tsz-wo Sze
dc847b39fd
HDFS-2486. Remove unnecessary priority level checks in UnderReplicatedBlocks. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242636 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 02:05:38 +00:00
Todd Lipcon
c14bb61a82
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242635 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 01:49:08 +00:00
Eli Collins
8af96c7b22
HDFS-2917. HA: haadmin should not work if run by regular user. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242626 13f79535-47bb-0310-9956-ffa450edef68
2012-02-10 00:46:17 +00:00
Eli Collins
a63e12c4c8
HDFS-2922. HA: close out operation categories. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242572 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 22:33:20 +00:00
Aaron Myers
467059b4ab
HDFS-2912. Namenode not shutting down when shared edits dir is inaccessible. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242564 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 22:23:47 +00:00
Jitendra Nath Pandey
b5d02a63cb
HDFS-2915. HA: TestFailureOfSharedDir.testFailureOfSharedDir() has race condition. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242522 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 21:08:17 +00:00
Todd Lipcon
5e26de982b
HDFS-2924. Standby checkpointing fails to authenticate in secure cluster. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242439 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 18:22:02 +00:00
Aaron Myers
bad0a2a4a1
HDFS-2510. Add HA-related metrics. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242410 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 17:39:50 +00:00
Todd Lipcon
e918b91e23
HDFS-2579. Starting delegation token manager during safemode fails. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1242225 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 06:12:01 +00:00
Todd Lipcon
a1574e1715
HDFS-2923. Namenode IPC handler count uses the wrong configuration key. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242220 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 05:28:40 +00:00
Jitendra Nath Pandey
987449b9b8
HDFS-2908. Add apache license header for StorageReport.java. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242192 13f79535-47bb-0310-9956-ffa450edef68
2012-02-09 00:24:06 +00:00
Tsz-wo Sze
b6ffb08a46
HDFS-2887. FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated. (szetszwo)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1242087 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 20:58:29 +00:00
Aaron Myers
4d3dc530e8
HDFS-2764. TestBackupNode is racy. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241780 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 05:38:29 +00:00
Jitendra Nath Pandey
11db1b855f
HDFS-2786. Fix host-based token incompatibilities in DFSUtil. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241766 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 03:55:36 +00:00
Jitendra Nath Pandey
b9e74da41b
HDFS-2905. HA: Standby NN NPE when shared edits dir is deleted. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241757 13f79535-47bb-0310-9956-ffa450edef68
2012-02-08 03:17:09 +00:00
Jitendra Nath Pandey
acacde55e6
HDFS-2901. Improvements for SBN web UI - not show under-replicated/missing blocks. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241568 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 19:29:39 +00:00
Suresh Srinivas
28eadb7cd7
HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241519 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 16:59:48 +00:00
Todd Lipcon
7f0a99f6e6
HDFS-2794. Active NN may purge edit log files before standby NN has a chance to read them. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1241317 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 01:39:14 +00:00
Konstantin Shvachko
7e4bd89590
HDFS-2886. CreateEditLogs should generate a realistic edit log. Contributed by Konstantin Shvachko.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241296 13f79535-47bb-0310-9956-ffa450edef68
2012-02-07 00:44:27 +00:00
Suresh Srinivas
2a9e430ff9
HDS-2895. Remove Writable wire protocol types and translators to complete transition to protocol buffers. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1241007 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 13:33:35 +00:00
Eli Collins
b837bbb7d5
HDFS-2893. The start/stop scripts don't start/stop the 2NN when using the default configuration. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240928 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 08:52:50 +00:00
Eli Collins
296b6c0063
HDFS-2894. HA: automatically determine the nameservice Id if only one nameservice is configured. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240917 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 08:25:52 +00:00
Eli Collins
2e4cf977ae
HDFS-2752. HA: exit if multiple shared dirs are configured. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240916 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 08:24:11 +00:00
Eli Collins
c17b4f8eef
HDFS-2819. Document new HA-related configs in hdfs-default.xml. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240914 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 08:21:06 +00:00
Harsh J
da7b0d90c6
HDFS-2868. Expose xceiver counts via the DataNode MXBean. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240897 13f79535-47bb-0310-9956-ffa450edef68
2012-02-06 05:25:12 +00:00
Suresh Srinivas
f88574acde
HDFS-2880. Protobuf chagnes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240653 13f79535-47bb-0310-9956-ffa450edef68
2012-02-05 01:39:30 +00:00
Eli Collins
a660c5dd2c
Add missing file from previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240601 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:13:48 +00:00
Eli Collins
7b913180be
HDFS-2808. HA: haadmin should use namenode ids. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240600 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 20:12:51 +00:00
Jitendra Nath Pandey
205f0470f4
HDFS-2785. Update webhdfs and httpfs for host-based token support. Contributed by Robert Joseph Evans.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240460 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 06:57:40 +00:00
Aaron Myers
ec6961b39c
HDFS-2792. Make fsck work. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240449 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 03:10:39 +00:00
Aaron Myers
3cc71933e9
HDFS-2890. DFSUtil#getSuffixIDs should skip unset configurations. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240447 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 03:00:17 +00:00
Todd Lipcon
11df1c2561
HDFS-2874. Edit log should log to shared dirs before local dirs. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240445 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 02:52:53 +00:00
Aaron Myers
447e81f51a
HDFS-2889. getNumCurrentReplicas is package private but should be public on0.23 (see HDFS-2408). Contributed by Gregory Chanan.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240412 13f79535-47bb-0310-9956-ffa450edef68
2012-02-04 00:01:06 +00:00
Aaron Myers
969318cfc2
HDFS-2863. Failures observed if dfs.edits.dir and shared.edits.dir have same directories. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1240267 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 18:04:21 +00:00
Tsz-wo Sze
38ad4b5036
HDFS-2879. Change FSDataset to package private.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1240020 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 07:26:02 +00:00
Eli Collins
d2b5531b0f
HDFS-2769. HA: When HA is enabled with a shared edits dir, that dir should be marked required. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239988 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 03:10:57 +00:00
Aaron Myers
05ab55b705
HDFS-2860. TestDFSRollback#testRollback is failing. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239968 13f79535-47bb-0310-9956-ffa450edef68
2012-02-03 01:09:05 +00:00
Todd Lipcon
32c313d51c
HDFS-2861. checkpointing should verify that the dfs.http.address has been configured to a non-loopback for peer NN. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239886 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 22:21:57 +00:00
Todd Lipcon
6d5510dfb8
HDFS-2877. If locking of a storage dir fails, it will remove the other NN's lock file on exit. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239880 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 22:12:02 +00:00
Eli Collins
4324e1bcd7
HADOOP-7991. HA: the FailoverController should check the standby is ready before failing over. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239774 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 19:20:32 +00:00
Jitendra Nath Pandey
9eb8f4d267
HDFS-2784. Update hftp and hdfs for host-based token support. Contributed by Kihwal Lee.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239763 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 19:04:40 +00:00
Konstantin Shvachko
191db6a907
HDFS-2718. Optimize OP_ADD in edits loading. Contributed by Konstantin Shvachko.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239760 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 18:57:49 +00:00
Jitendra Nath Pandey
c909aedbc1
HDFS-2814 NamenodeMXBean does not account for svn revision in the version information. Contributed by Hitesh Shah.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1239464 13f79535-47bb-0310-9956-ffa450edef68
2012-02-02 05:31:46 +00:00
Todd Lipcon
4d779e088a
HDFS-2859. LOCAL_ADDRESS_MATCHER.match has NPE when called from DFSUtil.getSuffixIDs when the host is incorrect. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239356 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 22:02:29 +00:00
Todd Lipcon
048c416beb
HDFS-2870. Fix log level for block debug info in processMisReplicatedBlocks. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1239278 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 19:23:28 +00:00
Tsz-wo Sze
dbbfaebb71
HDFS-2864. Remove some redundant methods and the constant METADATA_VERSION from FSDataset.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238969 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 07:46:50 +00:00
Eli Collins
cf611255d6
HDFS-2742. HA: observed dataloss in replication stress test. Contributed by Todd Lipcon
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238940 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 05:16:49 +00:00
Aaron Myers
43679fcccd
HDFS-2845. SBN should not allow browsing of the file system via web UI. Contributed by Bikas Saha.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238897 13f79535-47bb-0310-9956-ffa450edef68
2012-02-01 01:29:06 +00:00
Suresh Srinivas
536b30ec91
HDFS-2835. Fix findbugs and javadoc issue with GetConf.java. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238779 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 20:03:49 +00:00
Suresh Srinivas
319021d6fb
HDFS-2857. Cleanup BlockInfo class. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238747 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 18:59:58 +00:00
Tsz-wo Sze
8dfef7d2dc
HDFS-2827. When the parent of a directory is the root, renaming the directory results in leases updated incorrectly. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238700 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 17:36:42 +00:00
Eli Collins
6be13332db
HDFS-2853. HA: NN fails to start if the shared edits dir is marked required. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238134 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:17:53 +00:00
Todd Lipcon
641f79a325
HDFS-2824. Fix failover when prior NN died just after creating an edit log segment. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238069 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 23:05:18 +00:00
Eli Collins
6884348444
HADOOP-7938. HA: the FailoverController should optionally fence the active during failover. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238058 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 22:42:46 +00:00
Aaron Myers
9a8f119741
Amend HDFS-2841 to include new file which was omitted from original commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237971 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 20:32:35 +00:00
Todd Lipcon
846f97312c
HDFS-2691. Fixes for pipeline recovery in an HA cluster: report RBW replicas immediately upon pipeline creation. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237935 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 19:16:15 +00:00
Aaron Myers
6122357da5
HDFS-2841. HAAdmin does not work if security is enabled. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237534 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 02:52:27 +00:00
Jitendra Nath Pandey
98302971c2
HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237192 13f79535-47bb-0310-9956-ffa450edef68
2012-01-29 02:01:24 +00:00
Aaron Myers
30dd704e6c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237157 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 20:33:30 +00:00
Aaron Myers
976c07696d
HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237153 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 20:26:13 +00:00
Todd Lipcon
327c216c2f
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:50:23 +00:00
Todd Lipcon
da91e0d427
HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236945 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:42:34 +00:00
Aaron Myers
2b2e56056e
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:21:07 +00:00
Alejandro Abdelnur
8a234f394e
HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236929 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:53:35 +00:00
Jitendra Nath Pandey
e7775e0b3b
HDFS-2805. Add a test for a federated cluster with HA NNs. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236471 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 00:34:37 +00:00
Eli Collins
fdf7b18247
HDFS-2838. NPE in FSNamesystem when in safe mode. Contributed by Gregory Chanan
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236450 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 23:48:08 +00:00
Jitendra Nath Pandey
dea3164e00
HDFS-2809. Add test to verify that delegation tokens are honored after failover.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235495 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 21:06:27 +00:00
Jitendra Nath Pandey
0b2245a0f3
HDFS-2807. Service level authorizartion for HAServiceProtocol.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235431 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 19:31:49 +00:00
Aaron Myers
83bcb1bbf4
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235380 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 17:59:14 +00:00
Harsh J
7c69883917
HDFS-442. dfsthroughput in test jar throws NPE (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235137 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:10:28 +00:00
Eli Collins
5dfe62d845
HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235135 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 06:05:52 +00:00
Todd Lipcon
fa4a33a566
Merge trunk into HA branch.
...
- Some conflicts on BlockManager due to the recent commit of HDFS-2822 - moved logic to processMisReplicatedBlock function
- testNoExtensionIfNoBlocks(org.apache.hadoop.hdfs.TestSafeMode) is now failing due to an existing bug in the HA branch, to be fixed soon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235078 13f79535-47bb-0310-9956-ffa450edef68
2012-01-24 00:00:05 +00:00
Todd Lipcon
1525aae4b3
HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235067 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 23:42:17 +00:00
Todd Lipcon
465663afbf
HDFS-2804. Should not mark blocks under-replicated when exiting safemode. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235033 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:22:46 +00:00
Todd Lipcon
c0016ba85f
HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235025 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 22:07:49 +00:00
Todd Lipcon
8d1c996242
HDFS-2688. Add tests for quota tracking in an HA cluster. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235017 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:57:00 +00:00
Todd Lipcon
c10853a6b9
HDFS-2820. Add a simple sanity check for HA config. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1235013 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 21:49:43 +00:00
Todd Lipcon
12645ff6c0
HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234925 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:11:09 +00:00
Aaron Myers
e42bbfbca2
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234924 13f79535-47bb-0310-9956-ffa450edef68
2012-01-23 18:07:27 +00:00
Harsh J
ece854211f
HDFS-2818. Fix a missing space issue in HDFS webapps' title tags. (Devaraj K via harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234555 13f79535-47bb-0310-9956-ffa450edef68
2012-01-22 17:30:33 +00:00
Aaron Myers
c3e62de9ce
HDFS-2737. Automatically trigger log rolls periodically on the active NN. Contributed by Todd Lipcon and Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234256 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 03:17:26 +00:00
Todd Lipcon
c840548d6b
HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1234221 13f79535-47bb-0310-9956-ffa450edef68
2012-01-21 00:42:35 +00:00
Aaron Myers
2abe5c818d
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1234087 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 19:30:53 +00:00
Todd Lipcon
f7d20b2198
HDFS-2751. Datanode may incorrectly drop OS cache behind reads even for short reads. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233796 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 07:32:06 +00:00
Todd Lipcon
520a39ac2d
HDFS-2810. Leases not getting renewed properly by clients. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233794 13f79535-47bb-0310-9956-ffa450edef68
2012-01-20 07:26:19 +00:00
Todd Lipcon
1aed1296dd
HDFS-2812. When becoming active, the NN should treat all leases as freshly renewed. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233612 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 22:35:04 +00:00
Eli Collins
fa6033a029
HDFS-2768. BackupNode stop can not close proxy connections because it is not a proxy instance. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233584 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 21:41:50 +00:00
Aaron Myers
02919e61f6
HDFS-2367. Enable the configuration of multiple HA cluster addresses. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233549 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 19:41:48 +00:00
Aaron Myers
3e17cdde56
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1233533 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 19:02:07 +00:00
Todd Lipcon
1d2e706dd1
HDFS-2803. Add logging to LeaseRenewer for better lease expiration debugging. Contributed by Jimmy Xiang.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1233453 13f79535-47bb-0310-9956-ffa450edef68
2012-01-19 16:35:25 +00:00
Todd Lipcon
a380dc8732
HDFS-2592. Balancer support for HA namenodes. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232531 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 18:39:09 +00:00
Todd Lipcon
4c7a6c6c3f
Amend HDFS-2795. Fix PersistBlocks failure due to an NPE in isPopulatingReplQueues()
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232510 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 17:57:36 +00:00
Todd Lipcon
0c1450ca5d
HDFS-2795. Standby NN takes a long time to recover from a dead DN starting up. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232285 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 03:21:08 +00:00
Todd Lipcon
212678f036
HDFS-2767. ConfiguredFailoverProxyProvider should support NameNodeProtocol. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232284 13f79535-47bb-0310-9956-ffa450edef68
2012-01-17 03:10:25 +00:00
Aaron Myers
d880c7cc78
HDFS-2772. On transition to active, standby should not swallow ELIE. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232197 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 22:16:15 +00:00
Aaron Myers
940eeb866c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232184 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:57:28 +00:00
Todd Lipcon
2f26475a39
HDFS-2747. Entering safe mode after starting SBN can NPE. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1232176 13f79535-47bb-0310-9956-ffa450edef68
2012-01-16 21:46:05 +00:00
Eli Collins
f02ea82bd1
HDFS-2790. FSNamesystem.setTimes throws exception with wrong configuration name in the message. Contributed by Arpit Gupta
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231572 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 19:50:14 +00:00
Eli Collins
6b8bcfa916
HDFS-2788. HdfsServerConstants#DN_KEEPALIVE_TIMEOUT is dead code. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1231569 13f79535-47bb-0310-9956-ffa450edef68
2012-01-14 19:45:12 +00:00
Suresh Srinivas
72207596be
HADOOP-7972. HAServiceProtocol exceptions need to be unwrapped. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230861 13f79535-47bb-0310-9956-ffa450edef68
2012-01-13 02:30:29 +00:00
Aaron Myers
8610a9231a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230696 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 18:40:50 +00:00
Jitendra Nath Pandey
6234f3d91c
HADOOP-2776. Missing interface annotation on JournalSet. Contributed by Brandon Li.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230412 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 06:21:05 +00:00
Harsh J
dcea80a21b
HDFS-69. Improve the 'dfsadmin' commandline help. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1230398 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 05:13:19 +00:00
Suresh Srinivas
09e5af76f3
HADOOP-7970. HAServiceProtocol methods must throw IOException.Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230351 13f79535-47bb-0310-9956-ffa450edef68
2012-01-12 01:39:30 +00:00
Aaron Myers
3e76f00baa
Fix expected error text in assertion.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230254 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 21:14:30 +00:00
Aaron Myers
ede7f21278
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1230248 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 20:53:50 +00:00
Aaron Myers
4f1bf2fe23
HDFS-2738. FSEditLog.selectinputStreams is reading through in-progress streams even when non-in-progress are requested. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229931 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 08:32:10 +00:00
Aaron Myers
a339836bbc
HDFS-2766. Test for case where standby partially reads log and then performs checkpoint. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229929 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 08:26:18 +00:00
Todd Lipcon
a4f4becf52
HDFS-2775. Fix TestStandbyCheckpoints.testBothNodesInStandbyState failing intermittently. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229901 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 06:14:13 +00:00
Todd Lipcon
298e867673
HDFS-2773. Reading edit logs from an earlier version should not leave blocks in under-construction state. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229900 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 06:08:13 +00:00
Todd Lipcon
190dc1c91b
HDFS-2753. Fix standby getting stuck in safemode when blocks are written while SBN is down. Contributed by Hari Mankude and Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229898 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 05:55:32 +00:00
Jitendra Nath Pandey
8faf7e8fb6
HDFS-2739. SecondaryNameNode doesn't start up.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229877 13f79535-47bb-0310-9956-ffa450edef68
2012-01-11 02:54:48 +00:00
Todd Lipcon
44d070cd01
HDFS-2724. NN web UI can throw NPE after startup, before standby state is entered. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229466 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 03:46:05 +00:00
Todd Lipcon
526efb48a6
HDFS-2762. Fix TestCheckpoint timing out on HA branch. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229464 13f79535-47bb-0310-9956-ffa450edef68
2012-01-10 03:29:02 +00:00
Aaron Myers
ade897636d
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229279 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 18:01:55 +00:00
Aaron Myers
a7195bdd14
HDFS-2765. TestNameEditsConfigs is incorrectly swallowing IOE. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1229028 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 04:53:20 +00:00
Todd Lipcon
736b1860ab
HDFS-2730. Refactor shared HA-related test code into HATestUtil class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1229023 13f79535-47bb-0310-9956-ffa450edef68
2012-01-09 04:12:37 +00:00
Eli Collins
2d0b340c47
HADOOP-7961. Move HA fencing to common. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228510 13f79535-47bb-0310-9956-ffa450edef68
2012-01-07 00:17:42 +00:00
Todd Lipcon
9a07ba8945
HDFS-2709. Appropriately handle error conditions in EditLogTailer. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228390 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 20:44:05 +00:00
Aaron Myers
d680080da0
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1228339 13f79535-47bb-0310-9956-ffa450edef68
2012-01-06 18:47:05 +00:00
Jitendra Nath Pandey
4efd3699a6
HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings protocol to protocol buffers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227887 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 23:03:31 +00:00
Alejandro Abdelnur
6d45b9e31d
HADOOP-7934. Normalize dependencies versions across all modules. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227787 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:46:42 +00:00
Aaron Myers
3187a3ae05
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227775 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 19:21:01 +00:00
Suresh Srinivas
472e971891
HDFS-2710. Add HDFS tests related to HADOOP-7933. Contributed by Siddarth Seth.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227756 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 18:57:01 +00:00
Todd Lipcon
5b8dcb20a2
HDFS-2291. Allow the StandbyNode to make checkpoints in an HA setup. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227411 13f79535-47bb-0310-9956-ffa450edef68
2012-01-05 00:22:54 +00:00
Todd Lipcon
d004ddee76
HDFS-2720. Fix MiniDFSCluster HA support to work properly on Windows. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227284 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 19:50:41 +00:00
Aaron Myers
cd81cc6664
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1227260 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 18:47:51 +00:00
Harsh J
075122690c
HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1227165 13f79535-47bb-0310-9956-ffa450edef68
2012-01-04 14:15:15 +00:00
Aaron Myers
1423fff096
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1226900 13f79535-47bb-0310-9956-ffa450edef68
2012-01-03 18:07:55 +00:00
Harsh J
8e8203f3c5
HDFS-554. Use System.arraycopy in BlockInfo.ensureCapacity. (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226239 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 12:06:49 +00:00
Harsh J
11905517f1
HDFS-2574. Remove references to some deprecated properties in conf templates and defaults files. (Joe Crobak via harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1226211 13f79535-47bb-0310-9956-ffa450edef68
2012-01-01 03:11:48 +00:00
Todd Lipcon
737df8b67b
HDFS-2716. Configuration needs to allow different dfs.http.addresses for each HA NN. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1226020 13f79535-47bb-0310-9956-ffa450edef68
2011-12-31 01:53:23 +00:00
Todd Lipcon
20a6560bdf
HDFS-2692. Fix bugs related to failover from/into safe mode. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225709 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 00:30:27 +00:00
Todd Lipcon
15ebdd5664
HDFS-2714. Fix test cases which use standalone FSNamesystems. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225708 13f79535-47bb-0310-9956-ffa450edef68
2011-12-30 00:25:21 +00:00
Aaron Myers
f216303598
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1225612 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 18:25:48 +00:00
Harsh J
6c349f9420
HDFS-2729. Update BlockManager's comments regarding the invalid block set (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225591 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 16:51:59 +00:00
Harsh J
41737432c0
HDFS-2726. Fix a logging issue under DFSClient's createBlockOutputStream method (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1225456 13f79535-47bb-0310-9956-ffa450edef68
2011-12-29 07:22:54 +00:00
Aaron Myers
a500ba50c2
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1224965 13f79535-47bb-0310-9956-ffa450edef68
2011-12-27 18:18:36 +00:00
Todd Lipcon
31c91706f7
HDFS-1972. Fencing mechanism for block invalidations and replications. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1221608 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 04:32:40 +00:00
Todd Lipcon
36d1c49486
HDFS-2693. Fix synchronization issues around state transition. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1221582 13f79535-47bb-0310-9956-ffa450edef68
2011-12-21 03:03:23 +00:00
Tsz-wo Sze
3503d9a4a8
HDFS-2706. Use configuration for blockInvalidateLimit if it is set.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1221106 13f79535-47bb-0310-9956-ffa450edef68
2011-12-20 05:49:24 +00:00
Todd Lipcon
57ef902bbc
HDFS-2682. When a FailoverProxyProvider is used, Client should not retry for 45 times if it is timing out to connect to server. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220965 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 21:49:39 +00:00
Todd Lipcon
4bb0456c66
HDFS-2678. When a FailoverProxyProvider is used, DFSClient should not retry connection ten times before failing over. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220942 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 20:57:13 +00:00
Todd Lipcon
08bde10e24
Merge trunk into HA branch to pick up fix for bkjournal findbugs
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220941 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 20:46:58 +00:00
Todd Lipcon
dfba847eb6
Amend HDFS-234 (bkjournal contrib). Fix findbugs build
...
- Fixes pom parent to point to hadoop-project instead of hadoop-project-dist
- Fix relative path in pom to have the correct number of ../s
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220940 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 20:42:25 +00:00
Todd Lipcon
8ff28f4549
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220616 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 05:34:51 +00:00
Todd Lipcon
625d1b380a
HDFS-2677. Web UI should indicate the NN state. Contributed by Eli Collins.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220613 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 05:26:07 +00:00
Todd Lipcon
329717264f
HDFS-2679. Add interface to query current state to HAServiceProtocol. Contributed by Eli Collins.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1220612 13f79535-47bb-0310-9956-ffa450edef68
2011-12-19 05:24:32 +00:00
Eli Collins
5e185702ea
HDFS-2335. DataNodeCluster and NNStorage always pull fresh entropy. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220510 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 18:12:48 +00:00
Todd Lipcon
a89baed833
HDFS-2553. Fix BlockPoolSliceScanner spinning in a tight loop. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220317 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 01:13:00 +00:00
Todd Lipcon
fa1edc9a1e
HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1220315 13f79535-47bb-0310-9956-ffa450edef68
2011-12-18 01:10:49 +00:00
Aaron Myers
08c9dc3780
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215367 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:31:46 +00:00
Suresh Srinivas
89553be90e
HDFS-2687. Tests failing with ClassCastException post protobuf RPC changes. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215366 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:26:46 +00:00
Aaron Myers
52c1491155
HDFS-2694. Removal of Avro broke non-PB NN services. Contributed by Aaron T. Myers.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1215364 13f79535-47bb-0310-9956-ffa450edef68
2011-12-17 00:19:01 +00:00
Todd Lipcon
371f4228e8
HDFS-2684. Fix up some failing unit tests on HA branch. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215241 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 18:36:24 +00:00
Todd Lipcon
cdb9f01ad4
HDFS-2667. Fix transition from active to standby. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215037 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 04:25:13 +00:00
Aaron Myers
71071b904d
HDFS-2602. NN should log newly-allocated blocks without losing BlockInfo. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1215036 13f79535-47bb-0310-9956-ffa450edef68
2011-12-16 04:18:58 +00:00
Aaron Myers
353bc3799d
HDFS-2689. HA: BookKeeperEditLogInputStream doesn't implement isInProgress(). Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214965 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 21:54:00 +00:00
Todd Lipcon
afd0333196
HDFS-2683. Authority-based lookup of proxy provider fails if path becomes canonicalized. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214579 13f79535-47bb-0310-9956-ffa450edef68
2011-12-15 00:42:50 +00:00
Todd Lipcon
ecdf9da770
Fix treatment of NNHAStatusHeartbeat in protobuffer.
...
Committing without pre-commit review since it's a pretty trivial merge fix
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214543 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 23:28:43 +00:00
Todd Lipcon
8134b1c870
Merge trunk into HA branch.
...
Several conflicts around introduction of protobuf translator for DatanodeProtocol - mostly trivial resolutions.
NB: this does not successfully pass any tests since the HAStatus field needs
to be integrated into the HeartbeatResponse Protobuf implementation.
That will be a separate commit for clearer history.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214518 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 22:47:41 +00:00
Todd Lipcon
6c2da4bc0f
HDFS-2680. DFSClient should construct failover proxy with exponential backoff. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214487 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 21:41:31 +00:00
Sanjay Radia
d8dfcdcbc2
HDFS-2669 Enable protobuf rpc for ClientNamenodeProtocol
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214128 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 09:27:51 +00:00
Todd Lipcon
7e8accd68e
HDFS-2671. NN should throw StandbyException in response to RPCs in STANDBY state. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1214117 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 08:56:21 +00:00
Suresh Srinivas
95bdb29aaf
r1214102 should have removed the file. Committing this to remove empty file.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214103 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 08:25:47 +00:00
Suresh Srinivas
60dd76c6ab
HDFS-2676. Remove Avro RPC. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214102 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 08:20:23 +00:00
Todd Lipcon
b9238e3bad
HDFS-2675. Reduce warning verbosity when double-closing edit logs. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214098 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 08:13:55 +00:00
Jitendra Nath Pandey
3cffe34177
HDFS-2661. Enable protobuf RPC for DatanodeProtocol.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214033 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 02:15:37 +00:00
Tsz-wo Sze
433a6e78f6
HDFS-2545. Change WebHDFS to support multiple namenodes in federation.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1214027 13f79535-47bb-0310-9956-ffa450edef68
2011-12-14 01:47:57 +00:00
Suresh Srinivas
3954a2fb1c
HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213985 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:31:44 +00:00
Suresh Srinivas
6a609cb471
Reverting the patch r1213981
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213984 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:27:58 +00:00
Jitendra Nath Pandey
1f2f4e105b
HDFS-234. Integration with BookKeeper logging system. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213983 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:27:13 +00:00
Suresh Srinivas
b5229fd19b
HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213981 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:22:28 +00:00
Suresh Srinivas
3001a172c8
Reverting r1213512 because it committed changes that were not part of the patch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213980 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 23:17:02 +00:00
Aaron Myers
a0fe4f476a
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213867 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 19:02:37 +00:00
Suresh Srinivas
f2f4e93413
HDFS-2650. Replace @inheritDoc with @Override. Contributed by Hari Mankude.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213813 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 18:07:29 +00:00
Suresh Srinivas
4ec8424e5d
HDFS-2666. Fix TestBackupNode failure. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213808 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 17:59:37 +00:00
Eli Collins
c3f7c1f3e5
Add missing file to previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213593 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 08:10:29 +00:00
Eli Collins
5f39d6c239
HDFS-2654. Make BlockReaderLocal not extend RemoteBlockReader2. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213592 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 08:09:50 +00:00
Eli Collins
197634f2f7
HDFS-2653. DFSClient should cache whether addrs are non-local when short-circuiting is enabled. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213586 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 07:51:23 +00:00
Eli Collins
43100e9c0e
HDFS-1765. Block Replication should respect under-replication block priority. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213537 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 01:58:25 +00:00
Suresh Srinivas
13345f3a85
HDFS-2663. Handle protobuf optional parameters correctly. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213512 13f79535-47bb-0310-9956-ffa450edef68
2011-12-13 00:21:48 +00:00
Aaron Myers
89379bc1a3
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1213389 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 19:41:20 +00:00
Sanjay Radia
48da033901
HDFS-2651 ClientNameNodeProtocol Translators for Protocol Buffers (sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213143 13f79535-47bb-0310-9956-ffa450edef68
2011-12-12 05:36:35 +00:00
Suresh Srinivas
2740112bb6
HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1213040 13f79535-47bb-0310-9956-ffa450edef68
2011-12-11 18:53:21 +00:00
Alejandro Abdelnur
e7682e1496
HDFS-2511. Add dev script to generate HDFS protobufs. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212609 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 20:21:19 +00:00
Jitendra Nath Pandey
38a19bc293
HDFS-2642. Protobuf translators for DatanodeProtocol.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212606 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 20:02:33 +00:00
Tsz-wo Sze
9b1f47226b
HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212299 13f79535-47bb-0310-9956-ffa450edef68
2011-12-09 09:26:33 +00:00
Todd Lipcon
2481474bd9
HDFS-2634. Standby needs to ingest latest edit logs before transitioning to active. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1212187 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 23:55:40 +00:00
Sanjay Radia
9f69ae5a9e
HDFS-2597 ClientNameNodeProtocol in Protocol Buffers (sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211769 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 06:48:45 +00:00
Aaron Myers
d9ea5bb489
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211749 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:57:47 +00:00
Todd Lipcon
6016e95fee
HDFS-2627. Determine DN's view of which NN is active based on heartbeat responses. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1211735 13f79535-47bb-0310-9956-ffa450edef68
2011-12-08 02:00:20 +00:00
Aaron Myers
a27adf3de4
HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. Contributed by Aaron T. Myers
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211650 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 21:47:13 +00:00
Suresh Srinivas
c17bb83644
HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211249 13f79535-47bb-0310-9956-ffa450edef68
2011-12-07 01:05:56 +00:00
Suresh Srinivas
7a59150bff
HDFS-2629. Implement protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211206 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 22:19:10 +00:00
Jitendra Nath Pandey
b981daa07f
HDFS-1580. Committing the test case, it was missed in earlier commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210749 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 02:15:56 +00:00
Jitendra Nath Pandey
8c0f2a0d59
HDFS-2618. Fix for the build failure caused by previous commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210746 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 02:08:48 +00:00
Suresh Srinivas
0a713035f2
HDFS-2618. Implement protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210719 13f79535-47bb-0310-9956-ffa450edef68
2011-12-06 00:25:25 +00:00
Todd Lipcon
f39aac60e0
Merge trunk into branch.
...
Resolved conflicts generated by commit of HDFS-1580 in trunk:
- made EditLogInputStream.isInProgress public
- fixed trivial conflict in DFSConfigKeys
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210666 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 22:10:35 +00:00
Suresh Srinivas
c256f8266d
HDFS-2581. Implement protobuf service for JournalProtocol. Contributed Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210657 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:52:23 +00:00
Todd Lipcon
6491444357
Fix to previous trunk merge - RPC's addProtocol method now needs an RpcKind
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210638 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 21:13:07 +00:00
Jitendra Nath Pandey
d18e5b3844
HDFS-1580. Add interface for generic Write Ahead Logging mechanisms. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210602 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 20:10:27 +00:00
Aaron Myers
8a4db4d331
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210547 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 18:00:44 +00:00
Todd Lipcon
ad7fe4e21e
HDFS-2625. TestDfsOverAvroRpc failing after introduction of HeartbeatResponse type. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210342 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 06:38:52 +00:00
Todd Lipcon
c7f5167845
HDFS-2624. ConfiguredFailoverProxyProvider doesn't correctly stop ProtocolTranslators. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210341 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 06:37:46 +00:00
Todd Lipcon
b3f28dbb3d
HDFS-2626. BPOfferService.verifyAndSetNamespaceInfo needs to be synchronized. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1210340 13f79535-47bb-0310-9956-ffa450edef68
2011-12-05 06:36:00 +00:00
Sanjay Radia
65200998c0
HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
2011-12-04 20:44:36 +00:00
Todd Lipcon
74b1f069cc
Amend HDFS-2616 to fix mocking in TestBPOfferService
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209315 13f79535-47bb-0310-9956-ffa450edef68
2011-12-02 00:03:17 +00:00
Todd Lipcon
28dbd56de0
HDFS-2623. Add test case for hot standby capability. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209256 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 21:37:08 +00:00
Todd Lipcon
f4fa76719e
HDFS-2612. Handle refreshNameNodes in federated HA clusters. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209249 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 21:26:08 +00:00
Todd Lipcon
4cbead8484
HDFS-2622. Fix TestDFSUpgrade in HA branch. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1209230 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 20:38:46 +00:00
Suresh Srinivas
8dbb523768
HDFS-2616. Change DatanodeProtocol#sendHeartbeat() to return HeartbeatResponse. (suresh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208987 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 08:03:41 +00:00
Suresh Srinivas
1e346aa829
HDFS-1971. Send block report from datanode to both active and standby namenodes. (sanjay, todd via suresh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208925 13f79535-47bb-0310-9956-ffa450edef68
2011-12-01 01:10:28 +00:00
Todd Lipcon
f87a4b40bc
HDFS-1975. Support for sharing the namenode state from active to standby. Contributed by Jitendra Nath Pandey, Aaron T Myers, and Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208813 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 21:46:22 +00:00
Aaron Myers
0eec2218a1
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208644 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 18:27:04 +00:00
Eli Collins
68ff73c802
Ammend HDFS-2570 to shorten description.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208313 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 07:49:15 +00:00
Todd Lipcon
bb91ebb53c
HDFS-2591. MiniDFSCluster support to mix and match federation with HA. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208297 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 06:49:30 +00:00
Alejandro Abdelnur
afbc3aa30c
HDFS-2606. webhdfs client filesystem impl must set the content-type header for create/append. (tucu)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208157 13f79535-47bb-0310-9956-ffa450edef68
2011-11-30 00:25:54 +00:00
Tsz-wo Sze
0398a9e88d
HDFS-2604. Add a log message to show if WebHDFS is enabled and a configuration section in the forrest doc.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208140 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 23:38:59 +00:00
Aaron Myers
ee97365f58
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1208002 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 17:55:28 +00:00
Todd Lipcon
9146ad23f3
HDFS-2582. Scope dfs.ha.namenodes config by nameservice. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207738 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 02:27:45 +00:00
Konstantin Shvachko
68f56ca906
HDFS-2287. Fix second assert.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207710 13f79535-47bb-0310-9956-ffa450edef68
2011-11-29 00:03:49 +00:00
Eli Collins
b32543d9ae
HDFS-2596. TestDirectoryScanner doesn't test parallel scans. (eli)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1207694 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 23:20:16 +00:00
Aaron Myers
73b3de6204
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1207490 13f79535-47bb-0310-9956-ffa450edef68
2011-11-28 18:21:46 +00:00
Tsz-wo Sze
4b65d10cfe
HDFS-2590. Fix the missing links in the WebHDFS forrest doc.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1206178 13f79535-47bb-0310-9956-ffa450edef68
2011-11-25 13:58:29 +00:00
Konstantin Shvachko
080a34143d
HADOOP-7861. changes2html.pl generates links to HADOOP, HDFS, and MAPREDUCE jiras. Contributed by Konstantin Shvachko.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205988 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 21:44:36 +00:00
Todd Lipcon
5f5b3bbdcd
HDFS-2577. NN fails to start since it tries to start secret manager in safemode. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1205689 13f79535-47bb-0310-9956-ffa450edef68
2011-11-24 00:55:37 +00:00
Matthew Foley
db092f5048
HADOOP-7827 HDFS-2588 MAPREDUCE-3464. jsp pages missing DOCTYPE. Contributed by Dave Vronay.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205519 13f79535-47bb-0310-9956-ffa450edef68
2011-11-23 18:15:37 +00:00
Tsz-wo Sze
7381884e85
HDFS-2552. Add Forrest doc for WebHDFS REST API.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1205146 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 20:04:58 +00:00
Suresh Srinivas
49417594e8
HDFS-2519. Add protobuf service for DatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204825 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 06:25:13 +00:00
Todd Lipcon
6a0671977b
Merge trunk into HDFS-1623 branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1204794 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 03:18:47 +00:00
Tsz-wo Sze
2ab10e29d9
HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204792 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 02:57:04 +00:00
Konstantin Boudnik
a2e66776a9
HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204781 13f79535-47bb-0310-9956-ffa450edef68
2011-11-22 02:15:49 +00:00
Suresh Srinivas
5293760973
HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204753 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 23:49:44 +00:00
Suresh Srinivas
b76b85986e
HDFS-2520. Add protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204709 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 21:11:43 +00:00
Suresh Srinivas
4754b80862
HDFS-2518. Add protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204707 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 21:10:04 +00:00
Todd Lipcon
39ce694d05
HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204659 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:27:00 +00:00
Todd Lipcon
68173af69d
HDFS-2575. DFSTestUtil may create empty files. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204652 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 19:03:31 +00:00
Suresh Srinivas
54ac7e5413
HDFS-2517. Add protobuf service for JounralProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204544 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 15:39:33 +00:00
Eli Collins
9c2f4f634d
HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204370 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 07:01:29 +00:00
Todd Lipcon
5bc66c4c86
HDFS-2532. TestDfsOverAvroRpc timing out in trunk. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204366 13f79535-47bb-0310-9956-ffa450edef68
2011-11-21 06:41:56 +00:00
Harsh J
67f25b0a1b
HDFS-2572. Remove Unnecessary double-check in DN#getHostName (harsh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204177 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 15:18:14 +00:00
Eli Collins
5573b691d5
HDFS-2567. When 0 DNs are available, show a proper error when trying to browse DFS via web UI. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204131 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 06:28:37 +00:00
Eli Collins
8686a00c7a
HDFS-2570. Add descriptions for dfs.*.https.address in hdfs-default.xml. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204129 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 06:22:44 +00:00
Eli Collins
8e8bb50afd
HDFS-2454. Move maxXceiverCount check to before starting the thread in dataXceiver. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204124 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 04:27:59 +00:00
Eli Collins
513718f92d
HDFS-2568. Use a set to manage child sockets in XceiverServer. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204122 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 04:13:32 +00:00
Eli Collins
b2313021fd
HDFS-2536. Remove unused imports. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204120 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:58:50 +00:00
Eli Collins
0e5c1a45bf
HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204119 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:38:51 +00:00
Eli Collins
84f0c0f180
HDFS-2502. hdfs-default.xml should include dfs.name.dir.restore. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204117 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 03:29:20 +00:00
Eli Collins
7a8015c0e2
HDFS-2541. For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. Contributed by Harsh J
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1204114 13f79535-47bb-0310-9956-ffa450edef68
2011-11-20 02:51:50 +00:00
Eli Collins
b7cd8c0f86
HDFS-2564. Cleanup unnecessary exceptions thrown and unnecessary casts. Contributed by Hari Mankude
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203950 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 02:34:25 +00:00
Todd Lipcon
1f92266516
HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203943 13f79535-47bb-0310-9956-ffa450edef68
2011-11-19 01:31:59 +00:00
Aaron Myers
67c372991c
Merge trunk into HA branch.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1203781 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 18:29:26 +00:00
Todd Lipcon
905a127850
HDFS-2562. Refactor DN configuration variables out of DataNode class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203543 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 09:04:20 +00:00
Thomas White
6a01c22755
HDFS-2543. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203486 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 05:10:40 +00:00
Thomas White
dc5a0ab245
HDFS-2544. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203452 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:53:46 +00:00
Todd Lipcon
0864ef1908
HDFS-2560. Refactor BPOfferService to be a static inner class. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1203444 13f79535-47bb-0310-9956-ffa450edef68
2011-11-18 00:45:31 +00:00
Aaron Myers
0d171f6513
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1202013 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 02:39:13 +00:00
Todd Lipcon
9a3f147fdd
HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201991 13f79535-47bb-0310-9956-ffa450edef68
2011-11-15 01:13:58 +00:00
Todd Lipcon
51ce383112
HDFS-2532. Add timeout to TestDfsOverAvroRpc
...
This test is timing out on trunk, causing tests below it to
fail spuriously. This patch doesn't fix the issue -- just adds
a JUnit timeout so that the failure is properly attributed
to this test.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1201963 13f79535-47bb-0310-9956-ffa450edef68
2011-11-14 23:34:21 +00:00
Tsz-wo Sze
09a156fcce
HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1200731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-11 04:19:45 +00:00
Tsz-wo Sze
94c631af1f
HDFS-2540. Webhdfs: change "Expect: 100-continue" to two-step write; change "HdfsFileStatus" and "localName" respectively to "FileStatus" and "pathSuffix" in JSON response.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199396 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 19:25:57 +00:00
Hairong Kuang
6dff9329d5
HDFS-2495. Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock. Contributed by Tomasz Nykiel.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1199024 13f79535-47bb-0310-9956-ffa450edef68
2011-11-08 00:16:23 +00:00
Tsz-wo Sze
a590b498ac
HDFS-2528. Webhdfs: set delegation kind to WEBHDFS and add a HDFS token when http requests are redirected to datanode.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1198903 13f79535-47bb-0310-9956-ffa450edef68
2011-11-07 20:05:16 +00:00
Hairong Kuang
db13c99940
Add the missing test file to HDFS-2477.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197801 13f79535-47bb-0310-9956-ffa450edef68
2011-11-04 21:49:15 +00:00
Tsz-wo Sze
6afe3e0d22
HDFS-2527. WebHdfs: remove the use of "Range" header in Open; use ugi username if renewer parameter is null in GetDelegationToken; response OK when setting replication for non-files; rename GETFILEBLOCKLOCATIONS to GET_BLOCK_LOCATIONS and state that it is a private unstable API; replace isDirectory and isSymlink with enum {FILE, DIRECTORY, SYMLINK} in HdfsFileStatus JSON object.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1197329 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 22:34:47 +00:00
Todd Lipcon
40fe96546f
HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196976 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 06:54:59 +00:00
Todd Lipcon
11cf658d0a
HDFS-2533. Remove needless synchronization on some FSDataSet methods. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196902 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 01:00:25 +00:00
Todd Lipcon
f84552ac35
HDFS-2130. Switch default checksum to CRC32C. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196889 13f79535-47bb-0310-9956-ffa450edef68
2011-11-03 00:35:37 +00:00
Hairong Kuang
a4baabe4a4
HDFS-2477. Optimize computing the diff between a block report and the namenode state. Contributed by Tomasz Nykiel.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196676 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 16:31:21 +00:00
Aaron Myers
571d7990f4
Merge trunk into HA branch
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1196458 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 05:34:31 +00:00
Jitendra Nath Pandey
bd21ddcb78
HDFS-2416. distcp with a webhdfs uri on a secure cluster fails.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196434 13f79535-47bb-0310-9956-ffa450edef68
2011-11-02 02:08:20 +00:00
Aaron Myers
abe45f59ac
HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry (atm)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196171 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 17:59:53 +00:00
Eli Collins
4961441584
HDFS-2308. NamenodeProtocol.endCheckpoint is vestigial and can be removed. Contributed by Eli Collins
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1196113 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 16:44:28 +00:00
Konstantin Shvachko
22000ce96d
HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195869 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 08:37:11 +00:00
Todd Lipcon
1c940637b1
HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195829 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 05:17:08 +00:00
Tsz-wo Sze
bb8fd6a267
TestHDFSCLI is failing due to HADOOP-7360. HDFS-2038 is going to fix it. Disable it for the moment.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195754 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:31:06 +00:00
Todd Lipcon
3ab295994a
HDFS-2523. Small NN fixes to include HAServiceProtocol and prevent NPE on shutdown. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1195753 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 01:29:59 +00:00
Tsz-wo Sze
8d1a09b741
HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195731 13f79535-47bb-0310-9956-ffa450edef68
2011-11-01 00:38:57 +00:00
Todd Lipcon
c46876982e
HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195693 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 21:53:58 +00:00
Tsz-wo Sze
32cad9affe
HDFS-2385. Support renew and cancel delegation tokens in webhdfs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195656 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 20:37:16 +00:00
Jitendra Nath Pandey
7cb77a3b1b
HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195620 13f79535-47bb-0310-9956-ffa450edef68
2011-10-31 19:03:55 +00:00
Konstantin Shvachko
64c019cccc
HDFS-2285. BackupNode should reject requests to modify namespace. Contributed by Konstantin Shvachko and Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1195013 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 20:11:35 +00:00
Tsz-wo Sze
2eca60199a
Revert 1190677 for HDFS-2509.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1194986 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 19:31:06 +00:00
Tsz-wo Sze
2dcd43c7b1
HDFS-2436. Change FSNamesystem.setTimes(..) for allowing setting times on directories. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190708 13f79535-47bb-0310-9956-ffa450edef68
2011-10-29 00:19:21 +00:00
Tsz-wo Sze
c8ac31e9a0
HDFS-2509. Add a test for DistributedFileSystem.getFileChecksum(..) on directories or non existing files. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190677 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 23:42:27 +00:00
Todd Lipcon
6b0963c53b
HDFS-2465. Add HDFS support for fadvise readahead and drop-behind. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190626 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 22:18:42 +00:00
Suresh Srinivas
c0c938f242
HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190620 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 22:06:04 +00:00
Tsz-wo Sze
9692cfc9ae
HDFS-2493. Remove reference to FSNamesystem in blockmanagement classes.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190491 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 18:28:26 +00:00
Eric Yang
da1db28e93
HADOOP-7740. Fixed security audit logger configuration. (Arpit Gupta via Eric Yang)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190452 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 17:08:09 +00:00
Sanjay Radia
b49c95a5d9
HDFS-2479 HDFS Client Data Types in Protocol Buffers (sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190127 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 01:52:00 +00:00
Aaron Myers
efb2d93f77
HDFS-2393. Mark appropriate methods of ClientProtocol with the idempotent annotation. (atm)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190088 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:26:44 +00:00
Aaron Myers
180646dea3
HDFS-2418. Change ConfiguredFailoverProxyProvider to take advantage of HDFS-2231. (atm)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190078 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:15:07 +00:00
Tsz-wo Sze
8cb0d4b380
HDFS-2432. Webhdfs: response FORBIDDEN when setReplication on non-files; clear umask before creating a flie; throw IllegalArgumentException if setOwner with both owner and group empty; throw FileNotFoundException if getFileStatus on non-existing files; fix bugs in getBlockLocations; and changed getFileChecksum json response root to "FileChecksum".
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190077 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:13:26 +00:00
Todd Lipcon
221aadbc5b
HDFS-2500. Avoid file system operations in BPOfferService thread while processing deletes. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190071 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:47:19 +00:00
Todd Lipcon
646e855f6e
HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1190060 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:11:10 +00:00
Todd Lipcon
ebb6cc60c4
HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190059 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:10:58 +00:00
Suresh Srinivas
456ca74b96
HDFS-2496. Separate datatypes for DatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189901 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 18:09:42 +00:00
Tsz-wo Sze
10dc6b0927
HDFS-1869. mkdirs should use the supplied permission for all of the created directories. Contributed by Daryn Sharp
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189546 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 00:02:19 +00:00
Tsz-wo Sze
758194382c
HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods. Contributed by Uma Maheswara Rao G
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189360 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:24:29 +00:00
Jitendra Nath Pandey
8534e70044
HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189355 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 18:15:58 +00:00
Tsz-wo Sze
8335995630
HDFS-2501. Add version prefix and root methods to webhdfs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1189028 13f79535-47bb-0310-9956-ffa450edef68
2011-10-26 05:16:57 +00:00
Mahadev Konar
d19cfe0164
MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188522 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 06:07:13 +00:00
Suresh Srinivas
a268a3c0e4
HDFS-2488. Separate datatypes for InterDatanodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188487 13f79535-47bb-0310-9956-ffa450edef68
2011-10-25 01:32:49 +00:00
Suresh Srinivas
4846ca7863
HDFS-2497 Fix TestBackupNode failure. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188436 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 23:07:13 +00:00
Sanjay Radia
0920056f04
HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol (sanjay)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188300 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 19:08:03 +00:00
Suresh Srinivas
8fe95d276d
Added missing files for HDFS-2489 commit.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188286 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 18:46:59 +00:00
Suresh Srinivas
2b35e8aa4f
HDFS-2489. Move Finalize and Register to separate file out of DatanodeCommand.java. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1188282 13f79535-47bb-0310-9956-ffa450edef68
2011-10-24 18:40:13 +00:00
Konstantin Shvachko
6e0991704f
HDFS-2452. OutOfMemoryError in DataXceiverServer takes down the DataNode. Contributed by Uma Maheswara Rao.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187965 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 20:17:04 +00:00
Steve Loughran
a54ccc0bde
HDFS-2485
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187888 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 14:14:22 +00:00
Steve Loughran
2690d0db0e
HDFS-2485
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187887 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 14:13:58 +00:00
Konstantin Shvachko
7dd869c2a9
HDFS-2491. TestBalancer can fail when datanode utilization and avgUtilization is exactly same. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187837 13f79535-47bb-0310-9956-ffa450edef68
2011-10-23 00:35:55 +00:00
Suresh Srinivas
d2e1a71918
HDFS-2480. Separate datatypes for NamenodeProtocol. Contributed by Suresh Srinivas.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187505 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 19:03:18 +00:00
Tsz-wo Sze
7c48130d41
HDFS-2427. Change the default permission in webhdfs to 755 and add range check/validation for all parameters.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1187140 13f79535-47bb-0310-9956-ffa450edef68
2011-10-21 00:27:08 +00:00
Suresh Srinivas
520d2502c5
HDFS-2459. Separate datatypes for Journal Protocol. (suresh)
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186896 13f79535-47bb-0310-9956-ffa450edef68
2011-10-20 16:31:57 +00:00
Arun Murthy
a6cc9bafa8
HDFS-2445. Ensure failed tests exit with proper error code. Contributed by Jonathan Eagles.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186550 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 22:51:51 +00:00
Tsz-wo Sze
0bd8f0bd40
HDFS-2453. Fix http response code for partial content in webhdfs, added getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem and cleared content type in ExceptionHandler.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1186508 13f79535-47bb-0310-9956-ffa450edef68
2011-10-19 21:38:58 +00:00
Owen O'Malley
073a13aeb1
HDFS-2467. HftpFileSystem uses incorrect compare for finding delegation
...
tokens. (omalley)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185842 13f79535-47bb-0310-9956-ffa450edef68
2011-10-18 20:33:16 +00:00
Jitendra Nath Pandey
ab7e7dfd7e
Merged r1185354 from trunk for HDFS-2188.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1185363 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 20:42:32 +00:00
Jitendra Nath Pandey
8d4842383e
HDFS-2188. Make FSEditLog create its journals from a list of URIs rather than NNStorage. Contributed by Ivan Kelly.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1185354 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 20:23:57 +00:00
Tsz-wo Sze
50cb2771e9
HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing file or creating a file without specifying the replication parameter.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183554 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 23:25:09 +00:00
Konstantin Shvachko
4cb7a4854d
HDFS-2012. Balancer incorrectly treats nodes whose utilization equals avgUtilization. Contributed by Uma Maheswara Rao G.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183457 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 18:31:55 +00:00
Jitendra Nath Pandey
002dd6968b
MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183187 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 01:24:20 +00:00
Tsz-wo Sze
c46dbedaf9
HDFS-2424. Added a root element "HdfsFileStatuses" for the response of webhdfs listStatus.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183175 13f79535-47bb-0310-9956-ffa450edef68
2011-10-14 00:30:30 +00:00
Tsz-wo Sze
5904e00b4f
HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException to IllegalArgumentException and response it http BAD_REQUEST in webhdfs.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183098 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 21:06:41 +00:00
Tsz-wo Sze
7d1a5078b7
HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in webhdfs responses.
...
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1183081 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 20:41:00 +00:00