Commit Graph

399 Commits

Author SHA1 Message Date
Todd Lipcon
f6c01e2f8e Merge trunk into auto-HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333291 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 02:14:01 +00:00
Todd Lipcon
9d5799553f HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68
2012-05-03 01:56:33 +00:00
Alejandro Abdelnur
6575fcd430 HADOOP-8214. make hadoop script recognize a full set of deprecated commands (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333231 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 22:43:59 +00:00
Alejandro Abdelnur
a5a2abbacc HADOOP-8342. HDFS command fails with exception following merge of HADOOP-8325 (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333224 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 21:48:39 +00:00
Aaron Myers
13a5af0907 HADOOP-8185. Update namenode -format documentation and add -nonInteractive and -force. Contributed by Arpit Gupta.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1333141 13f79535-47bb-0310-9956-ffa450edef68
2012-05-02 18:17:18 +00:00
Thomas Graves
70c392df0e HADOOP-8339. jenkins complaining about 16 javadoc warnings (Tom White and Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332853 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 21:46:58 +00:00
Eli Collins
bbfda83044 HADOOP-8275. Range check DelegationKey length. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332839 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 21:25:36 +00:00
Robert Joseph Evans
7d1b804d3a HADOOP-8172. Configuration no longer sets all keys in a deprecated key list. (Anupam Seth via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332821 13f79535-47bb-0310-9956-ffa450edef68
2012-05-01 21:00:52 +00:00
Robert Joseph Evans
1e88c1f088 HADOOP-8335. Improve Configuration's address handling (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332427 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 21:55:26 +00:00
Alejandro Abdelnur
8a0c7323ce HADOOP-8325. Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332345 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 19:21:11 +00:00
Robert Joseph Evans
097a001b3f HADOOP-8334. HttpServer sometimes returns incorrect port (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1332336 13f79535-47bb-0310-9956-ffa450edef68
2012-04-30 18:56:42 +00:00
Robert Joseph Evans
500dc61523 HADOOP-8305. distcp over viewfs is broken (John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331440 13f79535-47bb-0310-9956-ffa450edef68
2012-04-27 14:39:35 +00:00
Alejandro Abdelnur
17e03547dc HADOOP-8321. TestUrlStreamHandler fails. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331073 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 20:35:58 +00:00
Aaron Myers
4b62c68292 HADOOP-8310. FileContext#checkPath should handle URIs with no port. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1331007 13f79535-47bb-0310-9956-ffa450edef68
2012-04-26 18:19:01 +00:00
Thomas Graves
e84b552713 HADOOP-8296. hadoop/yarn daemonlog usage wrong (Devaraj K via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330445 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 17:59:08 +00:00
Alejandro Abdelnur
e29ede3f72 HADOOP-8314. HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1330086 13f79535-47bb-0310-9956-ffa450edef68
2012-04-25 03:20:53 +00:00
Alejandro Abdelnur
706e861a85 HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329994 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 20:33:05 +00:00
Todd Lipcon
c6e1321245 HADOOP-8306. ZKFC: improve error message when ZK is not running. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1329960 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 19:34:51 +00:00
Eli Collins
858887e289 HADOOP-8152. Expand public APIs for security library classes. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329541 13f79535-47bb-0310-9956-ffa450edef68
2012-04-24 03:59:35 +00:00
Sanjay Radia
589c68ae09 HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1329319 13f79535-47bb-0310-9956-ffa450edef68
2012-04-23 16:34:21 +00:00
Thomas White
0363ca0489 HADOOP-7350. Use ServiceLoader to discover compression codec classes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328083 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 19:20:31 +00:00
Robert Joseph Evans
f6cadd8610 HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1328018 13f79535-47bb-0310-9956-ffa450edef68
2012-04-19 16:05:34 +00:00
Todd Lipcon
ca49126e3d Merge trunk into auto-HA branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1327724 13f79535-47bb-0310-9956-ffa450edef68
2012-04-18 23:35:30 +00:00
Aaron Myers
c21bd72a2f HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327182 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 17:06:38 +00:00
Aaron Myers
1675c18ded Revert HADOOP-8280 so it can be recommitted using `svn mv'
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327179 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 16:49:04 +00:00
Robert Joseph Evans
e8eed2f62d HADOOP-8227. Allow RPC to limit ephemeral port range. (bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327127 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 15:04:20 +00:00
Robert Joseph Evans
a98ba41092 HADOOP-8286. Simplify getting a socket address from conf (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1327108 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 14:21:11 +00:00
Eli Collins
207a2ada0c HADOOP-8282. start-all.sh refers incorrectly start-dfs.sh existence for starting start-yarn.sh. Contributed by Devaraj K
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326890 13f79535-47bb-0310-9956-ffa450edef68
2012-04-17 02:44:06 +00:00
Aaron Myers
551468385c HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1326727 13f79535-47bb-0310-9956-ffa450edef68
2012-04-16 18:28:36 +00:00
Todd Lipcon
2ed825e66c HDFS-3159. Document NN auto-failover setup and configuration. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325539 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 21:53:42 +00:00
Robert Joseph Evans
047a7b276c HADOOP-7510. Tokens should use original hostname provided instead of ip (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325500 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 20:43:18 +00:00
Eli Collins
f01ede227f HADOOP-8144. pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node. Contributed by Junping Du
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325367 13f79535-47bb-0310-9956-ffa450edef68
2012-04-12 16:37:15 +00:00
Eli Collins
b31d9d9d86 HADOOP-8270. hadoop-daemon.sh stop action should return 0 for an already stopped service. Contributed by Roman Shaposhnik
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1325069 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 23:57:12 +00:00
Todd Lipcon
2bf19979b3 Merge trunk into auto-failover branch.
Needs a few tweaks to fix compilation - will do in followup commit. This is just a straight merge


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324567 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:47:40 +00:00
Todd Lipcon
41a014c31b HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68
2012-04-11 05:40:26 +00:00
Robert Joseph Evans
482e0638e8 HADOOP-8264. Remove irritating double double quotes in front of hostname (Bernd Fondermann via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311738 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 14:12:02 +00:00
Todd Lipcon
4b0d4d54d9 HADOOP-8263. Stringification of IPC calls not useful. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311543 13f79535-47bb-0310-9956-ffa450edef68
2012-04-10 01:02:05 +00:00
Aaron Myers
909176c1fc HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311133 13f79535-47bb-0310-9956-ffa450edef68
2012-04-09 05:56:22 +00:00
Todd Lipcon
693ec453d2 HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310919 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 23:24:57 +00:00
Todd Lipcon
ca6f0940fd Merge trunk into auto-failover branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310905 13f79535-47bb-0310-9956-ffa450edef68
2012-04-07 22:53:55 +00:00
Todd Lipcon
97804bacd0 HDFS-3223. add zkfc to hadoop-daemon.sh script. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310620 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 22:27:28 +00:00
Robert Joseph Evans
fcb3ff5d18 HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310555 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 19:16:13 +00:00
Robert Joseph Evans
534591697c HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary (John George via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310507 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 17:54:40 +00:00
Todd Lipcon
30068a1d83 Merge trunk into auto-failover branch.
Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 05:07:33 +00:00
Todd Lipcon
d483b6f3fc HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 04:56:26 +00:00
Todd Lipcon
04cc1d614d HADOOP-8251. Fix SecurityUtil.fetchServiceTicket after HADOOP-6941. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310168 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 04:47:05 +00:00
Todd Lipcon
844faefd08 HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68
2012-04-06 04:27:44 +00:00
Tsz-wo Sze
bf5b508074 HADOOP-6963. In FileUtil.getDU(..), neither include the size of directories nor follow symbolic links. Contributed by Ravi Prakash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309994 13f79535-47bb-0310-9956-ffa450edef68
2012-04-05 18:28:34 +00:00
Aaron Myers
8a109ebebb HADOOP-8244. Improve comments on ByteBufferReadable.read. Contributed by Henry Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309625 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 23:36:29 +00:00
Todd Lipcon
00a1548005 Merge trunk into auto-HA branch
Resolved some trivial conflicts in NNHAServiceTarget


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68
2012-04-04 20:00:15 +00:00