big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,752 Commits 2 Branches 2 Tags 264 MiB
2bf19979b3
Commit Graph

366 Commits

Author SHA1 Message Date
Todd Lipcon
2bf19979b3 Merge trunk into auto-failover branch. 
Needs a few tweaks to fix compilation - will do in followup commit. This is just a straight merge


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324567 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:47:40 +00:00
Todd Lipcon
41a014c31b HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-11 05:40:26 +00:00
Robert Joseph Evans
482e0638e8 HADOOP-8264. Remove irritating double double quotes in front of hostname (Bernd Fondermann via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311738 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 14:12:02 +00:00
Todd Lipcon
4b0d4d54d9 HADOOP-8263. Stringification of IPC calls not useful. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311543 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-10 01:02:05 +00:00
Aaron Myers
909176c1fc HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311133 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-09 05:56:22 +00:00
Todd Lipcon
693ec453d2 HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310919 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 23:24:57 +00:00
Todd Lipcon
ca6f0940fd Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310905 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-07 22:53:55 +00:00
Todd Lipcon
97804bacd0 HDFS-3223. add zkfc to hadoop-daemon.sh script. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310620 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 22:27:28 +00:00
Robert Joseph Evans
fcb3ff5d18 HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310555 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 19:16:13 +00:00
Robert Joseph Evans
534591697c HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary (John George via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310507 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 17:54:40 +00:00
Todd Lipcon
30068a1d83 Merge trunk into auto-failover branch. 
Addressed two semantic conflicts after the commit of HADOOP-8077 -- test code was referencing the old constant for the fencing methods config key.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310174 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 05:07:33 +00:00
Todd Lipcon
d483b6f3fc HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310173 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:56:26 +00:00
Todd Lipcon
04cc1d614d HADOOP-8251. Fix SecurityUtil.fetchServiceTicket after HADOOP-6941. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310168 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:47:05 +00:00
Todd Lipcon
844faefd08 HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-06 04:27:44 +00:00
Tsz-wo Sze
bf5b508074 HADOOP-6963. In FileUtil.getDU(..), neither include the size of directories nor follow symbolic links. Contributed by Ravi Prakash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309994 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-05 18:28:34 +00:00
Aaron Myers
8a109ebebb HADOOP-8244. Improve comments on ByteBufferReadable.read. Contributed by Henry Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309625 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 23:36:29 +00:00
Todd Lipcon
00a1548005 Merge trunk into auto-HA branch 
Resolved some trivial conflicts in NNHAServiceTarget


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309576 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 20:00:15 +00:00
Robert Joseph Evans
fcacb14a1e HADOOP-8179. risk of NPE in CopyCommands processArguments() (Daryn Sharp via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309572 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:53:09 +00:00
Todd Lipcon
b74d742785 HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 19:21:01 +00:00
Todd Lipcon
dae6daba8c HADOOP-8007. Use substitution tokens for fencing argument. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309285 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-04 08:27:16 +00:00
Todd Lipcon
30e1b3bba8 HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 23:37:15 +00:00
Todd Lipcon
39a5fd5c71 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309164 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 21:48:23 +00:00
Todd Lipcon
84ff2d6d06 HADOOP-8243. Security support broken in CLI (manual) failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309135 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-03 20:41:26 +00:00
Eli Collins
9b1d2949ae HADOOP-8242. AbstractDelegationTokenIdentifier: add getter methods for owner and realuser. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308485 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 19:22:10 +00:00
Eli Collins
950273bde4 HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308457 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 18:49:06 +00:00
Todd Lipcon
2fd05aa597 Merge trunk into auto-failover branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308260 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 07:28:42 +00:00
Todd Lipcon
a4ccb8f504 HADOOP-8236. haadmin should have configurable timeouts for failover commands. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308235 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-02 03:48:28 +00:00
Eli Collins
78e3568340 HADOOP-8238. NetUtils#getHostNameOfIP blows up if given ip:port string w/o port. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308192 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 20:07:03 +00:00
Uma Maheswara Rao G
2c47463cba HADOOP-8199. Fix issues in start-all.sh and stop-all.sh Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1308180 13f79535-47bb-0310-9956-ffa450edef68
 2012-04-01 19:00:38 +00:00
Todd Lipcon
543701387f HADOOP-8228. Auto HA: Refactor tests and add stress tests. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307599 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:30:47 +00:00
Todd Lipcon
6693167028 HADOOP-8220. ZKFailoverController doesn't handle failure to become active correctly. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307596 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-30 20:23:59 +00:00
Todd Lipcon
04416861eb Amend HADOOP-8212 (Improve ActiveStandbyElector's behavior when session expires) 
Amendment patch incorporates following feedback from Bikas Saha:
- adds a new functional test for session expiration while in the standby state
- adds a safety check in the StatCallback for session expiration
- improves some comments


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307128 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:49:37 +00:00
Eli Collins
9b588ed924 HADOOP-8149. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1307106 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 21:00:35 +00:00
Eli Collins
978404d1a8 HADOOP-8208. Disallow self failover. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306935 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-29 15:48:58 +00:00
Arun Murthy
67a74198b1 Changed version in trunk to 3.0.0-SNAPSHOT. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306200 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 07:37:06 +00:00
Todd Lipcon
84a97fbcf6 HADOOP-8218. RPC.closeProxy shouldn't throw error when closing a mock. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1306164 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-28 04:53:26 +00:00
Eli Collins
f9fec982f7 HADOOP-8216. Address log4j.properties inconsistencies btw main and template dirs. Contributed by Patrick Hunt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305891 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 16:32:37 +00:00
Suresh Srinivas
600e327a56 HADOOP-8202. RPC stopProxy() does not close the proxy correctly. Contributed by Hari Mankude. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305704 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-27 01:31:29 +00:00
Todd Lipcon
578f413778 HADOOP-8206. Common portion of a ZK-based failover controller. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305673 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 23:37:33 +00:00
Todd Lipcon
31c2e3f29c HADOOP-8212. Improve ActiveStandbyElector's behavior when session expires. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305510 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 19:31:43 +00:00
Todd Lipcon
1d5e7dde95 HADOOP-8204. TestHealthMonitor fails occasionally. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305199 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 01:57:03 +00:00
Todd Lipcon
840df19cee HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305195 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-26 01:54:14 +00:00
Todd Lipcon
39775dca68 Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1305152 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-25 21:38:31 +00:00
Todd Lipcon
90ea037d21 HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304967 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 23:48:07 +00:00
Todd Lipcon
805c1280ce HADOOP-8163. Improve ActiveStandbyElector to provide hooks for fencing old active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304675 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-24 00:05:33 +00:00
Thomas White
1ff0359aa0 HADOOP-7030. Add TableMapping topology implementation to read host to rack mapping from a file. Contributed by Patrick Angeles and tomwhite. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304597 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 21:03:30 +00:00
Tsz-wo Sze
081eda94fe HADOOP-8184. ProtoBuf RPC engine uses the IPC layer reply packet. Contributed by Sanjay Radia 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304542 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 18:21:45 +00:00
Todd Lipcon
b795c65f49 HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304203 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-23 06:29:40 +00:00
Eli Collins
b5a8ccb75b HADOOP-8159. NetworkTopology: getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304118 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 22:43:28 +00:00
Eli Collins
0259a3ea6b HADOOP-8200. Remove HADOOP_[JOBTRACKER|TASKTRACKER]_OPTS. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1304112 13f79535-47bb-0310-9956-ffa450edef68
 2012-03-22 22:36:39 +00:00