big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,075 Commits 2 Branches 2 Tags 264 MiB
d1207cbd88
Commit Graph

744 Commits

Author SHA1 Message Date
Aaron Myers
d1207cbd88 HDFS-3442. Incorrect count for Missing Replicas in FSCK report. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345408 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-02 00:39:34 +00:00
Eli Collins
f343419055 HDFS-3487. offlineimageviewer should give byte offset information when it encounters an exception. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344972 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-01 02:37:09 +00:00
Eli Collins
4eb6d65eef HDFS-3486. offlineimageviewer can't read fsimage files that contain persistent delegation tokens. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344970 13f79535-47bb-0310-9956-ffa450edef68
 2012-06-01 02:31:29 +00:00
Eli Collins
675a7e4acb HDFS-3484. hdfs fsck doesn't work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344908 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 21:02:08 +00:00
Uma Maheswara Rao G
c0dcdd67d1 HDFS-3441. Race condition between rolling logs at active NN and purging at standby. Contributed by Rakesh R. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344874 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 19:29:58 +00:00
Uma Maheswara Rao G
fe6dfad79d HDFS-3423. BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes. Contributed by Ivan and Uma. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344840 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 18:09:04 +00:00
Uma Maheswara Rao G
ed7b0622fe HDFS-3468. Make BKJM-ZK session timeout configurable. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344423 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 19:17:35 +00:00
Tsz-wo Sze
83cf475050 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 19:10:09 +00:00
Harsh J
f2c3d3ac52 HDFS-3476. Correct the default used in TestDFSClientRetries.busyTest() after HDFS-3462. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344394 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 18:33:41 +00:00
Uma Maheswara Rao G
7a4c33ae86 HDFS-3474. Cleanup Exception handling in BookKeeper journal manager. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344386 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 18:25:42 +00:00
Uma Maheswara Rao G
47a29c6329 HDFS-3398. Client will not retry when primaryDN is down once it's just got pipeline. Contributed by Amith D K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343944 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 19:37:03 +00:00
Uma Maheswara Rao G
787c08c05a HDFS-3452. BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343913 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 18:50:07 +00:00
Harsh J
5cf21e4383 HDFS-3462. TestDFSClientRetries.busyTest() should restore default xceiver count in the config. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343798 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 16:01:44 +00:00
Harsh J
d2b57e00bc HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343290 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 15:36:00 +00:00
Harsh J
1fab229f30 HADOOP-8268. A few pom.xml across Hadoop project may fail XML validation. Contributed by Radim Kolar. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343272 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 14:51:05 +00:00
Uma Maheswara Rao G
e767845c36 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342534 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 08:56:59 +00:00
Harsh J
befd45fcb1 HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342520 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 07:04:35 +00:00
Konstantin Shvachko
2e0a15c488 HDFS-3368. Missing blocks due to bad DataNodes coming up and down. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342512 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:29:17 +00:00
Eli Collins
22cb0ec82a HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 04:10:15 +00:00
Eli Collins
39661c06f7 Revert HDFS-3058 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342493 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 03:56:12 +00:00
Uma Maheswara Rao G
64ec449010 HDFS-3058. HA: Bring BookKeeperJournalManager up to date with HA changes. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342483 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 01:31:23 +00:00
Todd Lipcon
6c544adeb3 Merge HDFS-3042 (automatic failover) to trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 00:56:20 +00:00
Todd Lipcon
14bf2d4357 HDFS-1013. Miscellaneous improvements to HTML markup for web UIs. Contributed by Eugene Koontz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342102 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 00:27:51 +00:00
Todd Lipcon
74dfa8f1f2 HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342042 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 20:42:48 +00:00
Tsz-wo Sze
ade42bce10 HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341961 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 17:59:30 +00:00
Eli Collins
445018cea8 HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341916 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 15:56:59 +00:00
Tsz-wo Sze
aa80e6895d HDFS-3415. Make sure all layout versions are the same for all storage directories in the Namenode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341676 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-22 23:18:04 +00:00
Tsz-wo Sze
d69510a7f8 HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341141 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 18:51:15 +00:00
Eli Collins
260dfa367e HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 21:13:17 +00:00
Uma Maheswara Rao G
75041b9950 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340750 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 15:14:53 +00:00
Todd Lipcon
1a3bd5d42f Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1340622 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 06:12:14 +00:00
Todd Lipcon
d1a54b872d HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340343 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-19 05:13:38 +00:00
Aaron Myers
ea0baa3609 HDFS-3444. hdfs groups command doesn't work with security enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340260 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 21:25:21 +00:00
Todd Lipcon
7d1f97b821 HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339978 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-18 05:28:18 +00:00
Todd Lipcon
5258d6bf3f HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339897 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 22:30:46 +00:00
Todd Lipcon
15ddb6634f HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339745 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 17:49:48 +00:00
Eli Collins
5ef725eb53 HDFS-3434. InvalidProtocolBufferException when visiting DN browseDirectory.jsp. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339712 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 17:01:13 +00:00
Eli Collins
6d71407582 HDFS-1153. dfsnodelist.jsp should handle invalid input parameters. Contributed by Ravi Phulari 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339706 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 16:55:49 +00:00
Aaron Myers
1377709b4c HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339540 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 10:23:18 +00:00
Todd Lipcon
ba1e4a823a HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339452 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 02:45:47 +00:00
Todd Lipcon
0600e834be HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-17 00:36:13 +00:00
Eli Collins
97e1d5c9ad HDFS-860. fuse-dfs truncate behavior causes issues with scp. Contributed by Brian Bockelman 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339413 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 22:57:18 +00:00
Todd Lipcon
e14e10fb86 Merge trunk into auto-HA branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339410 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 22:47:37 +00:00
Aaron Myers
7286e8a9da HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339250 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-16 16:24:38 +00:00
Eli Collins
dac828de0f HDFS-3197. Incorrect class comments in a few tests. Contributed by Andy Isaacson 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338880 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 20:37:12 +00:00
Eli Collins
7428aeca86 HDFS-3418. Rename BlockWithLocationsProto datanodeIDs field to storageIDs. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338830 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 19:03:14 +00:00
Todd Lipcon
52ecdb751e HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1338817 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 18:16:49 +00:00
Eli Collins
c4e4e56160 HDFS-3419. Cleanup LocatedBlock. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338802 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 17:23:50 +00:00
Eli Collins
e9a7648f62 HDFS-3416. Cleanup DatanodeID and DatanodeRegistration constructors used by testing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338784 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 16:23:52 +00:00
Eli Collins
e4df14f8f1 HDFS-3417. Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338767 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-15 16:01:44 +00:00