big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,168 Commits 2 Branches 2 Tags 264 MiB
f455566982
Commit Graph

3168 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Eli Collins
675a7e4acb HDFS-3484. hdfs fsck doesn't work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344908 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 21:02:08 +00:00
Uma Maheswara Rao G
c0dcdd67d1 HDFS-3441. Race condition between rolling logs at active NN and purging at standby. Contributed by Rakesh R. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344874 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 19:29:58 +00:00
Uma Maheswara Rao G
fe6dfad79d HDFS-3423. BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes. Contributed by Ivan and Uma. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344840 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 18:09:04 +00:00
Robert Joseph Evans
8bbacfaa31 MAPREDUCE-4297. Usersmap file in gridmix should not fail on empty lines (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344763 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 15:16:48 +00:00
Robert Joseph Evans
8d559d2d9a HADOOP-8452. DN logs backtrace when running under jsvc and /jmx is loaded (Andy Isaacson via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344733 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-31 14:10:16 +00:00
Uma Maheswara Rao G
ed7b0622fe HDFS-3468. Make BKJM-ZK session timeout configurable. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344423 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 19:17:35 +00:00
Tsz-wo Sze
83cf475050 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344419 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 19:10:09 +00:00
Harsh J
f2c3d3ac52 HDFS-3476. Correct the default used in TestDFSClientRetries.busyTest() after HDFS-3462. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344394 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 18:33:41 +00:00
Uma Maheswara Rao G
7a4c33ae86 HDFS-3474. Cleanup Exception handling in BookKeeper journal manager. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344386 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 18:25:42 +00:00
Robert Joseph Evans
0a80f82a30 MAPREDUCE-4152. map task left hanging after AM dies trying to connect to RM (Tom Graves via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344283 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-30 14:48:53 +00:00
Uma Maheswara Rao G
47a29c6329 HDFS-3398. Client will not retry when primaryDN is down once it's just got pipeline. Contributed by Amith D K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343944 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 19:37:03 +00:00
Uma Maheswara Rao G
787c08c05a HDFS-3452. BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343913 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 18:50:07 +00:00
Harsh J
515e29ac82 MAPREDUCE-3493. Add the default mapreduce.shuffle.port property to mapred-default.xml. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343804 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 16:10:59 +00:00
Harsh J
5cf21e4383 HDFS-3462. TestDFSClientRetries.busyTest() should restore default xceiver count in the config. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343798 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 16:01:44 +00:00
Thomas White
45be2c085d MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343755 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 14:43:40 +00:00
Harsh J
e576bac2f7 HADOOP-8444. Fix the tests FSMainOperationsBaseTest.java and FileContextMainOperationsBaseTest.java to avoid potential test failure. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343732 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-29 14:12:17 +00:00
Harsh J
d2b57e00bc HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343290 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 15:36:00 +00:00
Harsh J
1fab229f30 HADOOP-8268. A few pom.xml across Hadoop project may fail XML validation. Contributed by Radim Kolar. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343272 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 14:51:05 +00:00
Harsh J
fcf47eb4b8 MAPREDUCE-3990. MRBench allows Long-sized input-lines value but parses CLI argument as an Integer. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343247 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 13:26:35 +00:00
Harsh J
0037bf5dc5 MAPREDUCE-2384. The job submitter should make sure to validate jobs before creation of necessary files. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343240 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-28 13:14:14 +00:00
Harsh J
4709160d75 HADOOP-6871. When the value of a configuration key is set to its unresolved form, it causes an IllegalStateException in Configuration.get() stating that substitution depth is too large. Contributed by Arvind Prabhakar (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342626 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 14:02:01 +00:00
Harsh J
2ebb1f47db MAPREDUCE-3302. Remove the last dependency call from org.apache.hadoop.record package in MR. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342613 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 13:21:30 +00:00
Harsh J
ceaf168dc7 HADOOP-7659. fs -getmerge isn't guaranteed to work well over non-HDFS filesystems (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342600 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 12:46:22 +00:00
Uma Maheswara Rao G
e767845c36 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342534 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 08:56:59 +00:00
Harsh J
befd45fcb1 HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342520 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 07:04:35 +00:00
Harsh J
e62a76a40c HADOOP-8323. Add javadoc and tests for Text.clear() behavior (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342514 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:38:16 +00:00
Konstantin Shvachko
2e0a15c488 HDFS-3368. Missing blocks due to bad DataNodes coming up and down. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342512 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:29:17 +00:00
Harsh J
458be39423 HADOOP-8415. Add getDouble() and setDouble() in org.apache.hadoop.conf.Configuration. Contributed by Jan van der Lugt. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342501 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 06:06:01 +00:00
Eli Collins
22cb0ec82a HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 04:10:15 +00:00
Eli Collins
39661c06f7 Revert HDFS-3058 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342493 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 03:56:12 +00:00
Uma Maheswara Rao G
64ec449010 HDFS-3058. HA: Bring BookKeeperJournalManager up to date with HA changes. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342483 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-25 01:31:23 +00:00
Alejandro Abdelnur
e937068c0b HDFS-3460. HttpFS proxyuser validation with Kerberos ON uses full principal name. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342334 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 16:51:04 +00:00
Thomas Graves
c4f17d242d MAPREDUCE-4224. TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342244 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 13:10:57 +00:00
Todd Lipcon
6c544adeb3 Merge HDFS-3042 (automatic failover) to trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342112 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 00:56:20 +00:00
Todd Lipcon
14bf2d4357 HDFS-1013. Miscellaneous improvements to HTML markup for web UIs. Contributed by Eugene Koontz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342102 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-24 00:27:51 +00:00
Alejandro Abdelnur
cf7b017422 MAPREDUCE-4276. Allow setting yarn.nodemanager.delete.debug-delay-sec property to -1 for easier container debugging. (ahmed via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342075 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 22:22:55 +00:00
Sanjay Radia
266a0f1de9 HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers (Sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342051 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 21:16:39 +00:00
Todd Lipcon
74dfa8f1f2 HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342042 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 20:42:48 +00:00
Thomas Graves
432c4a6ffc MAPREDUCE-4262. NM gives wrong log message saying Connected to ResourceManager before trying to connect. (Devaraj K via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341972 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 18:37:37 +00:00
Tsz-wo Sze
ade42bce10 HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341961 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 17:59:30 +00:00
Eli Collins
445018cea8 HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341916 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-23 15:56:59 +00:00
Tsz-wo Sze
aa80e6895d HDFS-3415. Make sure all layout versions are the same for all storage directories in the Namenode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341676 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-22 23:18:04 +00:00
Aaron Myers
23b96766ad Amend HADOOP-8408 per Daryn's post-commit feedback. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341338 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-22 07:50:00 +00:00
Thomas Graves
d74bec2f88 MAPREDUCE-3870. Invalid App Metrics (Bhallamudi Venkata Siva Kamesh via tgraves). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341160 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 19:15:41 +00:00
Robert Joseph Evans
2eebc21a55 MAPREDUCE-4274 MapOutputBuffer should use native byte order for kvmeta. (todd via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341151 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 19:05:19 +00:00
Tsz-wo Sze
d69510a7f8 HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341141 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 18:51:15 +00:00
Robert Joseph Evans
99a552fd70 HADOOP-8413. test-patch.sh gives out the wrong links for newPatchFindbugsWarnings (Colin Patrick McCabe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341113 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 17:08:58 +00:00
Thomas Graves
d239307d00 MAPREDUCE-4269. documentation: Gridmix has javadoc warnings in StressJobFactory (Jonathon Eagles via tgraves). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340880 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-21 01:55:44 +00:00
Eli Collins
260dfa367e HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 21:13:17 +00:00
Uma Maheswara Rao G
75041b9950 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340750 13f79535-47bb-0310-9956-ffa450edef68
 2012-05-20 15:14:53 +00:00