Commit Graph

2677 Commits

Author SHA1 Message Date
Mahadev Konar
443d8f6c0b MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1 second. (Vinod KV via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238146 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 04:53:49 +00:00
Vinod Kumar Vavilapalli
76b653a367 MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238136 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:23:38 +00:00
Eli Collins
6be13332db HDFS-2853. HA: NN fails to start if the shared edits dir is marked required. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238134 13f79535-47bb-0310-9956-ffa450edef68
2012-01-31 02:17:53 +00:00
Todd Lipcon
641f79a325 HDFS-2824. Fix failover when prior NN died just after creating an edit log segment. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238069 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 23:05:18 +00:00
Eli Collins
6884348444 HADOOP-7938. HA: the FailoverController should optionally fence the active during failover. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238058 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 22:42:46 +00:00
Eli Collins
5c156519df HADOOP-7983. HA: failover should be able to pass args to fencers. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1238049 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 22:27:42 +00:00
Aaron Myers
9a8f119741 Amend HDFS-2841 to include new file which was omitted from original commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237971 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 20:32:35 +00:00
Todd Lipcon
846f97312c HDFS-2691. Fixes for pipeline recovery in an HA cluster: report RBW replicas immediately upon pipeline creation. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237935 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 19:16:15 +00:00
Mahadev Konar
7e4725db41 MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237920 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:47:55 +00:00
Mahadev Konar
e6ca182a26 HADOOP-7999. "hadoop archive" fails with ClassNotFoundException. (Jason Lowe via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237915 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 18:33:11 +00:00
Tsz-wo Sze
be2c6415d1 Delete svn:mergeinfo from .gitignore and test java source files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237549 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 07:14:37 +00:00
Amar Kamat
5652e71992 MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237543 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 06:20:53 +00:00
Aaron Myers
6122357da5 HDFS-2841. HAAdmin does not work if security is enabled. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237534 13f79535-47bb-0310-9956-ffa450edef68
2012-01-30 02:52:27 +00:00
Jitendra Nath Pandey
98302971c2 HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237192 13f79535-47bb-0310-9956-ffa450edef68
2012-01-29 02:01:24 +00:00
Aaron Myers
30dd704e6c Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1237157 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 20:33:30 +00:00
Aaron Myers
976c07696d HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1237153 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 20:26:13 +00:00
Mahadev Konar
934047630a HADOOP-8002. SecurityUtil acquired token message should be a debug rather than info. (Arpit Gupta via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236976 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 04:05:19 +00:00
Todd Lipcon
327c216c2f Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236965 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:50:23 +00:00
Jitendra Nath Pandey
ed6a73140e HADOOP-7988. Upper case in hostname part of the principals doesn't work with kerberos.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236960 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 02:24:08 +00:00
Vinod Kumar Vavilapalli
5262b7ba4d MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236953 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 01:32:29 +00:00
Todd Lipcon
da91e0d427 HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236945 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:42:34 +00:00
Alejandro Abdelnur
0d5b734681 HDFS-2840. TestHostnameFilter should work with localhost or localhost.localdomain (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236940 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:24:46 +00:00
Aaron Myers
2b2e56056e Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236936 13f79535-47bb-0310-9956-ffa450edef68
2012-01-28 00:21:07 +00:00
Alejandro Abdelnur
8a234f394e HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236929 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:53:35 +00:00
Mahadev Konar
5d15e5640e HADOOP-8000. fetchdt command not available in bin/hadoop. (Arpit Gupta via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236921 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 23:15:57 +00:00
Robert Joseph Evans
cc8a2a29f1 HADOOP-7998 CheckFileSystem does not correctly honor setVerifyChecksum (Daryn Sharp via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236911 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 22:42:47 +00:00
Vinod Kumar Vavilapalli
fe4bff77e1 MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for HADOOP-7965. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236901 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 21:49:15 +00:00
Mahadev Konar
fdb9d51cec MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236816 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 18:46:56 +00:00
Arun Murthy
f57de0d6dd MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml. Contributed by Roman Shapshonik.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236594 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:49:18 +00:00
Arun Murthy
0cb3dd913b MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific information not available at RM. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236588 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 08:44:19 +00:00
Mahadev Konar
c8bb6f59b8 HADOOP-7993. Hadoop ignores old-style config options for enabling compressed output. (Anupam Seth via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236506 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 03:42:36 +00:00
Jitendra Nath Pandey
e7775e0b3b HDFS-2805. Add a test for a federated cluster with HA NNs. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236471 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 00:34:37 +00:00
Eli Collins
c5caed914d HADOOP-7997. SequenceFile.createWriter(...createParent...) no longer works on existing file. Contributed by Gregory Chanan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236456 13f79535-47bb-0310-9956-ffa450edef68
2012-01-27 00:09:10 +00:00
Eli Collins
fdf7b18247 HDFS-2838. NPE in FSNamesystem when in safe mode. Contributed by Gregory Chanan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236450 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 23:48:08 +00:00
Jitendra Nath Pandey
12289efa2b HADOOP-7965. Support for protocol version and signature in PB.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236444 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 23:23:03 +00:00
Vinod Kumar Vavilapalli
3cdc100369 MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236433 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 22:56:53 +00:00
Vinod Kumar Vavilapalli
54f738575c MAPREDUCE-3699. Increased RPC handlers for all YARN servers to reasonable values for working at scale. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236396 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 21:37:28 +00:00
Mahadev Konar
af6448e543 MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236371 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 20:10:50 +00:00
Siddharth Seth
5283398187 MAPREDUCE-3718. Amending incorrect JIRA number in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236358 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:31:00 +00:00
Siddharth Seth
2bd728b366 MAPREDUCE-3712. Change default AM heartbeat interval to 1 second. (Contributed by Hitesh Shah)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236356 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 19:28:45 +00:00
Alejandro Abdelnur
cf16929584 HDFS-2837. mvn javadoc:javadoc not seeing LimitedPrivate class (revans2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236338 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:15:04 +00:00
Mahadev Konar
faa6806df3 MAPREDUCE-3735. Add distcp jar to the distribution (tar). (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236336 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:10:11 +00:00
Aaron Myers
1c95060a72 Merge trunk into HA branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1236333 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 18:03:46 +00:00
Alejandro Abdelnur
a7091893de HDFS-2836. HttpFSServer still has 2 javadoc warnings in trunk (revans2 via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236328 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 17:58:42 +00:00
Harsh J
563b09c004 merge HADOOP-4515 HADOOP-6490 HADOOP-7574 HADOOP-7736 HADOOP-7919 to 0.23 from trunk and update CHANGES.txt file accordingly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236125 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 10:06:46 +00:00
Mahadev Konar
34a6a9f4bc MAPREDUCE-3733. Add Apache License Header to hadoop-distcp/pom.xml. (mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236066 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 08:30:17 +00:00
Mahadev Konar
d5bcc58828 MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev) - wrong version in poms
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236048 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 06:46:25 +00:00
Mahadev Konar
d06948002f MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236045 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 06:36:52 +00:00
Arun Murthy
fae75c2d7f MAPREDUCE-3721. Fixed a race in shuffle which caused reduces to hang. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1236041 13f79535-47bb-0310-9956-ffa450edef68
2012-01-26 05:40:29 +00:00
Vinod Kumar Vavilapalli
21c9116309 MAPREDUCE-3713. Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1235989 13f79535-47bb-0310-9956-ffa450edef68
2012-01-25 23:31:14 +00:00