Commit Graph

2159 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
7475e836dc MAPREDUCE-3901. Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times. Contributed by Siddarth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294417 13f79535-47bb-0310-9956-ffa450edef68
2012-02-28 00:32:19 +00:00
Tsz-wo Sze
7144c91c53 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294336 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 21:30:05 +00:00
Tsz-wo Sze
dee6ca3d41 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294323 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 21:01:06 +00:00
Jitendra Nath Pandey
da2e4496d8 HADOOP-8113. Correction to BUILDING.txt: HDFS needs ProtocolBuffer, too (not just MapReduce). Contributed by Eugene Koontz.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294293 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 19:29:16 +00:00
Steve Loughran
008cf6a11d MAPREDUCE-3909
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294219 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:53:06 +00:00
Steve Loughran
acf8e6f1b5 trailing whitespace on end of title lines
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294216 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:51:11 +00:00
Thomas Graves
d6170f00b1 MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs (Jason Lowe via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1294207 13f79535-47bb-0310-9956-ffa450edef68
2012-02-27 16:44:05 +00:00
Vinod Kumar Vavilapalli
f071323343 MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293775 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 08:32:30 +00:00
Vinod Kumar Vavilapalli
f3cc891148 MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail. Contributed by John George.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293750 13f79535-47bb-0310-9956-ffa450edef68
2012-02-26 06:49:21 +00:00
Aaron Myers
b57260f848 HDFS-2978. The NameNode should expose name dir statuses via JMX. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293707 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 22:14:53 +00:00
Vinod Kumar Vavilapalli
d83672d71c MAPREDUCE-2793. Reneabling commented out test from previous comment.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293521 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:30:55 +00:00
Vinod Kumar Vavilapalli
7a082ec2bd MAPREDUCE-2793. Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293517 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 02:03:59 +00:00
Arun Murthy
1de3fa8653 Preparing for 0.23.3 release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293506 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 01:37:07 +00:00
Tsz-wo Sze
dacbeb5f67 HDFS-3006. In WebHDFS, when the return body is empty, set the Content-Type to application/octet-stream instead of application/json.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293487 13f79535-47bb-0310-9956-ffa450edef68
2012-02-25 00:15:37 +00:00
Suresh Srinivas
5293e5d1c5 HDFS-3002. TestNameNodeMetrics need not wait for metrics update. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293482 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:52:20 +00:00
Robert Joseph Evans
4e64d7b447 MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293469 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 23:00:17 +00:00
Thomas Graves
582b97c3e7 MAPREDUCE-3904. Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true (Jonathon Eagles via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293456 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 22:30:47 +00:00
Vinod Kumar Vavilapalli
c0572656ce MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293436 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:39:31 +00:00
Vinod Kumar Vavilapalli
969b3809e4 MAPREDUCE-3866. Fixed the bin/yarn script to not print the command line unnecessarily. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293425 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:21:20 +00:00
Eli Collins
78f22bc525 HDFS-3008. Negative caching of local addrs doesn't work. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293419 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 21:14:04 +00:00
Suresh Srinivas
0e79131981 HDFS-3009. Remove duplicate code in DFSClient#isLocalAddress by using NetUtils. Contributed by Hari Mankude.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293390 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 19:29:41 +00:00
Aaron Myers
62c7e2edfc HDFS-3003. Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString(). Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293338 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 17:03:17 +00:00
Jitendra Nath Pandey
584a1ca1f7 HADOOP-8108. Move method getHostPortString() from NameNode to NetUtils. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293128 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 08:16:40 +00:00
Suresh Srinivas
22d5944c42 HADOOP-8085. Add RPC metrics to ProtobufRpcEngine. Contributed by Hari Mankude.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293071 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 04:05:39 +00:00
Siddharth Seth
6112940841 MAPREDUCE 3738. NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly. (Contributed by Jason Lowe)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1293060 13f79535-47bb-0310-9956-ffa450edef68
2012-02-24 02:12:06 +00:00
Thomas Graves
81f5c5933d MAPREDUCE-3878. Null user on filtered jobhistory job page (Jonathon Eagles via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292831 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 15:50:53 +00:00
Amar Kamat
8a2073cc61 MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for faster job submission. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292736 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 10:41:07 +00:00
Tsz-wo Sze
f11b0788df HDFS-2981. In hdfs-default.xml, the default value of dfs.client.block.write.replace-datanode-on-failure.enable should be true.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292626 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 02:27:07 +00:00
Tsz-wo Sze
af70addc94 Move HDFS-2944 entry to 0.23 in CHANGES.txt.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292624 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 02:23:46 +00:00
Todd Lipcon
475db83b87 HDFS-2985. Improve logging when replicas are marked as corrupt. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292609 13f79535-47bb-0310-9956-ffa450edef68
2012-02-23 01:16:33 +00:00
Robert Joseph Evans
b69e4d9173 HADOOP-7660 Maven generated .classpath doesnot includes "target/generated-test-source/java" as source directory. (Laxman via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292483 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 19:58:52 +00:00
Alejandro Abdelnur
267bebeab0 MAPREDUCE-3884. PWD should be first in the classpath of MR tasks (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292424 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:57:32 +00:00
Tsz-wo Sze
efbc58f30c HDFS-2907. Add a conf property dfs.datanode.fsdataset.factory to make FSDataset in Datanode pluggable.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292419 13f79535-47bb-0310-9956-ffa450edef68
2012-02-22 17:47:39 +00:00
Vinod Kumar Vavilapalli
b2172c394e MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291606 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:30:23 +00:00
Devaraj Das
ae7e43139d HADOOP-8084. Updates ProtoBufRpc engine to not do an unnecessary copy for RPC request/response. Contributed by Devaraj Das.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291602 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:19:53 +00:00
Vinod Kumar Vavilapalli
5ee495e6f3 MAPREDUCE-3634. Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291598 13f79535-47bb-0310-9956-ffa450edef68
2012-02-21 05:08:25 +00:00
Matthew Foley
def0ac8060 HADOOP-8050. Deadlock in metrics. Contributed by Kihwal Lee.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1291084 13f79535-47bb-0310-9956-ffa450edef68
2012-02-19 22:45:12 +00:00
Steve Loughran
145338bc44 HADOOP-7680 TestHardLink fails on Mac OS X, when gnu stat is in path.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1290868 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 21:05:06 +00:00
Steve Loughran
2147427bd2 HADOOP-8057 hadoop-setup-conf.sh not working because of some extra spaces.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1290859 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 20:41:35 +00:00
Steve Loughran
a57b9b8335 HDFS-2725 script to mention dfs command
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245943 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 15:25:11 +00:00
Steve Loughran
3d8907fdd6 MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245918 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 13:22:47 +00:00
Steve Loughran
3f8d7dbde3 HADOOP-8046 Revert StaticMapping semantics to the existing ones, add DNS mapping diagnostics in progress
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245911 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 12:57:49 +00:00
Arun Murthy
566f0b5ad2 MAPREDUCE-3880. Changed LCE binary to be 32-bit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245867 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 06:36:00 +00:00
Arun Murthy
e38b7e6ddd Preparing for hadoop-0.23.1-rc2.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245845 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 02:30:48 +00:00
Arun Murthy
3c5eb01263 MAPREDUCE-3856. Committing to 0.23.1.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245840 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 02:18:00 +00:00
Arun Murthy
089714f6dc HADOOP-8054. Committing to 0.23.1.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245837 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 02:05:43 +00:00
Todd Lipcon
9ae4fac8dd HDFS-2968. Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245832 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:18:01 +00:00
Todd Lipcon
a8e7f745cd HDFS-2969. ExtendedBlock.equals is incorrectly implemented. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245830 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:13:09 +00:00
Tsz-wo Sze
b4c8567e1b MAPREDUCE-3583. Change pid to String and stime to BigInteger in order to handle integers larger than Long.MAX_VALUE. Contributed by Zhihong Yu
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245828 13f79535-47bb-0310-9956-ffa450edef68
2012-02-18 01:12:18 +00:00
Robert Joseph Evans
ff33b38734 MAPREDUCE-3862 Nodemanager can appear to hang on shutdown due to lingering DeletionService threads (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1245781 13f79535-47bb-0310-9956-ffa450edef68
2012-02-17 21:57:49 +00:00