Commit Graph

1293 Commits

Author SHA1 Message Date
Todd Lipcon
b4992f671d HADOOP-7774. HA: Administrative CLI to control HA daemons. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190584 13f79535-47bb-0310-9956-ffa450edef68
2011-10-28 21:24:04 +00:00
Aaron Myers
efb2d93f77 HDFS-2393. Mark appropriate methods of ClientProtocol with the idempotent annotation. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190088 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:26:44 +00:00
Aaron Myers
180646dea3 HDFS-2418. Change ConfiguredFailoverProxyProvider to take advantage of HDFS-2231. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190078 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 23:15:07 +00:00
Todd Lipcon
ebb6cc60c4 HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1190059 13f79535-47bb-0310-9956-ffa450edef68
2011-10-27 22:10:58 +00:00
Jitendra Nath Pandey
ab7e7dfd7e Merged r1185354 from trunk for HDFS-2188.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1185363 13f79535-47bb-0310-9956-ffa450edef68
2011-10-17 20:42:32 +00:00
Suresh Srinivas
7ca7832158 HDFS-2231. Configuration changes for HA namenode. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1182626 13f79535-47bb-0310-9956-ffa450edef68
2011-10-13 00:09:55 +00:00
Suresh Srinivas
f00198b16c HDFS-2301. Start/stop appropriate namenode services when transition to active and standby states. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1182080 13f79535-47bb-0310-9956-ffa450edef68
2011-10-11 20:44:34 +00:00
Aaron Myers
8b4f497af8 HDFS-1973. HA: HDFS clients must handle namenode failover and switch over to the new active namenode. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179896 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 23:26:14 +00:00
Aaron Myers
90727b82e0 HDFS-2407. getServerDefaults and getStats don't check operation category (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179685 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 16:14:50 +00:00
Aaron Myers
60dcc5f237 Merging trunk to HDFS-1623 branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179484 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 01:16:48 +00:00
Aaron Myers
14569ab482 HADOOP-7717. Move handling of concurrent client fail-overs to RetryInvocationHandler (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179483 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 01:01:19 +00:00
Vinod Kumar Vavilapalli
282e2e910c MAPREDUCE-2913. Fixed TestMRJobs.testFailingMapper to assert the correct TaskCompletionEventStatus. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179319 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 17:07:20 +00:00
Eric Yang
9b6671dc29 HADOOP-7704. Reduce number of object created by JMXJsonServlet.
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179287 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 16:09:27 +00:00
Eric Yang
c90d7d649b HADOOP-7703. Improved excpetion handling of shutting down web server.
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179286 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 16:06:05 +00:00
Vinod Kumar Vavilapalli
9a4e890f4a MAPREDUCE-2738. Added the missing cluster level statisticss on the RM web UI. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179229 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 14:01:32 +00:00
Vinod Kumar Vavilapalli
f29bfa0e0e MAPREDUCE-2702. Added a new API in OutputCommitter for recovering the outputs of tasks from a crashed job so as to support MR Application Master recovery. Contributed by Sharad Agarwal and Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179188 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 12:15:44 +00:00
Vinod Kumar Vavilapalli
f24dcb3449 MAPREDUCE-2907. Changed log level for various messages in ResourceManager from INFO to DEBUG. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179178 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:56:54 +00:00
Vinod Kumar Vavilapalli
66137cf17c MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage as it doesn't affect security any more. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179174 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:43:05 +00:00
Tsz-wo Sze
1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:29:05 +00:00
Amar Kamat
45e6fb00af MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk. (Ravi Gummadi via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179090 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 08:03:49 +00:00
Konstantin Shvachko
ff9d7de705 Move MAPREDUCE-2531 changes to Release 0.22 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179078 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 07:39:35 +00:00
Eric Yang
a3df6dd38f HADOOP-7720. Added parameter for HBase user to setup config script.
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179025 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 00:37:24 +00:00
Eric Yang
4d81e96398 HADOOP-7707. Added toggle for dfs.support.append, webhdfs and hadoop proxy
user to setup config script. (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179001 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 22:52:14 +00:00
Eric Yang
496b4b976c HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config file
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178969 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 21:48:06 +00:00
Eric Yang
cf4fade514 HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config files
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178965 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 21:44:00 +00:00
Eric Yang
b7c2431f28 HADOOP-7710. Added hadoop-setup-application.sh for creating
application directory (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178876 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 17:47:21 +00:00
Eric Yang
c9aed1f1a7 HADOOP-7681. Fixed security and hdfs audit log4j properties
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178863 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 16:48:46 +00:00
Eric Yang
266cb1da57 HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178853 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 16:30:13 +00:00
Vinod Kumar Vavilapalli
e979a3ddb1 MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178740 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 09:37:56 +00:00
Eric Yang
97a60315b1 HADOOP-7685. Improved directory ownership check function in
hadoop-setup-conf.sh. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178671 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:58:32 +00:00
Eric Yang
5c4ed07c76 HADOOP-7715. Removed unnecessary security logger configuration. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178662 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:14:19 +00:00
Eric Yang
a48e6f2519 MAPREDUCE-3112. Fixed recursive sourcing of HADOOP_OPTS environment
variable. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178657 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:51:13 +00:00
Eric Yang
3edf3579c8 HADOOP-7684. Added init.d script for jobhistory server and
secondary namenode. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178653 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:44:08 +00:00
Arun Murthy
4f97e37648 MAPREDUCE-3138. Add a utility to help applications bridge changes in Context Objects APIs due to MAPREDUCE-954. Contributed by omalley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178650 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:42:37 +00:00
Eric Yang
62682a12e5 HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
(Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178646 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:31:07 +00:00
Eric Yang
abc2b45dfa HADOOP-7603. Set hdfs, mapred uid, and hadoop uid to fixed numbers. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178644 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:13:58 +00:00
Sanjay Radia
2d45bfdffd HADOOP-7716 RPC protocol registration on SS does not log the protocol name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178639 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:39:25 +00:00
Eric Yang
de03173761 HADOOP-7691. Fixed conflict uid for install packages. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178638 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:36:19 +00:00
Arun Murthy
12743d2169 MAPREDUCE-2792. Replace usage of node ip-addresses with hostnames. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178631 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:21:20 +00:00
Todd Lipcon
93e0265af0 Fix CHANGES.txt to include complete subtask list for HDFS-1073.
Somehow in the merge, some subtasks were lost from CHANGES.txt.
I spot-checked these patches to make sure they were in fact merged,
and it was only CHANGES.txt that was missing them.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178610 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 22:05:42 +00:00
Arun Murthy
43b59b894b MAPREDUCE-3134. Added documentation the CapacityScheduler.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178530 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 19:35:41 +00:00
Vinod Kumar Vavilapalli
4ee39ffe6a HADOOP-7542. Reverting the patch to address issues.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178308 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 06:45:10 +00:00
Arun Murthy
7aa8a3c9f8 MAPREDUCE-2889. Added documentation for writing new YARN applications. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177920 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 05:22:50 +00:00
Tsz-wo Sze
dc8464f943 HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177905 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 04:49:00 +00:00
Arun Murthy
f3b98a26c4 MAPREDUCE-3113. Ensure bin/yarn and bin/yarn-daemon.sh identify the root of the install properly. Contributed by Xie Xianshan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177874 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 23:58:58 +00:00
Arun Murthy
fad230a49d MAPREDUCE-2719. Add a simple, DistributedShell, application to illustrate alternate frameworks on YARN. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177864 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:25:32 +00:00
Arun Murthy
dcf9d475e0 MAPREDUCE-3050. Add ability to get resource usage information for applications and nodes. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177859 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:19:17 +00:00
Konstantin Shvachko
960d7643fb MAPREDUCE-2779. JobSplitWriter.java can't handle large job.split file. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177779 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 19:04:56 +00:00
Doug Cutting
f48280ac56 HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to not include multiple methods of the same name.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177757 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 18:01:27 +00:00
Steve Loughran
32431d25ae HADOOP-7469 backporting to 0.23; moving in CHANGES.TXT
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177672 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 14:14:36 +00:00