Commit Graph

1424 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli
fa2529c931 MAPREDUCE-3141. Fix the broken MRAppMaster to work over YARN in security mode.(vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180007 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 11:35:17 +00:00
Vinod Kumar Vavilapalli
a56f3931d1 MAPREDUCE-2783. Fixing RM web-UI to show no tracking-URL when AM crashes. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 09:17:57 +00:00
Mahadev Konar
b8102dbdf8 MAPREDUCE-2794. [MR-279] Incorrect metrics value for AvailableGB per queue per user. (John George via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179936 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 05:27:36 +00:00
Amar Kamat
c1c0e8c9ea MAPREDUCE-3008. Improvements to cumulative CPU emulation for short running tasks in Gridmix. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179933 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 04:59:58 +00:00
Eric Yang
77f79ee92b HADOOP-7724. Fixed hadoop-setup-conf.sh to put proxy user in
core-site.xml.  (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179915 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 01:10:08 +00:00
Alejandro Abdelnur
21cb78d246 HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179912 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 01:01:18 +00:00
Alejandro Abdelnur
9291197de4 HDFS-2294. Download of commons-daemon TAR should not be under target (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179894 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 23:10:31 +00:00
Sanjay Radia
e4db38bdbe HDFS-2181 Separate HDFS Client wire protocol data types (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179877 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:58:22 +00:00
Jitendra Nath Pandey
a90f8fb50f HADOOP-7721. Add a log before login in KerberosAuthenticationHandler.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179869 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:41:11 +00:00
Jitendra Nath Pandey
6f1d18bd47 HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. Incorporates HDFS-2405 as well.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179861 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:30:06 +00:00
Tsz-wo Sze
a2d7287873 HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use the renewer parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179856 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:17:19 +00:00
Aaron Myers
e95dfd8931 HADOOP-7695. RPC.stopProxy can throw unintended exception while logging error (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179512 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 06:08:16 +00:00
Aaron Myers
14569ab482 HADOOP-7717. Move handling of concurrent client fail-overs to RetryInvocationHandler (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179483 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 01:01:19 +00:00
Vinod Kumar Vavilapalli
282e2e910c MAPREDUCE-2913. Fixed TestMRJobs.testFailingMapper to assert the correct TaskCompletionEventStatus. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179319 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 17:07:20 +00:00
Eric Yang
9b6671dc29 HADOOP-7704. Reduce number of object created by JMXJsonServlet.
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179287 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 16:09:27 +00:00
Eric Yang
c90d7d649b HADOOP-7703. Improved excpetion handling of shutting down web server.
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179286 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 16:06:05 +00:00
Vinod Kumar Vavilapalli
9a4e890f4a MAPREDUCE-2738. Added the missing cluster level statisticss on the RM web UI. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179229 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 14:01:32 +00:00
Vinod Kumar Vavilapalli
f29bfa0e0e MAPREDUCE-2702. Added a new API in OutputCommitter for recovering the outputs of tasks from a crashed job so as to support MR Application Master recovery. Contributed by Sharad Agarwal and Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179188 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 12:15:44 +00:00
Vinod Kumar Vavilapalli
f24dcb3449 MAPREDUCE-2907. Changed log level for various messages in ResourceManager from INFO to DEBUG. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179178 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:56:54 +00:00
Vinod Kumar Vavilapalli
66137cf17c MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage as it doesn't affect security any more. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179174 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:43:05 +00:00
Tsz-wo Sze
1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:29:05 +00:00
Amar Kamat
45e6fb00af MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk. (Ravi Gummadi via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179090 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 08:03:49 +00:00
Konstantin Shvachko
ff9d7de705 Move MAPREDUCE-2531 changes to Release 0.22 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179078 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 07:39:35 +00:00
Eric Yang
a3df6dd38f HADOOP-7720. Added parameter for HBase user to setup config script.
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179025 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 00:37:24 +00:00
Eric Yang
4d81e96398 HADOOP-7707. Added toggle for dfs.support.append, webhdfs and hadoop proxy
user to setup config script. (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179001 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 22:52:14 +00:00
Eric Yang
496b4b976c HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config file
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178969 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 21:48:06 +00:00
Eric Yang
cf4fade514 HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config files
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178965 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 21:44:00 +00:00
Eric Yang
b7c2431f28 HADOOP-7710. Added hadoop-setup-application.sh for creating
application directory (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178876 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 17:47:21 +00:00
Eric Yang
c9aed1f1a7 HADOOP-7681. Fixed security and hdfs audit log4j properties
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178863 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 16:48:46 +00:00
Eric Yang
266cb1da57 HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178853 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 16:30:13 +00:00
Vinod Kumar Vavilapalli
e979a3ddb1 MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178740 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 09:37:56 +00:00
Eric Yang
97a60315b1 HADOOP-7685. Improved directory ownership check function in
hadoop-setup-conf.sh. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178671 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:58:32 +00:00
Eric Yang
5c4ed07c76 HADOOP-7715. Removed unnecessary security logger configuration. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178662 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:14:19 +00:00
Eric Yang
a48e6f2519 MAPREDUCE-3112. Fixed recursive sourcing of HADOOP_OPTS environment
variable. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178657 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:51:13 +00:00
Eric Yang
3edf3579c8 HADOOP-7684. Added init.d script for jobhistory server and
secondary namenode. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178653 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:44:08 +00:00
Arun Murthy
4f97e37648 MAPREDUCE-3138. Add a utility to help applications bridge changes in Context Objects APIs due to MAPREDUCE-954. Contributed by omalley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178650 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:42:37 +00:00
Eric Yang
62682a12e5 HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh
(Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178646 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:31:07 +00:00
Eric Yang
abc2b45dfa HADOOP-7603. Set hdfs, mapred uid, and hadoop uid to fixed numbers. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178644 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 00:13:58 +00:00
Sanjay Radia
2d45bfdffd HADOOP-7716 RPC protocol registration on SS does not log the protocol name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178639 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:39:25 +00:00
Eric Yang
de03173761 HADOOP-7691. Fixed conflict uid for install packages. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178638 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:36:19 +00:00
Arun Murthy
12743d2169 MAPREDUCE-2792. Replace usage of node ip-addresses with hostnames. Contributed by Vinod K V.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178631 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 23:21:20 +00:00
Todd Lipcon
93e0265af0 Fix CHANGES.txt to include complete subtask list for HDFS-1073.
Somehow in the merge, some subtasks were lost from CHANGES.txt.
I spot-checked these patches to make sure they were in fact merged,
and it was only CHANGES.txt that was missing them.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178610 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 22:05:42 +00:00
Arun Murthy
43b59b894b MAPREDUCE-3134. Added documentation the CapacityScheduler.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178530 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 19:35:41 +00:00
Vinod Kumar Vavilapalli
4ee39ffe6a HADOOP-7542. Reverting the patch to address issues.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178308 13f79535-47bb-0310-9956-ffa450edef68
2011-10-03 06:45:10 +00:00
Arun Murthy
7aa8a3c9f8 MAPREDUCE-2889. Added documentation for writing new YARN applications. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177920 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 05:22:50 +00:00
Tsz-wo Sze
dc8464f943 HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177905 13f79535-47bb-0310-9956-ffa450edef68
2011-10-01 04:49:00 +00:00
Arun Murthy
f3b98a26c4 MAPREDUCE-3113. Ensure bin/yarn and bin/yarn-daemon.sh identify the root of the install properly. Contributed by Xie Xianshan.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177874 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 23:58:58 +00:00
Arun Murthy
fad230a49d MAPREDUCE-2719. Add a simple, DistributedShell, application to illustrate alternate frameworks on YARN. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177864 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:25:32 +00:00
Arun Murthy
dcf9d475e0 MAPREDUCE-3050. Add ability to get resource usage information for applications and nodes. Contributed by Robert Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177859 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 22:19:17 +00:00
Konstantin Shvachko
960d7643fb MAPREDUCE-2779. JobSplitWriter.java can't handle large job.split file. Contributed by Ming Ma.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177779 13f79535-47bb-0310-9956-ffa450edef68
2011-09-30 19:04:56 +00:00