Commit Graph

3712 Commits

Author SHA1 Message Date
Konstantin Shvachko
a09a2b48cd Move MAPREDUCE-3138 changes to Release 0.22 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180751 13f79535-47bb-0310-9956-ffa450edef68
2011-10-10 00:36:04 +00:00
Todd Lipcon
4cf6bc415f HDFS-2414. Fix TestDFSRollback to avoid spurious failures. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180541 13f79535-47bb-0310-9956-ffa450edef68
2011-10-09 03:59:21 +00:00
Steve Loughran
3ab2e79ad7 HDFS-2209 datanode connection failure logging
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180353 13f79535-47bb-0310-9956-ffa450edef68
2011-10-08 10:41:56 +00:00
Alejandro Abdelnur
4972959173 Reverted MAPREDUCE-3003
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180283 13f79535-47bb-0310-9956-ffa450edef68
2011-10-08 00:38:41 +00:00
Todd Lipcon
0d1fe120c8 HADOOP-7627. Improve MetricsAsserts to give more understandable output on failure. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180259 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 21:54:38 +00:00
Arun Murthy
047b175aac MAPREDUCE-2802. Ensure JobHistory filenames have jobId. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180220 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:44:37 +00:00
Arun Murthy
6b343adfe8 MAPREDUCE-3033. Ensure Master interface pays attention to classic v/s yarn frameworks. Contributed by Hitesh Shah.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180214 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:39:33 +00:00
Todd Lipcon
54e81464a3 HDFS-2412. Add backwards-compatibility layer for renamed FSConstants class. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180202 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 20:28:39 +00:00
Alejandro Abdelnur
68d1162f7a MAPREDUCE-3003. Publish Yarn and MapReduce artifacts to Maven snapshot repository. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180155 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 19:01:01 +00:00
Thomas White
02ce6b3d07 MAPREDUCE-3014. Rename and invert logic of '-cbuild' profile to 'native' and off by default. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180116 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 17:33:10 +00:00
Alejandro Abdelnur
2b157c6b12 HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be fetched. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180094 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 16:34:51 +00:00
Steve Loughran
aace6cb631 HDFS-2209. Make MiniDFS easier to embed in other apps.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180077 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 15:30:32 +00:00
Vinod Kumar Vavilapalli
02a81203bd MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180071 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 15:23:20 +00:00
Steve Loughran
639121c743 HADOOP-7727 fix some typos and tabs in CHANGES.TXT
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180019 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 12:22:48 +00:00
Vinod Kumar Vavilapalli
fa2529c931 MAPREDUCE-3141. Fix the broken MRAppMaster to work over YARN in security mode.(vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1180007 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 11:35:17 +00:00
Vinod Kumar Vavilapalli
a56f3931d1 MAPREDUCE-2783. Fixing RM web-UI to show no tracking-URL when AM crashes. Contributed by Eric Payne.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179975 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 09:17:57 +00:00
Mahadev Konar
b8102dbdf8 MAPREDUCE-2794. [MR-279] Incorrect metrics value for AvailableGB per queue per user. (John George via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179936 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 05:27:36 +00:00
Amar Kamat
c1c0e8c9ea MAPREDUCE-3008. Improvements to cumulative CPU emulation for short running tasks in Gridmix. (amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179933 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 04:59:58 +00:00
Eric Yang
77f79ee92b HADOOP-7724. Fixed hadoop-setup-conf.sh to put proxy user in
core-site.xml.  (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179915 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 01:10:08 +00:00
Alejandro Abdelnur
21cb78d246 HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179912 13f79535-47bb-0310-9956-ffa450edef68
2011-10-07 01:01:18 +00:00
Aaron Myers
8b4f497af8 HDFS-1973. HA: HDFS clients must handle namenode failover and switch over to the new active namenode. (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179896 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 23:26:14 +00:00
Alejandro Abdelnur
9291197de4 HDFS-2294. Download of commons-daemon TAR should not be under target (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179894 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 23:10:31 +00:00
Sanjay Radia
e4db38bdbe HDFS-2181 Separate HDFS Client wire protocol data types (sanjay)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179877 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:58:22 +00:00
Jitendra Nath Pandey
a90f8fb50f HADOOP-7721. Add a log before login in KerberosAuthenticationHandler.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179869 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:41:11 +00:00
Jitendra Nath Pandey
6f1d18bd47 HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. Incorporates HDFS-2405 as well.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179861 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:30:06 +00:00
Tsz-wo Sze
a2d7287873 HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use the renewer parameter.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179856 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 21:17:19 +00:00
Aaron Myers
90727b82e0 HDFS-2407. getServerDefaults and getStats don't check operation category (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179685 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 16:14:50 +00:00
Aaron Myers
e95dfd8931 HADOOP-7695. RPC.stopProxy can throw unintended exception while logging error (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179512 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 06:08:16 +00:00
Aaron Myers
60dcc5f237 Merging trunk to HDFS-1623 branch.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179484 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 01:16:48 +00:00
Aaron Myers
14569ab482 HADOOP-7717. Move handling of concurrent client fail-overs to RetryInvocationHandler (atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179483 13f79535-47bb-0310-9956-ffa450edef68
2011-10-06 01:01:19 +00:00
Vinod Kumar Vavilapalli
282e2e910c MAPREDUCE-2913. Fixed TestMRJobs.testFailingMapper to assert the correct TaskCompletionEventStatus. Contributed by Jonathan Eagles.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179319 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 17:07:20 +00:00
Eric Yang
9b6671dc29 HADOOP-7704. Reduce number of object created by JMXJsonServlet.
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179287 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 16:09:27 +00:00
Eric Yang
c90d7d649b HADOOP-7703. Improved excpetion handling of shutting down web server.
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179286 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 16:06:05 +00:00
Vinod Kumar Vavilapalli
9a4e890f4a MAPREDUCE-2738. Added the missing cluster level statisticss on the RM web UI. Contributed by Robert Joseph Evans.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179229 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 14:01:32 +00:00
Vinod Kumar Vavilapalli
f29bfa0e0e MAPREDUCE-2702. Added a new API in OutputCommitter for recovering the outputs of tasks from a crashed job so as to support MR Application Master recovery. Contributed by Sharad Agarwal and Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179188 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 12:15:44 +00:00
Vinod Kumar Vavilapalli
f24dcb3449 MAPREDUCE-2907. Changed log level for various messages in ResourceManager from INFO to DEBUG. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179178 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:56:54 +00:00
Vinod Kumar Vavilapalli
66137cf17c MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage as it doesn't affect security any more. (vinodkv)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179174 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:43:05 +00:00
Tsz-wo Sze
1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 11:29:05 +00:00
Amar Kamat
45e6fb00af MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk. (Ravi Gummadi via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179090 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 08:03:49 +00:00
Konstantin Shvachko
ff9d7de705 Move MAPREDUCE-2531 changes to Release 0.22 section.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179078 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 07:39:35 +00:00
Eric Yang
a3df6dd38f HADOOP-7720. Added parameter for HBase user to setup config script.
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179025 13f79535-47bb-0310-9956-ffa450edef68
2011-10-05 00:37:24 +00:00
Eric Yang
4d81e96398 HADOOP-7707. Added toggle for dfs.support.append, webhdfs and hadoop proxy
user to setup config script. (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179001 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 22:52:14 +00:00
Eric Yang
496b4b976c HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config file
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178969 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 21:48:06 +00:00
Eric Yang
cf4fade514 HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config files
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178965 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 21:44:00 +00:00
Eric Yang
b7c2431f28 HADOOP-7710. Added hadoop-setup-application.sh for creating
application directory (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178876 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 17:47:21 +00:00
Eric Yang
c9aed1f1a7 HADOOP-7681. Fixed security and hdfs audit log4j properties
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178863 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 16:48:46 +00:00
Eric Yang
266cb1da57 HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment
variables (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178853 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 16:30:13 +00:00
Vinod Kumar Vavilapalli
e979a3ddb1 MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178740 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 09:37:56 +00:00
Eric Yang
97a60315b1 HADOOP-7685. Improved directory ownership check function in
hadoop-setup-conf.sh. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178671 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:58:32 +00:00
Eric Yang
5c4ed07c76 HADOOP-7715. Removed unnecessary security logger configuration. (Eric Yang)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178662 13f79535-47bb-0310-9956-ffa450edef68
2011-10-04 01:14:19 +00:00