big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,284 Commits 2 Branches 2 Tags 264 MiB
60dcc5f237
Commit Graph

1284 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Myers
60dcc5f237 Merging trunk to HDFS-1623 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-1623@1179484 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 01:16:48 +00:00
Aaron Myers
14569ab482 HADOOP-7717. Move handling of concurrent client fail-overs to RetryInvocationHandler (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179483 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-06 01:01:19 +00:00
Vinod Kumar Vavilapalli
282e2e910c MAPREDUCE-2913. Fixed TestMRJobs.testFailingMapper to assert the correct TaskCompletionEventStatus. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179319 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 17:07:20 +00:00
Eric Yang
9b6671dc29 HADOOP-7704. Reduce number of object created by JMXJsonServlet. 
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179287 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 16:09:27 +00:00
Eric Yang
c90d7d649b HADOOP-7703. Improved excpetion handling of shutting down web server. 
(Devaraj K via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179286 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 16:06:05 +00:00
Vinod Kumar Vavilapalli
9a4e890f4a MAPREDUCE-2738. Added the missing cluster level statisticss on the RM web UI. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179229 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 14:01:32 +00:00
Vinod Kumar Vavilapalli
f29bfa0e0e MAPREDUCE-2702. Added a new API in OutputCommitter for recovering the outputs of tasks from a crashed job so as to support MR Application Master recovery. Contributed by Sharad Agarwal and Arun C Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179188 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 12:15:44 +00:00
Vinod Kumar Vavilapalli
f24dcb3449 MAPREDUCE-2907. Changed log level for various messages in ResourceManager from INFO to DEBUG. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179178 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 11:56:54 +00:00
Vinod Kumar Vavilapalli
66137cf17c MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage as it doesn't affect security any more. (vinodkv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179174 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 11:43:05 +00:00
Tsz-wo Sze
1b1016beeb HDFS-2395. Add a root element in the JSON responses of webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179169 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 11:29:05 +00:00
Amar Kamat
45e6fb00af MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk. (Ravi Gummadi via amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179090 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 08:03:49 +00:00
Konstantin Shvachko
ff9d7de705 Move MAPREDUCE-2531 changes to Release 0.22 section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179078 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 07:39:35 +00:00
Eric Yang
a3df6dd38f HADOOP-7720. Added parameter for HBase user to setup config script. 
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179025 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-05 00:37:24 +00:00
Eric Yang
4d81e96398 HADOOP-7707. Added toggle for dfs.support.append, webhdfs and hadoop proxy 
user to setup config script. (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1179001 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 22:52:14 +00:00
Eric Yang
496b4b976c HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config file 
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178969 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 21:48:06 +00:00
Eric Yang
cf4fade514 HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config files 
consistently.  (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178965 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 21:44:00 +00:00
Eric Yang
b7c2431f28 HADOOP-7710. Added hadoop-setup-application.sh for creating 
application directory (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178876 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 17:47:21 +00:00
Eric Yang
c9aed1f1a7 HADOOP-7681. Fixed security and hdfs audit log4j properties 
(Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178863 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 16:48:46 +00:00
Eric Yang
266cb1da57 HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment 
variables (Arpit Gupta via Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178853 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 16:30:13 +00:00
Vinod Kumar Vavilapalli
e979a3ddb1 MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178740 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 09:37:56 +00:00
Eric Yang
97a60315b1 HADOOP-7685. Improved directory ownership check function in 
hadoop-setup-conf.sh. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178671 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 01:58:32 +00:00
Eric Yang
5c4ed07c76 HADOOP-7715. Removed unnecessary security logger configuration. (Eric Yang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178662 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 01:14:19 +00:00
Eric Yang
a48e6f2519 MAPREDUCE-3112. Fixed recursive sourcing of HADOOP_OPTS environment 
variable. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178657 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 00:51:13 +00:00
Eric Yang
3edf3579c8 HADOOP-7684. Added init.d script for jobhistory server and 
secondary namenode. (Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178653 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 00:44:08 +00:00
Arun Murthy
4f97e37648 MAPREDUCE-3138. Add a utility to help applications bridge changes in Context Objects APIs due to MAPREDUCE-954. Contributed by omalley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178650 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 00:42:37 +00:00
Eric Yang
62682a12e5 HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh 
(Eric Yang)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178646 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 00:31:07 +00:00
Eric Yang
abc2b45dfa HADOOP-7603. Set hdfs, mapred uid, and hadoop uid to fixed numbers. (Eric Yang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178644 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-04 00:13:58 +00:00
Sanjay Radia
2d45bfdffd HADOOP-7716 RPC protocol registration on SS does not log the protocol name 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178639 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 23:39:25 +00:00
Eric Yang
de03173761 HADOOP-7691. Fixed conflict uid for install packages. (Eric Yang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178638 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 23:36:19 +00:00
Arun Murthy
12743d2169 MAPREDUCE-2792. Replace usage of node ip-addresses with hostnames. Contributed by Vinod K V. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178631 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 23:21:20 +00:00
Todd Lipcon
93e0265af0 Fix CHANGES.txt to include complete subtask list for HDFS-1073. 
Somehow in the merge, some subtasks were lost from CHANGES.txt.
I spot-checked these patches to make sure they were in fact merged,
and it was only CHANGES.txt that was missing them.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178610 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 22:05:42 +00:00
Arun Murthy
43b59b894b MAPREDUCE-3134. Added documentation the CapacityScheduler. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178530 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 19:35:41 +00:00
Vinod Kumar Vavilapalli
4ee39ffe6a HADOOP-7542. Reverting the patch to address issues. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1178308 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-03 06:45:10 +00:00
Arun Murthy
7aa8a3c9f8 MAPREDUCE-2889. Added documentation for writing new YARN applications. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177920 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-01 05:22:50 +00:00
Tsz-wo Sze
dc8464f943 HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177905 13f79535-47bb-0310-9956-ffa450edef68
 2011-10-01 04:49:00 +00:00
Arun Murthy
f3b98a26c4 MAPREDUCE-3113. Ensure bin/yarn and bin/yarn-daemon.sh identify the root of the install properly. Contributed by Xie Xianshan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177874 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 23:58:58 +00:00
Arun Murthy
fad230a49d MAPREDUCE-2719. Add a simple, DistributedShell, application to illustrate alternate frameworks on YARN. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177864 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 22:25:32 +00:00
Arun Murthy
dcf9d475e0 MAPREDUCE-3050. Add ability to get resource usage information for applications and nodes. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177859 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 22:19:17 +00:00
Konstantin Shvachko
960d7643fb MAPREDUCE-2779. JobSplitWriter.java can't handle large job.split file. Contributed by Ming Ma. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177779 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 19:04:56 +00:00
Doug Cutting
f48280ac56 HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to not include multiple methods of the same name. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177757 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 18:01:27 +00:00
Steve Loughran
32431d25ae HADOOP-7469 backporting to 0.23; moving in CHANGES.TXT 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177672 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 14:14:36 +00:00
Steve Loughran
ebdc7f800a HADOOP-7469 Add a standard handler for socket connection problems 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177645 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 13:22:05 +00:00
Vinod Kumar Vavilapalli
063e33a862 MAPREDUCE-3098. Fixed RM and MR AM to report YarnApplicationState and application's FinalStatus separately. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177633 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 12:46:32 +00:00
Arun Murthy
964d4a1666 MAPREDUCE-2996. Add uber-ness information to JobHistory. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177531 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 06:47:53 +00:00
Arun Murthy
0b3c654d83 MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177487 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 03:08:35 +00:00
Jitendra Nath Pandey
1ae5b5e338 HDFS-2158. Add JournalSet to manage the set of journals. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177473 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-30 01:14:37 +00:00
Doug Cutting
7d1897d78d HADOOP-7693. Moving to 0.24 section for now. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177408 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 19:39:31 +00:00
Doug Cutting
47c8528bfa HADOOP-7693. Enhance AvroRpcEngine to support the new #addProtocol introduced in HADOOP-724. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177399 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 19:03:10 +00:00
Vinod Kumar Vavilapalli
71886657f8 MAPREDUCE-3001. Added task-specific counters to AppMaster and JobHistory web-UIs. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177203 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 08:08:49 +00:00
Vinod Kumar Vavilapalli
44090734c9 MAPREDUCE-3114. Fixed invalid ApplicationURL on RM WebUI. Contributed by Subroto Sanyal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1177187 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-29 07:28:29 +00:00