big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,395 Commits 2 Branches 2 Tags 264 MiB
16f7fb80d9
Commit Graph

6395 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sanford Ryza
2caa899882 YARN-305. Fair scheduler logs too many "Node offered to app" messages. (Lohit Vijayarenu via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531817 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-14 08:51:34 +00:00
Siddharth Seth
f2745babf3 MAPREDUCE-5329. Allow MR applications to use additional AuxServices, which are compatible with the default MapReduce shuffle. Contributed by Avner BenHanoch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531741 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-13 20:17:53 +00:00
Brandon Li
7cd044b1aa HDFS-5329. Update FSNamesystem#getListing() to handle inode path in startAfter token. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531617 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-13 04:28:49 +00:00
Luke Lu
b83364d1c7 Workaround git eol hell 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531501 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-12 04:55:06 +00:00
Luke Lu
0840906699 Fix typo (HDFS-5276 -> HDFS-5267) in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531500 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-12 04:54:58 +00:00
Chris Nauroth
bbac0cf05e HADOOP-10040. hadoop.cmd in UNIX format and would not run by default on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531491 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-12 03:14:24 +00:00
Andrew Wang
09e9e57a0b HDFS-5348. Fix error message when dfs.datanode.max.locked.memory is improperly configured. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1531460 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 23:13:13 +00:00
Sanford Ryza
5bed5bb829 YARN-1044. used/min/max resources do not display info in the scheduler page (Sangjin Lee via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531447 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 22:13:57 +00:00
Jing Zhao
f7eaacc103 HDFS-5322. HDFS delegation token not found in cache errors seen on secure HA clusters. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531436 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 21:49:01 +00:00
Sanford Ryza
335923be6f Delete fair-scheduler-allocation.xml for YARN-1300 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531425 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 21:25:59 +00:00
Sanford Ryza
156b9f2e88 YARN-1300. SLS tests fail because conf puts YARN properties in fair-scheduler.xml (Ted Yu via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531423 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 21:18:48 +00:00
Chris Nauroth
8111c3af6b HDFS-5224. Refactor PathBasedCache* methods to use a Path rather than a String. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1531406 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 19:44:20 +00:00
Luke Lu
1d07c5cf17 Move HDFS-5276 to 2.3.0 in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531228 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 08:31:34 +00:00
Luke Lu
d0aaa5ba9f HDFS-5276. Remove volatile from LightWeightHashSet. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531225 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 08:29:06 +00:00
Luke Lu
735d8b27f7 YARN-7. Support CPU resource for DistributedShell. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531222 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 08:18:57 +00:00
Jing Zhao
0387ec792f HADOOP-10039. Add Hive to the list of projects using AbstractDelegationTokenSecretManager. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531158 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 01:25:01 +00:00
Suresh Srinivas
f2f5cdb555 HDFS-5335. Hive query failed with possible race in dfs output stream. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531152 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-10 23:58:08 +00:00
Sanford Ryza
f218527fff YARN-1265. Fair Scheduler chokes on unhealthy node reconnect (Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531146 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-10 22:49:56 +00:00
Suresh Srinivas
4f0089621c HADOOP-10029. Specifying har file to MR job fails in secure cluster. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531125 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-10 21:55:38 +00:00
Devarajulu K
22b332ff46 YARN-879. Fixed tests w.r.t o.a.h.y.server.resourcemanager.Application. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530902 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-10 09:47:11 +00:00
Brandon Li
7429debd86 HDFS-5337. should do hsync for a commit request even there is no pending writes. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530835 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-10 00:52:54 +00:00
Chris Nauroth
a75794567b HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows local path. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530823 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 22:57:59 +00:00
Vinod Kumar Vavilapalli
9b9ddf29e2 YARN-1283. Fixed RM to give a fully-qualified proxy URL for an application so that clients don't need to do scheme-mangling. Contributed by Omkar Vinit Joshi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530819 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 22:49:06 +00:00
Jason Darrell Lowe
00395a0064 MAPREDUCE-5102. fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db. Contributed by Aleksey Gorshkov, Andrey Klochkov, and Nathan Roberts 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530816 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 22:39:39 +00:00
Colin McCabe
b8ae4e2a8e HDFS-5323. Remove some deadcode in BlockManager (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530814 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 22:27:27 +00:00
Andrew Wang
3fc8792b5c HDFS-5304. Expose if a block replica is cached in getFileBlockLocations. (Contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530802 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 21:30:08 +00:00
Alejandro Abdelnur
a184fceddc Amending yarn CHANGES.txt moving YARN-1284 to 2.2.1 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530716 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 17:11:37 +00:00
Jason Darrell Lowe
7b7caa1e56 MAPREDUCE-5569. FloatSplitter is not generating correct splits. Contributed by Nathan Roberts 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530683 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 15:43:36 +00:00
Kihwal Lee
f6a2cac321 HDFS-4510. Cover classes ClusterJspHelper/NamenodeJspHelper with unit tests. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530669 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 15:10:33 +00:00
Daryn Sharp
b858b812b7 HADOOP-9470. eliminate duplicate FQN tests in different Hadoop modules (Ivan A. Veselovsky via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530667 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 15:09:37 +00:00
Sanford Ryza
643b1a4019 YARN-1258. Allow configuring the Fair Scheduler root queue (Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530542 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 09:19:14 +00:00
Sanford Ryza
389d846e77 Fix position of YARN-461 in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530505 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 06:49:24 +00:00
Sanford Ryza
00388655e5 YARN-976. Document the meaning of a virtual core. (Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530500 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 05:56:23 +00:00
Sanford Ryza
5a87d89366 Add missing file TestCgroupsLCEResourcesHandler for YARN-1284. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530493 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 05:07:41 +00:00
Sanford Ryza
726c3538a7 YARN-1284. LCE: Race condition leaves dangling cgroups entries for killed containers. (Alejandro Abdelnur via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530492 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 05:05:17 +00:00
Chris Nauroth
b7e885435a HADOOP-10030. FsShell -put/copyFromLocal should support Windows local path. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530462 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 23:41:53 +00:00
Brandon Li
5c02d2f622 HDFS-5281. COMMIT request should not block. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530461 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 23:40:21 +00:00
Andrew Wang
54801ba4f9 Addenum for HDFS-5309, update binary edits again 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530410 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 20:01:48 +00:00
Jonathan Turner Eagles
db8bf2e0a3 HADOOP-9199. Cover package org.apache.hadoop.io with unit tests (Andrey Klochkov via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530404 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 19:36:16 +00:00
Brandon Li
09998741ac HDFS-5316. Namenode ignores the default https port. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530150 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 04:26:01 +00:00
Arun Murthy
418773f44e Moving recent bug-fixes to hadoop-2.2.1. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530128 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 02:03:29 +00:00
Brandon Li
61c1dd96c3 HDFS-5317. Go back to DFS Home link does not work on datanode webUI. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530114 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 00:07:12 +00:00
Jing Zhao
1fe1942328 HDFS-5291. Standby namenode after transition to active goes into safemode. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530112 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 23:58:44 +00:00
Jing Zhao
4e46d2066e HADOOP-10028. Malformed ssl-server.xml.example. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530100 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 22:41:11 +00:00
Jason Darrell Lowe
3de419a478 YARN-465. fix coverage org.apache.hadoop.yarn.server.webproxy. Contributed by Aleksey Gorshkov and Andrey Klochkov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530095 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 22:21:38 +00:00
Colin McCabe
b60e18db74 HDFS-5314. Do not expose CachePool type in AddCachePoolOp (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530073 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 21:26:01 +00:00
Brandon Li
267a606831 HDFS-5307. Support both HTTP and HTTPS in jsp pages. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530027 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 19:02:55 +00:00
Arun Murthy
bac6515f96 Release notes for hadoop-2.2.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529756 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 05:39:20 +00:00
Arun Murthy
b8f1cf3192 HDFS-4817. Moving changelog to Release 2.2.0 section to reflect the backport. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529751 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 05:30:18 +00:00
Arun Murthy
43c7a834dc Preparing for hadoop-2.2.0 release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529750 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 05:17:00 +00:00