big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,999 Commits 2 Branches 2 Tags 264 MiB
b066be8115
Commit Graph

7999 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sanford Ryza
1a2f75c903 YARN-2036. Document yarn.resourcemanager.hostname in ClusterSetup (Ray Chiang via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593631 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 22:18:43 +00:00
Haohui Mai
ed6f32c540 HDFS-6240. WebImageViewer returns 404 if LISTSTATUS to an empty directory. Contributed by Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593591 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 18:43:46 +00:00
Zhijie Shen
0c437e90b8 YARN-1701. Improved default paths of the timeline store and the generic history store. Contributed by Tsuyoshi Ozawa. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593481 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 04:23:27 +00:00
Kihwal Lee
5323d5e388 HDFS-6313. WebHdfs may use the wrong NN when configured for multiple HA NNs. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593475 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 02:01:37 +00:00
Kihwal Lee
87215cb9f6 Fix CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593473 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 01:52:35 +00:00
Kihwal Lee
eac832f92d HDFS-6329. WebHdfs does not work if HA is enabled on NN but logical URI is not configured. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593470 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 01:46:42 +00:00
Arpit Agarwal
63fadf0abd HDFS-6340.DN can't finalize upgrade. (Contributed by Rahul Singhal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593436 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 22:20:37 +00:00
Jason Darrell Lowe
e2c18809d3 MAPREDUCE-5884. History server uses short user name when canceling tokens. Contributed by Mohammad Kamrul Islam 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593422 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 21:22:26 +00:00
Kihwal Lee
47f03bc9fe HADOOP-10158. SPNEGO should work with multiple interfaces/SPNs. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593362 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 18:26:58 +00:00
Kihwal Lee
584e384fd6 Correcting the check-in mistake for HADOOP-10581. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593360 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 18:22:42 +00:00
Kihwal Lee
624f8b0832 HADOOP-10581. TestUserGroupInformation#testGetServerSideGroups fails. Contributed by Mit Desai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593357 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 18:03:20 +00:00
Colin McCabe
280c764f54 HDFS-5381. ExtendedBlock#hashCode should use both blockId and block pool ID (Benoy Antony via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593346 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 17:49:52 +00:00
Sanford Ryza
1c5902fba2 YARN-1864. Add missing file FSQueueType.java 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593191 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 07:22:42 +00:00
Sanford Ryza
cfc97a4e88 YARN-1864. Fair Scheduler Dynamic Hierarchical User Queues (Ashwin Shankar via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593190 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 07:21:11 +00:00
Arpit Agarwal
1ff694081f HADOOP-10467. Enable proxyuser specification to support list of users in addition to list of groups. (Contributed bt Benoy Antony) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593162 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-08 00:45:32 +00:00
Alejandro Abdelnur
838aeee2e5 HADOOP-10556. [FIXING JIRA NUMBER TYPO] Add toLowerCase support to auth_to_local rules for service name. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593107 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-07 18:24:12 +00:00
Alejandro Abdelnur
dca7350a36 HADOOP-10566. Add toLowerCase support to auth_to_local rules for service name. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593105 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-07 18:20:11 +00:00
Haohui Mai
2d5362073c HADOOP-10471. Reduce the visibility of constants in ProxyUsers. Contributed by Benoy Antony. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592915 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 22:38:02 +00:00
Chris Nauroth
a6d19c51a1 HADOOP-10517. InputStream is not closed in two methods of JarFinder. Contributed by Ted Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592855 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 19:49:38 +00:00
Chris Nauroth
0ba580e9e3 HADOOP-10541. InputStream in MiniKdc#initKDCServer for minikdc.ldiff is not closed. Contributed by Swarnim Kulkarni. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592803 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 16:50:28 +00:00
Jonathan Turner Eagles
7fe28fc8f9 MAPREDUCE-5636. Convert MapReduce Tutorial document to APT (Akira AJISAKA via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592795 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 16:17:16 +00:00
Jonathan Turner Eagles
bd54137afa MAPREDUCE-5637. Convert Hadoop Streaming document to APT (Akira AJISAKA via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592789 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 16:01:21 +00:00
Arpit Agarwal
f4b687b873 YARN-2018. TestClientRMService.testTokenRenewalWrongUser fails after HADOOP-10562. (Contributed by Ming Ma) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592783 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 15:45:49 +00:00
Tsz-wo Sze
03db13206f MAPREDUCE-5402. In DynamicInputFormat, change MAX_CHUNKS_TOLERABLE, MAX_CHUNKS_IDEAL, MIN_RECORDS_PER_CHUNK and SPLIT_RATIO to be configurable. Contributed by Tsuyoshi OZAWA 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592703 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-06 10:24:10 +00:00
Alejandro Abdelnur
17d4fbbf0a HADOOP-10433. Key Management Server based on KeyProvider API. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592637 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-05 21:43:14 +00:00
Uma Maheswara Rao G
8b0acf4b1f HDFS-6337. Setfacl testcase is failing due to dash character in username in TestAclCLI. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592489 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-05 11:53:33 +00:00
Andrew Wang
9445859930 HDFS-6295. Add decommissioning state and node state filtering to dfsadmin. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592438 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-05 03:38:29 +00:00
Junping Du
2ad1cee5da YARN-1201. TestAMAuthorization fails with local hostname cannot be resolved. (Wangda Tan via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592197 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-03 13:03:27 +00:00
Tsz-wo Sze
b2f65c276d HDFS-5168. Add cross node dependency support to BlockPlacementPolicy. Contributed by Nikola Vujic 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592179 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-03 11:02:44 +00:00
Aaron Myers
1ac2ce067c HADOOP-10568. Add s3 server-side encryption. Contributed by David S. Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592133 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-03 00:25:09 +00:00
Haohui Mai
d777cb8996 HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592069 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-02 22:26:02 +00:00
Chris Nauroth
73db6bdb9b HADOOP-10549. MAX_SUBST and varPat should be final in Configuration.java. Contributed by Gera Shegalov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592011 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-02 19:08:38 +00:00
Arpit Agarwal
bee448cacd HADOOP-10562. Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager. (Contributed by Suresh Srinivas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592002 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-02 18:38:30 +00:00
Arpit Agarwal
13bba8ceac HADOOP-10562. Undo previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591785 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-01 21:20:48 +00:00
Arpit Agarwal
94381e82ab HADOOP-10562. Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager. (Contributed by Suresh Srinivas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591782 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-01 21:14:51 +00:00
Haohui Mai
6420249d47 HDFS-6252. Phase out the old web UI in HDFS. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591732 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-01 18:46:18 +00:00
Vinod Kumar Vavilapalli
ef498235ad YARN-1696. Added documentation for ResourceManager fail-over. Contributed by Karthik Kambatla, Masatake Iwasaki, Tsuyoshi OZAWA. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591416 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-30 18:00:32 +00:00
Aaron Myers
e5d6fba47d HDFS-6289. HA failover can fail if there are pending DN messages for DNs which no longer exist. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591413 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-30 17:46:15 +00:00
Haohui Mai
0689363343 HDFS-6304. Consolidate the logic of path resolution in FSDirectory. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591411 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-30 17:44:17 +00:00
Aaron Myers
74921bd7bb HADOOP-10543. RemoteException's unwrapRemoteException method failed for PathIOException. Contributed by Yongjun Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591181 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-30 03:22:20 +00:00
Jonathan Turner Eagles
0532b8bad1 HDFS-6269. NameNode Audit Log should differentiate between webHDFS open and HDFS open. (Eric Payne via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591117 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 21:51:14 +00:00
Jonathan Turner Eagles
693025a3d4 MAPREDUCE-5638. Port Hadoop Archives document to trunk (Akira AJISAKA via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591107 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 21:23:50 +00:00
Arpit Agarwal
19176f423a HADOOP-10547. Fix CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591098 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 20:42:08 +00:00
Arpit Agarwal
871d81060d HADOOP-10547. Give SaslPropertiesResolver.getDefaultProperties() public scope. (Contributed by Benoy Antony) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591095 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 20:38:36 +00:00
Vinod Kumar Vavilapalli
7a241aee90 YARN-1929. Fixed a deadlock in ResourceManager that occurs when failover happens right at the time of shutdown. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591071 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 19:49:44 +00:00
Jason Darrell Lowe
a9775b4e49 YARN-738. TestClientRMTokens is failing irregularly while running all yarn tests. Contributed by Ming Ma 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591030 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 17:47:11 +00:00
Vinayakumar B
9d21180c1a HDFS-2882. DN continues to start up, even if block pool fails to initialize (Contributed by Vinayakumar B) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590941 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 10:27:29 +00:00
Haohui Mai
02d28907be HADOOP-10508. RefreshCallQueue fails when authorization is enabled. Contributed by Chris Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590876 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-29 06:04:14 +00:00
Andrew Wang
71aa608b84 HDFS-6288. DFSInputStream Pread doesn't update ReadStatistics. Contributed by Juan Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590776 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-28 20:20:10 +00:00
Jason Darrell Lowe
bb7ce82816 MAPREDUCE-5812. Make job context available to OutputCommitter.isRecoverySupported(). Contributed by Mohammad Kamrul Islam 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1590668 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-28 15:18:02 +00:00