big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,528 Commits 2 Branches 2 Tags 264 MiB
fc77ed153e
Commit Graph

6528 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin McCabe
9a361c5821 HDFS-5191. Revisit zero-copy API in FSDataInputStream to make it more intuitive (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1526020 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 21:40:53 +00:00
Vinod Kumar Vavilapalli
78e995a37d YARN-1204. Added separate configuration properties for https for RM and NM without which servers enabled with https will also start on http ports. Contributed by Omkar Vinit Joshi. 
MAPREDUCE-5523. Added separate configuration properties for https for JHS without which even when https is enabled, it starts on http port itself. Contributed by Omkar Vinit Joshi.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525947 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 17:20:18 +00:00
Tsz-wo Sze
5827d1667c HDFS-5228. The RemoteIterator returned by DistributedFileSystem.listFiles may throw NullPointerException. Contributed by szetszwo and cnauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525828 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 10:16:14 +00:00
Suresh Srinivas
b838ac89a6 HDFS-5251. Race between the initialization of NameNode and the http server. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525787 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 05:31:02 +00:00
Brandon Li
e3088e4aef HDFS-5249. Fix dumper thread which may die silently. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525770 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 04:11:15 +00:00
Arpit Agarwal
114aa229de Merging r1525409 through r1525758 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525759 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 00:57:43 +00:00
Jing Zhao
28e3d09230 HDFS-4971. Move IO operations out of locking in OpenFileCtx. Contributed by Jing Zhao and Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525681 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 20:02:38 +00:00
Robert Joseph Evans
743d8ae055 MAPREDUCE-5522. Incorrect oreder expected from JobQueueInfo (Jinghui Wang via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525670 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 18:33:12 +00:00
Arpit Agarwal
be565473da HDFS-5139. Remove redundant -R option from setrep (update CHANGES.txt). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525665 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 18:18:41 +00:00
Arpit Agarwal
eef16dadaf HDFS-5139. Remove redundant -R option from setrep. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525659 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 17:57:23 +00:00
Chris Nauroth
0bdeb7d143 HADOOP-9977. Hadoop services won't start with different keypass and keystorepass when https is enabled. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525657 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 17:48:38 +00:00
Daryn Sharp
7094738d84 HDFS-5240. Separate formatting from logging in the audit logger API (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525626 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 15:33:11 +00:00
Daryn Sharp
3dfadca6f5 HDFS-5239. Allow FSNamesystem lock fairness to be configurable (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525624 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 15:27:08 +00:00
Sanford Ryza
3175cf17c7 Fix credit for YARN-1188 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525518 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 07:11:01 +00:00
Sanford Ryza
6d030abe8c YARN-1188. The context of QueueMetrics becomes default when using FairScheduler (Akira Ajisaka via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525516 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 07:06:05 +00:00
Arpit Agarwal
5133d78c1a Merging r1524587 through r1525408 from trunk to branch HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525410 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-22 18:23:22 +00:00
Arpit Agarwal
4551da302d HDFS-5233. Use Datanode UUID to identify Datanodes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525407 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-22 18:03:02 +00:00
Sanford Ryza
9f6cf60ae0 YARN-1128. FifoPolicy.computeShares throws NPE on empty list of Schedulables (Karthik Kambatla via Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525313 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-22 01:46:58 +00:00
Andrew Wang
552e081a07 Delete a file for HDFS-5236. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1525184 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-21 00:22:02 +00:00
Andrew Wang
a0d9a155a4 HDFS-5236. Change PathBasedCacheDirective APIs to be a single value rather than batch. (Contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1525183 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-21 00:20:36 +00:00
Arpit Agarwal
eb9f1b6707 HDFS-5232. Protocol changes to transmit StorageUuid. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525153 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-20 22:06:09 +00:00
Jing Zhao
ab22245dc8 HDFS-5231. Fix broken links in the document of HDFS Federation. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525133 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-20 20:34:55 +00:00
Brandon Li
d8d3d3eaed HDFS-5234 Move RpcFrameDecoder out of the public API. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525104 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-20 19:03:51 +00:00
Andrew Wang
aae86e4f3f merge changes from trunk to HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1524865 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 23:42:10 +00:00
Vinod Kumar Vavilapalli
13420d01f2 YARN-1203. Changed YARN web-app proxy to handle http and https URLs from AM registration and finish correctly. Contributed by Omkar Vinit Joshi. 
MAPREDUCE-5515. Fixed MR AM's webapp to depend on a new config mapreduce.ssl.enabled to enable https and disabling it by default as MR AM needs
to set up its own certificates etc and not depend on clusters'. Contributed by Omkar Vinit Joshi.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524864 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 23:35:58 +00:00
Vinod Kumar Vavilapalli
af78fd729c MAPREDUCE-5488. Changed MR client to keep trying to reach the application when it sees that on attempt's AM is down. Contributed by Jian He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524856 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 22:35:12 +00:00
Thomas Graves
6b1f5073a7 MAPREDUCE-5504. mapred queue -info inconsistent with types (Kousuke Saruta via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524841 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 20:58:18 +00:00
Hitesh Shah
8628c1704b YARN-353. Add Zookeeper-based store implementation for RMStateStore. Contributed by Bikas Saha, Jian He and Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524829 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 20:39:10 +00:00
Steve Loughran
8de47fc570 HADOOP-9974: document setting mvn heap size - trailing space 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524651 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 08:21:06 +00:00
Steve Loughran
3a87e8fec0 HADOOP-9974: document setting mvn heap size 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524650 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 08:19:27 +00:00
Ivan Mitic
3720956a6a HADOOP-9791. Add a test case covering long paths for new FileUtil access check methods. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524631 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 06:54:29 +00:00
Colin McCabe
1c4f4a38ca HADOOP-9929. Insufficient permission for a path reported as file not found. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524611 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 02:09:43 +00:00
Arpit Agarwal
a80b826eef Merging r1523878 through r1524586 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1524590 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 21:54:21 +00:00
Jing Zhao
f7eb75fa89 Move HDFS-5122 from Release 2.1.1-beta to Release 2.3.0 in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524581 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 21:33:07 +00:00
Jing Zhao
7a2443e9f8 HDFS-5122. Support failover and retry in WebHdfsFileSystem for NN HA. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524562 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 20:47:16 +00:00
Andrew Wang
e202d4d154 HDFS-5213. Separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1524561 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 20:43:40 +00:00
Arpit Agarwal
22b401284b HDFS-5031. BlockScanner scans the block multiple times. (Vinay via Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524553 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 20:08:50 +00:00
Jing Zhao
f278a491dc HDFS-5219. Add configuration keys for retry policy in WebHDFSFileSystem. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524498 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 17:29:27 +00:00
Tsz-wo Sze
abf09f090f HDFS-4990. Change BlockPlacementPolicy to choose storages instead of datanodes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1524444 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 15:12:52 +00:00
Sanford Ryza
c09f00771e MAPREDUCE-5487. In task processes, JobConf is unnecessarily loaded again in Limits (Sandy Ryza) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524408 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 13:44:33 +00:00
Jing Zhao
5e18410e06 HDFS-5212. Refactor RpcMessage and NFS3Response to support different types of authentication information. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524298 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 06:08:23 +00:00
Brandon Li
c16442c459 HADOOP-9669 Reduce the number of byte array creations and copies in XDR data manipulation. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524259 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 00:06:12 +00:00
Arun Murthy
ac618c6429 Added ASL2 header to releasenotes.html. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523900 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 05:42:39 +00:00
Arun Murthy
004e830750 HADOOP-9350. Moving to appropriate section in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523891 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 05:23:20 +00:00
Arun Murthy
492ecd34c4 Preparing for hadoop-2.1.1-beta release. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523890 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 05:16:21 +00:00
Arun Murthy
877f7adb14 HADOOP-9944. Fix RpcRequestHeaderProto.callId to be sint32 rather than uint32 since ipc.Client.CONNECTION_CONTEXT_CALL_ID is signed (i.e. -3). Contributed by Arun C. Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523885 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 04:53:10 +00:00
Tsz-wo Sze
0398943572 Merge r1523804 through r1523877 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1523878 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 02:59:14 +00:00
Tsz-wo Sze
f98c343c7f HDFS-5207. In BlockPlacementPolicy.chooseTarget(..), change the writer and the excludedNodes parameter types respectively to Node and Set. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523875 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 02:38:47 +00:00
Christopher Douglas
90f43b1c18 YARN-1184. ClassCastException during preemption enforcement. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523863 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 01:31:09 +00:00
Vinod Kumar Vavilapalli
4ea295016e YARN-1001. Added a web-service to get statistics about per application-type per state for consumption by downstream projects. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523855 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 00:24:17 +00:00