Commit Graph

10490 Commits

Author SHA1 Message Date
Andrew Wang
5a540c3d31 HDFS-8025. Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated. Contributed by Ming Ma. 2015-04-08 16:09:17 -07:00
Haohui Mai
82d56b337d Revert HDFS-7813. 2015-04-08 16:02:45 -07:00
Haohui Mai
bd4c99bece Revert HDFS-7808. 2015-04-08 15:59:55 -07:00
Andrew Wang
6af0d74a75 HDFS-7725. Incorrect 'nodes in service' metrics caused all writes to fail. Contributed by Ming Ma. 2015-04-08 15:52:06 -07:00
Andrew Wang
a42bb1cd91 HDFS-8076. Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible. Contributed by Zhe Zhang. 2015-04-08 15:41:48 -07:00
Hitesh Shah
265ed1fe80 YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai. 2015-04-08 14:13:10 -07:00
Kihwal Lee
285b31e75e HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee. 2015-04-08 15:38:29 -05:00
Tsz-Wo Nicholas Sze
c931a3c776 HDFS-8079. Move CorruptFileBlockIterator to a new hdfs.client.impl package. 2015-04-08 11:50:52 -07:00
Arpit Agarwal
608c499841 HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (Arpit Agarwal) 2015-04-08 11:38:21 -07:00
Wangda Tan
ba9ee22ca4 YARN-2901 addendum: Fixed findbugs warning caused by previously patch 2015-04-08 11:02:06 -07:00
Wangda Tan
7af086a515 YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda) 2015-04-08 10:57:48 -07:00
Allen Wittenauer
f4b3fc5621 HADOOP-11781. fix race conditions and add URL support to smart-apply-patch.sh (Raymie Stata via aw) 2015-04-08 10:05:25 -07:00
Tsuyoshi Ozawa
dd852f5b8c YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt. 2015-04-08 15:56:18 +09:00
Haohui Mai
ab04ff9efe HDFS-8080. Separate JSON related routines used by WebHdfsFileSystem to a package local class. Contributed by Haohui Mai. 2015-04-07 21:30:57 -07:00
Vinayakumar B
d505c8acd3 HDFS-8073. Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. (Contributed by Walter Su) 2015-04-08 09:56:37 +05:30
Tsz-Wo Nicholas Sze
4be648b55c HDFS-8079. Move dfs.client.retry.* confs from DFSConfigKeys to HdfsClientConfigKeys.Retry. 2015-04-07 19:48:57 -07:00
Yongjun Zhang
66763bb06f HDFS-5215. dfs.datanode.du.reserved is not considered while computing
available space ( Brahma Reddy Battula via Yongjun Zhang)
2015-04-07 19:31:58 -07:00
Arpit Agarwal
5449adc9e5 HADOOP-11801. Update BUILDING.txt for Ubuntu. (Contributed by Gabor Liptak) 2015-04-07 18:06:05 -07:00
Robert Kanter
5b8a3ae366 YARN-3429. Fix incorrect CHANGES.txt 2015-04-07 16:15:42 -07:00
cnauroth
bd77a7c4d9 HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. Contributed by Xiaoyu Yao. 2015-04-07 14:47:21 -07:00
cnauroth
1e72d98c69 HDFS-8038. PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. Contributed by Xiaoyu Yao. 2015-04-07 14:23:01 -07:00
Tsz-Wo Nicholas Sze
571a1ce9d0 HDFS-8049. Add @InterfaceAudience.Private annotation to hdfs client implementation. Contributed by Takuya Fukudome 2015-04-07 13:59:48 -07:00
Xuan
d27e9241e8 YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
a fixed time period. Contributed by Varun Vasudev
2015-04-07 09:52:36 -07:00
Karthik Kambatla
0b5d7d23c4 YARN-2666. Commit 53959e6 2015-04-07 09:07:57 -07:00
Xuan
19a4feaf6f YARN-3110. Few issues in ApplicationHistory web ui. Contributed by Naganarasimha G R 2015-04-07 08:22:39 -07:00
Owen O'Malley
ce63573314 HADOOP-11717. Support JWT tokens for web single sign on to the Hadoop
servers. (Larry McCay via omalley)
2015-04-07 08:09:41 -07:00
Konstantin V Shvachko
75c5454860 HDFS-8071. Redundant checkFileProgress() in PART II of getAdditionalBlock(). Contributed by Konstantin Shvachko. 2015-04-06 22:20:44 -07:00
Zhijie Shen
3fb5abfc87 Move YARN-3273 from 2.8 to 2.7. 2015-04-06 14:14:53 -07:00
Robert Kanter
99b08a748e YARN-2429. TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken (zxu via rkanter) 2015-04-06 14:11:20 -07:00
Colin Patrick Mccabe
28bebc81db HDFS-7999. FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time (sinago via cmccabe) 2015-04-06 08:56:52 -07:00
Tsuyoshi Ozawa
53959e69f7 TestFairScheduler.testContinuousScheduling fails Intermittently. Contributed by Zhihai Xu. 2015-04-06 20:19:13 +09:00
Xuan
96d72118f5 YARN-3435. AM container to be allocated Appattempt AM container shown as
null. Contributed by Bibin A Chundatt
2015-04-05 00:40:57 -07:00
Vinod Kumar Vavilapalli
4b3948ea36 HADOOP-11776. Fixed the broken JDiff support in Hadoop 2. Contributed by Li Lu. 2015-04-04 13:52:01 -07:00
Vinod Kumar Vavilapalli
5370e7128b HADOOP-11377. Added Null.java without which jdiff completely flops. Contributed by Tsuyoshi Ozawa. 2015-04-04 13:47:08 -07:00
Colin Patrick Mccabe
ef591b1d6a HDFS-8051. FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. (Lei (Eddy) Xu via Colin P. McCabe) 2015-04-03 16:34:23 -07:00
Colin Patrick Mccabe
023133cef9 HDFS-7996. After swapping a volume, BlockReceiver reports ReplicaNotFoundException (Lei (Eddy) Xu via Colin P. McCabe) 2015-04-03 14:19:46 -07:00
Colin Patrick Mccabe
932730df7d HADOOP-11785. Reduce the number of listStatus operation in distcp buildListing (Zoran Dimitrijevic via Colin P. McCabe) 2015-04-03 14:08:25 -07:00
cnauroth
db80e42891 HDFS-8039. Fix TestDebugAdmin#testRecoverLease and testVerfiyBlockChecksumCommand on Windows. Contributed by Xiaoyu Yao. 2015-04-03 10:44:02 -07:00
Gera Shegalov
a0795c1e81 MAPREDUCE-4844. Counters / AbstractCounters have constant references not declared final. (Brahma Reddy Battula via gera) 2015-04-03 10:28:52 -07:00
cnauroth
dc5596c36a HDFS-8034. Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows. Contributed by Xiaoyu Yao. 2015-04-03 10:10:11 -07:00
Akira Ajisaka
228ae9aaa4 HADOOP-11800. Clean up some test methods in TestCodec.java. Contributed by Brahma Reddy Battula. 2015-04-04 00:32:18 +09:00
Jing Zhao
72f6bd4893 HDFS-7811. Avoid recursive call getStoragePolicyID in INodeFile#computeQuotaUsage. Contributed by Xiaoyu Yao and Jing Zhao. 2015-04-02 21:20:30 -07:00
Allen Wittenauer
8d3c0f601d HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) 2015-04-02 20:50:36 -07:00
Wangda Tan
bad070fe15 YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda) 2015-04-02 17:23:20 -07:00
Vinod Kumar Vavilapalli
b21c72777a YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana. 2015-04-02 16:53:59 -07:00
cnauroth
5763b173d3 HADOOP-9805. Refactor RawLocalFileSystem#rename for improved testability. Contributed by Jean-Pierre Matsumoto. 2015-04-02 16:13:00 -07:00
Haohui Mai
16b74f978a HDFS-7893. Update the POM to create a separate hdfs-client jar. Contributed by Haohui Mai. 2015-04-02 15:29:18 -07:00
Sandy Ryza
6a6a59db7f YARN-3415. Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue (Zhihai Xu via Sandy Ryza) 2015-04-02 13:56:08 -07:00
Junping Du
eccb7d46ef MAPREDUCE-6303. Read timeout when retrying a fetch error can be fatal to a reducer. Contributed by Jason Lowe. 2015-04-02 12:13:03 -07:00
Haohui Mai
96649c38f9 HDFS-8035. Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager. Contributed by Haohui Mai. 2015-04-02 11:36:51 -07:00