Colin Patrick Mccabe
|
5f6b4157a4
|
HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe)
|
2016-06-20 10:42:50 -07:00 |
|
Arpit Agarwal
|
0319d73c3b
|
HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal)
|
2016-06-18 16:16:54 -07:00 |
|
Colin Patrick Mccabe
|
2ca73445f5
|
HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe)
|
2016-06-15 22:47:01 -07:00 |
|
Colin Patrick Mccabe
|
2449db507d
|
HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe)
|
2016-06-15 22:35:19 -07:00 |
|
Ming Ma
|
b48f27e794
|
HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma)
|
2016-06-15 22:00:52 -07:00 |
|
Ming Ma
|
7d521a29ee
|
HDFS-9016. Display upgrade domain information in fsck. (mingma)
|
2016-06-14 20:05:50 -07:00 |
|
Andrew Wang
|
709a814fe0
|
HDFS-10516. Fix bug when warming up EDEK cache of more than one encryption zone. Contributed by Xiao Chen.
|
2016-06-13 11:50:19 -07:00 |
|
Ravi Prakash
|
ae047655f4
|
HDFS-10220. A large number of expired leases can make namenode unresponsive and cause failover (Nicolas Fraison via raviprak)
|
2016-06-08 13:44:22 -07:00 |
|
Akira Ajisaka
|
e620530301
|
HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka)
|
2016-06-07 17:52:55 +09:00 |
|
Zhe Zhang
|
6de9213df1
|
HDFS-10458. getFileEncryptionInfo should return quickly for non-encrypted cluster.
|
2016-06-06 15:52:39 -07:00 |
|
Arpit Agarwal
|
97e2449477
|
HDFS-10341. Add a metric to expose the timeout number of pending replication blocks. (Contributed by Akira Ajisaka)
|
2016-06-02 13:14:45 -07:00 |
|
Akira Ajisaka
|
1df6f5735c
|
HDFS-10471. DFSAdmin#SetQuotaCommand's help msg is not correct. Contributed by Yiqun Lin.
|
2016-06-03 04:10:32 +09:00 |
|
Kai Zheng
|
d749cf65e1
|
HDFS-9833. Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data. Contributed by Rakesh R.
|
2016-06-02 12:56:21 +08:00 |
|
Colin Patrick Mccabe
|
c7921c9bdd
|
HDFS-9466. TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky (Wei-Chiu Chuang via cmccabe)
|
2016-05-31 17:37:52 -07:00 |
|
Kai Zheng
|
93d8a7f2a2
|
Revert "HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng"
This reverts commit a6c79f92d5.
|
2016-06-01 08:41:15 +08:00 |
|
Yongjun Zhang
|
5ea6fd85c7
|
HDFS-10276. HDFS should not expose path info that user has no permission to see. (Yuanbo Liu via Yongjun Zhang)
|
2016-05-27 10:02:02 -07:00 |
|
Zhe Zhang
|
8c84a2a93c
|
HDFS-10236. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3]. Contributed by Rakesh R.
|
2016-05-26 16:50:55 -07:00 |
|
Kai Zheng
|
77202fa103
|
HADOOP-13010. Refactor raw erasure coders. Contributed by Kai Zheng
|
2016-05-27 13:23:34 +08:00 |
|
Kai Zheng
|
a6c79f92d5
|
HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by Kai Zheng
|
2016-05-27 04:29:42 +08:00 |
|
Tsz-Wo Nicholas Sze
|
15ed080e36
|
HDFS-9365. Balaner does not work with the HDFS-6376 HA setup.
|
2016-05-24 12:49:48 -07:00 |
|
Allen Wittenauer
|
4b0f55b6ea
|
HDFS-7766. Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect (Ravi Prakash via aw)
|
2016-05-23 15:52:01 -07:00 |
|
Chris Nauroth
|
500e946729
|
HDFS-10438. When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server. Contributed by Chris Nauroth.
|
2016-05-20 13:01:43 -07:00 |
|
Chris Nauroth
|
bcde1562d2
|
HDFS-10424. DatanodeLifelineProtocol not able to use under security cluster. Contributed by Chris Nauroth.
|
2016-05-20 12:47:41 -07:00 |
|
Kihwal Lee
|
204de430bf
|
HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu.
|
2016-05-19 15:52:32 -05:00 |
|
Andrew Wang
|
010e6ac328
|
HDFS-2173. saveNamespace should not throw IOE when only one storage directory fails to write VERSION file. Contributed by Andras Bokor.
|
2016-05-18 14:13:41 -07:00 |
|
Lei Xu
|
cf552aa87b
|
HDFS-10360. DataNode may format directory and lose blocks if current/VERSION is missing. (Wei-Chiu Chuang via lei)
|
2016-05-18 09:38:37 -07:00 |
|
Junping Du
|
f6ef876fe1
|
MAPREDUCE-6657. Job history server can fail on startup when NameNode is in start phase. Contributed by Haibo Chen.
|
2016-05-17 14:41:47 -07:00 |
|
Yongjun Zhang
|
e24fe2641b
|
HDFS-9732, Improve DelegationTokenIdentifier.toString() for better logging. Contributed by Yongjun Zhang.
|
2016-05-17 14:03:08 -07:00 |
|
Kihwal Lee
|
1356cbe994
|
Revert "HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu."
This reverts commit 0942954e8a.
|
2016-05-17 15:20:03 -05:00 |
|
Kihwal Lee
|
0942954e8a
|
HDFS-10417. Improve error message from checkBlockLocalPathAccess. Contributed by Tianyin Xu.
|
2016-05-17 15:06:25 -05:00 |
|
Colin Patrick Mccabe
|
7cd5ae62f6
|
HDFS-10404. Fix formatting of CacheAdmin command usage help text (Yiqun Lin via cmccabe)
|
2016-05-17 11:10:48 -07:00 |
|
Lei Xu
|
6a6e74acf5
|
HDFS-10410. RedundantEditLogInputStream.LOG is set to wrong class. (John Zhuge via lei)
|
2016-05-16 17:05:46 -07:00 |
|
Kai Zheng
|
ad9441122f
|
HDFS-8449. Add tasks count metrics to datanode for ECWorker. Contributed by Bo Li.
|
2016-05-15 23:39:09 -07:00 |
|
Andrew Wang
|
3c5c57af28
|
HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.
|
2016-05-12 18:27:28 -07:00 |
|
Zhe Zhang
|
307db61aac
|
HDFS-10172. hdfs erasurecode command should remove the redundant -usage option. Contributed by Yuanbo Liu.
|
2016-05-10 15:20:17 -07:00 |
|
Colin Patrick Mccabe
|
f0252ad252
|
HDFS-10377. CacheReplicationMonitor shutdown log message should use INFO level (Yiqun Lin via cmccabe)
|
2016-05-10 11:15:05 -07:00 |
|
Akira Ajisaka
|
411fb4b2b7
|
HDFS-10337. OfflineEditsViewer stats option should print 0 instead of null for the count of operations. Contributed by Yiqun Lin.
|
2016-05-08 15:49:13 -07:00 |
|
Xiaoyu Yao
|
dacd1f50fe
|
HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang.
|
2016-05-05 18:08:47 -07:00 |
|
Ming Ma
|
1268cf5fbe
|
HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma)
|
2016-05-04 17:02:26 -07:00 |
|
Arpit Agarwal
|
6d77d6eab7
|
HDFS-9902. Support different values of dfs.datanode.du.reserved per storage type. (Contributed by Brahma Reddy Battula)
|
2016-05-03 16:52:43 -07:00 |
|
Ravi Prakash
|
2753185a01
|
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
|
2016-04-29 22:32:27 -07:00 |
|
Kihwal Lee
|
7da540d03e
|
HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah.
|
2016-04-29 15:50:43 -05:00 |
|
Tsz-Wo Nicholas Sze
|
4da6f69ca1
|
HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu
|
2016-04-29 11:22:33 -07:00 |
|
Kihwal Lee
|
6243eabb48
|
HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Contributed by Kuhu Shukla
|
2016-04-28 12:44:53 -05:00 |
|
Lei Xu
|
0a152103f1
|
HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
|
2016-04-27 14:22:51 -07:00 |
|
Kihwal Lee
|
919a1d824a
|
HDFS-10330. Add Corrupt Blocks Information in Metasave output. Contributed by Kuhu Shukla.
|
2016-04-27 08:19:48 -05:00 |
|
Andrew Wang
|
6be22ddbf1
|
HDFS-10297. Increase default balance bandwidth and concurrent moves. Contributed by John Zhuge.
|
2016-04-26 13:04:18 -07:00 |
|
Kihwal Lee
|
c6a2430b47
|
HDFS-10329. Bad initialisation of StringBuffer in RequestHedgingProxyProvider. Contributed by Lin Yiqun.
|
2016-04-26 11:45:29 -05:00 |
|
Zhe Zhang
|
5865fe2bf0
|
HDFS-9869. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]. Contributed by Rakesh R.
|
2016-04-25 22:01:54 -07:00 |
|
Tsz-Wo Nicholas Sze
|
f308561f1d
|
HDFS-8057 Move BlockReader implementation to the client implementation package. Contributed by Takanobu Asanuma
|
2016-04-25 12:01:48 -07:00 |
|
Jing Zhao
|
63e5412f1a
|
HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.
|
2016-04-22 15:14:40 -07:00 |
|
Ravi Prakash
|
d6402faded
|
Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano"
This reverts commit 4838b735f0.
|
2016-04-22 10:17:20 -07:00 |
|
Kihwal Lee
|
5d4255a801
|
HDFS-9555. LazyPersistFileScrubber should still sleep if there are errors in the clear progress. Contributed by Phil Yang.
|
2016-04-22 11:08:44 -05:00 |
|
Tsz-Wo Nicholas Sze
|
14ab7a81e2
|
HDFS-10309 Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga). Contributed by Amit Anand
|
2016-04-21 15:41:50 -07:00 |
|
Tsz-Wo Nicholas Sze
|
bbce1d525e
|
HDFS-10319. Balancer should not try to pair storages with different types.
|
2016-04-21 15:20:12 -07:00 |
|
Ravi Prakash
|
4838b735f0
|
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
|
2016-04-21 11:32:39 -07:00 |
|
Xiaoyu Yao
|
b4be288c5d
|
HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.
|
2016-04-21 10:18:48 -07:00 |
|
Xiaoyu Yao
|
5bd7b592e5
|
HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
|
2016-04-20 23:10:52 -07:00 |
|
Chris Nauroth
|
63ac2db59a
|
HDFS-10312. Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Contributed by Chris Nauroth.
|
2016-04-20 13:39:44 -07:00 |
|
Arpit Agarwal
|
af9bdbe447
|
HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou)
|
2016-04-19 11:26:30 -07:00 |
|
Kai Zheng
|
b5d4c7dc76
|
HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li.
|
2016-04-20 15:47:01 +08:00 |
|
Jing Zhao
|
be0bce1b71
|
HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu.
|
2016-04-18 18:05:49 -07:00 |
|
Colin Patrick Mccabe
|
cb3ca460ef
|
HDFS-10265. OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag (Wan Chang via cmccabe)
|
2016-04-18 13:47:56 -07:00 |
|
Kihwal Lee
|
d8b729e16f
|
HDFS-10302. BlockPlacementPolicyDefault should use default replication considerload value. Contributed by Lin Yiqun.
|
2016-04-18 07:58:55 -05:00 |
|
Walter Su
|
67523ffcf4
|
HDFS-9412. getBlocks occupies FSLock and takes too long to complete. Contributed by He Tianyi.
|
2016-04-18 09:28:02 +08:00 |
|
Kihwal Lee
|
c970f1d005
|
HDFS-10280. Document new dfsadmin command -evictWriters. Contributed by Wei-Chiu Chuang.
|
2016-04-14 12:45:47 -05:00 |
|
Kihwal Lee
|
0d1c1152f1
|
HDFS-10282. The VolumeScanner should warn about replica files which are misplaced. Contributed by Colin Patrick McCabe.
|
2016-04-14 07:58:24 -05:00 |
|
Xiaoyu Yao
|
5566177c9a
|
HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode. Contributed by Xiaobing Zhou.
|
2016-04-13 16:51:13 -07:00 |
|
Xiaoyu Yao
|
4895c73dd4
|
Revert "HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode"
This reverts commit 192112d5a2.
|
2016-04-13 16:45:18 -07:00 |
|
Andrew Wang
|
314aa21a89
|
HDFS-10279. Improve validation of the configured number of tolerated failed volumes. Contributed by Lin Yiqun.
|
2016-04-13 16:39:50 -07:00 |
|
Xiaobing Zhou
|
192112d5a2
|
HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode
|
2016-04-13 15:34:41 -07:00 |
|
Colin Patrick Mccabe
|
35f0770555
|
HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
|
2016-04-12 16:28:42 -07:00 |
|
Zhe Zhang
|
6ef42873a0
|
HDFS-9918. Erasure Coding: Sort located striped blocks based on decommissioned states. Contributed by Rakesh R.
|
2016-04-12 13:38:58 -07:00 |
|
Colin Patrick Mccabe
|
600d129bb8
|
HDFS-10273. Remove duplicate logSync() and log message in FSN#enterSafemode() (Vinayakumar B via cmccabe)
|
2016-04-12 10:52:39 -07:00 |
|
Vinayakumar B
|
a9a607f8fc
|
HDFS-10271. Extra bytes are getting released from reservedSpace for append (Contributed by Brahma Reddy Battula)
|
2016-04-12 11:44:34 +05:30 |
|
Akira Ajisaka
|
9c32f8785e
|
HDFS-10266. Remove unused properties dfs.client.file-block-storage-locations.num-threads and dfs.client.file-block-storage-locations.timeout.millis. Contributed by Ray Chiang.
|
2016-04-08 15:32:13 +09:00 |
|
Uma Maheswara Rao G
|
3c18a53cbd
|
HDFS-9719. Refactoring ErasureCodingWorker into smaller reusable constructs. Contributed by Kai Zheng.
|
2016-04-06 22:50:24 -07:00 |
|
Tsz-Wo Nicholas Sze
|
654cd1d0c0
|
HDFS-10186. DirectoryScanner: Improve logs by adding full path of both actual and expected block directories. Contributed by Rakesh R
|
2016-04-07 12:38:42 +08:00 |
|
Colin Patrick Mccabe
|
4bd7cbc29d
|
HDFS-10267. Extra "synchronized" on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose
|
2016-04-06 21:07:31 -07:00 |
|
Eric Payne
|
aede8c10ec
|
HDFS-9945. Datanode command for evicting writers. Contributed by Kihwal Lee
|
2016-04-06 20:20:14 +00:00 |
|
Colin Patrick Mccabe
|
188f65287d
|
HDFS-6520. hdfs fsck passes invalid length value when creating BlockReader (Xiao Chen via cmccabe)
|
2016-04-06 11:28:34 -07:00 |
|
Jing Zhao
|
221b3a8722
|
HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula.
|
2016-04-06 10:42:59 -07:00 |
|
Vinayakumar B
|
818d6b799e
|
HDFS-9917. IBR accumulate more objects when SNN was down for sometime. (Contributed by Brahma Reddy Battula)
|
2016-04-05 09:49:39 +08:00 |
|
Colin Patrick Mccabe
|
f6b1a81812
|
HDFS-8496. Calling stopWriter() with FSDatasetImpl lock held may block other threads (cmccabe)
|
2016-04-04 18:02:15 -07:00 |
|
Kihwal Lee
|
a7d1fb0cd2
|
HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee.
|
2016-04-04 16:40:00 -05:00 |
|
Colin Patrick Mccabe
|
37e23ce45c
|
HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe)
|
2016-03-30 13:37:37 -07:00 |
|
Vinayakumar B
|
09d63d5a19
|
HDFS-5177. blocksScheduled count should be decremented for abandoned blocks (Contributed by Vinayakumar B)
|
2016-03-30 14:22:00 +08:00 |
|
Arpit Agarwal
|
ddfe6774c2
|
HDFS-9439. Support reconfiguring fs.protected.directories without NN restart. (Contributed by Xiaobing Zhou)
|
2016-03-29 13:55:00 -07:00 |
|
Vinayakumar B
|
1f004b3367
|
HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla)
|
2016-03-29 11:25:41 +08:00 |
|
Uma Maheswara Rao G
|
3a4ff7776e
|
HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng
|
2016-03-26 19:58:09 -07:00 |
|
Arpit Agarwal
|
a337ceb74e
|
Revert "HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng"
This reverts commit e5ff0ea7ba.
|
2016-03-26 09:20:01 -07:00 |
|
Uma Maheswara Rao G
|
e5ff0ea7ba
|
HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng
|
2016-03-26 00:52:50 -07:00 |
|
Lei Xu
|
fde8ac5d85
|
Add missing files from HDFS-9005. (lei)
|
2016-03-25 17:11:35 -07:00 |
|
Lei Xu
|
4fcfea71bf
|
HDFS-9005. Provide support for upgrade domain script. (Ming Ma via Lei Xu)
|
2016-03-25 17:09:12 -07:00 |
|
Colin Patrick Mccabe
|
a7d8f2b396
|
HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe)
|
2016-03-22 14:56:02 -07:00 |
|
Colin Patrick Mccabe
|
680716f31e
|
HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe)
|
2016-03-21 11:40:37 -07:00 |
|
Andrew Wang
|
e3bb38d625
|
HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
|
2016-03-21 11:39:05 -07:00 |
|
Sangjin Lee
|
cd8b6889a7
|
HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee)
|
2016-03-19 14:02:04 -07:00 |
|
Kihwal Lee
|
63c966a3fb
|
HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah.
|
2016-03-18 10:24:59 -05:00 |
|
Andrew Wang
|
02a250db9f
|
HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han.
|
2016-03-16 18:49:57 -07:00 |
|