Ravi Prakash
|
2753185a01
|
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
|
2016-04-29 22:32:27 -07:00 |
|
Kihwal Lee
|
7da540d03e
|
HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah.
|
2016-04-29 15:50:43 -05:00 |
|
Tsz-Wo Nicholas Sze
|
4da6f69ca1
|
HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu
|
2016-04-29 11:22:33 -07:00 |
|
Kihwal Lee
|
6243eabb48
|
HDFS-9958. BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Contributed by Kuhu Shukla
|
2016-04-28 12:44:53 -05:00 |
|
Lei Xu
|
0a152103f1
|
HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu)
|
2016-04-27 14:22:51 -07:00 |
|
Kihwal Lee
|
919a1d824a
|
HDFS-10330. Add Corrupt Blocks Information in Metasave output. Contributed by Kuhu Shukla.
|
2016-04-27 08:19:48 -05:00 |
|
Andrew Wang
|
6be22ddbf1
|
HDFS-10297. Increase default balance bandwidth and concurrent moves. Contributed by John Zhuge.
|
2016-04-26 13:04:18 -07:00 |
|
Kihwal Lee
|
c6a2430b47
|
HDFS-10329. Bad initialisation of StringBuffer in RequestHedgingProxyProvider. Contributed by Lin Yiqun.
|
2016-04-26 11:45:29 -05:00 |
|
Zhe Zhang
|
5865fe2bf0
|
HDFS-9869. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]. Contributed by Rakesh R.
|
2016-04-25 22:01:54 -07:00 |
|
Tsz-Wo Nicholas Sze
|
f308561f1d
|
HDFS-8057 Move BlockReader implementation to the client implementation package. Contributed by Takanobu Asanuma
|
2016-04-25 12:01:48 -07:00 |
|
Jing Zhao
|
63e5412f1a
|
HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.
|
2016-04-22 15:14:40 -07:00 |
|
Ravi Prakash
|
d6402faded
|
Revert "HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano"
This reverts commit 4838b735f0.
|
2016-04-22 10:17:20 -07:00 |
|
Kihwal Lee
|
5d4255a801
|
HDFS-9555. LazyPersistFileScrubber should still sleep if there are errors in the clear progress. Contributed by Phil Yang.
|
2016-04-22 11:08:44 -05:00 |
|
Tsz-Wo Nicholas Sze
|
14ab7a81e2
|
HDFS-10309 Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga). Contributed by Amit Anand
|
2016-04-21 15:41:50 -07:00 |
|
Tsz-Wo Nicholas Sze
|
bbce1d525e
|
HDFS-10319. Balancer should not try to pair storages with different types.
|
2016-04-21 15:20:12 -07:00 |
|
Ravi Prakash
|
4838b735f0
|
HADOOP-12563. Updated utility (dtutil) to create/modify token files. Contributed by Matthew Paduano
|
2016-04-21 11:32:39 -07:00 |
|
Xiaoyu Yao
|
b4be288c5d
|
HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.
|
2016-04-21 10:18:48 -07:00 |
|
Xiaoyu Yao
|
5bd7b592e5
|
HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.
|
2016-04-20 23:10:52 -07:00 |
|
Chris Nauroth
|
63ac2db59a
|
HDFS-10312. Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Contributed by Chris Nauroth.
|
2016-04-20 13:39:44 -07:00 |
|
Arpit Agarwal
|
af9bdbe447
|
HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou)
|
2016-04-19 11:26:30 -07:00 |
|
Kai Zheng
|
b5d4c7dc76
|
HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li.
|
2016-04-20 15:47:01 +08:00 |
|
Jing Zhao
|
be0bce1b71
|
HDFS-10306. SafeModeMonitor should not leave safe mode if name system is starting active service. Contributed by Mingliang Liu.
|
2016-04-18 18:05:49 -07:00 |
|
Colin Patrick Mccabe
|
cb3ca460ef
|
HDFS-10265. OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag (Wan Chang via cmccabe)
|
2016-04-18 13:47:56 -07:00 |
|
Kihwal Lee
|
d8b729e16f
|
HDFS-10302. BlockPlacementPolicyDefault should use default replication considerload value. Contributed by Lin Yiqun.
|
2016-04-18 07:58:55 -05:00 |
|
Walter Su
|
67523ffcf4
|
HDFS-9412. getBlocks occupies FSLock and takes too long to complete. Contributed by He Tianyi.
|
2016-04-18 09:28:02 +08:00 |
|
Kihwal Lee
|
c970f1d005
|
HDFS-10280. Document new dfsadmin command -evictWriters. Contributed by Wei-Chiu Chuang.
|
2016-04-14 12:45:47 -05:00 |
|
Kihwal Lee
|
0d1c1152f1
|
HDFS-10282. The VolumeScanner should warn about replica files which are misplaced. Contributed by Colin Patrick McCabe.
|
2016-04-14 07:58:24 -05:00 |
|
Xiaoyu Yao
|
5566177c9a
|
HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode. Contributed by Xiaobing Zhou.
|
2016-04-13 16:51:13 -07:00 |
|
Xiaoyu Yao
|
4895c73dd4
|
Revert "HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode"
This reverts commit 192112d5a2.
|
2016-04-13 16:45:18 -07:00 |
|
Andrew Wang
|
314aa21a89
|
HDFS-10279. Improve validation of the configured number of tolerated failed volumes. Contributed by Lin Yiqun.
|
2016-04-13 16:39:50 -07:00 |
|
Xiaobing Zhou
|
192112d5a2
|
HDFS-10209. Support enable caller context in HDFS namenode audit log without restart namenode
|
2016-04-13 15:34:41 -07:00 |
|
Colin Patrick Mccabe
|
35f0770555
|
HADOOP-12973. Make DU pluggable. (Elliott Clark via cmccabe)
|
2016-04-12 16:28:42 -07:00 |
|
Zhe Zhang
|
6ef42873a0
|
HDFS-9918. Erasure Coding: Sort located striped blocks based on decommissioned states. Contributed by Rakesh R.
|
2016-04-12 13:38:58 -07:00 |
|
Colin Patrick Mccabe
|
600d129bb8
|
HDFS-10273. Remove duplicate logSync() and log message in FSN#enterSafemode() (Vinayakumar B via cmccabe)
|
2016-04-12 10:52:39 -07:00 |
|
Vinayakumar B
|
a9a607f8fc
|
HDFS-10271. Extra bytes are getting released from reservedSpace for append (Contributed by Brahma Reddy Battula)
|
2016-04-12 11:44:34 +05:30 |
|
Akira Ajisaka
|
9c32f8785e
|
HDFS-10266. Remove unused properties dfs.client.file-block-storage-locations.num-threads and dfs.client.file-block-storage-locations.timeout.millis. Contributed by Ray Chiang.
|
2016-04-08 15:32:13 +09:00 |
|
Uma Maheswara Rao G
|
3c18a53cbd
|
HDFS-9719. Refactoring ErasureCodingWorker into smaller reusable constructs. Contributed by Kai Zheng.
|
2016-04-06 22:50:24 -07:00 |
|
Tsz-Wo Nicholas Sze
|
654cd1d0c0
|
HDFS-10186. DirectoryScanner: Improve logs by adding full path of both actual and expected block directories. Contributed by Rakesh R
|
2016-04-07 12:38:42 +08:00 |
|
Colin Patrick Mccabe
|
4bd7cbc29d
|
HDFS-10267. Extra "synchronized" on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose
|
2016-04-06 21:07:31 -07:00 |
|
Eric Payne
|
aede8c10ec
|
HDFS-9945. Datanode command for evicting writers. Contributed by Kihwal Lee
|
2016-04-06 20:20:14 +00:00 |
|
Colin Patrick Mccabe
|
188f65287d
|
HDFS-6520. hdfs fsck passes invalid length value when creating BlockReader (Xiao Chen via cmccabe)
|
2016-04-06 11:28:34 -07:00 |
|
Jing Zhao
|
221b3a8722
|
HDFS-10192. Namenode safemode not coming out during failover. Contributed by Brahma Reddy Battula.
|
2016-04-06 10:42:59 -07:00 |
|
Vinayakumar B
|
818d6b799e
|
HDFS-9917. IBR accumulate more objects when SNN was down for sometime. (Contributed by Brahma Reddy Battula)
|
2016-04-05 09:49:39 +08:00 |
|
Colin Patrick Mccabe
|
f6b1a81812
|
HDFS-8496. Calling stopWriter() with FSDatasetImpl lock held may block other threads (cmccabe)
|
2016-04-04 18:02:15 -07:00 |
|
Kihwal Lee
|
a7d1fb0cd2
|
HDFS-10178. Permanent write failures can happen if pipeline recoveries occur for the first packet. Contributed by Kihwal Lee.
|
2016-04-04 16:40:00 -05:00 |
|
Colin Patrick Mccabe
|
37e23ce45c
|
HDFS-10223. peerFromSocketAndKey performs SASL exchange before setting connection timeouts (cmccabe)
|
2016-03-30 13:37:37 -07:00 |
|
Vinayakumar B
|
09d63d5a19
|
HDFS-5177. blocksScheduled count should be decremented for abandoned blocks (Contributed by Vinayakumar B)
|
2016-03-30 14:22:00 +08:00 |
|
Arpit Agarwal
|
ddfe6774c2
|
HDFS-9439. Support reconfiguring fs.protected.directories without NN restart. (Contributed by Xiaobing Zhou)
|
2016-03-29 13:55:00 -07:00 |
|
Vinayakumar B
|
1f004b3367
|
HDFS-9871. "Bytes Being Moved" -ve(-1 B) when cluster was already balanced. (Contributed by Brahma Reddy Battulla)
|
2016-03-29 11:25:41 +08:00 |
|
Uma Maheswara Rao G
|
3a4ff7776e
|
HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng
|
2016-03-26 19:58:09 -07:00 |
|
Arpit Agarwal
|
a337ceb74e
|
Revert "HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng"
This reverts commit e5ff0ea7ba.
|
2016-03-26 09:20:01 -07:00 |
|
Uma Maheswara Rao G
|
e5ff0ea7ba
|
HDFS-9694. Make existing DFSClient#getFileChecksum() work for striped blocks. Contributed by Kai Zheng
|
2016-03-26 00:52:50 -07:00 |
|
Lei Xu
|
fde8ac5d85
|
Add missing files from HDFS-9005. (lei)
|
2016-03-25 17:11:35 -07:00 |
|
Lei Xu
|
4fcfea71bf
|
HDFS-9005. Provide support for upgrade domain script. (Ming Ma via Lei Xu)
|
2016-03-25 17:09:12 -07:00 |
|
Colin Patrick Mccabe
|
a7d8f2b396
|
HDFS-10189. PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE (Joe Pallas via cmccabe)
|
2016-03-22 14:56:02 -07:00 |
|
Colin Patrick Mccabe
|
680716f31e
|
HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe)
|
2016-03-21 11:40:37 -07:00 |
|
Andrew Wang
|
e3bb38d625
|
HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen.
|
2016-03-21 11:39:05 -07:00 |
|
Sangjin Lee
|
cd8b6889a7
|
HDFS-9579. Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level (Ming Ma via sjlee)
|
2016-03-19 14:02:04 -07:00 |
|
Kihwal Lee
|
63c966a3fb
|
HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah.
|
2016-03-18 10:24:59 -05:00 |
|
Andrew Wang
|
02a250db9f
|
HDFS-10173. Typo in DataXceiverServer. Contributed by Michael Han.
|
2016-03-16 18:49:57 -07:00 |
|
Zhe Zhang
|
32d043d9c5
|
HDFS-9857. Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]. Contributed by Rakesh R.
|
2016-03-16 16:53:58 -07:00 |
|
Chris Nauroth
|
5644137ada
|
HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal.
|
2016-03-14 09:54:54 -07:00 |
|
Arpit Agarwal
|
e01c6ea688
|
HDFS-1477. Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart. (Contributed by Xiaobing Zhou)
|
2016-03-10 19:03:55 -08:00 |
|
Colin Patrick Mccabe
|
79961ecea8
|
HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe)
|
2016-03-10 13:43:27 -08:00 |
|
Colin Patrick Mccabe
|
bd49354c6d
|
HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe)
|
2016-03-10 13:41:06 -08:00 |
|
Zhe Zhang
|
7600e3c48f
|
HDFS-7866. Erasure coding: NameNode manages multiple erasure coding policies. Contributed by Rui Li.
|
2016-03-08 22:30:30 -08:00 |
|
Jing Zhao
|
743a99f2db
|
HDFS-8786. Erasure coding: use simple replication for internal blocks on decommissioning datanodes. Contributed by Rakesh R.
|
2016-03-08 10:24:57 -08:00 |
|
Arpit Agarwal
|
c2140d05ef
|
HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu)
|
2016-03-07 21:10:24 -08:00 |
|
Arpit Agarwal
|
724d2299cd
|
HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula)
|
2016-03-07 12:19:53 -08:00 |
|
Harsh J
|
fd1c09be3e
|
HDFS-9521. TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk. Contributed by Wellington Chevreuil
|
2016-03-07 17:14:51 +05:30 |
|
Chris Nauroth
|
2759689d7d
|
HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth.
|
2016-03-04 15:29:50 -08:00 |
|
Arpit Agarwal
|
27941a1811
|
HDFS-9534. Add CLI command to clear storage policy from a path. (Contributed by Xiaobing Zhou)
|
2016-03-02 18:35:28 -08:00 |
|
Colin Patrick Mccabe
|
700b0e4019
|
HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe)
|
2016-03-02 17:56:11 -08:00 |
|
Akira Ajisaka
|
27e0681f28
|
HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula.
|
2016-03-02 14:43:03 +09:00 |
|
Jing Zhao
|
f2ba7da4f0
|
HDFS-9876. shouldProcessOverReplicated should not count number of pending replicas. Contributed by Jing Zhao.
|
2016-03-01 18:41:57 -08:00 |
|
Kihwal Lee
|
2c8496ebf3
|
HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo.
|
2016-03-01 15:04:59 -06:00 |
|
Chris Nauroth
|
2137e8feeb
|
HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula.
|
2016-03-01 11:15:13 -08:00 |
|
Uma Maheswara Rao G
|
307ec80aca
|
HDFS-9733. Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum. Contributed by Kai Zheng
|
2016-02-29 21:52:20 -08:00 |
|
Jing Zhao
|
2151716832
|
HDFS-7964. Add support for async edit logging. Contributed by Daryn Sharp.
|
2016-02-29 15:34:43 -08:00 |
|
Jing Zhao
|
408f2c807b
|
HDFS-9866. BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance. Contributed by Jing Zhao.
|
2016-02-28 14:54:49 -08:00 |
|
Tsz-Wo Nicholas Sze
|
d1d4e16690
|
HDFS-9710. DN can be configured to send block receipt IBRs in batches.
|
2016-02-26 15:32:25 -08:00 |
|
Zhe Zhang
|
8808779db3
|
HDFS-9734. Refactoring of checksum failure report related codes. Contributed by Kai Zheng.
Change-Id: Ie69a77e3498a360959f8e213c51fb2b17c28b64a
|
2016-02-25 09:55:50 -08:00 |
|
Zhe Zhang
|
ccff6035f5
|
HDFS-9804. Allow long-running Balancer to login with keytab. Contributed by Xiao Chen.
Change-Id: I54b82e0b11929082057b4d21bfcf285222c94cdb
|
2016-02-25 09:24:32 -08:00 |
|
Tsz-Wo Nicholas Sze
|
6979cbfc1f
|
HDFS-9838. Refactor the excessReplicateMap to a class.
|
2016-02-24 19:42:47 -08:00 |
|
Jing Zhao
|
47b92f2b6f
|
HDFS-9837. BlockManager#countNodes should be able to detect duplicated internal blocks. Contributed by Jing Zhao.
|
2016-02-24 15:13:56 -08:00 |
|
cnauroth
|
d1dd248b75
|
HDFS-9854. Log cipher suite negotiation more verbosely. Contributed by Wei-Chiu Chuang.
|
2016-02-24 12:11:35 -08:00 |
|
Kihwal Lee
|
d27d7fc72e
|
HDFS-9395. Make HDFS audit logging consistant. Contributed by Kuhu Shukla.
|
2016-02-24 12:04:01 -06:00 |
|
Zhe Zhang
|
def754ec06
|
HDFS-9816. Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]. Contributed by Rui Li.
Change-Id: I64b57bab4722cdc6e1e3148c3a3a401370249afe
|
2016-02-23 14:05:17 -08:00 |
|
Colin Patrick Mccabe
|
211c78c090
|
HDFS-9549. TestCacheDirectives#testExceedsCapacity is flaky (Xiao Chen via cmccabe)
|
2016-02-23 12:01:20 -08:00 |
|
Tsz-Wo Nicholas Sze
|
66289a3bf4
|
HDFS-8578. On upgrade, Datanode should process all storage/data dirs in parallel. Contributed by vinayakumarb and szetszwo
|
2016-02-22 15:01:15 -08:00 |
|
Zhe Zhang
|
a2fdfff02d
|
HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh.
Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335
|
2016-02-22 14:13:54 -08:00 |
|
Arpit Agarwal
|
a63301a864
|
HDFS-9842. dfs.datanode.balance.bandwidthPerSec should accept friendly size units. (Contributed by Lin Yiqun)
|
2016-02-22 11:34:09 -08:00 |
|
Vinayakumar B
|
342c9572bf
|
HDFS-9425. Expose number of blocks per volume as a metric (Contributed by Brahma Reddy Battula)
|
2016-02-22 09:29:23 +05:30 |
|
Vinayakumar B
|
f313516731
|
HDFS-7452. skip StandbyException log for getCorruptFiles() (Contributed by Bramha Reddy Battula)
|
2016-02-22 09:21:46 +05:30 |
|
Arpit Agarwal
|
d5abd293a8
|
HDFS-9839. Reduce verbosity of processReport logging. (Contributed by Arpit Agarwal)
This closes #78
|
2016-02-20 23:19:09 -08:00 |
|
Jing Zhao
|
e54cc29312
|
HDFS-9818. Correctly handle EC reconstruction work caused by not enough racks. Contributed by Jing Zhao.
|
2016-02-19 19:02:23 -08:00 |
|
Jing Zhao
|
6546d9e7ff
|
HDFS-9829. Erasure Coding: Improve few exception handling logic of ErasureCodingWorker. Contributed by Rakesh R.
|
2016-02-19 10:40:28 -08:00 |
|
Tsz-Wo Nicholas Sze
|
46f7790236
|
HDFS-8923. Add -source flag to balancer usage message. Contributed by Chris Trezzo
|
2016-02-18 18:18:12 -08:00 |
|
Kihwal Lee
|
ba6d5ed955
|
HDFS-4946. Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable. Contributed by James Kinley and Nathan Roberts.
|
2016-02-18 13:21:51 -06:00 |
|
cnauroth
|
5d1889a66d
|
HDFS-9711. Integrate CSRF prevention filter in WebHDFS. Contributed by Chris Nauroth.
|
2016-02-18 10:07:28 -08:00 |
|