cnauroth
|
02e7dec79d
|
HDFS-7773. Additional metrics in HDFS to be accessed via jmx. Contributed by Anu Engineer.
|
2015-02-20 12:37:48 -08:00 |
|
cnauroth
|
8c6ae0d619
|
HDFS-7814. Fix usage string of storageType parameter for "dfsadmin -setSpaceQuota/clrSpaceQuota". Contributed by Xiaoyu Yao.
|
2015-02-20 12:21:46 -08:00 |
|
Kihwal Lee
|
7ae5255a16
|
HDFS-7788. Post-2.6 namenode may not start up with an image containing inodes created with an old release. Contributed by Rushabh Shah.
|
2015-02-20 09:09:02 -06:00 |
|
Tsuyoshi Ozawa
|
946456c6d8
|
HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)
|
2015-02-19 13:06:53 +09:00 |
|
Haohui Mai
|
9a3e292087
|
HDFS-7808. Remove obsolete -ns options in in DFSHAAdmin.java. Contributed by Arshad Mohammad.
|
2015-02-18 15:15:08 -08:00 |
|
cnauroth
|
2aa9979a71
|
HDFS-7772. Document hdfs balancer -exclude/-include option in HDFSCommands.html. Contributed by Xiaoyu Yao.
|
2015-02-18 12:03:07 -08:00 |
|
Akira Ajisaka
|
6dc8812a95
|
HDFS-7780. Update use of Iterator to Iterable in DataXceiverServer and SnapshotDiffInfo. Contributed by Ray Chiang.
|
2015-02-17 14:47:53 -08:00 |
|
Haohui Mai
|
043e44bc36
|
HDFS-6662. WebHDFS cannot open a file if its path contains "%". Contributed by Gerson Carlos.
|
2015-02-17 13:04:38 -08:00 |
|
Kihwal Lee
|
db6606223c
|
HDFS-7795. Show warning if not all favored nodes were chosen by namenode. Contributed by Kihwal Lee.
|
2015-02-17 13:05:43 -06:00 |
|
Uma Maheswara Rao G
|
f24a56787a
|
HDFS-7797. Add audit log for setQuota operation (Rakesh R via umamahesh)
|
2015-02-17 20:11:11 +05:30 |
|
Tsuyoshi Ozawa
|
2f0f756b26
|
HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa)
|
2015-02-17 21:56:20 +09:00 |
|
yliu
|
500e6a0f46
|
HDFS-7798. Checkpointing failure caused by shared KerberosAuthenticator. (Chengbing Liu via yliu)
|
2015-02-17 07:46:33 +08:00 |
|
cnauroth
|
9729b244de
|
HDFS-7604. Track and display failed DataNode storage locations in NameNode. Contributed by Chris Nauroth.
|
2015-02-16 14:43:02 -08:00 |
|
Arpit Agarwal
|
f2231cebcd
|
HDFS-7775. Use consistent naming for NN-internal quota related types and functions. (Contributed bu Xiaoyu Yao)
|
2015-02-13 21:01:33 -08:00 |
|
Colin Patrick Mccabe
|
8bb9a5000e
|
HDFS-7686. Re-add rapid rescan of possibly corrupt block feature to the block scanner (cmccabe)
|
2015-02-13 14:35:49 -08:00 |
|
Colin Patrick Mccabe
|
871cb56152
|
HDFS-7790. Do not create optional fields in DFSInputStream unless they are needed (cmccabe)
|
2015-02-12 17:48:51 -08:00 |
|
Akira Ajisaka
|
46b6d23e8f
|
HDFS-7684. The host:port settings of the deamons should be trimmed before use. Contributed by Anu Engineer.
|
2015-02-12 17:40:30 -08:00 |
|
Colin Patrick Mccabe
|
6b39ad0865
|
HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe)
|
2015-02-12 10:40:46 -08:00 |
|
Kihwal Lee
|
8d7215d40f
|
Adding missing files from HDFS-7404
|
2015-02-12 11:17:39 -06:00 |
|
Kihwal Lee
|
38262779bb
|
HDFS-7704. DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out. Contributed by Rushabh Shah.
|
2015-02-12 09:15:30 -06:00 |
|
Vinayakumar B
|
89a5449280
|
HDFS-7703. Support favouredNodes for the append for new blocks ( Contributed by Vinayakumar B)
|
2015-02-12 12:38:44 +05:30 |
|
yliu
|
8a54384a0a
|
HDFS-7761. cleanup unnecssary code logic in LocatedBlock. (yliu)
|
2015-02-12 03:08:16 +08:00 |
|
Tsz-Wo Nicholas Sze
|
085b1e293f
|
HDFS-6133. Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover. Contributed by zhaoyunjiong
|
2015-02-11 15:12:12 -08:00 |
|
Haohui Mai
|
f80c9888fa
|
HDFS-7736. Fix typos in dfsadmin/fsck/snapshotDiff usage messages. Contributed by Brahma Reddy Battula.
|
2015-02-11 11:21:33 -08:00 |
|
Arpit Agarwal
|
5dae97a584
|
HDFS-7723. Quota By Storage Type namenode implemenation. (Contributed by Xiaoyu Yao)
|
2015-02-11 10:41:50 -08:00 |
|
Allen Wittenauer
|
b94c1117a2
|
HDFS-316. Balancer should run for a configurable # of iterations (Xiaoyu Yao via aw)
|
2015-02-11 08:10:34 -08:00 |
|
Konstantin V Shvachko
|
a4ceea60f5
|
HDFS-7753. Fix Multithreaded correctness Warnings in BackupImage. Contributed by Rakesh R and Konstantin Shvachko.
|
2015-02-11 00:45:18 -08:00 |
|
Vinayakumar B
|
3d15728ff5
|
HDFS-7714. Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode.(Contributed by Vinayakumar B)
|
2015-02-10 10:43:08 +05:30 |
|
Colin Patrick Mccabe
|
02340a24f2
|
HDFS-7718. Store KeyProvider in ClientContext to avoid leaking key provider threads when using FileContext (Arun Suresh via Colin P. McCabe)
|
2015-02-09 20:23:23 -08:00 |
|
Colin Patrick Mccabe
|
a9dc5cd706
|
HDFS-7744. Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called (cmccabe)
|
2015-02-09 20:16:41 -08:00 |
|
yliu
|
260b5e32c4
|
HDFS-7756. Restore method signature for LocatedBlock#getLocations(). (Ted Yu via yliu)
|
2015-02-10 01:57:51 +08:00 |
|
yliu
|
1b56d1ce32
|
HADOOP-11510. Expose truncate API via FileContext. (yliu)
|
2015-02-10 01:45:29 +08:00 |
|
Arpit Agarwal
|
ab934e8594
|
HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai)
|
2015-02-09 12:17:40 -08:00 |
|
Jing Zhao
|
1382ae525c
|
HDFS-7743. Code cleanup of BlockInfo and rename BlockInfo to BlockInfoContiguous. Contributed by Jing Zhao.
|
2015-02-08 11:51:44 -08:00 |
|
Tsz-Wo Nicholas Sze
|
8f7d4bb09f
|
HDFS-7738. Revise the exception message for recover lease; add more truncate tests such as truncate with HA setup, negative tests, truncate with other operations and multiple truncates.
|
2015-02-07 15:21:16 -08:00 |
|
Akira Ajisaka
|
cfb829ecd5
|
HDFS-7710. Remove dead code in BackupImage.java. Contributed by Xiaoyu Yao.
|
2015-02-06 18:59:31 -08:00 |
|
Arpit Agarwal
|
8de80ff712
|
HDFS-7720. Quota by Storage Type API, tools and ClientNameNode Protocol changes. (Contributed by Xiaoyu Yao)
|
2015-02-06 17:01:19 -08:00 |
|
Akira Ajisaka
|
eaab959a3e
|
HDFS-7732. Fix the order of the parameters in DFSConfigKeys. Contributed by Brahma Reddy Battula.
|
2015-02-06 11:26:49 -08:00 |
|
yliu
|
7b10ef0c3b
|
HDFS-7741. Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream. (yliu)
|
2015-02-06 06:31:03 +08:00 |
|
yliu
|
45ea53f938
|
HDFS-7698. Fix locking on HDFS read statistics and add a method for clearing them. (Colin P. McCabe via yliu)
|
2015-02-05 23:56:29 +08:00 |
|
yliu
|
03f7ed382b
|
HDFS-7655. Expose truncate API for Web HDFS. (yliu)
|
2015-02-05 23:45:06 +08:00 |
|
Haohui Mai
|
c4980a2f34
|
HDFS-7270. Add congestion signaling capability to DataNode write protocol. Contributed by Haohui Mai.
|
2015-02-05 10:58:58 -08:00 |
|
Colin Patrick Mccabe
|
40a415799b
|
HDFS-7719. BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes. (Lei (Eddy) Xu via Colin P. McCabe)
|
2015-02-04 12:10:00 -08:00 |
|
Andrew Wang
|
9175105eea
|
HDFS-7734. Class cast exception in NameNode#main. Contributed by Yi Liu.
|
2015-02-04 11:31:38 -08:00 |
|
Andrew Wang
|
3ae38ec7df
|
HDFS-7712. Switch blockStateChangeLog to use slf4j.
|
2015-02-03 15:01:16 -08:00 |
|
Kihwal Lee
|
843806d03a
|
HDFS-7707. Edit log corruption due to delayed block removal again. Contributed by Yongjun Zhang
|
2015-02-03 14:45:15 -06:00 |
|
Colin Patrick Mccabe
|
115428176e
|
HDFS-7721. The HDFS BlockScanner may run fast during the first hour (cmccabe)
|
2015-02-03 11:05:31 -08:00 |
|
Haohui Mai
|
8cb473124c
|
HDFS-6651. Deletion failure can leak inodes permanently. Contributed by Jing Zhao.
|
2015-02-02 16:32:38 -08:00 |
|
Tsz-Wo Nicholas Sze
|
d085eb15d7
|
HDFS-7696. In FsDatasetImpl, the getBlockInputStream(..) and getTmpInputStreams(..) methods may leak file descriptors.
|
2015-02-02 13:38:36 -08:00 |
|
Colin Patrick Mccabe
|
09ad9a868a
|
HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe)
|
2015-01-30 16:01:59 -08:00 |
|
Andrew Wang
|
951b3608a8
|
HDFS-7706. Switch BlockManager logging to use slf4j.
|
2015-01-30 11:33:03 -08:00 |
|
Kihwal Lee
|
89b07490f8
|
HDFS-7603. The background replication queue initialization may not let others run. Contributed by Kihwal Lee.
|
2015-01-29 12:36:22 -06:00 |
|
yliu
|
f37849188b
|
HDFS-7423. various typos and message formatting fixes in nfs daemon and doc. (Charles Lamb via yliu)
|
2015-01-29 04:56:04 +08:00 |
|
Tsz-Wo Nicholas Sze
|
5a0051f4da
|
HDFS-7681. Change ReplicaInputStreams constructor to take InputStream(s) instead of FileDescriptor(s). Contributed by Joe Pallas
|
2015-01-28 16:00:47 -08:00 |
|
Jing Zhao
|
d244574d03
|
HDFS-7611. deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart. Contributed by Jing Zhao and Byron Wong.
|
2015-01-28 15:25:03 -08:00 |
|
Andrew Wang
|
caf7298e49
|
HDFS-6673. Add delimited format support to PB OIV tool. Contributed by Eddy Xu.
|
2015-01-28 12:36:29 -08:00 |
|
Colin Patrick Mccabe
|
d12dd47f45
|
HDFS-7675. Remove unused member DFSClient.spanReceiverHost (cmccabe)
|
2015-01-27 20:52:02 -08:00 |
|
yliu
|
9ca565e970
|
HDFS-7677. DistributedFileSystem#truncate should resolve symlinks. (yliu)
|
2015-01-27 23:50:11 +08:00 |
|
Jing Zhao
|
2848db814a
|
HDFS-3689. Add support for variable length block. Contributed by Jing Zhao.
|
2015-01-27 12:58:10 -08:00 |
|
Kihwal Lee
|
2b0fa20f69
|
HDFS-7224. Allow reuse of NN connections via webhdfs. Contributed by Eric Payne
|
2015-01-26 08:14:30 -06:00 |
|
yliu
|
e9fd46ddbf
|
HDFS-7659. truncate should check negative value of the new length. Contributed by Yi Liu.
|
2015-01-24 15:44:07 -08:00 |
|
yliu
|
5f124efb3e
|
HDFS-7660. BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly. (Lei Xu via yliu)
|
2015-01-23 02:37:44 +08:00 |
|
cnauroth
|
d3268c4b10
|
HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma.
|
2015-01-22 16:26:21 -08:00 |
|
Arpit Agarwal
|
d34074e237
|
HDFS-7575. Upgrade should generate a unique storage ID for each volume. (Contributed by Arpit Agarwal)
|
2015-01-22 14:08:20 -08:00 |
|
Colin Patrick Mccabe
|
6e62a1a672
|
HDFS-7430. Refactor the BlockScanner to use O(1) memory and use multiple threads (cmccabe)
|
2015-01-21 19:00:53 -08:00 |
|
Konstantin V Shvachko
|
a0521bc83a
|
HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai.
|
2015-01-21 16:00:49 -08:00 |
|
Kihwal Lee
|
c0af72c7f7
|
HDFS-7548. Corrupt block reporting delayed until datablock scanner thread detects it. Contributed by Rushabh Shah.
|
2015-01-21 14:41:31 -06:00 |
|
Tsz-Wo Nicholas Sze
|
db334bb862
|
HDFS-3443. Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer. Contributed by Vinayakumar B
|
2015-01-21 11:33:55 -08:00 |
|
Colin Patrick Mccabe
|
a17584936c
|
HDFS-7610. Fix removal of dynamically added DN volumes (Lei (Eddy) Xu via Colin P. McCabe)
|
2015-01-20 20:11:09 -08:00 |
|
Colin Patrick Mccabe
|
b7f4a3156c
|
HDFS-7496. Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances (lei via cmccabe)
|
2015-01-20 19:05:33 -08:00 |
|
Arpit Agarwal
|
c09c65b212
|
HDFS-7634. Disallow truncation of Lazy persist files. (Contributed by Yi Liu)
|
2015-01-20 12:11:36 -08:00 |
|
yliu
|
5a6c084f07
|
HDFS-7638: Small fix and few refinements for FSN#truncate. (yliu)
|
2015-01-20 00:45:12 +08:00 |
|
Tsz-Wo Nicholas Sze
|
4a4450836c
|
HDFS-5631. Change BlockMetadataHeader.readHeader(..), ChunkChecksum class and constructor to public; and fix FsDatasetSpi to use generic type instead of FsVolumeImpl. Contributed by David Powell and Joe Pallas
|
2015-01-19 13:49:19 -08:00 |
|
Jing Zhao
|
e843a0a8ce
|
HDFS-7637. Fix the check condition for reserved path. Contributed by Yi Liu.
|
2015-01-19 10:28:29 -08:00 |
|
Haohui Mai
|
24315e7d37
|
HDFS-7573. Consolidate the implementation of delete() into a single class. Contributed by Haohui Mai.
|
2015-01-17 12:56:04 -08:00 |
|
Konstantin V Shvachko
|
60cbcff2f7
|
HDFS-7606. Fix potential NPE in INodeFile.getBlocks(). Contributed by Byron Wong.
|
2015-01-16 14:31:18 -08:00 |
|
yliu
|
c4ccbe62c0
|
HDFS-7189. Add trace spans for DFSClient metadata operations. (Colin P. McCabe via yliu)
|
2015-01-16 00:23:51 +08:00 |
|
Kihwal Lee
|
780a6bf145
|
HDFS-7457. DatanodeID generates excessive garbage. Contributed by Daryn Sharp.
|
2015-01-15 16:44:11 -06:00 |
|
Kihwal Lee
|
44eed6cbc9
|
HDFS-7615. Remove longReadLock. Contributed by Kihwal Lee.
|
2015-01-15 16:39:18 -06:00 |
|
Tsz-Wo Nicholas Sze
|
6464a8929a
|
HDFS-5782. Change BlockListAsLongs constructor to take Replica as parameter type instead of concrete classes Block and ReplicaInfo. Contributed by David Powell and Joe Pallas
|
2015-01-14 13:46:06 -08:00 |
|
Tsz-Wo Nicholas Sze
|
7fe0f25ad2
|
HDFS-2219. Change fsck to support fully qualified paths so that a particular namenode in a federated cluster with multiple namenodes can be specified in the path parameter.
|
2015-01-14 11:31:18 -08:00 |
|
cnauroth
|
85aec75ce5
|
HDFS-7570. SecondaryNameNode need twice memory when calling reloadFromImageFile. Contributed by zhaoyunjiong.
|
2015-01-13 16:10:28 -08:00 |
|
Konstantin V Shvachko
|
08ac06283a
|
HDFS-7056. Snapshot support for truncate. Contributed by Konstantin Shvachko and Plamen Jeliazkov.
|
2015-01-13 00:24:23 -08:00 |
|
Plamen Jeliazkov
|
7e9358feb3
|
HDFS-3107. Introduce truncate. Contributed by Plamen Jeliazkov.
|
2015-01-12 22:50:04 -08:00 |
|
Jing Zhao
|
6f3a63a41b
|
HDFS-7600. Refine hdfs admin classes to reuse common code. Contributed by Jing Zhao.
|
2015-01-12 17:32:33 -08:00 |
|
Colin Patrick Mccabe
|
f761bd8fe4
|
HDFS-5445. PacketReceiver populates the packetLen field in PacketHeader incorrectly (Jonathan Mace via Colin P. McCabe)
|
2015-01-12 17:11:03 -08:00 |
|
Kihwal Lee
|
6bbf9fdd04
|
HDFS-7533. Datanode sometimes does not shutdown on receiving upgrade shutdown command. Contributed by Eric Payne.
|
2015-01-12 15:36:55 -06:00 |
|
yliu
|
5b0d060d2a
|
HDFS-7323. Move the get/setStoragePolicy commands out from dfsadmin. (jing9 via yliu)
|
2015-01-12 00:35:43 +08:00 |
|
cnauroth
|
ef3c3a832c
|
HDFS-7596. NameNode should prune dead storages from storageMap. Contributed by Arpit Agarwal.
|
2015-01-10 09:18:33 -08:00 |
|
Jing Zhao
|
2a06101e61
|
HDFS-7182. JMX metrics aren't accessible when NN is busy. Contributed by Ming Ma.
|
2015-01-09 17:35:57 -08:00 |
|
Colin Patrick Mccabe
|
ae91b13a4b
|
HADOOP-11470. Remove some uses of obsolete guava APIs from the hadoop codebase (Sangjin Lee via Colin P. McCabe)
|
2015-01-08 16:09:44 -08:00 |
|
cnauroth
|
7e2d9a3242
|
HDFS-7579. Improve log reporting during block report rpc failure. Contributed by Charles Lamb.
|
2015-01-08 15:12:56 -08:00 |
|
Tsuyoshi Ozawa
|
a6ed4894b5
|
HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)
|
2015-01-08 14:51:57 +09:00 |
|
Tsuyoshi Ozawa
|
9886396400
|
Revert "Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)" because of missing JIRA's number.
This reverts commit 2eba7eb9af .
|
2015-01-08 14:35:08 +09:00 |
|
Tsuyoshi Ozawa
|
2eba7eb9af
|
Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa)
|
2015-01-08 14:21:30 +09:00 |
|
Vinayakumar B
|
4cd66f7fb2
|
HDFS-7583. Fix findbug in TransferFsImage.java (Contributed by Vinayakumar B)
|
2015-01-06 09:31:35 +05:30 |
|
Jing Zhao
|
5caebbae8c
|
HDFS-7484. Make FSDirectory#addINode take existing INodes as its parameter. Contributed by Jing Zhao.
|
2014-12-22 23:19:20 -08:00 |
|
Vinayakumar B
|
50ae1a6664
|
HDFS-7456. De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode (Contributed by Vinayakumar B)
|
2014-12-23 12:35:53 +05:30 |
|
cnauroth
|
2cf90a2c33
|
HDFS-7560. ACLs removed by removeDefaultAcl() will be back after NameNode restart/failover. Contributed by Vinayakumar B.
|
2014-12-22 13:59:10 -08:00 |
|
yliu
|
7bc0a6d5c2
|
HDFS-7557. Fix spacing for a few keys in DFSConfigKeys.java (Colin P. McCabe)
|
2014-12-22 00:49:13 +08:00 |
|