big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,011 Commits 2 Branches 2 Tags 264 MiB
46b6d23e8f
Commit Graph

2252 Commits

Author SHA1 Message Date
Akira Ajisaka
46b6d23e8f HDFS-7684. The host:port settings of the deamons should be trimmed before use. Contributed by Anu Engineer. 2015-02-12 17:40:30 -08:00
Colin Patrick Mccabe
6b39ad0865 HDFS-7694. FSDataInputStream should support "unbuffer" (cmccabe) 2015-02-12 10:40:46 -08:00
Kihwal Lee
38262779bb HDFS-7704. DN heartbeat to Active NN may be blocked and expire if connection to Standby NN continues to time out. Contributed by Rushabh Shah. 2015-02-12 09:15:30 -06:00
Vinayakumar B
89a5449280 HDFS-7703. Support favouredNodes for the append for new blocks ( Contributed by Vinayakumar B) 2015-02-12 12:38:44 +05:30
Tsz-Wo Nicholas Sze
085b1e293f HDFS-6133. Add a feature for replica pinning so that a pinned replica will not be moved by Balancer/Mover. Contributed by zhaoyunjiong 2015-02-11 15:12:12 -08:00
Arpit Agarwal
5dae97a584 HDFS-7723. Quota By Storage Type namenode implemenation. (Contributed by Xiaoyu Yao) 2015-02-11 10:41:50 -08:00
Allen Wittenauer
b94c1117a2 HDFS-316. Balancer should run for a configurable # of iterations (Xiaoyu Yao via aw) 2015-02-11 08:10:34 -08:00
Tsz-Wo Nicholas Sze
7c6b6547ee HDFS-7769. TestHDFSCLI should not create files in hdfs project root dir. 2015-02-10 17:48:57 -08:00
Konstantin V Shvachko
b73956fdad HDFS-7058. Tests for truncate CLI. Contributed by Dasha Boudnik. 2015-02-09 21:26:59 -08:00
Colin Patrick Mccabe
02340a24f2 HDFS-7718. Store KeyProvider in ClientContext to avoid leaking key provider threads when using FileContext (Arun Suresh via Colin P. McCabe) 2015-02-09 20:23:23 -08:00
Colin Patrick Mccabe
a9dc5cd706 HDFS-7744. Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called (cmccabe) 2015-02-09 20:16:41 -08:00
yliu
260b5e32c4 HDFS-7756. Restore method signature for LocatedBlock#getLocations(). (Ted Yu via yliu) 2015-02-10 01:57:51 +08:00
yliu
1b56d1ce32 HADOOP-11510. Expose truncate API via FileContext. (yliu) 2015-02-10 01:45:29 +08:00
Allen Wittenauer
30b797ee9d HADOOP-8934. Shell command ls should include sort options (Jonathan Allen via aw) 2015-02-09 12:50:44 -08:00
Arpit Agarwal
ab934e8594 HDFS-7647. DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs. (Contributed by Milan Desai) 2015-02-09 12:17:40 -08:00
Jing Zhao
1382ae525c HDFS-7743. Code cleanup of BlockInfo and rename BlockInfo to BlockInfoContiguous. Contributed by Jing Zhao. 2015-02-08 11:51:44 -08:00
Tsz-Wo Nicholas Sze
350b520c64 HDFS-7751. Fix TestHDFSCLI for quota with storage type. Contributed by Xiaoyu Yao 2015-02-07 15:40:47 -08:00
Tsz-Wo Nicholas Sze
8f7d4bb09f HDFS-7738. Revise the exception message for recover lease; add more truncate tests such as truncate with HA setup, negative tests, truncate with other operations and multiple truncates. 2015-02-07 15:21:16 -08:00
Arpit Agarwal
8de80ff712 HDFS-7720. Quota by Storage Type API, tools and ClientNameNode Protocol changes. (Contributed by Xiaoyu Yao) 2015-02-06 17:01:19 -08:00
yliu
03f7ed382b HDFS-7655. Expose truncate API for Web HDFS. (yliu) 2015-02-05 23:45:06 +08:00
Haohui Mai
c4980a2f34 HDFS-7270. Add congestion signaling capability to DataNode write protocol. Contributed by Haohui Mai. 2015-02-05 10:58:58 -08:00
Allen Wittenauer
fb06c00837 HADOOP-7713. dfs -count -q should label output column (Jonathan Allen via aw) 2015-02-05 07:44:49 -08:00
Colin Patrick Mccabe
40a415799b HDFS-7719. BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes. (Lei (Eddy) Xu via Colin P. McCabe) 2015-02-04 12:10:00 -08:00
Andrew Wang
3ae38ec7df HDFS-7712. Switch blockStateChangeLog to use slf4j. 2015-02-03 15:01:16 -08:00
Kihwal Lee
843806d03a HDFS-7707. Edit log corruption due to delayed block removal again. Contributed by Yongjun Zhang 2015-02-03 14:45:15 -06:00
Colin Patrick Mccabe
115428176e HDFS-7721. The HDFS BlockScanner may run fast during the first hour (cmccabe) 2015-02-03 11:05:31 -08:00
Haohui Mai
8cb473124c HDFS-6651. Deletion failure can leak inodes permanently. Contributed by Jing Zhao. 2015-02-02 16:32:38 -08:00
Colin Patrick Mccabe
09ad9a868a HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe) 2015-01-30 16:01:59 -08:00
Andrew Wang
951b3608a8 HDFS-7706. Switch BlockManager logging to use slf4j. 2015-01-30 11:33:03 -08:00
Tsz-Wo Nicholas Sze
5a0051f4da HDFS-7681. Change ReplicaInputStreams constructor to take InputStream(s) instead of FileDescriptor(s). Contributed by Joe Pallas 2015-01-28 16:00:47 -08:00
Jing Zhao
d244574d03 HDFS-7611. deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart. Contributed by Jing Zhao and Byron Wong. 2015-01-28 15:25:03 -08:00
Andrew Wang
caf7298e49 HDFS-6673. Add delimited format support to PB OIV tool. Contributed by Eddy Xu. 2015-01-28 12:36:29 -08:00
yliu
9ca565e970 HDFS-7677. DistributedFileSystem#truncate should resolve symlinks. (yliu) 2015-01-27 23:50:11 +08:00
Jing Zhao
2848db814a HDFS-3689. Add support for variable length block. Contributed by Jing Zhao. 2015-01-27 12:58:10 -08:00
Steve Loughran
0da53a37ec HDFS-49. MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found. (stevel) 2015-01-27 11:11:00 +00:00
Kihwal Lee
2b0fa20f69 HDFS-7224. Allow reuse of NN connections via webhdfs. Contributed by Eric Payne 2015-01-26 08:14:30 -06:00
Konstantin V Shvachko
370396509d HDFS-7676. Fix TestFileTruncate to avoid bug of HDFS-7611. Contributed by Konstantin Shvachko. 2015-01-24 18:03:11 -08:00
yliu
e9fd46ddbf HDFS-7659. truncate should check negative value of the new length. Contributed by Yi Liu. 2015-01-24 15:44:07 -08:00
cnauroth
d3268c4b10 HDFS-3519. Checkpoint upload may interfere with a concurrent saveNamespace. Contributed by Ming Ma. 2015-01-22 16:26:21 -08:00
Arpit Agarwal
d34074e237 HDFS-7575. Upgrade should generate a unique storage ID for each volume. (Contributed by Arpit Agarwal) 2015-01-22 14:08:20 -08:00
Colin Patrick Mccabe
6e62a1a672 HDFS-7430. Refactor the BlockScanner to use O(1) memory and use multiple threads (cmccabe) 2015-01-21 19:00:53 -08:00
Konstantin V Shvachko
a0521bc83a HADOOP-11490. Expose truncate API via FileSystem and shell command. Contributed by Milan Desai. 2015-01-21 16:00:49 -08:00
Kihwal Lee
c0af72c7f7 HDFS-7548. Corrupt block reporting delayed until datablock scanner thread detects it. Contributed by Rushabh Shah. 2015-01-21 14:41:31 -06:00
Arpit Agarwal
6b17eb9eac HDFS-7643. Test case to ensure lazy persist files cannot be truncated. (Contributed by Yi Liu) 2015-01-20 21:58:38 -08:00
Colin Patrick Mccabe
a17584936c HDFS-7610. Fix removal of dynamically added DN volumes (Lei (Eddy) Xu via Colin P. McCabe) 2015-01-20 20:11:09 -08:00
Colin Patrick Mccabe
b7f4a3156c HDFS-7496. Fix FsVolume removal race conditions on the DataNode by reference-counting the volume instances (lei via cmccabe) 2015-01-20 19:05:33 -08:00
Tsz-Wo Nicholas Sze
4a4450836c HDFS-5631. Change BlockMetadataHeader.readHeader(..), ChunkChecksum class and constructor to public; and fix FsDatasetSpi to use generic type instead of FsVolumeImpl. Contributed by David Powell and Joe Pallas 2015-01-19 13:49:19 -08:00
cnauroth
ec4389cf72 HDFS-7632. MiniDFSCluster configures DataNode data directories incorrectly if using more than 1 DataNode and more than 2 storage locations per DataNode. Contributed by Chris Nauroth. 2015-01-16 10:52:01 -08:00
yliu
c4ccbe62c0 HDFS-7189. Add trace spans for DFSClient metadata operations. (Colin P. McCabe via yliu) 2015-01-16 00:23:51 +08:00
Tsz-Wo Nicholas Sze
6464a8929a HDFS-5782. Change BlockListAsLongs constructor to take Replica as parameter type instead of concrete classes Block and ReplicaInfo. Contributed by David Powell and Joe Pallas 2015-01-14 13:46:06 -08:00