Kihwal Lee
|
b6ceee9bf4
|
HDFS-8865. Improve quota initialization performance. Contributed by Kihwal Lee.
|
2015-08-28 13:14:35 -05:00 |
|
yliu
|
e166c038c0
|
HDFS-8963. Fix incorrect sign extension of xattr length in HDFS-8900. (Colin Patrick McCabe via yliu)
|
2015-08-28 10:54:55 +08:00 |
|
Haohui Mai
|
035ed26147
|
Revert "HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu."
This reverts commit 4e9307f26d .
|
2015-08-27 16:09:35 -07:00 |
|
Haohui Mai
|
4e9307f26d
|
HDFS-8938. Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager. Contributed by Mingliang Liu.
|
2015-08-27 15:36:44 -07:00 |
|
Haohui Mai
|
f97a0f8c2c
|
HDFS-8969. Clean up findbugs warnings for HDFS-8823 and HDFS-8932. Contributed by Anu Engineer.
|
2015-08-27 13:03:16 -07:00 |
|
Haohui Mai
|
7e971b7315
|
HDFS-8962. Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf. Contributed by Mingliang Liu.
|
2015-08-27 09:02:34 -07:00 |
|
Harsh J
|
0bf285413f
|
HDFS-2390. dfsadmin -setBalancerBandwidth does not validate -ve value. Contributed by Gautam Gopalakrishnan.
|
2015-08-27 16:22:48 +05:30 |
|
Vinayakumar B
|
fdb56f74f3
|
HDFS-8682. Should not remove decommissioned node,while calculating the number of live/dead decommissioned node. (Contributed by J. Andreina)
|
2015-08-27 13:06:43 +05:30 |
|
Haohui Mai
|
4cbbfa2220
|
HDFS-8248. Store INodeId instead of the INodeFile object in BlockInfoContiguous. Contributed by Haohui Mai.
|
2015-08-26 18:14:29 -07:00 |
|
Haohui Mai
|
c992bcf9c1
|
HDFS-8951. Move the shortcircuit package to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-26 14:02:48 -07:00 |
|
yliu
|
eee0d4563c
|
HDFS-8900. Compact XAttrs to optimize memory footprint. (yliu)
|
2015-08-25 16:16:09 +08:00 |
|
Xiaoyu Yao
|
3b00eaea25
|
HDFS-8932. NPE thrown in NameNode when try to get TotalSyncCount metric before editLogStream initialization. Contributed by Surendra Singh Lilhore
|
2015-08-24 16:56:24 -07:00 |
|
Jing Zhao
|
bdd79388f3
|
HDFS-8928. Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array. Contributed by Jing Zhao.
|
2015-08-24 15:53:34 -07:00 |
|
Colin Patrick Mccabe
|
b5ce87f84d
|
HDFS-8930. Block report lease may leak if the 2nd full block report comes when NN is still in safemode (Colin P. McCabe via Jing Zhao)
|
2015-08-24 11:31:56 -07:00 |
|
Haohui Mai
|
490bb5ebd6
|
HDFS-8934. Move ShortCircuitShm to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-22 13:31:03 -07:00 |
|
Haohui Mai
|
745d04be59
|
HDFS-8823. Move replication factor into individual blocks. Contributed by Haohui Mai.
|
2015-08-22 00:09:40 -07:00 |
|
Lei Xu
|
7087e700e0
|
HDFS-8924. Add pluggable interface for reading replicas in DFSClient. (Colin Patrick McCabe via Lei Xu)
|
2015-08-21 17:02:00 -07:00 |
|
Jing Zhao
|
c8bca62718
|
HDFS-8809. HDFS fsck reports under construction blocks as CORRUPT. Contributed by Jing Zhao.
|
2015-08-20 16:31:24 -07:00 |
|
yliu
|
5e8fe89437
|
HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu)
|
2015-08-20 20:15:03 +08:00 |
|
yliu
|
80a29906bc
|
HDFS-8884. Fail-fast check in BlockPlacementPolicyDefault#chooseTarget. (yliu)
|
2015-08-20 20:07:18 +08:00 |
|
Jing Zhao
|
4e14f7982a
|
HDFS-8917. Cleanup BlockInfoUnderConstruction from comments and tests. Contributed by Zhe Zhang.
|
2015-08-19 15:11:37 -07:00 |
|
Haohui Mai
|
3aac4758b0
|
HDFS-8803. Move DfsClientConf to hdfs-client. Contributed by Mingliang Liu.
|
2015-08-19 11:28:05 -07:00 |
|
Jing Zhao
|
f61120d964
|
HDFS-8867. Enable optimized block reports. Contributed by Daryn Sharp.
|
2015-08-19 10:36:56 -07:00 |
|
Arpit Agarwal
|
9c3571ea60
|
HDFS-8911. NameNode Metric : Add Editlog counters as a JMX metric. (Contributed by Anu Engineer)
|
2015-08-19 09:42:35 -07:00 |
|
Tsz-Wo Nicholas Sze
|
7ecbfd44aa
|
HDFS-8826. In Balancer, add an option to specify the source node list so that balancer only selects blocks to move from those nodes.
|
2015-08-18 19:25:50 -07:00 |
|
Chris Douglas
|
30e342a5d3
|
HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan
|
2015-08-18 17:32:48 -07:00 |
|
yliu
|
71566e2382
|
HDFS-8862. BlockManager#excessReplicateMap should use a HashMap. (yliu)
|
2015-08-18 09:23:06 +08:00 |
|
Tsz-Wo Nicholas Sze
|
51a00964da
|
HDFS-8278. When computing max-size-to-move in Balancer, count only the storage with remaining >= default block size.
|
2015-08-17 17:55:25 -07:00 |
|
Andrew Wang
|
eee4d716b4
|
HDFS-8895. Remove deprecated BlockStorageLocation APIs.
|
2015-08-17 17:40:37 -07:00 |
|
Arpit Agarwal
|
a88f31ebf3
|
HDFS-8880. NameNode metrics logging. (Arpit Agarwal)
|
2015-08-17 16:55:46 -07:00 |
|
Colin Patrick Mccabe
|
ec183faadc
|
HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe)
|
2015-08-17 15:25:29 -07:00 |
|
Colin Patrick Mccabe
|
c77bd6af16
|
HDFS-8792. BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory (Yi Liu via Colin P. McCabe)
|
2015-08-17 12:00:45 -07:00 |
|
Haohui Mai
|
e535e0f05b
|
HDFS-8801. Convert BlockInfoUnderConstruction as a feature. Contributed by Jing Zhao.
|
2015-08-17 11:28:28 -07:00 |
|
Haohui Mai
|
456e901a4c
|
HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai.
|
2015-08-17 11:04:00 -07:00 |
|
Andrew Wang
|
2e7b7e2cda
|
HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging.
|
2015-08-17 10:17:06 -07:00 |
|
Xiaoyu Yao
|
a7862d5fe4
|
HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer.
|
2015-08-17 10:15:56 -07:00 |
|
Jing Zhao
|
dc7a061668
|
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
|
2015-08-14 14:42:43 -07:00 |
|
Tsz-Wo Nicholas Sze
|
2bc0a4f299
|
HDFS-8824. Do not use small blocks for balancing the cluster.
|
2015-08-14 13:03:19 -07:00 |
|
Xiaoyu Yao
|
1569228ec9
|
HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao)
|
2015-08-14 12:34:31 -07:00 |
|
Akira Ajisaka
|
40f815131e
|
HDFS-8622. Implement GETCONTENTSUMMARY operation for WebImageViewer. Contributed by Jagadesh Kiran N.
|
2015-08-13 11:31:56 +09:00 |
|
Xiaoyu Yao
|
3e715a4f4c
|
HDFS-8879. Quota by storage type usage incorrectly initialized upon namenode restart. Contributed by Xiaoyu Yao.
|
2015-08-12 15:20:54 -07:00 |
|
Andrew Wang
|
1ea1a8334e
|
HDFS-8887. Expose storage type and storage ID in BlockLocation.
|
2015-08-11 23:25:33 -07:00 |
|
Jing Zhao
|
1fc3c779a4
|
HDFS-8805. Archival Storage: getStoragePolicy should not need superuser privilege. Contributed by Brahma Reddy Battula.
|
2015-08-11 10:28:18 -07:00 |
|
Tsz-Wo Nicholas Sze
|
b56daff6a1
|
HDFS-8818. Changes the global moveExecutor to per datanode executors and changes MAX_SIZE_TO_MOVE to be configurable.
|
2015-08-10 16:52:02 -07:00 |
|
Arpit Agarwal
|
6d4eee718a
|
HDFS-8856. Make LeaseManager#countPath O(1). (Contributed by Arpit Agarwal)
|
2015-08-06 18:51:28 -07:00 |
|
Jing Zhao
|
f4c523b69b
|
Revert "HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang."
This reverts commit c17439c2dd .
|
2015-08-06 10:21:55 -07:00 |
|
Jing Zhao
|
663eba0ab1
|
Revert "HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang."
This reverts commit de480d6c89 .
|
2015-08-06 10:21:54 -07:00 |
|
Vinayakumar B
|
cc71ad80e1
|
HDFS-8815. DFS getStoragePolicy implementation using single RPC call (Contributed by Surendra Singh Lilhore)
|
2015-08-06 11:10:48 +05:30 |
|
yliu
|
9a08999906
|
HDFS-8850. VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks. (Colin Patrick McCabe via yliu)
|
2015-08-04 15:54:23 +08:00 |
|
Xiaoyu Yao
|
d311a38a6b
|
HDFS-6860. BlockStateChange logs are too noisy. Contributed by Chang Li and Xiaoyu Yao.
|
2015-07-31 16:15:50 -07:00 |
|
Colin Patrick Mccabe
|
21d10ccc6e
|
HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)
|
2015-07-31 15:01:34 -07:00 |
|
Allen Wittenauer
|
666cafca8d
|
HADOOP-12249. pull argument parsing into a function (aw)
|
2015-07-31 14:32:21 -07:00 |
|
Harsh J
|
c5caa25b8f
|
HDFS-8821. Explain message "Operation category X is not supported in state standby". Contributed by Gautam Gopalakrishnan.
|
2015-07-31 08:58:22 +05:30 |
|
Arpit Agarwal
|
88d8736dde
|
HDFS-7192. DN should ignore lazyPersist hint if the writer is not local. (Contributed by Arpit Agarwal)
|
2015-07-30 13:16:46 -07:00 |
|
Haohui Mai
|
ddc867ceb9
|
HDFS-8816. Improve visualization for the Datanode tab in the NN UI. Contributed by Haohui Mai.
|
2015-07-29 17:14:05 -07:00 |
|
Vinayakumar B
|
6374ee0db4
|
HDFS-8670. Better to exclude decommissioned nodes for namenode NodeUsage JMX (Contributed by J.Andreina)
|
2015-07-29 14:47:19 +05:30 |
|
Akira Ajisaka
|
2a1d656196
|
Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)"
This reverts commit 02c01815ec .
|
2015-07-29 16:48:30 +09:00 |
|
Vinayakumar B
|
50887e5b07
|
HDFS-8811. Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java (Contributed by Vinayakumar B)
|
2015-07-29 11:45:33 +05:30 |
|
Jakob Homan
|
0712a8103f
|
HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak.
|
2015-07-28 21:03:31 -07:00 |
|
Arun Suresh
|
030fcfa99c
|
HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh)
|
2015-07-27 23:02:03 -07:00 |
|
Akira Ajisaka
|
206d4933a5
|
HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. Contributed by Zhe Zhang.
|
2015-07-24 18:28:44 +09:00 |
|
Akira Ajisaka
|
02c01815ec
|
HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)
|
2015-07-24 11:37:23 +09:00 |
|
Arpit Agarwal
|
adfa34ff99
|
HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula)
|
2015-07-23 10:13:04 -07:00 |
|
yliu
|
4025326288
|
HDFS-8795. Improve InvalidateBlocks#node2blocks. (yliu)
|
2015-07-22 15:16:50 +08:00 |
|
Haohui Mai
|
31f117138a
|
HDFS-8495. Consolidate append() related implementation into a single class. Contributed by Rakesh R.
|
2015-07-21 17:25:23 -07:00 |
|
cnauroth
|
cb03768b1b
|
HDFS-8721. Add a metric for number of encryption zones. Contributed by Rakesh R.
|
2015-07-21 13:55:58 -07:00 |
|
Ravi Prakash
|
5137b388fc
|
Revert "HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak)"
This reverts commit e4f756260f .
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
|
2015-07-21 11:29:35 -07:00 |
|
Allen Wittenauer
|
c9507fe6c1
|
HDFS-8800. hdfs --daemon stop namenode corrupts logs (John Smith via aw)
|
2015-07-21 09:41:28 -07:00 |
|
Vinayakumar B
|
29cf887b22
|
HDFS-7582. Enforce maximum number of ACL entries separately per access and default. (Contributed by Vinayakumar B)
|
2015-07-21 15:16:52 +05:30 |
|
Haohui Mai
|
df1e8ce44a
|
HDFS-7483. Display information per tier on the Namenode UI. Contributed by Benoy Antony and Haohui Mai.
|
2015-07-20 20:13:12 -07:00 |
|
yliu
|
d6d58606b8
|
HDFS-8794. Improve CorruptReplicasMap#corruptReplicasMap. (yliu)
|
2015-07-21 09:20:22 +08:00 |
|
Ravi Prakash
|
e4f756260f
|
HDFS-8344. NameNode doesn't recover lease for files with missing blocks (raviprak)
|
2015-07-20 14:03:34 -07:00 |
|
Allen Wittenauer
|
ee36f4f9b8
|
HADOOP-10979. Auto-entries in hadoop_usage (aw)
|
2015-07-16 16:58:11 -07:00 |
|
Ming Ma
|
fbd88f1062
|
HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient. (mingma)
|
2015-07-16 12:33:57 -07:00 |
|
Akira Ajisaka
|
979c9ca2ca
|
HDFS-8742. Inotify: Support event for OP_TRUNCATE. Contributed by Surendra Singh Lilhore.
|
2015-07-15 04:42:08 +09:00 |
|
Kihwal Lee
|
59388a8015
|
HDFS-8722. Optimize datanode writes for small writes and flushes. Contributed by Kihwal Lee
|
2015-07-14 14:04:06 -05:00 |
|
Colin Patrick Mccabe
|
1d74ccecec
|
HDFS-7608: hdfs dfsclient newConnectedPeer has no write timeout (Xiaoyu Yao via Colin P. McCabe)
|
2015-07-14 10:57:59 -07:00 |
|
Tsz-Wo Nicholas Sze
|
9ef03a4c5b
|
HDFS-8541. Mover should exit with NO_MOVE_PROGRESS if there is no move progress. Contributed by Surendra Singh Lilhore
|
2015-07-13 15:12:26 -07:00 |
|
Jing Zhao
|
47f4c54106
|
HDFS-8751. Remove setBlocks API from INodeFile and misc code cleanup. Contributed by Zhe Zhang
|
2015-07-10 14:15:22 -07:00 |
|
Vinayakumar B
|
b48908033f
|
HDFS-2956. calling fetchdt without a --renewer argument throws NPE (Contributed by Vinayakumar B)HDFS-2956. calling fetchdt without a --renewer argument throws NPE (Contributed by Vinayakumar B)
|
2015-07-10 15:47:04 +05:30 |
|
Akira Ajisaka
|
d66302ed9b
|
HDFS-8749. Fix findbugs warnings in BlockManager.java. Contributed by Brahma Reddy Battula.
|
2015-07-10 15:04:06 +09:00 |
|
Haohui Mai
|
fc6182d5ed
|
HDFS-8726. Move protobuf files that define the client-sever protocols to hdfs-client. Contributed by Haohui Mai.
|
2015-07-08 10:37:10 -07:00 |
|
Vinayakumar B
|
bd4e10900c
|
HDFS-8712. Remove 'public' and 'abstract' modifiers in FsVolumeSpi and FsDatasetSpi (Contributed by Lei (Eddy) Xu)
|
2015-07-08 16:34:54 +05:30 |
|
Xiaoyu Yao
|
b68701b7b2
|
HDFS-8711. setSpaceQuota command should print the available storage type when input storage type is wrong. Contributed by Brahma Reddy Battula.
|
2015-07-07 13:50:49 -07:00 |
|
Jing Zhao
|
bc99aaffe7
|
Revert "HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao."
This reverts commit d62b63d297 .
|
2015-07-07 10:13:41 -07:00 |
|
Jing Zhao
|
d62b63d297
|
HDFS-8652. Track BlockInfo instead of Block in CorruptReplicasMap. Contributed by Jing Zhao.
|
2015-07-06 15:54:25 -07:00 |
|
Vinayakumar B
|
2eae130ab9
|
HDFS-8577. Avoid retrying to recover lease on a file which does not exist (Contributed by J.Andreina)
|
2015-07-03 13:35:48 +05:30 |
|
Andrew Wang
|
5fddc5177d
|
HDFS-8709. Clarify automatic sync in FSEditLog#logEdit.
|
2015-07-02 10:26:40 -07:00 |
|
Vinayakumar B
|
bff5999d07
|
HDFS-8703. Merge refactor of DFSInputStream from ErasureCoding branch (Contributed by Vinayakumar B)
|
2015-07-02 16:11:50 +05:30 |
|
Colin Patrick Mccabe
|
29df73dc05
|
HDFS-8635. Migrate HDFS native build to new CMake framework (Alan Burlison via Colin P. McCabe)
|
2015-06-30 15:54:38 -07:00 |
|
Vinayakumar B
|
7ba5bbac02
|
HDFS-8627. NPE thrown if unable to fetch token from Namenode (Contributed by J.Andreina)
|
2015-06-30 15:42:59 +05:30 |
|
Vinayakumar B
|
77588e1d32
|
HDFS-8579. Update HDFS usage with missing options (Contributed by J.Andreina)
|
2015-06-30 15:00:22 +05:30 |
|
Haohui Mai
|
d3797f9f3c
|
HDFS-8493. Consolidate truncate() related implementation in a single class. Contributed by Rakesh R.
|
2015-06-29 16:45:35 -07:00 |
|
Arpit Agarwal
|
8e333720e1
|
HDFS-8687. Remove the duplicate usage message from Dfsck.java. (Contributed by Brahma Reddy Battula)
|
2015-06-29 14:56:42 -07:00 |
|
Yongjun Zhang
|
43a1288fff
|
HDFS-8659. Block scanner INFO message is spamming logs. Contributed by Yongjun Zhang.
|
2015-06-29 14:43:56 -07:00 |
|
Andrew Wang
|
2ffd84273a
|
HDFS-8653. Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo. Contributed by Zhe Zhang.
|
2015-06-29 12:12:41 -07:00 |
|
Benoy Antony
|
d3fed8e653
|
HDFS-7390. Provide JMX metrics per storage type. (Benoy Antony)
|
2015-06-29 11:00:22 -07:00 |
|
Vinayakumar B
|
88ceb382ef
|
HDFS-8586. Dead Datanode is allocated for write when client is from deadnode (Contributed by Brahma Reddy Battula)
|
2015-06-29 15:25:03 +05:30 |
|
Arpit Agarwal
|
c6793dd8cc
|
HDFS-8681. BlockScanner is incorrectly disabled by default. (Contributed by Arpit Agarwal)
|
2015-06-28 14:51:36 -07:00 |
|
Andrew Wang
|
60b858bfa6
|
HDFS-8656. Preserve compatibility of ClientProtocol#rollingUpgrade after finalization.
|
2015-06-26 11:30:59 -07:00 |
|