Kihwal Lee
|
57369a678c
|
HDFS-10343. BlockManager#createLocatedBlocks may return blocks on failed storages. Contributed by Kuhu Shukla.
|
2016-08-04 14:55:21 -05:00 |
|
Tsz-Wo Nicholas Sze
|
8c9b44eaff
|
In Balancer, the target task should be removed when its size < 0. Contributed by Yiqun Lin
|
2016-08-04 09:45:40 -07:00 |
|
Kihwal Lee
|
6ae39199da
|
HDFS-10662. Optimize UTF8 string/byte conversions. Contributed by Daryn Sharp.
|
2016-08-04 09:07:34 -05:00 |
|
Kihwal Lee
|
6f63566694
|
HDFS-10569. A bug causes OutOfIndex error in BlockListAsLongs. Contributed by Weiwei Yang.
|
2016-08-03 15:20:20 -05:00 |
|
Jing Zhao
|
f4ba5ff1d7
|
HDFS-10710. In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved within the NN lock protection.Contributed by GAO Rui.
|
2016-08-03 12:42:05 -07:00 |
|
Kihwal Lee
|
22ef5286bc
|
HDFS-10674. Optimize creating a full path from an inode. Contributed by Daryn Sharp.
|
2016-08-03 13:12:43 -05:00 |
|
Kihwal Lee
|
58db263e93
|
HDFS-742. A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list. Contributed by Mit Desai.
|
2016-08-03 12:14:59 -05:00 |
|
Kihwal Lee
|
bebf10d245
|
HDFS-10656. Optimize conversion of byte arrays back to path string. Contributed by Daryn Sharp.
|
2016-08-03 11:53:41 -05:00 |
|
Akira Ajisaka
|
a5fb298e56
|
HDFS-10707. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon.
|
2016-08-02 17:07:59 +09:00 |
|
Konstantin V Shvachko
|
c4463f2ef2
|
Revert "HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi."
This reverts commit 85a20508bd.
|
2016-08-01 22:34:40 -07:00 |
|
Daryn Sharp
|
9f473cf903
|
HDFS-10655. Fix path related byte array conversion bugs. (daryn)
|
2016-08-01 10:14:28 -05:00 |
|
Yongjun Zhang
|
8d32bd884d
|
HDFS-10703. HA NameNode Web UI should show last checkpoint time. (John Zhuge via Yongjun Zhang)
|
2016-07-29 23:20:14 -07:00 |
|
Akira Ajisaka
|
204a2055b1
|
HDFS-10691. FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException. Contributed by Yiqun Lin.
|
2016-07-29 15:39:48 +09:00 |
|
Xiaoyu Yao
|
ce3d68e9c3
|
HDFS-10676. Add namenode metric to measure time spent in generating EDEKs. Contributed by Hanisha Koneru.
|
2016-07-28 16:07:45 -07:00 |
|
Lei Xu
|
67406460f0
|
HDFS-4176. EditLogTailer should call rollEdits with a timeout. (Lei Xu)
|
2016-07-28 13:32:00 -07:00 |
|
Akira Ajisaka
|
414fbfab41
|
HDFS-10696. TestHDFSCLI fails. Contributed by Kai Sasaki.
|
2016-07-28 16:58:23 +09:00 |
|
Andrew Wang
|
098ec2b11f
|
HDFS-10519. Add a configuration option to enable in-progress edit log tailing. Contributed by Jiayi Zhou.
|
2016-07-27 17:55:41 -07:00 |
|
Yongjun Zhang
|
eb7ff0c992
|
HDFS-10667. Report more accurate info about data corruption location. (Yuanbo Liu via Yongjun Zhang)
|
2016-07-27 13:58:04 -07:00 |
|
Wei-Chiu Chuang
|
d84ab8a578
|
HDFS-10598. DiskBalancer does not execute multi-steps plan. Contributed by Lei (Eddy) Xu.
|
2016-07-26 16:01:50 -07:00 |
|
Wei-Chiu Chuang
|
25f0a9b3ab
|
HDFS-9937. Update dfsadmin command line help and HdfsQuotaAdminGuide. Contributed by Kai Sasaki.
|
2016-07-26 08:01:42 -07:00 |
|
Vinitha Reddy Gankidi
|
85a20508bd
|
HDFS-10301. Interleaving processing of storages from repeated block reports causes false zombie storage detection, removes valid blocks. Contributed by Vinitha Gankidi.
|
2016-07-25 18:50:59 -07:00 |
|
Jing Zhao
|
0cde9e12a7
|
HDFS-10688. BPServiceActor may run into a tight loop for sending block report when hitting IOException. Contributed by Chen Liang.
|
2016-07-25 18:41:13 -07:00 |
|
Kai Zheng
|
b79ba4fe96
|
HDFS-10651. Clean up some configuration related codes about legacy block reader. Contributed by Youwei Wang
|
2016-07-23 17:45:33 +08:00 |
|
Arpit Agarwal
|
c6e3a0020f
|
HDFS-10660. Expose storage policy apis via HDFSAdmin interface. (Contributed by Rakesh R)
|
2016-07-22 12:33:50 -07:00 |
|
Xiao Chen
|
132deb4cac
|
HDFS-10225. DataNode hot swap drives should disallow storage type changes. Contributed by Lei (Eddy) Xu.
|
2016-07-21 16:41:02 -07:00 |
|
Jing Zhao
|
bd3dcf46e2
|
HDFS-10653. Optimize conversion from path string to components. Contributed by Daryn Sharp.
|
2016-07-21 11:14:39 -07:00 |
|
Akira Ajisaka
|
38128baff4
|
HDFS-10425. Clean up NNStorage and TestSaveNamespace. Contributed by Andras Bokor.
|
2016-07-20 10:44:11 -07:00 |
|
Akira Ajisaka
|
f7dabe3add
|
HDFS-10620. StringBuilder created and appended even if logging is disabled. Contributed by Staffan Friberg.
|
2016-07-19 15:13:01 -07:00 |
|
Akira Ajisaka
|
c48e9d608c
|
HDFS-10628. Log HDFS Balancer exit message to its own log. Contributed by Jiayi Zhou.
|
2016-07-15 11:42:44 -07:00 |
|
Lei Xu
|
382dff7475
|
HDFS-10600. PlanCommand#getThrsholdPercentage should not use throughput value. (Yiqun Lin via lei)
|
2016-07-14 10:40:34 -07:00 |
|
Kihwal Lee
|
2bbc3ea1b5
|
HDFS-10617. PendingReconstructionBlocks.size() should be synchronized. Contributed by Eric Badger.
|
2016-07-13 21:59:35 -05:00 |
|
Zhe Zhang
|
087290e6b1
|
HDFS-10544. Balancer doesn't work with IPFailoverProxyProvider.
|
2016-07-12 23:18:37 -07:00 |
|
Jitendra Pandey
|
c447efebdb
|
HDFS-10579. HDFS web interfaces lack configs for X-FRAME-OPTIONS protection. Contributed by Anu Engineer.
|
2016-07-11 14:55:33 -07:00 |
|
Yongjun Zhang
|
da6f1b88dd
|
HDFS-10512. VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks. Contributed by Wei-Chiu Chuang and Yiqun Lin.
|
2016-07-08 19:40:44 -07:00 |
|
Akira Ajisaka
|
8b4b5259d5
|
HDFS-10589. Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params. Contributed by shenyinjie.
|
2016-07-04 07:15:04 -07:00 |
|
Akira Ajisaka
|
2e835d986e
|
HDFS-10572. Fix TestOfflineEditsViewer#testGenerated. Contributed by Surendra Singh Lilhore.
|
2016-07-03 21:11:56 -07:00 |
|
Kai Zheng
|
8b281bce85
|
HDFS-10548. Remove the long deprecated BlockReaderRemote. Contributed by Kai Zheng
|
2016-07-03 11:56:23 +08:00 |
|
Colin Patrick Mccabe
|
e4a2545620
|
HDFS-9805. Add server-side configuration for enabling TCP_NODELAY for DataTransferProtocol and default it to true (Gary Helmling via cmccabe)
|
2016-06-29 12:41:42 -07:00 |
|
Andrew Wang
|
c0829f4493
|
HDFS-6434. Default permission for creating file should be 644 for WebHdfs/HttpFS. Contributed by Wellington Chevreuil.
|
2016-06-28 13:55:26 -07:00 |
|
Allen Wittenauer
|
23c3ff85a9
|
HADOOP-13209. replace slaves with workers (John Smith via aw)
|
2016-06-28 05:53:03 -07:00 |
|
Vinayakumar B
|
2a0082c51d
|
HDFS-10440. Improve DataNode web UI (Contributed by Weiwei Yang)
|
2016-06-28 16:49:39 +05:30 |
|
Vinayakumar B
|
73615a789d
|
HDFS-10536. Standby NN can not trigger log roll after EditLogTailer thread failed 3 times in EditLogTailer.triggerActiveLogRoll method (Contributed by XingFeng Shen
|
2016-06-26 15:45:32 +05:30 |
|
Sangjin Lee
|
bf74dbf80d
|
HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee)
|
2016-06-24 14:44:15 -07:00 |
|
Zhe Zhang
|
22be604fa3
|
Revert "HDFS-10534. NameNode WebUI should display DataNode usage rate with a certain percentile. Contributed by Kai Sasaki."
This reverts commit 0424056a77.
|
2016-06-24 09:36:03 -07:00 |
|
Zhe Zhang
|
0424056a77
|
HDFS-10534. NameNode WebUI should display DataNode usage rate with a certain percentile. Contributed by Kai Sasaki.
|
2016-06-24 08:58:29 -07:00 |
|
Anu Engineer
|
8a6e354122
|
HDFS-10552. DiskBalancer "-query" results in NPE if no plan for the node. Contributed by Anu Engineer.
|
2016-06-23 18:27:02 -07:00 |
|
Anu Engineer
|
e8de28181a
|
HDFS-10551. o.a.h.h.s.diskbalancer.command.Command does not actually verify options as expected. Contributed by Anu Engineer.
|
2016-06-23 18:27:02 -07:00 |
|
Arpit Agarwal
|
66fa34c839
|
HDFS-10557. Fix handling of the -fs Generic option. (Arpit Agarwal)
|
2016-06-23 18:27:01 -07:00 |
|
Anu Engineer
|
7b23ad1ef7
|
HDFS-10550. DiskBalancer: fix issue of order dependency in iteration in ReportCommand test. Contributed by Xiaobing Zhou.
|
2016-06-23 18:27:01 -07:00 |
|
Anu Engineer
|
0774412e41
|
HDFS-10545. DiskBalancer: PlanCommand should use -fs instead of -uri to be consistent with other hdfs commands. Contributed by Anu Engineer.
|
2016-06-23 18:27:01 -07:00 |
|
Anu Engineer
|
5b8e1c26d7
|
HDFS-10541. Diskbalancer: When no actions in plan, error message says "Plan was generated more than 24 hours ago". Contributed by Anu Engineer.
|
2016-06-23 18:27:00 -07:00 |
|
Anu Engineer
|
cb68e5b3bd
|
HDFS-10540. Diskbalancer: The CLI error message for disk balancer is not enabled is not clear. Contributed by Anu Engineer.
|
2016-06-23 18:27:00 -07:00 |
|
Anu Engineer
|
3225c24e0e
|
HDFS-10520. DiskBalancer: Fix Checkstyle issues in test code. Contributed by Anu Engineer.
|
2016-06-23 18:27:00 -07:00 |
|
Anu Engineer
|
7e2be5c4a0
|
HDFS-10518. DiskBalancer: Pretty-print json in Query command. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
af11ab34d0
|
HDFS-10517. DiskBalancer: Support help command. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
b502102bb1
|
HDFS-9461. DiskBalancer: Add Report Command. Contributed by Xiaobing Zhou.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
121142cf95
|
HDFS-10501. DiskBalancer: Use the default datanode port if port is not provided. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
78a1032b71
|
HDFS-10500. Diskbalancer: Print out information when a plan is not generated. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
d2ff793ae4
|
HDFS-10496. DiskBalancer: ExecuteCommand checks planFile in a wrong way. Contributed by Lei (Eddy) Xu.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
64ccb232cc
|
HDFS-10478. DiskBalancer: resolve volume path names. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
47dcb0f952
|
HDFS-10476. DiskBalancer: Plan command output directory should be a sub-directory. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
43eee50966
|
HDFS-10403. DiskBalancer: Add cancel command. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Arpit Agarwal
|
9e5fcb5e40
|
HDFS-10402. DiskBalancer: Add QueryStatus command. (Contributed by Anu Engineer)
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
5df2d2b8fd
|
HDFS-10399. DiskBalancer: Add JMX for DiskBalancer. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
1b39b283c7
|
HDFS-9546: DiskBalancer: Add Execute command. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
75882ec0b0
|
HDFS-9545: DiskBalancer: Add Plan Command. Contributed by Anu Engineer.
|
2016-06-23 18:21:08 -07:00 |
|
Anu Engineer
|
1594b472bb
|
HDFS-9543. DiskBalancer: Add Data mover. Contributed by Anu Engineer.
|
2016-06-23 18:20:24 -07:00 |
|
Anu Engineer
|
7820737cfa
|
HDFS-9735. DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer. Contributed by Anu Engineer.
|
2016-06-23 18:20:24 -07:00 |
|
Anu Engineer
|
050677077b
|
HDFS-9720. DiskBalancer : Add configuration parameters. Contributed by Anu Engineer.
|
2016-06-23 18:18:48 -07:00 |
|
Anu Engineer
|
6c606bf5c8
|
HDFS-9709. DiskBalancer : Add tests for disk balancer using a Mock Mover class. Contributed by Anu Engineer.
|
2016-06-23 18:18:48 -07:00 |
|
Anu Engineer
|
9be9703716
|
Fix a build break in HDFS-1312
|
2016-06-23 18:18:48 -07:00 |
|
Anu Engineer
|
ec601673a8
|
HDFS-10170. DiskBalancer: Force rebase diskbalancer branch. Contributed by Anu Engineer
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
75a711a2d5
|
HDFS-9703. DiskBalancer: getBandwidth implementation. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
918722bdd2
|
HDFS-9702. DiskBalancer: getVolumeMap implementation. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Anu Engineer
|
747227e9de
|
HDFS-9817. Use SLF4J in new classes. Contributed by Anu Engineer
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
9847640603
|
HDFS-9683. DiskBalancer: Add cancelPlan implementation. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
e646c2eb50
|
HDFS-9681. DiskBalancer: Add QueryPlan implementation. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
2b1b2faf76
|
HDFS-9671. DiskBalancer: SubmitPlan implementation. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
66f0bb646d
|
HDFS-9647. DiskBalancer: Add getRuntimeSettings. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
96fe685b7a
|
HDFS-9645. DiskBalancer: Add Query RPC. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
0501d430e2
|
HDFS-9595. DiskBalancer: Add cancelPlan RPC. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
7100c0da35
|
HDFS-9588. DiskBalancer: Add submitDiskbalancer RPC. (Anu Engineer via Arpit Agarwal)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
5724a10316
|
HDFS-9469. DiskBalancer: Add Planner. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Arpit Agarwal
|
e325c6ade9
|
HDFS-9611. DiskBalancer : Replace htrace json imports with jackson. (Contributed by Anu Engineer)
|
2016-06-23 18:18:48 -07:00 |
|
Tsz-Wo Nicholas Sze
|
599eca07b4
|
HDFS-9526. Fix jackson annotation imports. Contributed by Xiaobing Zhou
|
2016-06-23 18:18:48 -07:00 |
|
Tsz-Wo Nicholas Sze
|
30c6ebd699
|
HDFS-9449. DiskBalancer: Add connectors. Contributed by Anu Engineer
|
2016-06-23 18:18:48 -07:00 |
|
Tsz-Wo Nicholas Sze
|
91a5c48143
|
HDFS-9420. Add DataModels for DiskBalancer. Contributed by Anu Engineer
|
2016-06-23 18:18:48 -07:00 |
|
Xiaoyu Yao
|
dca298d79e
|
HDFS-10469. Add number of active xceivers to datanode metrics. Contributed by Hanisha Koneru.
|
2016-06-23 14:13:39 -07:00 |
|
Kai Zheng
|
e6cb07520f
|
HDFS-10460. Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block. Contributed by Rakesh R
|
2016-06-24 17:39:32 +08:00 |
|
Uma Maheswara Rao G
|
01643020d2
|
HDFS-10555: Unable to loadFSEdits due to a failure in readCachePoolInfo. Contributed by Uma Maheswara Rao G
|
2016-06-22 22:06:13 -07:00 |
|
Uma Maheswara Rao G
|
17eae9ebb3
|
HDFS-10473: Allow only suitable storage policies to be set on striped files. Contributed by Uma Maheswara Rao G
|
2016-06-22 11:17:43 -07:00 |
|
Akira Ajisaka
|
d433b16ce6
|
HDFS-7597. DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping. Contributed by Daryn Sharp, Bob Hansen, and Xiao Chen.
|
2016-06-22 11:00:16 +09:00 |
|
Brahma Reddy Battula
|
f2ac132d6a
|
HDFS-9530. ReservedSpace is not cleared for abandoned Blocks (Contributed by Brahma Reddy Battula)
|
2016-06-21 15:42:28 +05:30 |
|
Colin Patrick Mccabe
|
46f1602e89
|
HDFS-10448. CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 (Yiqun Lin via cmccabe)
|
2016-06-20 18:25:09 -07:00 |
|
Colin Patrick Mccabe
|
5f6b4157a4
|
HDFS-10328. Add per-cache-pool default replication num configuration (xupeng via cmccabe)
|
2016-06-20 10:42:50 -07:00 |
|
Arpit Agarwal
|
0319d73c3b
|
HDFS-10437. ReconfigurationProtocol not covered by HDFSPolicyProvider. (Arpit Agarwal)
|
2016-06-18 16:16:54 -07:00 |
|
Kihwal Lee
|
280069510b
|
HDFS-10493. Add links to datanode web UI in namenode datanodes page. Contributed by Weiwei Yang.
|
2016-06-17 11:05:44 -05:00 |
|
Colin Patrick Mccabe
|
2ca73445f5
|
HDFS-10525. Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap (Xiao Chen via cmccabe)
|
2016-06-15 22:47:01 -07:00 |
|
Colin Patrick Mccabe
|
2449db507d
|
HDFS-10505. OIV's ReverseXML processor should support ACLs (Surendra Singh Lilhore via cmccabe)
|
2016-06-15 22:35:19 -07:00 |
|
Ming Ma
|
b48f27e794
|
HDFS-9922. Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes. (Chris Trezzo via mingma)
|
2016-06-15 22:00:52 -07:00 |
|