Kai Zheng
|
7bff8ca1c8
|
HDFS-8920. Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance. Contributed by Rui Li
|
2015-09-22 13:27:24 -07:00 |
|
Zhe Zhang
|
1080c37300
|
Merge remote-tracking branch 'apache/trunk' into HDFS-7285
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java
hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
Change-Id: I8511c4d64b0959e79129febc179845a3892fedcc
|
2015-09-22 13:27:09 -07:00 |
|
Tsuyoshi Ozawa
|
dfd807afab
|
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
|
2015-09-22 12:54:29 +09:00 |
|
Haohui Mai
|
06022b8fdc
|
HDFS-9111. Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient. Contributed by Mingliang Liu.
|
2015-09-21 18:53:13 -07:00 |
|
Zhe Zhang
|
a9e6681edf
|
HDFS-9091. Erasure Coding: Provide DistributedFilesystem API to getAllErasureCodingPolicies. Contributed by Rakesh R.
Change-Id: Id30a1ce9e2ce676d00a9220a2d3f14b8d9f00527
|
2015-09-21 13:24:02 -07:00 |
|
Uma Mahesh
|
b762199adb
|
HDFS-9113. ErasureCodingWorker#processErasureCodingTasks should not fail to process remaining tasks due to one invalid ECTask. Contributed by Uma Maheswara Rao G.
|
2015-09-19 21:18:42 -07:00 |
|
Lei Xu
|
3a9c7076e8
|
HDFS-9004. Add upgrade domain to DatanodeInfo. Contributed by Ming Ma (via Lei (Eddy) Xu).
Change-Id: I887c66578eebd61acc34b94f18da6e6851c609f4
|
2015-09-19 18:08:09 -07:00 |
|
Haohui Mai
|
66b46d0885
|
HDFS-9101. Remove deprecated NameNode.getUri() static helper method. Contributed by Mingliang Liu.
|
2015-09-18 18:23:53 -07:00 |
|
Zhe Zhang
|
c457095206
|
HDFS-8550. Erasure Coding: Fix FindBugs Multithreaded correctness Warning. Contributed by Rakesh R.
Change-Id: Ic248999a7f8e5e740d49c9b10abcf16f66dd0f98
|
2015-09-18 11:04:06 -07:00 |
|
Zhe Zhang
|
82a88b92b4
|
HDFS-9086. Rename dfs.datanode.stripedread.threshold.millis to dfs.datanode.stripedread.timeout.millis. Contributed by Andrew Wang.
Change-Id: Ice86c5d46d29e94087c0f186b941d5394e7ac0e6
|
2015-09-18 10:45:29 -07:00 |
|
Jing Zhao
|
3f42753102
|
HDFS-9063. Correctly handle snapshot path for getContentSummary. Contributed by Jing Zhao.
|
2015-09-18 09:26:33 -07:00 |
|
Yongjun Zhang
|
2ff6faf954
|
HDFS-5802. NameNode does not check for inode type before traversing down a path. (Xiao Chen via Yongjun Zhang)
|
2015-09-18 07:17:30 -07:00 |
|
Vinayakumar B
|
92c1af1646
|
HDFS-6955. DN should reserve disk space for a full block when creating tmp files (Contributed by Kanaka Kumar Avvaru)
|
2015-09-18 16:37:10 +05:30 |
|
Zhe Zhang
|
607bda2a21
|
HDFS-9097. Erasure coding: update EC command "-s" flag to "-p" when specifying policy. Contributed by Zhe Zhang.
Change-Id: I82919e55c4a0d8646d25a53aac757098a56b3029
|
2015-09-17 14:52:37 -07:00 |
|
Haohui Mai
|
9eee97508f
|
HDFS-9022. Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client. Contributed by Mingliang Liu.
|
2015-09-17 14:18:00 -07:00 |
|
Vinayakumar B
|
ce69c9b54c
|
HDFS-8953. DataNode Metrics logging (Contributed by Kanaka Kumar Avvaru)
|
2015-09-16 00:18:29 +05:30 |
|
Zhe Zhang
|
ced438a4bf
|
HDFS-8899. Erasure Coding: use threadpool for EC recovery tasks on DataNode. Contributed by Rakesh R.
Change-Id: I9429706ae3c9b10a9274c07b98da6ed54cce192b
|
2015-09-15 10:43:13 -07:00 |
|
Ming Ma
|
083b44c136
|
HDFS-9008. Balancer#Parameters class could use a builder pattern. (Chris Trezzo via mingma)
|
2015-09-15 10:16:02 -07:00 |
|
Haohui Mai
|
76957a485b
|
HDFS-9010. Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key. Contributed by Mingliang Liu.
|
2015-09-14 18:22:52 -07:00 |
|
Colin Patrick Mccabe
|
7b5cf5352e
|
HDFS-8829. Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning (He Tianyi via Colin P. McCabe)
Change-Id: I77dc71aaf9e14ef743f2a2cbebeec04a4f628c78
|
2015-09-14 16:02:10 -07:00 |
|
Colin Patrick Mccabe
|
53bad4eb00
|
HDFS-8996. Consolidate validateLog and scanLog in FJM#EditLogFile (Zhe Zhang via Colin P. McCabe)
|
2015-09-14 15:22:12 -07:00 |
|
Vinayakumar B
|
c715650385
|
HDFS-9036. In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. (Contributed by J.Andreina)
|
2015-09-12 17:40:16 +05:30 |
|
Arpit Agarwal
|
15a557fcfe
|
HDFS-9027. Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method. (Contributed by Mingliang Liu)
|
2015-09-11 10:11:52 -07:00 |
|
Zhe Zhang
|
96d6b516b2
|
HDFS-8853. Erasure Coding: Provide ECSchema validation when setting EC policy. Contributed by J.Andreina.
Change-Id: I9211d9728480225a407d82e6c0bea1a928adfa11
|
2015-09-10 16:31:37 -07:00 |
|
Kihwal Lee
|
a40342b0da
|
HDFS-6763. Initialize file system-wide quota once on transitioning to active. Contributed by Kihwal Lee
|
2015-09-10 09:16:29 -05:00 |
|
Zhe Zhang
|
f62237bc2f
|
HDFS-8833. Erasure coding: store EC schema and cell size in INodeFile and eliminate notion of EC zones.
|
2015-09-09 23:07:55 -07:00 |
|
Vinayakumar B
|
4014ce5990
|
HDFS-8581. ContentSummary on / skips further counts on yielding lock (contributed by J.Andreina)
|
2015-09-10 00:08:19 +05:30 |
|
Vinayakumar B
|
0f0e897bf1
|
HDFS-7116. Add a command to get the balancer bandwidth (Contributed by Rakesh R)
|
2015-09-09 22:58:50 +05:30 |
|
Kihwal Lee
|
4d13335fc9
|
HDFS-8716. Introduce a new config specifically for safe mode block count. Contributed by Chang Li.
|
2015-09-09 11:08:24 -05:00 |
|
Vinayakumar B
|
94cf7ab9d2
|
HDFS-8929. Add a metric to expose the timestamp of the last journal (Contributed by surendra singh lilhore)
|
2015-09-09 11:03:57 +05:30 |
|
Colin Patrick Mccabe
|
a153b9601a
|
HDFS-8860. Remove unused Replica copyOnWrite code (Lei (Eddy) Xu via Colin P. McCabe)
|
2015-09-08 18:37:22 -07:00 |
|
Xiaoyu Yao
|
970daaa5e4
|
HDFS-9019. Adding informative message to sticky bit permission denied exception. Contributed by Xiaoyu Yao.
|
2015-09-08 09:57:36 -07:00 |
|
Ming Ma
|
30db1adac3
|
HDFS-8981. Adding revision to data node jmx getVersion() method. (Siqi Li via mingma)
|
2015-09-04 11:55:58 -07:00 |
|
Haohui Mai
|
715b9c6499
|
HDFS-8984. Move replication queues related methods in FSNamesystem to BlockManager. Contributed by Haohui Mai.
|
2015-09-04 11:45:31 -07:00 |
|
Jing Zhao
|
8928729c80
|
HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao.
|
2015-09-04 11:42:22 -07:00 |
|
Haohui Mai
|
d16c4eee18
|
HDFS-9012. Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module. Contributed by Mingliang Liu.
|
2015-09-04 10:41:09 -07:00 |
|
Haohui Mai
|
ed78b14ebc
|
HDFS-9002. Move o.a.h.hdfs.net/*Peer classes to hdfs-client. Contributed by Mingliang Liu.
|
2015-09-03 15:32:53 -07:00 |
|
Jakob Homan
|
c2d2c1802a
|
HDFS-8939. Test(S)WebHdfsFileContextMainOperations failing on branch-2. Contributed by Chris Nauroth.
(cherry picked from commit 9871f57d41990b2763d4c23d9040aeb685b4a80f)
|
2015-09-03 13:26:54 -07:00 |
|
Colin Patrick Mccabe
|
53c38cc89a
|
HDFS-8964. When validating the edit log, do not read at or beyond the file offset that is being written (Zhe Zhang via Colin P. McCabe)
|
2015-09-03 11:22:47 -07:00 |
|
Jing Zhao
|
60bd765ac1
|
HDFS-8978. Erasure coding: fix 2 failed tests of DFSStripedOutputStream. Contributed by Walter Su.
|
2015-09-02 17:41:08 -07:00 |
|
Ming Ma
|
d31a41c359
|
HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma)
|
2015-09-02 15:55:42 -07:00 |
|
Jing Zhao
|
de928d566a
|
HDFS-9003. ForkJoin thread pool leaks. Contributed by Kihwal Lee.
|
2015-09-02 15:19:04 -07:00 |
|
Andrew Wang
|
afc88b396f
|
HDFS-328. Improve fs -setrep error message for invalid replication factors. Contributed by Daniel Templeton.
|
2015-09-02 13:46:00 -07:00 |
|
Jing Zhao
|
ddf4e78547
|
HDFS-8937. Erasure coding: do not throw exception when setting replication factor on EC files. Contributed by Gao Rui.
|
2015-09-02 11:45:45 -07:00 |
|
Akira Ajisaka
|
65ccf2b125
|
HDFS-8388. Time and Date format need to be in sync in NameNode UI page. Contributed by Surendra Singh Lilhore.
|
2015-09-02 14:28:38 +09:00 |
|
yliu
|
5652131d2e
|
HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu)
|
2015-09-02 08:58:51 +08:00 |
|
Zhe Zhang
|
53358fe680
|
Merge remote-tracking branch 'apache/trunk' into HDFS-7285
|
2015-09-01 14:48:37 -07:00 |
|
Zhe Zhang
|
ab56fcdb12
|
Merge remote-tracking branch 'apache/trunk' into HDFS-7285
|
2015-09-01 14:30:25 -07:00 |
|
Colin Patrick Mccabe
|
24f6a7c956
|
HDFS-8965. Harden edit log reading code against out of memory errors (cmccabe)
|
2015-08-31 18:06:30 -07:00 |
|
yliu
|
8fa41d9dd4
|
HDFS-8946. Improve choosing datanode storage for block placement. (yliu)
|
2015-09-01 08:52:50 +08:00 |
|