Inigo Goiri
|
0e79a86582
|
HDFS-14202. dfs.disk.balancer.max.disk.throughputInMBperSec property is not working as per set value. Contributed by Ranith Sardar.
|
2019-02-04 11:59:48 -08:00 |
|
tiwalter
|
9aa3dc872c
|
HDFS-14158. Checkpointer ignores configured time period > 5 minutes
This closes #449
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2019-02-04 13:51:07 +09:00 |
|
Akira Ajisaka
|
1129288cf5
|
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki.
|
2019-01-29 18:29:56 -08:00 |
|
Wei-Chiu Chuang
|
d1714c20e9
|
Revert "HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh."
This reverts commit 1d523279da .
|
2019-01-29 15:43:09 -08:00 |
|
Masatake Iwasaki
|
dc5af4c6b7
|
HDFS-12729. Document special paths in HDFS. Contributed by Masatake Iwasaki.
|
2019-01-26 05:34:32 +09:00 |
|
Pranay Singh
|
1d523279da
|
HDFS-14084. Need for more stats in DFSClient. Contributed by Pranay Singh.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-01-25 09:02:57 -08:00 |
|
Dinesh Chitlangia
|
45caeee6cf
|
HDFS-14228. Incorrect getSnapshottableDirListing() javadoc. Contributed by Dinesh Chitlangia.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-01-25 07:37:01 -08:00 |
|
shwetayakkali@cloudera.com
|
f3e642d92b
|
HDFS-14185. Cleanup method calls to static Assert methods in TestAddStripedBlocks
(Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: I0d533f575a405ed3affd05994a4208bde7d9cbe9
|
2019-01-23 15:57:39 -08:00 |
|
Kitti Nanasi
|
951cdd7e4c
|
HDFS-14061. Check if the cluster topology supports the EC policy before setting, enabling or adding it. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2019-01-23 14:40:57 -08:00 |
|
Surendra Singh Lilhore
|
221e308cb5
|
HDFS-14153. [SPS] : Add Support for Storage Policy Satisfier in WEBHDFS. Contributed by Ayush Saxena.
|
2019-01-23 17:00:37 +05:30 |
|
Takanobu Asanuma
|
7d6792e5d2
|
HDFS-14218. EC: Ls -e throw NPE when directory ec policy is disabled. Contributed by Ayush Saxena.
|
2019-01-23 10:03:06 +09:00 |
|
Arpit Agarwal
|
6f0756fc0e
|
HDFS-14222. Make ThrottledAsyncChecker constructor public. Contributed by Arpit Agarwal.
|
2019-01-21 20:45:09 -08:00 |
|
Arpit Agarwal
|
1ff658b2ef
|
HDFS-14221. Replace Guava Optional with Java Optional. Contributed by Arpit Agarwal.
|
2019-01-21 20:44:37 -08:00 |
|
Weiwei Yang
|
de34fc148c
|
HDFS-14207. ZKFC should catch exception when ha configuration missing. Contributed by Fei Hui.
|
2019-01-22 12:01:08 +08:00 |
|
Sunil G
|
e9962240f0
|
Make 3.2.0 aware to other branches - jdiff
|
2019-01-21 22:41:26 +05:30 |
|
Inigo Goiri
|
f048512bb8
|
HDFS-14192. Track missing DFS operations in Statistics and StorageStatistics. Contributed by Ayush Saxena.
|
2019-01-16 10:14:22 -08:00 |
|
Giovanni Matteo Fumarola
|
fb8932a727
|
HADOOP-16029. Consecutive StringBuilder.append can be reused. Contributed by Ayush Saxena.
|
2019-01-11 10:54:49 -08:00 |
|
Surendra Singh Lilhore
|
9aeaaa0479
|
HDFS-14198. Upload and Create button doesn't get enabled after getting reset. Contributed by Ayush Saxena.
|
2019-01-11 14:36:55 +05:30 |
|
shwetayakkali@cloudera.com
|
4ab5260b7e
|
HDFS-14132. Add BlockLocation.isStriped() to determine if block is replicated or Striped
(Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: I0ed8996a0bae2ad2c7d3513143195533f7191af8
|
2019-01-08 17:04:57 -08:00 |
|
Giovanni Matteo Fumarola
|
1a08302897
|
HDFS-14189. Fix intermittent failure of TestNameNodeMetrics. Contributed by Ayush Saxena.
|
2019-01-08 10:38:06 -08:00 |
|
Surendra Singh Lilhore
|
f660e5eaa3
|
HDFS-14163. Debug Admin Command Should Support Generic Options. Contributed by Ayush Saxena.
|
2019-01-03 18:58:03 +05:30 |
|
Surendra Singh Lilhore
|
21fe77e3ab
|
HDFS-14184. [SPS] Add support for URI based path in satisfystoragepolicy command. Contributed by Ayush Saxena.
|
2019-01-03 18:36:53 +05:30 |
|
Akira Ajisaka
|
f30473f2ef
|
HDFS-14183. [SPS] Remove the -w parameter from the -satisfystoragepolicy usage. Contributed by Ayush Saxena.
|
2018-12-31 03:16:26 +09:00 |
|
Wei-Chiu Chuang
|
e9a005dfcf
|
HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang.
|
2018-12-28 10:34:18 -08:00 |
|
Chao Sun
|
c546b12e45
|
HDFS-14154. [SBN read] Document dfs.ha.tail-edits.period in user guide. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Konstantin V Shvachko
|
c9d7737431
|
HDFS-14160. [SBN read] ObserverReadInvocationHandler should implement RpcInvocationHandler. Contributed by Konstantin V Shvachko.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
fa8550337d
|
HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
c3efc299fe
|
HDFS-14116. [SBN read] Fix class cast error in NNThroughputBenchmark with ObserverReadProxyProvider. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Erik Krogen
|
ef3e1929dd
|
HDFS-14146. [SBN read] Handle exceptions from and prevent handler threads from blocking within internalQueueCall. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Erik Krogen
|
b73fb70f97
|
HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too far behind. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:01 -08:00 |
|
Erik Krogen
|
2904aa3808
|
HDFS-14131. [SBN read] Create user guide for Consistent Reads from Observer feature. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
cbc2f932eb
|
HDFS-14067. [SBN read] Allow manual failover between standby and observer. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Chen Liang
|
652b257478
|
HDFS-14035. NN status discovery does not leverage delegation token. Contributed by Chen Liang.
|
2018-12-24 09:34:01 -08:00 |
|
Chao Sun
|
8c49135078
|
HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer. Contributed by Chao Sun.
|
2018-12-24 09:34:01 -08:00 |
|
Konstantin V Shvachko
|
b6f20c36c2
|
HDFS-13925. Unit Test for transitioning between different states. Contributed by Sherwood Zheng.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
1c4265d7bc
|
HDFS-13523. Support observer nodes in MiniDFSCluster. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
b5b9b77707
|
HDFS-13961. [SBN read] TestObserverNode refactoring. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:00 -08:00 |
|
Chen Liang
|
a65bb97f5d
|
HDFS-13791. Limit logging frequency of edit tail related statements. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
b74a7dbf88
|
HDFS-13898. [SBN read] Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode. Contributed by Chao Sun.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
25b63e8da8
|
HDFS-13749. [SBN read] Use getServiceStatus to discover observer namenodes. Contributed by Chao Sun.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
28820fb6b1
|
HDFS-13778. [SBN read] TestStateAlignmentContextWithHA should use real ObserverReadProxyProvider instead of AlignmentContextProxyProvider. Contributed by Konstantin Shvachko and Plamen Jeliazkov.
|
2018-12-24 09:34:00 -08:00 |
|
Chen Liang
|
d2e85b0b6d
|
HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
aa42fb0db7
|
HDFS-13779. [SBN read] Implement proper failover and observer failure handling logic for for ObserverReadProxyProvider. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Konstantin V Shvachko
|
25d8e39b5c
|
HDFS-13851. Remove AlignmentContext from AbstractNNFailoverProxyProvider. Contributed by Konstantin Shvachko.
|
2018-12-24 09:34:00 -08:00 |
|
Chen Liang
|
66ec3a67e8
|
HDFS-13767. Add msync server implementation. Contributed by Chen Liang.
|
2018-12-24 09:34:00 -08:00 |
|
Chao Sun
|
4c9baba066
|
HDFS-13789. Reduce logging frequency of QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
eae0a5d54a
|
HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang.
|
2018-12-24 09:34:00 -08:00 |
|
Erik Krogen
|
1e22f2bfbb
|
HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test, documentation, remove unnecessary dummy sync, minors fixups. Contributed by Erik Krogen.
|
2018-12-24 09:34:00 -08:00 |
|
Chao Sun
|
64b7cf59bd
|
HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Konstantin V Shvachko
|
0105d7f597
|
HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed by Konstantin Shvachko.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
00e99c6594
|
HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to support tailing edits via RPC. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
151c8ddbe4
|
HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
c81ac2ff02
|
HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an in-memory cache of recent edit transactions. Contributed by Erik Krogen.
|
2018-12-24 09:33:59 -08:00 |
|
Plamen Jeliazkov
|
e880660a20
|
HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
091ad974cd
|
HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Erik Krogen
|
9bf0696c73
|
HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Plamen Jeliazkov
|
c9d73437e8
|
HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov.
|
2018-12-24 09:33:59 -08:00 |
|
Chao Sun
|
3a78e5ffd8
|
HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby. Contributed by Chao Sun.
|
2018-12-24 09:33:59 -08:00 |
|
Surendra Singh Lilhore
|
686fcd4db3
|
HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed by Ranith Sardar.
|
2018-12-24 11:02:36 +05:30 |
|
Surendra Singh Lilhore
|
d944d5ec46
|
HDFS-14165. In NameNode UI under DataNode tab ,the Capacity column is Non-Aligned. Contributed by Shubham Dewan.
|
2018-12-23 15:06:12 +05:30 |
|
Yiqun Lin
|
feb2664ac4
|
HDFS-13946. Log longest FSN write/read lock held stack trace.
|
2018-12-22 23:09:59 +08:00 |
|
Giovanni Matteo Fumarola
|
00d5e631b5
|
HDFS-14006. Refactor name node to allow different token verification implementations. Contributed by CR Hota.
|
2018-12-14 11:10:54 -08:00 |
|
Giovanni Matteo Fumarola
|
cb3382f667
|
HDFS-14145. TestBlockStorageMovementAttemptedItems#testNoBlockMovementAttemptFinishedReportAdded fails sporadically in Trunk. Contributed by Ayush Saxena.
|
2018-12-14 10:59:02 -08:00 |
|
Akira Ajisaka
|
ca379e1c43
|
HDFS-13970. Use MultiMap for CacheManager Directives to simplify the code. Contributed by BELUGA BEHR.
|
2018-12-14 14:36:26 +09:00 |
|
Giovanni Matteo Fumarola
|
561b61cfb1
|
HDFS-14144. TestPred fails in Trunk. Contributed by Ayush Saxena.
|
2018-12-12 11:16:16 -08:00 |
|
Giovanni Matteo Fumarola
|
60af851e59
|
HDFS-14137. TestMaintenanceState fails with ArrayIndexOutOfBound Exception. Contributed by Ayush Saxena.
|
2018-12-11 11:22:32 -08:00 |
|
Vinayakumar B
|
39dc7345b8
|
HDFS-14124. EC : Support EC Commands (set/get/unset EcPolicy) via WebHdfs. Contributed by Ayush Saxena.
|
2018-12-11 17:59:04 +05:30 |
|
Sean Mackrory
|
80e59e7876
|
HDFS-14101. Fixing underflow error in test. Contributed by Zsolt Venczel.
|
2018-12-10 14:03:08 -07:00 |
|
Inigo Goiri
|
8fc0d04517
|
HDFS-14001. [PROVIDED Storage] bootstrapStandby should manage the InMemoryAliasMap. Contributed by Virajith Jalaparti.
|
2018-12-07 18:30:36 -08:00 |
|
Vinayakumar B
|
c03024a530
|
HDFS-14113. EC : Add Configuration to restrict UserDefined Policies. Contributed by Ayush Saxena.
|
2018-12-06 18:20:28 +05:30 |
|
Giovanni Matteo Fumarola
|
69489ff2d1
|
HDFS-14119. Improve GreedyPlanner Parameter Logging. Contributed by Beluga Behr.
|
2018-12-03 12:55:52 -08:00 |
|
Adam Antal
|
fb10803dfa
|
HDFS-13818. Extend OIV to detect FSImage corruption. Contributed by Adam Antal.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-12-03 10:34:39 -08:00 |
|
Kitti Nanasi
|
dd5e7c6b72
|
HDFS-12946. Add a tool to check rack configuration against EC policies. Contributed by Kitti Nanasi.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-12-03 10:01:09 -08:00 |
|
Surendra Singh Lilhore
|
042c8ef593
|
HDFS-14075. Terminate the namenode when failed to start log segment. Contributed by Ayush Saxena.
|
2018-12-02 12:31:08 +05:30 |
|
Giovanni Matteo Fumarola
|
99e201dfe2
|
HDFS-14105. Replace TreeSet in NamenodeFsck with HashSet. Contributed by Beluga Behr.
|
2018-11-30 11:07:11 -08:00 |
|
Giovanni Matteo Fumarola
|
b09cfad432
|
HDFS-14106. Refactor NamenodeFsck#copyBlock. Contributed by Beluga Behr.
|
2018-11-30 10:47:59 -08:00 |
|
Yiqun Lin
|
0e36e935d9
|
HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng.
|
2018-11-30 11:31:34 +08:00 |
|
Tsz Wo Nicholas Sze
|
0081b02e35
|
HDFS-14112. Avoid recursive call to external authorizer for getContentSummary.
|
2018-11-29 13:55:21 -08:00 |
|
Brahma Reddy Battula
|
f534736867
|
HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena.
|
2018-11-30 00:18:27 +05:30 |
|
Ewan Higgs
|
c1d24f8483
|
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests.
Contributed by Ewan Higgs and Steve Loughran.
|
2018-11-29 15:12:17 +00:00 |
|
Giovanni Matteo Fumarola
|
300f560fcc
|
HDFS-14102. Performance improvement in BlockPlacementPolicyDefault. Contributed by Beluga Behr.
|
2018-11-28 11:33:22 -08:00 |
|
Giovanni Matteo Fumarola
|
4ca3a6b21a
|
HDFS-14108. Performance improvement in BlockManager Data Structures. Contributed by Beluga Behr.
|
2018-11-28 11:25:47 -08:00 |
|
Vinayakumar B
|
b098281454
|
HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B.
|
2018-11-26 18:22:32 +05:30 |
|
Brahma Reddy Battula
|
892b33e054
|
HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena.
|
2018-11-22 00:13:56 +05:30 |
|
Akira Ajisaka
|
1a00b4e325
|
Add 2.9.2 release notes and changes documents.
|
2018-11-20 14:25:18 +09:00 |
|
Vinayakumar B
|
68d5dfdc78
|
HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena.
|
2018-11-16 18:05:10 +05:30 |
|
Vinayakumar B
|
8571507efa
|
HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena.
|
2018-11-16 17:26:36 +05:30 |
|
Arpit Agarwal
|
1e15c7e855
|
HADOOP-15936. [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier. Contributed by Zsolt Venczel.
|
2018-11-15 12:42:31 -08:00 |
|
Inigo Goiri
|
460a94a10f
|
HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang.
|
2018-11-15 10:58:57 -08:00 |
|
Inigo Goiri
|
993c2140cc
|
HDFS-14054. TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky. Contributed by Zsolt Venczel.
|
2018-11-15 09:29:14 -08:00 |
|
Xiao Chen
|
9da6054ca4
|
Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel."
This reverts commit 7dc79a8b5b .
|
2018-11-13 12:44:25 -08:00 |
|
Brahma Reddy Battula
|
e7b63baca1
|
HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota
|
2018-11-13 12:45:44 +05:30 |
|
Arpit Agarwal
|
b6d4e19f34
|
HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena.
|
2018-11-12 15:31:42 -08:00 |
|
Kitti Nanasi
|
8d99648c20
|
HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi.
Signed-off-by: Xiao Chen <xiao@apache.org>
|
2018-11-08 10:01:19 -08:00 |
|
Inigo Goiri
|
887244de4a
|
HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen.
|
2018-11-06 11:18:15 -08:00 |
|
Inigo Goiri
|
f0ce072934
|
HDFS-14051. Refactor NameNodeHttpServer#initWebHdfs to specify local keytab. Contributed by CR Hota.
|
2018-11-06 10:05:58 -08:00 |
|
Akira Ajisaka
|
6430c9890a
|
HADOOP-15904. [JDK 11] Javadoc build failed due to bad use of '>' in hadoop-hdfs.
|
2018-11-06 18:42:38 +09:00 |
|
Xiao Chen
|
ffc9c50e07
|
HDFS-14053. Provide ability for NN to re-replicate based on topology changes. Contributed by Hrishikesh Gadre.
|
2018-11-05 21:38:39 -08:00 |
|
Inigo Goiri
|
f3296501e0
|
HDFS-14043. Tolerate corrupted seen_txid file. Contributed by Lukas Majercak.
|
2018-11-05 16:48:37 -08:00 |
|
Giovanni Matteo Fumarola
|
f3f5e7ad00
|
HDFS-14042. Fix NPE when PROVIDED storage is missing. Contributed by Virajith Jalaparti.
|
2018-11-05 11:02:31 -08:00 |
|