big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20,834 Commits 2 Branches 2 Tags 264 MiB
4c9baba066
Commit Graph

6850 Commits

Author SHA1 Message Date
Chao Sun
4c9baba066 HDFS-13789. Reduce logging frequency of QuorumJournalManager#selectInputStreams. Contributed by Erik Krogen. 2018-12-24 09:34:00 -08:00
Erik Krogen
eae0a5d54a HDFS-13688. [SBN read] Introduce msync API call. Contributed by Chen Liang. 2018-12-24 09:34:00 -08:00
Erik Krogen
1e22f2bfbb HDFS-13610. [SBN read] Edit Tail Fast Path Part 4: Cleanup. Integration test, documentation, remove unnecessary dummy sync, minors fixups. Contributed by Erik Krogen. 2018-12-24 09:34:00 -08:00
Chao Sun
64b7cf59bd HDFS-12976. [SBN read] Introduce ObserverReadProxyProvider. Contributed by Chao Sun. 2018-12-24 09:33:59 -08:00
Konstantin V Shvachko
0105d7f597 HDFS-13706. [SBN read] Rename client context to ClientGSIContext. Contributed by Konstantin Shvachko. 2018-12-24 09:33:59 -08:00
Erik Krogen
00e99c6594 HDFS-13609. [SBN read] Edit Tail Fast Path Part 3: NameNode-side changes to support tailing edits via RPC. Contributed by Erik Krogen. 2018-12-24 09:33:59 -08:00
Erik Krogen
151c8ddbe4 HDFS-13608. [SBN read] Edit Tail Fast Path Part 2: Add ability for JournalNode to serve edits via RPC. Contributed by Erik Krogen. 2018-12-24 09:33:59 -08:00
Erik Krogen
c81ac2ff02 HDFS-13607. [SBN read] Edit Tail Fast Path Part 1: Enhance JournalNode with an in-memory cache of recent edit transactions. Contributed by Erik Krogen. 2018-12-24 09:33:59 -08:00
Plamen Jeliazkov
e880660a20 HDFS-13399. [SBN read] Make Client field AlignmentContext non-static. Contributed by Plamen Jeliazkov. 2018-12-24 09:33:59 -08:00
Erik Krogen
091ad974cd HDFS-13286. [SBN read] Add haadmin commands to transition between standby and observer. Contributed by Chao Sun. 2018-12-24 09:33:59 -08:00
Erik Krogen
9bf0696c73 HDFS-13331. [SBN read] Add lastSeenStateId to RpcRequestHeader. Contributed by Plamen Jeliazkov. 2018-12-24 09:33:59 -08:00
Plamen Jeliazkov
c9d73437e8 HDFS-12977. [SBN read] Add stateId to RPC headers. Contributed by Plamen Jeliazkov. 2018-12-24 09:33:59 -08:00
Chao Sun
3a78e5ffd8 HDFS-12975. [SBN read] Changes to the NameNode to support reads from standby. Contributed by Chao Sun. 2018-12-24 09:33:59 -08:00
Surendra Singh Lilhore
686fcd4db3 HDFS-14046. In-Maintenance ICON is missing in datanode info page. Contributed by Ranith Sardar. 2018-12-24 11:02:36 +05:30
Surendra Singh Lilhore
d944d5ec46 HDFS-14165. In NameNode UI under DataNode tab ,the Capacity column is Non-Aligned. Contributed by Shubham Dewan. 2018-12-23 15:06:12 +05:30
Yiqun Lin
feb2664ac4 HDFS-13946. Log longest FSN write/read lock held stack trace. 2018-12-22 23:09:59 +08:00
Giovanni Matteo Fumarola
00d5e631b5 HDFS-14006. Refactor name node to allow different token verification implementations. Contributed by CR Hota. 2018-12-14 11:10:54 -08:00
Giovanni Matteo Fumarola
cb3382f667 HDFS-14145. TestBlockStorageMovementAttemptedItems#testNoBlockMovementAttemptFinishedReportAdded fails sporadically in Trunk. Contributed by Ayush Saxena. 2018-12-14 10:59:02 -08:00
Akira Ajisaka
ca379e1c43
HDFS-13970. Use MultiMap for CacheManager Directives to simplify the code. Contributed by BELUGA BEHR. 2018-12-14 14:36:26 +09:00
Giovanni Matteo Fumarola
561b61cfb1 HDFS-14144. TestPred fails in Trunk. Contributed by Ayush Saxena. 2018-12-12 11:16:16 -08:00
Giovanni Matteo Fumarola
60af851e59 HDFS-14137. TestMaintenanceState fails with ArrayIndexOutOfBound Exception. Contributed by Ayush Saxena. 2018-12-11 11:22:32 -08:00
Vinayakumar B
39dc7345b8 HDFS-14124. EC : Support EC Commands (set/get/unset EcPolicy) via WebHdfs. Contributed by Ayush Saxena. 2018-12-11 17:59:04 +05:30
Sean Mackrory
80e59e7876 HDFS-14101. Fixing underflow error in test. Contributed by Zsolt Venczel. 2018-12-10 14:03:08 -07:00
Inigo Goiri
8fc0d04517 HDFS-14001. [PROVIDED Storage] bootstrapStandby should manage the InMemoryAliasMap. Contributed by Virajith Jalaparti. 2018-12-07 18:30:36 -08:00
Vinayakumar B
c03024a530 HDFS-14113. EC : Add Configuration to restrict UserDefined Policies. Contributed by Ayush Saxena. 2018-12-06 18:20:28 +05:30
Giovanni Matteo Fumarola
69489ff2d1 HDFS-14119. Improve GreedyPlanner Parameter Logging. Contributed by Beluga Behr. 2018-12-03 12:55:52 -08:00
Adam Antal
fb10803dfa HDFS-13818. Extend OIV to detect FSImage corruption. Contributed by Adam Antal. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-12-03 10:34:39 -08:00
Kitti Nanasi
dd5e7c6b72 HDFS-12946. Add a tool to check rack configuration against EC policies. Contributed by Kitti Nanasi. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2018-12-03 10:01:09 -08:00
Surendra Singh Lilhore
042c8ef593 HDFS-14075. Terminate the namenode when failed to start log segment. Contributed by Ayush Saxena. 2018-12-02 12:31:08 +05:30
Giovanni Matteo Fumarola
99e201dfe2 HDFS-14105. Replace TreeSet in NamenodeFsck with HashSet. Contributed by Beluga Behr. 2018-11-30 11:07:11 -08:00
Giovanni Matteo Fumarola
b09cfad432 HDFS-14106. Refactor NamenodeFsck#copyBlock. Contributed by Beluga Behr. 2018-11-30 10:47:59 -08:00
Yiqun Lin
0e36e935d9 HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng. 2018-11-30 11:31:34 +08:00
Tsz Wo Nicholas Sze
0081b02e35 HDFS-14112. Avoid recursive call to external authorizer for getContentSummary. 2018-11-29 13:55:21 -08:00
Brahma Reddy Battula
f534736867 HDFS-14095. EC: Track Erasure Coding commands in DFS statistics. Contributed by Ayush Saxena. 2018-11-30 00:18:27 +05:30
Ewan Higgs
c1d24f8483
HDFS-13713. Add specification of Multipart Upload API to FS specification, with contract tests. 
Contributed by Ewan Higgs and Steve Loughran.
 2018-11-29 15:12:17 +00:00
Giovanni Matteo Fumarola
300f560fcc HDFS-14102. Performance improvement in BlockPlacementPolicyDefault. Contributed by Beluga Behr. 2018-11-28 11:33:22 -08:00
Giovanni Matteo Fumarola
4ca3a6b21a HDFS-14108. Performance improvement in BlockManager Data Structures. Contributed by Beluga Behr. 2018-11-28 11:25:47 -08:00
Vinayakumar B
b098281454 HDFS-13816. dfs.getQuotaUsage() throws NPE on non-existent dir instead of FileNotFoundException. Contributed by Vinayakumar B. 2018-11-26 18:22:32 +05:30
Brahma Reddy Battula
892b33e054 HDFS-14064. WEBHDFS: Support Enable/Disable EC Policy. Contributed by Ayush Saxena. 2018-11-22 00:13:56 +05:30
Vinayakumar B
68d5dfdc78 HDFS-14056. Fix error messages in HDFS-12716. Contributed by Ayush Saxena. 2018-11-16 18:05:10 +05:30
Vinayakumar B
8571507efa HDFS-13963. NN UI is broken with IE11. Contributed by Ayush Saxena. 2018-11-16 17:26:36 +05:30
Arpit Agarwal
1e15c7e855 HADOOP-15936. [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier. Contributed by Zsolt Venczel. 2018-11-15 12:42:31 -08:00
Inigo Goiri
460a94a10f HDFS-14045. Use different metrics in DataNode to better measure latency of heartbeat/blockReports/incrementalBlockReports of Active/Standby NN. Contributed by Jiandan Yang. 2018-11-15 10:58:57 -08:00
Inigo Goiri
993c2140cc HDFS-14054. TestLeaseRecovery2: testHardLeaseRecoveryAfterNameNodeRestart2 and testHardLeaseRecoveryWithRenameAfterNameNodeRestart are flaky. Contributed by Zsolt Venczel. 2018-11-15 09:29:14 -08:00
Xiao Chen
9da6054ca4 Revert "HDFS-13732. ECAdmin should print the policy name when an EC policy is set. Contributed by Zsolt Venczel." 
This reverts commit 7dc79a8b5b.
 2018-11-13 12:44:25 -08:00
Brahma Reddy Battula
e7b63baca1 HDFS-14070. Refactor NameNodeWebHdfsMethods to allow better extensibility. Contributed by CR Hota 2018-11-13 12:45:44 +05:30
Arpit Agarwal
b6d4e19f34 HDFS-14065. Failed Storage Locations shows nothing in the Datanode Volume Failures. Contributed by Ayush Saxena. 2018-11-12 15:31:42 -08:00
Kitti Nanasi
8d99648c20 HDFS-14039. ec -listPolicies doesn't show correct state for the default policy when the default is not RS(6,3). Contributed by Kitti Nanasi. 
Signed-off-by: Xiao Chen <xiao@apache.org>
 2018-11-08 10:01:19 -08:00
Inigo Goiri
887244de4a HDFS-14048. DFSOutputStream close() throws exception on subsequent call after DataNode restart. Contributed by Erik Krogen. 2018-11-06 11:18:15 -08:00
Inigo Goiri
f0ce072934 HDFS-14051. Refactor NameNodeHttpServer#initWebHdfs to specify local keytab. Contributed by CR Hota. 2018-11-06 10:05:58 -08:00