big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,264 Commits 2 Branches 2 Tags 264 MiB
f7a27cdee4
Commit Graph

5458 Commits

Author SHA1 Message Date
Yongjun Zhang
f7a27cdee4 HDFS-14118. Support using DNS to resolve nameservices to IP addresses. Contributed by Fengnan Li. 2019-02-23 09:35:36 -08:00
Surendra Singh Lilhore
7d3b567194 HDFS-14298. Improve log messages of ECTopologyVerifier. Contributed by Kitti Nanasi. 2019-02-23 01:08:15 +05:30
Surendra Singh Lilhore
92b53c40f0 HDFS-14216. NullPointerException happens in NamenodeWebHdfs. Contributed by lujie. 2019-02-21 20:36:34 +05:30
Shweta Yakkali
1bea785020 HDFS-14081. hdfs dfsadmin -metasave metasave_test results NPE. Contributed by Shweta Yakkali. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-20 14:28:37 -08:00
Inigo Goiri
f5b4e0f971 HDFS-14302. Refactor NameNodeWebHdfsMethods#generateDelegationToken() to allow better extensibility. Contributed by CR Hota. 2019-02-20 13:55:13 -08:00
Sahil Takiar
a30059bb61 HDFS-14267. Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examples. Contributed by Sahil Takiar. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-20 11:38:37 -08:00
Surendra Singh Lilhore
41e18feda3 HDFS-14235. Handle ArrayIndexOutOfBoundsException in DataNodeDiskMetrics#slowDiskDetectionDaemon. Contributed by Ranith Sardar. 2019-02-20 16:56:10 +05:30
Bharat Viswanadham
51950f149e Logging stale datanode information. Contributed by Karthik Palanisamy. 2019-02-19 17:01:07 -08:00
Kitti Nanasi
14282e311b HDFS-14188. Make hdfs ec -verifyClusterSetup command accept an erasure coding policy as a parameter. Contributed by Kitti Nanasi. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-19 12:04:56 -08:00
Inigo Goiri
7587f97127 HDFS-14296. Prefer ArrayList over LinkedList in VolumeScanner. Contributed by BELUGA BEHR. 2019-02-18 17:55:43 -08:00
Inigo Goiri
1de25d134f HDFS-9596. Remove Shuffle Method From DFSUtil. Contributed by BELUGA BEHR. 2019-02-18 15:30:38 -08:00
Inigo Goiri
235e3da90a HDFS-14287. DataXceiverServer May Double-Close PeerServer. Contributed by BELUGA BEHR. 2019-02-18 11:00:04 -08:00
Inigo Goiri
dde0ab55aa HDFS-14258. Introduce Java Concurrent Package To DataXceiverServer Class. Contributed by BELUGA BEHR. 2019-02-15 16:32:27 -08:00
Anu Engineer
75e15cc0c4 HDDS-1103.Fix rat/findbug/checkstyle errors in ozone/hdds projects. 
Contributed by Elek, Marton.
 2019-02-14 23:33:25 -08:00
Erik Krogen
64f28f9efa HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen. 2019-02-14 11:22:04 -08:00
Surendra Singh Lilhore
0d7a5ac5f5 HDFS-13209. DistributedFileSystem.create should allow an option to provide StoragePolicy. Contributed by Ayush Saxena. 2019-02-14 22:13:14 +05:30
Shweta Yakkali
080a421911 HDFS-14262. [SBN read] Make Log.WARN message in GlobalStateIdContext more informative. Contributed by Shweta Yakkali. 2019-02-14 08:05:06 -08:00
Chen Liang
024c87291c HDFS-13617. Allow wrapping NN QOP into token in encrypted message. Contributed by Chen Liang 2019-02-13 12:40:31 -08:00
Surendra Singh Lilhore
29b411d5f0 HDFS-14263. Remove unnecessary block file exists check from FsDatasetImpl#getBlockInputStream(). Contributed by Surendra Singh Lilhore 2019-02-13 23:41:27 +05:30
Surendra Singh Lilhore
35d4f32b32 HDFS-14274. EC: NPE While Listing EC Policy For A Directory Following Replication Policy. Contributed by Ayush Saxena. 2019-02-13 23:06:46 +05:30
Vinayakumar B
7806403842 HDFS-14266. EC : Fsck -blockId shows null for EC Blocks if One Block Is Not Available. Contributed by Ayush Saxena. 2019-02-12 21:57:57 +05:30
Inigo Goiri
0ceb1b70f3 HDFS-14260. Replace synchronized method in BlockReceiver with atomic value. Contributed by BELUGA BEHR. 2019-02-11 10:09:44 -08:00
Yiqun Lin
177131793a HDFS-14172. Avoid NPE when SectionName#fromString returns null. Contributed by Xiang Li. 2019-02-08 20:51:30 +08:00
Surendra Singh Lilhore
4be87353e3 HDFS-14140. JournalNodeSyncer authentication is failing in secure cluster. Contributed by Surendra Singh Lilhore. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-07 16:51:59 -08:00
Siyao Meng
6aa63452b3 HDFS-14242. OIV WebImageViewer: NPE when param op is not specified. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-06 12:19:21 -08:00
Kitti Nanasi
49ddd8a6ed HDFS-14231. DataXceiver#run() should not log exceptions caused by InvalidToken exception as an error. Contributed by Kitti Nanasi. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-05 15:14:19 -08:00
Kitti Nanasi
5f15a60e32 HDFS-14125. Use parameterized log format in ECTopologyVerifier. Contributed by Kitti Nanasi. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-04 14:52:07 -08:00
Inigo Goiri
0e79a86582 HDFS-14202. dfs.disk.balancer.max.disk.throughputInMBperSec property is not working as per set value. Contributed by Ranith Sardar. 2019-02-04 11:59:48 -08:00
tiwalter
9aa3dc872c
HDFS-14158. Checkpointer ignores configured time period > 5 minutes 
This closes #449

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-02-04 13:51:07 +09:00
Dinesh Chitlangia
45caeee6cf HDFS-14228. Incorrect getSnapshottableDirListing() javadoc. Contributed by Dinesh Chitlangia. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-01-25 07:37:01 -08:00
Kitti Nanasi
951cdd7e4c HDFS-14061. Check if the cluster topology supports the EC policy before setting, enabling or adding it. Contributed by Kitti Nanasi. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-01-23 14:40:57 -08:00
Surendra Singh Lilhore
221e308cb5 HDFS-14153. [SPS] : Add Support for Storage Policy Satisfier in WEBHDFS. Contributed by Ayush Saxena. 2019-01-23 17:00:37 +05:30
Takanobu Asanuma
7d6792e5d2 HDFS-14218. EC: Ls -e throw NPE when directory ec policy is disabled. Contributed by Ayush Saxena. 2019-01-23 10:03:06 +09:00
Arpit Agarwal
6f0756fc0e HDFS-14222. Make ThrottledAsyncChecker constructor public. Contributed by Arpit Agarwal. 2019-01-21 20:45:09 -08:00
Arpit Agarwal
1ff658b2ef HDFS-14221. Replace Guava Optional with Java Optional. Contributed by Arpit Agarwal. 2019-01-21 20:44:37 -08:00
Weiwei Yang
de34fc148c HDFS-14207. ZKFC should catch exception when ha configuration missing. Contributed by Fei Hui. 2019-01-22 12:01:08 +08:00
Giovanni Matteo Fumarola
fb8932a727 HADOOP-16029. Consecutive StringBuilder.append can be reused. Contributed by Ayush Saxena. 2019-01-11 10:54:49 -08:00
Surendra Singh Lilhore
9aeaaa0479 HDFS-14198. Upload and Create button doesn't get enabled after getting reset. Contributed by Ayush Saxena. 2019-01-11 14:36:55 +05:30
Surendra Singh Lilhore
f660e5eaa3 HDFS-14163. Debug Admin Command Should Support Generic Options. Contributed by Ayush Saxena. 2019-01-03 18:58:03 +05:30
Surendra Singh Lilhore
21fe77e3ab HDFS-14184. [SPS] Add support for URI based path in satisfystoragepolicy command. Contributed by Ayush Saxena. 2019-01-03 18:36:53 +05:30
Akira Ajisaka
f30473f2ef
HDFS-14183. [SPS] Remove the -w parameter from the -satisfystoragepolicy usage. Contributed by Ayush Saxena. 2018-12-31 03:16:26 +09:00
Wei-Chiu Chuang
e9a005dfcf HDFS-14171. Performance improvement in Tailing EditLog. Contributed by Kenneth Yang. 2018-12-28 10:34:18 -08:00
Chao Sun
fa8550337d HDFS-14149. [SBN read] Fix annotations on new interfaces/classes for SBN reads. Contributed by Chao Sun. 2018-12-24 09:34:01 -08:00
Erik Krogen
b73fb70f97 HDFS-13873. [SBN read] ObserverNode should reject read requests when it is too far behind. Contributed by Konstantin Shvachko. 2018-12-24 09:34:01 -08:00
Chen Liang
652b257478 HDFS-14035. NN status discovery does not leverage delegation token. Contributed by Chen Liang. 2018-12-24 09:34:01 -08:00
Chao Sun
8c49135078 HDFS-13924. [SBN read] Handle BlockMissingException when reading from observer. Contributed by Chao Sun. 2018-12-24 09:34:01 -08:00
Konstantin V Shvachko
b5b9b77707 HDFS-13961. [SBN read] TestObserverNode refactoring. Contributed by Konstantin Shvachko. 2018-12-24 09:34:00 -08:00
Chen Liang
a65bb97f5d HDFS-13791. Limit logging frequency of edit tail related statements. Contributed by Erik Krogen. 2018-12-24 09:34:00 -08:00
Erik Krogen
b74a7dbf88 HDFS-13898. [SBN read] Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode. Contributed by Chao Sun. 2018-12-24 09:34:00 -08:00
Chen Liang
d2e85b0b6d HDFS-13880. Add mechanism to allow certain RPC calls to bypass sync. Contributed by Chen Liang. 2018-12-24 09:34:00 -08:00