big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,832 Commits 2 Branches 2 Tags 264 MiB
f537410563
Commit Graph

22832 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Bharat Viswanadham
90e5eb0a48
HDDS-1849. Implement S3 Complete MPU request to use Cache and DoubleBuffer. (#1181) 2019-07-31 09:18:40 -07:00
Doroszlai, Attila
ac8ed7b5db
HDDS-1877. hadoop31-mapreduce fails due to wrong HADOOP_VERSION 
Closes #1193
 2019-07-31 16:07:27 +02:00
Lokesh Jain
d4ab9aea6f HDDS-1816: ContainerStateMachine should limit number of pending apply transactions. Adds a config, uses snapshot threshold default value. (#1150) 2019-07-31 13:26:24 +05:30
Bharat Viswanadham
e5c4131485
HDDS-1856. Make required changes for Non-HA to use new HA code in OM. (#1174) 2019-07-30 22:39:03 -07:00
Wei-Chiu Chuang
0f2dad6679 HDFS-14569. Result of crypto -listZones is not formatted properly. Contributed by hemanthboyina. 2019-07-30 16:52:42 -07:00
Wei-Chiu Chuang
99f88c30cb HDFS-14419. Avoid repeated calls to the listOpenFiles function. Contributed by HuangTao. 2019-07-30 16:50:06 -07:00
Chao Sun
3ae775d740 HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-07-30 16:01:17 -07:00
Erik Krogen
1f26cc8705 HDFS-13783. Add an option to the Balancer to make it run as a long-running service. Contributed by Chen Zhang. 2019-07-30 15:42:55 -07:00
Inigo Goiri
7849bdcf70 HDFS-14449. Expose total number of DT in JMX for Namenode. Contributed by Fengnan Li. 2019-07-30 13:45:27 -07:00
Doroszlai, Attila
e68d8446c4 HDDS-1834. parent directories not found in secure setup due to ACL check. Contributed by Doroszlai, Attila. 
This closes #1171.
 2019-07-30 13:41:16 -07:00
Eric E Payne
42683aef1a YARN-9596: QueueMetrics has incorrect metrics when labelled partitions are involved. Contributed by Muhammad Samir Khan. 2019-07-30 18:58:36 +00:00
Siyao Meng
c75f16db79 HADOOP-16452. Increase ipc.maximum.data.length default from 64MB to 128MB. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-07-30 11:22:45 -07:00
Sneha Vijayarajan
12a526c080 HADOOP-16460: ABFS: fix for Sever Name Indication (SNI) 
Contributed by Sneha Vijayarajan <snvijaya@microsoft.com>
 2019-07-30 17:23:23 +00:00
Ayush Saxena
8deced0073 HDFS-14677. TestDataNodeHotSwapVolumes#testAddVolumesConcurrently fails intermittently in trunk. Contributed by Chen Zhang. 2019-07-30 22:17:39 +05:30
Bharat Viswanadham
88daa730a3
HDDS-1872. Fix entry clean up from openKeyTable during complete MPU. (#1182) 2019-07-30 09:28:26 -07:00
Felipe Lopes
bca86bd289
HADOOP-16469. Update committers.md 
Contributed by Felipe Lopes.

Change-Id: I5c05b878bde073aeb45bf22340183893f85269e1
 2019-07-30 12:47:55 +01:00
Don Jeba
204a977f55
HADOOP-15910. Fix Javadoc for LdapAuthenticationHandler#ENABLE_START_TLS 
Contributed by Don Jeba.

Change-Id: I2755bfb1263fc659078a1af8f0bdfd739fd1ae40
 2019-07-30 12:39:48 +01:00
Akira Ajisaka
cbfa3f3e98
HADOOP-16435. RpcMetrics should not retained forever. Contributed by Zoltan Haindrich. 2019-07-29 17:37:26 -07:00
Bharat Viswanadham
68f9f2d833
Revert HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated. (#1183) 2019-07-29 16:44:48 -07:00
Siyao Meng
4d07134b13 HDDS-1829 On OM reload/restart OmMetrics#numKeys should be updated (#1164) 2019-07-29 16:42:00 -07:00
Wei-Chiu Chuang
8053085388 HDFS-14429. Block remain in COMMITTED but not COMPLETE caused by Decommission. Contributed by Yicong Cai. 2019-07-29 14:31:34 -07:00
Erik Krogen
72900de5f4 HDFS-14639. [Dynamometer] Remove unnecessary duplicate directory from the distribution. Contributed by Erik Krogen. 2019-07-29 13:50:14 -07:00
CR Hota
611718f59f HDFS-14670: RBF: Create secret manager instance using FederationUtil#newInstance. 2019-07-29 11:00:22 -07:00
avijayanhwx
60325c9611 HDDS-1391 : Add ability in OM to serve delta updates through an API. (#1033) 2019-07-29 09:39:40 -07:00
Eric Yang
d023663e3e HDDS-1833. Moved RefCountedDB stacktrace to log level trace. 
Contributed by Siddharth Wagle
 2019-07-29 12:05:24 -04:00
Chen Zhang
8a59cd1b8a HDFS-12967. NNBench should support multi-cluster access. Contributed by Chen Zhang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-07-29 05:55:12 -07:00
Márton Elek
90afb7bf8c
HDDS-1725. pv-test example to test csi is not working 2019-07-29 11:54:36 +02:00
Márton Elek
b039f7591f
HDDS-1682. TestEventWatcher.testMetrics is flaky 
Closes #962.
 2019-07-29 11:04:45 +02:00
Doroszlai, Attila
61ec03c966
HDDS-1852. Fix typo in TestOmAcls 
Closes #1173
 2019-07-29 10:46:11 +02:00
Doroszlai, Attila
902ff4a2f6
HDDS-1867. Invalid Prometheus metric name from JvmMetrics 
Closes #1172
 2019-07-29 10:27:55 +02:00
Ayush Saxena
02bd02b5af HDFS-14660. [SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider. Contributed by Chao Sun. 2019-07-28 08:41:42 +05:30
hunshenshi
2fe450cb5e HDFS-14425. Native build fails on macos due to jlong in hdfs.c (#741) 2019-07-26 15:33:12 -07:00
Erik Krogen
62efb63006 HADOOP-16245. Restrict the effect of LdapGroupsMapping SSL configurations to avoid interfering with other SSL connections. Contributed by Erik Krogen. 2019-07-26 11:16:58 -07:00
HUAN-PING SU
ecc8acfd24 HDFS-14673. The console log is noisy when using DNSDomainNameResolver to resolve NameNode. 2019-07-26 11:08:46 -07:00
Sammi Chen
c01e137273 HDDS-1864. Turn on topology aware read in TestFailureHandlingByClient. (#1168) 2019-07-26 23:11:34 +05:30
Chen, Junjie
c7c7a889a8 HDDS-1839: Change topology sorting related logs in Pipeline from INFO to DEBUG. Contributed by Junjie Chen. 
This closes #1158.
 2019-07-26 08:14:24 -07:00
Mehul Garnara
c0a0c353e8
MAPREDUCE-6973. Fix comments on creating _SUCCESS file. 
This closes #280

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-26 21:21:26 +09:00
Gopal V
aebac6d2d2
HADOOP-16461. Regression: FileSystem cache lock parses XML within the lock. 
Contributed by Gopal V.

Change-Id: If6654f850e9c24ee0d9519a46fd6269b18e1a7a4
 2019-07-26 11:32:13 +01:00
Steve Loughran
07530314c2
HADOOP-9844. NPE when trying to create an error message response of SASL RPC 
This closes #55

Change-Id: I10a20380565fa89762f4aa564b2f1c83b9aeecdc
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-26 17:53:18 +09:00
pingsutw
98653ecccb
HADOOP-16447 Upgrade JUnit5 from 5.3.1 to 5.5.1 to support global timeout 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2019-07-26 17:05:34 +09:00
Bharat Viswanadham
3426777140
HDDS-1861. Fix TableCacheImpl cleanup logic. (#1165) 2019-07-25 22:30:06 -07:00
Ayush Saxena
ce99cc31e9 HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu. 2019-07-26 08:31:00 +05:30
Nanda kumar
a2cc961086 HDDS-1855. TestStorageContainerManager#testScmProcessDatanodeHeartbeat is failing. (#1153) 2019-07-26 10:54:23 +08:00
Masatake Iwasaki
6b8107ad97 HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena. 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-07-26 09:35:23 +09:00
Siyao Meng
b7fba78fb6 HDDS-1830 OzoneManagerDoubleBuffer#stop should wait for daemon thread to die (#1156) 2019-07-25 16:14:50 -07:00
Nanda kumar
2b1d8aedbb HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-25 14:25:39 -07:00
Xiaoyu Yao
b41ef61ebc HDDS-1858. mTLS support for Ozone is not correct. Contributed by Siddharth Wagle. 2019-07-25 09:52:02 -07:00
Bharat Viswanadham
3c4159ff3d
HDDS-1842. Implement S3 Abort MPU request to use Cache and DoubleBuffer. (#1155) 2019-07-25 08:51:11 -07:00
avijayanhwx
ba43233451 HDDS-1749 : Ozone Client should randomize the list of nodes in pipeline for reads. (#1124) 2019-07-25 20:24:46 +05:30
Ayush Saxena
62deab17a3 HDFS-14647. NPE during secure namenode startup. Contributed by Fengnan Li. 2019-07-25 06:51:07 +05:30