big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,622 Commits 2 Branches 2 Tags 264 MiB
b58a35f374
Commit Graph

22622 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wei-Chiu Chuang
b58a35f374 HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow. 2019-08-18 17:46:00 -07:00
avijayanhwx
e32f52c75f HDDS-1903 : Use dynamic ports for SCM in TestSCMClientProtocolServer … (#1303) 2019-08-18 10:08:38 -07:00
Bharat Viswanadham
b83eae7bdb
HDDS-1974. Implement OM CancelDelegationToken request to use Cache and DoubleBuffer. (#1308) 2019-08-18 10:06:00 -07:00
Siyao Meng
3bba8086e0 HDDS-1938. Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter (#1305) 2019-08-17 21:54:48 -07:00
Vivek Ratnavel Subramanian
e61825682a HDDS-1979. Fix checkstyle errors (#1312) 2019-08-17 21:53:12 -07:00
Wei-Chiu Chuang
d873ddd656 HDFS-14127. Add a description about the observer read configuration. Contributed by xiangheng. 2019-08-17 04:39:22 -07:00
Wei-Chiu Chuang
528378784f HDFS-12012. Fix spelling mistakes in BPServiceActor.java. Contributed by chencan. 2019-08-17 04:37:05 -07:00
HUAN-PING SU
02015e3ed8 HDDS-1959. Decrement purge interval for Ratis logs in datanode (#1301) 2019-08-17 16:54:33 +05:30
Sunil G
0e0ddfaf24 YARN-2599. Standby RM should expose jmx endpoint. Contributed by Rohith Sharma K S. 2019-08-17 15:43:19 +05:30
HUAN-PING SU
8d754c2c39 HADOOP-16351. Change ":" to ApplicationConstants.CLASS_PATH_SEPARATOR. Contributed by kevin su. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-08-16 17:26:09 -07:00
Wei-Chiu Chuang
971a4c8e83 HDFS-14523. Remove excess read lock for NetworkToplogy. Contributed by Wu Weiwei. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Chen Liang <cliang@apache.org>
 2019-08-16 17:19:58 -07:00
Bharat Viswanadham
a46ba03d15
HDDS-1913. Fix OzoneBucket and RpcClient APIS for acl. (#1257) 2019-08-16 16:39:49 -07:00
Bharat Viswanadham
c8675ec42e
HDDS-1911. Support Prefix ACL operations for OM HA. (#1275) 2019-08-16 15:11:11 -07:00
hunshenshi
a38b9e137e HDFS-14456:HAState#prepareToEnterState neednt a lock (#770) Contributed by hunshenshi. 2019-08-16 14:53:06 -07:00
Bharat Viswanadham
8943e1340d
HDDS-1969. Implement OM GetDelegationToken request to use Cache and DoubleBuffer. (#1296) 2019-08-16 13:22:03 -07:00
Erik Krogen
e356e4f4b7 HADOOP-16391 Add a prefix to the metric names for MutableRatesWithAggregation used for deferred RPC metrics to avoid collision with non-deferred metrics. Contributed by Bilwa S T. 2019-08-16 09:01:44 -07:00
LeonGao91
9a1d8cfaf5 HDFS-14678. Allow triggerBlockReport to a specific namenode. (#1252). Contributed by Leon Gao. 2019-08-16 08:00:51 -07:00
Szilard Nemeth
9b8359bb08 YARN-9461. TestRMWebServicesDelegationTokenAuthentication.testCancelledDelegationToken fails with HTTP 400. Contributed by Peter Bacsko 2019-08-16 12:31:58 +02:00
Szilard Nemeth
4456ea67b9 YARN-8586. Extract log aggregation related fields and methods from RMAppImpl. Contributed by Peter Bacsko 2019-08-16 11:36:14 +02:00
Szilard Nemeth
2216ec54e5 YARN-9100. Add tests for GpuResourceAllocator and do minor code cleanup. Contributed by Peter Bacsko 2019-08-16 09:13:20 +02:00
Szilard Nemeth
2a05e0ff3b YARN-9749. TestAppLogAggregatorImpl#testDFSQuotaExceeded fails on trunk. Contributed by Adam Antal 2019-08-16 08:52:09 +02:00
Li Cheng
bf3751521b HDDS-1894. Add filter to scmcli listPipelines. (#1286) 2019-08-16 14:33:04 +08:00
Wei-Chiu Chuang
5882cf94ea HADOOP-16504. Increase ipc.server.listen.queue.size default from 128 to 256. Contributed by Lisheng Sun. 2019-08-15 15:20:54 -07:00
Doroszlai, Attila
77d102ceba HDDS-1910. Cannot build hadoop-hdds-config from scratch in IDEA 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-15 11:03:41 -07:00
Doroszlai, Attila
46d61913ff HDDS-1954. StackOverflowError in OzoneClientInvocationHandler 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-15 10:46:43 -07:00
dineshchitlangia
c801f7a26c HDDS-1768. Audit xxxAcl methods in OzoneManager (#1204) 2019-08-15 08:43:47 -07:00
Adam Antal
22c4f38c4b YARN-9679. Regular code cleanup in TestResourcePluginManager (#1122) 2019-08-15 17:32:05 +02:00
Szilard Nemeth
1845a83cec YARN-9488. Skip YARNFeatureNotEnabledException from ClientRMService. Contributed by Prabhu Joseph 2019-08-15 17:15:38 +02:00
Szilard Nemeth
3f4f097f1f MAPREDUCE-7230. TestHSWebApp.testLogsViewSingle fails. Contributed by Prabhu Joseph 2019-08-15 17:07:43 +02:00
Surendra Singh Lilhore
34681643e9 HDFS-14719. Correct the safemode threshold value in BlockManagerSafeMode. Contributed by hemanthboyina. 2019-08-15 12:12:18 +05:30
Zhankun Tang
85a00fd2bb SUBMARINE-45. Can't specify queue by using the parameter --queue. Contributed by Ayush Saxena, Zac Zhou. 2019-08-15 13:18:29 +08:00
Shashikant Banerjee
0a85af959c HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee. 2019-08-15 10:16:25 +05:30
HUAN-PING SU
167acd87da YARN-9683. Remove reapDockerContainerNoPid left behind by YARN-9074 (#1212) Contributed by Kevin Su. 
Reviewed-by: Eric Yang <eyang@apache.org>
Reviewed-by: Adam Antal <adam.antal@cloudera.com>
 2019-08-14 10:42:29 -07:00
Ayush Saxena
c7204417d7 SUBMARINE-107. Reduce the scope of mockito-core in submarine to test. Contributed by kevin su. 2019-08-14 22:37:22 +05:30
Doroszlai, Attila
8242085164 HDDS-1964. TestOzoneClientProducer fails with ConnectException 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-14 09:53:31 -07:00
Doroszlai, Attila
06d8ac9522 HDDS-1966. Wrong expected key ACL in acceptance test 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-14 09:34:11 -07:00
Adam Antal
c89bdfacc8 YARN-9676. Add DEBUG and TRACE level messages to AppLogAggregatorImpl… (#1261) 
* YARN-9676. Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes

* Using {} placeholder, and increasing loglevel if log aggregation failed.
 2019-08-14 17:35:16 +02:00
Ayush Saxena
b06c2345ef HDFS-14713. RBF: RouterAdmin supports refreshRouterArgs command but not on display. Contributed by wangzhaohui. 2019-08-14 20:44:31 +05:30
Szilard Nemeth
3e0410449f YARN-9133. Make tests more easy to comprehend in TestGpuResourceHandler. Contributed by Peter Bacsko 2019-08-14 17:13:54 +02:00
Mukul Kumar Singh
2432356570 HDDS-1955. TestBlockOutputStreamWithFailures#test2DatanodesFailure failing because of assertion error. 
Signed-off-by: Nanda kumar <nanda@apache.org>
 2019-08-14 20:37:15 +05:30
Szilard Nemeth
e5e609384f YARN-9140. Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager. Contributed by Peter Bacsko 2019-08-14 16:58:22 +02:00
Siyao Meng
3c0382f1b9 HDFS-14595. HDFS-11848 breaks API compatibility. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
 2019-08-14 07:30:35 -07:00
Doroszlai, Attila
83e452ecea HDDS-1965. Compile error due to leftover ScmBlockLocationTestIngClient file (#1293) 2019-08-14 18:39:45 +05:30
Steve Loughran
0e4b757955 HADOOP-16500 S3ADelegationTokens to only log at debug on startup (#1269). Contributed by Steve Loughran. 
Change-Id: Ifafc15f32791911976d7ebc36fb6e8853f59ed41
 2019-08-14 10:50:26 +02:00
bibinchundatt
89a53c7eb4 YARN-9747. Reduce additional namenode call by EntityGroupFSTimelineStore#cleanLogs. Contributed by Prabhu Joseph. 2019-08-14 13:46:23 +05:30
Márton Elek
846848ac4c HDDS-1914. Ozonescript example docker-compose cluster can't be started 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 23:26:47 -07:00
Doroszlai, Attila
48dc441864 HDDS-1929. OM started on recon host in ozonesecure compose 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 23:12:44 -07:00
Anu Engineer
5a248de511 HDDS-1947. fix naming issue for ScmBlockLocationTestingClient. 
Contributed by star.
 2019-08-13 23:07:02 -07:00
Aravindan Vijayan
fc229b6490 HDDS-1832 : Improve logging for PipelineActions handling in SCM and datanode. (Change to Error logging) 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 22:04:31 -07:00
Márton Elek
15545c8bf1 HDDS-1915. Remove hadoop script from ozone distribution 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-08-13 22:02:54 -07:00