big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,683 Commits 2 Branches 2 Tags 264 MiB
215a62e99f
Commit Graph

23683 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anu Engineer
92b1fdcece HDDS-1070. Adding Node and Pipeline related metrics in SCM. 
Contributed by Nandakumar.
 2019-02-24 15:39:41 -08:00
Anu Engineer
3aa0a57ea0 HDDS-1152. Add trace information for the client side of the datanode writes 
Contributed by Elek, Marton.
 2019-02-24 15:20:34 -08:00
Anu Engineer
5c1f946071 HDDS-1145. Add optional web server to the Ozone freon test tool. 
Contributed by Elek, Marton.
 2019-02-24 15:04:25 -08:00
Anu Engineer
416b730f34 HDDS-1115. Provide ozone specific top-level pom.xml. 
Contributed by Elek, Marton.
 2019-02-24 14:40:52 -08:00
Anu Engineer
fc5c83b2ca HDDS-1090. Add a recipe to the ozone docs about using Spark, OzoneFS, and K8s. 
Contributed by Elek, Marton.
 2019-02-24 14:02:30 -08:00
Anu Engineer
236b105e41 HDDS-1089. Disable OzoneFSStorageStatistics for hadoop versions older than 2.8. 
Contributed by Elek, Marton.
 2019-02-24 13:53:38 -08:00
Anu Engineer
d82014b70a HDDS-1149. Change the default ozone.client.checksum.type. 
Contributed by Bharat Viswanadham.
 2019-02-24 13:22:36 -08:00
Anu Engineer
8387bbdfb5 HDDS-1154. Add tracing to the client side of StorageContainerLocationProtocol and OzoneManagerProtocol. 
Contributed by Elek, Marton.
 2019-02-24 13:13:37 -08:00
Anu Engineer
021f8deef0 HDDS-1168.Use random ports in TestBlockManager and TestDeletedBlockLog. 
Contributed by Nandakumar.
 2019-02-24 12:36:03 -08:00
Weiwei Yang
9cd5c5447f YARN-9316. TestPlacementConstraintsUtil#testInterAppConstraintsByAppID fails intermittently. Contributed by Prabhu Joseph. 2019-02-24 22:42:27 +08:00
Weiwei Yang
50094d7fef YARN-9300. Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler. Contributed by Tao Yang. 2019-02-24 22:17:29 +08:00
Sunil G
dddcfa4d9f YARN-8821. [YARN-8851] GPU hierarchy/topology scheduling support based on pluggable device framework. Contributed by Zhankun Tang. 2019-02-24 14:37:06 +05:30
Bharat Viswanadham
106bdc6c04
HDDS-1120. Add a config to disable checksum verification during read. 2019-02-23 21:37:55 -08:00
Anu Engineer
490206e4b4 HDDS-1155.Fix failing unit test methods of TestDeadNodeHandler. 
Contributed by Nandakumar.
 2019-02-23 21:13:47 -08:00
Anu Engineer
c1e5b19212 HDDS-1147. Fix failing unit tests in TestOzoneManager. 
Contributed by Nandakumar.
 2019-02-23 20:56:24 -08:00
Anu Engineer
fb546d1807 HDDS-1167. Error in hadoop-ozone/dev-support/checks/checkstyle.sh. 
Contributed by Nandakumar.
 2019-02-23 20:45:01 -08:00
Anu Engineer
014e17af78 HDDS-1166. Fix checkstyle line length issues. 
Contributed by Nandakumar.
 2019-02-23 20:31:39 -08:00
Bharat Viswanadham
1b87668a3b HDDS-1165. Document generation in maven should be configured on execution level. Contributed by Anu Engineer. 2019-02-23 10:44:46 -08:00
Hanisha Koneru
d0e21ac16b HDDS-1158. TestOzoneManagerHA.testTwoOMNodesDown is failing with ratis error. 2019-02-23 10:20:28 -08:00
Yongjun Zhang
f7a27cdee4 HDFS-14118. Support using DNS to resolve nameservices to IP addresses. Contributed by Fengnan Li. 2019-02-23 09:35:36 -08:00
Sahil Takiar
f19c844e75 HDFS-14285. libhdfs hdfsRead copies entire array even if its only partially filled. Contributed by Sahil Takiar. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-22 17:54:32 -08:00
George Huang
9daf43c6fa HADOOP-16129. Misc. bug fixes for KMS Benchmark. Contributed by George Huang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-22 17:52:09 -08:00
Eric Yang
05bce33d6e YARN-9244. Document docker registry deployment with direct S3 driver. 
Contributed by Suma Shivaprasad
 2019-02-22 19:13:52 -05:00
Erik Krogen
bad3ffd290 HDFS-14279. [SBN read] Fix race condition in ObserverReadProxyProvider. Contributed by Erik Krogen. 2019-02-22 13:58:49 -08:00
Bharat Viswanadham
70579805c9 HDDS-1148. After allocating container, we are not adding to container DB. 2019-02-23 01:50:49 +05:30
Surendra Singh Lilhore
7d3b567194 HDFS-14298. Improve log messages of ECTopologyVerifier. Contributed by Kitti Nanasi. 2019-02-23 01:08:15 +05:30
bibinchundatt
ed13cf8406 YARN-9317. Avoid repeated YarnConfiguration#timelineServiceV2Enabled check. Contributed by Prabhu Joseph 2019-02-22 21:01:34 +05:30
Sunil G
95fbbfed75 YARN-9118. Handle exceptions with parsing user defined GPU devices in GpuDiscoverer. Contributed by Szilard Nemeth. 2019-02-22 20:22:17 +05:30
Sunil G
9636fe4114 YARN-8891. Documentation of the pluggable device framework. Contributed by Zhankun Tang. 2019-02-22 20:00:13 +05:30
Weiwei Yang
9c88695bcd YARN-9238. Avoid allocating opportunistic containers to previous/removed/non-exist application attempt. Contributed by lujie. 2019-02-22 20:58:33 +08:00
Weiwei Yang
632d5e8a98 YARN-9156. Improve debug message in device plugin method compatibility check of ResourcePluginManager. Contributed by Zhankun Tang. 2019-02-22 11:27:30 +08:00
Elek, Márton
28d0bf9f67 HDDS-1161. Disable failing test which are tracked by a separated jira. Contributed by Elek, Marton. 2019-02-21 13:57:05 -08:00
Bharat Viswanadham
d33f0666f6
HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint. 
* HDDS-1141.Update DBCheckpointSnapshot to DBCheckpoint.

* fix test failures in TestOzoneConfigurationFields
 2019-02-21 13:29:10 -08:00
Wangda Tan
b17a2602d1 YARN-9319. Fix compilation issue of handling typedef an existing name by gcc compiler. (Zhankun Tang via wangda) 
Change-Id: Ie8293cc5b710ff355fb6a1ea7201be53ed0385bf
 2019-02-21 11:17:32 -08:00
Weiwei Yang
6c4ab0312b YARN-9258. Support to specify allocation tags without constraint in distributed shell CLI. Contributed by Prabhu Joseph. 2019-02-22 00:18:07 +08:00
Nanda kumar
2bc3cfe28f HDDS-1126. Datanode is trying to qausi-close a container which is already closed. 
Signed-off-by: Nanda kumar <nanda@apache.org>
 2019-02-21 21:37:08 +05:30
Allen Wittenauer
b9b182eff4 HADOOP-16035. Jenkinsfile for Hadoop 
Signed-off-by: Steve Loughran <stevel@apache.org>
 2019-02-21 07:36:15 -08:00
Surendra Singh Lilhore
92b53c40f0 HDFS-14216. NullPointerException happens in NamenodeWebHdfs. Contributed by lujie. 2019-02-21 20:36:34 +05:30
Steve Loughran
a868f59d52
HADOOP-16105. WASB in secure mode does not set connectingUsingSAS. 
Contributed by Steve Loughran.
 2019-02-21 14:08:46 +00:00
Márton Elek
7c802c42dc
HDDS-1129. Fix findbug/checkstyle errors hdds projects. Contributed by Elek, Marton. 2019-02-21 14:04:18 +01:00
Weiwei Yang
eedcc8e26e YARN-9315. TestCapacitySchedulerMetrics fails intermittently. Contributed by Prabhu Joseph. 2019-02-21 17:21:21 +08:00
bibinchundatt
a63c358b78 YARN-8132. Final Status of applications shown as UNDEFINED in ATS app queries. Contributed by Prabhu Joseph. 2019-02-21 13:29:01 +05:30
Daryn Sharp
a87e458432 HADOOP-15813. Enable more reliable SSL connection reuse. Contributed by Daryn Sharp. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-20 18:17:04 -08:00
Shweta Yakkali
371a6db59a HDFS-14273. Fix checkstyle issues in BlockLocation's method javadoc 
(Contributed by Shweta Yakkali via Daniel Templeton)

Change-Id: I546aa4a0fe7f83b53735acd9925f366b2f1a00e2
 2019-02-20 15:36:53 -08:00
Hanisha Koneru
b1397ff9e4 HDDS-1109. Setup Failover Proxy Provider for OM client. 2019-02-20 14:49:59 -08:00
Shweta Yakkali
1bea785020 HDFS-14081. hdfs dfsadmin -metasave metasave_test results NPE. Contributed by Shweta Yakkali. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-20 14:28:37 -08:00
Inigo Goiri
f5b4e0f971 HDFS-14302. Refactor NameNodeWebHdfsMethods#generateDelegationToken() to allow better extensibility. Contributed by CR Hota. 2019-02-20 13:55:13 -08:00
Arpit Agarwal
676a9cb888 HDDS-1053. Generate RaftGroupId from OMServiceID. Contributed by Aravindan Vijayan. 2019-02-20 12:57:49 -08:00
Sahil Takiar
a30059bb61 HDFS-14267. Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examples. Contributed by Sahil Takiar. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2019-02-20 11:38:37 -08:00
Xiaoyu Yao
1374f8f548 HDDS-1060. Add API to get OM certificate from SCM CA. Contributed by Ajay Kumar. 2019-02-20 11:35:49 -08:00