big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
26,856 Commits 2 Branches 2 Tags 264 MiB
bf605c8acc
Commit Graph

6538 Commits

Author SHA1 Message Date
zhengchenyu
bf605c8acc
YARN-11564. Fix wrong config in yarn-default.xml (#6030) Contributed by Chenyu Zheng. 
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
 2023-09-08 15:23:26 +08:00
slfan1989
3ab983fbae
YARN-11434. [Router] UGI conf doesn't read user overridden configurations on Router startup. (#6011) Contributed by Shilun Fan. 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
 2023-09-08 07:52:54 +08:00
slfan1989
e1dde3bc23
YARN-11537. [Federation] Router CLI Supports List SubClusterPolicyConfiguration Of Queues. (#5944) Contributed by Shilun Fan. 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
 2023-09-06 22:08:59 +08:00
slfan1989
a6c2526c6c
YARN-11435. [Router] FederationStateStoreFacade is not reinitialized with Router conf. (#5967) Contributed by Shilun Fan. 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
 2023-09-03 20:08:40 +08:00
slfan1989
d5334fa761
YARN-6537. Running RM tests against the Router. (#5957) Contributed by Shilun Fan. 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
 2023-09-03 15:38:21 +08:00
slfan1989
b6d06c8928
YARN-11554. Fix TestRMFailover#testWebAppProxyInStandAloneMode Failed. (#5971) 2023-08-31 10:46:33 -07:00
Yang Jiandan
2f739450be
YARN-11552. Timeline endpoint: /clusters/{clusterid}/apps/{appid}/entity-types Error when using hdfs store (#5978) Contributed by Jiandan Yang. 
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
 2023-09-01 00:14:46 +08:00
Steve Loughran
28c533a582 Revert "HADOOP-18860. Upgrade mockito version to 4.11.0 (#5977)" 
This reverts commit 1046f9cf98.
 2023-08-31 14:54:53 +01:00
Anmol Asrani
1046f9cf98
HADOOP-18860. Upgrade mockito version to 4.11.0 (#5977) 
As well as the POM update, this patch moves to the (renamed) verify methods. 
Backporting mockito test changes may now require cherrypicking this patch, otherwise
use the old method names.

Contributed by Anmol Asrani
 2023-08-29 12:12:27 +01:00
WangYuanben
39eaf8d14e
YARN-11556. Let Federation.md more standardized. (#5983) 2023-08-29 12:16:10 +08:00
Benjamin Teke
43c889636a
YARN-11535. Remove jackson-dataformat-yaml dependency. (#5970) 2023-08-22 16:42:49 +02:00
WangYuanben
7368226332
YARN-11553. Change the time unit of scCleanerIntervalMs in Router. (#5965) 2023-08-20 10:12:21 +08:00
slfan1989
ff1570acfa
YARN-10218. [GPG] Support HTTPS in GPG. (#5945) Contributed by Shilun Fan. 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
 2023-08-19 10:32:06 +08:00
zhengchenyu
136111314d
YARN-11154. Make router support proxy server. (#5946) 2023-08-19 10:29:26 +08:00
Benjamin Teke
ebc32fbcaf
YARN-11551. RM format-conf-store should delete all the content of ZKConfigStore (#5958) 2023-08-18 12:01:56 +02:00
slfan1989
ea87aa2f5b
YARN-11037. Add configurable logic to split resource request to the least loaded SC. (#5515) 2023-08-15 13:28:29 -07:00
slfan1989
8d95c588d2
YARN-8934. [BackPort][GPG] Add JvmMetricsInfo and pause monitor. (#5929) Contributed by Bilwa S T. 2023-08-12 09:15:34 +08:00
zhengchenyu
59f3a16819
YARN-11153. Make proxy server support YARN federation. (#4314) 2023-08-11 13:02:58 -07:00
Benjamin Teke
85b3ea6f50
MAPREDUCE-7449: Add add-opens flag to container launch commands on JDK17 nodes (#5935) 2023-08-10 22:47:17 +02:00
slfan1989
df0381f236
YARN-11536. [Federation] Router CLI Supports Batch Save the SubClusterPolicyConfiguration Of Queues. (#5862) Contributed by Shilun Fan. 
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
 2023-08-10 10:27:36 +08:00
slfan1989
001d353cc5
YARN-7708. BackPort [GPG] Load based policy generator. (#5902) Contributed by Young Chen. 2023-08-05 16:33:35 +08:00
slfan1989
6d3bcaa674
YARN-7402. BackPort [GPG] Fix potential connection leak in GPGUtils. (#5901) 2023-08-05 16:29:21 +08:00
susheel-gupta
8eb58630ec
YARN-11416. FS2CS should use CapacitySchedulerConfiguration in FSQueueConverterBuilder (#5320) 
Co-authored-by: Susheel Gupta <38013283+susheelgupta7@users.noreply.github.com>
 2023-08-04 10:32:55 +02:00
Peter Szucs
6e6349c793
YARN-11545. Fixed FS2CS ACL conversion when all users are allowed. (#5910) 2023-08-03 16:29:41 +02:00
slfan1989
81b1562c32
YARN-3660. [Addendum] Fix GPG Pom.xml Typo, (#5903) 2023-08-02 11:10:24 -07:00
Benjamin Teke
030811bf85
YARN-11543: Fix checkstyle issues after YARN-11520. (#5896) 
Co-authored-by: Benjamin Teke <bteke@cloudera.com>
 2023-07-31 15:44:18 +02:00
Yang Jiandan
688f76a822
YARN-11538. CS UI: queue filter do not work as expected when submitti… (#5890) 2023-07-31 07:39:42 +08:00
slfan1989
5056c267e6
YARN-11508. [Minor] Improve UnmanagedAMPoolManager/UnmanagedApplicationManager Code (#5726) 2023-07-28 20:20:23 +08:00
slfan1989
6d32a06125
YARN-7707. BackPort [GPG] Policy generator framework. (#5810) 2023-07-28 13:41:27 +08:00
Benjamin Teke
6dafd53626
YARN-11520. Support capacity vector for AQCv2 dynamic templates. (#5871) 2023-07-27 17:33:19 +02:00
Tamas Domok
d1c52bffbd
YARN-11521. Parameterize tests runs with legacy/non-legacy queue-mode. (#5883) 2023-07-27 15:16:34 +02:00
Benjamin Teke
b1fc00d4b2
YARN-11539. Fix leaf-templates in Flexible AQC. (#5868) 2023-07-27 09:24:35 +02:00
Peter Szucs
4d4b099309
YARN-11534. Fixed exception handling when container signalling is interrupted (#5864) 2023-07-21 12:30:55 +02:00
yoonsch217
fbe9a29246
YARN-11540. Fix typo: form -> from (#5861). Contributed by Seokchan Yoon. 
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
 2023-07-21 00:38:19 +05:30
K0K0V0K
82c8070e93
YARN-9877 - Intermittent TIME_OUT of LogAggregationReport (#5784) 2023-07-20 06:30:55 +02:00
Benjamin Teke
193ff1c24e
YARN-11533. CapacityScheduler CapacityConfigType changed in legacy queue allocation mode (#5852) 
Co-authored-by: Benjamin Teke <bteke@cloudera.com>
 2023-07-20 06:26:29 +02:00
slfan1989
23ecc32d3a
YARN-11525. [Federation] Router CLI Supports Save the SubClusterPolicyConfiguration Of Queues. (#5816) 2023-07-19 11:51:47 -07:00
slfan1989
84dd624768
YARN-11531. [Federation] Code cleanup for NodeManager#amrmproxy. (#5841) 2023-07-19 11:50:38 -07:00
Xianming Lei
325f7e5fdb
YARN-11529 Add metrics for ContainerMonitorImpl. (#5828) 2023-07-13 09:50:41 +08:00
slfan1989
680af87377
YARN-11515. [Federation] Improve DefaultRequestInterceptor#init Code. (#5752) 2023-07-11 18:47:59 -07:00
slfan1989
8b88e9f8f4
YARN-11509. The FederationInterceptor#launchUAM Added retry logic. (#5727) 2023-07-11 18:47:07 -07:00
slfan1989
33b1677e9e
YARN-11524. Improve the Policy Description in Federation.md. (#5797) 2023-07-11 09:54:06 -07:00
Susheel Gupta
c13d92996d
YARN-11464: TestFSQueueConverter#testAutoCreateV2FlagsInWeightMode has a missing dot before auto-queue-creation-v2.enabled for method call assertNoValueForQueues (#5792) 
Co-authored-by: Susheel Gupta <susheel.gupta@cloudera.com>
 2023-07-11 15:20:51 +02:00
Masatake Iwasaki
a822a3c70b
YARN-11528. Lock triple-beam to the version compatible with node.js 12 to avoid compilation error. (#5827). Contributed by Masatake Iwasaki 
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
 2023-07-11 12:08:09 +05:30
Tamas Domok
a36d8adfd1
YARN-11000. Replace queue resource calculation logic in updateClusterResource (#5783) 
Contributed by: Andras Gyori, Tamas Domok, Bence Kosztolnik and Benjamin Teke

---------

Co-authored-by: Benjamin Teke <benjamin.teke@gmail.com>
 2023-07-06 10:18:14 +02:00
yl09099
178d046ce6
YARN-11526. [Client] Add a unit test to FormattingCLIUtils (#5801) 2023-07-06 09:11:13 +08:00
slfan1989
6042d59904
YARN-11090. [GPG] Support Secure Mode. (#5782) 2023-07-03 08:56:24 -07:00
slfan1989
8a52990150
YARN-11519. [Federation] Add RouterAuditLog to log4j.properties. (#5785) 2023-06-27 10:52:59 -07:00
slfan1989
a4cf4c3778
YARN-11517. Improve Federation#RouterCLI DeregisterSubCluster Code. (#5766) 2023-06-26 09:43:49 -07:00
Wei-Chiu Chuang
e239d40ab1 Post release update 
* Add jdiff xml files from 3.3.6 release.
* Declare 3.3.6 as the latest stable release.
* Copy release notes.

(cherry picked from commit 7db9895000)
(cherry picked from commit cc121e2124aa01458dc296a060edc5e21a295268)
 2023-06-26 16:08:24 +00:00