Syed Shameerur Rahman
21ec686be3
YARN-11702: Fix Yarn over allocating containers ( #6990 ) Contributed by Syed Shameerur Rahman.
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-09-25 12:10:15 +08:00
Nihal Jain
e602c601dd
HADOOP-15760. Upgrade commons-collections to commons-collections4 ( #7006 )
...
This moves Hadoop to Apache commons-collections4.
Apache commons-collections has been removed and is completely banned from the source code.
Contributed by Nihal Jain
2024-09-24 16:50:22 +01:00
Peter Szucs
b078f86d69
YARN-11733. Fix the order of updating CPU controls with cgroup v1 ( #7069 )
2024-09-24 17:13:28 +02:00
gavin.wang
f5345b881d
YARN-11560. Fix NPE bug when multi-node enabled with schedule asynchronously ( #6021 ). Contributed by wangzhongwei.
2024-09-23 13:09:15 +05:30
Arjun Mohnot
d8ca2dbe34
YARN-11730. Mark unreported nodes as LOST on RM Startup/HA failover ( #7049 ) Contributed by Arjun Mohnot.
...
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-09-23 10:46:20 +08:00
Benjamin Teke
d1311e52f7
YARN-11709. NodeManager should be marked unhealthy on localizer config issues ( #7043 )
2024-09-17 14:24:11 +02:00
Benjamin Teke
8c41fbcaf5
Revert "YARN-11709. NodeManager should be shut down or blacklisted when it ca…" ( #7028 )
...
website / build (push) Has been cancelled
This reverts commit f00094203b
2024-09-07 08:48:38 +02:00
Cheng Pan
9486844610
HADOOP-16928. Make javadoc work on Java 17 ( #6976 )
...
Contributed by Cheng Pan
2024-09-04 11:50:59 +01:00
Ayush Saxena
0837c84a9f
Revert "HADOOP-19231. Add JacksonUtil to manage Jackson classes ( #6953 )"
...
This reverts commit fa9bb0d1ac
2024-08-29 14:42:03 +05:30
PJ Fanning
59dba6e1bd
HADOOP-19134. Use StringBuilder instead of StringBuffer. ( #6692 ). Contributed by PJ Fanning
2024-08-18 21:29:12 +05:30
Ferenc Erdelyi
f00094203b
YARN-11709. NodeManager should be shut down or blacklisted when it cacannot run program /var/lib/yarn-ce/bin/container-executor ( #6960 )
2024-08-16 16:33:10 +02:00
PJ Fanning
fa9bb0d1ac
HADOOP-19231. Add JacksonUtil to manage Jackson classes ( #6953 )
...
New class org.apache.hadoop.util.JacksonUtil centralizes construction of
Jackson ObjectMappers and JsonFactories.
Contributed by PJ Fanning
2024-08-15 16:44:54 +01:00
K0K0V0K
9a9ad6cc98
YARN-11705. Turn off Node Manager working directories validation by default ( #6948 )
...
Change-Id: I011c13c79719be97c7ebc028804f1fdab5eb34c4
2024-07-18 16:55:40 +02:00
K0K0V0K
134dcf166f
YARN-11703. Validate accessibility of Node Manager working directories ( #6903 )
2024-06-27 16:21:28 +02:00
slfan1989
9710a8d52f
YARN-11701. [Federation] Enhance Federation Cache Clean Conditions. ( #6889 ) Contributed by Shilun Fan.
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2024-06-19 08:34:19 +08:00
Yang Jiandan
167d4c8447
YARN-11699. Diagnostics lacks userlimit info when user capacity has reached its maximum limit ( #6849 ) Contributed by Jiandan Yang.
...
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-06-01 06:18:28 +08:00
slfan1989
9f6c997662
YARN-11471. [Federation] FederationStateStoreFacade Cache Support Caffeine. ( #6795 ) Contributed by Shilun Fan.
...
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-06-01 06:15:20 +08:00
K0K0V0K
ccb8ff4360
YARN-11687. CGroupV2 resource calculator ( #6835 )
...
Co-authored-by: Benjamin Teke <brumi1024@users.noreply.github.com>
2024-05-29 17:20:23 +02:00
刘斌
6c08e8e2aa
HADOOP-19156. ZooKeeper based state stores use different ZK address configs. ( #6767 ). Contributed by liu bin.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
2024-05-29 20:44:36 +08:00
Peter Szucs
129d91f7b2
YARN-11692. Support mixed cgroup v1/v2 controller structure ( #6821 )
2024-05-15 16:32:49 +02:00
Benjamin Teke
ce7d01fac8
YARN-11689. Update the cgroup v2 init error handling ( #6810 )
2024-05-13 12:56:26 +02:00
Peter Szucs
910cb6b887
YARN-11685. Create a config to enable/disable cgroup v2 functionality ( #6770 )
2024-04-30 11:25:16 +02:00
Peter Szucs
08419c4233
YARN-11675. Update MemoryResourceHandler implementation for cgroup v2 support ( #6760 )
2024-04-29 16:26:18 +02:00
Benjamin Teke
399299104c
YARN-11674. Add CPUResourceHandler for cgroup v2. ( #6751 )
2024-04-26 15:00:00 +02:00
Benjamin Teke
579b3bcea9
YARN-11690. Update container executor to use CGROUP2_SUPER_MAGIC in cgroup 2 scenarios ( #6771 )
2024-04-26 13:21:29 +02:00
Tamas Domok
ecf665c6fa
YARN-11191. Fix potentional deadlock in GlobalScheduler refreshQueues ( #6732 )
2024-04-24 14:58:50 +02:00
Benjamin Teke
5d0a40c143
YARN-11672. Create a CgroupHandler implementation for cgroup v2 ( #6734 )
2024-04-24 11:33:50 +02:00
Ayush Saxena
eec9cd2997
HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 ( #6629 ). Contributed by Ayush Saxena
2024-04-22 21:55:58 +05:30
Tamas Domok
a386ac1f56
YARN-11684. Fix general contract violation in PriorityQueueComparator. ( #6725 ) Contributed by Tamas Domok.
...
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-04-19 08:37:05 +08:00
Yang Jiandan
3f8af73913
YARN-11670. Add CallerContext in NodeManager ( #6688 )
2024-04-08 22:50:41 -04:00
slfan1989
a1ae35e691
HADOOP-19135. Remove Jcache 1.0-alpha. ( #6695 ) Contributed by Shilun Fan.
...
Reviewed-by: Steve Loughran <stevel@cloudera.com>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-04-05 22:09:15 +08:00
slfan1989
5f3eb446f7
YARN-11663. [Federation] Add Cache Entity Nums Limit. ( #6662 ) Contributed by Shilun Fan.
...
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-04-02 07:47:59 +08:00
PJ Fanning
f7d1ec2d9e
HADOOP-19077. Remove use of javax.ws.rs.core.HttpHeaders ( #6554 ). Contributed by PJ Fanning
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2024-04-01 12:43:39 +05:30
PJ Fanning
06db6289cb
HADOOP-19024. Use bouncycastle jdk18 1.77 ( #6410 ). Contributed
2024-03-30 19:58:12 +05:30
PJ Fanning
97c5a6efba
HADOOP-19041. Use StandardCharsets in more places ( #6449 )
2024-03-28 23:17:18 -04:00
Junfan Zhang
f1f2abe641
YARN-11668. Fix RM crash for potential concurrent modification exception when updating node attributes ( #6681 ) Contributed by Junfan Zhang.
...
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-03-29 09:45:16 +08:00
XiaobaoWu
a375ef8cfa
YARN-11626. Optimize ResourceManager's operations on Zookeeper metadata ( #6616 )
...
Co-authored-by: wuxiaobao <xbaowu@163.com>
2024-03-21 03:12:14 -04:00
Peter Szucs
a957cd5049
YARN-5305. Allow log aggregation to discard expired delegation tokens ( #6625 )
2024-03-20 15:33:10 +01:00
Junfan Zhang
783cc3eda0
YARN-11660. Fix performance regression for SingleConstraintAppPlacementAllocator ( #6623 ) Contributed by Junfan Zhang.
...
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Reviewed-by: Dinesh Chitlangia <dineshc@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-03-15 08:14:38 +08:00
Steve Loughran
dae871e3e0
YARN-11657. Remove protobuf-2.5 from hadoop-yarn-api module ( #6575 ) ( #6580 )
...
The import of protobuf-java-2.5 in the hadoop-yarn-api module
is downgraded from "compile" to "provided"
This removes it from share/hadoop/yarn/lib/protobuf-java-2.5.0.jar
It is still found under
share/hadoop/yarn/timelineservice/lib/protobuf-java-2.5.0.jar
Contributed by Steve Loughran
2024-03-05 11:01:14 +00:00
Steve Loughran
095dfcca30
HADOOP-18088. Replace log4j 1.x with reload4j. ( #4052 )
...
Co-authored-by: Wei-Chiu Chuang <weichiu@apache.org>
Includes HADOOP-18354. Upgrade reload4j to 1.22.2 due to XXE vulnerability (#4607 ).
Log4j 1.2.17 has been replaced by reloadj 1.22.2
SLF4J is at 1.7.36
2024-02-13 16:33:51 +00:00
Eremenko Valentin
141627778d
YARN-11362: Fix several typos in YARN codebase of misspelled resource ( #6474 ) Contributed by EremenkoValentin.
...
Reviewed-by: Shilun Fan <slfan1989@apache.org>
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-02-03 19:34:42 +08:00
Yang Jiandan
98259fb4da
YARN-11653. Add Totoal_Memory and Total_Vcores columns in Nodes page ( #6501 ) Contributed by Jiandan Yang.
...
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-01-31 07:07:54 +08:00
Yang Jiandan
dffb505725
YARN-11650. Refactoring variable names related multiNodePolicy in MultiNodePolicySpec, FiCaSchedulerApp and AbstractCSQueue ( #6490 ) Contributed by Jiandan Yang.
...
Signed-off-by: Shilun Fan <slfan1989@apache.org>
2024-01-29 21:37:32 +08:00
Peter Szucs
4046751939
YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup ( #6499 )
2024-01-26 14:42:59 +01:00
Tamas Domok
7272a3d960
YARN-11641. Fix getCapacityConfigurationTypeForQueues for absolute mode with zero resource. ( #6435 )
2024-01-25 13:58:00 +01:00
slfan1989
6b80b1e60f
Revert "YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup" ( #6497 )
2024-01-25 11:44:15 +08:00
Peter Szucs
dd72e8fbc3
YARN-11041. Replace all occurences of queuePath with the new QueuePath class - followup ( #5332 )
2024-01-24 15:51:07 +01:00
Tamas Domok
af5c8e70ea
YARN-11645. Order the queues by queuePath in json assert tests. ( #6432 )
2024-01-24 10:12:24 +01:00
Ferenc Erdelyi
8243da8cb0
YARN-11639. CME and NPE in PriorityUtilizationQueueOrderingPolicy ( #6455 )
2024-01-22 15:41:48 +01:00
