big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,894 Commits 2 Branches 2 Tags 264 MiB
72dd79015a
Commit Graph

145 Commits

Author SHA1 Message Date
Giovanni Matteo Fumarola
358e928622 YARN-999. In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task. Addendum. Contributed by Inigo Goiri. 2019-04-09 14:18:05 -07:00
bibinchundatt
779dae4de7 YARN-9309. Improve graph text in SLS to avoid overlapping. Contributed by Bilwa S T. 2019-02-20 00:36:57 +05:30
bibinchundatt
134ae8fc80 YARN-9293. Optimize MockAMLauncher event handling. Contributed by Bibin A Chundatt. 2019-02-14 22:56:52 +05:30
Eric Yang
f82922dcfa YARN-5168. Added exposed port information for Docker container. 
Contributed by Xun Liu
 2018-12-21 19:44:07 -05:00
bibinchundatt
b4a38e7b3e YARN-8830. SLS tool fix node addition. Contributed by Bibin A Chundatt. 2018-10-15 16:10:25 +05:30
bibinchundatt
c44088ac19 YARN-8739. Fix jenkins issues for Node Attributes branch. Contributed by Sunil Govindan. 2018-09-12 16:01:01 +05:30
Naganarasimha
eb08543c7a YARN-8103. Add CLI interface to query node attributes. Contributed by Bibin A Chundatt. 2018-09-12 16:01:01 +05:30
Sunil G
89b3ebd11e YARN-8092. Expose Node Attributes info via RM nodes REST API. Contributed by Weiwei Yang. 2018-09-12 16:01:00 +05:30
Yufei Gu
8563fd67be YARN-8632. Threads in SLS quit without logging exception. Contributed by Xianghao Lu. 2018-08-24 11:23:17 -07:00
Akira Ajisaka
3e3963b035
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering. 2018-08-16 00:31:59 +09:00
Inigo Goiri
9fea5c9ee7 YARN-8175. Add support for Node Labels in SLS. Contributed by Abhishek Modi. 2018-07-31 09:36:34 -07:00
bibinchundatt
3d3158cea4 YARN-8577. Fix the broken anchor in SLS site-doc. Contributed by Weiwei Yang. 2018-07-25 18:59:05 +05:30
Wangda Tan
752dcce5f4 YARN-8511. When AM releases a container, RM removes allocation tags before it is released by NM. (Weiwei Yang via wangda) 
Change-Id: I6f9f409f2ef685b405cbff547dea9623bf3322d9
 2018-07-16 10:54:41 -07:00
Jitendra Pandey
f4c7c91123 HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh Jain, Mukul Kumar Singh and Sunil Govindan. 2018-06-13 00:36:02 -07:00
Inigo Goiri
c35481594f YARN-8422. TestAMSimulator failing with NPE. Contributed by Giovanni Matteo Fumarola. 2018-06-12 10:59:50 -07:00
Weiwei Yang
ba2db39c65 YARN-8152. Add chart in SLS to illustrate the throughput of the scheduler. Contributed by Tao Yang. 2018-04-27 15:36:21 +08:00
Owen O'Malley
2adda92de1
HDFS-7240 git commit fixup 
Signed-off-by: Owen O'Malley <omalley@apache.org>
 2018-04-26 13:52:17 -07:00
Akira Ajisaka
3e2ca23a53 HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Inigo Goiri
fd24fd0ff7 YARN-8137. Parallelize node addition in SLS. Contributed by Abhishek Modi. 2018-04-20 09:09:12 -07:00
Inigo Goiri
78860372bd YARN-8134. Support specifying node resources in SLS. Contributed by Abhishek Modi. 2018-04-17 13:11:34 -07:00
Haibo Chen
fcea5a4d79 YARN-7794. SLSRunner is not loading timeline service jars, causing failure. (Yufei Gu via Haibo Chen) 2018-03-26 14:30:11 -07:00
Weiwei Yang
7af4f34de5 YARN-7929. Support to set container execution type in SLS. (Jiandan Yang via Weiwei Yang) 2018-02-28 17:58:09 +08:00
Carlo Curino
84cea0011f YARN-7732. Support Generic AM Simulator from SynthGenerator. (Contributed by Young Chen via curino) 2018-02-20 17:00:34 -08:00
fang zhenyi
4d4dde5112
HADOOP-15223. Replace Collections.EMPTY* with empty* when available 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-02-18 22:19:39 +09:00
Anu Engineer
4304fcd5bd HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen. 2018-02-06 13:43:45 -08:00
Sunil G
9b81cb0537 YARN-7779. Display allocation tags in RM web UI and expose same through REST API. Contributed by Weiwei Yang. 2018-01-31 01:30:17 -08:00
Arun Suresh
38af237969 YARN-6599. Support anti-affinity constraint via AppPlacementAllocator. (Wangda Tan via asuresh) 2018-01-31 01:30:17 -08:00
Jason Lowe
ff8378eb1b YARN-7102. NM heartbeat stuck when responseId overflows MAX_INT. Contributed by Botong Huang 2018-01-25 17:47:19 -06:00
Yufei Gu
16be42d309 YARN-7798. Refactor SLS Reservation Creation. Contributed by Young Chen. 2018-01-25 13:06:01 -08:00
Daniel Templeton
ba8136615a YARN-7413. Support resource type in SLS (Contributed by Yufei Gu via Daniel Templeton) 
Change-Id: Ic0a897c123c5d2f57aae757ca6bcf1dad7b90d2b
 2017-11-09 12:09:48 -08:00
Yufei Gu
99880d0a16 YARN-6505. Define the strings used in SLS JSON input file format. (Contributed by Gergely Novak) 2017-10-27 14:41:37 -07:00
Wangda Tan
281d83604d YARN-7318. Fix shell check warnings of SLS. (Gergely Novák via wangda) 2017-10-20 15:54:15 -07:00
Haibo Chen
46eb1033a8 YARN-6546. SLS is slow while loading 10k queues. (Yufei Gu via Haibo Chen) 2017-10-17 16:04:19 -07:00
Haibo Chen
c071aad5da YARN-7009. TestNMClient.testNMClientNoCleanupOnStop is flaky by design. (Miklos Szegedi via Haibo Chen) 2017-10-05 15:50:13 -07:00
Yufei Gu
79e37dc6db YARN-7211. AMSimulator in SLS does't work due to responseId refactoring.(Contributed by Botong Huang via Yufei Gu) 2017-10-03 15:10:50 -07:00
Akira Ajisaka
c9b525bd94
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari. 2017-10-04 07:01:54 +09:00
Yufei Gu
26fafc3597 YARN-7077. TestAMSimulator and TestNMSimulator fail. (Contributed by Akira Ajisaka via Yufei Gu) 2017-08-29 16:33:51 -07:00
Arun Suresh
8410d862d3 YARN-6979. Add flag to notify all types of container updates to NM via NodeHeartbeatResponse. (Kartheek Muthyala via asuresh) 2017-08-20 07:54:09 -07:00
Haibo Chen
0ba8cda135 YARN-6685. Add job count in to SLS JSON input format. (Yufei Gu via Haibo Chen) 2017-07-20 08:15:46 -07:00
Haibo Chen
147df300bf YARN-5067 Support specifying resources for AM containers in SLS. (Yufei Gu via Haibo Chen) 2017-06-30 17:03:44 -07:00
Akira Ajisaka
3369540653
HADOOP-14296. Move logging APIs over to slf4j in hadoop-tools. 2017-06-20 13:18:26 +09:00
Carlo Curino
b65100c14b YARN-6547. Enhance SLS-based tests leveraging invariant checker. 2017-06-06 17:19:15 -07:00
Yufei Gu
fcbdecc54d YARN-6111. Rumen input does't work in SLS. Contributed by Yufei Gu. 2017-05-21 21:04:06 -07:00
Sunil G
40e6a85d25 YARN-6560. SLS doesn't honor node total resource specified in sls-runner.xml. Contributed by Wangda Tan. 2017-05-18 22:49:42 +05:30
Robert Kanter
101852ca11 YARN-6535. Program needs to exit when SLS finishes. (yufeigu via rkanter) 2017-05-16 17:52:17 -07:00
Carlo Curino
5cb6e3e082 YARN-6473. Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations. 2017-05-10 14:49:25 -07:00
Akira Ajisaka
2ba9903932
HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang. 2017-05-10 05:57:12 -05:00
Robert Kanter
3082552b3b YARN-6522. Make SLS JSON input file format simple and scalable (yufeigu via rkanter) 2017-05-04 17:21:46 -07:00
Robert Kanter
475f933b41 YARN-6423. Queue metrics doesn't work for Fair Scheduler in SLS (yufeigu via rkanter) 2017-04-25 16:26:09 -07:00
Wangda Tan
de69d6e811 YARN-6363. Extending SLS: Synthetic Load Generator. (Carlo Curino via wangda) 2017-04-20 21:54:30 -07:00