Yufei Gu
|
d5e9939ebb
|
YARN-6994. [YARN-3926] Remove last uses of Long from resource types code. (Daniel Templeton via Yufei Gu)
|
2017-09-12 09:19:11 -07:00 |
|
Daniel Templeton
|
5c4ab4c291
|
YARN-6935. [YARN-3926] ResourceProfilesManagerImpl.parseResource() has no need of the key parameter
(Contributed by Manikandan R via Daniel Templeton)
|
2017-09-12 09:19:11 -07:00 |
|
Daniel Templeton
|
3aeaafecb8
|
YARN-6788. [YARN-3926] Improve performance of resource profile branch
(Contributed by Sunil Govindan via Daniel Templeton)
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
4e5632d28e
|
YARN-6786. [YARN-3926] ResourcePBImpl imports cleanup. Contributed by Yeliang Cang.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
ca2808d8bb
|
YARN-6761. Fix build for YARN-3926 branch. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
58da54640e
|
YARN-6445. [YARN-3926] Performance improvements in resource profile branch with respect to SLS. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
dae65f3bef
|
YARN-6232. Update resource usage and preempted resource calculations to take into account all resource types. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Sunil G
|
7805deed48
|
YARN-5588. [YARN-3926] Add support for resource profiles in distributed shell. Contributed by Varun Vasudev.
|
2017-09-12 09:19:11 -07:00 |
|
Arun Suresh
|
6708ac3301
|
YARN-5587. Add support for resource profiles. (vvasudev via asuresh)
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
c2032e251e
|
YARN-5708. Implement APIs to get resource profiles from the RM. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
a9b4426302
|
YARN-5707. Add manager class for resource profiles. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Rohith Sharma K S
|
239c1824a0
|
YARN-5586. Update the Resources class to consider all resource types. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Rohith Sharma K S
|
9e4ba6aff5
|
YARN-5242. Update DominantResourceCalculator to consider all resource types in calculations. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
759114b006
|
YARN-4830. Add support for resource types in the nodemanager. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Arun Suresh
|
7ba698997b
|
YARN-4829. Add support for binary units in Resource class.(vvasudev via asuresh)
|
2017-09-12 09:19:10 -07:00 |
|
Varun Vasudev
|
ceb12c59a3
|
YARN-4715. Add support to read resource types from a config file. Contributed by Varun Vasudev.
|
2017-09-12 09:19:10 -07:00 |
|
Wangda Tan
|
32c91223f1
|
YARN-4172. Extend DominantResourceCalculator to account for all resources. (Varun Vasudev via wangda)
|
2017-09-12 09:19:09 -07:00 |
|
Wangda Tan
|
1bbab7c157
|
YARN-4081. Add support for multiple resource types in the Resource class. (Varun Vasudev via wangda)
|
2017-09-12 09:19:09 -07:00 |
|
Wangda Tan
|
e74d1be04b
|
YARN-7173. Container update RM-NM communication fix for backward compatibility. (Arun Suresh via wangda)
Change-Id: I1c39ed5c59dee739ba5044b61b3ef5ed203b79c1
|
2017-09-11 20:52:08 -07:00 |
|
Haibo Chen
|
fa531788fd
|
YARN-7132. FairScheduler.initScheduler() contains a surprising unary plus. (Yeliang Cang via Haibo Chen)
|
2017-09-11 20:42:49 -07:00 |
|
Haibo Chen
|
661f5eb0c6
|
YARN-7128. The error message in TimelineSchemaCreator is not enough to find out the error. (Jinjiang Ling via Haibo Chen)
|
2017-09-11 16:20:20 -07:00 |
|
Daniel Templeton
|
6651cbcc72
|
YARN-6622. Document Docker work as experimental (Contributed by Varun Vasudev)
|
2017-09-11 16:14:31 -07:00 |
|
Daniel Templeton
|
07951b586e
|
Revert "YARN-6022. Document Docker work as experimental (Contributed by Varun Vasudev)"
This reverts commit 66be6c848b.
|
2017-09-11 16:14:18 -07:00 |
|
Daniel Templeton
|
66be6c848b
|
YARN-6022. Document Docker work as experimental (Contributed by Varun Vasudev)
|
2017-09-11 15:46:23 -07:00 |
|
Yufei Gu
|
5ab21dfe9c
|
YARN-6799. Remove the duplicated code in CGroupsHandlerImp.java. (Contributed by Weiyuan via Yufei Gu)
|
2017-09-10 23:17:59 -07:00 |
|
Sunil G
|
722ee84194
|
YARN-7163. RMContext need not to be injected to webapp and other Always Running services. Contributed by Rohith Sharma K S.
|
2017-09-11 10:28:10 +05:30 |
|
Junping Du
|
3fddabc2fe
|
YARN-7072. Add a new log aggregation file format controller. Contributed by Xuan Gong.
|
2017-09-08 15:16:19 -07:00 |
|
Haibo Chen
|
8edc60531f
|
HADOOP-14847. Remove Guava Supplier and change to java Supplier in AMRMClient and AMRMClientAysnc. (Bharat Viswanadham via Haibo Chen)
|
2017-09-08 14:33:11 -07:00 |
|
Arun Suresh
|
1f53ae7972
|
YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh)
|
2017-09-08 09:24:05 -07:00 |
|
Rohith Sharma K S
|
4a83170be4
|
YARN-7140. CollectorInfo should have Public visibility. Contributed by Varun Saxena.
|
2017-09-08 20:23:16 +05:30 |
|
Rohith Sharma K S
|
0bfb3a2566
|
YARN-7130. ATSv2 documentation changes post merge. Contributed by Varun Saxena.
|
2017-09-08 20:21:50 +05:30 |
|
Sunil G
|
ab8368d2e0
|
YARN-7104. Improve Nodes Heatmap in new YARN UI with better color coding. Contributed by Da Ding.
|
2017-09-08 16:16:01 +05:30 |
|
Subru Krishnan
|
fa6137501c
|
YARN-5330. SharingPolicy enhancements required to support recurring reservations in ReservationSystem. (Carlo Curino via Subru).
|
2017-09-07 19:07:17 -07:00 |
|
Sunil G
|
56d93d2e39
|
YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S.
|
2017-09-08 07:15:17 +05:30 |
|
Jason Lowe
|
b0b535d9d5
|
YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf
|
2017-09-07 16:17:03 -05:00 |
|
Wangda Tan
|
f155ab7cfa
|
YARN-7033. Add support for NM Recovery of assigned resources (e.g. GPU's, NUMA, FPGA's) to container. (Devaraj K and Wangda Tan)
Change-Id: Iffd18bb95debe1c8cc55e30abc1d8f663e9d0e30
|
2017-09-07 14:13:37 -07:00 |
|
Arun Suresh
|
c41118a7f8
|
YARN-6978. Add updateContainer API to NMClient. (Kartheek Muthyala via asuresh)
|
2017-09-07 10:23:12 -07:00 |
|
Sunil G
|
6f101e7df1
|
YARN-6992. Kill application button is visible even if the application is FINISHED in RM UI. Contributed by Suma Shivaprasad.
|
2017-09-07 13:16:20 +05:30 |
|
Subru Krishnan
|
b6e7d13696
|
YARN-5328. Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-06 16:46:01 -07:00 |
|
Subru Krishnan
|
e3345e985b
|
Revert "Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem."
This reverts commit 7996eca7dc.
|
2017-09-06 16:39:23 -07:00 |
|
Junping Du
|
22de9449f8
|
YARN-7144. Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader. Contributed by Xuan Gong.
|
2017-09-06 14:53:31 -07:00 |
|
Jason Lowe
|
704267cb49
|
YARN-7164. TestAMRMClientOnRMRestart fails sporadically with bind address in use. Contributed by Jason Lowe
|
2017-09-06 15:23:49 -05:00 |
|
Junping Du
|
63231a2a30
|
YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc error. Contributed by Xuan Gong.
|
2017-09-06 13:19:34 -07:00 |
|
Sunil G
|
ed162b7aa0
|
YARN-7022. Improve click interaction in queue topology in new YARN UI. Contributed by Abdullah Yousufi.
|
2017-09-05 08:06:43 +05:30 |
|
Varun Saxena
|
ef87d34a0e
|
YARN-7152. [ATSv2] Registering timeline client before AMRMClient service init throw exception (Rohith Sharma K S via Varun Saxena)
|
2017-09-04 20:11:02 +05:30 |
|
Sunil G
|
275980bb1e
|
YARN-7075. Better styling for donut charts in new YARN UI. Contributed by Da Ding.
|
2017-09-02 08:08:59 +05:30 |
|
Subru Krishnan
|
7996eca7dc
|
Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem.
|
2017-09-01 15:16:40 -07:00 |
|
Oleg Danilov
|
c5281a85e1
|
YARN-7023. Incorrect ReservationId.compareTo() implementation.
This closes #262
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2017-09-01 21:33:31 +02:00 |
|
Andrew Wang
|
0d419c984f
|
Preparing for 3.1.0 development
|
2017-09-01 11:53:48 -07:00 |
|
Jason Lowe
|
99a7f5d451
|
YARN-7120. CapacitySchedulerPage NPE in "Aggregate scheduler counts" section. Contributed by Eric Payne
|
2017-09-01 11:09:14 -05:00 |
|
Sunil G
|
a756704f5a
|
YARN-7071. Add vcores and number of containers in new YARN UI node heat map. Contributed by Abdullah Yousufi.
|
2017-09-01 20:46:39 +05:30 |
|
bibinchundatt
|
dcd0bedcc8
|
YARN-7141. Move logging APIs to slf4j in timelineservice after ATSv2 merge. Contributed by Varun Saxena
|
2017-09-01 11:29:16 +05:30 |
|
Allen Wittenauer
|
0adc3a0533
|
YARN-6721. container-executor should have stack checking
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-31 19:39:31 -07:00 |
|
Allen Wittenauer
|
190410085b
|
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
Signed-off-by: Andrew Wang <wang@apache.org>
|
2017-08-31 19:06:49 -07:00 |
|
Junping Du
|
91cc070d67
|
YARN-6877. Create an abstract log reader for extendability. Contributed by Xuan Gong.
|
2017-08-31 16:41:43 -07:00 |
|
Subru Krishnan
|
bac4e8cca8
|
YARN-7095. Federation: routing getNode/getNodes/getMetrics REST invocations transparently to multiple RMs. (Giovanni Matteo Fumarola via Subru).
|
2017-08-31 15:05:41 -07:00 |
|
Daniel Templeton
|
d4417dae4f
|
YARN-6780. ResourceWeights.toString() cleanup (Contributed by weiyuan via Daniel Templeton)
|
2017-08-31 09:35:01 -07:00 |
|
Sunil G
|
f9e0cc8cdc
|
YARN-7116. CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage. Contributed by Wangda Tan.
|
2017-08-31 18:42:01 +05:30 |
|
Allen Wittenauer
|
71bbb86d69
|
HADOOP-14670. Increase minimum cmake version for all platforms
Signed-off-by: Chris Douglas <cdouglas@apache.org>
|
2017-08-30 21:47:24 -07:00 |
|
Robert Kanter
|
ce79f7be29
|
YARN-7094. Document the current known issue with server-side NM graceful decom (rkanter)
|
2017-08-30 18:04:55 -07:00 |
|
Daniel Templeton
|
cc23514aba
|
YARN-7115. Move BoundedAppender to org.hadoop.yarn.util pacakge
(Contributed by Jian He via Daniel Templeton)
|
2017-08-30 17:26:13 -07:00 |
|
Haibo Chen
|
a20e7105ea
|
YARN-6868. Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml. (Ray Chiang via Haibo Chen)
|
2017-08-30 09:14:59 -07:00 |
|
Varun Saxena
|
3d00c8f394
|
Made fixes for whitespace errors and checstyle warnings before merge.
|
2017-08-30 11:29:54 +05:30 |
|
Varun Saxena
|
512068a01f
|
YARN-6905. Addendum to fix TestTimelineReaderWebServicesHBaseStorage due to missing FastNumberFormat
|
2017-08-30 11:29:54 +05:30 |
|
Varun Saxena
|
16ba4f544f
|
MAPREDUCE-6838. Addendum to fix code comment
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
08f40bcc7f
|
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
|
2017-08-30 11:29:54 +05:30 |
|
Vrushali C
|
bea3e4df76
|
YARN-6047 Documentation updates for TimelineService v2 (Contributed by Rohith Sharma)
|
2017-08-30 11:29:54 +05:30 |
|
Haibo Chen
|
9b08f365d7
|
YARN-6323. Rolling upgrade/config change is broken on timeline v2. (Vrushali C via Haibo Chen)
|
2017-08-30 11:29:54 +05:30 |
|
Varun Saxena
|
b2efebdd07
|
YARN-6861. Reader API for sub application entities (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
7fd6ae2479
|
YARN-6134. [ATSv2 Security] Regenerate delegation token for app just before token expires if app collector is active. Contributed by Varun Saxena
|
2017-08-30 11:29:54 +05:30 |
|
Rohith Sharma K S
|
e276c75ec1
|
YARN-7041. Nodemanager NPE running jobs with security off. Contributed by Varun Saxena.
|
2017-08-30 11:29:54 +05:30 |
|
Rohith Sharma K S
|
32188d3295
|
YARN-7038. [Atsv2 Security] CollectorNodemanagerProtocol RPC interface doesn't work when service authorization is enabled. Contributed by Varun Saxena.
|
2017-08-30 11:29:54 +05:30 |
|
Jian He
|
b664569586
|
YARN-7006. [ATSv2 Security] Changes for authentication for CollectorNodemanagerProtocol. Contributed by Varun Saxena
|
2017-08-30 11:29:53 +05:30 |
|
Jason Lowe
|
d5ff965fee
|
YARN-6820. Restrict read access to timelineservice v2 data. Contributed by Vrushali C
|
2017-08-30 11:29:53 +05:30 |
|
Varun Saxena
|
60765aff9b
|
YARN-6874. Supplement timestamp for min start/max end time columns in flow run table to avoid overwrite (Vrushali C via Varun Saxena)
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
354be99dbf
|
YARN-6133. [ATSv2 Security] Renew delegation token for app automatically if an app collector is active. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
7594d1de7b
|
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|
Varun Saxena
|
9f6540535d
|
YARN-6734. Ensure sub-application user is extracted & sent to timeline service (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
3fb71b1393
|
YARN-6888. Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created. Contributed by Vrushali C.
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
a990ff70c2
|
YARN-6733. Add table for storing sub-application entities. Contributed by Vrushali C.
|
2017-08-30 11:29:53 +05:30 |
|
Vrushali C
|
61136d03f2
|
YARN-6850 Ensure that supplemented timestamp is stored only for flow run metrics (Contributed by Varun Saxena via Vrushali C)
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
70078e91e3
|
YARN-4455. Support fetching metrics by time range. Contributed by Varun Saxena.
|
2017-08-30 11:29:53 +05:30 |
|
Rohith Sharma K S
|
660413165a
|
YARN-6801. NPE in RM while setting collectors map in NodeHeartbeatResponse. Contributed by Vrushali C.
|
2017-08-30 11:29:53 +05:30 |
|
Jian He
|
ac7f52df83
|
YARN-5648. [ATSv2 Security] Client side changes for authentication. Contributed by Varun Saxena
|
2017-08-30 11:29:53 +05:30 |
|
Jian He
|
d3f11e3f13
|
YARN-6638. [ATSv2 Security] Timeline reader side changes for loading auth filters and principals. Contributed by Varun Saxena
|
2017-08-30 11:29:53 +05:30 |
|
Jian He
|
879de51206
|
YARN-5647. [ATSv2 Security] Collector side changes for loading auth filters and principals. Contributed by Varun Saxena
|
2017-08-30 11:29:53 +05:30 |
|
vrushali
|
24447b3626
|
YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C)
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
f6a51dce18
|
YARN-6658. Remove columnFor() methods of Columns in HBaseTimeline backend (Haibo Chen via Varun Saxena)
|
2017-08-30 11:29:52 +05:30 |
|
Haibo Chen
|
a8f082a180
|
YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)
(cherry picked from commit 47474fffac)
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
b87b72b40a
|
YARN-6146. Add Builder methods for TimelineEntityFilters (Haibo Chen via Varun Saxena)
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
44999aabc2
|
YARN-6318. timeline service schema creator fails if executed from a remote machine (Sangjin Lee via Varun Saxena)
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
18b3a80df7
|
YARN-6237. Move UID constant to TimelineReaderUtils (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
c3bd8d6ad3
|
YARN-6256. Add FROM_ID info key for timeline entities in reader response (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
8bb2646595
|
YARN-6027. Support fromid(offset) filter for /flows API (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:52 +05:30 |
|
Sangjin Lee
|
cf30b3b914
|
YARN-6253. FlowAcitivityColumnPrefix.store(byte[] rowKey, ...) drops timestamp. Contributed by Haibo Chen.
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
ff43b8db7a
|
YARN-6069. CORS support in timeline v2 (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:52 +05:30 |
|
Sangjin Lee
|
ccb38c1991
|
YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.
|
2017-08-30 11:29:52 +05:30 |
|
Sangjin Lee
|
580d884913
|
YARN-6094. Update the coprocessor to be a dynamically loaded one. Contributed by Vrushali C.
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
5e0acee75e
|
Addendum for YARN-6064. Support fromId for flowRuns and flow/flowRun apps REST API's
|
2017-08-30 11:29:52 +05:30 |
|
Varun Saxena
|
6f65cf27bb
|
YARN-6064. Support fromId for flowRuns and flow/flowRun apps REST API's (Rohith Sharma K S via Varun Saxena)
|
2017-08-30 11:29:51 +05:30 |
|