Zhijie Shen
|
f0e752c14b
|
YARN-3264. Created backing storage write interface and a POC only FS based storage implementation. Contributed by Vrushali C.
(cherry picked from commit 821b68d05d246fd57d7b7286eb2ccc075ed1eae8)
|
2016-07-10 08:45:30 -07:00 |
|
Zhijie Shen
|
bf54d32750
|
YARN-3210. Refactored timeline aggregator according to new code organization proposed in YARN-3166. Contributed by Li Lu.
(cherry picked from commit d3ff7f06cbc66d3a23c2551e7d4c752689f46afe)
|
2016-07-10 08:45:30 -07:00 |
|
Zhijie Shen
|
d45ff878c4
|
YARN-3125. Made the distributed shell use timeline service next gen and add an integration test for it. Contributed by Junping Du and Li Lu.
(cherry picked from commit bf08f7f0ed4900ce52f98137297dd1a47ba2a536)
|
2016-07-10 08:45:30 -07:00 |
|
Zhijie Shen
|
9d57c9c015
|
YARN-3087. Made the REST server of per-node aggregator work alone in NM daemon. Conntributed by Li Lu.
(cherry picked from commit 41a08ad404d4278fe598d6c222b2ae0e84bae0df)
|
2016-07-10 08:45:29 -07:00 |
|
Zhijie Shen
|
309592b9e5
|
YARN-3240. Added ".keep" file which was missed before.
(cherry picked from commit 6b4dc96414b3f15537670c67a0dccd048862f4f4)
|
2016-07-10 08:45:29 -07:00 |
|
Junping Du
|
4f0c7eaff3
|
YARN-3240. Implement client API to put generic entities. Contributed by Zhijie Shen
(cherry picked from commit 4487da249f448d5c67b712cd0aa723e764eed77d)
|
2016-07-10 08:45:29 -07:00 |
|
Zhijie Shen
|
c77f86bf63
|
YARN-3041. Added the overall data model of timeline service next gen. Contributed by Zhijie Shen.
(cherry picked from commit fdff5d2625c129c20c44f90a0517b28cee1522bd)
|
2016-07-10 08:45:29 -07:00 |
|
Zhijie Shen
|
7c8abec0a8
|
YARN-3030. Set up TS aggregator with basic request serving structure and lifecycle. Contributed by Sangjin Lee.
(cherry picked from commit f26941b39028ac30c77547e2be2d657bb5bf044a)
|
2016-07-10 08:45:28 -07:00 |
|
Zhijie Shen
|
0d2da08f35
|
YARN-3063. Bootstrapping TimelineServer next generation module. Contributed by Zhijie Shen.
(cherry picked from commit fe7d0e7c8fc88e0721b18e1531b0899d9dbed296)
|
2016-07-10 08:45:28 -07:00 |
|
Junping Du
|
9bdb5bebea
|
Fix OOM issue in DistributedShell. Contributed by Jian He.
|
2016-07-09 05:09:53 -07:00 |
|
Varun Saxena
|
c04c5ec501
|
YARN-5318. Fix intermittent test failure of TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider. (Jun Gong via Varun Saxena).
|
2016-07-09 01:13:18 +05:30 |
|
Varun Saxena
|
5252562edf
|
YARN-5297. Avoid printing a stack trace when recovering an app after the RM restarts. (Junping Du via Varun Saxena).
|
2016-07-09 00:09:25 +05:30 |
|
Junping Du
|
30ee57ceb1
|
YARN-4939. The decommissioning Node should keep alive during NM restart. Contributed by sandflee.
|
2016-07-08 04:14:53 -07:00 |
|
Vinod Kumar Vavilapalli
|
673e5e02fe
|
YARN-5314. Fixed a ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore. Contributed by Li Lu.
|
2016-07-07 22:37:29 -07:00 |
|
Allen Wittenauer
|
a0035661c1
|
HADOOP-13349. HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH (aw)
|
2016-07-07 14:15:34 -07:00 |
|
Jian He
|
8a9d293dd6
|
YARN-5233. Support for specifying a path for ATS plugin jars. Contributed by Li Lu
|
2016-07-06 16:44:46 -07:00 |
|
Vinod Kumar Vavilapalli
|
4c9e1aeb94
|
YARN-5224. Added new web-services /containers/{containerid}/logs & /containers/{containerid}/logs/{filename} and using them in "yarn logs" CLI to get logs of finished containers of a running application. Contributed by Xuan Gong.
|
2016-07-06 14:10:54 -07:00 |
|
Jian He
|
d169f5052f
|
YARN-5227. Yarn logs command: no need to specify applicationId when
specifying containerId. Contributed by Gergely Novák
|
2016-07-06 10:43:27 -07:00 |
|
Wangda Tan
|
04f6ebb66a
|
YARN-5294. Pass remote ip address down to YarnAuthorizationProvider. (Jian He via wangda)
|
2016-07-06 10:36:48 -07:00 |
|
Jian He
|
d792a90206
|
YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du
|
2016-07-05 18:05:16 -07:00 |
|
Vinod Kumar Vavilapalli
|
ce9c006430
|
YARN-5214. Fixed locking in DirectoryCollection to avoid hanging NMs when various code-paths hit slow disks. Contributed by Junping Du.
|
2016-07-05 16:07:28 -07:00 |
|
Varun Saxena
|
8e672e3c71
|
YARN-5286. Add RPC port info in RM web service's response when getting app status. (Jun Gong via Varun Saxena).
|
2016-07-05 22:56:07 +05:30 |
|
Ray Chiang
|
0a5def155e
|
YARN-4568. Fix message when NodeManager runs into errors initializing the recovery directory. (rchiang)
|
2016-07-01 15:53:46 -07:00 |
|
Jian He
|
c35a5a7a8d
|
YARN-5023. TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails. Contributed by sandflee
|
2016-07-01 14:29:03 -07:00 |
|
Varun Saxena
|
8ade81228e
|
YARN-5282. Fix typos in CapacityScheduler documentation. (Ray Chiang via Varun Saxena).
|
2016-07-01 11:38:32 +05:30 |
|
Varun Saxena
|
abe7fc22c1
|
YARN-5182. MockNodes.newNodes creates one more node per rack than requested. (Karthik Kambatla via Varun Saxena).
|
2016-06-30 00:13:28 +05:30 |
|
Rohith Sharma K S
|
26b5e6116f
|
YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat.
|
2016-06-29 10:08:30 +05:30 |
|
Allen Wittenauer
|
23c3ff85a9
|
HADOOP-13209. replace slaves with workers (John Smith via aw)
|
2016-06-28 05:53:03 -07:00 |
|
Akira Ajisaka
|
a8a48c9125
|
YARN-5278. Remove unused argument in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration. Contributed by Tao Jie.
|
2016-06-23 14:28:12 +09:00 |
|
Xuan
|
6ab5aa1c1f
|
YARN-5266. Wrong exit code while trying to get app logs using regex via CLI. Contributed by Xuan Gong
|
2016-06-22 21:48:49 -07:00 |
|
Arun Suresh
|
99e5dd68d0
|
YARN-5171. Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node. (Inigo Goiri via asuresh)
|
2016-06-22 19:04:54 -07:00 |
|
Tsuyoshi Ozawa
|
5d58858bb6
|
HADOOP-9613. [JDK8] Update jersey version to latest 1.x release.
|
2016-06-21 08:05:32 +09:00 |
|
Sangjin Lee
|
5107a967fa
|
YARN-4958. The file localization process should allow for wildcards to reduce the application footprint in the state store (Daniel Templeton via sjlee)
|
2016-06-20 09:56:53 -07:00 |
|
Junping Du
|
d0162f2040
|
YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev.
|
2016-06-19 17:44:54 -07:00 |
|
Karthik Kambatla
|
20f2799938
|
YARN-5077. Fix FSLeafQueue#getFairShare() for queues with zero fairshare. (Yufei Gu via kasha)
|
2016-06-17 22:24:42 -07:00 |
|
Karthik Kambatla
|
fbbe0bb627
|
YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit. Addendum to fix javac warning. (Arun Suresh via kasha)
|
2016-06-17 22:12:50 -07:00 |
|
Junping Du
|
c35fa4a0e5
|
YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong.
|
2016-06-17 08:24:24 -07:00 |
|
Junping Du
|
e14ee0d3b5
|
YARN-5083. YARN CLI for AM logs does not give any error message if entered invalid am value. Contributed by Jian He.
|
2016-06-16 08:55:56 -07:00 |
|
Junping Du
|
5dfc38ff57
|
YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong.
|
2016-06-15 16:17:54 -07:00 |
|
Varun Vasudev
|
25064fb2fb
|
YARN-5223. Container line in yarn logs output for a live application should include the hostname for the container. Contributed by Xuan Gong.
|
2016-06-15 12:42:44 +05:30 |
|
Varun Vasudev
|
d6284428e8
|
YARN-5122. "yarn logs" for running containers should print an explicit footer saying that the log may be incomplete. Contributed by Jian He.
|
2016-06-15 12:35:17 +05:30 |
|
Wangda Tan
|
c77a1095dc
|
YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)
|
2016-06-14 15:06:38 -07:00 |
|
Wangda Tan
|
eec835ec17
|
YARN-4887. Add allocation request ID to AM-RM protocol for identifying resource-requests explicitly. (Subru Krishnan via wangda)
|
2016-06-13 21:57:33 -07:00 |
|
Rohith Sharma K S
|
28b66ae919
|
YARN-4989. TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently. Contributed by Ajith S.
|
2016-06-13 11:09:32 +05:30 |
|
Arun Suresh
|
7dae2b3bc4
|
YARN-5212. Run existing ContainerManager tests using QueuingContainerManagerImpl. (Konstantinos Karanasos via asuresh)
|
2016-06-12 10:05:37 -07:00 |
|
Arun Suresh
|
5143277958
|
YARN-5124. Modify AMRMClient to set the ExecutionType in the ResourceRequest. (asuresh)
|
2016-06-12 09:42:38 -07:00 |
|
Arun Suresh
|
5279af7cd4
|
YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit (sandflee via asuresh)
|
2016-06-10 22:33:42 -07:00 |
|
Rohith Sharma K S
|
e0f4620cc7
|
YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe.
|
2016-06-11 10:22:27 +05:30 |
|
Wangda Tan
|
03fc6b1bb0
|
YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)
|
2016-06-10 09:51:09 -07:00 |
|
Wangda Tan
|
244506f9c8
|
YARN-5208. Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled. (Rohith Sharma K S via wangda)
|
2016-06-10 09:34:32 -07:00 |
|
Vinod Kumar Vavilapalli
|
9378d9428f
|
YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv)
|
2016-06-09 12:30:58 -07:00 |
|
Naganarasimha
|
1500a0a300
|
YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G
|
2016-06-09 05:41:09 +05:30 |
|
Vinod Kumar Vavilapalli
|
5a43583c0b
|
YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong
|
2016-06-08 09:49:55 -07:00 |
|
Arun Suresh
|
3344ba70e0
|
YARN-5204. Properly report status of killed/stopped queued containers. (Konstantinos Karanasos via asuresh)
|
2016-06-08 08:31:32 -07:00 |
|
Jason Lowe
|
8c8a377cac
|
YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran
|
2016-06-08 14:11:25 +00:00 |
|
Arun Suresh
|
76f0800c21
|
YARN-5176. More test cases for queuing of containers at the NM. (Konstantinos Karanasos via asuresh)
|
2016-06-07 17:16:18 -07:00 |
|
Xuan
|
58be55b6e0
|
YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and
FileInputStream in NMWebServices#getLogs. Contributed by Xuan Gong
|
2016-06-07 16:07:02 -07:00 |
|
Arun Suresh
|
8554aee1be
|
Addendum patch for YARN-5180 updating findbugs-exclude.xml
|
2016-06-07 15:59:43 -07:00 |
|
Wangda Tan
|
620325e816
|
YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda)
|
2016-06-07 15:06:42 -07:00 |
|
Rohith Sharma K S
|
bddea5fe5f
|
YARN-5118. Tests fails with localizer port bind exception. Contributed by Brahma Reddy Battula.
|
2016-06-07 11:20:15 +05:30 |
|
Arun Suresh
|
3a154f75ed
|
YARN-4525. Fix bug in RLESparseResourceAllocation.getRangeOverlapping(). (Ishai Menache and Carlo Curino via asuresh)
|
2016-06-06 21:18:32 -07:00 |
|
Arun Suresh
|
7a9b7372a1
|
YARN-5185. StageAllocaterGreedyRLE: Fix NPE in corner case. (Carlo Curino via asuresh)
|
2016-06-06 21:06:52 -07:00 |
|
Ming Ma
|
4a1cedc010
|
MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)
|
2016-06-06 14:30:51 -07:00 |
|
Arun Suresh
|
db54670e83
|
YARN-5165. Fix NoOvercommitPolicy to take advantage of RLE representation of plan. (Carlo Curino via asuresh)
|
2016-06-03 14:49:32 -07:00 |
|
Vinod Kumar Vavilapalli
|
f10ebc67f5
|
YARN-5098. Fixed ResourceManager's DelegationTokenRenewer to replace expiring system-tokens if RM stops and only restarts after a long time. Contributed by Jian He.
|
2016-06-03 13:00:07 -07:00 |
|
Jian He
|
99cc439e29
|
YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du
|
2016-06-03 11:10:42 -07:00 |
|
Jian He
|
097baaaeba
|
YARN-1815. Work preserving recovery of Unmanged AMs. Contributed by Subru Krishnan
|
2016-06-03 10:49:30 -07:00 |
|
Arun Suresh
|
dc26601d8f
|
YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)
|
2016-06-02 09:01:02 -07:00 |
|
Xuan
|
0bc05e40fa
|
YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong
|
2016-06-01 13:44:21 -07:00 |
|
Varun Vasudev
|
4e1f56e111
|
YARN-5141. Get Container logs for the Running application from Yarn Logs CommandLine. Contributed by Xuan Gong.
|
2016-05-29 21:53:43 +05:30 |
|
Varun Vasudev
|
86fb58b7dc
|
YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana.
|
2016-05-29 21:32:51 +05:30 |
|
Varun Vasudev
|
42f90ab885
|
YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.
|
2016-05-29 21:24:16 +05:30 |
|
Karthik Kambatla
|
f5ff05cc8a
|
YARN-5132. Exclude generated protobuf sources from YARN Javadoc build. (Subru Krishnan via kasha)
|
2016-05-28 08:09:46 -07:00 |
|
Arun Suresh
|
4fc09a897b
|
YARN-5117. QueuingContainerManager does not start GUARANTEED Container even if Resources are available. (Konstantinos Karanasos via asuresh)
|
2016-05-27 17:49:15 -07:00 |
|
Arun Suresh
|
aa975bc781
|
YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh)
|
2016-05-27 14:06:32 -07:00 |
|
Akira Ajisaka
|
e4022debf7
|
YARN-5166. javadoc:javadoc goal fails on hadoop-yarn-client. Contributed by Andras Bokor.
|
2016-05-27 23:15:32 +09:00 |
|
Junping Du
|
705286ccae
|
YARN-4987. Read cache concurrency issue between read and evict in EntityGroupFS timeline store. Contributed by Li Lu.
|
2016-05-27 06:58:32 -07:00 |
|
Xuan
|
bde819abbb
|
YARN-5089. Improve "yarn log" command-line "logFiles" option to support
regex. Contributed by Xuan Gong
|
2016-05-26 23:49:20 -07:00 |
|
Kai Zheng
|
916140604f
|
HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li
|
2016-05-28 14:23:39 +08:00 |
|
Rohith Sharma K S
|
0a544f8a3e
|
YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt.
|
2016-05-27 10:44:35 +05:30 |
|
Eric Payne
|
1b0cfc84e7
|
YARN-5116. Failed to execute "yarn application". Contributed by Jun Gong
|
2016-05-26 23:43:08 +00:00 |
|
Arun Suresh
|
5b41b288d0
|
YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh)
|
2016-05-26 14:56:37 -07:00 |
|
Karthik Kambatla
|
04ded558b0
|
YARN-5035. FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on. (kasha)
|
2016-05-26 14:41:07 -07:00 |
|
Karthik Kambatla
|
4f513a4a8e
|
YARN-4866. FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy. (Yufei Gu via kasha)
|
2016-05-25 22:13:27 -07:00 |
|
Carlo Curino
|
013532a95e
|
YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)
|
2016-05-25 16:55:49 -07:00 |
|
Jason Lowe
|
1ba31fe9e9
|
YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong
|
2016-05-25 21:24:55 +00:00 |
|
Karthik Kambatla
|
77d5ce9069
|
YARN-3344. Fix warning - procfs stat file is not in the expected format. (Ravindra Kumar Naik and Akira Ajisaka via kasha)
|
2016-05-25 10:50:54 -07:00 |
|
Robert Kanter
|
e07519b8db
|
YARN-4766. NM should not aggregate logs older than the retention policy (haibochen via rkanter)
|
2016-05-25 10:25:44 -07:00 |
|
Varun Vasudev
|
9a31e5dfef
|
YARN-5115. Avoid setting CONTENT-DISPOSITION header in the container-logs web-service. Contributed by Xuan Gong.
|
2016-05-25 19:01:12 +05:30 |
|
Varun Vasudev
|
c380a22031
|
YARN-857. Localization failures should be available in container diagnostics. Contributed by Vinod Kumar Vavilapalli.
|
2016-05-25 19:01:12 +05:30 |
|
Junping Du
|
48c931331c
|
YARN-5131. Distributed shell AM fails when extra container arrives during finishing. Contributed by Wangda Tan.
|
2016-05-25 06:18:11 -07:00 |
|
Rohith Sharma K S
|
28bd63e92b
|
YARN-5024. TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure. Contributed by Bibin A Chundatt
|
2016-05-25 10:15:50 +05:30 |
|
Naganarasimha
|
edd716e99c
|
YARN-5114. Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8. Contributed by Bibin A Chundatt
|
2016-05-25 06:11:38 +08:00 |
|
Karthik Kambatla
|
f979d779e1
|
YARN-4878. Expose scheduling policy and max running apps over JMX for Yarn queues. (Yufei Gu via kasha)
|
2016-05-24 10:54:11 -07:00 |
|
Naganarasimha
|
b4078bd17b
|
YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (addendum patch). Contributed by Bibin A chundatt
|
2016-05-24 08:06:53 +08:00 |
|
Karthik Kambatla
|
6d043aa4cf
|
YARN-4979. FSAppAttempt demand calculation considers demands at multiple locality levels different. (Zhihai Xu via kasha)
|
2016-05-23 14:29:28 -07:00 |
|
Jason Lowe
|
ac954486c5
|
YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger
|
2016-05-23 15:54:42 +00:00 |
|
Jason Lowe
|
d1df0266cf
|
YARN-5103. With NM recovery enabled, restarting NM multiple times results in AM restart. Contributed by Junping Du
|
2016-05-23 15:15:27 +00:00 |
|
Junping Du
|
6161d9ba52
|
YARN-5112. Excessive log warnings for directory permission issue on NM recovery. Contributed by Jian He.
(cherry picked from commit 867cd2f5a2e5966d6a7c5f5accb2fce78f9e7778)
|
2016-05-22 16:04:02 -07:00 |
|
Jian He
|
d364ceac85
|
YARN-5020. Fix Documentation for Yarn Capacity Scheduler on Resource Calculator. Contributed by Takashi Ohnishi
|
2016-05-20 11:35:26 -07:00 |
|