3093 Commits

Author	SHA1	Message	Date
Naganarasimha	1500a0a300	YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G	2016-06-09 05:41:09 +05:30
Vinod Kumar Vavilapalli	5a43583c0b	YARN-5080. Addendum fix to the original patch to fix YARN logs CLI. Contributed by Xuan Gong	2016-06-08 09:49:55 -07:00
Arun Suresh	3344ba70e0	YARN-5204. Properly report status of killed/stopped queued containers. (Konstantinos Karanasos via asuresh)	2016-06-08 08:31:32 -07:00
Jason Lowe	8c8a377cac	YARN-5206. RegistrySecurity includes id:pass in exception text if considered invalid. Contributed by Steve Loughran	2016-06-08 14:11:25 +00:00
Arun Suresh	76f0800c21	YARN-5176. More test cases for queuing of containers at the NM. (Konstantinos Karanasos via asuresh)	2016-06-07 17:16:18 -07:00
Xuan	58be55b6e0	YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and ... FileInputStream in NMWebServices#getLogs. Contributed by Xuan Gong	2016-06-07 16:07:02 -07:00
Arun Suresh	8554aee1be	Addendum patch for YARN-5180 updating findbugs-exclude.xml	2016-06-07 15:59:43 -07:00
Wangda Tan	620325e816	YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda)	2016-06-07 15:06:42 -07:00
Rohith Sharma K S	bddea5fe5f	YARN-5118. Tests fails with localizer port bind exception. Contributed by Brahma Reddy Battula.	2016-06-07 11:20:15 +05:30
Arun Suresh	3a154f75ed	YARN-4525. Fix bug in RLESparseResourceAllocation.getRangeOverlapping(). (Ishai Menache and Carlo Curino via asuresh)	2016-06-06 21:18:32 -07:00
Arun Suresh	7a9b7372a1	YARN-5185. StageAllocaterGreedyRLE: Fix NPE in corner case. (Carlo Curino via asuresh)	2016-06-06 21:06:52 -07:00
Ming Ma	4a1cedc010	MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)	2016-06-06 14:30:51 -07:00
Arun Suresh	db54670e83	YARN-5165. Fix NoOvercommitPolicy to take advantage of RLE representation of plan. (Carlo Curino via asuresh)	2016-06-03 14:49:32 -07:00
Vinod Kumar Vavilapalli	f10ebc67f5	YARN-5098. Fixed ResourceManager's DelegationTokenRenewer to replace expiring system-tokens if RM stops and only restarts after a long time. Contributed by Jian He.	2016-06-03 13:00:07 -07:00
Jian He	99cc439e29	YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du	2016-06-03 11:10:42 -07:00
Jian He	097baaaeba	YARN-1815. Work preserving recovery of Unmanged AMs. Contributed by Subru Krishnan	2016-06-03 10:49:30 -07:00
Arun Suresh	dc26601d8f	YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)	2016-06-02 09:01:02 -07:00
Xuan	0bc05e40fa	YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong	2016-06-01 13:44:21 -07:00
Varun Vasudev	4e1f56e111	YARN-5141. Get Container logs for the Running application from Yarn Logs CommandLine. Contributed by Xuan Gong.	2016-05-29 21:53:43 +05:30
Varun Vasudev	86fb58b7dc	YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana.	2016-05-29 21:32:51 +05:30
Varun Vasudev	42f90ab885	YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.	2016-05-29 21:24:16 +05:30
Karthik Kambatla	f5ff05cc8a	YARN-5132. Exclude generated protobuf sources from YARN Javadoc build. (Subru Krishnan via kasha)	2016-05-28 08:09:46 -07:00
Arun Suresh	4fc09a897b	YARN-5117. QueuingContainerManager does not start GUARANTEED Container even if Resources are available. (Konstantinos Karanasos via asuresh)	2016-05-27 17:49:15 -07:00
Arun Suresh	aa975bc781	YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh)	2016-05-27 14:06:32 -07:00
Akira Ajisaka	e4022debf7	YARN-5166. javadoc:javadoc goal fails on hadoop-yarn-client. Contributed by Andras Bokor.	2016-05-27 23:15:32 +09:00
Junping Du	705286ccae	YARN-4987. Read cache concurrency issue between read and evict in EntityGroupFS timeline store. Contributed by Li Lu.	2016-05-27 06:58:32 -07:00
Xuan	bde819abbb	YARN-5089. Improve "yarn log" command-line "logFiles" option to support ... regex. Contributed by Xuan Gong	2016-05-26 23:49:20 -07:00
Kai Zheng	916140604f	HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li	2016-05-28 14:23:39 +08:00
Rohith Sharma K S	0a544f8a3e	YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt.	2016-05-27 10:44:35 +05:30
Eric Payne	1b0cfc84e7	YARN-5116. Failed to execute "yarn application". Contributed by Jun Gong	2016-05-26 23:43:08 +00:00
Arun Suresh	5b41b288d0	YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh)	2016-05-26 14:56:37 -07:00
Karthik Kambatla	04ded558b0	YARN-5035. FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on. (kasha)	2016-05-26 14:41:07 -07:00
Karthik Kambatla	4f513a4a8e	YARN-4866. FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy. (Yufei Gu via kasha)	2016-05-25 22:13:27 -07:00
Carlo Curino	013532a95e	YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)	2016-05-25 16:55:49 -07:00
Jason Lowe	1ba31fe9e9	YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong	2016-05-25 21:24:55 +00:00
Karthik Kambatla	77d5ce9069	YARN-3344. Fix warning - procfs stat file is not in the expected format. (Ravindra Kumar Naik and Akira Ajisaka via kasha)	2016-05-25 10:50:54 -07:00
Robert Kanter	e07519b8db	YARN-4766. NM should not aggregate logs older than the retention policy (haibochen via rkanter)	2016-05-25 10:25:44 -07:00
Varun Vasudev	9a31e5dfef	YARN-5115. Avoid setting CONTENT-DISPOSITION header in the container-logs web-service. Contributed by Xuan Gong.	2016-05-25 19:01:12 +05:30
Varun Vasudev	c380a22031	YARN-857. Localization failures should be available in container diagnostics. Contributed by Vinod Kumar Vavilapalli.	2016-05-25 19:01:12 +05:30
Junping Du	48c931331c	YARN-5131. Distributed shell AM fails when extra container arrives during finishing. Contributed by Wangda Tan.	2016-05-25 06:18:11 -07:00
Rohith Sharma K S	28bd63e92b	YARN-5024. TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure. Contributed by Bibin A Chundatt	2016-05-25 10:15:50 +05:30
Naganarasimha	edd716e99c	YARN-5114. Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8. Contributed by Bibin A Chundatt	2016-05-25 06:11:38 +08:00
Karthik Kambatla	f979d779e1	YARN-4878. Expose scheduling policy and max running apps over JMX for Yarn queues. (Yufei Gu via kasha)	2016-05-24 10:54:11 -07:00
Naganarasimha	b4078bd17b	YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (addendum patch). Contributed by Bibin A chundatt	2016-05-24 08:06:53 +08:00
Karthik Kambatla	6d043aa4cf	YARN-4979. FSAppAttempt demand calculation considers demands at multiple locality levels different. (Zhihai Xu via kasha)	2016-05-23 14:29:28 -07:00
Jason Lowe	ac954486c5	YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger	2016-05-23 15:54:42 +00:00
Jason Lowe	d1df0266cf	YARN-5103. With NM recovery enabled, restarting NM multiple times results in AM restart. Contributed by Junping Du	2016-05-23 15:15:27 +00:00
Junping Du	6161d9ba52	YARN-5112. Excessive log warnings for directory permission issue on NM recovery. Contributed by Jian He. ... (cherry picked from commit 867cd2f5a2e5966d6a7c5f5accb2fce78f9e7778)	2016-05-22 16:04:02 -07:00
Jian He	d364ceac85	YARN-5020. Fix Documentation for Yarn Capacity Scheduler on Resource Calculator. Contributed by Takashi Ohnishi	2016-05-20 11:35:26 -07:00
Varun Vasudev	0287c49107	YARN-5016. Add support for a minimum retry interval for container retries. Contributed by Jun Gong.	2016-05-20 12:28:14 +05:30
Junping Du	22fcd819f0	YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron. ... (cherry picked from commit 2703ec68712279494d67b0d76b7ac10e7a1628be)	2016-05-19 14:15:21 -07:00
Jian He	feb90ffcca	YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong	2016-05-19 13:01:36 -07:00
Junping Du	141873ca7d	YARN-5100. The YarnApplicationState is always running in ATS even application is finished. Contributed by Xuan Gong.	2016-05-19 09:13:29 -07:00
Steve Loughran	22ff9e68d1	HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.	2016-05-19 14:48:18 +01:00
Akira Ajisaka	d4274c64bc	YARN-5107. TestContainerMetrics fails. (aajisaka)	2016-05-19 19:53:59 +09:00
Arun Suresh	1597630681	YARN-5110. Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds. (Konstantinos Karanasos via asuresh)	2016-05-18 18:46:00 -07:00
Naganarasimha	f04c81c9ce	YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt	2016-05-19 01:30:48 +08:00
Varun Vasudev	ef1757790d	YARN-4913. Yarn logs should take a -out option to write to a directory. Contributed by Xuan Gong.	2016-05-18 22:44:33 +05:30
Arun Suresh	8a9ecb7584	YARN-5090. Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster. (asuresh)	2016-05-17 19:01:29 -07:00
Jian He	0c6726e20d	Addendum patch for YARN-4832. Contributed by Junping Du	2016-05-17 14:50:30 -07:00
Jian He	fa3bc3405d	YARN-4832. NM side resource value should get updated if change applied in RM side. Contributed by Junping Du	2016-05-17 12:52:19 -07:00
Arun Suresh	ccc93e7812	YARN-5075. Fix findbugs warnings in hadoop-yarn-common module. (asuresh)	2016-05-16 23:22:01 -07:00
Allen Wittenauer	730bc746f9	HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw) ... This commit contains the following JIRA issues: HADOOP-12931. bin/hadoop work for dynamic subcommands HADOOP-12932. bin/yarn work for dynamic subcommands HADOOP-12933. bin/hdfs work for dynamic subcommands HADOOP-12934. bin/mapred work for dynamic subcommands HADOOP-12935. API documentation for dynamic subcommands HADOOP-12936. modify hadoop-tools to take advantage of dynamic subcommands HADOOP-13086. enable daemonization of dynamic commands HADOOP-13087. env var doc update for dynamic commands HADOOP-13088. fix shellprofiles in hadoop-tools to allow replacement HADOOP-13089. hadoop distcp adds client opts twice when dynamic HADOOP-13094. hadoop-common unit tests for dynamic commands HADOOP-13095. hadoop-hdfs unit tests for dynamic commands HADOOP-13107. clean up how rumen is executed HADOOP-13108. dynamic subcommands need a way to manipulate arguments HADOOP-13110. add a streaming subcommand to mapred HADOOP-13111. convert hadoop gridmix to be dynamic HADOOP-13115. dynamic subcommand docs should talk about exit vs. continue program flow HADOOP-13117. clarify daemonization and security vars for dynamic commands HADOOP-13120. add a --debug message when dynamic commands have been used HADOOP-13121. rename sub-project shellprofiles to match the rest of Hadoop HADOOP-13129. fix typo in dynamic subcommand docs HADOOP-13151. Underscores should be escaped in dynamic subcommands document HADOOP-13153. fix typo in debug statement for dynamic subcommands	2016-05-16 17:54:45 -07:00
Eric Payne	1217c8f6b4	YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger.	2016-05-16 20:28:04 +00:00
Jason Lowe	81effb7dcd	YARN-4325. Nodemanager log handlers fail to send finished/failed events in some cases. Contributed by Junping Du	2016-05-16 15:40:23 +00:00
Arun Suresh	f45bc5a83e	YARN-4738. Notify the RM about the status of OPPORTUNISTIC containers (Konstantinos Karanasos via asuresh)	2016-05-15 17:54:34 -07:00
Xuan	7be53b65f9	YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or ... RUNNING AM. Contributed by Xuan Gong	2016-05-14 12:19:23 -07:00
Arun Suresh	f0ac18d001	YARN-2888. Corrective mechanisms for rebalancing NM container queues. (asuresh)	2016-05-13 13:38:36 -07:00
Andrew Wang	3c5c57af28	HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.	2016-05-12 18:27:28 -07:00
Andrew Wang	ca5613af91	Revert "Update project version to 3.0.0-alpha1-SNAPSHOT." ... This reverts commit 6b53802cba.	2016-05-12 15:32:45 -07:00
Jason Lowe	013000fbc2	YARN-5053. More informative diagnostics when applications killed by a user. Contributed by Eric Badger	2016-05-12 20:28:36 +00:00
Andrew Wang	6b53802cba	Update project version to 3.0.0-alpha1-SNAPSHOT.	2016-05-12 11:05:05 -07:00
Sangjin Lee	0bbe01f8d5	YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)	2016-05-12 10:11:23 -07:00
Rohith Sharma K S	b7ac85259c	YARN-5068. Expose scheduler queue to application master. (Harish Jaiprakash via rohithsharmaks)	2016-05-12 15:17:49 +05:30
Arun Suresh	d464f4d1c4	YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)	2016-05-11 19:10:17 -07:00
Karthik Kambatla	4b4e4c6ba8	YARN-4995. FairScheduler: Display per-queue demand on the scheduler page. (xupeng via kasha)	2016-05-11 17:36:21 -07:00
Junping Du	39f2bac38b	YARN-5029. RM needs to send update event with YarnApplicationState as Running to ATS/AHS. Contributed by Xuan Gong.	2016-05-11 09:28:35 -07:00
Arun Suresh	d971bf252f	YARN-5073. Refactor startContainerInternal() in ContainerManager to remove unused parameter. (Konstantinos Karanasos via asuresh)	2016-05-10 22:31:38 -07:00
Vinod Kumar Vavilapalli	87f5e35133	YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the appOwner argument when viewing another user's logs. Contributed by Ram Venkatesh and Xuan Gong.	2016-05-09 22:41:18 -07:00
Naganarasimha	2750fb900f	YARN-4926. Change nodelabel rest API invalid reponse status to 400. Contributed by Bibin A Chundatt	2016-05-08 22:49:25 +05:30
Yongjun Zhang	47c41e7ac7	YARN-5048. DelegationTokenRenewer#skipTokenRenewal may throw NPE (Jian He via Yongjun Zhang)	2016-05-06 21:50:09 -07:00
Jason Lowe	b2ed6ae731	YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena	2016-05-06 22:59:39 +00:00
Wangda Tan	23248f63aa	getApplicationReport call may raise NPE for removed queues. (Jian He via wangda)	2016-05-06 15:30:45 -07:00
Jian He	bb62e05925	YARN-4390. Do surgical preemption based on reserved container in CapacityScheduler. Contributed by Wangda Tan	2016-05-05 12:56:21 -07:00
Jason Lowe	d0da13229c	YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla	2016-05-05 14:07:54 +00:00
Varun Vasudev	72b047715c	YARN-4595. Add support for configurable read-only mounts when launching Docker containers. Contributed by Billie Rinaldi.	2016-05-05 13:01:54 +05:30
Vinod Kumar Vavilapalli	9e37fe3b7a	YARN-4905. Improved "yarn logs" command-line to optionally show log metadata also. Contributed by Xuan Gong.	2016-05-04 14:16:03 -07:00
Wangda Tan	7bd418e48c	YARN-4984. LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak. (Junping Du via wangda)	2016-05-04 11:38:55 -07:00
Junping Du	e61d431275	YARN-4920. ATS/NM should support a link to dowload/get the logs in text format. Contributed by Xuan Gong.	2016-05-04 10:35:49 -07:00
Rohith Sharma K S	75e0450593	YARN-4947. Test timeout is happening for TestRMWebServicesNodes. Contributed by Bibin A Chundatt	2016-05-04 09:58:26 +05:30
Jason Lowe	ed54f5f1ff	YARN-5003. Add container resource to RM audit log. Contributed by Nathan Roberts	2016-05-03 20:03:41 +00:00
Jason Lowe	c6b4839168	YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts	2016-05-03 17:27:28 +00:00
Junping Du	06413da72e	YARN-4851. Metric improvements for ATS v1.5 storage components. Li Lu via junping_du.	2016-05-03 04:16:21 -07:00
Robert Kanter	9d4d30243b	Remove parent's env vars from child processes	2016-04-29 09:25:51 -07:00
Varun Vasudev	0f25a1bb52	YARN-3998. Add support in the NodeManager to re-launch containers. Contributed by Jun Gong.	2016-04-29 16:09:07 +05:30
Jian He	4a8508501b	YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe	2016-04-28 21:54:11 -07:00
Jian He	dd80042c42	YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe	2016-04-28 21:27:25 -07:00
Li Lu	f16722d2ef	YARN-4956. findbug issue on LevelDBCacheTimelineStore. (Zhiyuan Yang via gtcarrera9)	2016-04-27 10:57:10 -07:00
Karthik Kambatla	185c3d4de1	YARN-4807. MockAM#waitForState sleep duration is too long. (Yufei Gu via kasha)	2016-04-27 09:43:23 -07:00
Varun Vasudev	66b07d8374	YARN-4966. Improve yarn logs to fetch container logs without specifying nodeId. Contributed by Xuan Gong.	2016-04-27 15:56:36 +05:30
Jian He	4beff01354	YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode	2016-04-26 21:00:17 -07:00
Arun Suresh	341888a0aa	YARN-4412. Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers. (asuresh)	2016-04-26 20:12:12 -07:00
Karthik Kambatla	1a3f1482e2	YARN-4795. ContainerMetrics drops records. (Daniel Templeton via kasha)	2016-04-26 06:15:36 -07:00
Karthik Kambatla	4b1dcbbe0c	YARN-1297. FairScheduler: Move some logs to debug and check if debug logging is enabled	2016-04-26 05:10:09 -07:00
Arun Suresh	a5fed8bbfe	YARN-4991. Fix ContainerRequest Constructor to set nodelabelExpression correctly. (Bibin A Chundatt via asuresh)	2016-04-25 23:26:21 -07:00
Arun Suresh	c282a08f38	YARN-2885. Create AMRMProxy request interceptor and ContainerAllocator to distribute OPPORTUNISTIC containers to appropriate Nodes (asuresh) ... (cherry picked from commit 2bf025278a318b0452fdc9ece4427b4c42124e39)	2016-04-24 22:38:33 -07:00
Arun Suresh	b2a654c5ee	YARN-4335. Allow ResourceRequests to specify ExecutionType of a request ask (kkaranasos via asuresh) ... (cherry picked from commit 8ffabfdf4fec104cdaa68133385cfe9cf88b95a8)	2016-04-22 23:20:54 -07:00
Jing Zhao	63e5412f1a	HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.	2016-04-22 15:14:40 -07:00
Wangda Tan	7cb3a3da96	YARN-4846. Fix random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers. (Bibin A Chundatt via wangda)	2016-04-22 11:40:32 -07:00
Eric Payne	3dce486d88	YARN-4556. TestFifoScheduler.testResourceOverCommit fails. Contributed by Akihiro Suda	2016-04-21 21:16:47 +00:00
Li Lu	7c6339f66a	YARN-4968. A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped. (Wangda Tan via gtcarrera9)	2016-04-21 13:25:33 -07:00
Chris Douglas	95a5046607	YARN-4976. Missing NullPointer check in ContainerLaunchContextPBImpl. Contributed by Giovanni Matteo Fumarola	2016-04-21 10:45:38 -07:00
Karthik Kambatla	170c4fd4cd	YARN-4784. Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO. (Yufei Gu via kasha)	2016-04-20 23:58:12 -07:00
Karthik Kambatla	6e297836d6	YARN-4935. TestYarnClient#testSubmitIncorrectQueue fails when FairScheduler is the default. (Yufei Gu via kasha)	2016-04-20 23:40:46 -07:00
Wangda Tan	33fd95a99c	YARN-4890. Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate. (Sunil G via wangda)	2016-04-20 17:37:38 -07:00
Karthik Kambatla	c8172f5f14	YARN-2883. Queuing of container requests in the NM. (Konstantinos Karanasos and Arun Suresh via kasha)	2016-04-20 09:55:50 -07:00
Vinod Kumar Vavilapalli	477003730e	Fixed TimelineClient to retry SocketTimeoutException too. Contributed by Xuan Gong.	2016-04-18 11:47:06 -07:00
Wangda Tan	fdc46bfb37	YARN-4934. Reserved Resource for QueueMetrics needs to be handled correctly in few cases. (Sunil G via wangda)	2016-04-16 22:47:41 -07:00
Xuan	e6c0742012	YARN-4965. Distributed shell AM failed due to ClientHandlerException thrown by jersey. Contributed by Junping Du	2016-04-16 19:39:18 -07:00
Arun Suresh	cab9cbaa0a	YARN-4468. Document the general ReservationSystem functionality, and the REST API. (subru and carlo via asuresh)	2016-04-15 16:58:49 -07:00
Jason Lowe	69f3d428d5	YARN-4940. yarn node -list -all failed if RM start with decommissioned node. Contributed by sandflee	2016-04-15 20:36:45 +00:00
Naganarasimha	fdbafbc9e5	YARN-4909. Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter. Contributed by Bibin A Chundatt	2016-04-15 23:37:05 +05:30
Jason Lowe	3150ae8108	YARN-4924. NM recovery race can lead to container not cleaned up. Contributed by sandflee	2016-04-14 19:17:14 +00:00
Robert Kanter	0d9194df00	YARN-4541. Change log message in LocalizedResource#handle() to DEBUG (rchiang via rkanter)	2016-04-13 17:45:18 -07:00
Xuan	e0cb426758	YARN-4886. Add HDFS caller context for EntityGroupFSTimelineStore. Contributed by Li Lu	2016-04-13 10:38:17 -07:00
Naganarasimha	437e9d6475	YARN-4810. NM applicationpage cause internal error 500. Contributed by Bibin A Chundatt.	2016-04-12 17:59:46 +05:30
Rohith Sharma K S	4ee7f0a3e7	YARN-4897. dataTables_wrapper change min height. Contributed by Bibin A Chundatt.	2016-04-12 10:25:56 +05:30
Rohith Sharma K S	ff722bbbdf	YARN-4794. Deadlock in NMClientImpl. Contributed by Jian He.	2016-04-12 09:59:33 +05:30
Vinod Kumar Vavilapalli	44bbc50d91	YARN-4168. Fixed a failing test TestLogAggregationService.testLocalFileDeletionOnDiskFull. Contributed by Takashi Ohnishi.	2016-04-11 12:11:14 -07:00
Jason Lowe	2a5da97f81	Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla" ... This reverts commit 1cbcd4a491.	2016-04-11 15:51:01 +00:00
Junping Du	08ddb3ac6d	YARN-4928. Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon. Contributed by Gergely Novák.	2016-04-11 08:48:32 -07:00
Akira Ajisaka	1ff27f9d12	YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.	2016-04-11 14:55:03 +09:00
Varun Vasudev	07920acc16	YARN-4562. YARN WebApp ignores the configuration passed to it for keystore settings. Contributed by Sergey Shelukhin.	2016-04-11 09:39:57 +05:30
Akira Ajisaka	1b78b2ba17	YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger.	2016-04-11 01:31:49 +09:00
Karthik Kambatla	ff95fd547b	YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha)	2016-04-09 10:31:02 -07:00
Wangda Tan	fcb3fcd4c6	YARN-4826. Document configuration of ReservationSystem for CapacityScheduler. (Subru Krishnan via wangda)	2016-04-08 16:21:04 -07:00
Wangda Tan	ec06957941	YARN-3215. Respect labels in CapacityScheduler when computing headroom. (Naganarasimha G R via wangda)	2016-04-08 15:33:04 -07:00
Jian He	9cb0c963d2	YARN-4740. AM may not receive the container complete msg when it restarts. Contributed by Jun Gong	2016-04-08 11:20:35 -07:00
Karthik Kambatla	e82f961a39	YARN-4756. Unnecessary wait in Node Status Updater during reboot. (Eric Badger via kasha)	2016-04-07 17:05:29 -07:00
Jian He	93bacda08b	YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev	2016-04-06 16:13:47 -07:00
Varun Vasudev	b41e65e5bc	YARN-4906. Capture container start/finish time in container metrics. Contributed by Jian He.	2016-04-06 13:41:33 +05:30
Wangda Tan	21eb428448	YARN-4699. Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node. (Sunil G via wangda)	2016-04-05 16:24:11 -07:00
Masatake Iwasaki	500e5a5952	YARN-4917. Fix typos in documentation of Capacity Scheduler. (Takashi Ohnishi via iwasakims)	2016-04-06 04:00:31 +09:00
Masatake Iwasaki	30206346cf	YARN-4915. Fix typo in YARN Secure Containers documentation (Takashi Ohnishi via iwasakims)	2016-04-06 03:47:22 +09:00
Junping Du	0005816743	YARN-4916. TestNMProxy.tesNMProxyRPCRetry fails. Contributed by Tibor Kiss.	2016-04-05 09:01:08 -07:00
Junping Du	6be28bcc46	YARN-4893. Fix some intermittent test failures in TestRMAdminService. Contributed by Brahma Reddy Battula.	2016-04-05 06:57:54 -07:00
Jason Lowe	1cbcd4a491	YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla	2016-04-05 13:40:19 +00:00
Rohith Sharma K S	776b549e2a	YARN-4609. RM Nodes list page takes too much time to load. Contributed by Bibin A Chundatt	2016-04-05 14:47:25 +05:30
Rohith Sharma K S	552237d4a3	YARN-4880. Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE. Contributed by Sunil G	2016-04-05 14:26:19 +05:30
Li Lu	f61de41736	YARN-4706. UI Hosting Configuration in TimelineServer doc is broken. (Akira AJISAKA via gtcarrera9)	2016-04-04 14:40:27 -07:00
naganarasimha	5092c94195	YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt	2016-04-04 16:25:03 +05:30
Rohith Sharma K S	1e6f92977d	YARN-4607. Pagination support for AppAttempt page TotalOutstandingResource Requests table. Contributed by Bibin A Chundatt	2016-04-04 08:09:29 +05:30
Karthik Kambatla	81d04cae41	YARN-4657. Javadoc comment is broken for Resources.multiplyByAndAddTo(). (Daniel Templeton via kasha)	2016-04-01 16:20:00 -07:00
Arun Suresh	5686caa9fc	Missing file for YARN-4895.	2016-04-01 15:58:13 -07:00
Arun Suresh	82621e38a0	YARN-4895. Add subtractFrom method to ResourceUtilization class. Contributed by Konstantinos Karanasos.	2016-04-01 14:57:06 -07:00
Varun Vasudev	3488c4f2c9	Revert "YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki." ... This reverts commit 0064cba169.	2016-04-01 12:20:40 +05:30
Wangda Tan	12b11e2e68	YARN-4634. Scheduler UI/Metrics need to consider cases like non-queue label mappings. (Sunil G via wangda)	2016-03-31 14:35:18 -07:00
Jian He	0dd9bcab97	YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage	2016-03-31 14:28:13 -07:00
Robert Kanter	7a021471c3	YARN-4639. Remove dead code in TestDelegationTokenRenewer added in YARN-3055 (templedf via rkanter)	2016-03-31 13:09:09 -07:00
Sangjin Lee	6d67420dbc	YARN-4183. Clarify the behavior of timeline service config properties (Naganarasimha G R via sjlee)	2016-03-31 10:49:03 -07:00
Allen Wittenauer	0a74610d1c	HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw)	2016-03-31 07:51:05 -07:00
Varun Vasudev	0064cba169	YARN-4857. Add missing default configuration regarding preemption of CapacityScheduler. Contributed by Kai Sasaki.	2016-03-31 14:05:49 +05:30
Varun Vasudev	f1b8f6b2c1	YARN-4884. Fix missing documentation about rmadmin command regarding node labels. Contributed by Kai Sasaki.	2016-03-31 14:01:48 +05:30
Jian He	60e4116bf1	YARN-4822. Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates. Contributed by Wangda Tan	2016-03-30 12:43:52 -07:00
Robert Kanter	8286270466	YARN-4436. DistShell ApplicationMaster.ExecBatScripStringtPath is misspelled (mattlamantia via rkanter)	2016-03-29 17:21:29 -07:00
Wangda Tan	fc055a3cbe	YARN-4865. Track Reserved resources in ResourceUsage and QueueCapacities. (Sunil G via wangda)	2016-03-29 17:07:55 -07:00
Xuan	80182809ae	YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du	2016-03-28 22:17:45 -07:00
Jason Lowe	948b758070	YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong	2016-03-28 23:00:56 +00:00
Jian He	524bc3c33a	YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du	2016-03-28 11:12:33 -07:00
Jian He	8831b18c65	Missing file for YARN-4117.	2016-03-28 09:59:47 -07:00
Jian He	55ae143923	YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola	2016-03-27 20:22:12 -07:00
Karthik Kambatla	49ff54c860	YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha)	2016-03-26 21:45:13 -07:00
Arun Suresh	00bebb7e58	YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh)	2016-03-25 15:54:38 -07:00
Jason Lowe	e8fc81f9c8	YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong	2016-03-25 20:15:49 +00:00
Arun Suresh	2e1d0ff4e9	YARN-4687. Document Reservation ACLs (Contributed by Sean Po)	2016-03-24 10:40:51 -07:00
Arun Suresh	d820975c1a	YARN-4683. Document the List Reservations REST API. (Contributed by Sean Po)	2016-03-24 10:30:29 -07:00
Arun Suresh	d82e797b65	YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh)	2016-03-24 09:59:55 -07:00
Allen Wittenauer	b1394d6307	YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw)	2016-03-24 08:15:58 -07:00
Junping Du	19b645c938	YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.	2016-03-23 19:34:30 -07:00
Allen Wittenauer	738155063e	HADOOP-12857. rework hadoop-tools (aw)	2016-03-23 13:46:38 -07:00
Junping Du	af1d125f9c	YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. Contributed by Xuan Gong.	2016-03-23 08:57:16 -07:00
Karthik Kambatla	7fae4c68e6	YARN-4732. *ProcessTree classes have too many whitespace issues	2016-03-20 10:47:38 -07:00
Eric Payne	92b7e0d413	YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger.	2016-03-18 16:12:47 +00:00
Junping Du	ca8106d2dd	YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API.	2016-03-17 09:04:41 -07:00
Karthik Kambatla	f84af8bd58	YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha)	2016-03-17 05:54:06 -07:00
Wangda Tan	ae14e5d07f	YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan) ... (cherry picked from commit 7e8c9beb41)	2016-03-16 17:02:33 -07:00
Wangda Tan	fa7a43529d	Revert "CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)" ... This reverts commit 7e8c9beb41.	2016-03-16 17:02:10 -07:00
Wangda Tan	7e8c9beb41	CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)	2016-03-16 16:59:59 -07:00
Karthik Kambatla	3ef5500783	YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha)	2016-03-15 23:45:01 -07:00
Xuan	a888b5bc53	Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" ... This reverts commit 3a0b695441.	2016-03-15 22:10:39 -07:00
Li Lu	5176a69868	YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9)	2016-03-15 11:47:39 -07:00
Li Lu	3a0b695441	YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)	2016-03-15 11:40:54 -07:00
Robert Kanter	22ca176dfe	TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)	2016-03-15 10:05:10 -07:00
Siddharth Seth	eba66a64d2	YARN-4816. Fix incompatible change in SystemClock.	2016-03-14 20:14:33 -07:00
Karthik Kambatla	20d389ce61	YARN-4719. Add a helper library to maintain node state and allows common queries. (kasha)	2016-03-14 14:19:05 -07:00
Junping Du	f291d82cd4	YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du	2016-03-14 08:28:38 -07:00
Li Lu	017d2c127b	YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. ... This commit amends commit d49cfb3504 with a missed test file.	2016-03-10 13:02:28 -08:00
Li Lu	d49cfb3504	YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)	2016-03-10 10:51:55 -08:00
Wangda Tan	0233d4e0ee	YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda)	2016-03-08 14:27:03 -08:00
Jian He	3c33158d1c	YARN-4764. Application submission fails when submitted queue is not available in scheduler xml. Contributed by Bibin A Chundatt	2016-03-08 13:07:57 -08:00
Akira Ajisaka	f86850b544	HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang.	2016-03-08 14:28:47 +09:00
Vinod Kumar Vavilapalli	b2661765a5	YARN-4762. Fixed CgroupHandler's creation and usage to avoid NodeManagers crashing when LinuxContainerExecutor is enabled. (Sidharta Seethana via vinodkv)	2016-03-07 11:08:17 -08:00
Jason Lowe	4163e36c2b	YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger	2016-03-07 15:56:33 +00:00
Jason Lowe	059caf9989	YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana	2016-03-07 15:40:01 +00:00
Varun Vasudev	8ed2e060e8	YARN-4245. Generalize config file handling in container-executor. Contributed by Sidharta Seethana.	2016-03-07 16:18:35 +05:30
Varun Vasudev	e51a8c1056	YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.	2016-03-07 15:26:44 +05:30
Zhihai Xu	e1ccc9622b	YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee	2016-03-06 19:46:09 -08:00
Rohith Sharma K S	19ee185907	YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks)	2016-03-05 13:02:57 +05:30
Masatake Iwasaki	cbd31328a6	HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)	2016-03-04 14:11:36 +09:00
Jian He	5c465df904	YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding	2016-03-01 13:14:12 -08:00
Jian He	d93c22ec27	YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu	2016-02-29 18:19:09 -08:00
Karthik Kambatla	9dafaaaf0d	YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha)	2016-02-29 16:10:12 -08:00
Haohui Mai	0fa54d45b1	HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.	2016-02-29 11:41:00 -08:00
Jason Lowe	c58a6d53c5	YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe	2016-02-29 15:24:35 +00:00
Rohith Sharma K S	e0b14f26f5	YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks)	2016-02-29 10:38:14 +08:00
Karthik Kambatla	f9692770a5	YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha)	2016-02-28 09:35:59 -08:00
Jason Lowe	6b0f813e89	YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla	2016-02-26 20:24:50 +00:00
Ming Ma	7f3139e54d	YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma)	2016-02-26 08:40:05 -08:00
Robert Kanter	d7fdec1e6b	YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)	2016-02-25 16:36:38 -08:00
Robert Kanter	c4d4df8de0	YARN-4701. When task logs are not available, port 8041 is referenced instead of port 8042 (haibochen via rkanter)	2016-02-25 12:48:02 -08:00
Karthik Kambatla	c684f2b007	YARN-4729. SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE. (kasha)	2016-02-24 18:33:57 -08:00
Robert Kanter	954dd57043	YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)	2016-02-24 15:00:24 -08:00
Li Lu	9e0f7b8b69	YARN-4680. TimerTasks leak in ATS V1.5 Writer. (Xuan Gong via ... gtcarrera9)	2016-02-24 13:43:09 -08:00
Sangjin Lee	553b591ba0	YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)	2016-02-24 09:29:41 -08:00
Jason Lowe	d284e187b8	YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma	2016-02-23 20:49:09 +00:00
Junping Du	9ed17f181d	YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou.	2016-02-23 03:30:26 -08:00
Tsuyoshi Ozawa	0e12114c9c	YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki.	2016-02-23 19:50:08 +09:00
Rohith Sharma K S	de09f41147	YARN-4651. Document movetoqueue option in 'YARN Commands'. (Takashi Ohnishi via rohithsharmaks)	2016-02-23 18:03:42 +08:00
Varun Vasudev	140cb5d745	YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.	2016-02-23 12:29:25 +05:30
Zhe Zhang	a2fdfff02d	HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through ssl-server.conf. Contributed by Vijay Singh. ... Change-Id: Ie46a5427d29188935427f67e55203c19fcd83335	2016-02-22 14:13:54 -08:00
Junping Du	3fab88540f	YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla.	2016-02-22 07:04:19 -08:00
Akira Ajisaka	5e7d4d51f8	YARN-4707. Remove the extra char (>) from SecureContainer.md. Contributed by Brahma Reddy Battula.	2016-02-22 17:17:40 +09:00
Tsuyoshi Ozawa	b68901d7dd	YARN-4708. Missing default mapper type in TimelineServer performance test tool usage. Contributed by Kai Sasaki.	2016-02-22 07:54:53 +09:00
Rohith Sharma K S	c1afac3a98	YARN-4654. Yarn node label CLI should parse "=" correctly when trying to remove all labels on a node. (Naganarasimha G R via rohithsharmaks)	2016-02-18 14:10:37 +05:30
Sangjin Lee	7de70680fe	YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee)	2016-02-17 20:55:21 -08:00
Karthik Kambatla	a0c95b5fc4	YARN-4569. Remove incorrect part of maxResources in FairScheduler documentation. (Ray Chiang via kasha)	2016-02-17 18:36:12 -08:00
Karthik Kambatla	2ab4c476ed	YARN-4689. FairScheduler: Cleanup preemptContainer to be more readable. (Kai Sasaki via kasha)	2016-02-17 18:16:15 -08:00
Jian He	dea90c9a86	YARN-4653. Document YARN security model from the perspective of Application Developers. Contributed by Steve Loughran	2016-02-14 17:13:15 +08:00
Steve Loughran	51fc7f5427	YARN-4682. AMRM client to log when AMRM token updated. (Prabhu Joseph via stevel)	2016-02-12 11:02:08 +00:00
Varun Vasudev	2fb423e195	YARN-4684. TestYarnCLI#testGetContainers failing in CN locale. Contributed by Bibin A Chundatt.	2016-02-12 12:06:55 +05:30
Arun Suresh	23f937e3b7	YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)	2016-02-11 10:47:43 -08:00
Varun Vasudev	fa00d3e205	YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.	2016-02-11 12:06:42 +05:30
Varun Vasudev	663a80031c	YARN-4628. Display application priority in yarn top. Contributed by Bibin A Chundatt.	2016-02-11 11:56:09 +05:30
Jian He	d16b17b4d2	YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding	2016-02-11 10:06:27 +08:00
=	b706cbc1bc	YARN-4420. Add REST API for List Reservations (Sean Po via curino)	2016-02-10 10:19:26 -08:00
Arun Suresh	5cf5c41a89	YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh)	2016-02-10 09:11:15 -08:00
Steve Loughran	e9a622606f	YARN-4629. Distributed shell breaks under strong security. (Daniel Templeton via stevel)	2016-02-10 13:01:10 +00:00
Devaraj K	565af873d5	YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing ... is configured. Contributed by Naganarasimha G R.	2016-02-08 15:01:54 +05:30
Varun Vasudev	22a2b2231d	YARN-4669. Fix logging statements in resource manager's Application class. Contributed by Sidharta Seethana.	2016-02-04 13:51:25 +05:30
Varun Vasudev	308d63f382	YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.	2016-02-04 13:32:54 +05:30
Jason Lowe	fa328e2d39	YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe	2016-02-03 17:21:12 +00:00
Varun Vasudev	1adb64e09b	YARN-4625. Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent. Contributed by Xuan Gong.	2016-02-03 16:26:28 +05:30
Devaraj K	db144eb1c5	YARN-4100. Add Documentation for Distributed and Delegated-Centralized ... Node Labels feature. Contributed by Naganarasimha G R.	2016-02-02 12:06:51 +05:30
Varun Vasudev	1cd55e0c17	YARN-4649. Add additional logging to some NM state store operations. Contributed by Sidharta Seethana	2016-02-02 09:25:23 +05:30
Wangda Tan	9875325d5c	YARN-4340. Add list API to reservation system. (Sean Po via wangda)	2016-02-02 10:17:33 +08:00
Jason Lowe	ed55950164	YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla	2016-02-01 23:15:26 +00:00
Rohith Sharma K S	2673cbaf55	YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks)	2016-02-01 10:43:56 +05:30
Jason Lowe	772ea7b41b	YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li	2016-01-29 21:48:54 +00:00
Jian He	f4a57d4a53	YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S	2016-01-29 12:22:23 -08:00
Karthik Kambatla	c9a09d6926	YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha)	2016-01-29 08:12:54 -08:00
Devaraj K	a277bdc9ed	YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws ... IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.	2016-01-29 13:51:37 +05:30
Rohith Sharma K S	ac68666803	YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks)	2016-01-29 12:29:54 +05:30
Rohith Sharma K S	09d831c95b	YARN-4219. addendum patch to fix javadoc errors	2016-01-29 11:51:47 +05:30
Jian He	7f46636495	YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding	2016-01-28 14:51:00 -08:00
Xuan	9fab22b366	YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by ... Li Lu	2016-01-28 14:24:22 -08:00
Jason Lowe	61382ff8fa	YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana	2016-01-28 18:59:35 +00:00
Rohith Sharma K S	ef343be82b	YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks)	2016-01-28 21:53:45 +05:30
Karthik Kambatla	fb238d7e5d	YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha)	2016-01-27 12:29:06 -08:00
Rohith Sharma K S	c01bee0108	YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)	2016-01-27 08:23:02 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	2085e60a96	YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev.	2016-01-25 16:19:36 -08:00
Jian He	992dd2f783	YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee	2016-01-25 15:36:14 -08:00
Akira Ajisaka	56a0c17508	YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li.	2016-01-25 15:20:29 +09:00
rohithsharmaks	10dc2c0493	YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks)	2016-01-24 23:36:15 +05:30
rohithsharmaks	99829eb221	YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks)	2016-01-23 07:56:57 +05:30
Xuan	618bfd6ac2	YARN-4496. Improve HA ResourceManager Failover detection on the client. ... Contributed by Jian He	2016-01-22 18:20:38 -08:00
Jason Lowe	46e5ea81e0	YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen	2016-01-22 21:55:01 +00:00
Jason Lowe	e91e8b711c	YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G	2016-01-22 21:36:15 +00:00
rohithsharmaks	34a3900773	YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks)	2016-01-22 21:17:37 +05:30
rohithsharmaks	d6258b33a7	YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks)	2016-01-22 20:27:38 +05:30
Akira Ajisaka	8f58f742ae	YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.	2016-01-22 19:43:06 +09:00
Varun Vasudev	b41a7e89d1	YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana.	2016-01-22 14:43:14 +05:30
Rohith Sharma K S	e30668106d	YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks)	2016-01-22 10:14:46 +05:30
Jason Lowe	468a53b22f	YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe	2016-01-21 18:31:29 +00:00
Akira Ajisaka	3ac9511da2	YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki.	2016-01-22 02:14:31 +09:00
Karthik Kambatla	4992398aee	YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha)	2016-01-21 17:40:59 +01:00
Jason Lowe	f858ac2426	YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R	2016-01-21 15:38:40 +00:00
Wangda Tan	5ff5f67332	YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda)	2016-01-21 11:21:06 +08:00
Xuan	890a2ebd1a	YARN-4559. Make leader elector and zk store share the same curator ... client. Contributed by Jian He	2016-01-20 14:48:10 -08:00
Wangda Tan	89d1fd5dac	HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)	2016-01-19 21:27:38 +08:00
Jian He	edc43a9097	YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan	2016-01-18 21:04:36 -08:00
Wangda Tan	a44ce3f14f	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)	2016-01-19 09:30:04 +08:00
Wangda Tan	150f5ae034	Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" ... This reverts commit 3fe5728563. Conflicts: hadoop-yarn-project/CHANGES.txt	2016-01-19 09:27:36 +08:00
Jian He	f385851141	YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu	2016-01-18 16:58:39 -08:00
Karthik Kambatla	d40859fab1	YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)	2016-01-18 10:58:14 +01:00
Wangda Tan	3fe5728563	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) ... (cherry picked from commit 805a9ed85e)	2016-01-18 17:06:05 +08:00
Wangda Tan	adf260a728	Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" ... This reverts commit 805a9ed85e.	2016-01-18 16:50:45 +08:00
Wangda Tan	b08ecf5c75	YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda)	2016-01-18 11:11:32 +08:00
Wangda Tan	805a9ed85e	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)	2016-01-18 11:04:25 +08:00
Wangda Tan	9523648d57	YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda)	2016-01-18 10:57:14 +08:00
Junping Du	02f597c5db	YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe	2016-01-17 17:37:40 -08:00
Colin Patrick Mccabe	b2c155f810	HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)	2016-01-15 12:29:18 -08:00
Junping Du	fc6d3a3b23	YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee.	2016-01-15 08:40:56 -08:00
rohithsharmaks	f7736f464f	YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks)	2016-01-15 21:38:26 +05:30
Colin Patrick Mccabe	b1ed28fa77	HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)	2016-01-14 11:02:34 -08:00
Karthik Kambatla	9d04f26d4c	YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha)	2016-01-14 08:33:23 -08:00
Varun Vasudev	3ddb92bd30	YARN-4553. Add cgroups support for docker containers. Contributed by Sidharta Seethana.	2016-01-14 14:29:29 +05:30
Akira Ajisaka	62b0d61513	YARN-4534. Remove the redundant symbol in yarn rmadmin help msg. Contributed by Lin Yiqun.	2016-01-14 13:59:39 +09:00
Karthik Kambatla	321072ba81	YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha)	2016-01-13 12:09:34 -08:00
Wangda Tan	c0537bcd2c	YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)	2016-01-13 13:18:31 +08:00
Jason Lowe	13de8359a1	YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li	2016-01-12 15:56:15 +00:00
Akira Ajisaka	da1e3e3c57	YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67.	2016-01-12 15:12:17 +09:00
Wangda Tan	9e792da014	YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)	2016-01-12 12:53:31 +08:00
Akira Ajisaka	56b9500bbd	HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.	2016-01-12 13:34:18 +09:00
Jian He	5fab4ec31c	Missing file for YARN-4580	2016-01-11 17:00:44 -08:00
Jian He	b8942be888	YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S	2016-01-11 16:44:28 -08:00
Jian He	109e528ef5	YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S	2016-01-08 15:51:10 -08:00
Xuan	89022f8d4b	YARN-4438. Implement RM leader election with curator. Contributed by Jian He	2016-01-07 14:33:06 -08:00
Akira Ajisaka	52b77577c4	YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi.	2016-01-08 01:12:46 +09:00
Steve Loughran	07d1cb612c	YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel)	2016-01-07 14:30:20 +00:00
rohithsharmaks	791c1639ae	YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)	2016-01-07 09:38:47 +05:30
Junping Du	c1462a67ff	YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe.	2016-01-06 05:49:24 -08:00
rohithsharmaks	6da6d87872	YARN-4535. Fix checkstyle error in CapacityScheduler.java (Naganarasimha G R via rohithsharmaks)	2016-01-05 12:09:57 +05:30
Rohith Sharma K S	f9e36dea96	YARN-4530. LocalizedResource trigger a NPE Cause the NodeManager exit. (tangshangwen via rohithsharmaks)	2016-01-04 09:58:13 +05:30
Wangda Tan	4e4b3a8465	YARN-4524. Cleanup AppSchedulingInfo. (Karthik Kambatla via wangda) ... (cherry picked from commit 05fa852d7567b7590d6b53bbf925f8f424736514)	2015-12-30 15:39:34 -08:00
Wangda Tan	8310b2e9ff	YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)	2015-12-30 15:30:12 -08:00
Junping Du	223ce323bb	YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S.	2015-12-30 07:52:07 -08:00
Jian He	ad997fab67	YARN-4098. Document ApplicationPriority feature. Contributed by Rohith Sharma K S	2015-12-29 16:51:55 -08:00
Jian He	5273413411	YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong	2015-12-29 15:58:39 -08:00
Wangda Tan	561abb9fee	YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda)	2015-12-29 13:28:00 -08:00
Jian He	d0a22bae9b	YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan	2015-12-28 15:52:45 -08:00
Karthik Kambatla	fb00794368	YARN-2882. Add an OPPORTUNISTIC ExecutionType. (Konstantinos Karanasos and Inigo Goiri via kasha)	2015-12-26 20:22:16 -08:00
Gera Shegalov	2c17b81569	YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)	2015-12-24 23:48:05 -08:00
Karthik Kambatla	0af492b4bd	YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha)	2015-12-23 17:52:36 -08:00
Junping Du	bb5df272b9	YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.	2015-12-23 08:55:12 -08:00
Junping Du	882f2f0464	YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.	2015-12-23 05:26:51 -08:00
rohithsharmaks	8c180a13c8	YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks)	2015-12-23 09:12:32 +05:30
Arun Suresh	e88422df45	YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh)	2015-12-21 22:41:09 -08:00
cnauroth	114b590955	YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.	2015-12-21 16:59:09 -08:00
Wangda Tan	a0de702851	YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda)	2015-12-21 11:36:22 -08:00
Wangda Tan	bc038b382c	YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)	2015-12-21 11:30:13 -08:00
Uma Mahesh	0f82b5d878	YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh)	2015-12-19 23:10:13 -08:00
Jian He	85c2466048	YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S	2015-12-18 14:13:48 -08:00
Junping Du	1de56b0448	YARN-3226. UI changes for decommissioning node. Contributed by Sunil G.	2015-12-17 15:20:17 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	4e7d32c0db	YARN-1856. Added cgroups based memory monitoring for containers as another alternative to custom memory-monitoring. Contributed by Varun Vasudev.	2015-12-17 12:13:03 -08:00
Jason Lowe	91828fef6b	YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne	2015-12-16 23:22:31 +00:00
Wangda Tan	9b856d9787	YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda)	2015-12-16 13:22:37 -08:00
Wangda Tan	7faa406f27	YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)	2015-12-16 13:19:40 -08:00
Wangda Tan	79c41b1d83	YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)	2015-12-16 13:18:19 -08:00
Siddharth Seth	0f708d465f	YARN-4207. Add a non-judgemental YARN app completion status. Contributed by Rich Haase.	2015-12-16 11:33:55 -08:00
Junping Du	50bd067e1d	YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.	2015-12-16 10:57:39 -08:00
Zhihai Xu	2aaed10327	YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun	2015-12-15 00:17:21 -08:00
Xuan	d8a45425eb	YARN-4439. Clarify NMContainerStatus#toString method. Contributed by ... Jian He	2015-12-14 15:41:28 -08:00
Jian He	915cd6c3f4	YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula	2015-12-14 14:59:01 -08:00
Jian He	1cb3299b48	YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du	2015-12-14 13:51:23 -08:00
Wangda Tan	07b0fb996a	YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda)	2015-12-14 11:24:30 -08:00
Wangda Tan	dfcbbddb09	YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)	2015-12-14 11:13:22 -08:00
Wangda Tan	6cb0af3c39	YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda)	2015-12-14 10:52:46 -08:00
Arun Suresh	7fb212e5e6	YARN-4358 addendum patch to fix javadoc error	2015-12-12 22:22:55 -08:00
Sangjin Lee	e8964589de	YARN-4341. add doc about timeline performance tool usage (Chang Li via sjlee)	2015-12-11 09:46:32 -08:00
Xuan	21daa6c68a	YARN-3623-Addendum: Improve the description for Timeline Service Version configuration in yarn-default.xml	2015-12-10 10:56:12 -08:00
Junping Du	f910e4f639	YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.	2015-12-10 02:53:47 -08:00
Akira Ajisaka	50edcb947c	YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang.	2015-12-09 16:32:33 +09:00
rohithsharmaks	a5e2e1ecb0	YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks)	2015-12-09 11:31:51 +05:30
rohithsharmaks	15c3e7ffe3	YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks)	2015-12-09 10:50:43 +05:30
Wangda Tan	7e4715186d	YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)	2015-12-08 14:25:16 -08:00
Chris Douglas	9f50e13d5d	YARN-4248. Followup patch adding asf-licence exclusions for json test files	2015-12-08 12:08:04 -08:00
=	c25a635459	YARN-4248. REST API for submit/update/delete Reservations. (curino)	2015-12-07 13:33:28 -08:00
Jonathan Eagles	4ff973f96a	YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)	2015-12-07 15:04:48 -06:00
Xuan	4546c7582b	YARN-4392. ApplicationCreatedEvent event time resets after RM ... restart/failover. Contributed by Naganarasimha G R and Xuan Gong	2015-12-07 12:24:55 -08:00
rohithsharmaks	01a641bc44	YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)	2015-12-07 15:16:56 +05:30
Steve Loughran	65f395226b	HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]	2015-12-06 17:43:35 +00:00
Arun Suresh	742632e346	YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh)	2015-12-05 21:26:16 -08:00
Jian He	e84d6ca2df	Add missing file for YARN-4419	2015-12-03 19:07:28 -08:00
Jian He	755dda8dd8	YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan	2015-12-03 17:45:31 -08:00
Wangda Tan	a2c3bfc8c1	YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda)	2015-12-03 14:28:32 -08:00
Jian He	9f77ccad73	YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena	2015-12-03 12:48:50 -08:00
Junping Du	62e9348bc1	YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter.	2015-12-03 06:36:37 -08:00
Jian He	6b9a5beb2b	YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding	2015-12-02 11:07:18 -08:00
Tsuyoshi Ozawa	0656d2dc83	YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena.	2015-11-26 01:10:02 +09:00
Wangda Tan	23c625ec57	YARN-4384. updateNodeResource CLI should not accept negative values for resource. (Junping Du via wangda)	2015-11-24 16:35:56 -08:00
Jason Lowe	f5acf94eca	YARN-4365. FileSystemNodeLabelStore should check for root dir existence on startup. Contributed by Kuhu Shukla	2015-11-24 23:47:10 +00:00
Jason Lowe	4ac6799d4a	YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li	2015-11-24 22:35:37 +00:00
Tsuyoshi Ozawa	28dfe721b8	YARN-4387. Fix typo in FairScheduler log message. Contributed by Xin Wang.	2015-11-24 19:24:01 +09:00
Akira Ajisaka	8c0133f3d4	YARN-4298. Fix findbugs warnings in hadoop-yarn-common. Contributed by Sunil G.	2015-11-24 18:40:33 +09:00
Karthik Kambatla	52948bb20b	YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)	2015-11-24 13:47:17 +05:30
Jian He	8676a118a1	YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan	2015-11-23 17:19:48 -08:00
Jason Lowe	d36b6e045f	YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev	2015-11-23 20:30:26 +00:00
Arun Suresh	da1016365a	YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)	2015-11-21 09:59:41 -08:00
Wangda Tan	2346fa3141	YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)	2015-11-20 15:55:50 -08:00
Jason Lowe	060cdcbe5d	YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li	2015-11-20 23:12:29 +00:00
Xuan	f114e728da	YARN-2859.addendum: fix the remaining issue from the previous patch	2015-11-19 10:08:38 -08:00
Steve Loughran	253e0404f3	YARN-4279. Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable. (stevel)	2015-11-18 21:41:39 +00:00
Arun Suresh	6a61928fb7	YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)	2015-11-17 15:50:34 -08:00
Jian He	fcd7888029	Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan" ... This reverts commit 8fbea531d7. Conflicts: hadoop-yarn-project/CHANGES.txt	2015-11-16 20:18:44 -08:00
Junping Du	855d52927b	YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.	2015-11-15 04:43:57 -08:00
Wangda Tan	7ff280fca9	YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda)	2015-11-12 11:50:00 -08:00
Wangda Tan	7f55a18071	YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)	2015-11-12 11:23:40 -08:00
Wangda Tan	796638d9bc	YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)	2015-11-12 11:09:37 -08:00
Jason Lowe	06a70311b9	YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du	2015-11-12 14:49:06 +00:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	6351d3fa63	YARN-4183. Reverting the patch to fix behaviour change. ... Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)" This reverts commit c293c58954.	2015-11-11 10:40:43 -08:00
Akira Ajisaka	23d0db551c	YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas.	2015-11-11 16:13:08 +09:00
Wangda Tan	c99925d6dd	YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda)	2015-11-10 11:45:46 -08:00
Jian He	8fbea531d7	YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan	2015-11-09 10:43:45 -08:00
Allen Wittenauer	b76b0ce51e	HADOOP-12366. expose calculated paths (aw)	2015-11-07 08:32:56 -08:00
Varun Vasudev	73b9c7b82b	HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer.	2015-11-04 15:56:17 +05:30
Wangda Tan	0783184f4b	YARN-4326. Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188. (Meng Ding via wangda)	2015-11-03 11:18:34 -08:00
Tsuyoshi Ozawa	ce31b22739	YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.	2015-10-30 18:00:20 +09:00
Jian He	e5b1733e04	YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena	2015-10-29 15:42:57 -07:00
Jonathan Eagles	c293c58954	YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)	2015-10-29 16:41:10 -05:00
Arun Suresh	58d1df585c	YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh)	2015-10-29 13:42:09 -07:00
Jason Lowe	e2267de207	YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena	2015-10-29 16:34:25 +00:00
Jian He	c41699965e	YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du	2015-10-29 00:00:48 -07:00
Rohith Sharma K S	656c8f9527	YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks)	2015-10-29 12:22:44 +05:30
Xuan	27414dac66	YARN-2859. ApplicationHistoryServer binds to default port 8188 in ... MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli	2015-10-28 10:32:16 -07:00
Tsuyoshi Ozawa	9f4dfdf4eb	YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula.	2015-10-28 17:39:12 +09:00
Tsuyoshi Ozawa	96677bef00	YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.	2015-10-27 12:35:01 +09:00
Akira Ajisaka	8a68630dd1	YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka)	2015-10-27 10:28:01 +09:00
Wangda Tan	56e4f6237a	YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda)	2015-10-26 16:44:39 -07:00
Wangda Tan	6f606214e7	YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)	2015-10-26 16:36:34 -07:00
Wangda Tan	3cc73773eb	YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)	2015-10-26 13:07:39 -07:00
Jason Lowe	33a03af3c3	YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee	2015-10-26 19:53:03 +00:00
Rohith Sharma K S	5acdde4744	YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)	2015-10-26 15:42:42 +05:30
Rohith Sharma K S	092883b34a	YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager project. (varun saxena via rohithsharmaks)	2015-10-26 15:23:51 +05:30
Tsuyoshi Ozawa	ce60b4fc8b	YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula.	2015-10-26 16:45:11 +09:00
Rohith Sharma K S	b57f08c0d2	YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks)	2015-10-26 11:56:36 +05:30
Allen Wittenauer	1aa735c188	YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw)	2015-10-25 21:43:23 -07:00
Arun Suresh	ab8eb8770c	YARN-3738. Add support for recovery of reserved apps running under dynamic queues (subru via asuresh)	2015-10-24 22:53:10 -07:00
Steve Loughran	446212a39e	YARN-4296. DistributedShell Log.info is not friendly. (Xiaowei Wang via stevel)	2015-10-24 12:55:36 +01:00
Steve Loughran	14f8dd0423	YARN-4289. TestDistributedShell failing with bind exception. (Brahma Reddy Battula via stevel)	2015-10-24 12:48:15 +01:00
Akira Ajisaka	7781fe1b9e	YARN-4294. [JDK8] Fix javadoc errors caused by wrong reference and illegal tag. (aajisaka)	2015-10-24 11:54:42 +09:00
Jason Lowe	d3a34a4f38	YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G	2015-10-23 20:57:01 +00:00
Ming Ma	934d96a334	YARN-2913. Fair scheduler should have ability to set MaxResourceDefault for each queue. (Siqi Li via mingma)	2015-10-23 08:36:33 -07:00
Jonathan Eagles	f8adeb712d	YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)	2015-10-23 10:34:08 -05:00
Junping Du	0fce5f9a49	YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.	2015-10-22 13:41:09 -07:00
Zhihai Xu	960201b79b	YARN-4256. YARN fair scheduler vcores with decimal values. Contributed by Jun Gong	2015-10-22 12:28:03 -07:00
Anubhav Dhoot	2798723a54	YARN-3739. Add reservation system recovery to RM recovery process. Contributed by Subru Krishnan.	2015-10-22 06:51:00 -07:00
Jonathan Eagles	25f8f801d1	YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)	2015-10-21 15:38:08 -05:00
Arun Suresh	506d1b1dbc	YARN-3985. Make ReservationSystem persist state using RMStateStore reservation APIs. (adhoot via asuresh)	2015-10-20 16:46:14 -07:00
Arun Suresh	7e2837f830	YARN-4270. Limit application resource reservation on nodes for non-node/rack specific requests (asuresh)	2015-10-19 20:00:38 -07:00
Varun Vasudev	151eab2a12	YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana.	2015-10-19 20:56:01 +05:30
Varun Vasudev	e39ae0e676	YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.	2015-10-19 20:19:22 +05:30
Steve Loughran	e2d59e2c7b	YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel)	2015-10-18 12:03:57 +01:00
Jian He	f9da5cdb2b	YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G	2015-10-16 15:26:27 -07:00
Wangda Tan	4337b263aa	YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda)	2015-10-16 15:06:28 -07:00
Jian He	cf23f2c2b5	YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena	2015-10-15 17:12:46 -07:00
Varun Vasudev	63020c54c1	YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana.	2015-10-15 13:41:20 +05:30
Steve Loughran	dfa7848463	HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)	2015-10-14 20:25:47 +01:00
rohithsharmaks	d6c8bad869	YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks)	2015-10-14 16:11:34 +05:30
Varun Vasudev	da1ee078f9	YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana.	2015-10-14 15:25:21 +05:30
Varun Vasudev	fb9c1519b3	YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana.	2015-10-14 15:18:08 +05:30
Varun Vasudev	8d59293089	YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana.	2015-10-14 14:58:10 +05:30
Steve Loughran	c59af2fdf8	HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)	2015-10-13 21:49:28 +01:00
Varun Vasudev	5b6bae0094	YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana	2015-10-13 12:48:30 +05:30
Jian He	9849c8b386	YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding	2015-10-12 11:51:33 -07:00
Zhihai Xu	049c6e8dc0	YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong.	2015-10-12 00:14:25 -07:00
Devaraj K	db93047881	YARN-3964. Support NodeLabelsProvider at Resource Manager side. ... Contributed by Dian Fu.	2015-10-11 11:21:29 +05:30
Wangda Tan	def374e666	YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda)	2015-10-09 16:38:59 -07:00
Karthik Kambatla	4aa9b3e75c	MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)	2015-10-09 07:37:39 -07:00
Jason Lowe	a0bca2b5ad	YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S	2015-10-09 14:17:38 +00:00
Rohith Sharma K S	8f195387a4	YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks)	2015-10-09 10:09:26 +05:30
Jason Lowe	8d226225d0	YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu	2015-10-08 22:25:34 +00:00
Rohith Sharma K S	3793cbe4c3	YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks)	2015-10-07 10:12:14 +05:30
Rohith Sharma K S	9156fc60c6	YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks)	2015-10-07 09:34:59 +05:30
Wangda Tan	29a582ada0	YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda)	2015-10-06 11:56:04 -07:00
Wangda Tan	30ac69c6bd	YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda)	2015-10-05 15:47:21 -07:00
Vinod Kumar Vavilapalli	f1c19b9365	HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan.	2015-10-05 10:56:55 -07:00
Harsh J	c918f7be5e	HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.	2015-10-03 18:37:58 +05:30
Xuan	8f08532bde	YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma	2015-10-02 18:50:47 -07:00
Jason Lowe	fdf02d1f26	YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu	2015-10-02 20:20:31 +00:00
Jason Lowe	854d25b0c3	YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu	2015-09-30 14:59:44 +00:00
Karthik Kambatla	a0b5a0a419	YARN-4066. Large number of queues choke fair scheduler. (Johan Gustavsson via kasha)	2015-09-29 07:55:34 -07:00
Anubhav Dhoot	9735afe967	YARN-4180. AMLauncher does not retry on failures when talking to NM. (adhoot)	2015-09-28 16:13:41 -07:00
Jason Lowe	9f53a95ff6	YARN-4141. Runtime Application Priority change should not throw exception for applications at finishing states. Contributed by Sunil G	2015-09-28 22:55:20 +00:00
Anubhav Dhoot	fb2e525c07	YARN-4204. ConcurrentModificationException in FairSchedulerQueueInfo. (adhoot)	2015-09-28 09:05:45 -07:00
Xuan	d1b9b85244	YARN-3624. ApplicationHistoryServer should not reverse the order of the ... filters it gets. Contributed by Mit Desai	2015-09-24 15:01:17 -07:00
Rohith Sharma K S	a9aafad12b	YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks)	2015-09-24 12:13:22 +05:30
Rohith Sharma K S	8ed0d4b744	YARN-4152. NodeManager crash with NPE when LogAggregationService#stopContainer called for absent container. (Bibin A Chundatt via rohithsharmaks)	2015-09-24 11:24:14 +05:30
Jian He	b3f6b641dc	YARN-4171. Fix findbugs warnings in YARN-1197 branch. Contributed by Wangda Tan	2015-09-23 13:29:38 -07:00
Jian He	89cab1ba5f	YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan	2015-09-23 13:29:38 -07:00
Jian He	c57eac5dfe	YARN-3868. Recovery support for container resizing. Contributed by Meng Ding	2015-09-23 13:29:38 -07:00
Jian He	c3dc1af072	YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding	2015-09-23 13:29:37 -07:00
Jian He	c59ae4eeb1	YARN-1643. Make ContainersMonitor support changing monitoring size of an allocated container. Contributed by Meng Ding and Wangda Tan	2015-09-23 13:29:37 -07:00
Jian He	5f5a968d65	YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding	2015-09-23 13:29:37 -07:00
Jian He	ffd820c27a	YARN-1645. ContainerManager implementation to support container resizing. Contributed by Meng Ding & Wangda Tan	2015-09-23 13:29:37 -07:00
Jian He	83a18add10	YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)	2015-09-23 13:29:36 -07:00
Jian He	dfe2cb849f	YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding	2015-09-23 13:29:36 -07:00
Jason Lowe	692d51c09d	YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai	2015-09-23 16:38:55 +00:00
Jason Lowe	c890c51a91	YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu	2015-09-23 15:42:01 +00:00
Tsuyoshi Ozawa	dfd807afab	HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.	2015-09-22 12:54:29 +09:00
Chris Douglas	8e01b0d97a	YARN-4188. Make MoveApplicationAcrossQueues abstract, newInstance static ... Contributed by Giovanni Matteo Fumarola	2015-09-21 17:51:48 -07:00
Wangda Tan	b00392dd9c	YARN-4113. RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER. (Sunil G via wangda)	2015-09-21 11:04:03 -07:00
Rohith Sharma K S	c9cb6a5960	YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks)	2015-09-21 09:59:30 +05:30
Arun Suresh	94dec5a916	YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh)	2015-09-18 14:02:55 -07:00
Wangda Tan	9bc913a35c	YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda)	2015-09-18 10:04:17 -07:00
Steve Loughran	a7201d635f	YARN-2597 MiniYARNCluster should propagate reason for AHS not starting	2015-09-18 09:45:35 +01:00
Rohith Sharma K S	723c31d45b	YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks)	2015-09-18 08:44:10 +05:30
Jian He	6c6e734f0b	YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S	2015-09-17 14:55:50 +08:00
Steve Loughran	bf2f2b4fc4	YARN-3433. Jersey tests failing with Port in Use -again. (Brahma Reddy Battula)	2015-09-16 10:31:02 +01:00
Jian He	452079af8b	YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R	2015-09-16 14:59:20 +08:00
Xuan	34ef1a092b	YARN-4149. yarn logs -am should provide an option to fetch all the log ... files. Contributed by Varun Vasudev	2015-09-15 14:36:30 -07:00
Jason Lowe	8c1cdb17a0	YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu	2015-09-15 20:21:33 +00:00
Wangda Tan	ae5308fe1d	YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)	2015-09-15 11:40:50 -07:00
Junping Du	73e3a49eb0	YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)	2015-09-15 07:56:47 -07:00
Jian He	5468baa80a	YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan	2015-09-15 15:39:20 +08:00
Wangda Tan	e2a0270217	YARN-4151. Fix findbugs errors in hadoop-yarn-server-common module. (Meng Ding via wangda)	2015-09-14 16:00:43 -07:00
Jian He	e1b1d7e4ae	YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt	2015-09-14 14:09:19 +08:00
Karthik Kambatla	332b520a48	YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)	2015-09-13 18:07:43 -07:00
Karthik Kambatla	81df7b586a	YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)	2015-09-13 17:03:15 -07:00
Steve Loughran	7269906254	HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).	2015-09-13 14:25:26 +01:00
Robert Kanter	ea4bb2749f	YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter)	2015-09-11 11:46:10 -07:00
Robert Kanter	b84fb41bb6	YARN-4115. Reduce loglevel of ContainerManagementProtocolProxy to Debug (adhoot via rkanter)	2015-09-11 11:46:10 -07:00
Varun Vasudev	486d5cb803	YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt.	2015-09-11 14:37:48 +05:30
Wangda Tan	77666105b4	YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda)	2015-09-10 09:30:09 -07:00
Robert Kanter	6dd6ca442a	YARN-4086. Allow Aggregated Log readers to handle HAR files (rkanter)	2015-09-09 18:03:04 -07:00
Zhihai Xu	16b9037dc1	YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe.	2015-09-08 12:29:54 -07:00
Varun Vasudev	435f935ba7	YARN-4121. Fix typos in capacity scheduler documentation. Contributed by Kai Sasaki.	2015-09-08 12:33:43 +05:30
Jian He	6f72f1e600	YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil	2015-09-08 09:35:46 +08:00
Xuan	9b78e6e33d	YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when ... state-store error occurs. Contributed by Jian He	2015-09-07 17:45:47 -07:00
Varun Vasudev	1dbd8e34a7	YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir.	2015-09-07 11:32:12 +05:30
Wangda Tan	bcc85e3bab	YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)	2015-09-04 15:13:53 -07:00
Jason Lowe	6eaca2e363	YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li	2015-09-04 15:30:53 +00:00
Varun Vasudev	40d222e862	YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.	2015-09-04 14:31:51 +05:30
Varun Vasudev	b469ac531a	YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R.	2015-09-03 16:40:10 +05:30
Jian He	09c64ba1ba	YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong	2015-09-02 17:45:23 -07:00
Rohith Sharma K S	7d6687fe76	YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)	2015-09-02 15:22:48 +05:30
Rohith Sharma K S	095ab9ab5f	YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks)	2015-09-02 14:13:33 +05:30
Andrew Wang	0eb9b19325	HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf within target folder.	2015-09-01 10:57:32 -07:00
Tsuyoshi Ozawa	faa38e1aa4	YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R.	2015-09-01 17:54:49 +09:00
Varun Vasudev	bf669b6d9f	YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan.	2015-09-01 14:19:11 +05:30
Jian He	a3fd2ccc86	YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong	2015-08-31 17:33:24 -07:00
Junping Du	beb65c9465	YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang.	2015-08-28 05:57:34 -07:00
Jian He	a9c8ea71aa	YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S	2015-08-27 13:25:53 -07:00
Andrew Wang	90fe7bcc3b	HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. Contributed by Charlie Helin.	2015-08-27 10:17:00 -07:00
Jian He	57c7ae1aff	YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S	2015-08-24 20:36:44 -07:00
Rohith Sharma K S	feaf034994	YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks)	2015-08-24 11:25:07 +05:30
Xuan	b71c6006f5	YARN-221. Addendum patch to compilation issue which is caused by missing ... AllContainerLogAggregationPolicy. Contributed by Xuan Gong	2015-08-23 16:46:30 -07:00
Xuan	37e1c3d82a	YARN-221. NM should provide a way for AM to tell it not to aggregate ... logs. Contributed by Ming Ma	2015-08-22 16:25:24 -07:00
Rohith Sharma K S	22de7c1dca	YARN-3986. getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface	2015-08-21 10:51:11 +05:30
Wangda Tan	fc07464d1a	YARN-2923. Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup. (Naganarasimha G R)	2015-08-20 11:51:03 -07:00
Xuan	22dc5fc209	YARN-4028. AppBlock page key update and diagnostics value null on ... recovery. Contributed by Bibin A Chundatt	2015-08-18 22:53:03 -07:00
Zhihai Xu	14215c8ef8	YARN-4057. If ContainersMonitor is not enabled, only print related log info one time. Contributed by Jun Gong.	2015-08-18 11:36:02 -07:00
Zhihai Xu	3a76a010b8	YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao.	2015-08-18 10:36:40 -07:00
Karthik Kambatla	13604bd5f1	YARN-4055. Report node resource utilization in heartbeat. (Inigo Goiri via kasha)	2015-08-16 15:08:53 -07:00
Karthik Kambatla	def12933b3	YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha)	2015-08-16 06:24:16 -07:00
Jian He	0a030546e2	YARN-3987. Send AM container completed msg to NM once AM finishes. Contributed by sandflee	2015-08-13 16:22:53 -07:00
Jian He	7a445fcfab	YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe	2015-08-13 16:02:57 -07:00
Jian He	38aed1a94e	YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong	2015-08-13 14:46:08 -07:00
Robert Kanter	dc2340c60e	YARN-4031. Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer (djp via rkanter)	2015-08-12 15:47:47 -07:00
Jian He	e5003be907	YARN-4026. Refactored ContainerAllocator to accept a list of priorites rather than a single priority. Contributed by Wangda Tan	2015-08-12 15:07:50 -07:00
rohithsharmaks	1c12adb71f	YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks)	2015-08-12 14:45:41 +05:30
Xuan	3ae716fa69	YARN-3999. RM hangs on draing events. Contributed by Jian He	2015-08-11 18:25:11 -07:00
Jian He	fa1d84ae27	YARN-3887. Support changing Application priority during runtime. Contributed by Sunil G	2015-08-10 20:51:54 -07:00
Wangda Tan	cf9d3c9256	YARN-3873. PendingApplications in LeafQueue should also use OrderingPolicy. (Sunil G via wangda)	2015-08-10 14:54:55 -07:00
Wangda Tan	4bc42d76e7	YARN-3966. Fix excessive loggings in CapacityScheduler. (Jian He via wangda)	2015-08-07 09:46:57 -07:00
Rohith Sharma K S	b6265d39c5	YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks)	2015-08-07 10:43:41 +05:30
Carlo Curino	8572a5a14b	YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino)	2015-08-02 01:55:31 -07:00
Junping Du	cfee02b3bd	YARN-4019. Add JvmPauseMonitor to ResourceManager and NodeManager. Contributed by Robert Kanter.	2015-08-06 06:49:45 -07:00
Arun Suresh	154c9d2e42	YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh)	2015-08-05 23:14:14 -07:00
rohithsharmaks	df9e7280db	YARN-3992. TestApplicationPriority.testApplicationPriorityAllocation fails intermittently. (Contributed by Sunil G)	2015-08-06 10:43:37 +05:30
Jian He	ba2313d614	YARN-3983. Refactored CapacityScheduleri#FiCaSchedulerApp to easier extend container allocation logic. Contributed by Wangda Tan	2015-08-05 13:47:40 -07:00
Arun Suresh	f271d37735	YARN-3736. Add RMStateStore apis to store and load accepted reservations for failover (adhoot via asuresh)	2015-08-05 12:57:12 -07:00
Xuan	c3364ca8e7	YARN-4004. container-executor should print output of docker logs if the ... docker container exits with non-0 exit status. Contributed by Varun Vasudev	2015-08-03 18:10:11 -07:00
Xuan	0306d902f5	YARN-3543. ApplicationReport should be able to tell whether the ... Application is AM managed or not. Contributed by Rohith Sharma K S	2015-08-03 15:46:00 -07:00
Jason Lowe	469cfcd695	YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo	2015-08-03 15:53:32 +00:00
Jonathan Eagles	3cd02b9522	YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles)	2015-08-03 10:38:05 -05:00
Allen Wittenauer	666cafca8d	HADOOP-12249. pull argument parsing into a function (aw)	2015-07-31 14:32:21 -07:00
Jason Lowe	32e490b6c0	YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt	2015-07-31 17:37:24 +00:00
Zhihai Xu	ab80e27703	YARN-433. When RM is catching up with node updates then it should not expire acquired containers. Contributed by Xuan Gong	2015-07-30 21:57:11 -07:00
Wangda Tan	91b42e7d6e	YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (Bibin A Chundatt via wangda)	2015-07-30 10:00:31 -07:00
Wangda Tan	8acb30b016	YARN-3963. AddNodeLabel on duplicate label addition shows success. (Bibin A Chundatt via wangda)	2015-07-30 09:42:55 -07:00
rohithsharmaks	c020b62cf8	YARN-3919. NPEs' while stopping service after exception during CommonNodeLabelsManager#start. (varun saxena via rohithsharmaks)	2015-07-29 23:30:47 +05:30
Karthik Kambatla	5205a330b3	YARN-2768. Avoid cloning Resource in FSAppAttempt#updateDemand. (Hong Zhiguo via kasha)	2015-07-29 09:42:32 -07:00
Jason Lowe	2b2bd92146	YARN-3950. Add unique SHELL_ID environment variable to DistributedShell. Contributed by Robert Kanter	2015-07-29 15:16:40 +00:00
Xuan	f170934215	YARN-3982. container-executor parsing of container-executor.cfg broken ... in trunk and branch-2. Contributed by Varun Vasudev	2015-07-27 23:45:58 -07:00
Jian He	3572ebd738	YARN-3846. RM Web UI queue filter is not working for sub queue. Contributed by Mohammad Shahid Khan	2015-07-27 17:12:05 -07:00
Varun Vasudev	3e6fce91a4	YARN-3853. Add docker container runtime support to LinuxContainterExecutor. Contributed by Sidharta Seethana.	2015-07-27 11:57:40 -07:00
Varun Vasudev	f36835ff9b	YARN-3852. Add docker container support to container-executor. Contributed by Abin Shahab.	2015-07-27 10:14:51 -07:00
Akira Ajisaka	42d4e0ae99	YARN-3958. TestYarnConfigurationFields should be moved to hadoop-yarn-api module. Contributed by Varun Saxena.	2015-07-27 11:43:25 +09:00
ccurino	156f24ead0	YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)	2015-07-25 07:39:47 -07:00
Wangda Tan	a3bd7b4a59	YARN-3973. Recent changes to application priority management break reservation system from YARN-1051 (Carlo Curino via wangda)	2015-07-24 16:44:18 -07:00
Jason Lowe	ff9c13e0a7	YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu	2015-07-24 22:14:39 +00:00
Jian He	83fe34ac08	YARN-3026. Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp. Contributed by Wangda Tan	2015-07-24 14:00:25 -07:00
Karthik Kambatla	d19d187753	YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha)	2015-07-24 11:44:37 -07:00
Xuan	fbd6063269	YARN-3967. Fetch the application report from the AHS if the RM does not ... know about it. Contributed by Mit Desai	2015-07-24 10:15:54 -07:00
carlo curino	0fcb4a8cf2	YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)	2015-07-23 19:33:59 -07:00
Rohith Sharma K S	e202efaf93	YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan)	2015-07-24 12:43:06 +05:30
Robert Kanter	1d3026e7b3	YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter)	2015-07-23 14:46:54 -07:00
Wangda Tan	3bba180051	YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda)	2015-07-23 10:07:57 -07:00
Junping Du	ee98d6354b	YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He.	2015-07-22 17:52:35 -07:00
Wangda Tan	06e5dd2c84	YARN-3956. Fix TestNodeManagerHardwareUtils fails on Mac (Varun Vasudev via wangda)	2015-07-22 12:01:41 -07:00
rohithsharmaks	8376ea3297	YARN-3954. Fix TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml. (varun saxena via rohithsharmaks)	2015-07-23 00:28:24 +05:30
Wangda Tan	76ec26de80	YARN-3932. SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources. (Bibin A Chundatt via wangda)	2015-07-22 11:54:02 -07:00
Jian He	393fe71771	YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena	2015-07-21 15:05:41 -07:00
Allen Wittenauer	3b7ffc4f3f	YARN-3261. rewrite resourcemanager restart doc to remove roadmap bits (Gururaj Shetty via aw)	2015-07-21 10:00:34 -07:00
Wangda Tan	c39ca541f4	YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda)	2015-07-21 09:57:23 -07:00
Allen Wittenauer	da2d1ac4bc	YARN-3915. scmadmin help message correction (Bibin A Chundatt via aw)	2015-07-21 09:44:45 -07:00
Colin Patrick Mccabe	419c51d233	YARN-3844. Make hadoop-yarn-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe)	2015-07-17 11:38:59 -07:00
Jonathan Eagles	7faae0e6fe	YARN-3905. Application History Server UI NPEs when accessing apps run after RM restart (Eric Payne via jeagles)	2015-07-17 11:02:11 -05:00
Arun Suresh	9b272ccae7	YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh)	2015-07-17 04:31:34 -07:00
Allen Wittenauer	ee36f4f9b8	HADOOP-10979. Auto-entries in hadoop_usage (aw)	2015-07-16 16:58:11 -07:00