3659 Commits

Author	SHA1	Message	Date
Subru Krishnan	047a16bf15	YARN-5307. Federation Application State Store internal APIs ... (cherry picked from commit 1af5292042a336a5789b72f0fb6d5f4636d64d49)	2017-08-01 17:28:18 -07:00
Subru Krishnan	d19b677301	YARN-5390. Federation Subcluster Resolver. Contributed by Ellen Hui. ... (cherry picked from commit d3dc461a935c2af4ec3f0312ff0c26918c408467)	2017-08-01 17:28:18 -07:00
Subru Krishnan	dcf8c52d80	YARN-5406. In-memory based implementation of the FederationMembershipStateStore. Contributed by Ellen Hui. ... (cherry picked from commit 20d1d2be91bf841e0fee32522ee7b560a6f2598f)	2017-08-01 17:28:18 -07:00
Subru Krishnan	3e22896f86	YARN-3662. Federation Membership State Store internal APIs. ... (cherry picked from commit 5424d0899cd68cb728f60adcefd2a95877cddbca)	2017-08-01 17:28:17 -07:00
Jian He	91f120f743	YARN-6872. Ensure apps could run given NodeLabels are disabled post RM switchover/restart. Contributed by Sunil G	2017-08-01 09:56:33 -07:00
Akira Ajisaka	b38a1eea8e	HADOOP-14245. Use Mockito.when instead of Mockito.stub. Contributed by Andras Bokor.	2017-08-01 15:15:43 +09:00
Akira Ajisaka	a4aa1cb405	Revert "YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang." ... This reverts commit 1a78c0ff01.	2017-08-01 12:15:03 +09:00
Akira Ajisaka	1a78c0ff01	YARN-6873. Moving logging APIs over to slf4j in hadoop-yarn-server-applicationhistoryservice. Contributed by Yeliang Cang.	2017-08-01 10:53:32 +09:00
Akira Ajisaka	f8bed5e9a7	YARN-5728. TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout.	2017-07-31 11:09:13 +09:00
Arun Suresh	890e14c02a	YARN-6870. Fix floating point inaccuracies in resource availability check in AllocationBasedResourceUtilizationTracker. (Brook Zhou via asuresh)	2017-07-28 16:32:43 -07:00
Subru Krishnan	bcde66bed1	YARN-6897. Refactoring RMWebServices by moving some util methods to RMWebAppUtil. (Giovanni Matteo Fumarola via Subru).	2017-07-28 15:44:36 -07:00
Yufei Gu	9ea01fd956	YARN-6802. Add max AM resource and AM resource usage to leaf queue view in FairScheduler WebUI. (YunFan Zhou via Yufei Gu)	2017-07-28 09:52:53 -07:00
Yufei Gu	9902be72cb	YARN-6864. FSPreemptionThread cleanup for readability. (Daniel Templeton via Yufei Gu)	2017-07-27 23:19:39 -07:00
Akira Ajisaka	38c6fa5c7a	HADOOP-11875. [JDK9] Adding a second copy of Hamlet without _ as a one-character identifier.	2017-07-28 09:10:52 +09:00
Varun Saxena	11ece0bda1	Addendum for YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)	2017-07-28 00:10:45 +05:30
Varun Saxena	f66fd11e51	YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)	2017-07-27 23:14:50 +05:30
Daniel Templeton	f81a4efb8c	YARN-6307. Refactor FairShareComparator#compare (Contributed by Yufei Gu via Daniel Templeton)	2017-07-25 13:00:31 -07:00
Jian He	ac9489f7fc	YARN-6804. Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi	2017-07-25 09:57:14 -07:00
Akira Ajisaka	cca51e916b	HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.	2017-07-25 15:24:56 +09:00
Akira Ajisaka	218b1b33ff	YARN-6150. TestContainerManagerSecurity tests for Yarn Server are flakey. Contributed by Daniel Sturman and Ray Chiang.	2017-07-25 15:12:08 +09:00
Daniel Templeton	10583625c1	YARN-6845. Variable scheduler of FSLeafQueue duplicates the one of its parent FSQueue. ... (Contributed by Yufei Gu via Daniel Templeton)	2017-07-24 13:44:00 -07:00
Daniel Templeton	bb30bd3771	YARN-6779. DominantResourceFairnessPolicy.DominantResourceFairnessComparator.calculateShares() should be @VisibleForTesting ... (Contributed by Yeliang Cang via Daniel Templeton)	2017-07-24 12:13:50 -07:00
Sunil G	e315328428	YARN-6102. RMActiveService context to be updated with new RMContext on failover. Contributed by Rohith Sharma K S.	2017-07-24 11:39:03 +05:30
Brahma Reddy Battula	2054324d47	Revert "YARN-6804. [YARN core changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi" ... This reverts commit 4a771d9010.	2017-07-23 12:56:18 +08:00
Jian He	4a771d9010	YARN-6804. [YARN core changes] Allow custom hostname for docker containers in native services. Contributed by Billie Rinaldi	2017-07-21 11:31:33 -07:00
Jason Lowe	c8df3668ec	YARN-6837. Null LocalResource visibility or resource type can crash the nodemanager. Contributed by Jinjiang Ling	2017-07-20 11:03:04 -05:00
Arun Suresh	077fcf6a96	YARN-6777. Support for ApplicationMasterService processing chain of interceptors. (asuresh)	2017-07-19 12:26:40 -07:00
Rohith Sharma K S	845c4e52bd	YARN-6819. Application report fails if app rejected due to nodesize. Contributed by Bibin A Chundatt.	2017-07-19 11:10:52 +05:30
Yufei Gu	daaf530fce	YARN-6778. In ResourceWeights, weights and setWeights() should be final. (Daniel Templeton via Yufei Gu)	2017-07-18 16:38:07 -07:00
Ray Chiang	f5f14a2ad6	YARN-6798. Fix NM startup failure with old state store due to version mismatch. (Botong Huang via rchiang)	2017-07-18 12:35:08 -07:00
Sunil G	0b7afc060c	Addendum patch for YARN-5731	2017-07-18 11:49:09 +05:30
Arun Suresh	5b007921cd	YARN-6706. Refactor ContainerScheduler to make oversubscription change easier. (Haibo Chen via asuresh)	2017-07-17 14:11:14 -07:00
Yufei Gu	9e0cde1469	YARN-6625. yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment. (Yufei Gu)	2017-07-14 14:10:45 -07:00
Jason Lowe	a5ae5ac50e	YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt	2017-07-14 14:56:00 -05:00
bibinchundatt	75c0220b44	YARN-6759. Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure. Contributed by Naganarasimha G R	2017-07-14 13:53:39 +05:30
Yufei Gu	4a574e9a84	YARN-6769. Make schedulables without demand less needy in FairSharePolicy#compare. (Yunfan Zhou via Yufei Gu)	2017-07-13 23:10:10 -07:00
Sunil G	228ddaa31d	YARN-6792. Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo. Contributed by Giovanni Matteo Fumarola.	2017-07-14 08:07:05 +05:30
Jason Lowe	ebc048cc05	YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe	2017-07-13 17:44:47 -05:00
Jason Lowe	0ffca5d347	Revert "YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe" ... This reverts commit f76f5c0919.	2017-07-13 17:42:38 -05:00
Jason Lowe	f76f5c0919	YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe	2017-07-13 17:38:17 -05:00
Jason Lowe	5f1ee72b0e	YARN-6654. RollingLevelDBTimelineStore backwards incompatible after fst upgrade. Contributed by Jonathan Eagles	2017-07-13 17:27:40 -05:00
Wangda Tan	945c0958bb	YARN-6775. CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls. (Nathan Roberts via wangda) ... Change-Id: I84ccd54200ccbaae23018ef320028e42b4c3509a	2017-07-13 10:30:15 -07:00
Sunil G	cf0d0844d6	YARN-5731. Preemption calculation is not accurate when reserved containers are present in queue. Contributed by Wangda Tan.	2017-07-13 16:48:29 +05:30
Xuan	9845bea59c	YARN-6689. PlacementRule should be configurable. (Jonathan Hung via xgong)	2017-07-12 15:40:45 -07:00
Sunil G	34f113df5c	YARN-6714. IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by Tao Yang.	2017-07-11 14:52:44 +05:30
Arun Suresh	5496a34c0c	YARN-6776. Refactor ApplicaitonMasterService to move actual processing logic to a separate class. (asuresh)	2017-07-10 14:34:58 -07:00
Steve Loughran	09653ea098	HADOOP-14634. Remove jline from main Hadoop pom.xml. ... Contributed by Ray Chiang.	2017-07-10 11:53:13 +01:00
Yufei Gu	3de47ab5ea	YARN-6764. Simplify the logic in FairScheduler#attemptScheduling. Contributed by Yufei Gu.	2017-07-09 16:09:12 -07:00
Naganarasimha	626d730bfc	YARN-6428. Queue AM limit is not honored in CS always. Contributed by Bibin A Chundatt.	2017-07-09 17:26:09 +05:30
Daniel Templeton	9d27880442	YARN-6410. FSContext.scheduler should be final (Contributed by Yeliang Cang via Daniel Templeton)	2017-07-09 19:34:35 +09:00
Daniel Templeton	c5a0c38d8e	YARN-6746. SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code ... (Contributed by Deepti Sawhney via Daniel Templeton)	2017-07-09 19:27:32 +09:00
Daniel Templeton	0615985886	YARN-6752. Display reserved resources in web UI per application ... (Contributed by Abdullah Yousufi via Daniel Templeton)	2017-07-09 19:02:31 +09:00
Jason Lowe	7576a688ea	YARN-6708. Nodemanager container crash after ext3 folder limit. Contributed by Bibin A Chundatt	2017-07-06 09:40:09 -05:00
Naganarasimha	fa1aaee87b	YARN-6681. Eliminate double-copy of child queues in canAssignToThisQueue. Contributed by Daryn Sharp.	2017-07-01 12:29:39 +05:30
Andrew Wang	af2773f609	Updating version for 3.0.0-beta1 development	2017-06-29 17:57:40 -07:00
Daniel Templeton	ec97519779	YARN-6751. Display reserved resources in web UI per queue ... (Contributed by Abdullah Yousufi via Daniel Templeton)	2017-06-29 16:53:50 -07:00
Sunil G	c1edca101c	YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin.	2017-06-28 15:40:58 -07:00
Jason Lowe	63ce1593c5	YARN-6738. LevelDBCacheTimelineStore should reuse ObjectMapper instances. Contributed by Zoltan Haindrich	2017-06-27 17:12:42 -05:00
Yufei Gu	0b77262890	YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu)	2017-06-23 13:26:03 -07:00
Sunil G	ca13b224b2	YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne.	2017-06-22 23:50:57 -07:00
Naganarasimha	740204b292	YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt.	2017-06-23 07:52:41 +05:30
Arun Suresh	49aa60e50d	YARN-6127. Add support for work preserving NM restart when AMRMProxy is enabled. (Botong Huang via asuresh).	2017-06-22 11:27:13 -07:00
Akira Ajisaka	099dfe92a9	YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang.	2017-06-20 17:20:27 +09:00
Naganarasimha	ee89ac84e6	YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp	2017-06-19 22:42:45 +05:30
Naganarasimha	e9c2aa1bc3	YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R.	2017-06-19 21:31:40 +05:30
bibinchundatt	d64c842743	YARN-6703. RM startup failure with old state store due to version mismatch. Contributed by Varun Saxena	2017-06-12 18:07:43 +05:30
Eric Payne	5578af8603	YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G.	2017-06-09 16:16:34 -05:00
Naganarasimha	99634d10ed	YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp.	2017-06-09 11:10:13 +05:30
Daniel Templeton	a062374c39	YARN-6679. Reduce Resource instance overhead via non-PBImpl ... (Contributed by Daryn Sharp via Daniel Templeton)	2017-06-08 10:08:08 -07:00
Carlo Curino	547cb53e8a	YARN-6634. [API] Refactor ResourceManager WebServices to make API explicit. (Giovanni Matteo Fumarola via curino)	2017-06-07 13:41:06 -07:00
Varun Saxena	0b7bff706e	YARN-6604. Allow metric TTL for Application table to be specified through cmd (Haibo Chen via Varun Saxena)	2017-06-07 21:51:07 +05:30
Jian He	7311015ace	YARN-6683. Invalid event: COLLECTOR_UPDATE at KILLED. Contributed by Rohith Sharma K S	2017-06-05 13:16:57 -07:00
Daniel Templeton	73ecb19312	YARN-6208. Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application ... (Contributed by Akira Ajisaka via Daniel Templeton)	2017-06-02 08:50:19 -07:00
vrushali	d95c82cb79	YARN-6316 Provide help information and documentation for TimelineSchemaCreator (Contributed by Haibo Chen via Vrushali C)	2017-06-01 18:30:23 -07:00
Daniel Templeton	d5b71e4175	YARN-6246. Identifying starved apps does not need the scheduler writelock ... (Contributed by Karthik Kambatla via Daniel Templeton)	2017-05-31 15:48:04 -07:00
Nathan Roberts	4369690ce6	YARN-6649. RollingLevelDBTimelineServer throws RuntimeException if object decoding ever fails runtime exception. Contributed by Jon Eagles.	2017-05-31 11:32:32 -05:00
Jonathan Eagles	cbfed0e82f	YARN-6497. Method length of ResourceManager#serviceInit() is too long (Gergely Novák via jeagles)	2017-05-31 10:18:42 -05:00
Varun Vasudev	547f18cb96	YARN-6366. Refactor the NodeManager DeletionService to support additional DeletionTask types. Contributed by Shane Kumpf.	2017-05-31 16:15:35 +05:30
Andrew Wang	16ad896d5c	Update maven version for 3.0.0-alpha4 development	2017-05-26 14:09:44 -07:00
Daniel Templeton	d81372dfad	YARN-6646. Modifier 'static' is redundant for inner enums ... (Contributed by ZhangBing Lin via Daniel Templeton)	2017-05-26 12:05:48 -07:00
Jason Lowe	aea42930bb	YARN-6641. Non-public resource localization on a bad disk causes subsequent containers failure. Contributed by Kuhu Shukla	2017-05-26 09:37:56 -05:00
Haibo Chen	47474fffac	YARN-6555. Store application flow context in NM state store for work-preserving restart. (Rohith Sharma K S via Haibo Chen)	2017-05-25 21:15:27 -07:00
Yufei Gu	87590090c8	YARN-6582. FSAppAttempt demand can be updated atomically in updateDemand(). (Karthik Kambatla via Yufei Gu)	2017-05-25 14:22:13 -07:00
Jason Lowe	3fd6a2da4e	YARN-6643. TestRMFailover fails rarely due to port conflict. Contributed by Robert Kanter	2017-05-25 16:07:52 -05:00
Varun Vasudev	1a56a3db59	Addendum patch to fix Docker sanitization.	2017-05-25 14:53:57 +05:30
Akira Ajisaka	bc28da65fb	YARN-6141. ppc64le on Linux doesn't trigger __linux get_executable codepath. Contributed by Sonia Garudi and Ayappan.	2017-05-25 17:06:26 +09:00
Jason Lowe	8bf1949c0e	YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg	2017-05-24 11:22:42 -05:00
Wangda Tan	8e0f83e49a	YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda) ... Change-Id: Ib20326daac10acad363befb0ae0998441fa5b32d	2017-05-22 14:28:55 -07:00
Wangda Tan	c583ab02c7	YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda) ... Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c	2017-05-22 14:26:13 -07:00
Sunil G	b6f66b0da1	YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.	2017-05-22 14:10:06 +05:30
Jian He	e135c0b207	YARN-6627. Use deployed webapp folder to launch new YARN UI. Contributed by Sunil G	2017-05-19 20:14:03 -07:00
Robert Kanter	9855225a79	YARN-6602. Impersonation does not work if standby RM is contacted first (rkanter)	2017-05-19 15:43:22 -07:00
Yufei Gu	66bba8c024	YARN-6249. TestFairSchedulerPreemption fails inconsistently. (Tao Jie via Yufei Gu)	2017-05-19 14:53:27 -07:00
Eric Payne	19482e0d09	YARN-6618. TestNMLeveldbStateStoreService#testCompactionCycle can fail if compaction occurs more than once. Contributed by Jason Lowe.	2017-05-19 11:24:54 -05:00
Varun Vasudev	b46cd315f7	Sanitize arguments before launching Docker containers.	2017-05-18 10:37:16 +05:30
Varun Vasudev	e120ee865a	Validate docker image name before launching container.	2017-05-18 10:29:34 +05:30
Chris Douglas	b23fcc86c6	YARN-6577. Remove unused ContainerLocalization classes. Contributed by ZhangBing Lin	2017-05-17 20:40:06 -07:00
Rohith Sharma K S	d87a63a901	HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe.	2017-05-17 08:27:45 +05:30
Robert Kanter	18c494a00c	YARN-6447. Provide container sandbox policies for groups (gphillips via rkanter)	2017-05-16 18:02:39 -07:00
Jian He	8236130b2c	YARN-6306. NMClient API change for container upgrade. Contributed by Arun Suresh	2017-05-16 10:48:46 -07:00
Jason Lowe	489f85933c	YARN-6603. NPE in RMAppsBlock. Contributed by Jason Lowe	2017-05-16 09:26:44 -05:00
Jonathan Eagles	c48f2976a3	YARN-6598. History server getApplicationReport NPE when fetching report for pre-2.8 job (Jason Lowe via jeagles)	2017-05-15 10:32:01 -05:00
Carlo Curino	6600abbb5c	YARN-6587. Refactor of ResourceManager#startWebApp in a Util class. (Giovanni Matteo Fumarola via curino).	2017-05-12 17:48:55 -07:00
Haibo Chen	6c35001b9f	YARN-6580. Incorrect logger for FairSharePolicy. (Vrushali C via Haibo Chen)	2017-05-12 13:05:40 -07:00
Daniel Templeton	90cb5b4635	YARN-6380. FSAppAttempt keeps redundant copy of the queue	2017-05-11 13:47:02 -07:00
Min Shen	2ada100da7	YARN-5543. ResourceManager SchedulingMonitor could potentially terminate the preemption checker thread. Contributed by Min Shen.	2017-05-11 13:25:31 -07:00
Brahma Reddy Battula	4aae2d40a3	HADOOP-14410. Correct spelling of 'beginning' and variants. Contributed By Dongtao Zhang	2017-05-11 23:33:45 +05:30
Carlo Curino	5cb6e3e082	YARN-6473. Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations.	2017-05-10 14:49:25 -07:00
Daniel Templeton	e7654c4a1f	YARN-6571. Fix JavaDoc issues in SchedulingPolicy ... (Contributed by Weiwei Yang via Daniel Templeton)	2017-05-10 14:34:13 -07:00
Daniel Templeton	74a61438ca	YARN-6475. Fix some long function checkstyle issues ... (Contributed by Soumabrata Chakraborty via Daniel Templeton)	2017-05-10 10:46:50 -07:00
Jason Lowe	6099deebcb	YARN-6552. Increase YARN test timeouts from 1 second to 10 seconds. Contributed by Eric Badger	2017-05-10 08:47:48 -05:00
Haibo Chen	ab2bb93a2a	YARN-6561. Update exception message during timeline collector aux service initialization. (Vrushali C via Haibo Chen)	2017-05-09 21:37:30 -07:00
Haibo Chen	461ee44d28	YARN-6435. [ATSv2] Can't retrieve more than 1000 versions of metrics in time series. (Rohith Sharma K S via Haibo Chen)	2017-05-09 21:12:57 -07:00
Karthik Kambatla	166be0ee95	YARN-3742. YARN RM will shut down if ZKClient creation times out. (Daniel Templeton via kasha)	2017-05-09 14:44:16 -07:00
Daniel Templeton	a2f680493f	YARN-5301. NM mount cpu cgroups failed on some systems ... (Contributed by Miklos Szegedi via Daniel Templeton)	2017-05-09 12:05:46 -07:00
Vrushali Channapattan	7dd258d8f4	YARN-6563 ConcurrentModificationException in TimelineCollectorManager while stopping RM (Contributed by Haibo Chen via Vrushali C)	2017-05-09 11:18:12 -07:00
Andrew Wang	543aac9f28	HADOOP-14386. Rewind trunk from Guava 21.0 back to Guava 11.0.2.	2017-05-09 09:22:53 -07:00
Subru Krishnan	749e5c09b9	YARN-6281. Cleanup when AMRMProxy fails to initialize a new interceptor chain. (Botong Huang via Subru) ... (cherry picked from commit 57a9afbd45b7ef8e6021cc58f96bd0074bf1389d)	2017-05-08 16:55:47 -07:00
Subru Krishnan	cd9ff27ffc	YARN-6234. Support multiple attempts on the node when AMRMProxy is enabled. (Giovanni Matteo Fumarola via Subru).	2017-05-08 16:41:30 -07:00
Jason Lowe	424887ecb7	YARN-3839. Quit throwing NMNotYetReadyException. Contributed by Manikandan R	2017-05-08 17:14:37 -05:00
Subru Krishnan	d6eed5acca	YARN-6565. Fix memory leak and finish app trigger in AMRMProxy. (Botong Huang via Subru).	2017-05-05 16:27:49 -07:00
Chris Douglas	e4f34ecb04	HADOOP-14390. Correct spelling of 'succeed' and variants. Contributed by Dongtao Zhang	2017-05-05 12:10:50 -07:00
Vrushali Channapattan	54e2b9e876	YARN-6375 App level aggregation should not consider metric values reported in the previous aggregation cycle (Varun Saxena via Vrushali C)	2017-05-04 15:25:56 -07:00
Sidharta S	fd5cb2c946	YARN-6374. Improve test coverage and add utility classes for common Docker operations. Contributed by Shane Kumpf	2017-05-03 14:49:30 -07:00
Daniel Templeton	9f0aea0ee2	YARN-6481. Yarn top shows negative container number in FS ... (Contributed by Tao Jie via Daniel Templeton)	2017-05-02 13:06:47 -07:00
Subru Krishnan	6bf42e48ef	YARN-5331. Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).	2017-05-01 18:48:36 -07:00
Subru Krishnan	e514fc432a	YARN-6542. Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent.	2017-05-01 18:10:07 -07:00
Subru Krishnan	a3a615eeab	YARN-4359. Update LowCost agents logic to take advantage of YARN-4358. (Jonathan Yaniv and Ishai Menache via Subru).	2017-05-01 16:01:07 -07:00
Naganarasimha	30fc580196	YARN-6519. Fix warnings from Spotbugs in hadoop-yarn-server-resourcemanager. Contributed by Weiwei Yang.	2017-05-01 20:15:27 +05:30
Naganarasimha	0f1af3178e	YARN-6518. Fix warnings from Spotbugs in hadoop-yarn-server-timelineservice. Contributed by Weiwei Yang.	2017-05-01 16:49:30 +05:30
Daniel Templeton	2e52789edf	YARN-2962. ZKRMStateStore: Limit the number of znodes under a znode (Contributed by Varun Sexena via Daniel Templeton)	2017-04-28 13:30:28 -07:00
Robert Kanter	68e45f554b	YARN-6472. Improve Java sandbox regex (gphillips via rkanter)	2017-04-28 11:01:50 -07:00
Robert Kanter	371b6467dc	YARN-5894. fixed license warning caused by de.ruedigermoeller:fst:jar:2.24 (haibochen via rkanter)	2017-04-27 17:49:38 -07:00
Varun Saxena	793bbf216d	YARN-6455. Enhance the timelinewriter.flush() race condition fix (Haibo Chen via Varun Saxena)	2017-04-27 15:01:58 +05:30
Akira Ajisaka	8a99eba96d	Revert "YARN-5007. Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster. Contributed by Andras Bokor." ... This reverts commit 34ab8e73d4.	2017-04-26 15:34:23 +09:00
Wangda Tan	2ba21d6376	YARN-6392. Add submit time to Application Summary log. (Zhihai Xu via wangda)	2017-04-24 13:17:35 -07:00
Haibo Chen	8ac50e1322	YARN-6500. Do not mount inaccessible cgroups directories in CgroupsLCEResourcesHandler. (Miklos Szegedi via Haibo Chen)	2017-04-24 11:37:52 -07:00
Eric Payne	52adf71914	YARN-5617. AMs only intended to run one attempt can be run more than once? Contributed by Jason Lowe.	2017-04-24 12:03:28 -05:00
Daniel Templeton	46940d92e2	YARN-6302. Fail the node if Linux Container Executor is not configured properly ... (Contributed by Miklos Szegedi via Daniel Templeton)	2017-04-19 12:23:49 -07:00
Daniel Templeton	dd43b895c2	YARN-6202. Configuration item Dispatcher.DISPATCHER_EXIT_ON_ERROR_KEY is disregarded ... (Contributed by Yufei Gu via Daniel Templeton)	2017-04-19 11:44:55 -07:00
Daniel Templeton	41ac190dba	YARN-6438. Code can be improved in ContainersMonitorImpl.java ... (Contributed by Miklos Szegedi via Daniel Templeton)	2017-04-19 10:53:08 -07:00
Sunil G	9ff25408bc	YARN-6164. Expose Queue Configurations per Node Label through YARN client api. Contributed by Benson Qiu.	2017-04-19 20:39:09 +05:30
Chris Douglas	af8e9842d2	YARN-6451. Add RM monitor validating metrics invariants. Contributed by Carlo Curino	2017-04-18 10:29:44 -07:00
Junping Du	6ed9d36224	YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S.	2017-04-17 15:51:10 -07:00
Jason Lowe	4168805502	YARN-6480. Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart. Contributed by Eric Badger	2017-04-14 17:15:48 -05:00
Karthik Kambatla	8a1d7480f7	YARN-6433. Only accessible cgroup mount directories should be selected for a controller. (Miklos Szegedi via kasha)	2017-04-14 15:07:14 -07:00
Eric Payne	a41f8dd58e	YARN-5994. TestCapacityScheduler.testAMLimitUsage fails intermittently. Contributed by Eric Badger	2017-04-14 10:53:09 -05:00
Karthik Kambatla	c3375175d6	YARN-6432. FairScheduler: Reserve preempted resources for corresponding applications. (Miklos Szegedi via kasha)	2017-04-12 14:21:20 -07:00
Eric Payne	a16ab2be91	YARN-6450. TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest? Contributed by Jason Lowe.	2017-04-12 10:20:08 -05:00
Wangda Tan	4d4ad0ebb7	YARN-6439. Fix ReservationSystem creation of default ReservationQueue. (Carlo Curino via wangda)	2017-04-11 14:56:18 -07:00
Naganarasimha	7d873c465b	YARN-6463. Correct spelling mistake in FileSystemRMStateStore. Contributed by Yeliang Cang.	2017-04-11 22:42:08 +05:30
Jason Lowe	0e065f2ede	YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu	2017-04-11 08:44:18 -05:00
Konstantinos Karanasos	7999318af1	YARN-6344. Add parameter for rack locality delay in CapacityScheduler. (kkaranasos)	2017-04-10 15:34:44 -07:00
Daniel Templeton	e9ac61cc0e	YARN-6372. Add default value for NM disk validator (Contributed by Yufei Gu via Daniel Templeton)	2017-04-10 14:56:42 -07:00
Karthik Kambatla	2aa8967809	YARN-6298. Metric preemptCall is not used in new preemption. (Yufei Gu via kasha)	2017-04-07 17:31:59 -07:00
Robert Kanter	63f7322522	YARN-6368. Decommissioning an NM results in a -1 exit code (miklos.szegedi@cloudera.com via rkanter)	2017-04-07 14:28:07 -07:00
Ming Ma	0116c3c957	YARN-5797. Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches. (Chris Trezzo via mingma)	2017-04-06 16:54:43 -07:00
Jason Lowe	1b081ca27e	YARN-6288. Exceptions during aggregated log writes are mishandled. Contributed by Akira Ajisaka	2017-04-06 16:24:36 -05:00
Rohith Sharma K S	1a9439e299	YARN-6424. TimelineCollector is not stopped when an app finishes in RM. Contributed by Varun Saxena.	2017-04-06 10:15:22 +05:30
Daniel Templeton	a2c57bb70d	YARN-6381. FSAppAttempt has several variables that should be final ... (Contributed by Ameet Zaveri via Daniel Templeton)	2017-04-05 16:07:24 -07:00
Andrew Wang	539ef5aa2e	HFDS-11596. hadoop-hdfs-client jar is in the wrong directory in release tarball. Contributed by Yuanbo Liu.	2017-04-05 16:04:09 -07:00
Karthik Kambatla	b4c4f36594	YARN-6448. Continuous scheduling thread crashes while sorting nodes. (Yufei Gu via kasha)	2017-04-05 15:43:14 -07:00
Varun Saxena	7d963c477a	YARN-6437. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently (Jason Lowe via Varun Saxena)	2017-04-06 01:20:41 +05:30
Wangda Tan	87e2ef8c98	YARN-6406. Remove SchedulerRequestKeys when no more pending ResourceRequest. (Arun Suresh via wangda)	2017-04-05 11:28:30 -07:00
Jason Lowe	e8071aa249	YARN-6403. Invalid local resource request can raise NPE and make NM exit. Contributed by Tao Yang	2017-04-05 12:30:45 -05:00
Akira Ajisaka	34ab8e73d4	YARN-5007. Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster. Contributed by Andras Bokor.	2017-04-05 17:33:07 +09:00
Varun Saxena	19b89c4c7b	YARN-6420. RM startup failure due to wrong order in nodelabel editlog (Bibin A Chundatt via Varun Saxena)	2017-04-05 09:38:35 +05:30
Ming Ma	2d5c09b848	YARN-6004. Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines. (Chris Trezzo via mingma)	2017-04-04 17:56:21 -07:00
Karthik Kambatla	9cc04b4708	YARN-6436. TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low. (Eric Badger via kasha)	2017-04-04 17:08:33 -07:00
Wangda Tan	3fdae0a2b6	YARN-6109. Add an ability to convert ChildQueue to ParentQueue. (Xuan Gong via wangda)	2017-04-04 14:39:01 -07:00
Chris Douglas	6eba79232f	HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang	2017-04-03 20:13:14 -07:00
Varun Saxena	a4b5aa8493	YARN-6377. NMTimelinePublisher#serviceStop does not stop timeline clients (Haibo Chen via Varun Saxena)	2017-04-02 04:54:12 +05:30
Varun Saxena	b8838578ce	YARN-6414. ATSv2 HBase related tests fail due to guava version upgrade (Haibo Chen via Varun Saxena)	2017-04-02 04:37:34 +05:30
Eric Payne	318bfb01bc	YARN-6354. LeveldbRMStateStore can parse invalid keys when recovering reservations. Contributed by Jason Lowe	2017-03-31 12:30:35 -05:00
Jason Lowe	4d1fac5df2	YARN-6411. Clean up the overwrite of createDispatcher() in subclass of MockRM. Contributed by Yufei Gu	2017-03-31 10:05:34 -05:00
Varun Saxena	b58777a9c9	YARN-6376. Exceptions caused by synchronous putEntities requests can be swallowed (Haibo Chen via Varun Saxena)	2017-03-31 02:17:20 +05:30
Daniel Templeton	640ba1d23f	YARN-5685. RM configuration allows all failover methods to disabled when automatic failover is enabled	2017-03-29 12:38:11 -07:00
Akira Ajisaka	82fb9ce8df	YARN-6329. Remove unnecessary TODO comment from AppLogAggregatorImpl.java. Contributed by victor bertschinger.	2017-03-29 10:36:24 +09:00
Varun Saxena	063b513b1c	YARN-6357. Implement putEntitiesAsync API in TimelineCollector (Haibo Chen via Varun Saxena)	2017-03-29 03:48:03 +05:30
Varun Saxena	01aca54a22	YARN-5368. Memory leak in timeline server (Jonathan Eagles via Varun Saxena)	2017-03-29 01:53:20 +05:30
Jason Lowe	fdf8f8ebca	YARN-6359. TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition. Contributed by Robert Kanter	2017-03-28 09:33:26 -05:00
Robert Kanter	9bae6720cb	YARN-6050. AMs can't be scheduled on racks or nodes (rkanter)	2017-03-27 17:23:13 -07:00
Wangda Tan	cd014d57aa	YARN-6339. Improve performance for createAndGetApplicationReport. (Yunjiong Zhao via wangda)	2017-03-27 13:29:09 -07:00
Akira Ajisaka	b63ae854f9	YARN-6379. Remove unused argument in ClientRMService. Contributed by Kai Sasaki.	2017-03-27 11:23:41 +09:00
Sunil G	cffea251be	YARN-5956. Refactor ClientRMService for unify error handling across apis. Contributed by Kai Sasaki.	2017-03-25 22:26:19 +05:30
Tsuyoshi Ozawa	84ddedc0b2	HADOOP-10101. Update guava dependency to the latest version. (ozawa)	2017-03-25 10:06:52 +09:00
Ravi Prakash	d4f73e7e27	HDFS-11574. Spelling mistakes in the Java source. Contributed by Hu Xiaodong.	2017-03-24 09:38:17 -07:00
Varun Saxena	f462e1ff68	YARN-5934. Fix TestTimelineWebServices.testPrimaryFilterNumericString (Akira Ajisaka via Varun Saxena)	2017-03-22 04:11:53 +05:30
Daniel Templeton	0a05c5c598	YARN-6284. hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable ... (Contributed by Laura Adams via Daniel Templeton)	2017-03-21 14:15:40 -07:00
Varun Saxena	35034653d0	YARN-6353. Clean up OrderingPolicy javadoc (Daniel Templeton via Varun Saxena)	2017-03-20 23:29:09 +05:30
Jason Lowe	4a8e304502	YARN-6217. TestLocalCacheDirectoryManager test timeout is too aggressive. Contributed by Miklos Szegedi	2017-03-17 14:06:35 -05:00
Jason Lowe	7114baddb6	YARN-4051. ContainerKillEvent lost when container is still recovering and application finishes. Contributed by sandflee	2017-03-16 09:30:10 -05:00
Sunil G	2d0e24eb01	YARN-6328. Fix a spelling mistake in CapacityScheduler. Contributed by Jin Yibo. This closes #202	2017-03-15 14:48:05 +05:30
Ray Chiang	4c66a8d19b	YARN-6331. Fix flakiness in TestFairScheduler#testDumpState. (Yufei Gu via rchiang)	2017-03-14 15:09:47 -07:00
Naganarasimha	0a3aa40fe7	YARN-6327. Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator. Contributed by Jonathan Hung.	2017-03-15 01:22:25 +05:30
Junping Du	34424e98a6	YARN-6314. Potential infinite redirection on YARN log redirection web service. Contributed by Xuan Gong. ... (cherry picked from commit 5a9dda796f0e73060ada794ad5752cc6a237ab2e)	2017-03-14 02:58:07 -07:00
Ray Chiang	4db9cc70d0	YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang)	2017-03-10 16:13:31 -08:00
Varun Saxena	229c7c9f89	YARN-6069. CORS support in timeline v2 (Rohith Sharma K S via Varun Saxena)	2017-03-11 04:09:01 +05:30
Jason Lowe	9649c27864	YARN-6321. TestResources test timeouts are too aggressive. Contributed by Eric Badger	2017-03-10 13:06:54 -06:00
Karthik Kambatla	a96afae125	YARN-6264. AM not launched when a single vcore is available on the cluster. (Yufei Gu via kasha)	2017-03-09 23:11:54 -08:00
Daniel Templeton	846a0cd678	YARN-1047. Expose # of pre-emptions as a queue counter (Contributed by Karthik Kambatla via Daniel Templeton)	2017-03-09 17:51:47 -08:00
Sidharta S	e96a0b8c92	YARN-5669. Add support for docker pull command (Contribtued by luhuichun)	2017-03-09 16:22:19 -08:00
Daniel Templeton	822a74f2ae	YARN-6300. NULL_UPDATE_REQUESTS is redundant in TestFairScheduler (Contributed by Yuanbo Liu via Daniel Templeton)	2017-03-09 12:14:33 -08:00
Jason Lowe	d7762a5511	YARN-6165. Intra-queue preemption occurs even when preemption is turned off for a specific queue. Contributed by Eric Payne	2017-03-08 16:46:09 -06:00
Robert Kanter	287ba4ffa6	YARN-6297. TestAppLogAggregatorImp.verifyFilesUploaded() should check # of filed uploaded with that of files expected (haibochen via rkanter)	2017-03-08 10:45:33 -08:00
Sunil G	1eb8186703	YARN-6207. Move application across queues should handle delayed event processing. Contributed by Bibin A Chundatt.	2017-03-08 12:04:30 +05:30
Daniel Templeton	e0c239cdbd	YARN-6287. RMCriticalThreadUncaughtExceptionHandler.rmContext should be final (Contributed by Corey Barker via Daniel Templeton)	2017-03-07 11:58:48 -08:00
Sunil G	c1386a90d7	YARN-6248. user is not removed from UsersManager’s when app is killed with pending container requests. Contributed by Eric Payne.	2017-03-04 13:46:35 +05:30
Junping Du	8db7a8c3ae	YARN-6271. yarn rmadin -getGroups returns information from standby RM. Contributed by Jian He.	2017-03-03 14:39:31 -08:00
Ray Chiang	2148b83993	YARN-6218. Fix TestAMRMClient when using FairScheduler. (Miklos Szegedi via rchiang)	2017-03-03 13:04:51 -08:00
Jason Lowe	e58fc76030	YARN-6263. NMTokenSecretManagerInRM.createAndGetNMToken is not thread safe. Contributed by Haibo Chen	2017-03-03 08:23:08 -06:00
Robert Kanter	6f6dfe0202	YARN-5280. Allow YARN containers to run with Java Security Manager (gphillips via rkanter)	2017-03-01 14:53:47 -08:00
Jian He	235203dffd	YARN-6153. KeepContainer does not work when AM retry window is set. Contributed by kyungwan nam	2017-02-28 13:23:36 -08:00
Xuan	e0bb867c3f	YARN-6189: Improve application status log message when RM restarted when ... app is in NEW state. Contributed by Junping Du	2017-02-28 11:04:56 -08:00
Wangda Tan	eac6b4c35c	YARN-6216. Unify Container Resizing code paths with Container Updates making it scheduler agnostic. (Arun Suresh via wangda)	2017-02-28 10:35:50 -08:00
Yiqun Lin	0f35443bf2	YARN-6239. Fix javadoc warnings in YARN that caused by deprecated FileSystem APIs. Contributed by Yiqun Lin.	2017-02-28 18:51:56 +08:00
Karthik Kambatla	f187d63816	YARN-6231. FairSchedulerTestBase helper methods should call scheduler.update to avoid flakiness. (kasha)	2017-02-27 22:10:57 -08:00
Naganarasimha	5f5b031d1f	YARN-5703. ReservationAgents are not correctly configured. Contributed by Manikandan R.	2017-02-27 20:38:29 +05:30
Karthik Kambatla	fbfe86deea	YARN-6172. FSLeafQueue demand update needs to be atomic. (Miklos Szegedi via kasha)	2017-02-26 20:36:33 -08:00
Karthik Kambatla	815d53506f	YARN-6215. FairScheduler preemption and update should not run concurrently. (Tao Jie via kasha)	2017-02-26 20:16:36 -08:00
Xuan	53d372a255	YARN-6228: EntityGroupFSTimelineStore should allow configurable cache ... stores. Contributed by Li Lu	2017-02-24 10:59:35 -08:00
Karthik Kambatla	694e680d20	YARN-6222. TestFairScheduler.testReservationMetrics is flaky. (Yufei Gu via kasha)	2017-02-23 15:21:52 -08:00
Sunil G	a207aa9930	YARN-6211. Synchronization improvement for moveApplicationAcrossQueues and updateApplicationPriority. Contributed by Bibin A Chundatt.	2017-02-23 14:19:07 +05:30
Karthik Kambatla	b10e962224	YARN-6194. Cluster capacity in SchedulingPolicy is updated only on allocation file reload. (Yufei Gu via kasha)	2017-02-22 15:58:49 -08:00
Karthik Kambatla	718ad9f6ee	YARN-6210. FairScheduler: Node reservations can interfere with preemption. (kasha)	2017-02-22 15:46:07 -08:00
Wangda Tan	1a6ca75f38	YARN-6143. Fix incompatible issue caused by YARN-3583. (Sunil G via wangda)	2017-02-22 11:17:09 -08:00
Eric Yang	172b23af33	HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu.	2017-02-18 18:34:13 -08:00
Karthik Kambatla	dbbfcf74ab	YARN-6193. FairScheduler might not trigger preemption when using DRF. (kasha)	2017-02-17 14:07:31 -08:00
Daniel Templeton	c7a36e6130	YARN-6125. The application attempt's diagnostic message should have a maximum size ... (Contributed by Andras Piros via Daniel Templeton)	2017-02-17 13:40:58 -08:00
Daniel Templeton	9a92837786	YARN-6188. Fix OOM issue with decommissioningNodesWatcher in the case of clusters with ... large number of nodes (Contributed by Ajay Jadhav via Daniel Templeton)	2017-02-17 13:13:46 -08:00
Karthik Kambatla	a77f432449	YARN-6171. ConcurrentModificationException on FSAppAttempt.containersToPreempt. (Miklos Szegedi via kasha)	2017-02-16 14:54:58 -08:00
Sangjin Lee	4fa1afdb88	YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R.	2017-02-16 11:41:04 -08:00
Rohith Sharma K S	e63a7814d2	YARN-6200. addendum to fix compilation error caused by reverting YARN-5068.	2017-02-16 18:19:57 +05:30
Rohith Sharma K S	a393e84c6f	YARN-6200. Reverting since the same functionality achieved by YARN-1623. ... Revert "YARN-5068. Expose scheduler queue to application master. (Harish Jaiprakash via rohithsharmaks)" This reverts commit b7ac85259c.	2017-02-16 18:00:25 +05:30
Karthik Kambatla	74dd142250	YARN-5798. Set UncaughtExceptionHandler for all FairScheduler threads. (Yufei Gu via kasha)	2017-02-16 00:03:09 -08:00
Karthik Kambatla	11be3f70e0	YARN-4212. FairScheduler: Can't create a DRF queue under a FAIR policy queue. (Yufei Gu via kasha)	2017-02-15 23:51:22 -08:00
Karthik Kambatla	6c25dbcdc0	YARN-6163. FS Preemption is a trickle for severely starved applications. (kasha)	2017-02-15 23:16:12 -08:00
Junping Du	ce2d5bfa5f	YARN-6174. Log files pattern should be same for both running and finished container. Contributed by Xuan Gong.	2017-02-15 09:05:14 -08:00
Varun Saxena	b7613e0f40	YARN-6156. AM blacklisting to consider node label partition (Bibin A Chundatt via Varun Saxena)	2017-02-15 14:48:17 +05:30
Karthik Kambatla	353a9b2d91	YARN-6061. Addendum. Remove extraneous change.	2017-02-14 15:19:52 -08:00
Karthik Kambatla	652679aa8a	YARN-6061. Add an UncaughtExceptionHandler for critical threads in RM. (Yufei Gu via kasha)	2017-02-14 13:39:41 -08:00
Arun Suresh	aaf106fde3	YARN-5966. AMRMClient changes to support ExecutionType update. (asuresh)	2017-02-14 06:09:10 -08:00
Karthik Kambatla	646c6d6509	YARN-3933. FairScheduler: Multiple calls to completedContainer are not safe. (Shiwei Guo and Miklos Szegedi via kasha)	2017-02-13 11:26:30 -08:00
Junping Du	464ff479ce	YARN-6113. Re-direct NM Web Service to get container logs for finished applications. Contributed by Xuan Gong.	2017-02-13 06:12:54 -08:00
Varun Saxena	649deb72fb	YARN-6170. TimelineReaderServer should wait to join with HttpServer2 (Sangjin Lee via Varun Saxena)	2017-02-11 19:21:45 +05:30
Karthik Kambatla	08f93978f3	YARN-6144. FairScheduler: preempted resources can become negative. (Miklos Szegedi via kasha)	2017-02-09 14:45:04 -08:00
Karthik Kambatla	9b85053583	YARN-6112. UpdateCallDuration is calculated only when debug logging is enabled. (Yufei Gu via kasha)	2017-02-09 13:09:32 -08:00
Wangda Tan	5fb723bb77	YARN-5889. Improve and refactor user-limit calculation in Capacity Scheduler. (Sunil G via wangda)	2017-02-09 10:23:50 -08:00
Junping Du	9dbfab1284	YARN-6108. Improve AHS webservice to accept NM address as a parameter to get container logs. Contributed by Xuan Gong.	2017-02-07 02:13:14 -08:00
Junping Du	327c9980aa	YARN-6100. Improve YARN webservice to output aggregated container logs. Contributed by Xuan Gong.	2017-02-02 00:41:18 -08:00
Daniel Templeton	3e06475307	YARN-4658. Typo in o.a.h.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler comment (Contributed by Udai Potluri via Daniel Templeton)	2017-01-31 16:25:33 -08:00
Daniel Templeton	87852b6ef4	YARN-6103. Log updates for ZKRMStateStore (Contributed by Daniel Sturman via Daniel Templeton)	2017-01-30 21:44:48 -08:00
Karthik Kambatla	11e44bdda7	YARN-6131. FairScheduler: Lower update interval for faster tests. (kasha)	2017-01-30 13:35:23 -08:00
Sunil G	165f07f51a	YARN-6123. [YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed. Contributed by Wangda Tan.	2017-01-27 18:37:51 +05:30
Daniel Templeton	f85b74ccf9	YARN-4975. Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues ... (Contributed by Yufei Gu via Daniel Templeton)	2017-01-26 10:31:09 -08:00
Jason Lowe	9e19f758c1	YARN-5641. Localizer leaves behind tarballs after container is complete. Contributed by Eric Badger	2017-01-25 21:41:43 +00:00
Karthik Kambatla	abedb8a9d8	YARN-5830. FairScheduler: Avoid preempting AM containers. (Yufei Gu via kasha)	2017-01-25 12:17:28 -08:00
Junping Du	8528d85a68	YARN-6099. Improve webservice to list aggregated log files. Contributed by Xuan Gong.	2017-01-24 15:26:53 -08:00
Jason Lowe	a33ce45e35	YARN-5547. NMLeveldbStateStore should be more tolerant of unknown keys. Contributed by Ajith S	2017-01-24 16:17:36 +00:00
Rohith Sharma K S	0101267d9d	YARN-6082. Invalid REST api response for getApps since queueUsagePercentage is coming as INF. Contributed by Sunil G.	2017-01-24 10:59:55 +05:30
Wangda Tan	ce832059db	YARN-5864. Capacity Scheduler - Queue Priorities. (wangda)	2017-01-23 10:52:14 -08:00
Jason Lowe	69fa81679f	YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He	2017-01-23 17:12:51 +00:00
Sunil G	3fa0d540df	YARN-6031. Application recovery has failed when node label feature is turned off during RM recovery. Contributed by Ying Zhang.	2017-01-23 12:19:35 +05:30
Sangjin Lee	b01514f65b	YARN-5928. Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers. Contributed by Haibo Chen.	2017-01-19 20:52:55 -08:00
Andrew Wang	5d8b80ea9b	Preparing for 3.0.0-alpha3 development	2017-01-19 15:50:07 -08:00
Wangda Tan	72054a817d	YARN-5556. CapacityScheduler: Support deleting queues without requiring a RM restart. (Naganarasimha G R via wangda)	2017-01-18 13:31:33 -08:00
Karthik Kambatla	e224c96234	YARN-5831. FairScheduler: Propagate allowPreemptionFrom flag all the way down to the app. (Yufei Gu via kasha)	2017-01-17 17:01:31 -08:00
Subru Krishnan	4d1f3d9020	YARN-6016. Fix minor bugs in handling of local AMRMToken in AMRMProxy. (Botong Huang via Subru).	2017-01-17 14:48:03 -08:00
Daniel Templeton	695f110f93	YARN-6071. Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only) ... (Contributed by Wangda Tan via Daniel Templeton)	2017-01-17 12:55:47 -08:00
Junping Du	cf695577aa	YARN-6011. Add a new web service to list the files on a container in AHSWebService. Contributed by Xuan Gong.	2017-01-16 16:20:24 -08:00
Sunil G	d3170f9eba	YARN-6081. LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container. Contributed by Wangda Tan.	2017-01-13 18:22:29 +05:30
Naganarasimha	a6b06f7179	YARN-6072. RM unable to start in secure mode. Contributed by Ajith S.	2017-01-12 06:40:41 +05:30
Daniel Templeton	e6f13fe5d1	YARN-5849. Automatically create YARN control group for pre-mounted cgroups (Contributed by Miklos Szegedi via Daniel Templeton)	2017-01-11 16:00:01 -08:00
Daniel Templeton	7979939428	YARN-5554. MoveApplicationAcrossQueues does not check user permission on the target queue ... (Contributed by Wilfred Spiegelenburg via Daniel Templeton)	2017-01-11 14:34:10 -08:00
Jason Lowe	357eab9566	YARN-5416. TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped. Contributed by Junping Du	2017-01-11 17:13:37 +00:00
Junping Du	4db119b7b5	YARN-6079. Fix simple spelling errors in yarn test code. Contributed by vijay.	2017-01-10 18:20:27 -08:00
Naganarasimha	4c431a6940	YARN-6054. TimelineServer fails to start when some LevelDb state files are missing. Contributed by Ravi Prakash.	2017-01-10 15:54:16 +05:30
Sunil G	9594c35dcb	YARN-5899. Debug log in AbstractCSQueue#canAssignToThisQueue needs improvement. Contributed by Ying Zhang.	2017-01-10 14:08:01 +05:30
Junping Du	945db55f2e	YARN-4148. When killing app, RM releases app's resource before they are released by NM. Contributed by Jason Lowe.	2017-01-09 18:14:46 -08:00
Wangda Tan	287d3d6804	YARN-3955. Support for application priority ACLs in queues of CapacityScheduler. (Sunil G via wangda)	2017-01-09 08:40:39 -08:00
Varun Saxena	f59e36b4ce	YARN-6068. Log aggregation get failed when NM restart even with recovery (Junping Du via Varun Saxena)	2017-01-09 11:17:19 +05:30
Daniel Templeton	ac16400e1f	YARN-6022. Revert changes of AbstractResourceRequest (Contributed by Wangda Tan via Daniel Templeton)	2017-01-07 08:24:30 -08:00
Naganarasimha	a59df15757	YARN-6015. AsyncDispatcher thread name can be set to improved debugging. Contributed by Ajith S.	2017-01-07 08:11:58 +05:30
Jian He	020316458d	YARN-6009. Skip validating app timeout value on recovery. Contributed by Rohith Sharma K S	2017-01-06 18:19:09 -08:00
Arun Suresh	2977bc6a14	YARN-6040. Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes. (Wangda Tan via asuresh)	2017-01-06 09:59:57 -08:00
Wangda Tan	0a55bd841e	YARN-5959. RM changes to support change of container ExecutionType. (Arun Suresh via wangda)	2017-01-05 10:31:05 -08:00
Rohith Sharma K S	e49e0a6e37	YARN-5988. RM unable to start in secure setup. Contributed by Ajith S.	2017-01-04 12:09:29 +05:30
Junping Du	8fadd69047	YARN-5923. Unable to access logs for a running application if YARN_ACL_ENABLE is enabled. Contributed by Xuan Gong.	2017-01-03 15:03:38 -08:00
Wangda Tan	f69a107aec	YARN-6025. Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda) ... (cherry picked from commit e0f2379312)	2017-01-03 14:53:36 -08:00
Wangda Tan	ab1faa4ba8	Revert "Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)" to add correct JIRA number ... This reverts commit e0f2379312.	2017-01-03 14:53:13 -08:00
Wangda Tan	e0f2379312	Fix synchronization issues of AbstractYarnScheduler#nodeUpdate and its implementations. (Naganarasimha G R via wangda)	2017-01-03 14:46:41 -08:00
Daniel Templeton	165d01a73e	YARN-5931. Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)	2016-12-30 08:41:52 -08:00
Robert Kanter	f216276d21	YARN-4882. Change the log level to DEBUG for recovering completed applications (templedf via rkanter)	2016-12-28 15:21:52 -08:00
Sunil G	9ca54f4810	YARN-5906. Update AppSchedulingInfo to use SchedulingPlacementSet. Contributed by Wangda Tan.	2016-12-28 22:48:19 +05:30
Varun Vasudev	972da46cb4	YARN-5719. Enforce a C standard for native container-executor. Contributed by Chris Douglas.	2016-12-28 14:59:57 +05:30
Sunil G	f6715b26b6	YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan.	2016-12-28 12:33:02 +05:30
Wangda Tan	0840b4329b	YARN-5756. Add state-machine implementation for scheduler queues. (Xuan Gong via wangda)	2016-12-27 21:18:33 -08:00
Robert Kanter	9262797e86	YARN-5257. Fix unreleased resources and null dereferences (yufeigu via rkanter)	2016-12-27 14:14:08 -08:00
Robert Kanter	1bbd023275	YARN-5962. Spelling errors in logging and exceptions for resource manager code (gsohn via rkanter)	2016-12-27 13:35:34 -08:00
Daniel Templeton	e216e8e233	HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton)	2016-12-27 13:03:16 -08:00
Arun Suresh	ac1e5d4f77	YARN-5938. Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes (asuresh)	2016-12-27 12:40:44 -08:00
Karthik Kambatla	c3973e7080	YARN-5969. FairShareComparator: Cache value of getResourceUsage for better performance. (zhangshilong via kasha)	2016-12-27 12:30:35 -08:00
Karthik Kambatla	4d3f73acc0	YARN-6000. Make AllocationFileLoaderService.Listener public. (Tao Jie via kasha)	2016-12-23 11:40:56 -08:00
Akira Ajisaka	ae401539ea	YARN-4994. Use MiniYARNCluster with try-with-resources in tests. Contributed by Andras Bokor.	2016-12-22 14:32:24 +09:00
Junping Du	736f54b727	YARN-4990. Re-direction of a particular log file within in a container in NM UI does not redirect properly. Contributed by Xuan Gong.	2016-12-21 14:14:42 -08:00
Sangjin Lee	8b042bc1e6	YARN-5976. Update hbase version to 1.2. Contributed by Vrushali C.	2016-12-21 09:43:17 -08:00
Sunil G	575773a357	YARN-5877. Allow all env's from yarn.nodemanager.env-whitelist to get overridden during launch. Contributed by Bibin A Chundatt.	2016-12-20 11:39:06 +05:30
Sunil G	ef2dd7b78c	YARN-5650. Render Application Timeout value in web UI. Contributed by Akhil PB.	2016-12-19 11:44:03 +05:30
Arun Suresh	2273a74c1f	YARN-5646. Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers. (Konstantinos Karanasos via asuresh)	2016-12-16 08:14:34 -08:00
Jian He	ada876cd1d	Revert YARN-4126. RM should not issue delegation tokens in unsecure mode.	2016-12-13 20:49:54 -08:00
Robert Kanter	4b149a1e77	YARN-4457. Cleanup unchecked types for EventHandler (templedf via rkanter)	2016-12-09 17:28:25 -08:00
Jian He	a6410a542e	YARN-5709. Cleanup leader election configs and pluggability. Contribtued by Karthik Kambatla	2016-12-09 17:00:37 -08:00
Arun Suresh	b0aace21b1	YARN-5982. Simplify opportunistic container parameters and metrics. (Konstantinos Karanasos via asuresh)	2016-12-09 16:41:25 -08:00
Sangjin Lee	55f5886ea2	YARN-5925. Extract hbase-backend-exclusive utility methods from TimelineStorageUtil. Contributed by Haibo Chen.	2016-12-09 16:17:24 -08:00
Sangjin Lee	a5a55a54ab	YARN-5922. Remove direct references of HBaseTimelineWriter/Reader in core ATS classes. Contributed by Haibo Chen.	2016-12-08 12:31:12 -08:00
Sunil G	74d0066d33	YARN-5970. Validate application update timeout request parameters. Contributed by Rohith Sharma K S.	2016-12-08 15:53:56 +05:30
Robert Kanter	72fe546841	YARN-5963. Spelling errors in logging and exceptions for node manager, client, web-proxy, common, and app history code (gsohn via rkanter)	2016-12-07 15:07:25 -08:00
Daniel Templeton	9f5d2c4fff	YARN-5136. Error in handling event type APP_ATTEMPT_REMOVED to the scheduler ... (Contributed by Wilfred Spiegelenburg via Daniel Templeton)	2016-12-07 11:12:14 -08:00
Sunil	ab923a53fc	YARN-5965. Retrospect ApplicationReport#getApplicationTimeouts. Contributed by Rohith Sharma K S	2016-12-08 00:27:25 +05:30
Rohith Sharma K S	563480dccd	YARN-5932. Retrospect moveApplicationToQueue in align with YARN-5611. Contributed by Sunil G.	2016-12-07 10:39:14 +05:30
Naganarasimha	f3b8ff54ab	YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena	2016-12-06 06:53:38 +05:30
Jian He	43ebff2e35	YARN-5559. Analyse 2.8.0/3.0.0 jdiff reports and fix any issues. Contributed by Akira Ajisaka & Wangda Tan	2016-12-05 11:39:34 -08:00
Jian He	f885160f4a	YARN-5746. The state of the parentQueue and its childQueues should be synchronized. Contributed by Xuan Gong	2016-12-02 16:17:31 -08:00
Daniel Templeton	5bd18c49bd	YARN-5929. Missing scheduling policy in the FS queue metric. (Contributed by Yufei Gu via Daniel Templeton)	2016-12-02 13:55:42 -08:00
Li Lu	69fb70c31a	YARN-5761. Separate QueueManager from Scheduler. (Xuan Gong via gtcarrera9)	2016-11-30 13:38:42 -08:00
Daniel Templeton	b3befc021b	YARN-4997. Update fair scheduler to use pluggable auth provider (Contributed by Tao Jie via Daniel Templeton)	2016-11-30 09:50:33 -08:00
Kai Zheng	cfd8076f81	Revert due to an error "HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen" ... This reverts commit 5614f847b2ef2a5b70bd9a06edc4eba06174c6.	2016-11-30 15:44:52 +08:00
Daniel Templeton	dd9a96cb17	YARN-5851. TestContainerManagerSecurity testContainerManager[1] failed (Contributed by Haibo Chen via Daniel Templeton)	2016-11-29 14:22:19 -08:00
Daniel Templeton	3b9d3acd20	YARN-5890. FairScheduler should log information about AM-resource-usage and max-AM-share for queues ... (Contributed by Yufei Gu via Daniel Templeton)	2016-11-29 12:46:05 -08:00
Daniel Templeton	25f9872be6	YARN-5774. MR Job stuck in ACCEPTED status without any progress in Fair Scheduler ... if set yarn.scheduler.minimum-allocation-mb to 0. (Contributed by Yufei Gu via Daniel Templeton)	2016-11-29 09:40:49 -08:00
Daniel Templeton	62b42ef5dd	YARN-5725. Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange ... when setting IP and host (Contributed by Miklos Szegedi via Daniel Templeton)	2016-11-28 15:19:52 -08:00
Kai Zheng	5d5614f847	HDFS-10994. Support an XOR policy XOR-2-1-64k in HDFS. Contributed by Sammi Chen	2016-11-28 14:34:44 +08:00
Akira Ajisaka	209e805430	HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.	2016-11-28 14:34:57 +09:00
Naganarasimha	c06114d6a3	YARN-5572. HBaseTimelineWriterImpl appears to reference a bad property name. Contributed by Varun Saxena.	2016-11-27 23:35:53 +05:30
Naganarasimha	e2f77ca77b	Revert "YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena." ... This reverts commit 9f2960be19.	2016-11-27 23:32:59 +05:30
Naganarasimha	9f2960be19	YARN-5921. Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState. Contributed by Varun Saxena.	2016-11-27 23:31:27 +05:30
Sunil	eb0a483ed0	YARN-4206. Add Application timeouts in Application report and CLI. Contributed by Rohith Sharma K S.	2016-11-24 18:18:42 +05:30
Rohith Sharma K S	e15c20edba	YARN-5920. Fix deadlock in TestRMHA.testTransitionedToStandbyShouldNotHang. Contributed by Varun Saxena.	2016-11-24 12:18:38 +05:30
Daniel Templeton	10468529a9	YARN-4752. Improved preemption in FairScheduler. (kasha) ... Contains: YARN-5605. Preempt containers (all on one node) to meet the requirement of starved applications YARN-5821. Drop left-over preemption-related code and clean up method visibilities in the Schedulable hierarchy YARN-5783. Verify identification of starved applications. YARN-5819. Verify fairshare and minshare preemption YARN-5885. Cleanup YARN-4752 branch for merge Change-Id: Iee0962377d019dd64dc69a020725d2eaf360858c	2016-11-23 19:48:59 -10:00
Jian He	1f12867a69	YARN-5649. Add REST endpoints for updating application timeouts. Contributed by Rohith Sharma K S	2016-11-23 16:25:39 -08:00
Arun Suresh	005850b28f	YARN-5918. Handle Opportunistic scheduling allocate request failure when NM is lost. (Bibin A Chundatt via asuresh)	2016-11-23 09:53:31 -08:00
Naganarasimha	3541ed8068	YARN-4330. MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages. Contributed by Varun Saxena	2016-11-23 14:12:23 +05:30
Daniel Templeton	83cc7263af	YARN-5722. FairScheduler hides group resolution exceptions when assigning queue (Contributed by Wilfred Spiegelenburg via Daniel Templeton)	2016-11-22 11:16:00 -08:00
Rohith Sharma K S	a926f895c1	YARN-5865. Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611. Contributed by Sunil G.	2016-11-22 14:49:15 +05:30
Akira Ajisaka	6f8074298d	YARN-5713. Update jackson from 1.9.13 to 2.x in hadoop-yarn.	2016-11-22 10:20:31 +09:00
Jason Lowe	009452bb6d	YARN-5859. TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails. Contributed by Eric Badger	2016-11-21 16:36:08 +00:00
Junping Du	f05a9ceb4a	YARN-3538. TimelineWebService doesn't catch runtime exception. Contributed by Steve Loughran and Tsuyoshi Ozawa.	2016-11-17 16:55:39 -08:00
Jason Lowe	59bfcbf357	YARN-5836. Malicious AM can kill containers of other apps running in any node its containers are running. Contributed by Botong Huang	2016-11-16 22:21:03 +00:00
Rohith Sharma K S	d65603517e	YARN-5375. invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures. Contributed by sandflee.	2016-11-16 15:14:00 +05:30
Xiao Chen	f121d0b036	YARN-5875. TestTokenClientRMService#testTokenRenewalWrongUser fails. Contributed by Gergely Novák.	2016-11-15 13:58:11 -08:00
Daniel Templeton	264ddb13ff	YARN-5736 Addendum. Fixes segfault due to unterminated string. (Contributed by Miklos Szegedi via Daniel Templeton)	2016-11-15 13:01:57 -08:00
Mingliang Liu	5af572b644	HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu	2016-11-15 10:57:00 -08:00
Arun Suresh	3219b7b4ac	YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle. (asuresh)	2016-11-15 07:56:25 -08:00
Naganarasimha	7ffb9943b8	YARN-4355. NPE while processing localizer heartbeat. Contributed by Varun Saxena & Jonathan Hung.	2016-11-15 15:41:56 +05:30
Naganarasimha	43aef303bf	Reverted due to issue YARN-5765. Revert "YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang" ... This reverts commit 131d58a24e. server-nodemanager/src/main/native/container-executor/test/test- container-executor.c	2016-11-15 13:27:37 +05:30
Rohith Sharma K S	b7070f3308	YARN-5874. RM -format-state-store and -remove-application-from-state-store commands fail with NPE. Contributed by Varun Saxena.	2016-11-15 10:58:25 +05:30
Rohith Sharma K S	296c5de0cf	YARN-5873. RM crashes with NPE if generic application history is enabled. Contributed by Varun Saxena.	2016-11-15 10:56:28 +05:30
Karthik Kambatla	79448d4ab1	YARN-4033. In FairScheduler, parent queues should also display queue status. (Siqi Li via kasha)	2016-11-13 21:38:36 -08:00
Jian He	fad9609d13	YARN-5825. ProportionalPreemptionalPolicy should use readLock over LeafQueue instead of synchronized block. Contributed by Sunil G	2016-11-11 15:16:21 -08:00
Wangda Tan	ede1a473f5	YARN-5552. Add Builder methods for common yarn API records. (Tao Jie via wangda)	2016-11-11 13:34:56 -08:00
Naganarasimha	503e73e849	YARN-5545. Fix issues related to Max App in capacity scheduler. Contributed by Bibin A Chundatt	2016-11-11 20:48:31 +05:30
Eric Payne	93eeb13164	YARN-4218. Metric for resource*time that was preempted. Contributed by Chang Li.	2016-11-10 22:35:12 +00:00
Karthik Kambatla	3a98419532	YARN-5834. TestNodeStatusUpdater.testNMRMConnectionConf compares nodemanager wait time to the incorrect value. (Chang Li via kasha)	2016-11-10 14:08:51 -08:00
Karthik Kambatla	86ac1ad9fd	YARN-5453. FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource. (sandflee via kasha)	2016-11-09 23:44:02 -08:00
Varun Saxena	c202a10923	YARN-5862. TestDiskFailures.testLocalDirsFailures failed (Yufei Gu via Varun Saxena)	2016-11-10 11:41:34 +05:30
Naganarasimha	de3a5f8d08	YARN-5856. Unnecessary duplicate start container request sent to NM State store. Contributed by Varun Saxena.	2016-11-10 05:42:30 +05:30
Jian He	bcc15c6290	YARN-5611. Provide an API to update lifetime of an application. Contributed by Rohith Sharma K S	2016-11-09 16:08:05 -08:00
Naganarasimha	edbee9e609	YARN-4498. Application level node labels stats to be available in REST (addendum patch). Contributed by Bibin A Chundatt.	2016-11-10 05:00:05 +05:30
Daniel Templeton	59ee8b7a88	YARN-4329. [YARN-5437] Allow fetching exact reason as to why a submitted app ... is in ACCEPTED state in Fair Scheduler (Contributed by Yufei Gu)	2016-11-09 13:11:37 -08:00
Robert Kanter	09f43fa9c0	YARN-5736. YARN container executor config does not handle white space (miklos.szegedi@cloudera.com via rkanter)	2016-11-09 13:34:40 +01:00
Arun Suresh	283fa33feb	YARN-5823. Update NMTokens in case of requests with only opportunistic containers. (Konstantinos Karanasos via asuresh)	2016-11-09 00:11:25 -08:00
Andrew Wang	e1c6ef2efa	HADOOP-13789. Hadoop Common includes generated test protos in both jar and test-jar. Contributed by Sean Busbey.	2016-11-08 16:33:55 -08:00
Jason Lowe	3f93ac0733	YARN-5356. NodeManager should communicate physical resource capability to ResourceManager. Contributed by Inigo Goiri	2016-11-08 22:01:26 +00:00
Arun Suresh	f38a6d03a1	YARN-5377. Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers. (Konstantinos Karanasos via asuresh)	2016-11-07 22:10:03 -08:00
Jian He	de3b4aac56	YARN-5716. Add global scheduler interface definition and update CapacityScheduler to use it. Contributed by Wangda Tan	2016-11-07 10:14:39 -08:00
Wangda Tan	c00b5d1e51	YARN-5804. New UI2 is not able to launch with jetty 9 upgrade post HADOOP-10075. (Sunil G via wangda) ... (cherry picked from commit ddebaa6b7ae1031899139d153d57df5387d60542)	2016-11-06 13:13:31 -08:00
Wangda Tan	3de0da2a76	YARN-5698. [YARN-3368] Launch new YARN UI under hadoop web app port. (Sunil G via wangda)	2016-11-06 13:13:31 -08:00
Wangda Tan	817d5f4c96	YARN-4849. Addendum patch to fix javadocs. (Sunil G via wangda)	2016-11-06 13:13:31 -08:00
Wangda Tan	c85cc3b56e	YARN-4515. [YARN-3368] Support hosting web UI framework inside YARN RM. (Sunil G via wangda) ... YARN-5000. [YARN-3368] App attempt page is not loading when timeline server is not started (Sunil G via wangda) YARN-5038. [YARN-3368] Application and Container pages shows wrong values when RM is stopped. (Sunil G via wangda)	2016-11-06 13:13:31 -08:00
Jason Lowe	6bb741ff0e	YARN-5837. NPE when getting node status of a decommissioned node after an RM restart. Contributed by Robert Kanter	2016-11-04 22:20:21 +00:00
Arun Suresh	0aafc122d4	YARN-2995. Enhance UI to show cluster resource utilization of various container Execution types. (Konstantinos Karanasos via asuresh)	2016-11-04 07:31:54 -07:00
Sunil	19b3779ae7	YARN-5802. updateApplicationPriority api in scheduler should ensure to re-insert app to correct ordering policy. Contributred by Bibin A Chundatt	2016-11-04 16:07:28 +05:30
Varun Vasudev	9ee0e3172e	YARN-5822. Log ContainerRuntime initialization error in LinuxContainerExecutor. Contributed by Sidharta Seethana.	2016-11-03 22:33:43 +05:30
Jason Lowe	352cbaa7a5	YARN-4862. Handle duplicate completed containers in RMNodeImpl. Contributed by Rohith Sharma K S	2016-11-03 13:54:31 +00:00
Varun Saxena	377919010b	YARN-5815. Random failure of TestApplicationPriority.testOrderOfActivatingThePriorityApplicationOnRMRestart (Bibin A Chundatt via Varun Saxena)	2016-11-03 00:37:09 +05:30
Jason Lowe	76893a4100	YARN-5001. Aggregated Logs root directory is created with wrong group if nonexistent. Contributed by Haibo Chen	2016-11-01 20:23:24 +00:00
Rohith Sharma K S	9d0c2ad5a5	YARN-3732. Change NodeHeartbeatResponse.java and RegisterNodeManagerResponse.java as abstract classes. Contributed by Devaraj K.	2016-11-01 16:25:45 +05:30
Varun Saxena	7d2d8d25ba	YARN-5788. Apps not activiated and AM limit resource in UI and REST not updated after -replaceLabelsOnNode (Bibin A Chundatt via Varun Saxena)	2016-11-01 15:32:04 +05:30
Varun Saxena	310aa4686e	YARN-5805. Add isDebugEnabled check for debug logs in nodemanager (Bibin A Chundatt via Varun Saxena)	2016-11-01 14:51:31 +05:30
Karthik Kambatla	733aa99313	YARN-4998. Minor cleanup to UGI use in AdminService. (Daniel Templeton via kasha)	2016-10-31 16:26:01 -07:00
Wangda Tan	90dd3a8148	YARN-2009. CapacityScheduler: Add intra-queue preemption for app priority support. (Sunil G via wangda)	2016-10-31 15:18:31 -07:00
Daniel Templeton	f3eb4c3c73	YARN-5793. Trim configuration values in DockerLinuxContainerRuntime (Contributed by Tianyin Xu via Daniel Templeton)	2016-10-31 13:51:07 -07:00
Daniel Templeton	2528bea67f	YARN-4396. Log the trace information on FSAppAttempt#assignContainer (Contributed by Yiqun Li via Daniel Templeton)	2016-10-31 13:34:25 -07:00
Daniel Templeton	cc2c993a8a	YARN-4907. Make all MockRM#waitForState consistent. (Contributed by Yufei Gu via Daniel Templeton)	2016-10-31 13:20:56 -07:00
Naganarasimha	e0bebbbcdd	YARN-4498. Application level node labels stats to be available in REST. Contributed by Bibin A Chundatt	2016-10-31 04:38:20 +05:30
Arun Suresh	aa3cab1eb2	YARN-5799. Fix Opportunistic Allocation to set the correct value of Node Http Address. (asuresh)	2016-10-29 02:03:57 -07:00
Varun Saxena	1c8ab41e8b	YARN-5773. RM recovery too slow due to LeafQueue#activateApplications (Bibin A Chundatt via Varun Saxena)	2016-10-29 13:47:39 +05:30
Jason Lowe	1eae719bce	YARN-4963. capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable. Contributed by Nathan Roberts	2016-10-28 17:30:15 +00:00
Jason Lowe	1b79c417dc	YARN-5767. Fix the order that resources are cleaned up from the local Public/Private caches. Contributed by Chris Trezzo	2016-10-28 15:58:04 +00:00
Jason Lowe	7146359bfd	YARN-5027. NM should clean up app log dirs after NM restart. Contributed by sandflee	2016-10-28 15:48:58 +00:00
Jason Lowe	c017171da0	HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang	2016-10-28 14:57:50 +00:00
Karthik Kambatla	4df8ed63ed	YARN-4743. FairSharePolicy breaks TimSort assumption. (Zephyr Guo and Yufei Gu via kasha)	2016-10-27 17:45:48 -07:00
Subru Krishnan	b2c4f24c31	YARN-2306. Add test for leakage of reservation metrics in fair scheduler. (Hong Zhiguo and Yufei Gu via subru).	2016-10-27 17:43:13 -07:00
Robert Kanter	5877f20f9c	HADOOP-10075. Update jetty dependency to version 9 (rkanter)	2016-10-27 16:09:00 -07:00
Vrushali Channapattan	022bf783aa	YARN-4765 Split TestHBaseTimelineStorage into multiple test classes (Varun Saxena via Vrushali C) ... (cherry picked from commit 513dcf6817dd76fde8096ff04cd888d7c908461d)	2016-10-27 15:37:36 -07:00
Carlo Curino	892a8348fc	YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino)	2016-10-27 15:15:49 -07:00
Subru Krishnan	79ae78dcbe	YARN-3568. TestAMRMTokens should use some random port. (Takashi Ohnishi via Subru).	2016-10-27 15:11:12 -07:00
Daniel Templeton	b98fc8249f	YARN-4710. Reduce logging application reserved debug info in FSAppAttempt#assignContainer (Contributed by Yiqun Lin via Daniel Templeton)	2016-10-27 14:42:19 -07:00
Robert Kanter	9449519a25	YARN-5776. Checkstyle: MonitoringThread.Run method length is too long (miklos.szegedi@cloudera.com via rkanter)	2016-10-27 14:36:38 -07:00
Jason Lowe	7e3c327d31	YARN-4831. Recovered containers will be killed after NM stateful restart. Contributed by Siqi Li	2016-10-27 20:42:52 +00:00
Robert Kanter	6fbfb501f2	YARN-4456. Clean up Lint warnings in nodemanager (templedf via rkanter)	2016-10-27 12:37:01 -07:00
Varun Saxena	79aeddc88f	YARN-5308. FairScheduler: Move continuous scheduling related tests to TestContinuousScheduling (Kai Sasaki via Varun Saxena)	2016-10-28 00:34:50 +05:30
Naganarasimha	b3c15e4ef7	YARN-5420. Delete org.apache.hadoop.yarn.server.resourcemanager.resource.Priority as its not necessary. Contributed by Sunil G.	2016-10-27 18:22:07 +05:30
Naganarasimha	6c8830992c	YARN-3848. TestNodeLabelContainerAllocation is timing out. Contributed by Varun Saxena	2016-10-27 17:10:02 +05:30
Varun Saxena	7b4e9ec3b0	YARN-5686. DefaultContainerExecutor random working dir algorigthm skews results (Vrushali C via Varun Saxena)	2016-10-27 14:02:29 +05:30
Varun Saxena	5c39a419a6	YARN-5752. TestLocalResourcesTrackerImpl#testLocalResourceCache times out (Eric Badger via Varun Saxena)	2016-10-27 13:41:49 +05:30
Rohith Sharma K S	e29cba61a0	YARN-4363. In TestFairScheduler, testcase should not create FairScheduler redundantly. Conntributed by Tao Jie.	2016-10-27 11:57:17 +05:30
Rohith Sharma K S	b110c4b5e8	YARN-4555. TestDefaultContainerExecutor#testContainerLaunchError fails on non-english locale environment. Contributed by Takashi Ohnishi.	2016-10-27 11:34:07 +05:30
Sangjin Lee	f511cc89b6	YARN-5433. Audit dependencies for Category-X. Contributed by Sangjin Lee.	2016-10-26 11:31:00 -07:00
Akira Ajisaka	d3bb69a667	YARN-5575. Many classes use bare yarn. properties instead of the defined constants. Contributed by Daniel Templeton.	2016-10-26 15:32:07 +09:00
Karthik Kambatla	de6faae97c	YARN-5388. Deprecate and remove DockerContainerExecutor. (Daniel Templeton via kasha)	2016-10-25 13:35:47 -07:00
Karthik Kambatla	a71fc81655	YARN-5754. Null check missing for earliest in FifoPolicy. (Yufei Gu via kasha)	2016-10-24 22:19:23 -07:00
Varun Saxena	44eb2bd7ae	YARN-5747. Application timeline metric aggregation in timeline v2 will lose last round aggregation when an application finishes (Li Lu via Varun Saxena)	2016-10-22 01:14:49 +05:30
Karthik Kambatla	754cb4e30f	YARN-5047. Refactor nodeUpdate across schedulers. (Ray Chiang via kasha)	2016-10-20 21:17:48 -07:00
Karthik Kambatla	a064865abf	YARN-4911. Bad placement policy in FairScheduler causes the RM to crash	2016-10-20 20:57:04 -07:00
Sangjin Lee	e9c4616b5e	YARN-5561. [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST. Contributed by Rohith Sharma K S.	2016-10-19 09:45:23 -07:00
Xuan	b733a6f862	YARN-5718. TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior. Contributed by Junping Du.	2016-10-18 11:06:47 -07:00
Varun Saxena	b154d3edce	YARN-5743. [Atsv2] Publish queue name and RMAppMetrics to ATS (Rohith Sharma K S via Varun Saxena)	2016-10-18 23:32:52 +05:30
Robert Kanter	f5d9235914	YARN-5466. DefaultContainerExecutor needs JavaDocs (templedf via rkanter)	2016-10-17 14:29:09 -07:00
Sangjin Lee	1f304b0c7f	YARN-5699. Retrospect yarn entity fields which are publishing in events info fields. Contributed by Rohith Sharma K S.	2016-10-15 13:54:40 -07:00
Chris Douglas	cf3f43e95b	YARN-5717. Add tests for container-executor is_feature_enabled. Contributed by Sidharta Seethana	2016-10-13 20:49:07 -07:00
Karthik Kambatla	6476934ae5	YARN-5677. RM should transition to standby when connection is lost for an extended period. (Daniel Templeton via kasha)	2016-10-11 22:07:10 -07:00
Karthik Kambatla	6378845f9e	YARN-4464. Lower the default max applications stored in the RM and store. (Daniel Templeton via kasha)	2016-10-11 21:42:08 -07:00
Naganarasimha	0773ffd0f8	YARN-5057. Resourcemanager.security.TestDelegationTokenRenewer fails in trunk. Contributed by Jason Lowe.	2016-10-10 18:04:47 -04:00
Rohith Sharma K S	4d2f380d78	YARN-5101. YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order. Contributed by Sunil G.	2016-10-06 20:42:36 +05:30
Akira Ajisaka	272a21747e	MAPREDUCE-6789. Fix TestAMWebApp failure. Contributed by Daniel Templeton.	2016-10-06 15:57:15 +09:00
Varun Vasudev	0992708d79	YARN-5704. Provide config knobs to control enabling/disabling new/work in progress features in container-executor. Contributed by Sidharta Seethana.	2016-10-05 15:31:38 +05:30
Jian He	31f8da22d0	YARN-3139. Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler. Contributed by Wangda Tan	2016-10-04 17:23:13 -07:00
Karthik Kambatla	736d33cddd	YARN-4767. Network issues can cause persistent RM UI outage. (Daniel Templeton via kasha)	2016-10-03 14:35:57 -07:00
Karthik Kambatla	0da54e8848	YARN-5672. FairScheduler: Wrong queue name in log when adding application. (Wilfred Spiegelenburg via kasha)	2016-10-03 06:03:46 -07:00
Naganarasimha	6e130c308c	YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie	2016-10-03 02:02:26 -04:00
Karthik Kambatla	82857037b6	YARN-5678. Log demand as demand in FSLeafQueue and FSParentQueue. (Yufei Gu via kasha)	2016-10-02 22:09:43 -07:00
Subru Krishnan	3a3697deab	YARN-5384. Expose priority in ReservationSystem submission APIs. (Sean Po via Subru).	2016-09-30 19:41:43 -07:00
Arun Suresh	10be45986c	YARN-5486. Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests. (Konstantinos Karanasos via asuresh)	2016-09-29 15:11:41 -07:00
Jian He	2ae5a3a5bf	YARN-4205. Add a service for monitoring application life time out. Contributed by Rohith Sharma K S	2016-09-29 22:00:31 +08:00
Robert Kanter	bcb2528a51	YARN-5400. Light cleanup in ZKRMStateStore (templedf via rkanter)	2016-09-28 14:56:41 -07:00
Varun Saxena	9b0fd01d2e	YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena)	2016-09-28 16:10:10 +05:30
Varun Vasudev	bc2656f09f	YARN-5662. Provide an option to enable ContainerMonitor. Contributed by Jian He.	2016-09-28 15:18:18 +05:30
Wangda Tan	1831be8e73	YARN-3142. Improve locks in AppSchedulingInfo. (Varun Saxena via wangda)	2016-09-27 11:54:55 -07:00
Naganarasimha	ebf528c443	YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S	2016-09-27 16:37:59 +05:30
Arun Suresh	4815d024c5	YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh	2016-09-26 08:46:54 -07:00
Arun Suresh	2f163cd5cf	Revert "YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh" ... This reverts commit fe644bafe7.	2016-09-26 08:36:59 -07:00
Jian He	fe644bafe7	YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh	2016-09-26 22:41:16 +08:00
Akira Ajisaka	14a696f369	YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov.	2016-09-26 15:00:01 +09:00
Naganarasimha	d0372dc613	YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S	2016-09-23 06:30:49 +05:30
Arun Suresh	9f03b403ec	YARN-5656. Fix ReservationACLsTestBase. (Sean Po via asuresh)	2016-09-20 12:27:17 -07:00
Wangda Tan	e45307c9a0	Addendum patch for fix javadocs failure which is caused by YARN-3141. (wangda)	2016-09-20 11:21:01 -07:00
Jason Lowe	c6d1d742e7	YARN-5655. TestContainerManagerSecurity#testNMTokens is asserting. Contributed by Robert Kanter	2016-09-20 14:15:06 +00:00
Jian He	2b66d9ec5b	YARN-3140. Improve locks in AbstractCSQueue/LeafQueue/ParentQueue. Contributed by Wangda Tan	2016-09-20 15:03:31 +08:00
Jason Lowe	7558dbbb48	YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe	2016-09-19 20:31:35 +00:00
Jian He	b8a30f2f17	YARN-3141. Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp. Contributed by Wangda Tan	2016-09-19 17:08:01 +08:00
Arun Suresh	3552c2b99d	YARN-5637. Changes in NodeManager to support Container rollback and commit. (asuresh)	2016-09-18 10:55:18 -07:00
Arun Suresh	f67237cbe7	YARN-5657. Fix TestDefaultContainerExecutor. (asuresh)	2016-09-17 09:32:05 -07:00
Naganarasimha	4174b9756c	YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani	2016-09-17 10:35:39 +05:30
Kai Zheng	58bae35447	YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng	2016-09-18 08:43:36 +08:00
Arun Suresh	40b5a59b72	YARN-5620. Core changes in NodeManager to support re-initialization of Containers with new launchContext. (asuresh)	2016-09-15 07:15:11 -07:00
Jason Lowe	e793309735	YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe	2016-09-13 14:41:27 +00:00
Karthik Kambatla	c0e492e50f	YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha)	2016-09-06 22:40:20 -07:00
Varun Vasudev	e6fcfe28e3	YARN-5576. Allow resource localization while container is running. Contributed by Jian He.	2016-09-06 20:01:45 +05:30
Karthik Kambatla	f6ea9be547	YARN-5264. Store all queue-specific information in FSQueue. (Yufei Gu via kasha)	2016-09-02 14:56:29 -07:00
Ray Chiang	378f624a39	YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang)	2016-09-02 11:14:35 -07:00
Varun Vasudev	05f5c0f631	YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne.	2016-09-02 16:02:01 +05:30
Karthik Kambatla	74f4bae455	YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha)	2016-09-01 14:44:01 -07:00
Varun Vasudev	08f55ccbb0	YARN-5596. Fix failing unit test in TestDockerContainerRuntime. Contributed by Sidharta Seethana.	2016-09-01 14:08:51 +05:30
Arun Suresh	d6d9cff21b	YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh)	2016-08-30 15:52:29 -07:00
Subru Krishnan	b930dc3ec0	YARN-5327. API changes required to support recurring reservations in the YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).	2016-08-26 16:58:47 -07:00
Karthik Kambatla	cde3a00526	YARN-5373. NPE listing wildcard directory in containerLaunch. (Daniel Templeton via kasha)	2016-08-26 11:04:33 -07:00
Junping Du	9ef632f3b0	YARN-5557. Add localize API to the ContainerManagementProtocol. Contributed by Jian He.	2016-08-26 09:04:44 -07:00
Naganarasimha	46e02ab719	YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt	2016-08-26 20:19:11 +05:30
Varun Vasudev	bfb4d95059	YARN-5430. Return container's ip and host from NM ContainerStatus call. Contributed by Jian He.	2016-08-26 16:30:18 +05:30
Naganarasimha	27c3b86252	YARN-5564. Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLE. Contributed by Ray Chiang	2016-08-26 08:47:21 +05:30
Varun Vasudev	525d52bf7c	YARN-5042. Mount /sys/fs/cgroup into Docker containers as read only mount. Contributed by luhuichun.	2016-08-25 14:18:26 +05:30
Rohith Sharma K S	0d5997d2b9	YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G.	2016-08-23 14:37:39 +05:30
Wangda Tan	444b2ea7af	YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda)	2016-08-19 16:28:32 -07:00
Varun Saxena	091dd19e86	YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)	2016-08-19 17:30:17 +05:30
Varun Saxena	8aed374182	Revert "YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)" ... This reverts commit 59557e85a4.	2016-08-19 16:14:16 +05:30
Varun Saxena	59557e85a4	YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)	2016-08-19 15:01:48 +05:30
Junping Du	0da69c324d	YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi. ... (cherry picked from commit d464483bf7f0b3e3be3ba32cd6c3eee546747ab5) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java	2016-08-18 07:27:23 -07:00
Karthik Kambatla	20f0eb871c	YARN-4702. FairScheduler: Allow setting maxResources for ad hoc queues. (Daniel Templeton via kasha)	2016-08-17 17:40:20 -07:00
Varun Vasudev	7f05ff7a4e	YARN-5455. Update Javadocs for LinuxContainerExecutor. Contributed by Daniel Templeton.	2016-08-17 15:34:58 +05:30
Varun Saxena	24249115bf	YARN-5521. Fix random failure of TestCapacityScheduler#testKillAllAppsInQueue (sandflee via Varun Saxena)	2016-08-16 00:03:29 +05:30
Varun Saxena	d677b68c25	YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena)	2016-08-15 03:31:21 +05:30
Varun Saxena	23c6e3c4e4	YARN-5476. Non existent application reported as ACCEPTED by YarnClientImpl (Junping Du via Varun Saxena)	2016-08-12 20:37:58 +05:30
Naganarasimha	874577a67d	YARN-4833. For Queue AccessControlException client retries multiple times on both RM. Contributed by Bibin A Chundatt	2016-08-12 01:09:41 +05:30
Rohith Sharma K S	5199db387d	YARN-5492. TestSubmitApplicationWithRMHA is failing sporadically during precommit builds. Contributed by Vrushali C.	2016-08-11 11:50:46 +05:30
Ray Chiang	aea3e65749	YARN-5137. Make DiskChecker pluggable in NodeManager. (Yufei Gu via rchiang)	2016-08-10 19:23:29 -07:00
Naganarasimha	89c0bff719	YARN-5495. Remove import wildcard in CapacityScheduler. Contributed by Ray Chiang.	2016-08-11 00:35:19 +05:30
Jason Lowe	5c95bb315b	YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C	2016-08-10 18:25:54 +00:00
Jason Lowe	e0b570dffb	YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee	2016-08-10 18:04:18 +00:00
Karthik Kambatla	7992c0b42c	YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha)	2016-08-09 16:51:03 -07:00
Varun Vasudev	522ddbde79	YARN-5394. Remove bind-mount /etc/passwd for Docker containers. Contributed by Zhankun Tang.	2016-08-09 16:04:09 +05:30
Arun Suresh	82c9e06101	YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh)	2016-08-09 00:42:29 -07:00
Varun Saxena	37d939a453	YARN-4910. Fix incomplete log info in ResourceLocalizationService (Jun Gong via Varun Saxena)	2016-08-08 22:12:53 +05:30
Naganarasimha	131d58a24e	YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang	2016-08-07 01:08:13 +05:30
Naganarasimha	d81b8163b4	YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula	2016-08-06 01:13:36 +05:30
Wangda Tan	3f100d76ff	YARN-4888. Changes in scheduler to identify resource-requests explicitly by allocation-id. (Subru Krishnan via wangda)	2016-08-05 10:43:35 -07:00
Wangda Tan	e0d131f055	YARN-4091. Add REST API to retrieve scheduler activity. (Chen Ge and Sunil G via wangda)	2016-08-05 10:27:34 -07:00
Rohith Sharma K S	d9a354c2f3	YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong.	2016-08-05 21:35:49 +05:30
Varun Vasudev	08e33381f5	YARN-5459. Add support for docker rm. Contributed by Shane Kumpf.	2016-08-04 14:08:34 +05:30
Jason Lowe	db4a61dc61	YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger	2016-08-03 19:51:44 +00:00
Jason Lowe	db646540f0	YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger	2016-08-03 19:17:25 +00:00
Jason Lowe	4d92aefd35	YARN-4280. CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster. Contributed by Kuhu Shukla	2016-08-03 18:53:14 +00:00
Varun Vasudev	d848184e90	YARN-5460. Change container runtime type logging in DelegatingLinuxContainerRuntime to debug. Contributed by Shane Kumpf.	2016-08-03 12:02:39 +05:30
Chris Nauroth	b913677365	YARN-5456. container-executor support for FreeBSD, NetBSD, and others if conf path is absolute. Contributed by Allen Wittenauer.	2016-08-02 22:24:34 -07:00
Varun Vasudev	7fc70c6422	YARN-5458. Rename DockerStopCommandTest to TestDockerStopCommand. Contributed by Shane Kumpf.	2016-08-02 16:56:45 +05:30
Varun Vasudev	2e7c2a13a8	YARN-5443. Add support for docker inspect command. Contributed by Shane Kumpf.	2016-08-02 16:55:10 +05:30
Varun Vasudev	95694b70cd	YARN-5444. Fix failing unit tests in TestLinuxContainerExecutorWithMocks. Contributed by Yufei Gu.	2016-08-01 16:08:38 +05:30
Arun Suresh	e5766b1dbe	YARN-5113. Refactoring and other clean-up for distributed scheduling. (Konstantinos Karanasos via asuresh)	2016-07-31 11:48:25 -07:00
Chris Nauroth	ef501b1a0b	YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer.	2016-07-30 08:26:19 -07:00
Subru Krishnan	4e756d7271	YARN-5203.Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API. Contributed by Ellen Hui.	2016-07-28 16:03:24 -07:00
Junping Du	7f3c306e2e	YARN-5432. Lock already held by another process while LevelDB cache store creation for dag. Contributed by Li Lu.	2016-07-28 06:35:24 -07:00
Subru Krishnan	d2cbfd7de3	YARN-5441. Fixing minor Scheduler test case failures	2016-07-27 18:21:58 -07:00
Akira Ajisaka	54fe17a607	HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.	2016-07-27 19:41:09 +09:00
Wangda Tan	d62e121ffc	YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. (sandflee via wangda)	2016-07-26 21:22:59 -07:00
Wangda Tan	49969b16cd	YARN-5342. Improve non-exclusive node partition resource allocation in Capacity Scheduler. (Sunil G via wangda)	2016-07-26 18:14:09 -07:00
Arun Suresh	5aace38b74	YARN-5392. Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerRequestKey. (asuresh and subru)	2016-07-26 14:54:03 -07:00
Chris Douglas	d383bfdcd4	YARN-5164. Use plan RLE to improve CapacityOverTimePolicy efficiency	2016-07-25 16:37:50 -07:00
Rohith Sharma K S	557a245d83	YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe.	2016-07-21 12:47:27 +05:30
Akira Ajisaka	c63afdbe14	YARN-4883. Make consistent operation name in AdminService. Contributed by Kai Sasaki.	2016-07-20 16:51:01 -07:00
Vinod Kumar Vavilapalli	1c9d2ab503	YARN-5340. Fixed a race condition in RollingLevelDBTimelineStore that caused loss of Timeline events. Contributed by Li Lu.	2016-07-20 08:36:36 -07:00
Arun Suresh	8fbe6ece24	YARN-5350. Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost. (asuresh)	2016-07-19 23:03:58 -07:00
Arun Suresh	cda0a280dd	YARN-5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)	2016-07-19 10:43:37 -07:00
Arun Suresh	5f2d33a551	Revert "YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)" ... This reverts commit e905a42a2c.	2016-07-19 10:43:19 -07:00
Varun Saxena	fe20494a72	YARN-4996. Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic (Kai Sasaki via Varun Saxena)	2016-07-19 16:03:28 +05:30
Andrew Wang	da456ffd62	Preparing for 3.0.0-alpha2 development	2016-07-15 19:04:17 -07:00
Ray Chiang	f5f1c81e7d	YARN-5272. Handle queue names consistently in FairScheduler. (Wilfred Spiegelenburg via rchiang)	2016-07-15 14:38:50 -07:00
Arun Suresh	e905a42a2c	YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)	2016-07-15 14:35:12 -07:00
Wangda Tan	24db9167f1	YARN-4484. Available Resource calculation for a queue is not correct when used with labels. (Sunil G via wangda)	2016-07-15 11:40:12 -07:00
Varun Saxena	a72cb3825a	YARN-5383. Fix findbugs and checkstyle issues in ContainerExecutor. (Vrushali C via Varun Saxena)	2016-07-15 23:17:04 +05:30
Naganarasimha	b5ee7dbd8d	YARN-5380. NMTimelinePublisher should use getMemorySize instead of getMemory. Contributed by Vrushali C	2016-07-15 14:34:48 +05:30
Sangjin Lee	e549a9af31	YARN-5379. TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently (Vrushali C via sjlee)	2016-07-14 15:19:03 -07:00
Akira Ajisaka	6cf017558a	YARN-5159. Wrong Javadoc tag in MiniYarnCluster. Contributed by Andras Bokor.	2016-07-14 10:45:11 -07:00
Varun Vasudev	54bf14f80b	YARN-5303. Clean up ContainerExecutor JavaDoc. Contributed by Daniel Templeton.	2016-07-14 19:28:11 +05:30
Varun Vasudev	e5e558b0a3	YARN-4759. Fix signal handling for docker containers. Contributed by Shane Kumpf.	2016-07-14 19:27:16 +05:30
Varun Vasudev	58e1850801	YARN-5298. Mount usercache and NM filecache directories into Docker container. Contributed by Sidharta Seethana.	2016-07-14 16:11:07 +05:30
Rohith Sharma K S	dbe97aa768	YARN-5299. Log Docker run command when container fails. Contributed by Varun Vasudev.	2016-07-14 11:48:10 +05:30
Naganarasimha	af8f480c24	YARN-5364. timelineservice modules have indirect dependencies on mapreduce artifacts. Contributed by Sangjin Lee	2016-07-14 01:43:37 +05:30
Varun Saxena	56142171b9	YARN-5359. FileSystemTimelineReader/Writer uses unix-specific default storage path (Sangjin Lee via Varun Saxena)	2016-07-13 21:15:41 +05:30
Rohith Sharma K S	d6d41e820a	YARN-5362. TestRMRestart#testFinishedAppRemovalAfterRMRestart can fail. Contributed by sandflee.	2016-07-13 19:12:35 +05:30
Varun Saxena	06c56ff79b	YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena).	2016-07-13 07:55:34 +05:30
Jason Lowe	10b704c594	YARN-5317. testAMRestartNotLostContainerCompleteMsg may fail. Contributed by sandflee	2016-07-12 20:27:41 +00:00
Jian He	819224dcf9	YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan	2016-07-11 22:36:20 -07:00
Varun Saxena	0fd3980a1f	YARN-5037. Fix random failure of TestRMRestart#testQueueMetricsOnRMRestart (sandflee via Varun Saxena).	2016-07-10 21:28:52 +05:30
Sangjin Lee	6cf6ab7b78	Made a number of miscellaneous fixes for javac, javadoc, and checstyle warnings.	2016-07-10 08:46:05 -07:00
Sangjin Lee	c5dbde0cc4	Fixed the build after the rebase with trunk.	2016-07-10 08:46:05 -07:00
Vrushali	6d943038f6	Cleanup changes during rebase with trunk (Vrushali C)	2016-07-10 08:46:04 -07:00
Sangjin Lee	1a227744ac	YARN-5070. upgrade HBase version for first merge (Vrushali C via sjlee)	2016-07-10 08:46:04 -07:00
Varun Saxena	1ff6833bba	YARN-5243. fix several rebase and other miscellaneous issues before merge. (Sangjin Lee via Varun Saxena)	2016-07-10 08:46:03 -07:00
Varun Saxena	892b193bd7	YARN-5170. Eliminate singleton converters and static method access. (Joep Rottinghuis via Varun Saxena)	2016-07-10 08:46:03 -07:00
Varun Saxena	c65020075e	YARN-5167. Escape occurences of encodedValues. (Sangjin Lee via Varun Saxena)	2016-07-10 08:46:02 -07:00
Varun Saxena	9c926cf432	YARN-5142. fix findbugs warnings/errors for hadoop-yarn-server-timelineservice-hbase-tests. (Vrushali C via Varun Saxena)	2016-07-10 08:46:02 -07:00
Li Lu	0a9b085f05	YARN-5189. Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl. (Joep Rottinghuis and Sangjin Lee via gtcarrera9)	2016-07-10 08:46:01 -07:00
Sangjin Lee	c81a2e1d19	YARN-5015. entire time series is returned for YARN container system metrics (CPU and memory) (Varun Saxena via sjlee)	2016-07-10 08:46:01 -07:00
Sangjin Lee	7b8cfa5c2f	YARN-5109. timestamps are stored unencoded causing parse errors (Varun Saxena via sjlee)	2016-07-10 08:46:01 -07:00
Li Lu	d729e8211b	YARN-5138. fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests. (Vrushali C via gtcarrera9)	2016-07-10 08:46:00 -07:00
Sangjin Lee	702236129b	YARN-5095. flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled (Varun Saxena via sjlee)	2016-07-10 08:46:00 -07:00
Sangjin Lee	831a3ffd6e	YARN-5097. NPE in Separator.joinEncoded() (Vrushali C via sjlee)	2016-07-10 08:46:00 -07:00
Sangjin Lee	a1b6d7456f	YARN-5018. Online aggregation logic should not run immediately after collectors got started (Li Lu via sjlee)	2016-07-10 08:45:59 -07:00
Sangjin Lee	8c8183e515	YARN-5093. created time shows 0 in most REST output (Varun Saxena via sjlee)	2016-07-10 08:45:59 -07:00
Sangjin Lee	4a7011a45f	YARN-5096 addendum. Turned another logging statement to debug. Contributed by Sangjin Lee.	2016-07-10 08:45:59 -07:00
Varun Saxena	bcdb382600	YARN-5096. timelinereader has a lot of logging that's not useful. (Sangjin Lee via Varun Saxena)	2016-07-10 08:45:58 -07:00
Varun Saxena	bc6f978cd3	YARN-5045. hbase unit tests fail due to dependency issues. (Sangjin Lee via varunsaxena)	2016-07-10 08:45:58 -07:00
Sangjin Lee	089caf49fe	YARN-4447. Provide a mechanism to represent complex filters and parse them at the REST layer (Varun Saxena via sjlee)	2016-07-10 08:45:57 -07:00
Li Lu	c2055a97d5	YARN-3150. Documenting the timeline service v2. (Sangjin Lee and Vrushali C via gtcarrera9)	2016-07-10 08:45:57 -07:00
Sangjin Lee	69dc561b61	YARN-4986. Add a check in the coprocessor for table to operated on (Vrushali C via sjlee)	2016-07-10 08:45:56 -07:00
Sangjin Lee	39cce4e629	YARN-3816. [Aggregation] App-level aggregation and accumulation for YARN system metrics (Li Lu via sjlee)	2016-07-10 08:45:56 -07:00
Sangjin Lee	c2efdc415a	YARN-3863. Support complex filters in TimelineReader (Varun Saxena via sjlee)	2016-07-10 08:45:55 -07:00
Varun Saxena	a3cf40e532	YARN-3461. Consolidate flow name/version/run defaults. (Sangjin Lee via Varun Saxena)	2016-07-10 08:45:55 -07:00
Sangjin Lee	84c35ac6c4	YARN-4711. NM is going down with NPE's due to single thread processing of events by Timeline client (Naganarasimha G R via sjlee)	2016-07-10 08:45:55 -07:00
Varun Saxena	6f6cc647d6	YARN-4712. CPU Usage Metric is not captured properly in YARN-2928. (Naganarasimha G R via Varun Saxena)	2016-07-10 08:45:54 -07:00
Sangjin Lee	9bdd455dce	YARN-4062. Add the flush and compaction functionality via coprocessors and scanners for flow run table (Vrushali C via sjlee)	2016-07-10 08:45:54 -07:00
Varun Saxena	d56dde490b	YARN-4700. ATS storage has one extra record each time the RM got restarted. (Naganarasimha G R via Varun Saxena)	2016-07-10 08:45:53 -07:00
Sangjin Lee	0d02ab8729	YARN-3367. Replace starting a separate thread for post entity with event loop in TimelineClient (Naganarasimha G R via sjlee)	2016-07-10 08:45:53 -07:00
Sangjin Lee	960af7d471	YARN-4409. Fix javadoc and checkstyle issues in timelineservice code (Varun Saxena via sjlee)	2016-07-10 08:45:53 -07:00
Sangjin Lee	9cb1287e9b	YARN-4446. Refactor reader API for better extensibility (Varun Saxena via sjlee)	2016-07-10 08:45:52 -07:00
Naganarasimha	06f0b50a28	YARN-4644. TestRMRestart fails and findbugs issue in YARN-2928 branch (Varun Saxena via Naganarasimha G R)	2016-07-10 08:45:52 -07:00
Li Lu	9d40d9d34c	YARN-4224. Support fetching entities by UID and change the REST ... interface to conform to current REST APIs' in YARN. (Varun Saxena via gtcarrera9)	2016-07-10 08:45:52 -07:00
Naganarasimha	6934b05c71	YARN-4238. createdTime and modifiedTime is not reported while publishing entities to ATSv2. (Varun Saxena via Naganarasimha G R)	2016-07-10 08:45:52 -07:00
Li Lu	34f02f07d5	Rebase to latest trunk	2016-07-10 08:45:51 -07:00
Li Lu	88f0294114	YARN-4200. Refactor reader classes in storage to nest under hbase ... specific package name. Contributed by Li Lu.	2016-07-10 08:45:51 -07:00
Sangjin Lee	cc16683cef	YARN-3995. Some of the NM events are not getting published due race condition when AM container finishes in NM (Naganarasimha G R via sjlee)	2016-07-10 08:45:50 -07:00
Varun Saxena	829cceebc0	YARN-3586. RM to only get back addresses of Collectors that NM needs to know. ... (Junping Du via Varun Saxena).	2016-07-10 08:45:50 -07:00
Varun Saxena	eb0ac8efb1	YARN-4350. TestDistributedShell fails for V2 scenarios. (Naganarasimha G R via Varun Saxena)	2016-07-10 08:45:50 -07:00
Li Lu	8ef546c1ee	YARN-4445. Unify the term flowId and flowName in timeline v2 codebase. ... Contributed by Zhan Zhang.	2016-07-10 08:45:49 -07:00
Varun Saxena	c4d7bbda5c	YARN-4460. [Bug fix] RM fails to start when SMP is enabled. (Li Lu via Varun Saxena)	2016-07-10 08:45:49 -07:00
Xuan	2e2dbf59d1	YARN-4392. ApplicationCreatedEvent event time resets after RM ... restart/failover. Contributed by Naganarasimha G R and Xuan Gong (cherry picked from commit 4546c7582b) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestRMAppTransitions.java	2016-07-10 08:45:49 -07:00
Li Lu	89e5c44f9e	YARN-4356. Ensure the timeline service v.2 is disabled cleanly and has no ... impact when it's turned off. Contributed by Sangjin Lee.	2016-07-10 08:45:48 -07:00
Sangjin Lee	1f710484e5	YARN-3862. Support for fetching specific configs and metrics based on prefixes (Varun Saxena via sjlee)	2016-07-10 08:45:48 -07:00
Sangjin Lee	ae72f1dc77	YARN-4297. TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch (Varun Saxena via sjlee)	2016-07-10 08:45:47 -07:00
Sangjin Lee	51254a6b51	YARN-4053. Change the way metric values are stored in HBase Storage (Varun Saxena via sjlee)	2016-07-10 08:45:47 -07:00
Sangjin Lee	09649005ca	YARN-4221. Store user in app to flow table (Varun Saxena via sjlee)	2016-07-10 08:45:47 -07:00
Sangjin Lee	10ec5586fb	YARN-4129. Refactor the SystemMetricPublisher in RM to better support newer events (Naganarasimha G R via sjlee)	2016-07-10 08:45:46 -07:00
Sangjin Lee	e3e857866d	YARN-4179. [reader implementation] support flow activity queries based on time (Varun Saxena via sjlee)	2016-07-10 08:45:46 -07:00
Li Lu	d014f2ffd2	YARN-4237 Support additional queries for ATSv2 Web UI. Contributed by ... Varun Saxena.	2016-07-10 08:45:46 -07:00
Sangjin Lee	b51d0fef56	YARN-4178. [storage implementation] app id as string in row keys can cause incorrect ordering (Varun Saxena via sjlee)	2016-07-10 08:45:45 -07:00
Sangjin Lee	0f44b5508d	YARN-3864. Implement support for querying single app and all apps for a flow run (Varun Saxena via sjlee)	2016-07-10 08:45:45 -07:00
Vrushali Channapattan	708fa8b1ae	YARN-4210. HBase reader throws NPE if Get returns no rows (Varun Saxena via vrushali)	2016-07-10 08:45:45 -07:00
Vrushali Channapattan	da2b7bd08e	YARN-4203. Add request/response logging & timing for each REST endpoint call (Varun Saxena via vrushali)	2016-07-10 08:45:45 -07:00
Vrushali Channapattan	d95dc89a02	YARN-4075 [reader REST API] implement support for querying for flows and flow runs (Varun Saxena via vrushali)	2016-07-10 08:45:44 -07:00
Vrushali	10fa6da7d8	YARN-4074. [timeline reader] implement support for querying for flows and flow runs (sjlee via vrushali)	2016-07-10 08:45:44 -07:00
Sangjin Lee	a68e383921	YARN-3901. Populate flow run data in the flow_run & flow activity tables (Vrushali C via sjlee)	2016-07-10 08:45:44 -07:00
Sangjin Lee	ee081018e4	YARN-4102. Add a "skip existing table" mode for timeline schema creator (Li Lu via sjlee)	2016-07-10 08:45:43 -07:00
Sangjin Lee	8d9476ec5f	YARN-4058. Miscellaneous issues in NodeManager project (Naganarasimha G R via sjlee)	2016-07-10 08:45:43 -07:00
Sangjin Lee	451c13b1de	YARN-3814. REST API implementation for getting raw entities in TimelineReader (Varun Saxena via sjlee)	2016-07-10 08:45:43 -07:00
Sangjin Lee	c7224a285c	YARN-4064. build is broken at TestHBaseTimelineWriterImpl.java (sjlee)	2016-07-10 08:45:43 -07:00
Junping Du	7a41b5501e	YARN-4025. Deal with byte representations of Longs in writer code. Contributed by Sangjin Lee and Vrushali C.	2016-07-10 08:45:42 -07:00
Junping Du	477a30f536	YARN-3045. Implement NM writing container lifecycle events to Timeline Service v2. Contributed by Naganarasimha G R.	2016-07-10 08:45:42 -07:00
Sangjin Lee	102b56ee96	YARN-3904. Refactor timelineservice.storage to add support to online and offline aggregation writers (Li Lu via sjlee)	2016-07-10 08:45:42 -07:00
Zhijie Shen	5088f6c76a	MAPREDUCE-6337. Added a mode to replay MR job history files and put them into the timeline service v2. Contributed by Sangjin Lee. ... (cherry picked from commit 463e070a8e7c882706a96eaa20ea49bfe9982875)	2016-07-10 08:45:41 -07:00
Junping Du	00e85e7a2b	YARN-3906. Split the application table from the entity table. Contributed by Sangjin Lee. ... (cherry picked from commit bcd755eba9466ce277d3c14192c31da6462c4ab3)	2016-07-10 08:45:41 -07:00
Sangjin Lee	9e5155be36	YARN-3049. [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend (Zhijie Shen via sjlee) ... (cherry picked from commit 07433c2ad52df9e844dbd90020c277d3df844dcd)	2016-07-10 08:45:41 -07:00
Zhijie Shen	9422d9b50d	YARN-3984. Adjusted the event column key schema and avoided missing empty event. Contributed by Vrushali C. ... (cherry picked from commit 895ccfa1ab9e701f2908586e323249f670fe5544)	2016-07-10 08:45:40 -07:00
Zhijie Shen	57e2498cd4	YARN-3993. Changed to use the AM flag in ContainerContext determine AM container in TestPerNodeTimelineCollectorsAuxService. Contributed by Sunil G. ... (cherry picked from commit 9e48f9ff2ce08f3dcdd8d60bacb697664b92196f)	2016-07-10 08:45:40 -07:00
Zhijie Shen	a9fab9b644	YARN-3908. Fixed bugs in HBaseTimelineWriterImpl. Contributed by Vrushali C and Sangjin Lee. ... (cherry picked from commit df0ec473a84871b0effd7ca6faac776210d7df09)	2016-07-10 08:45:40 -07:00
Junping Du	8603736ef2	YARN-3949. Ensure timely flush of timeline writes. Contributed by Sangjin Lee. ... (cherry picked from commit 967bef7e0396d857913caa2574afb103a5f0b81b)	2016-07-10 08:45:39 -07:00
Sangjin Lee	e27642abf4	YARN-3047. [Data Serving] Set up ATS reader with basic request serving structure and lifecycle (Varun Saxena via sjlee) ... (cherry picked from commit 4c5f88fb0f04b7919738d07598b0f006a9ff91f2)	2016-07-10 08:45:39 -07:00
Zhijie Shen	2d59bc4458	YARN-3051. Created storage oriented reader interface for fetching raw entity data and made the filesystem based implementation. Contributed by Varun Saxena. ... (cherry picked from commit 499ce52c7b645ec0b1cc8ac62dc9a3127b987a20)	2016-07-10 08:45:38 -07:00
Sangjin Lee	22e7ae5771	YARN-3792. Test case failures in TestDistributedShell and some issue fixes related to ATSV2 (Naganarasimha G R via sjlee) ... (cherry picked from commit 84f37f1c7eefec6d139cbf091c50d6c06f734323)	2016-07-10 08:45:38 -07:00
Sangjin Lee	92d90c3a24	YARN-3706. Generalize native HBase writer for additional tables (Joep Rottinghuis via sjlee) ... (cherry picked from commit 9137aeae0dec83f9eff40d12cae712dfd508c0c5)	2016-07-10 08:45:38 -07:00
Zhijie Shen	f3c661e8dd	YARN-3044. Made RM write app, attempt and optional container lifecycle events to timeline service v2. Contributed by Naganarasimha G R.	2016-07-10 08:45:37 -07:00
Sangjin Lee	f668212529	YARN-3721. build is broken on YARN-2928 branch due to possible dependency cycle (Li Lu via sjlee) ... (cherry picked from commit a9738ceb17b50cce8844fd42bb800c7f83f15caf)	2016-07-10 08:45:37 -07:00
Sangjin Lee	db891f51d0	YARN-3726. Fix TestHBaseTimelineWriterImpl unit test failure by fixing its test data (Vrushali C via sjlee) ... (cherry picked from commit 4c0b6d73914f2e249795deb292f508177ea54884)	2016-07-10 08:45:36 -07:00
Sangjin Lee	5a4278ccbd	YARN-3411. [Storage implementation] explore the native HBase write schema for storage (Vrushali C via sjlee) ... (cherry picked from commit 7a3068854d27eadae1c57545988f5b2029bf119a)	2016-07-10 08:45:36 -07:00
Junping Du	d275677e24	YARN-3634. TestMRTimelineEventHandling and TestApplication are broken. Contributed by Sangjin Lee. ... (cherry picked from commit b059dd4882fd759e4762cc11c019be4b68fb74c1)	2016-07-10 08:45:36 -07:00
Zhijie Shen	51d092faef	YARN-3529. Added mini HBase cluster and Phoenix support to timeline service v2 unit tests. Contributed by Li Lu.	2016-07-10 08:45:36 -07:00
Zhijie Shen	41fb5c7381	YARN-3134. Implemented Phoenix timeline writer to access HBase backend. Contributed by Li Lu. ... (cherry picked from commit b3b791be466be79e4e964ad068f7a6ec701e22e1)	2016-07-10 08:45:35 -07:00
Sangjin Lee	dc1f306fdc	YARN-3562. unit tests failures and issues found from findbug from earlier ATS checkins (Naganarasimha G R via sjlee)	2016-07-10 08:45:35 -07:00
Sangjin Lee	fc8485d893	YARN-3551. Consolidate data model change according to the backend implementation (Zhijie Shen via sale) ... (cherry picked from commit 557a3950bddc837469244835f5577899080115d8)	2016-07-10 08:45:35 -07:00
Junping Du	2bdefbc4a0	YARN-3431. Sub resources of timeline entity needs to be passed to a separate endpoint. Contributed By Zhijie Shen. ... (cherry picked from commit fa5cc75245a6dba549620a8b26c7b4a8aed9838e)	2016-07-10 08:45:34 -07:00
Sangjin Lee	11e8905d8d	YARN-3390. Reuse TimelineCollectorManager for RM (Zhijie Shen via sjlee) ... (cherry picked from commit 58221188811e0f61d842dac89e1f4ad4fd8aa182)	2016-07-10 08:45:33 -07:00
Junping Du	47f35a30bb	YARN-3391. Clearly define flow ID/ flow run / flow version in API and storage. Contributed by Zhijie Shen ... (cherry picked from commit 68c6232f8423e55b4d152ef3d1d66aeb2d6a555e)	2016-07-10 08:45:33 -07:00
Zhijie Shen	5712b8f9fd	YARN-3334. NM uses timeline client to publish container metrics to new timeline service. Contributed by Junping Du.	2016-07-10 08:45:33 -07:00
Junping Du	42e49399ce	YARN-3374. Collector's web server should randomly bind an available port. Contributed by Zhijie Shen ... (cherry picked from commit 3aa898e734a1e4368ddf1d0bbd31f9b4de53ceba)	2016-07-10 08:45:32 -07:00
Junping Du	d67c9bdb4d	YARN-3040. Make putEntities operation be aware of the app's context. Contributed by Zhijie Shen	2016-07-10 08:45:32 -07:00
Junping Du	5e3d9a477b	YARN-3034. Implement RM starting its timeline collector. Contributed by Naganarasimha G R	2016-07-10 08:45:32 -07:00
Zhijie Shen	19c1132146	YARN-3377. Fixed test failure in TestTimelineServiceClientIntegration. Contributed by Sangjin Lee. ... (cherry picked from commit 04de2ceccd02edb00bd671a63e04855c132e9735)	2016-07-10 08:45:31 -07:00
Junping Du	2188a07e5b	YARN-3333. Rename TimelineAggregator etc. to TimelineCollector. Contributed by Sangjin Lee	2016-07-10 08:45:31 -07:00
Zhijie Shen	9b56364080	YARN-3039. Implemented the app-level timeline aggregator discovery service. Contributed by Junping Du.	2016-07-10 08:45:31 -07:00
Zhijie Shen	f0e752c14b	YARN-3264. Created backing storage write interface and a POC only FS based storage implementation. Contributed by Vrushali C. ... (cherry picked from commit 821b68d05d246fd57d7b7286eb2ccc075ed1eae8)	2016-07-10 08:45:30 -07:00
Zhijie Shen	bf54d32750	YARN-3210. Refactored timeline aggregator according to new code organization proposed in YARN-3166. Contributed by Li Lu. ... (cherry picked from commit d3ff7f06cbc66d3a23c2551e7d4c752689f46afe)	2016-07-10 08:45:30 -07:00
Zhijie Shen	d45ff878c4	YARN-3125. Made the distributed shell use timeline service next gen and add an integration test for it. Contributed by Junping Du and Li Lu. ... (cherry picked from commit bf08f7f0ed4900ce52f98137297dd1a47ba2a536)	2016-07-10 08:45:30 -07:00
Zhijie Shen	9d57c9c015	YARN-3087. Made the REST server of per-node aggregator work alone in NM daemon. Conntributed by Li Lu. ... (cherry picked from commit 41a08ad404d4278fe598d6c222b2ae0e84bae0df)	2016-07-10 08:45:29 -07:00
Junping Du	4f0c7eaff3	YARN-3240. Implement client API to put generic entities. Contributed by Zhijie Shen ... (cherry picked from commit 4487da249f448d5c67b712cd0aa723e764eed77d)	2016-07-10 08:45:29 -07:00
Zhijie Shen	7c8abec0a8	YARN-3030. Set up TS aggregator with basic request serving structure and lifecycle. Contributed by Sangjin Lee. ... (cherry picked from commit f26941b39028ac30c77547e2be2d657bb5bf044a)	2016-07-10 08:45:28 -07:00
Zhijie Shen	0d2da08f35	YARN-3063. Bootstrapping TimelineServer next generation module. Contributed by Zhijie Shen. ... (cherry picked from commit fe7d0e7c8fc88e0721b18e1531b0899d9dbed296)	2016-07-10 08:45:28 -07:00
Varun Saxena	c04c5ec501	YARN-5318. Fix intermittent test failure of TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider. (Jun Gong via Varun Saxena).	2016-07-09 01:13:18 +05:30
Varun Saxena	5252562edf	YARN-5297. Avoid printing a stack trace when recovering an app after the RM restarts. (Junping Du via Varun Saxena).	2016-07-09 00:09:25 +05:30
Junping Du	30ee57ceb1	YARN-4939. The decommissioning Node should keep alive during NM restart. Contributed by sandflee.	2016-07-08 04:14:53 -07:00
Vinod Kumar Vavilapalli	673e5e02fe	YARN-5314. Fixed a ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore. Contributed by Li Lu.	2016-07-07 22:37:29 -07:00
Jian He	8a9d293dd6	YARN-5233. Support for specifying a path for ATS plugin jars. Contributed by Li Lu	2016-07-06 16:44:46 -07:00
Vinod Kumar Vavilapalli	4c9e1aeb94	YARN-5224. Added new web-services /containers/{containerid}/logs & /containers/{containerid}/logs/{filename} and using them in "yarn logs" CLI to get logs of finished containers of a running application. Contributed by Xuan Gong.	2016-07-06 14:10:54 -07:00
Wangda Tan	04f6ebb66a	YARN-5294. Pass remote ip address down to YarnAuthorizationProvider. (Jian He via wangda)	2016-07-06 10:36:48 -07:00
Jian He	d792a90206	YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du	2016-07-05 18:05:16 -07:00
Vinod Kumar Vavilapalli	ce9c006430	YARN-5214. Fixed locking in DirectoryCollection to avoid hanging NMs when various code-paths hit slow disks. Contributed by Junping Du.	2016-07-05 16:07:28 -07:00
Varun Saxena	8e672e3c71	YARN-5286. Add RPC port info in RM web service's response when getting app status. (Jun Gong via Varun Saxena).	2016-07-05 22:56:07 +05:30
Ray Chiang	0a5def155e	YARN-4568. Fix message when NodeManager runs into errors initializing the recovery directory. (rchiang)	2016-07-01 15:53:46 -07:00
Jian He	c35a5a7a8d	YARN-5023. TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails. Contributed by sandflee	2016-07-01 14:29:03 -07:00
Varun Saxena	abe7fc22c1	YARN-5182. MockNodes.newNodes creates one more node per rack than requested. (Karthik Kambatla via Varun Saxena).	2016-06-30 00:13:28 +05:30
Rohith Sharma K S	26b5e6116f	YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat.	2016-06-29 10:08:30 +05:30
Akira Ajisaka	a8a48c9125	YARN-5278. Remove unused argument in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration. Contributed by Tao Jie.	2016-06-23 14:28:12 +09:00
Arun Suresh	99e5dd68d0	YARN-5171. Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node. (Inigo Goiri via asuresh)	2016-06-22 19:04:54 -07:00
Tsuyoshi Ozawa	5d58858bb6	HADOOP-9613. [JDK8] Update jersey version to latest 1.x release.	2016-06-21 08:05:32 +09:00
Sangjin Lee	5107a967fa	YARN-4958. The file localization process should allow for wildcards to reduce the application footprint in the state store (Daniel Templeton via sjlee)	2016-06-20 09:56:53 -07:00
Junping Du	d0162f2040	YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev.	2016-06-19 17:44:54 -07:00
Karthik Kambatla	20f2799938	YARN-5077. Fix FSLeafQueue#getFairShare() for queues with zero fairshare. (Yufei Gu via kasha)	2016-06-17 22:24:42 -07:00
Karthik Kambatla	fbbe0bb627	YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit. Addendum to fix javac warning. (Arun Suresh via kasha)	2016-06-17 22:12:50 -07:00
Junping Du	c35fa4a0e5	YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong.	2016-06-17 08:24:24 -07:00
Junping Du	5dfc38ff57	YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong.	2016-06-15 16:17:54 -07:00
Wangda Tan	c77a1095dc	YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)	2016-06-14 15:06:38 -07:00
Rohith Sharma K S	28b66ae919	YARN-4989. TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently. Contributed by Ajith S.	2016-06-13 11:09:32 +05:30
Arun Suresh	7dae2b3bc4	YARN-5212. Run existing ContainerManager tests using QueuingContainerManagerImpl. (Konstantinos Karanasos via asuresh)	2016-06-12 10:05:37 -07:00
Arun Suresh	5279af7cd4	YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit (sandflee via asuresh)	2016-06-10 22:33:42 -07:00
Rohith Sharma K S	e0f4620cc7	YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe.	2016-06-11 10:22:27 +05:30
Wangda Tan	03fc6b1bb0	YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)	2016-06-10 09:51:09 -07:00
Wangda Tan	244506f9c8	YARN-5208. Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled. (Rohith Sharma K S via wangda)	2016-06-10 09:34:32 -07:00
Vinod Kumar Vavilapalli	9378d9428f	YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv)	2016-06-09 12:30:58 -07:00
Naganarasimha	1500a0a300	YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G	2016-06-09 05:41:09 +05:30
Arun Suresh	3344ba70e0	YARN-5204. Properly report status of killed/stopped queued containers. (Konstantinos Karanasos via asuresh)	2016-06-08 08:31:32 -07:00
Arun Suresh	76f0800c21	YARN-5176. More test cases for queuing of containers at the NM. (Konstantinos Karanasos via asuresh)	2016-06-07 17:16:18 -07:00
Xuan	58be55b6e0	YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and ... FileInputStream in NMWebServices#getLogs. Contributed by Xuan Gong	2016-06-07 16:07:02 -07:00
Wangda Tan	620325e816	YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda)	2016-06-07 15:06:42 -07:00
Rohith Sharma K S	bddea5fe5f	YARN-5118. Tests fails with localizer port bind exception. Contributed by Brahma Reddy Battula.	2016-06-07 11:20:15 +05:30
Arun Suresh	3a154f75ed	YARN-4525. Fix bug in RLESparseResourceAllocation.getRangeOverlapping(). (Ishai Menache and Carlo Curino via asuresh)	2016-06-06 21:18:32 -07:00
Arun Suresh	7a9b7372a1	YARN-5185. StageAllocaterGreedyRLE: Fix NPE in corner case. (Carlo Curino via asuresh)	2016-06-06 21:06:52 -07:00
Ming Ma	4a1cedc010	MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)	2016-06-06 14:30:51 -07:00
Arun Suresh	db54670e83	YARN-5165. Fix NoOvercommitPolicy to take advantage of RLE representation of plan. (Carlo Curino via asuresh)	2016-06-03 14:49:32 -07:00
Vinod Kumar Vavilapalli	f10ebc67f5	YARN-5098. Fixed ResourceManager's DelegationTokenRenewer to replace expiring system-tokens if RM stops and only restarts after a long time. Contributed by Jian He.	2016-06-03 13:00:07 -07:00
Jian He	99cc439e29	YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du	2016-06-03 11:10:42 -07:00
Jian He	097baaaeba	YARN-1815. Work preserving recovery of Unmanged AMs. Contributed by Subru Krishnan	2016-06-03 10:49:30 -07:00
Arun Suresh	dc26601d8f	YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)	2016-06-02 09:01:02 -07:00
Xuan	0bc05e40fa	YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong	2016-06-01 13:44:21 -07:00
Varun Vasudev	86fb58b7dc	YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana.	2016-05-29 21:32:51 +05:30
Varun Vasudev	42f90ab885	YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.	2016-05-29 21:24:16 +05:30
Arun Suresh	4fc09a897b	YARN-5117. QueuingContainerManager does not start GUARANTEED Container even if Resources are available. (Konstantinos Karanasos via asuresh)	2016-05-27 17:49:15 -07:00
Arun Suresh	aa975bc781	YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh)	2016-05-27 14:06:32 -07:00
Junping Du	705286ccae	YARN-4987. Read cache concurrency issue between read and evict in EntityGroupFS timeline store. Contributed by Li Lu.	2016-05-27 06:58:32 -07:00
Kai Zheng	916140604f	HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li	2016-05-28 14:23:39 +08:00
Rohith Sharma K S	0a544f8a3e	YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt.	2016-05-27 10:44:35 +05:30
Arun Suresh	5b41b288d0	YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh)	2016-05-26 14:56:37 -07:00
Karthik Kambatla	04ded558b0	YARN-5035. FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on. (kasha)	2016-05-26 14:41:07 -07:00
Karthik Kambatla	4f513a4a8e	YARN-4866. FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy. (Yufei Gu via kasha)	2016-05-25 22:13:27 -07:00
Carlo Curino	013532a95e	YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)	2016-05-25 16:55:49 -07:00
Jason Lowe	1ba31fe9e9	YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong	2016-05-25 21:24:55 +00:00
Robert Kanter	e07519b8db	YARN-4766. NM should not aggregate logs older than the retention policy (haibochen via rkanter)	2016-05-25 10:25:44 -07:00
Varun Vasudev	9a31e5dfef	YARN-5115. Avoid setting CONTENT-DISPOSITION header in the container-logs web-service. Contributed by Xuan Gong.	2016-05-25 19:01:12 +05:30
Varun Vasudev	c380a22031	YARN-857. Localization failures should be available in container diagnostics. Contributed by Vinod Kumar Vavilapalli.	2016-05-25 19:01:12 +05:30
Rohith Sharma K S	28bd63e92b	YARN-5024. TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure. Contributed by Bibin A Chundatt	2016-05-25 10:15:50 +05:30
Naganarasimha	edd716e99c	YARN-5114. Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8. Contributed by Bibin A Chundatt	2016-05-25 06:11:38 +08:00
Karthik Kambatla	f979d779e1	YARN-4878. Expose scheduling policy and max running apps over JMX for Yarn queues. (Yufei Gu via kasha)	2016-05-24 10:54:11 -07:00
Naganarasimha	b4078bd17b	YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (addendum patch). Contributed by Bibin A chundatt	2016-05-24 08:06:53 +08:00
Karthik Kambatla	6d043aa4cf	YARN-4979. FSAppAttempt demand calculation considers demands at multiple locality levels different. (Zhihai Xu via kasha)	2016-05-23 14:29:28 -07:00
Jason Lowe	ac954486c5	YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger	2016-05-23 15:54:42 +00:00
Jason Lowe	d1df0266cf	YARN-5103. With NM recovery enabled, restarting NM multiple times results in AM restart. Contributed by Junping Du	2016-05-23 15:15:27 +00:00
Junping Du	6161d9ba52	YARN-5112. Excessive log warnings for directory permission issue on NM recovery. Contributed by Jian He. ... (cherry picked from commit 867cd2f5a2e5966d6a7c5f5accb2fce78f9e7778)	2016-05-22 16:04:02 -07:00
Varun Vasudev	0287c49107	YARN-5016. Add support for a minimum retry interval for container retries. Contributed by Jun Gong.	2016-05-20 12:28:14 +05:30
Junping Du	22fcd819f0	YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron. ... (cherry picked from commit 2703ec68712279494d67b0d76b7ac10e7a1628be)	2016-05-19 14:15:21 -07:00
Jian He	feb90ffcca	YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong	2016-05-19 13:01:36 -07:00
Junping Du	141873ca7d	YARN-5100. The YarnApplicationState is always running in ATS even application is finished. Contributed by Xuan Gong.	2016-05-19 09:13:29 -07:00
Steve Loughran	22ff9e68d1	HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.	2016-05-19 14:48:18 +01:00
Akira Ajisaka	d4274c64bc	YARN-5107. TestContainerMetrics fails. (aajisaka)	2016-05-19 19:53:59 +09:00
Arun Suresh	1597630681	YARN-5110. Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds. (Konstantinos Karanasos via asuresh)	2016-05-18 18:46:00 -07:00
Arun Suresh	8a9ecb7584	YARN-5090. Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster. (asuresh)	2016-05-17 19:01:29 -07:00
Jian He	0c6726e20d	Addendum patch for YARN-4832. Contributed by Junping Du	2016-05-17 14:50:30 -07:00
Jian He	fa3bc3405d	YARN-4832. NM side resource value should get updated if change applied in RM side. Contributed by Junping Du	2016-05-17 12:52:19 -07:00
Arun Suresh	ccc93e7812	YARN-5075. Fix findbugs warnings in hadoop-yarn-common module. (asuresh)	2016-05-16 23:22:01 -07:00
Eric Payne	1217c8f6b4	YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger.	2016-05-16 20:28:04 +00:00
Jason Lowe	81effb7dcd	YARN-4325. Nodemanager log handlers fail to send finished/failed events in some cases. Contributed by Junping Du	2016-05-16 15:40:23 +00:00
Arun Suresh	f45bc5a83e	YARN-4738. Notify the RM about the status of OPPORTUNISTIC containers (Konstantinos Karanasos via asuresh)	2016-05-15 17:54:34 -07:00
Arun Suresh	f0ac18d001	YARN-2888. Corrective mechanisms for rebalancing NM container queues. (asuresh)	2016-05-13 13:38:36 -07:00
Andrew Wang	3c5c57af28	HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.	2016-05-12 18:27:28 -07:00
Andrew Wang	ca5613af91	Revert "Update project version to 3.0.0-alpha1-SNAPSHOT." ... This reverts commit 6b53802cba.	2016-05-12 15:32:45 -07:00
Jason Lowe	013000fbc2	YARN-5053. More informative diagnostics when applications killed by a user. Contributed by Eric Badger	2016-05-12 20:28:36 +00:00
Andrew Wang	6b53802cba	Update project version to 3.0.0-alpha1-SNAPSHOT.	2016-05-12 11:05:05 -07:00
Sangjin Lee	0bbe01f8d5	YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)	2016-05-12 10:11:23 -07:00
Rohith Sharma K S	b7ac85259c	YARN-5068. Expose scheduler queue to application master. (Harish Jaiprakash via rohithsharmaks)	2016-05-12 15:17:49 +05:30
Arun Suresh	d464f4d1c4	YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)	2016-05-11 19:10:17 -07:00
Karthik Kambatla	4b4e4c6ba8	YARN-4995. FairScheduler: Display per-queue demand on the scheduler page. (xupeng via kasha)	2016-05-11 17:36:21 -07:00
Junping Du	39f2bac38b	YARN-5029. RM needs to send update event with YarnApplicationState as Running to ATS/AHS. Contributed by Xuan Gong.	2016-05-11 09:28:35 -07:00
Arun Suresh	d971bf252f	YARN-5073. Refactor startContainerInternal() in ContainerManager to remove unused parameter. (Konstantinos Karanasos via asuresh)	2016-05-10 22:31:38 -07:00
Naganarasimha	2750fb900f	YARN-4926. Change nodelabel rest API invalid reponse status to 400. Contributed by Bibin A Chundatt	2016-05-08 22:49:25 +05:30
Yongjun Zhang	47c41e7ac7	YARN-5048. DelegationTokenRenewer#skipTokenRenewal may throw NPE (Jian He via Yongjun Zhang)	2016-05-06 21:50:09 -07:00
Jason Lowe	b2ed6ae731	YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena	2016-05-06 22:59:39 +00:00
Wangda Tan	23248f63aa	getApplicationReport call may raise NPE for removed queues. (Jian He via wangda)	2016-05-06 15:30:45 -07:00
Jian He	bb62e05925	YARN-4390. Do surgical preemption based on reserved container in CapacityScheduler. Contributed by Wangda Tan	2016-05-05 12:56:21 -07:00
Jason Lowe	d0da13229c	YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla	2016-05-05 14:07:54 +00:00
Varun Vasudev	72b047715c	YARN-4595. Add support for configurable read-only mounts when launching Docker containers. Contributed by Billie Rinaldi.	2016-05-05 13:01:54 +05:30
Wangda Tan	7bd418e48c	YARN-4984. LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak. (Junping Du via wangda)	2016-05-04 11:38:55 -07:00
Junping Du	e61d431275	YARN-4920. ATS/NM should support a link to dowload/get the logs in text format. Contributed by Xuan Gong.	2016-05-04 10:35:49 -07:00
Rohith Sharma K S	75e0450593	YARN-4947. Test timeout is happening for TestRMWebServicesNodes. Contributed by Bibin A Chundatt	2016-05-04 09:58:26 +05:30
Jason Lowe	ed54f5f1ff	YARN-5003. Add container resource to RM audit log. Contributed by Nathan Roberts	2016-05-03 20:03:41 +00:00
Junping Du	06413da72e	YARN-4851. Metric improvements for ATS v1.5 storage components. Li Lu via junping_du.	2016-05-03 04:16:21 -07:00
Robert Kanter	9d4d30243b	Remove parent's env vars from child processes	2016-04-29 09:25:51 -07:00
Varun Vasudev	0f25a1bb52	YARN-3998. Add support in the NodeManager to re-launch containers. Contributed by Jun Gong.	2016-04-29 16:09:07 +05:30
Jian He	4a8508501b	YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe	2016-04-28 21:54:11 -07:00
Jian He	dd80042c42	YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe	2016-04-28 21:27:25 -07:00
Li Lu	f16722d2ef	YARN-4956. findbug issue on LevelDBCacheTimelineStore. (Zhiyuan Yang via gtcarrera9)	2016-04-27 10:57:10 -07:00
Karthik Kambatla	185c3d4de1	YARN-4807. MockAM#waitForState sleep duration is too long. (Yufei Gu via kasha)	2016-04-27 09:43:23 -07:00
Jian He	4beff01354	YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode	2016-04-26 21:00:17 -07:00
Arun Suresh	341888a0aa	YARN-4412. Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers. (asuresh)	2016-04-26 20:12:12 -07:00
Karthik Kambatla	1a3f1482e2	YARN-4795. ContainerMetrics drops records. (Daniel Templeton via kasha)	2016-04-26 06:15:36 -07:00
Karthik Kambatla	4b1dcbbe0c	YARN-1297. FairScheduler: Move some logs to debug and check if debug logging is enabled	2016-04-26 05:10:09 -07:00
Arun Suresh	c282a08f38	YARN-2885. Create AMRMProxy request interceptor and ContainerAllocator to distribute OPPORTUNISTIC containers to appropriate Nodes (asuresh) ... (cherry picked from commit 2bf025278a318b0452fdc9ece4427b4c42124e39)	2016-04-24 22:38:33 -07:00
Jing Zhao	63e5412f1a	HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.	2016-04-22 15:14:40 -07:00
Wangda Tan	7cb3a3da96	YARN-4846. Fix random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers. (Bibin A Chundatt via wangda)	2016-04-22 11:40:32 -07:00
Eric Payne	3dce486d88	YARN-4556. TestFifoScheduler.testResourceOverCommit fails. Contributed by Akihiro Suda	2016-04-21 21:16:47 +00:00
Li Lu	7c6339f66a	YARN-4968. A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped. (Wangda Tan via gtcarrera9)	2016-04-21 13:25:33 -07:00
Karthik Kambatla	170c4fd4cd	YARN-4784. Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO. (Yufei Gu via kasha)	2016-04-20 23:58:12 -07:00
Wangda Tan	33fd95a99c	YARN-4890. Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate. (Sunil G via wangda)	2016-04-20 17:37:38 -07:00
Karthik Kambatla	c8172f5f14	YARN-2883. Queuing of container requests in the NM. (Konstantinos Karanasos and Arun Suresh via kasha)	2016-04-20 09:55:50 -07:00
Wangda Tan	fdc46bfb37	YARN-4934. Reserved Resource for QueueMetrics needs to be handled correctly in few cases. (Sunil G via wangda)	2016-04-16 22:47:41 -07:00
Jason Lowe	69f3d428d5	YARN-4940. yarn node -list -all failed if RM start with decommissioned node. Contributed by sandflee	2016-04-15 20:36:45 +00:00
Jason Lowe	3150ae8108	YARN-4924. NM recovery race can lead to container not cleaned up. Contributed by sandflee	2016-04-14 19:17:14 +00:00
Robert Kanter	0d9194df00	YARN-4541. Change log message in LocalizedResource#handle() to DEBUG (rchiang via rkanter)	2016-04-13 17:45:18 -07:00
Xuan	e0cb426758	YARN-4886. Add HDFS caller context for EntityGroupFSTimelineStore. Contributed by Li Lu	2016-04-13 10:38:17 -07:00
Naganarasimha	437e9d6475	YARN-4810. NM applicationpage cause internal error 500. Contributed by Bibin A Chundatt.	2016-04-12 17:59:46 +05:30
Vinod Kumar Vavilapalli	44bbc50d91	YARN-4168. Fixed a failing test TestLogAggregationService.testLocalFileDeletionOnDiskFull. Contributed by Takashi Ohnishi.	2016-04-11 12:11:14 -07:00
Jason Lowe	2a5da97f81	Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla" ... This reverts commit 1cbcd4a491.	2016-04-11 15:51:01 +00:00
Junping Du	08ddb3ac6d	YARN-4928. Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon. Contributed by Gergely Novák.	2016-04-11 08:48:32 -07:00
Akira Ajisaka	1ff27f9d12	YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.	2016-04-11 14:55:03 +09:00
Akira Ajisaka	1b78b2ba17	YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger.	2016-04-11 01:31:49 +09:00
Karthik Kambatla	ff95fd547b	YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha)	2016-04-09 10:31:02 -07:00
Wangda Tan	ec06957941	YARN-3215. Respect labels in CapacityScheduler when computing headroom. (Naganarasimha G R via wangda)	2016-04-08 15:33:04 -07:00
Jian He	9cb0c963d2	YARN-4740. AM may not receive the container complete msg when it restarts. Contributed by Jun Gong	2016-04-08 11:20:35 -07:00
Karthik Kambatla	e82f961a39	YARN-4756. Unnecessary wait in Node Status Updater during reboot. (Eric Badger via kasha)	2016-04-07 17:05:29 -07:00
Jian He	93bacda08b	YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev	2016-04-06 16:13:47 -07:00
Varun Vasudev	b41e65e5bc	YARN-4906. Capture container start/finish time in container metrics. Contributed by Jian He.	2016-04-06 13:41:33 +05:30
Wangda Tan	21eb428448	YARN-4699. Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node. (Sunil G via wangda)	2016-04-05 16:24:11 -07:00
Junping Du	0005816743	YARN-4916. TestNMProxy.tesNMProxyRPCRetry fails. Contributed by Tibor Kiss.	2016-04-05 09:01:08 -07:00
Junping Du	6be28bcc46	YARN-4893. Fix some intermittent test failures in TestRMAdminService. Contributed by Brahma Reddy Battula.	2016-04-05 06:57:54 -07:00
Jason Lowe	1cbcd4a491	YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla	2016-04-05 13:40:19 +00:00
Rohith Sharma K S	776b549e2a	YARN-4609. RM Nodes list page takes too much time to load. Contributed by Bibin A Chundatt	2016-04-05 14:47:25 +05:30
Rohith Sharma K S	552237d4a3	YARN-4880. Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE. Contributed by Sunil G	2016-04-05 14:26:19 +05:30
naganarasimha	5092c94195	YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt	2016-04-04 16:25:03 +05:30
Rohith Sharma K S	1e6f92977d	YARN-4607. Pagination support for AppAttempt page TotalOutstandingResource Requests table. Contributed by Bibin A Chundatt	2016-04-04 08:09:29 +05:30
Wangda Tan	12b11e2e68	YARN-4634. Scheduler UI/Metrics need to consider cases like non-queue label mappings. (Sunil G via wangda)	2016-03-31 14:35:18 -07:00
Jian He	0dd9bcab97	YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage	2016-03-31 14:28:13 -07:00
Robert Kanter	7a021471c3	YARN-4639. Remove dead code in TestDelegationTokenRenewer added in YARN-3055 (templedf via rkanter)	2016-03-31 13:09:09 -07:00
Allen Wittenauer	0a74610d1c	HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw)	2016-03-31 07:51:05 -07:00
Jian He	60e4116bf1	YARN-4822. Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates. Contributed by Wangda Tan	2016-03-30 12:43:52 -07:00
Wangda Tan	fc055a3cbe	YARN-4865. Track Reserved resources in ResourceUsage and QueueCapacities. (Sunil G via wangda)	2016-03-29 17:07:55 -07:00
Xuan	80182809ae	YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du	2016-03-28 22:17:45 -07:00
Jason Lowe	948b758070	YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong	2016-03-28 23:00:56 +00:00
Jian He	524bc3c33a	YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du	2016-03-28 11:12:33 -07:00
Jian He	55ae143923	YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola	2016-03-27 20:22:12 -07:00
Karthik Kambatla	49ff54c860	YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha)	2016-03-26 21:45:13 -07:00
Arun Suresh	00bebb7e58	YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh)	2016-03-25 15:54:38 -07:00
Arun Suresh	d82e797b65	YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh)	2016-03-24 09:59:55 -07:00
Allen Wittenauer	b1394d6307	YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw)	2016-03-24 08:15:58 -07:00
Junping Du	19b645c938	YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.	2016-03-23 19:34:30 -07:00
Eric Payne	92b7e0d413	YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger.	2016-03-18 16:12:47 +00:00
Junping Du	ca8106d2dd	YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API.	2016-03-17 09:04:41 -07:00
Karthik Kambatla	f84af8bd58	YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha)	2016-03-17 05:54:06 -07:00
Wangda Tan	ae14e5d07f	YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan) ... (cherry picked from commit 7e8c9beb41)	2016-03-16 17:02:33 -07:00
Wangda Tan	fa7a43529d	Revert "CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)" ... This reverts commit 7e8c9beb41.	2016-03-16 17:02:10 -07:00
Wangda Tan	7e8c9beb41	CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)	2016-03-16 16:59:59 -07:00
Karthik Kambatla	3ef5500783	YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha)	2016-03-15 23:45:01 -07:00
Robert Kanter	22ca176dfe	TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)	2016-03-15 10:05:10 -07:00
Karthik Kambatla	20d389ce61	YARN-4719. Add a helper library to maintain node state and allows common queries. (kasha)	2016-03-14 14:19:05 -07:00
Junping Du	f291d82cd4	YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du	2016-03-14 08:28:38 -07:00
Li Lu	017d2c127b	YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. ... This commit amends commit d49cfb3504 with a missed test file.	2016-03-10 13:02:28 -08:00
Li Lu	d49cfb3504	YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)	2016-03-10 10:51:55 -08:00
Wangda Tan	0233d4e0ee	YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda)	2016-03-08 14:27:03 -08:00
Jian He	3c33158d1c	YARN-4764. Application submission fails when submitted queue is not available in scheduler xml. Contributed by Bibin A Chundatt	2016-03-08 13:07:57 -08:00
Vinod Kumar Vavilapalli	b2661765a5	YARN-4762. Fixed CgroupHandler's creation and usage to avoid NodeManagers crashing when LinuxContainerExecutor is enabled. (Sidharta Seethana via vinodkv)	2016-03-07 11:08:17 -08:00
Jason Lowe	4163e36c2b	YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger	2016-03-07 15:56:33 +00:00
Jason Lowe	059caf9989	YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana	2016-03-07 15:40:01 +00:00
Varun Vasudev	8ed2e060e8	YARN-4245. Generalize config file handling in container-executor. Contributed by Sidharta Seethana.	2016-03-07 16:18:35 +05:30
Varun Vasudev	e51a8c1056	YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.	2016-03-07 15:26:44 +05:30
Zhihai Xu	e1ccc9622b	YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee	2016-03-06 19:46:09 -08:00
Rohith Sharma K S	19ee185907	YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks)	2016-03-05 13:02:57 +05:30
Jian He	5c465df904	YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding	2016-03-01 13:14:12 -08:00
Jian He	d93c22ec27	YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu	2016-02-29 18:19:09 -08:00
Karthik Kambatla	9dafaaaf0d	YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha)	2016-02-29 16:10:12 -08:00
Haohui Mai	0fa54d45b1	HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.	2016-02-29 11:41:00 -08:00
Jason Lowe	c58a6d53c5	YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe	2016-02-29 15:24:35 +00:00
Rohith Sharma K S	e0b14f26f5	YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks)	2016-02-29 10:38:14 +08:00
Karthik Kambatla	f9692770a5	YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha)	2016-02-28 09:35:59 -08:00
Jason Lowe	6b0f813e89	YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla	2016-02-26 20:24:50 +00:00
Ming Ma	7f3139e54d	YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma)	2016-02-26 08:40:05 -08:00
Robert Kanter	d7fdec1e6b	YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)	2016-02-25 16:36:38 -08:00
Karthik Kambatla	c684f2b007	YARN-4729. SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE. (kasha)	2016-02-24 18:33:57 -08:00
Robert Kanter	954dd57043	YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)	2016-02-24 15:00:24 -08:00
Sangjin Lee	553b591ba0	YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)	2016-02-24 09:29:41 -08:00
Jason Lowe	d284e187b8	YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma	2016-02-23 20:49:09 +00:00
Junping Du	9ed17f181d	YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou.	2016-02-23 03:30:26 -08:00
Tsuyoshi Ozawa	0e12114c9c	YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki.	2016-02-23 19:50:08 +09:00
Varun Vasudev	140cb5d745	YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.	2016-02-23 12:29:25 +05:30
Junping Du	3fab88540f	YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla.	2016-02-22 07:04:19 -08:00
Sangjin Lee	7de70680fe	YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee)	2016-02-17 20:55:21 -08:00
Karthik Kambatla	2ab4c476ed	YARN-4689. FairScheduler: Cleanup preemptContainer to be more readable. (Kai Sasaki via kasha)	2016-02-17 18:16:15 -08:00
Arun Suresh	23f937e3b7	YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)	2016-02-11 10:47:43 -08:00
Varun Vasudev	fa00d3e205	YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.	2016-02-11 12:06:42 +05:30
Jian He	d16b17b4d2	YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding	2016-02-11 10:06:27 +08:00
=	b706cbc1bc	YARN-4420. Add REST API for List Reservations (Sean Po via curino)	2016-02-10 10:19:26 -08:00
Arun Suresh	5cf5c41a89	YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh)	2016-02-10 09:11:15 -08:00
Devaraj K	565af873d5	YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing ... is configured. Contributed by Naganarasimha G R.	2016-02-08 15:01:54 +05:30
Varun Vasudev	22a2b2231d	YARN-4669. Fix logging statements in resource manager's Application class. Contributed by Sidharta Seethana.	2016-02-04 13:51:25 +05:30
Varun Vasudev	308d63f382	YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.	2016-02-04 13:32:54 +05:30
Jason Lowe	fa328e2d39	YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe	2016-02-03 17:21:12 +00:00
Varun Vasudev	1adb64e09b	YARN-4625. Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent. Contributed by Xuan Gong.	2016-02-03 16:26:28 +05:30
Varun Vasudev	1cd55e0c17	YARN-4649. Add additional logging to some NM state store operations. Contributed by Sidharta Seethana	2016-02-02 09:25:23 +05:30
Wangda Tan	9875325d5c	YARN-4340. Add list API to reservation system. (Sean Po via wangda)	2016-02-02 10:17:33 +08:00
Jason Lowe	ed55950164	YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla	2016-02-01 23:15:26 +00:00
Rohith Sharma K S	2673cbaf55	YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks)	2016-02-01 10:43:56 +05:30
Jason Lowe	772ea7b41b	YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li	2016-01-29 21:48:54 +00:00
Jian He	f4a57d4a53	YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S	2016-01-29 12:22:23 -08:00
Karthik Kambatla	c9a09d6926	YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha)	2016-01-29 08:12:54 -08:00
Devaraj K	a277bdc9ed	YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws ... IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.	2016-01-29 13:51:37 +05:30
Rohith Sharma K S	ac68666803	YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks)	2016-01-29 12:29:54 +05:30
Rohith Sharma K S	09d831c95b	YARN-4219. addendum patch to fix javadoc errors	2016-01-29 11:51:47 +05:30
Jian He	7f46636495	YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding	2016-01-28 14:51:00 -08:00
Xuan	9fab22b366	YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by ... Li Lu	2016-01-28 14:24:22 -08:00
Jason Lowe	61382ff8fa	YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana	2016-01-28 18:59:35 +00:00
Rohith Sharma K S	ef343be82b	YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks)	2016-01-28 21:53:45 +05:30
Karthik Kambatla	fb238d7e5d	YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha)	2016-01-27 12:29:06 -08:00
Rohith Sharma K S	c01bee0108	YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)	2016-01-27 08:23:02 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	2085e60a96	YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev.	2016-01-25 16:19:36 -08:00
Jian He	992dd2f783	YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee	2016-01-25 15:36:14 -08:00
rohithsharmaks	10dc2c0493	YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks)	2016-01-24 23:36:15 +05:30
rohithsharmaks	99829eb221	YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks)	2016-01-23 07:56:57 +05:30
Xuan	618bfd6ac2	YARN-4496. Improve HA ResourceManager Failover detection on the client. ... Contributed by Jian He	2016-01-22 18:20:38 -08:00
Jason Lowe	46e5ea81e0	YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen	2016-01-22 21:55:01 +00:00
rohithsharmaks	d6258b33a7	YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks)	2016-01-22 20:27:38 +05:30
Akira Ajisaka	8f58f742ae	YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.	2016-01-22 19:43:06 +09:00
Varun Vasudev	b41a7e89d1	YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana.	2016-01-22 14:43:14 +05:30
Rohith Sharma K S	e30668106d	YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks)	2016-01-22 10:14:46 +05:30
Jason Lowe	468a53b22f	YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe	2016-01-21 18:31:29 +00:00
Karthik Kambatla	4992398aee	YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha)	2016-01-21 17:40:59 +01:00
Wangda Tan	5ff5f67332	YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda)	2016-01-21 11:21:06 +08:00
Xuan	890a2ebd1a	YARN-4559. Make leader elector and zk store share the same curator ... client. Contributed by Jian He	2016-01-20 14:48:10 -08:00
Wangda Tan	89d1fd5dac	HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)	2016-01-19 21:27:38 +08:00
Jian He	edc43a9097	YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan	2016-01-18 21:04:36 -08:00
Wangda Tan	a44ce3f14f	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)	2016-01-19 09:30:04 +08:00
Wangda Tan	150f5ae034	Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" ... This reverts commit 3fe5728563. Conflicts: hadoop-yarn-project/CHANGES.txt	2016-01-19 09:27:36 +08:00
Jian He	f385851141	YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu	2016-01-18 16:58:39 -08:00
Karthik Kambatla	d40859fab1	YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)	2016-01-18 10:58:14 +01:00
Wangda Tan	3fe5728563	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) ... (cherry picked from commit 805a9ed85e)	2016-01-18 17:06:05 +08:00
Wangda Tan	adf260a728	Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" ... This reverts commit 805a9ed85e.	2016-01-18 16:50:45 +08:00
Wangda Tan	b08ecf5c75	YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda)	2016-01-18 11:11:32 +08:00
Wangda Tan	805a9ed85e	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)	2016-01-18 11:04:25 +08:00
Wangda Tan	9523648d57	YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda)	2016-01-18 10:57:14 +08:00
Junping Du	02f597c5db	YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe	2016-01-17 17:37:40 -08:00
Colin Patrick Mccabe	b2c155f810	HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)	2016-01-15 12:29:18 -08:00
Junping Du	fc6d3a3b23	YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee.	2016-01-15 08:40:56 -08:00
rohithsharmaks	f7736f464f	YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks)	2016-01-15 21:38:26 +05:30
Colin Patrick Mccabe	b1ed28fa77	HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)	2016-01-14 11:02:34 -08:00
Karthik Kambatla	9d04f26d4c	YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha)	2016-01-14 08:33:23 -08:00
Varun Vasudev	3ddb92bd30	YARN-4553. Add cgroups support for docker containers. Contributed by Sidharta Seethana.	2016-01-14 14:29:29 +05:30
Karthik Kambatla	321072ba81	YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha)	2016-01-13 12:09:34 -08:00
Wangda Tan	c0537bcd2c	YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)	2016-01-13 13:18:31 +08:00
Jason Lowe	13de8359a1	YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li	2016-01-12 15:56:15 +00:00
Akira Ajisaka	da1e3e3c57	YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67.	2016-01-12 15:12:17 +09:00
Wangda Tan	9e792da014	YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)	2016-01-12 12:53:31 +08:00
Jian He	5fab4ec31c	Missing file for YARN-4580	2016-01-11 17:00:44 -08:00
Jian He	b8942be888	YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S	2016-01-11 16:44:28 -08:00
Jian He	109e528ef5	YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S	2016-01-08 15:51:10 -08:00
Xuan	89022f8d4b	YARN-4438. Implement RM leader election with curator. Contributed by Jian He	2016-01-07 14:33:06 -08:00
Akira Ajisaka	52b77577c4	YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi.	2016-01-08 01:12:46 +09:00
Steve Loughran	07d1cb612c	YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel)	2016-01-07 14:30:20 +00:00
rohithsharmaks	791c1639ae	YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)	2016-01-07 09:38:47 +05:30
Junping Du	c1462a67ff	YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe.	2016-01-06 05:49:24 -08:00
rohithsharmaks	6da6d87872	YARN-4535. Fix checkstyle error in CapacityScheduler.java (Naganarasimha G R via rohithsharmaks)	2016-01-05 12:09:57 +05:30
Rohith Sharma K S	f9e36dea96	YARN-4530. LocalizedResource trigger a NPE Cause the NodeManager exit. (tangshangwen via rohithsharmaks)	2016-01-04 09:58:13 +05:30
Wangda Tan	4e4b3a8465	YARN-4524. Cleanup AppSchedulingInfo. (Karthik Kambatla via wangda) ... (cherry picked from commit 05fa852d7567b7590d6b53bbf925f8f424736514)	2015-12-30 15:39:34 -08:00
Wangda Tan	8310b2e9ff	YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)	2015-12-30 15:30:12 -08:00
Junping Du	223ce323bb	YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S.	2015-12-30 07:52:07 -08:00
Jian He	5273413411	YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong	2015-12-29 15:58:39 -08:00
Wangda Tan	561abb9fee	YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda)	2015-12-29 13:28:00 -08:00
Jian He	d0a22bae9b	YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan	2015-12-28 15:52:45 -08:00
Gera Shegalov	2c17b81569	YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)	2015-12-24 23:48:05 -08:00
Karthik Kambatla	0af492b4bd	YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha)	2015-12-23 17:52:36 -08:00
Junping Du	882f2f0464	YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.	2015-12-23 05:26:51 -08:00
rohithsharmaks	8c180a13c8	YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks)	2015-12-23 09:12:32 +05:30
Arun Suresh	e88422df45	YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh)	2015-12-21 22:41:09 -08:00
Wangda Tan	bc038b382c	YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)	2015-12-21 11:30:13 -08:00
Uma Mahesh	0f82b5d878	YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh)	2015-12-19 23:10:13 -08:00
Jian He	85c2466048	YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S	2015-12-18 14:13:48 -08:00
Junping Du	1de56b0448	YARN-3226. UI changes for decommissioning node. Contributed by Sunil G.	2015-12-17 15:20:17 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	4e7d32c0db	YARN-1856. Added cgroups based memory monitoring for containers as another alternative to custom memory-monitoring. Contributed by Varun Vasudev.	2015-12-17 12:13:03 -08:00
Jason Lowe	91828fef6b	YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne	2015-12-16 23:22:31 +00:00
Wangda Tan	9b856d9787	YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda)	2015-12-16 13:22:37 -08:00
Wangda Tan	7faa406f27	YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)	2015-12-16 13:19:40 -08:00
Wangda Tan	79c41b1d83	YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)	2015-12-16 13:18:19 -08:00
Junping Du	50bd067e1d	YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.	2015-12-16 10:57:39 -08:00
Zhihai Xu	2aaed10327	YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun	2015-12-15 00:17:21 -08:00
Xuan	d8a45425eb	YARN-4439. Clarify NMContainerStatus#toString method. Contributed by ... Jian He	2015-12-14 15:41:28 -08:00
Jian He	915cd6c3f4	YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula	2015-12-14 14:59:01 -08:00
Jian He	1cb3299b48	YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du	2015-12-14 13:51:23 -08:00
Wangda Tan	07b0fb996a	YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda)	2015-12-14 11:24:30 -08:00
Wangda Tan	dfcbbddb09	YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)	2015-12-14 11:13:22 -08:00
Wangda Tan	6cb0af3c39	YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda)	2015-12-14 10:52:46 -08:00
Arun Suresh	7fb212e5e6	YARN-4358 addendum patch to fix javadoc error	2015-12-12 22:22:55 -08:00
rohithsharmaks	a5e2e1ecb0	YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks)	2015-12-09 11:31:51 +05:30
rohithsharmaks	15c3e7ffe3	YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks)	2015-12-09 10:50:43 +05:30
Wangda Tan	7e4715186d	YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)	2015-12-08 14:25:16 -08:00
Chris Douglas	9f50e13d5d	YARN-4248. Followup patch adding asf-licence exclusions for json test files	2015-12-08 12:08:04 -08:00
=	c25a635459	YARN-4248. REST API for submit/update/delete Reservations. (curino)	2015-12-07 13:33:28 -08:00
Jonathan Eagles	4ff973f96a	YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)	2015-12-07 15:04:48 -06:00
Xuan	4546c7582b	YARN-4392. ApplicationCreatedEvent event time resets after RM ... restart/failover. Contributed by Naganarasimha G R and Xuan Gong	2015-12-07 12:24:55 -08:00
rohithsharmaks	01a641bc44	YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)	2015-12-07 15:16:56 +05:30
Steve Loughran	65f395226b	HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]	2015-12-06 17:43:35 +00:00
Arun Suresh	742632e346	YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh)	2015-12-05 21:26:16 -08:00
Jian He	755dda8dd8	YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan	2015-12-03 17:45:31 -08:00
Wangda Tan	a2c3bfc8c1	YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda)	2015-12-03 14:28:32 -08:00
Jian He	9f77ccad73	YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena	2015-12-03 12:48:50 -08:00
Junping Du	62e9348bc1	YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter.	2015-12-03 06:36:37 -08:00
Jian He	6b9a5beb2b	YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding	2015-12-02 11:07:18 -08:00
Tsuyoshi Ozawa	0656d2dc83	YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena.	2015-11-26 01:10:02 +09:00
Jason Lowe	4ac6799d4a	YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li	2015-11-24 22:35:37 +00:00
Tsuyoshi Ozawa	28dfe721b8	YARN-4387. Fix typo in FairScheduler log message. Contributed by Xin Wang.	2015-11-24 19:24:01 +09:00
Karthik Kambatla	52948bb20b	YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)	2015-11-24 13:47:17 +05:30
Jian He	8676a118a1	YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan	2015-11-23 17:19:48 -08:00
Jason Lowe	d36b6e045f	YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev	2015-11-23 20:30:26 +00:00
Arun Suresh	da1016365a	YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)	2015-11-21 09:59:41 -08:00
Wangda Tan	2346fa3141	YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)	2015-11-20 15:55:50 -08:00
Jason Lowe	060cdcbe5d	YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li	2015-11-20 23:12:29 +00:00
Xuan	f114e728da	YARN-2859.addendum: fix the remaining issue from the previous patch	2015-11-19 10:08:38 -08:00
Arun Suresh	6a61928fb7	YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)	2015-11-17 15:50:34 -08:00
Jian He	fcd7888029	Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan" ... This reverts commit 8fbea531d7. Conflicts: hadoop-yarn-project/CHANGES.txt	2015-11-16 20:18:44 -08:00
Junping Du	855d52927b	YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.	2015-11-15 04:43:57 -08:00
Wangda Tan	7f55a18071	YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)	2015-11-12 11:23:40 -08:00
Wangda Tan	796638d9bc	YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)	2015-11-12 11:09:37 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	6351d3fa63	YARN-4183. Reverting the patch to fix behaviour change. ... Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)" This reverts commit c293c58954.	2015-11-11 10:40:43 -08:00
Jian He	8fbea531d7	YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan	2015-11-09 10:43:45 -08:00
Tsuyoshi Ozawa	ce31b22739	YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.	2015-10-30 18:00:20 +09:00
Jian He	e5b1733e04	YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena	2015-10-29 15:42:57 -07:00
Jonathan Eagles	c293c58954	YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)	2015-10-29 16:41:10 -05:00
Arun Suresh	58d1df585c	YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh)	2015-10-29 13:42:09 -07:00
Jason Lowe	e2267de207	YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena	2015-10-29 16:34:25 +00:00
Rohith Sharma K S	656c8f9527	YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks)	2015-10-29 12:22:44 +05:30
Xuan	27414dac66	YARN-2859. ApplicationHistoryServer binds to default port 8188 in ... MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli	2015-10-28 10:32:16 -07:00
Tsuyoshi Ozawa	96677bef00	YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.	2015-10-27 12:35:01 +09:00
Akira Ajisaka	8a68630dd1	YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka)	2015-10-27 10:28:01 +09:00
Wangda Tan	56e4f6237a	YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda)	2015-10-26 16:44:39 -07:00
Wangda Tan	6f606214e7	YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)	2015-10-26 16:36:34 -07:00
Wangda Tan	3cc73773eb	YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)	2015-10-26 13:07:39 -07:00
Jason Lowe	33a03af3c3	YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee	2015-10-26 19:53:03 +00:00
Rohith Sharma K S	5acdde4744	YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)	2015-10-26 15:42:42 +05:30
Tsuyoshi Ozawa	ce60b4fc8b	YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula.	2015-10-26 16:45:11 +09:00
Allen Wittenauer	1aa735c188	YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw)	2015-10-25 21:43:23 -07:00
Arun Suresh	ab8eb8770c	YARN-3738. Add support for recovery of reserved apps running under dynamic queues (subru via asuresh)	2015-10-24 22:53:10 -07:00
Akira Ajisaka	7781fe1b9e	YARN-4294. [JDK8] Fix javadoc errors caused by wrong reference and illegal tag. (aajisaka)	2015-10-24 11:54:42 +09:00
Jason Lowe	d3a34a4f38	YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G	2015-10-23 20:57:01 +00:00
Ming Ma	934d96a334	YARN-2913. Fair scheduler should have ability to set MaxResourceDefault for each queue. (Siqi Li via mingma)	2015-10-23 08:36:33 -07:00
Jonathan Eagles	f8adeb712d	YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)	2015-10-23 10:34:08 -05:00
Junping Du	0fce5f9a49	YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.	2015-10-22 13:41:09 -07:00
Zhihai Xu	960201b79b	YARN-4256. YARN fair scheduler vcores with decimal values. Contributed by Jun Gong	2015-10-22 12:28:03 -07:00
Anubhav Dhoot	2798723a54	YARN-3739. Add reservation system recovery to RM recovery process. Contributed by Subru Krishnan.	2015-10-22 06:51:00 -07:00
Jonathan Eagles	25f8f801d1	YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)	2015-10-21 15:38:08 -05:00
Arun Suresh	506d1b1dbc	YARN-3985. Make ReservationSystem persist state using RMStateStore reservation APIs. (adhoot via asuresh)	2015-10-20 16:46:14 -07:00
Arun Suresh	7e2837f830	YARN-4270. Limit application resource reservation on nodes for non-node/rack specific requests (asuresh)	2015-10-19 20:00:38 -07:00
Varun Vasudev	151eab2a12	YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana.	2015-10-19 20:56:01 +05:30
Varun Vasudev	e39ae0e676	YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.	2015-10-19 20:19:22 +05:30
Steve Loughran	e2d59e2c7b	YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel)	2015-10-18 12:03:57 +01:00
Jian He	f9da5cdb2b	YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G	2015-10-16 15:26:27 -07:00
Wangda Tan	4337b263aa	YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda)	2015-10-16 15:06:28 -07:00
Jian He	cf23f2c2b5	YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena	2015-10-15 17:12:46 -07:00
Varun Vasudev	63020c54c1	YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana.	2015-10-15 13:41:20 +05:30
Steve Loughran	dfa7848463	HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)	2015-10-14 20:25:47 +01:00
rohithsharmaks	d6c8bad869	YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks)	2015-10-14 16:11:34 +05:30
Varun Vasudev	da1ee078f9	YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana.	2015-10-14 15:25:21 +05:30
Varun Vasudev	fb9c1519b3	YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana.	2015-10-14 15:18:08 +05:30
Varun Vasudev	8d59293089	YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana.	2015-10-14 14:58:10 +05:30
Steve Loughran	c59af2fdf8	HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)	2015-10-13 21:49:28 +01:00
Varun Vasudev	5b6bae0094	YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana	2015-10-13 12:48:30 +05:30
Jian He	9849c8b386	YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding	2015-10-12 11:51:33 -07:00
Zhihai Xu	049c6e8dc0	YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong.	2015-10-12 00:14:25 -07:00
Devaraj K	db93047881	YARN-3964. Support NodeLabelsProvider at Resource Manager side. ... Contributed by Dian Fu.	2015-10-11 11:21:29 +05:30
Wangda Tan	def374e666	YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda)	2015-10-09 16:38:59 -07:00
Karthik Kambatla	4aa9b3e75c	MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)	2015-10-09 07:37:39 -07:00
Jason Lowe	a0bca2b5ad	YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S	2015-10-09 14:17:38 +00:00
Rohith Sharma K S	8f195387a4	YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks)	2015-10-09 10:09:26 +05:30
Jason Lowe	8d226225d0	YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu	2015-10-08 22:25:34 +00:00
Rohith Sharma K S	3793cbe4c3	YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks)	2015-10-07 10:12:14 +05:30
Rohith Sharma K S	9156fc60c6	YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks)	2015-10-07 09:34:59 +05:30
Wangda Tan	29a582ada0	YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda)	2015-10-06 11:56:04 -07:00
Wangda Tan	30ac69c6bd	YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda)	2015-10-05 15:47:21 -07:00
Vinod Kumar Vavilapalli	f1c19b9365	HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan.	2015-10-05 10:56:55 -07:00
Harsh J	c918f7be5e	HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.	2015-10-03 18:37:58 +05:30
Xuan	8f08532bde	YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma	2015-10-02 18:50:47 -07:00
Jason Lowe	fdf02d1f26	YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu	2015-10-02 20:20:31 +00:00
Jason Lowe	854d25b0c3	YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu	2015-09-30 14:59:44 +00:00
Karthik Kambatla	a0b5a0a419	YARN-4066. Large number of queues choke fair scheduler. (Johan Gustavsson via kasha)	2015-09-29 07:55:34 -07:00
Anubhav Dhoot	9735afe967	YARN-4180. AMLauncher does not retry on failures when talking to NM. (adhoot)	2015-09-28 16:13:41 -07:00
Jason Lowe	9f53a95ff6	YARN-4141. Runtime Application Priority change should not throw exception for applications at finishing states. Contributed by Sunil G	2015-09-28 22:55:20 +00:00
Anubhav Dhoot	fb2e525c07	YARN-4204. ConcurrentModificationException in FairSchedulerQueueInfo. (adhoot)	2015-09-28 09:05:45 -07:00
Xuan	d1b9b85244	YARN-3624. ApplicationHistoryServer should not reverse the order of the ... filters it gets. Contributed by Mit Desai	2015-09-24 15:01:17 -07:00
Rohith Sharma K S	a9aafad12b	YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks)	2015-09-24 12:13:22 +05:30
Rohith Sharma K S	8ed0d4b744	YARN-4152. NodeManager crash with NPE when LogAggregationService#stopContainer called for absent container. (Bibin A Chundatt via rohithsharmaks)	2015-09-24 11:24:14 +05:30
Jian He	b3f6b641dc	YARN-4171. Fix findbugs warnings in YARN-1197 branch. Contributed by Wangda Tan	2015-09-23 13:29:38 -07:00
Jian He	89cab1ba5f	YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan	2015-09-23 13:29:38 -07:00
Jian He	c57eac5dfe	YARN-3868. Recovery support for container resizing. Contributed by Meng Ding	2015-09-23 13:29:38 -07:00
Jian He	c3dc1af072	YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding	2015-09-23 13:29:37 -07:00
Jian He	c59ae4eeb1	YARN-1643. Make ContainersMonitor support changing monitoring size of an allocated container. Contributed by Meng Ding and Wangda Tan	2015-09-23 13:29:37 -07:00
Jian He	5f5a968d65	YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding	2015-09-23 13:29:37 -07:00
Jian He	ffd820c27a	YARN-1645. ContainerManager implementation to support container resizing. Contributed by Meng Ding & Wangda Tan	2015-09-23 13:29:37 -07:00
Jian He	83a18add10	YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)	2015-09-23 13:29:36 -07:00
Jason Lowe	692d51c09d	YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai	2015-09-23 16:38:55 +00:00
Jason Lowe	c890c51a91	YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu	2015-09-23 15:42:01 +00:00
Tsuyoshi Ozawa	dfd807afab	HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.	2015-09-22 12:54:29 +09:00
Rohith Sharma K S	c9cb6a5960	YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks)	2015-09-21 09:59:30 +05:30
Arun Suresh	94dec5a916	YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh)	2015-09-18 14:02:55 -07:00
Wangda Tan	9bc913a35c	YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda)	2015-09-18 10:04:17 -07:00
Steve Loughran	a7201d635f	YARN-2597 MiniYARNCluster should propagate reason for AHS not starting	2015-09-18 09:45:35 +01:00
Rohith Sharma K S	723c31d45b	YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks)	2015-09-18 08:44:10 +05:30
Jian He	6c6e734f0b	YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S	2015-09-17 14:55:50 +08:00
Jian He	452079af8b	YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R	2015-09-16 14:59:20 +08:00
Xuan	34ef1a092b	YARN-4149. yarn logs -am should provide an option to fetch all the log ... files. Contributed by Varun Vasudev	2015-09-15 14:36:30 -07:00
Jason Lowe	8c1cdb17a0	YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu	2015-09-15 20:21:33 +00:00
Wangda Tan	ae5308fe1d	YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)	2015-09-15 11:40:50 -07:00
Junping Du	73e3a49eb0	YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)	2015-09-15 07:56:47 -07:00
Jian He	5468baa80a	YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan	2015-09-15 15:39:20 +08:00
Wangda Tan	e2a0270217	YARN-4151. Fix findbugs errors in hadoop-yarn-server-common module. (Meng Ding via wangda)	2015-09-14 16:00:43 -07:00
Jian He	e1b1d7e4ae	YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt	2015-09-14 14:09:19 +08:00
Karthik Kambatla	332b520a48	YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)	2015-09-13 18:07:43 -07:00
Karthik Kambatla	81df7b586a	YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)	2015-09-13 17:03:15 -07:00
Steve Loughran	7269906254	HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).	2015-09-13 14:25:26 +01:00
Robert Kanter	ea4bb2749f	YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter)	2015-09-11 11:46:10 -07:00
Varun Vasudev	486d5cb803	YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt.	2015-09-11 14:37:48 +05:30
Wangda Tan	77666105b4	YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda)	2015-09-10 09:30:09 -07:00
Zhihai Xu	16b9037dc1	YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe.	2015-09-08 12:29:54 -07:00
Jian He	6f72f1e600	YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil	2015-09-08 09:35:46 +08:00
Xuan	9b78e6e33d	YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when ... state-store error occurs. Contributed by Jian He	2015-09-07 17:45:47 -07:00
Varun Vasudev	1dbd8e34a7	YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir.	2015-09-07 11:32:12 +05:30
Wangda Tan	bcc85e3bab	YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)	2015-09-04 15:13:53 -07:00
Jason Lowe	6eaca2e363	YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li	2015-09-04 15:30:53 +00:00
Varun Vasudev	40d222e862	YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.	2015-09-04 14:31:51 +05:30
Varun Vasudev	b469ac531a	YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R.	2015-09-03 16:40:10 +05:30
Jian He	09c64ba1ba	YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong	2015-09-02 17:45:23 -07:00
Rohith Sharma K S	7d6687fe76	YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)	2015-09-02 15:22:48 +05:30