3659 Commits

Author	SHA1	Message	Date
Jason Lowe	c017171da0	HADOOP-13770. Shell.checkIsBashSupported swallowed an interrupted exception. Contributed by Wei-Chiu Chuang	2016-10-28 14:57:50 +00:00
Karthik Kambatla	4df8ed63ed	YARN-4743. FairSharePolicy breaks TimSort assumption. (Zephyr Guo and Yufei Gu via kasha)	2016-10-27 17:45:48 -07:00
Subru Krishnan	b2c4f24c31	YARN-2306. Add test for leakage of reservation metrics in fair scheduler. (Hong Zhiguo and Yufei Gu via subru).	2016-10-27 17:43:13 -07:00
Robert Kanter	5877f20f9c	HADOOP-10075. Update jetty dependency to version 9 (rkanter)	2016-10-27 16:09:00 -07:00
Vrushali Channapattan	022bf783aa	YARN-4765 Split TestHBaseTimelineStorage into multiple test classes (Varun Saxena via Vrushali C) ... (cherry picked from commit 513dcf6817dd76fde8096ff04cd888d7c908461d)	2016-10-27 15:37:36 -07:00
Carlo Curino	892a8348fc	YARN-3432. Cluster metrics have wrong Total Memory when there is reserved memory on CS. (Brahma Reddy Battula via curino)	2016-10-27 15:15:49 -07:00
Subru Krishnan	79ae78dcbe	YARN-3568. TestAMRMTokens should use some random port. (Takashi Ohnishi via Subru).	2016-10-27 15:11:12 -07:00
Daniel Templeton	b98fc8249f	YARN-4710. Reduce logging application reserved debug info in FSAppAttempt#assignContainer (Contributed by Yiqun Lin via Daniel Templeton)	2016-10-27 14:42:19 -07:00
Robert Kanter	9449519a25	YARN-5776. Checkstyle: MonitoringThread.Run method length is too long (miklos.szegedi@cloudera.com via rkanter)	2016-10-27 14:36:38 -07:00
Jason Lowe	7e3c327d31	YARN-4831. Recovered containers will be killed after NM stateful restart. Contributed by Siqi Li	2016-10-27 20:42:52 +00:00
Robert Kanter	6fbfb501f2	YARN-4456. Clean up Lint warnings in nodemanager (templedf via rkanter)	2016-10-27 12:37:01 -07:00
Varun Saxena	79aeddc88f	YARN-5308. FairScheduler: Move continuous scheduling related tests to TestContinuousScheduling (Kai Sasaki via Varun Saxena)	2016-10-28 00:34:50 +05:30
Naganarasimha	b3c15e4ef7	YARN-5420. Delete org.apache.hadoop.yarn.server.resourcemanager.resource.Priority as its not necessary. Contributed by Sunil G.	2016-10-27 18:22:07 +05:30
Naganarasimha	6c8830992c	YARN-3848. TestNodeLabelContainerAllocation is timing out. Contributed by Varun Saxena	2016-10-27 17:10:02 +05:30
Varun Saxena	7b4e9ec3b0	YARN-5686. DefaultContainerExecutor random working dir algorigthm skews results (Vrushali C via Varun Saxena)	2016-10-27 14:02:29 +05:30
Varun Saxena	5c39a419a6	YARN-5752. TestLocalResourcesTrackerImpl#testLocalResourceCache times out (Eric Badger via Varun Saxena)	2016-10-27 13:41:49 +05:30
Rohith Sharma K S	e29cba61a0	YARN-4363. In TestFairScheduler, testcase should not create FairScheduler redundantly. Conntributed by Tao Jie.	2016-10-27 11:57:17 +05:30
Rohith Sharma K S	b110c4b5e8	YARN-4555. TestDefaultContainerExecutor#testContainerLaunchError fails on non-english locale environment. Contributed by Takashi Ohnishi.	2016-10-27 11:34:07 +05:30
Sangjin Lee	f511cc89b6	YARN-5433. Audit dependencies for Category-X. Contributed by Sangjin Lee.	2016-10-26 11:31:00 -07:00
Akira Ajisaka	d3bb69a667	YARN-5575. Many classes use bare yarn. properties instead of the defined constants. Contributed by Daniel Templeton.	2016-10-26 15:32:07 +09:00
Karthik Kambatla	de6faae97c	YARN-5388. Deprecate and remove DockerContainerExecutor. (Daniel Templeton via kasha)	2016-10-25 13:35:47 -07:00
Karthik Kambatla	a71fc81655	YARN-5754. Null check missing for earliest in FifoPolicy. (Yufei Gu via kasha)	2016-10-24 22:19:23 -07:00
Varun Saxena	44eb2bd7ae	YARN-5747. Application timeline metric aggregation in timeline v2 will lose last round aggregation when an application finishes (Li Lu via Varun Saxena)	2016-10-22 01:14:49 +05:30
Karthik Kambatla	754cb4e30f	YARN-5047. Refactor nodeUpdate across schedulers. (Ray Chiang via kasha)	2016-10-20 21:17:48 -07:00
Karthik Kambatla	a064865abf	YARN-4911. Bad placement policy in FairScheduler causes the RM to crash	2016-10-20 20:57:04 -07:00
Sangjin Lee	e9c4616b5e	YARN-5561. [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST. Contributed by Rohith Sharma K S.	2016-10-19 09:45:23 -07:00
Xuan	b733a6f862	YARN-5718. TimelineClient (and other places in YARN) shouldn't over-write HDFS client retry settings which could cause unexpected behavior. Contributed by Junping Du.	2016-10-18 11:06:47 -07:00
Varun Saxena	b154d3edce	YARN-5743. [Atsv2] Publish queue name and RMAppMetrics to ATS (Rohith Sharma K S via Varun Saxena)	2016-10-18 23:32:52 +05:30
Robert Kanter	f5d9235914	YARN-5466. DefaultContainerExecutor needs JavaDocs (templedf via rkanter)	2016-10-17 14:29:09 -07:00
Sangjin Lee	1f304b0c7f	YARN-5699. Retrospect yarn entity fields which are publishing in events info fields. Contributed by Rohith Sharma K S.	2016-10-15 13:54:40 -07:00
Chris Douglas	cf3f43e95b	YARN-5717. Add tests for container-executor is_feature_enabled. Contributed by Sidharta Seethana	2016-10-13 20:49:07 -07:00
Karthik Kambatla	6476934ae5	YARN-5677. RM should transition to standby when connection is lost for an extended period. (Daniel Templeton via kasha)	2016-10-11 22:07:10 -07:00
Karthik Kambatla	6378845f9e	YARN-4464. Lower the default max applications stored in the RM and store. (Daniel Templeton via kasha)	2016-10-11 21:42:08 -07:00
Naganarasimha	0773ffd0f8	YARN-5057. Resourcemanager.security.TestDelegationTokenRenewer fails in trunk. Contributed by Jason Lowe.	2016-10-10 18:04:47 -04:00
Rohith Sharma K S	4d2f380d78	YARN-5101. YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order. Contributed by Sunil G.	2016-10-06 20:42:36 +05:30
Akira Ajisaka	272a21747e	MAPREDUCE-6789. Fix TestAMWebApp failure. Contributed by Daniel Templeton.	2016-10-06 15:57:15 +09:00
Varun Vasudev	0992708d79	YARN-5704. Provide config knobs to control enabling/disabling new/work in progress features in container-executor. Contributed by Sidharta Seethana.	2016-10-05 15:31:38 +05:30
Jian He	31f8da22d0	YARN-3139. Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler. Contributed by Wangda Tan	2016-10-04 17:23:13 -07:00
Karthik Kambatla	736d33cddd	YARN-4767. Network issues can cause persistent RM UI outage. (Daniel Templeton via kasha)	2016-10-03 14:35:57 -07:00
Karthik Kambatla	0da54e8848	YARN-5672. FairScheduler: Wrong queue name in log when adding application. (Wilfred Spiegelenburg via kasha)	2016-10-03 06:03:46 -07:00
Naganarasimha	6e130c308c	YARN-4855. Should check if node exists when replace nodelabels. Contributeed by Tao Jie	2016-10-03 02:02:26 -04:00
Karthik Kambatla	82857037b6	YARN-5678. Log demand as demand in FSLeafQueue and FSParentQueue. (Yufei Gu via kasha)	2016-10-02 22:09:43 -07:00
Subru Krishnan	3a3697deab	YARN-5384. Expose priority in ReservationSystem submission APIs. (Sean Po via Subru).	2016-09-30 19:41:43 -07:00
Arun Suresh	10be45986c	YARN-5486. Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests. (Konstantinos Karanasos via asuresh)	2016-09-29 15:11:41 -07:00
Jian He	2ae5a3a5bf	YARN-4205. Add a service for monitoring application life time out. Contributed by Rohith Sharma K S	2016-09-29 22:00:31 +08:00
Robert Kanter	bcb2528a51	YARN-5400. Light cleanup in ZKRMStateStore (templedf via rkanter)	2016-09-28 14:56:41 -07:00
Varun Saxena	9b0fd01d2e	YARN-5599. Publish AM launch command to ATS (Rohith Sharma K S via Varun Saxena)	2016-09-28 16:10:10 +05:30
Varun Vasudev	bc2656f09f	YARN-5662. Provide an option to enable ContainerMonitor. Contributed by Jian He.	2016-09-28 15:18:18 +05:30
Wangda Tan	1831be8e73	YARN-3142. Improve locks in AppSchedulingInfo. (Varun Saxena via wangda)	2016-09-27 11:54:55 -07:00
Naganarasimha	ebf528c443	YARN-5660. Wrong audit constants are used in Get/Put of priority in RMWebService. Contributed by Rohith Sharma K S	2016-09-27 16:37:59 +05:30
Arun Suresh	4815d024c5	YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh	2016-09-26 08:46:54 -07:00
Arun Suresh	2f163cd5cf	Revert "YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh" ... This reverts commit fe644bafe7.	2016-09-26 08:36:59 -07:00
Jian He	fe644bafe7	YARN-5609. Expose upgrade and restart API in ContainerManagementProtocol. Contributed by Arun Suresh	2016-09-26 22:41:16 +08:00
Akira Ajisaka	14a696f369	YARN-5663. Small refactor in ZKRMStateStore. Contributed by Oleksii Dymytrov.	2016-09-26 15:00:01 +09:00
Naganarasimha	d0372dc613	YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S	2016-09-23 06:30:49 +05:30
Arun Suresh	9f03b403ec	YARN-5656. Fix ReservationACLsTestBase. (Sean Po via asuresh)	2016-09-20 12:27:17 -07:00
Wangda Tan	e45307c9a0	Addendum patch for fix javadocs failure which is caused by YARN-3141. (wangda)	2016-09-20 11:21:01 -07:00
Jason Lowe	c6d1d742e7	YARN-5655. TestContainerManagerSecurity#testNMTokens is asserting. Contributed by Robert Kanter	2016-09-20 14:15:06 +00:00
Jian He	2b66d9ec5b	YARN-3140. Improve locks in AbstractCSQueue/LeafQueue/ParentQueue. Contributed by Wangda Tan	2016-09-20 15:03:31 +08:00
Jason Lowe	7558dbbb48	YARN-5540. Scheduler spends too much time looking at empty priorities. Contributed by Jason Lowe	2016-09-19 20:31:35 +00:00
Jian He	b8a30f2f17	YARN-3141. Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp. Contributed by Wangda Tan	2016-09-19 17:08:01 +08:00
Arun Suresh	3552c2b99d	YARN-5637. Changes in NodeManager to support Container rollback and commit. (asuresh)	2016-09-18 10:55:18 -07:00
Arun Suresh	f67237cbe7	YARN-5657. Fix TestDefaultContainerExecutor. (asuresh)	2016-09-17 09:32:05 -07:00
Naganarasimha	4174b9756c	YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani	2016-09-17 10:35:39 +05:30
Kai Zheng	58bae35447	YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng	2016-09-18 08:43:36 +08:00
Arun Suresh	40b5a59b72	YARN-5620. Core changes in NodeManager to support re-initialization of Containers with new launchContext. (asuresh)	2016-09-15 07:15:11 -07:00
Jason Lowe	e793309735	YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe	2016-09-13 14:41:27 +00:00
Karthik Kambatla	c0e492e50f	YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha)	2016-09-06 22:40:20 -07:00
Varun Vasudev	e6fcfe28e3	YARN-5576. Allow resource localization while container is running. Contributed by Jian He.	2016-09-06 20:01:45 +05:30
Karthik Kambatla	f6ea9be547	YARN-5264. Store all queue-specific information in FSQueue. (Yufei Gu via kasha)	2016-09-02 14:56:29 -07:00
Ray Chiang	378f624a39	YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang)	2016-09-02 11:14:35 -07:00
Varun Vasudev	05f5c0f631	YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne.	2016-09-02 16:02:01 +05:30
Karthik Kambatla	74f4bae455	YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha)	2016-09-01 14:44:01 -07:00
Varun Vasudev	08f55ccbb0	YARN-5596. Fix failing unit test in TestDockerContainerRuntime. Contributed by Sidharta Seethana.	2016-09-01 14:08:51 +05:30
Arun Suresh	d6d9cff21b	YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh)	2016-08-30 15:52:29 -07:00
Subru Krishnan	b930dc3ec0	YARN-5327. API changes required to support recurring reservations in the YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).	2016-08-26 16:58:47 -07:00
Karthik Kambatla	cde3a00526	YARN-5373. NPE listing wildcard directory in containerLaunch. (Daniel Templeton via kasha)	2016-08-26 11:04:33 -07:00
Junping Du	9ef632f3b0	YARN-5557. Add localize API to the ContainerManagementProtocol. Contributed by Jian He.	2016-08-26 09:04:44 -07:00
Naganarasimha	46e02ab719	YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt	2016-08-26 20:19:11 +05:30
Varun Vasudev	bfb4d95059	YARN-5430. Return container's ip and host from NM ContainerStatus call. Contributed by Jian He.	2016-08-26 16:30:18 +05:30
Naganarasimha	27c3b86252	YARN-5564. Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLE. Contributed by Ray Chiang	2016-08-26 08:47:21 +05:30
Varun Vasudev	525d52bf7c	YARN-5042. Mount /sys/fs/cgroup into Docker containers as read only mount. Contributed by luhuichun.	2016-08-25 14:18:26 +05:30
Rohith Sharma K S	0d5997d2b9	YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G.	2016-08-23 14:37:39 +05:30
Wangda Tan	444b2ea7af	YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda)	2016-08-19 16:28:32 -07:00
Varun Saxena	091dd19e86	YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)	2016-08-19 17:30:17 +05:30
Varun Saxena	8aed374182	Revert "YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)" ... This reverts commit 59557e85a4.	2016-08-19 16:14:16 +05:30
Varun Saxena	59557e85a4	YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)	2016-08-19 15:01:48 +05:30
Junping Du	0da69c324d	YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi. ... (cherry picked from commit d464483bf7f0b3e3be3ba32cd6c3eee546747ab5) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java	2016-08-18 07:27:23 -07:00
Karthik Kambatla	20f0eb871c	YARN-4702. FairScheduler: Allow setting maxResources for ad hoc queues. (Daniel Templeton via kasha)	2016-08-17 17:40:20 -07:00
Varun Vasudev	7f05ff7a4e	YARN-5455. Update Javadocs for LinuxContainerExecutor. Contributed by Daniel Templeton.	2016-08-17 15:34:58 +05:30
Varun Saxena	24249115bf	YARN-5521. Fix random failure of TestCapacityScheduler#testKillAllAppsInQueue (sandflee via Varun Saxena)	2016-08-16 00:03:29 +05:30
Varun Saxena	d677b68c25	YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena)	2016-08-15 03:31:21 +05:30
Varun Saxena	23c6e3c4e4	YARN-5476. Non existent application reported as ACCEPTED by YarnClientImpl (Junping Du via Varun Saxena)	2016-08-12 20:37:58 +05:30
Naganarasimha	874577a67d	YARN-4833. For Queue AccessControlException client retries multiple times on both RM. Contributed by Bibin A Chundatt	2016-08-12 01:09:41 +05:30
Rohith Sharma K S	5199db387d	YARN-5492. TestSubmitApplicationWithRMHA is failing sporadically during precommit builds. Contributed by Vrushali C.	2016-08-11 11:50:46 +05:30
Ray Chiang	aea3e65749	YARN-5137. Make DiskChecker pluggable in NodeManager. (Yufei Gu via rchiang)	2016-08-10 19:23:29 -07:00
Naganarasimha	89c0bff719	YARN-5495. Remove import wildcard in CapacityScheduler. Contributed by Ray Chiang.	2016-08-11 00:35:19 +05:30
Jason Lowe	5c95bb315b	YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C	2016-08-10 18:25:54 +00:00
Jason Lowe	e0b570dffb	YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee	2016-08-10 18:04:18 +00:00
Karthik Kambatla	7992c0b42c	YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha)	2016-08-09 16:51:03 -07:00
Varun Vasudev	522ddbde79	YARN-5394. Remove bind-mount /etc/passwd for Docker containers. Contributed by Zhankun Tang.	2016-08-09 16:04:09 +05:30
Arun Suresh	82c9e06101	YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh)	2016-08-09 00:42:29 -07:00
Varun Saxena	37d939a453	YARN-4910. Fix incomplete log info in ResourceLocalizationService (Jun Gong via Varun Saxena)	2016-08-08 22:12:53 +05:30
Naganarasimha	131d58a24e	YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang	2016-08-07 01:08:13 +05:30
Naganarasimha	d81b8163b4	YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula	2016-08-06 01:13:36 +05:30
Wangda Tan	3f100d76ff	YARN-4888. Changes in scheduler to identify resource-requests explicitly by allocation-id. (Subru Krishnan via wangda)	2016-08-05 10:43:35 -07:00
Wangda Tan	e0d131f055	YARN-4091. Add REST API to retrieve scheduler activity. (Chen Ge and Sunil G via wangda)	2016-08-05 10:27:34 -07:00
Rohith Sharma K S	d9a354c2f3	YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong.	2016-08-05 21:35:49 +05:30
Varun Vasudev	08e33381f5	YARN-5459. Add support for docker rm. Contributed by Shane Kumpf.	2016-08-04 14:08:34 +05:30
Jason Lowe	db4a61dc61	YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger	2016-08-03 19:51:44 +00:00
Jason Lowe	db646540f0	YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger	2016-08-03 19:17:25 +00:00
Jason Lowe	4d92aefd35	YARN-4280. CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster. Contributed by Kuhu Shukla	2016-08-03 18:53:14 +00:00
Varun Vasudev	d848184e90	YARN-5460. Change container runtime type logging in DelegatingLinuxContainerRuntime to debug. Contributed by Shane Kumpf.	2016-08-03 12:02:39 +05:30
Chris Nauroth	b913677365	YARN-5456. container-executor support for FreeBSD, NetBSD, and others if conf path is absolute. Contributed by Allen Wittenauer.	2016-08-02 22:24:34 -07:00
Varun Vasudev	7fc70c6422	YARN-5458. Rename DockerStopCommandTest to TestDockerStopCommand. Contributed by Shane Kumpf.	2016-08-02 16:56:45 +05:30
Varun Vasudev	2e7c2a13a8	YARN-5443. Add support for docker inspect command. Contributed by Shane Kumpf.	2016-08-02 16:55:10 +05:30
Varun Vasudev	95694b70cd	YARN-5444. Fix failing unit tests in TestLinuxContainerExecutorWithMocks. Contributed by Yufei Gu.	2016-08-01 16:08:38 +05:30
Arun Suresh	e5766b1dbe	YARN-5113. Refactoring and other clean-up for distributed scheduling. (Konstantinos Karanasos via asuresh)	2016-07-31 11:48:25 -07:00
Chris Nauroth	ef501b1a0b	YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer.	2016-07-30 08:26:19 -07:00
Subru Krishnan	4e756d7271	YARN-5203.Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API. Contributed by Ellen Hui.	2016-07-28 16:03:24 -07:00
Junping Du	7f3c306e2e	YARN-5432. Lock already held by another process while LevelDB cache store creation for dag. Contributed by Li Lu.	2016-07-28 06:35:24 -07:00
Subru Krishnan	d2cbfd7de3	YARN-5441. Fixing minor Scheduler test case failures	2016-07-27 18:21:58 -07:00
Akira Ajisaka	54fe17a607	HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.	2016-07-27 19:41:09 +09:00
Wangda Tan	d62e121ffc	YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. (sandflee via wangda)	2016-07-26 21:22:59 -07:00
Wangda Tan	49969b16cd	YARN-5342. Improve non-exclusive node partition resource allocation in Capacity Scheduler. (Sunil G via wangda)	2016-07-26 18:14:09 -07:00
Arun Suresh	5aace38b74	YARN-5392. Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerRequestKey. (asuresh and subru)	2016-07-26 14:54:03 -07:00
Chris Douglas	d383bfdcd4	YARN-5164. Use plan RLE to improve CapacityOverTimePolicy efficiency	2016-07-25 16:37:50 -07:00
Rohith Sharma K S	557a245d83	YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe.	2016-07-21 12:47:27 +05:30
Akira Ajisaka	c63afdbe14	YARN-4883. Make consistent operation name in AdminService. Contributed by Kai Sasaki.	2016-07-20 16:51:01 -07:00
Vinod Kumar Vavilapalli	1c9d2ab503	YARN-5340. Fixed a race condition in RollingLevelDBTimelineStore that caused loss of Timeline events. Contributed by Li Lu.	2016-07-20 08:36:36 -07:00
Arun Suresh	8fbe6ece24	YARN-5350. Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost. (asuresh)	2016-07-19 23:03:58 -07:00
Arun Suresh	cda0a280dd	YARN-5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)	2016-07-19 10:43:37 -07:00
Arun Suresh	5f2d33a551	Revert "YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)" ... This reverts commit e905a42a2c.	2016-07-19 10:43:19 -07:00
Varun Saxena	fe20494a72	YARN-4996. Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic (Kai Sasaki via Varun Saxena)	2016-07-19 16:03:28 +05:30
Andrew Wang	da456ffd62	Preparing for 3.0.0-alpha2 development	2016-07-15 19:04:17 -07:00
Ray Chiang	f5f1c81e7d	YARN-5272. Handle queue names consistently in FairScheduler. (Wilfred Spiegelenburg via rchiang)	2016-07-15 14:38:50 -07:00
Arun Suresh	e905a42a2c	YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)	2016-07-15 14:35:12 -07:00
Wangda Tan	24db9167f1	YARN-4484. Available Resource calculation for a queue is not correct when used with labels. (Sunil G via wangda)	2016-07-15 11:40:12 -07:00
Varun Saxena	a72cb3825a	YARN-5383. Fix findbugs and checkstyle issues in ContainerExecutor. (Vrushali C via Varun Saxena)	2016-07-15 23:17:04 +05:30
Naganarasimha	b5ee7dbd8d	YARN-5380. NMTimelinePublisher should use getMemorySize instead of getMemory. Contributed by Vrushali C	2016-07-15 14:34:48 +05:30
Sangjin Lee	e549a9af31	YARN-5379. TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently (Vrushali C via sjlee)	2016-07-14 15:19:03 -07:00
Akira Ajisaka	6cf017558a	YARN-5159. Wrong Javadoc tag in MiniYarnCluster. Contributed by Andras Bokor.	2016-07-14 10:45:11 -07:00
Varun Vasudev	54bf14f80b	YARN-5303. Clean up ContainerExecutor JavaDoc. Contributed by Daniel Templeton.	2016-07-14 19:28:11 +05:30
Varun Vasudev	e5e558b0a3	YARN-4759. Fix signal handling for docker containers. Contributed by Shane Kumpf.	2016-07-14 19:27:16 +05:30
Varun Vasudev	58e1850801	YARN-5298. Mount usercache and NM filecache directories into Docker container. Contributed by Sidharta Seethana.	2016-07-14 16:11:07 +05:30
Rohith Sharma K S	dbe97aa768	YARN-5299. Log Docker run command when container fails. Contributed by Varun Vasudev.	2016-07-14 11:48:10 +05:30
Naganarasimha	af8f480c24	YARN-5364. timelineservice modules have indirect dependencies on mapreduce artifacts. Contributed by Sangjin Lee	2016-07-14 01:43:37 +05:30
Varun Saxena	56142171b9	YARN-5359. FileSystemTimelineReader/Writer uses unix-specific default storage path (Sangjin Lee via Varun Saxena)	2016-07-13 21:15:41 +05:30
Rohith Sharma K S	d6d41e820a	YARN-5362. TestRMRestart#testFinishedAppRemovalAfterRMRestart can fail. Contributed by sandflee.	2016-07-13 19:12:35 +05:30
Varun Saxena	06c56ff79b	YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena).	2016-07-13 07:55:34 +05:30
Jason Lowe	10b704c594	YARN-5317. testAMRestartNotLostContainerCompleteMsg may fail. Contributed by sandflee	2016-07-12 20:27:41 +00:00
Jian He	819224dcf9	YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan	2016-07-11 22:36:20 -07:00
Varun Saxena	0fd3980a1f	YARN-5037. Fix random failure of TestRMRestart#testQueueMetricsOnRMRestart (sandflee via Varun Saxena).	2016-07-10 21:28:52 +05:30
Sangjin Lee	6cf6ab7b78	Made a number of miscellaneous fixes for javac, javadoc, and checstyle warnings.	2016-07-10 08:46:05 -07:00
Sangjin Lee	c5dbde0cc4	Fixed the build after the rebase with trunk.	2016-07-10 08:46:05 -07:00
Vrushali	6d943038f6	Cleanup changes during rebase with trunk (Vrushali C)	2016-07-10 08:46:04 -07:00
Sangjin Lee	1a227744ac	YARN-5070. upgrade HBase version for first merge (Vrushali C via sjlee)	2016-07-10 08:46:04 -07:00
Varun Saxena	1ff6833bba	YARN-5243. fix several rebase and other miscellaneous issues before merge. (Sangjin Lee via Varun Saxena)	2016-07-10 08:46:03 -07:00
Varun Saxena	892b193bd7	YARN-5170. Eliminate singleton converters and static method access. (Joep Rottinghuis via Varun Saxena)	2016-07-10 08:46:03 -07:00
Varun Saxena	c65020075e	YARN-5167. Escape occurences of encodedValues. (Sangjin Lee via Varun Saxena)	2016-07-10 08:46:02 -07:00
Varun Saxena	9c926cf432	YARN-5142. fix findbugs warnings/errors for hadoop-yarn-server-timelineservice-hbase-tests. (Vrushali C via Varun Saxena)	2016-07-10 08:46:02 -07:00
Li Lu	0a9b085f05	YARN-5189. Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl. (Joep Rottinghuis and Sangjin Lee via gtcarrera9)	2016-07-10 08:46:01 -07:00
Sangjin Lee	c81a2e1d19	YARN-5015. entire time series is returned for YARN container system metrics (CPU and memory) (Varun Saxena via sjlee)	2016-07-10 08:46:01 -07:00
Sangjin Lee	7b8cfa5c2f	YARN-5109. timestamps are stored unencoded causing parse errors (Varun Saxena via sjlee)	2016-07-10 08:46:01 -07:00
Li Lu	d729e8211b	YARN-5138. fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests. (Vrushali C via gtcarrera9)	2016-07-10 08:46:00 -07:00
Sangjin Lee	702236129b	YARN-5095. flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled (Varun Saxena via sjlee)	2016-07-10 08:46:00 -07:00
Sangjin Lee	831a3ffd6e	YARN-5097. NPE in Separator.joinEncoded() (Vrushali C via sjlee)	2016-07-10 08:46:00 -07:00
Sangjin Lee	a1b6d7456f	YARN-5018. Online aggregation logic should not run immediately after collectors got started (Li Lu via sjlee)	2016-07-10 08:45:59 -07:00
Sangjin Lee	8c8183e515	YARN-5093. created time shows 0 in most REST output (Varun Saxena via sjlee)	2016-07-10 08:45:59 -07:00
Sangjin Lee	4a7011a45f	YARN-5096 addendum. Turned another logging statement to debug. Contributed by Sangjin Lee.	2016-07-10 08:45:59 -07:00
Varun Saxena	bcdb382600	YARN-5096. timelinereader has a lot of logging that's not useful. (Sangjin Lee via Varun Saxena)	2016-07-10 08:45:58 -07:00
Varun Saxena	bc6f978cd3	YARN-5045. hbase unit tests fail due to dependency issues. (Sangjin Lee via varunsaxena)	2016-07-10 08:45:58 -07:00
Sangjin Lee	089caf49fe	YARN-4447. Provide a mechanism to represent complex filters and parse them at the REST layer (Varun Saxena via sjlee)	2016-07-10 08:45:57 -07:00
Li Lu	c2055a97d5	YARN-3150. Documenting the timeline service v2. (Sangjin Lee and Vrushali C via gtcarrera9)	2016-07-10 08:45:57 -07:00
Sangjin Lee	69dc561b61	YARN-4986. Add a check in the coprocessor for table to operated on (Vrushali C via sjlee)	2016-07-10 08:45:56 -07:00
Sangjin Lee	39cce4e629	YARN-3816. [Aggregation] App-level aggregation and accumulation for YARN system metrics (Li Lu via sjlee)	2016-07-10 08:45:56 -07:00
Sangjin Lee	c2efdc415a	YARN-3863. Support complex filters in TimelineReader (Varun Saxena via sjlee)	2016-07-10 08:45:55 -07:00
Varun Saxena	a3cf40e532	YARN-3461. Consolidate flow name/version/run defaults. (Sangjin Lee via Varun Saxena)	2016-07-10 08:45:55 -07:00
Sangjin Lee	84c35ac6c4	YARN-4711. NM is going down with NPE's due to single thread processing of events by Timeline client (Naganarasimha G R via sjlee)	2016-07-10 08:45:55 -07:00
Varun Saxena	6f6cc647d6	YARN-4712. CPU Usage Metric is not captured properly in YARN-2928. (Naganarasimha G R via Varun Saxena)	2016-07-10 08:45:54 -07:00
Sangjin Lee	9bdd455dce	YARN-4062. Add the flush and compaction functionality via coprocessors and scanners for flow run table (Vrushali C via sjlee)	2016-07-10 08:45:54 -07:00
Varun Saxena	d56dde490b	YARN-4700. ATS storage has one extra record each time the RM got restarted. (Naganarasimha G R via Varun Saxena)	2016-07-10 08:45:53 -07:00
Sangjin Lee	0d02ab8729	YARN-3367. Replace starting a separate thread for post entity with event loop in TimelineClient (Naganarasimha G R via sjlee)	2016-07-10 08:45:53 -07:00
Sangjin Lee	960af7d471	YARN-4409. Fix javadoc and checkstyle issues in timelineservice code (Varun Saxena via sjlee)	2016-07-10 08:45:53 -07:00
Sangjin Lee	9cb1287e9b	YARN-4446. Refactor reader API for better extensibility (Varun Saxena via sjlee)	2016-07-10 08:45:52 -07:00
Naganarasimha	06f0b50a28	YARN-4644. TestRMRestart fails and findbugs issue in YARN-2928 branch (Varun Saxena via Naganarasimha G R)	2016-07-10 08:45:52 -07:00
Li Lu	9d40d9d34c	YARN-4224. Support fetching entities by UID and change the REST ... interface to conform to current REST APIs' in YARN. (Varun Saxena via gtcarrera9)	2016-07-10 08:45:52 -07:00
Naganarasimha	6934b05c71	YARN-4238. createdTime and modifiedTime is not reported while publishing entities to ATSv2. (Varun Saxena via Naganarasimha G R)	2016-07-10 08:45:52 -07:00
Li Lu	34f02f07d5	Rebase to latest trunk	2016-07-10 08:45:51 -07:00
Li Lu	88f0294114	YARN-4200. Refactor reader classes in storage to nest under hbase ... specific package name. Contributed by Li Lu.	2016-07-10 08:45:51 -07:00
Sangjin Lee	cc16683cef	YARN-3995. Some of the NM events are not getting published due race condition when AM container finishes in NM (Naganarasimha G R via sjlee)	2016-07-10 08:45:50 -07:00
Varun Saxena	829cceebc0	YARN-3586. RM to only get back addresses of Collectors that NM needs to know. ... (Junping Du via Varun Saxena).	2016-07-10 08:45:50 -07:00
Varun Saxena	eb0ac8efb1	YARN-4350. TestDistributedShell fails for V2 scenarios. (Naganarasimha G R via Varun Saxena)	2016-07-10 08:45:50 -07:00
Li Lu	8ef546c1ee	YARN-4445. Unify the term flowId and flowName in timeline v2 codebase. ... Contributed by Zhan Zhang.	2016-07-10 08:45:49 -07:00
Varun Saxena	c4d7bbda5c	YARN-4460. [Bug fix] RM fails to start when SMP is enabled. (Li Lu via Varun Saxena)	2016-07-10 08:45:49 -07:00
Xuan	2e2dbf59d1	YARN-4392. ApplicationCreatedEvent event time resets after RM ... restart/failover. Contributed by Naganarasimha G R and Xuan Gong (cherry picked from commit 4546c7582b) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestRMAppTransitions.java	2016-07-10 08:45:49 -07:00
Li Lu	89e5c44f9e	YARN-4356. Ensure the timeline service v.2 is disabled cleanly and has no ... impact when it's turned off. Contributed by Sangjin Lee.	2016-07-10 08:45:48 -07:00
Sangjin Lee	1f710484e5	YARN-3862. Support for fetching specific configs and metrics based on prefixes (Varun Saxena via sjlee)	2016-07-10 08:45:48 -07:00
Sangjin Lee	ae72f1dc77	YARN-4297. TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch (Varun Saxena via sjlee)	2016-07-10 08:45:47 -07:00
Sangjin Lee	51254a6b51	YARN-4053. Change the way metric values are stored in HBase Storage (Varun Saxena via sjlee)	2016-07-10 08:45:47 -07:00
Sangjin Lee	09649005ca	YARN-4221. Store user in app to flow table (Varun Saxena via sjlee)	2016-07-10 08:45:47 -07:00
Sangjin Lee	10ec5586fb	YARN-4129. Refactor the SystemMetricPublisher in RM to better support newer events (Naganarasimha G R via sjlee)	2016-07-10 08:45:46 -07:00
Sangjin Lee	e3e857866d	YARN-4179. [reader implementation] support flow activity queries based on time (Varun Saxena via sjlee)	2016-07-10 08:45:46 -07:00
Li Lu	d014f2ffd2	YARN-4237 Support additional queries for ATSv2 Web UI. Contributed by ... Varun Saxena.	2016-07-10 08:45:46 -07:00
Sangjin Lee	b51d0fef56	YARN-4178. [storage implementation] app id as string in row keys can cause incorrect ordering (Varun Saxena via sjlee)	2016-07-10 08:45:45 -07:00
Sangjin Lee	0f44b5508d	YARN-3864. Implement support for querying single app and all apps for a flow run (Varun Saxena via sjlee)	2016-07-10 08:45:45 -07:00
Vrushali Channapattan	708fa8b1ae	YARN-4210. HBase reader throws NPE if Get returns no rows (Varun Saxena via vrushali)	2016-07-10 08:45:45 -07:00
Vrushali Channapattan	da2b7bd08e	YARN-4203. Add request/response logging & timing for each REST endpoint call (Varun Saxena via vrushali)	2016-07-10 08:45:45 -07:00
Vrushali Channapattan	d95dc89a02	YARN-4075 [reader REST API] implement support for querying for flows and flow runs (Varun Saxena via vrushali)	2016-07-10 08:45:44 -07:00
Vrushali	10fa6da7d8	YARN-4074. [timeline reader] implement support for querying for flows and flow runs (sjlee via vrushali)	2016-07-10 08:45:44 -07:00
Sangjin Lee	a68e383921	YARN-3901. Populate flow run data in the flow_run & flow activity tables (Vrushali C via sjlee)	2016-07-10 08:45:44 -07:00
Sangjin Lee	ee081018e4	YARN-4102. Add a "skip existing table" mode for timeline schema creator (Li Lu via sjlee)	2016-07-10 08:45:43 -07:00
Sangjin Lee	8d9476ec5f	YARN-4058. Miscellaneous issues in NodeManager project (Naganarasimha G R via sjlee)	2016-07-10 08:45:43 -07:00
Sangjin Lee	451c13b1de	YARN-3814. REST API implementation for getting raw entities in TimelineReader (Varun Saxena via sjlee)	2016-07-10 08:45:43 -07:00
Sangjin Lee	c7224a285c	YARN-4064. build is broken at TestHBaseTimelineWriterImpl.java (sjlee)	2016-07-10 08:45:43 -07:00
Junping Du	7a41b5501e	YARN-4025. Deal with byte representations of Longs in writer code. Contributed by Sangjin Lee and Vrushali C.	2016-07-10 08:45:42 -07:00
Junping Du	477a30f536	YARN-3045. Implement NM writing container lifecycle events to Timeline Service v2. Contributed by Naganarasimha G R.	2016-07-10 08:45:42 -07:00
Sangjin Lee	102b56ee96	YARN-3904. Refactor timelineservice.storage to add support to online and offline aggregation writers (Li Lu via sjlee)	2016-07-10 08:45:42 -07:00
Zhijie Shen	5088f6c76a	MAPREDUCE-6337. Added a mode to replay MR job history files and put them into the timeline service v2. Contributed by Sangjin Lee. ... (cherry picked from commit 463e070a8e7c882706a96eaa20ea49bfe9982875)	2016-07-10 08:45:41 -07:00
Junping Du	00e85e7a2b	YARN-3906. Split the application table from the entity table. Contributed by Sangjin Lee. ... (cherry picked from commit bcd755eba9466ce277d3c14192c31da6462c4ab3)	2016-07-10 08:45:41 -07:00
Sangjin Lee	9e5155be36	YARN-3049. [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend (Zhijie Shen via sjlee) ... (cherry picked from commit 07433c2ad52df9e844dbd90020c277d3df844dcd)	2016-07-10 08:45:41 -07:00
Zhijie Shen	9422d9b50d	YARN-3984. Adjusted the event column key schema and avoided missing empty event. Contributed by Vrushali C. ... (cherry picked from commit 895ccfa1ab9e701f2908586e323249f670fe5544)	2016-07-10 08:45:40 -07:00
Zhijie Shen	57e2498cd4	YARN-3993. Changed to use the AM flag in ContainerContext determine AM container in TestPerNodeTimelineCollectorsAuxService. Contributed by Sunil G. ... (cherry picked from commit 9e48f9ff2ce08f3dcdd8d60bacb697664b92196f)	2016-07-10 08:45:40 -07:00
Zhijie Shen	a9fab9b644	YARN-3908. Fixed bugs in HBaseTimelineWriterImpl. Contributed by Vrushali C and Sangjin Lee. ... (cherry picked from commit df0ec473a84871b0effd7ca6faac776210d7df09)	2016-07-10 08:45:40 -07:00
Junping Du	8603736ef2	YARN-3949. Ensure timely flush of timeline writes. Contributed by Sangjin Lee. ... (cherry picked from commit 967bef7e0396d857913caa2574afb103a5f0b81b)	2016-07-10 08:45:39 -07:00
Sangjin Lee	e27642abf4	YARN-3047. [Data Serving] Set up ATS reader with basic request serving structure and lifecycle (Varun Saxena via sjlee) ... (cherry picked from commit 4c5f88fb0f04b7919738d07598b0f006a9ff91f2)	2016-07-10 08:45:39 -07:00
Zhijie Shen	2d59bc4458	YARN-3051. Created storage oriented reader interface for fetching raw entity data and made the filesystem based implementation. Contributed by Varun Saxena. ... (cherry picked from commit 499ce52c7b645ec0b1cc8ac62dc9a3127b987a20)	2016-07-10 08:45:38 -07:00
Sangjin Lee	22e7ae5771	YARN-3792. Test case failures in TestDistributedShell and some issue fixes related to ATSV2 (Naganarasimha G R via sjlee) ... (cherry picked from commit 84f37f1c7eefec6d139cbf091c50d6c06f734323)	2016-07-10 08:45:38 -07:00
Sangjin Lee	92d90c3a24	YARN-3706. Generalize native HBase writer for additional tables (Joep Rottinghuis via sjlee) ... (cherry picked from commit 9137aeae0dec83f9eff40d12cae712dfd508c0c5)	2016-07-10 08:45:38 -07:00
Zhijie Shen	f3c661e8dd	YARN-3044. Made RM write app, attempt and optional container lifecycle events to timeline service v2. Contributed by Naganarasimha G R.	2016-07-10 08:45:37 -07:00
Sangjin Lee	f668212529	YARN-3721. build is broken on YARN-2928 branch due to possible dependency cycle (Li Lu via sjlee) ... (cherry picked from commit a9738ceb17b50cce8844fd42bb800c7f83f15caf)	2016-07-10 08:45:37 -07:00
Sangjin Lee	db891f51d0	YARN-3726. Fix TestHBaseTimelineWriterImpl unit test failure by fixing its test data (Vrushali C via sjlee) ... (cherry picked from commit 4c0b6d73914f2e249795deb292f508177ea54884)	2016-07-10 08:45:36 -07:00
Sangjin Lee	5a4278ccbd	YARN-3411. [Storage implementation] explore the native HBase write schema for storage (Vrushali C via sjlee) ... (cherry picked from commit 7a3068854d27eadae1c57545988f5b2029bf119a)	2016-07-10 08:45:36 -07:00
Junping Du	d275677e24	YARN-3634. TestMRTimelineEventHandling and TestApplication are broken. Contributed by Sangjin Lee. ... (cherry picked from commit b059dd4882fd759e4762cc11c019be4b68fb74c1)	2016-07-10 08:45:36 -07:00
Zhijie Shen	51d092faef	YARN-3529. Added mini HBase cluster and Phoenix support to timeline service v2 unit tests. Contributed by Li Lu.	2016-07-10 08:45:36 -07:00
Zhijie Shen	41fb5c7381	YARN-3134. Implemented Phoenix timeline writer to access HBase backend. Contributed by Li Lu. ... (cherry picked from commit b3b791be466be79e4e964ad068f7a6ec701e22e1)	2016-07-10 08:45:35 -07:00
Sangjin Lee	dc1f306fdc	YARN-3562. unit tests failures and issues found from findbug from earlier ATS checkins (Naganarasimha G R via sjlee)	2016-07-10 08:45:35 -07:00
Sangjin Lee	fc8485d893	YARN-3551. Consolidate data model change according to the backend implementation (Zhijie Shen via sale) ... (cherry picked from commit 557a3950bddc837469244835f5577899080115d8)	2016-07-10 08:45:35 -07:00
Junping Du	2bdefbc4a0	YARN-3431. Sub resources of timeline entity needs to be passed to a separate endpoint. Contributed By Zhijie Shen. ... (cherry picked from commit fa5cc75245a6dba549620a8b26c7b4a8aed9838e)	2016-07-10 08:45:34 -07:00
Sangjin Lee	11e8905d8d	YARN-3390. Reuse TimelineCollectorManager for RM (Zhijie Shen via sjlee) ... (cherry picked from commit 58221188811e0f61d842dac89e1f4ad4fd8aa182)	2016-07-10 08:45:33 -07:00
Junping Du	47f35a30bb	YARN-3391. Clearly define flow ID/ flow run / flow version in API and storage. Contributed by Zhijie Shen ... (cherry picked from commit 68c6232f8423e55b4d152ef3d1d66aeb2d6a555e)	2016-07-10 08:45:33 -07:00
Zhijie Shen	5712b8f9fd	YARN-3334. NM uses timeline client to publish container metrics to new timeline service. Contributed by Junping Du.	2016-07-10 08:45:33 -07:00
Junping Du	42e49399ce	YARN-3374. Collector's web server should randomly bind an available port. Contributed by Zhijie Shen ... (cherry picked from commit 3aa898e734a1e4368ddf1d0bbd31f9b4de53ceba)	2016-07-10 08:45:32 -07:00
Junping Du	d67c9bdb4d	YARN-3040. Make putEntities operation be aware of the app's context. Contributed by Zhijie Shen	2016-07-10 08:45:32 -07:00
Junping Du	5e3d9a477b	YARN-3034. Implement RM starting its timeline collector. Contributed by Naganarasimha G R	2016-07-10 08:45:32 -07:00
Zhijie Shen	19c1132146	YARN-3377. Fixed test failure in TestTimelineServiceClientIntegration. Contributed by Sangjin Lee. ... (cherry picked from commit 04de2ceccd02edb00bd671a63e04855c132e9735)	2016-07-10 08:45:31 -07:00
Junping Du	2188a07e5b	YARN-3333. Rename TimelineAggregator etc. to TimelineCollector. Contributed by Sangjin Lee	2016-07-10 08:45:31 -07:00
Zhijie Shen	9b56364080	YARN-3039. Implemented the app-level timeline aggregator discovery service. Contributed by Junping Du.	2016-07-10 08:45:31 -07:00
Zhijie Shen	f0e752c14b	YARN-3264. Created backing storage write interface and a POC only FS based storage implementation. Contributed by Vrushali C. ... (cherry picked from commit 821b68d05d246fd57d7b7286eb2ccc075ed1eae8)	2016-07-10 08:45:30 -07:00
Zhijie Shen	bf54d32750	YARN-3210. Refactored timeline aggregator according to new code organization proposed in YARN-3166. Contributed by Li Lu. ... (cherry picked from commit d3ff7f06cbc66d3a23c2551e7d4c752689f46afe)	2016-07-10 08:45:30 -07:00
Zhijie Shen	d45ff878c4	YARN-3125. Made the distributed shell use timeline service next gen and add an integration test for it. Contributed by Junping Du and Li Lu. ... (cherry picked from commit bf08f7f0ed4900ce52f98137297dd1a47ba2a536)	2016-07-10 08:45:30 -07:00
Zhijie Shen	9d57c9c015	YARN-3087. Made the REST server of per-node aggregator work alone in NM daemon. Conntributed by Li Lu. ... (cherry picked from commit 41a08ad404d4278fe598d6c222b2ae0e84bae0df)	2016-07-10 08:45:29 -07:00
Junping Du	4f0c7eaff3	YARN-3240. Implement client API to put generic entities. Contributed by Zhijie Shen ... (cherry picked from commit 4487da249f448d5c67b712cd0aa723e764eed77d)	2016-07-10 08:45:29 -07:00
Zhijie Shen	7c8abec0a8	YARN-3030. Set up TS aggregator with basic request serving structure and lifecycle. Contributed by Sangjin Lee. ... (cherry picked from commit f26941b39028ac30c77547e2be2d657bb5bf044a)	2016-07-10 08:45:28 -07:00
Zhijie Shen	0d2da08f35	YARN-3063. Bootstrapping TimelineServer next generation module. Contributed by Zhijie Shen. ... (cherry picked from commit fe7d0e7c8fc88e0721b18e1531b0899d9dbed296)	2016-07-10 08:45:28 -07:00
Varun Saxena	c04c5ec501	YARN-5318. Fix intermittent test failure of TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider. (Jun Gong via Varun Saxena).	2016-07-09 01:13:18 +05:30
Varun Saxena	5252562edf	YARN-5297. Avoid printing a stack trace when recovering an app after the RM restarts. (Junping Du via Varun Saxena).	2016-07-09 00:09:25 +05:30
Junping Du	30ee57ceb1	YARN-4939. The decommissioning Node should keep alive during NM restart. Contributed by sandflee.	2016-07-08 04:14:53 -07:00
Vinod Kumar Vavilapalli	673e5e02fe	YARN-5314. Fixed a ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore. Contributed by Li Lu.	2016-07-07 22:37:29 -07:00
Jian He	8a9d293dd6	YARN-5233. Support for specifying a path for ATS plugin jars. Contributed by Li Lu	2016-07-06 16:44:46 -07:00
Vinod Kumar Vavilapalli	4c9e1aeb94	YARN-5224. Added new web-services /containers/{containerid}/logs & /containers/{containerid}/logs/{filename} and using them in "yarn logs" CLI to get logs of finished containers of a running application. Contributed by Xuan Gong.	2016-07-06 14:10:54 -07:00
Wangda Tan	04f6ebb66a	YARN-5294. Pass remote ip address down to YarnAuthorizationProvider. (Jian He via wangda)	2016-07-06 10:36:48 -07:00
Jian He	d792a90206	YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du	2016-07-05 18:05:16 -07:00
Vinod Kumar Vavilapalli	ce9c006430	YARN-5214. Fixed locking in DirectoryCollection to avoid hanging NMs when various code-paths hit slow disks. Contributed by Junping Du.	2016-07-05 16:07:28 -07:00
Varun Saxena	8e672e3c71	YARN-5286. Add RPC port info in RM web service's response when getting app status. (Jun Gong via Varun Saxena).	2016-07-05 22:56:07 +05:30
Ray Chiang	0a5def155e	YARN-4568. Fix message when NodeManager runs into errors initializing the recovery directory. (rchiang)	2016-07-01 15:53:46 -07:00
Jian He	c35a5a7a8d	YARN-5023. TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails. Contributed by sandflee	2016-07-01 14:29:03 -07:00
Varun Saxena	abe7fc22c1	YARN-5182. MockNodes.newNodes creates one more node per rack than requested. (Karthik Kambatla via Varun Saxena).	2016-06-30 00:13:28 +05:30
Rohith Sharma K S	26b5e6116f	YARN-5262. Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat.	2016-06-29 10:08:30 +05:30
Akira Ajisaka	a8a48c9125	YARN-5278. Remove unused argument in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration. Contributed by Tao Jie.	2016-06-23 14:28:12 +09:00
Arun Suresh	99e5dd68d0	YARN-5171. Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node. (Inigo Goiri via asuresh)	2016-06-22 19:04:54 -07:00
Tsuyoshi Ozawa	5d58858bb6	HADOOP-9613. [JDK8] Update jersey version to latest 1.x release.	2016-06-21 08:05:32 +09:00
Sangjin Lee	5107a967fa	YARN-4958. The file localization process should allow for wildcards to reduce the application footprint in the state store (Daniel Templeton via sjlee)	2016-06-20 09:56:53 -07:00
Junping Du	d0162f2040	YARN-5246. NMWebAppFilter web redirects drop query parameters. Contributed by Varun Vasudev.	2016-06-19 17:44:54 -07:00
Karthik Kambatla	20f2799938	YARN-5077. Fix FSLeafQueue#getFairShare() for queues with zero fairshare. (Yufei Gu via kasha)	2016-06-17 22:24:42 -07:00
Karthik Kambatla	fbbe0bb627	YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit. Addendum to fix javac warning. (Arun Suresh via kasha)	2016-06-17 22:12:50 -07:00
Junping Du	c35fa4a0e5	YARN-5251. Yarn CLI to obtain App logs for last 'n' bytes fails. Contributed by Xuan Gong.	2016-06-17 08:24:24 -07:00
Junping Du	5dfc38ff57	YARN-5237. Fix missing log files issue in rolling log aggregation. Contributed by Xuan Gong.	2016-06-15 16:17:54 -07:00
Wangda Tan	c77a1095dc	YARN-1942. Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. (wangda)	2016-06-14 15:06:38 -07:00
Rohith Sharma K S	28b66ae919	YARN-4989. TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently. Contributed by Ajith S.	2016-06-13 11:09:32 +05:30
Arun Suresh	7dae2b3bc4	YARN-5212. Run existing ContainerManager tests using QueuingContainerManagerImpl. (Konstantinos Karanasos via asuresh)	2016-06-12 10:05:37 -07:00
Arun Suresh	5279af7cd4	YARN-5082. Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit (sandflee via asuresh)	2016-06-10 22:33:42 -07:00
Rohith Sharma K S	e0f4620cc7	YARN-5197. RM leaks containers if running container disappears from node update. Contributed by Jason Lowe.	2016-06-11 10:22:27 +05:30
Wangda Tan	03fc6b1bb0	YARN-3426. Add jdiff support to YARN. (vinodkv via wangda)	2016-06-10 09:51:09 -07:00
Wangda Tan	244506f9c8	YARN-5208. Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled. (Rohith Sharma K S via wangda)	2016-06-10 09:34:32 -07:00
Vinod Kumar Vavilapalli	9378d9428f	YARN-5191. Renamed the newly added “download=true” option for getting logs via NMWebServices and AHSWebServices to be a better "format" option. (Xuan Gong via vinodkv)	2016-06-09 12:30:58 -07:00
Naganarasimha	1500a0a300	YARN-4308. ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats. Contributed by Sunil G	2016-06-09 05:41:09 +05:30
Arun Suresh	3344ba70e0	YARN-5204. Properly report status of killed/stopped queued containers. (Konstantinos Karanasos via asuresh)	2016-06-08 08:31:32 -07:00
Arun Suresh	76f0800c21	YARN-5176. More test cases for queuing of containers at the NM. (Konstantinos Karanasos via asuresh)	2016-06-07 17:16:18 -07:00
Xuan	58be55b6e0	YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and ... FileInputStream in NMWebServices#getLogs. Contributed by Xuan Gong	2016-06-07 16:07:02 -07:00
Wangda Tan	620325e816	YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. (vinodkv via wangda)	2016-06-07 15:06:42 -07:00
Rohith Sharma K S	bddea5fe5f	YARN-5118. Tests fails with localizer port bind exception. Contributed by Brahma Reddy Battula.	2016-06-07 11:20:15 +05:30
Arun Suresh	3a154f75ed	YARN-4525. Fix bug in RLESparseResourceAllocation.getRangeOverlapping(). (Ishai Menache and Carlo Curino via asuresh)	2016-06-06 21:18:32 -07:00
Arun Suresh	7a9b7372a1	YARN-5185. StageAllocaterGreedyRLE: Fix NPE in corner case. (Carlo Curino via asuresh)	2016-06-06 21:06:52 -07:00
Ming Ma	4a1cedc010	MAPREDUCE-5044. Have AM trigger jstack on task attempts that timeout before killing them. (Eric Payne and Gera Shegalov via mingma)	2016-06-06 14:30:51 -07:00
Arun Suresh	db54670e83	YARN-5165. Fix NoOvercommitPolicy to take advantage of RLE representation of plan. (Carlo Curino via asuresh)	2016-06-03 14:49:32 -07:00
Vinod Kumar Vavilapalli	f10ebc67f5	YARN-5098. Fixed ResourceManager's DelegationTokenRenewer to replace expiring system-tokens if RM stops and only restarts after a long time. Contributed by Jian He.	2016-06-03 13:00:07 -07:00
Jian He	99cc439e29	YARN-5190. Registering/unregistering container metrics in ContainerMonitorImpl and ContainerImpl causing uncaught exception in ContainerMonitorImpl. Contributed by Junping Du	2016-06-03 11:10:42 -07:00
Jian He	097baaaeba	YARN-1815. Work preserving recovery of Unmanged AMs. Contributed by Subru Krishnan	2016-06-03 10:49:30 -07:00
Arun Suresh	dc26601d8f	YARN-5180. Allow ResourceRequest to specify an enforceExecutionType flag. (asuresh)	2016-06-02 09:01:02 -07:00
Xuan	0bc05e40fa	YARN-5088. Improve "yarn log" command-line to read the last K bytes for the log files. Contributed by Xuan Gong	2016-06-01 13:44:21 -07:00
Varun Vasudev	86fb58b7dc	YARN-4007. Add support for different network setups when launching the docker container. Contributed by Sidharta Seethana.	2016-05-29 21:32:51 +05:30
Varun Vasudev	42f90ab885	YARN-4844. Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource. Contributed by Wangda Tan.	2016-05-29 21:24:16 +05:30
Arun Suresh	4fc09a897b	YARN-5117. QueuingContainerManager does not start GUARANTEED Container even if Resources are available. (Konstantinos Karanasos via asuresh)	2016-05-27 17:49:15 -07:00
Arun Suresh	aa975bc781	YARN-5127. Expose ExecutionType in Container api record. (Hitesh Sharma via asuresh)	2016-05-27 14:06:32 -07:00
Junping Du	705286ccae	YARN-4987. Read cache concurrency issue between read and evict in EntityGroupFS timeline store. Contributed by Li Lu.	2016-05-27 06:58:32 -07:00
Kai Zheng	916140604f	HADOOP-12911. Upgrade Hadoop MiniKDC with Kerby. Contributed by Jiajia Li	2016-05-28 14:23:39 +08:00
Rohith Sharma K S	0a544f8a3e	YARN-5005. TestRMWebServices#testDumpingSchedulerLogs fails randomly. Contributed by Bibin A Chundatt.	2016-05-27 10:44:35 +05:30
Arun Suresh	5b41b288d0	YARN-5162. Fix Exceptions thrown during in registerAM call when Distributed Scheduling is Enabled (Hitesh Sharma via asuresh)	2016-05-26 14:56:37 -07:00
Karthik Kambatla	04ded558b0	YARN-5035. FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on. (kasha)	2016-05-26 14:41:07 -07:00
Karthik Kambatla	4f513a4a8e	YARN-4866. FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy. (Yufei Gu via kasha)	2016-05-25 22:13:27 -07:00
Carlo Curino	013532a95e	YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po via curino)	2016-05-25 16:55:49 -07:00
Jason Lowe	1ba31fe9e9	YARN-4459. container-executor should only kill process groups. Contributed by Jun Gong	2016-05-25 21:24:55 +00:00
Robert Kanter	e07519b8db	YARN-4766. NM should not aggregate logs older than the retention policy (haibochen via rkanter)	2016-05-25 10:25:44 -07:00
Varun Vasudev	9a31e5dfef	YARN-5115. Avoid setting CONTENT-DISPOSITION header in the container-logs web-service. Contributed by Xuan Gong.	2016-05-25 19:01:12 +05:30
Varun Vasudev	c380a22031	YARN-857. Localization failures should be available in container diagnostics. Contributed by Vinod Kumar Vavilapalli.	2016-05-25 19:01:12 +05:30
Rohith Sharma K S	28bd63e92b	YARN-5024. TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure. Contributed by Bibin A Chundatt	2016-05-25 10:15:50 +05:30
Naganarasimha	edd716e99c	YARN-5114. Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8. Contributed by Bibin A Chundatt	2016-05-25 06:11:38 +08:00
Karthik Kambatla	f979d779e1	YARN-4878. Expose scheduling policy and max running apps over JMX for Yarn queues. (Yufei Gu via kasha)	2016-05-24 10:54:11 -07:00
Naganarasimha	b4078bd17b	YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (addendum patch). Contributed by Bibin A chundatt	2016-05-24 08:06:53 +08:00
Karthik Kambatla	6d043aa4cf	YARN-4979. FSAppAttempt demand calculation considers demands at multiple locality levels different. (Zhihai Xu via kasha)	2016-05-23 14:29:28 -07:00
Jason Lowe	ac954486c5	YARN-5055. max apps per user can be larger than max per queue. Contributed by Eric Badger	2016-05-23 15:54:42 +00:00
Jason Lowe	d1df0266cf	YARN-5103. With NM recovery enabled, restarting NM multiple times results in AM restart. Contributed by Junping Du	2016-05-23 15:15:27 +00:00
Junping Du	6161d9ba52	YARN-5112. Excessive log warnings for directory permission issue on NM recovery. Contributed by Jian He. ... (cherry picked from commit 867cd2f5a2e5966d6a7c5f5accb2fce78f9e7778)	2016-05-22 16:04:02 -07:00
Varun Vasudev	0287c49107	YARN-5016. Add support for a minimum retry interval for container retries. Contributed by Jun Gong.	2016-05-20 12:28:14 +05:30
Junping Du	22fcd819f0	YARN-5076. YARN web interfaces lack XFS protection. Contributed by Jonathan Maron. ... (cherry picked from commit 2703ec68712279494d67b0d76b7ac10e7a1628be)	2016-05-19 14:15:21 -07:00
Jian He	feb90ffcca	YARN-4002. Make ResourceTrackerService#nodeHeartbeat more concurrent. Contributed by Rohith Sharma K S & Zhiguo Hong	2016-05-19 13:01:36 -07:00
Junping Du	141873ca7d	YARN-5100. The YarnApplicationState is always running in ATS even application is finished. Contributed by Xuan Gong.	2016-05-19 09:13:29 -07:00
Steve Loughran	22ff9e68d1	HADOOP-12767. Update apache httpclient version to 4.5.2; httpcore to 4.4.4. Artem Aliev via stevel.	2016-05-19 14:48:18 +01:00
Akira Ajisaka	d4274c64bc	YARN-5107. TestContainerMetrics fails. (aajisaka)	2016-05-19 19:53:59 +09:00
Arun Suresh	1597630681	YARN-5110. Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds. (Konstantinos Karanasos via asuresh)	2016-05-18 18:46:00 -07:00
Arun Suresh	8a9ecb7584	YARN-5090. Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster. (asuresh)	2016-05-17 19:01:29 -07:00
Jian He	0c6726e20d	Addendum patch for YARN-4832. Contributed by Junping Du	2016-05-17 14:50:30 -07:00
Jian He	fa3bc3405d	YARN-4832. NM side resource value should get updated if change applied in RM side. Contributed by Junping Du	2016-05-17 12:52:19 -07:00
Arun Suresh	ccc93e7812	YARN-5075. Fix findbugs warnings in hadoop-yarn-common module. (asuresh)	2016-05-16 23:22:01 -07:00
Eric Payne	1217c8f6b4	YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. Contributed by Eric Badger.	2016-05-16 20:28:04 +00:00
Jason Lowe	81effb7dcd	YARN-4325. Nodemanager log handlers fail to send finished/failed events in some cases. Contributed by Junping Du	2016-05-16 15:40:23 +00:00
Arun Suresh	f45bc5a83e	YARN-4738. Notify the RM about the status of OPPORTUNISTIC containers (Konstantinos Karanasos via asuresh)	2016-05-15 17:54:34 -07:00
Arun Suresh	f0ac18d001	YARN-2888. Corrective mechanisms for rebalancing NM container queues. (asuresh)	2016-05-13 13:38:36 -07:00
Andrew Wang	3c5c57af28	HADOOP-13142. Change project version from 3.0.0 to 3.0.0-alpha1.	2016-05-12 18:27:28 -07:00
Andrew Wang	ca5613af91	Revert "Update project version to 3.0.0-alpha1-SNAPSHOT." ... This reverts commit 6b53802cba.	2016-05-12 15:32:45 -07:00
Jason Lowe	013000fbc2	YARN-5053. More informative diagnostics when applications killed by a user. Contributed by Eric Badger	2016-05-12 20:28:36 +00:00
Andrew Wang	6b53802cba	Update project version to 3.0.0-alpha1-SNAPSHOT.	2016-05-12 11:05:05 -07:00
Sangjin Lee	0bbe01f8d5	YARN-4577. Enable aux services to have their own custom classpath/jar file (Xuan Gong via sale)	2016-05-12 10:11:23 -07:00
Rohith Sharma K S	b7ac85259c	YARN-5068. Expose scheduler queue to application master. (Harish Jaiprakash via rohithsharmaks)	2016-05-12 15:17:49 +05:30
Arun Suresh	d464f4d1c4	YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh)	2016-05-11 19:10:17 -07:00
Karthik Kambatla	4b4e4c6ba8	YARN-4995. FairScheduler: Display per-queue demand on the scheduler page. (xupeng via kasha)	2016-05-11 17:36:21 -07:00
Junping Du	39f2bac38b	YARN-5029. RM needs to send update event with YarnApplicationState as Running to ATS/AHS. Contributed by Xuan Gong.	2016-05-11 09:28:35 -07:00
Arun Suresh	d971bf252f	YARN-5073. Refactor startContainerInternal() in ContainerManager to remove unused parameter. (Konstantinos Karanasos via asuresh)	2016-05-10 22:31:38 -07:00
Naganarasimha	2750fb900f	YARN-4926. Change nodelabel rest API invalid reponse status to 400. Contributed by Bibin A Chundatt	2016-05-08 22:49:25 +05:30
Yongjun Zhang	47c41e7ac7	YARN-5048. DelegationTokenRenewer#skipTokenRenewal may throw NPE (Jian He via Yongjun Zhang)	2016-05-06 21:50:09 -07:00
Jason Lowe	b2ed6ae731	YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena	2016-05-06 22:59:39 +00:00
Wangda Tan	23248f63aa	getApplicationReport call may raise NPE for removed queues. (Jian He via wangda)	2016-05-06 15:30:45 -07:00
Jian He	bb62e05925	YARN-4390. Do surgical preemption based on reserved container in CapacityScheduler. Contributed by Wangda Tan	2016-05-05 12:56:21 -07:00
Jason Lowe	d0da13229c	YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla	2016-05-05 14:07:54 +00:00
Varun Vasudev	72b047715c	YARN-4595. Add support for configurable read-only mounts when launching Docker containers. Contributed by Billie Rinaldi.	2016-05-05 13:01:54 +05:30
Wangda Tan	7bd418e48c	YARN-4984. LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak. (Junping Du via wangda)	2016-05-04 11:38:55 -07:00
Junping Du	e61d431275	YARN-4920. ATS/NM should support a link to dowload/get the logs in text format. Contributed by Xuan Gong.	2016-05-04 10:35:49 -07:00
Rohith Sharma K S	75e0450593	YARN-4947. Test timeout is happening for TestRMWebServicesNodes. Contributed by Bibin A Chundatt	2016-05-04 09:58:26 +05:30
Jason Lowe	ed54f5f1ff	YARN-5003. Add container resource to RM audit log. Contributed by Nathan Roberts	2016-05-03 20:03:41 +00:00
Junping Du	06413da72e	YARN-4851. Metric improvements for ATS v1.5 storage components. Li Lu via junping_du.	2016-05-03 04:16:21 -07:00
Robert Kanter	9d4d30243b	Remove parent's env vars from child processes	2016-04-29 09:25:51 -07:00
Varun Vasudev	0f25a1bb52	YARN-3998. Add support in the NodeManager to re-launch containers. Contributed by Jun Gong.	2016-04-29 16:09:07 +05:30
Jian He	4a8508501b	YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe	2016-04-28 21:54:11 -07:00
Jian He	dd80042c42	YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe	2016-04-28 21:27:25 -07:00
Li Lu	f16722d2ef	YARN-4956. findbug issue on LevelDBCacheTimelineStore. (Zhiyuan Yang via gtcarrera9)	2016-04-27 10:57:10 -07:00
Karthik Kambatla	185c3d4de1	YARN-4807. MockAM#waitForState sleep duration is too long. (Yufei Gu via kasha)	2016-04-27 09:43:23 -07:00
Jian He	4beff01354	YARN-4983. JVM and UGI metrics disappear after RM transitioned to standby mode	2016-04-26 21:00:17 -07:00
Arun Suresh	341888a0aa	YARN-4412. Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers. (asuresh)	2016-04-26 20:12:12 -07:00
Karthik Kambatla	1a3f1482e2	YARN-4795. ContainerMetrics drops records. (Daniel Templeton via kasha)	2016-04-26 06:15:36 -07:00
Karthik Kambatla	4b1dcbbe0c	YARN-1297. FairScheduler: Move some logs to debug and check if debug logging is enabled	2016-04-26 05:10:09 -07:00
Arun Suresh	c282a08f38	YARN-2885. Create AMRMProxy request interceptor and ContainerAllocator to distribute OPPORTUNISTIC containers to appropriate Nodes (asuresh) ... (cherry picked from commit 2bf025278a318b0452fdc9ece4427b4c42124e39)	2016-04-24 22:38:33 -07:00
Jing Zhao	63e5412f1a	HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.	2016-04-22 15:14:40 -07:00
Wangda Tan	7cb3a3da96	YARN-4846. Fix random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers. (Bibin A Chundatt via wangda)	2016-04-22 11:40:32 -07:00
Eric Payne	3dce486d88	YARN-4556. TestFifoScheduler.testResourceOverCommit fails. Contributed by Akihiro Suda	2016-04-21 21:16:47 +00:00
Li Lu	7c6339f66a	YARN-4968. A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped. (Wangda Tan via gtcarrera9)	2016-04-21 13:25:33 -07:00
Karthik Kambatla	170c4fd4cd	YARN-4784. Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO. (Yufei Gu via kasha)	2016-04-20 23:58:12 -07:00
Wangda Tan	33fd95a99c	YARN-4890. Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate. (Sunil G via wangda)	2016-04-20 17:37:38 -07:00
Karthik Kambatla	c8172f5f14	YARN-2883. Queuing of container requests in the NM. (Konstantinos Karanasos and Arun Suresh via kasha)	2016-04-20 09:55:50 -07:00
Wangda Tan	fdc46bfb37	YARN-4934. Reserved Resource for QueueMetrics needs to be handled correctly in few cases. (Sunil G via wangda)	2016-04-16 22:47:41 -07:00
Jason Lowe	69f3d428d5	YARN-4940. yarn node -list -all failed if RM start with decommissioned node. Contributed by sandflee	2016-04-15 20:36:45 +00:00
Jason Lowe	3150ae8108	YARN-4924. NM recovery race can lead to container not cleaned up. Contributed by sandflee	2016-04-14 19:17:14 +00:00
Robert Kanter	0d9194df00	YARN-4541. Change log message in LocalizedResource#handle() to DEBUG (rchiang via rkanter)	2016-04-13 17:45:18 -07:00
Xuan	e0cb426758	YARN-4886. Add HDFS caller context for EntityGroupFSTimelineStore. Contributed by Li Lu	2016-04-13 10:38:17 -07:00
Naganarasimha	437e9d6475	YARN-4810. NM applicationpage cause internal error 500. Contributed by Bibin A Chundatt.	2016-04-12 17:59:46 +05:30
Vinod Kumar Vavilapalli	44bbc50d91	YARN-4168. Fixed a failing test TestLogAggregationService.testLocalFileDeletionOnDiskFull. Contributed by Takashi Ohnishi.	2016-04-11 12:11:14 -07:00
Jason Lowe	2a5da97f81	Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla" ... This reverts commit 1cbcd4a491.	2016-04-11 15:51:01 +00:00
Junping Du	08ddb3ac6d	YARN-4928. Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon. Contributed by Gergely Novák.	2016-04-11 08:48:32 -07:00
Akira Ajisaka	1ff27f9d12	YARN-4630. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.	2016-04-11 14:55:03 +09:00
Akira Ajisaka	1b78b2ba17	YARN-4938. MiniYarnCluster should not request transitionToActive to RM on non-HA environment. Contributed by Eric Badger.	2016-04-11 01:31:49 +09:00
Karthik Kambatla	ff95fd547b	YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha)	2016-04-09 10:31:02 -07:00
Wangda Tan	ec06957941	YARN-3215. Respect labels in CapacityScheduler when computing headroom. (Naganarasimha G R via wangda)	2016-04-08 15:33:04 -07:00
Jian He	9cb0c963d2	YARN-4740. AM may not receive the container complete msg when it restarts. Contributed by Jun Gong	2016-04-08 11:20:35 -07:00
Karthik Kambatla	e82f961a39	YARN-4756. Unnecessary wait in Node Status Updater during reboot. (Eric Badger via kasha)	2016-04-07 17:05:29 -07:00
Jian He	93bacda08b	YARN-4769. Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI. Contributed by Varun Vasudev	2016-04-06 16:13:47 -07:00
Varun Vasudev	b41e65e5bc	YARN-4906. Capture container start/finish time in container metrics. Contributed by Jian He.	2016-04-06 13:41:33 +05:30
Wangda Tan	21eb428448	YARN-4699. Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node. (Sunil G via wangda)	2016-04-05 16:24:11 -07:00
Junping Du	0005816743	YARN-4916. TestNMProxy.tesNMProxyRPCRetry fails. Contributed by Tibor Kiss.	2016-04-05 09:01:08 -07:00
Junping Du	6be28bcc46	YARN-4893. Fix some intermittent test failures in TestRMAdminService. Contributed by Brahma Reddy Battula.	2016-04-05 06:57:54 -07:00
Jason Lowe	1cbcd4a491	YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla	2016-04-05 13:40:19 +00:00
Rohith Sharma K S	776b549e2a	YARN-4609. RM Nodes list page takes too much time to load. Contributed by Bibin A Chundatt	2016-04-05 14:47:25 +05:30
Rohith Sharma K S	552237d4a3	YARN-4880. Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE. Contributed by Sunil G	2016-04-05 14:26:19 +05:30
naganarasimha	5092c94195	YARN-4746. yarn web services should convert parse failures of appId, appAttemptId and containerId to 400. Contributed by Bibin A Chundatt	2016-04-04 16:25:03 +05:30
Rohith Sharma K S	1e6f92977d	YARN-4607. Pagination support for AppAttempt page TotalOutstandingResource Requests table. Contributed by Bibin A Chundatt	2016-04-04 08:09:29 +05:30
Wangda Tan	12b11e2e68	YARN-4634. Scheduler UI/Metrics need to consider cases like non-queue label mappings. (Sunil G via wangda)	2016-03-31 14:35:18 -07:00
Jian He	0dd9bcab97	YARN-4811. Generate histograms in ContainerMetrics for actual container resource usage	2016-03-31 14:28:13 -07:00
Robert Kanter	7a021471c3	YARN-4639. Remove dead code in TestDelegationTokenRenewer added in YARN-3055 (templedf via rkanter)	2016-03-31 13:09:09 -07:00
Allen Wittenauer	0a74610d1c	HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw)	2016-03-31 07:51:05 -07:00
Jian He	60e4116bf1	YARN-4822. Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates. Contributed by Wangda Tan	2016-03-30 12:43:52 -07:00
Wangda Tan	fc055a3cbe	YARN-4865. Track Reserved resources in ResourceUsage and QueueCapacities. (Sunil G via wangda)	2016-03-29 17:07:55 -07:00
Xuan	80182809ae	YARN-4863. AHS Security login should be in serviceInit() instead of serviceStart(). Contributed by Junping Du	2016-03-28 22:17:45 -07:00
Jason Lowe	948b758070	YARN-4773. Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled. Contributed by Jun Gong	2016-03-28 23:00:56 +00:00
Jian He	524bc3c33a	YARN-998. Keep NM resource updated through dynamic resource config for RM/NM restart. Contributed by Junping Du	2016-03-28 11:12:33 -07:00
Jian He	55ae143923	YARN-4117. End to end unit test with mini YARN cluster for AMRMProxy Service. Contributed by Giovanni Matteo Fumarola	2016-03-27 20:22:12 -07:00
Karthik Kambatla	49ff54c860	YARN-4805. Don't go through all schedulers in ParameterizedTestBase. (kasha)	2016-03-26 21:45:13 -07:00
Arun Suresh	00bebb7e58	YARN-4823. Refactor the nested reservation id field in listReservation to simple string field. (subru via asuresh)	2016-03-25 15:54:38 -07:00
Arun Suresh	d82e797b65	YARN-4825. Remove redundant code in ClientRMService::listReservations. (subru via asuresh)	2016-03-24 09:59:55 -07:00
Allen Wittenauer	b1394d6307	YARN-4850. test-fair-scheduler.xml isn't valid xml (Yufei Gu via aw)	2016-03-24 08:15:58 -07:00
Junping Du	19b645c938	YARN-4820. ResourceManager web redirects in HA mode drops query parameters. Contributed by Varun Vasudev.	2016-03-23 19:34:30 -07:00
Eric Payne	92b7e0d413	YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger.	2016-03-18 16:12:47 +00:00
Junping Du	ca8106d2dd	YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API.	2016-03-17 09:04:41 -07:00
Karthik Kambatla	f84af8bd58	YARN-4812. TestFairScheduler#testContinuousScheduling fails intermittently. (kasha)	2016-03-17 05:54:06 -07:00
Wangda Tan	ae14e5d07f	YARN-4108. CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan) ... (cherry picked from commit 7e8c9beb41)	2016-03-16 17:02:33 -07:00
Wangda Tan	fa7a43529d	Revert "CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)" ... This reverts commit 7e8c9beb41.	2016-03-16 17:02:10 -07:00
Wangda Tan	7e8c9beb41	CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request. (Wangda Tan)	2016-03-16 16:59:59 -07:00
Karthik Kambatla	3ef5500783	YARN-4560. Make scheduler error checking message more user friendly. (Ray Chiang via kasha)	2016-03-15 23:45:01 -07:00
Robert Kanter	22ca176dfe	TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup (templedf via rkanter)	2016-03-15 10:05:10 -07:00
Karthik Kambatla	20d389ce61	YARN-4719. Add a helper library to maintain node state and allows common queries. (kasha)	2016-03-14 14:19:05 -07:00
Junping Du	f291d82cd4	YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du	2016-03-14 08:28:38 -07:00
Li Lu	017d2c127b	YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. ... This commit amends commit d49cfb3504 with a missed test file.	2016-03-10 13:02:28 -08:00
Li Lu	d49cfb3504	YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9)	2016-03-10 10:51:55 -08:00
Wangda Tan	0233d4e0ee	YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda)	2016-03-08 14:27:03 -08:00
Jian He	3c33158d1c	YARN-4764. Application submission fails when submitted queue is not available in scheduler xml. Contributed by Bibin A Chundatt	2016-03-08 13:07:57 -08:00
Vinod Kumar Vavilapalli	b2661765a5	YARN-4762. Fixed CgroupHandler's creation and usage to avoid NodeManagers crashing when LinuxContainerExecutor is enabled. (Sidharta Seethana via vinodkv)	2016-03-07 11:08:17 -08:00
Jason Lowe	4163e36c2b	YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger	2016-03-07 15:56:33 +00:00
Jason Lowe	059caf9989	YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana	2016-03-07 15:40:01 +00:00
Varun Vasudev	8ed2e060e8	YARN-4245. Generalize config file handling in container-executor. Contributed by Sidharta Seethana.	2016-03-07 16:18:35 +05:30
Varun Vasudev	e51a8c1056	YARN-4737. Add CSRF filter support in YARN. Contributed by Jonathan Maron.	2016-03-07 15:26:44 +05:30
Zhihai Xu	e1ccc9622b	YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee	2016-03-06 19:46:09 -08:00
Rohith Sharma K S	19ee185907	YARN-4763. RMApps Page crashes with NPE. (Bibin A Chundatt via rohithsharmaks)	2016-03-05 13:02:57 +05:30
Jian He	5c465df904	YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding	2016-03-01 13:14:12 -08:00
Jian He	d93c22ec27	YARN-4748. ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport. Contributed by Li Lu	2016-02-29 18:19:09 -08:00
Karthik Kambatla	9dafaaaf0d	YARN-4704. TestResourceManager#testResourceAllocation() fails when using FairScheduler. (Yufei Gu via kasha)	2016-02-29 16:10:12 -08:00
Haohui Mai	0fa54d45b1	HADOOP-12813. Migrate TestRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng.	2016-02-29 11:41:00 -08:00
Jason Lowe	c58a6d53c5	YARN-4731. container-executor should not follow symlinks in recursive_unlink_children. Contributed by Colin Patrick McCabe	2016-02-29 15:24:35 +00:00
Rohith Sharma K S	e0b14f26f5	YARN-4566. Fix test failure in TestMiniYarnClusterNodeUtilization. (Takashi Ohnishi via rohithsharmaks)	2016-02-29 10:38:14 +08:00
Karthik Kambatla	f9692770a5	YARN-4718. Rename variables in SchedulerNode to reduce ambiguity post YARN-1011. (Inigo Goiri via kasha)	2016-02-28 09:35:59 -08:00
Jason Lowe	6b0f813e89	YARN-4723. NodesListManager$UnknownNodeId ClassCastException. Contributed by Kuhu Shukla	2016-02-26 20:24:50 +00:00
Ming Ma	7f3139e54d	YARN-4720. Skip unnecessary NN operations in log aggregation. (Jun Gong via mingma)	2016-02-26 08:40:05 -08:00
Robert Kanter	d7fdec1e6b	YARN-4579. Allow DefaultContainerExecutor container log directory permissions to be configurable (rchiang via rkanter)	2016-02-25 16:36:38 -08:00
Karthik Kambatla	c684f2b007	YARN-4729. SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE. (kasha)	2016-02-24 18:33:57 -08:00
Robert Kanter	954dd57043	YARN-4697. NM aggregation thread pool is not bound by limits (haibochen via rkanter)	2016-02-24 15:00:24 -08:00
Sangjin Lee	553b591ba0	YARN-4722. AsyncDispatcher logs redundant event queue sizes (Jason Lowe via sjlee)	2016-02-24 09:29:41 -08:00
Jason Lowe	d284e187b8	YARN-2046. Out of band heartbeats are sent only on container kill and possibly too early. Contributed by Ming Ma	2016-02-23 20:49:09 +00:00
Junping Du	9ed17f181d	YARN-3223. Resource update during NM graceful decommission. Contributed by Brook Zhou.	2016-02-23 03:30:26 -08:00
Tsuyoshi Ozawa	0e12114c9c	YARN-4648. Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption. Contributed by Kai Sasaki.	2016-02-23 19:50:08 +09:00
Varun Vasudev	140cb5d745	YARN-4709. NMWebServices produces incorrect JSON for containers. Contributed by Varun Saxena.	2016-02-23 12:29:25 +05:30
Junping Du	3fab88540f	YARN-4386. refreshNodesGracefully() should send recommission event to active RMNodes only. Contributed by Kuhu Shukla.	2016-02-22 07:04:19 -08:00
Sangjin Lee	7de70680fe	YARN-4690. Skip object allocation in FSAppAttempt#getResourceUsage when possible (Ming Ma via sjlee)	2016-02-17 20:55:21 -08:00
Karthik Kambatla	2ab4c476ed	YARN-4689. FairScheduler: Cleanup preemptContainer to be more readable. (Kai Sasaki via kasha)	2016-02-17 18:16:15 -08:00
Arun Suresh	23f937e3b7	YARN-2575. Create separate ACLs for Reservation create/update/delete/list ops (Sean Po via asuresh)	2016-02-11 10:47:43 -08:00
Varun Vasudev	fa00d3e205	YARN-4655. Log uncaught exceptions/errors in various thread pools in YARN. Contributed by Sidharta Seethana.	2016-02-11 12:06:42 +05:30
Jian He	d16b17b4d2	YARN-4138. Roll back container resource allocation after resource increase token expires. Contributed by Meng Ding	2016-02-11 10:06:27 +08:00
=	b706cbc1bc	YARN-4420. Add REST API for List Reservations (Sean Po via curino)	2016-02-10 10:19:26 -08:00
Arun Suresh	5cf5c41a89	YARN-4360. Improve GreedyReservationAgent to support "early" allocations, and performance improvements (curino via asuresh)	2016-02-10 09:11:15 -08:00
Devaraj K	565af873d5	YARN-4667. RM Admin CLI for refreshNodesResources throws NPE when nothing ... is configured. Contributed by Naganarasimha G R.	2016-02-08 15:01:54 +05:30
Varun Vasudev	22a2b2231d	YARN-4669. Fix logging statements in resource manager's Application class. Contributed by Sidharta Seethana.	2016-02-04 13:51:25 +05:30
Varun Vasudev	308d63f382	YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R.	2016-02-04 13:32:54 +05:30
Jason Lowe	fa328e2d39	YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe	2016-02-03 17:21:12 +00:00
Varun Vasudev	1adb64e09b	YARN-4625. Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent. Contributed by Xuan Gong.	2016-02-03 16:26:28 +05:30
Varun Vasudev	1cd55e0c17	YARN-4649. Add additional logging to some NM state store operations. Contributed by Sidharta Seethana	2016-02-02 09:25:23 +05:30
Wangda Tan	9875325d5c	YARN-4340. Add list API to reservation system. (Sean Po via wangda)	2016-02-02 10:17:33 +08:00
Jason Lowe	ed55950164	YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla	2016-02-01 23:15:26 +00:00
Rohith Sharma K S	2673cbaf55	YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks)	2016-02-01 10:43:56 +05:30
Jason Lowe	772ea7b41b	YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li	2016-01-29 21:48:54 +00:00
Jian He	f4a57d4a53	YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S	2016-01-29 12:22:23 -08:00
Karthik Kambatla	c9a09d6926	YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha)	2016-01-29 08:12:54 -08:00
Devaraj K	a277bdc9ed	YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws ... IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.	2016-01-29 13:51:37 +05:30
Rohith Sharma K S	ac68666803	YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks)	2016-01-29 12:29:54 +05:30
Rohith Sharma K S	09d831c95b	YARN-4219. addendum patch to fix javadoc errors	2016-01-29 11:51:47 +05:30
Jian He	7f46636495	YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding	2016-01-28 14:51:00 -08:00
Xuan	9fab22b366	YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by ... Li Lu	2016-01-28 14:24:22 -08:00
Jason Lowe	61382ff8fa	YARN-4643. Container recovery is broken with delegating container runtime. Contributed by Sidharta Seethana	2016-01-28 18:59:35 +00:00
Rohith Sharma K S	ef343be82b	YARN-4633. Fix random test failure in TestRMRestart#testRMRestartAfterPreemption. (Bibin A Chundatt via rohithsharmaks)	2016-01-28 21:53:45 +05:30
Karthik Kambatla	fb238d7e5d	YARN-4462. FairScheduler: Disallow preemption from a queue. (Tao Jie via kasha)	2016-01-27 12:29:06 -08:00
Rohith Sharma K S	c01bee0108	YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks)	2016-01-27 08:23:02 +05:30
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	2085e60a96	YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev.	2016-01-25 16:19:36 -08:00
Jian He	992dd2f783	YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee	2016-01-25 15:36:14 -08:00
rohithsharmaks	10dc2c0493	YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks)	2016-01-24 23:36:15 +05:30
rohithsharmaks	99829eb221	YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks)	2016-01-23 07:56:57 +05:30
Xuan	618bfd6ac2	YARN-4496. Improve HA ResourceManager Failover detection on the client. ... Contributed by Jian He	2016-01-22 18:20:38 -08:00
Jason Lowe	46e5ea81e0	YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen	2016-01-22 21:55:01 +00:00
rohithsharmaks	d6258b33a7	YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks)	2016-01-22 20:27:38 +05:30
Akira Ajisaka	8f58f742ae	YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang.	2016-01-22 19:43:06 +09:00
Varun Vasudev	b41a7e89d1	YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana.	2016-01-22 14:43:14 +05:30
Rohith Sharma K S	e30668106d	YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks)	2016-01-22 10:14:46 +05:30
Jason Lowe	468a53b22f	YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe	2016-01-21 18:31:29 +00:00
Karthik Kambatla	4992398aee	YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha)	2016-01-21 17:40:59 +01:00
Wangda Tan	5ff5f67332	YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda)	2016-01-21 11:21:06 +08:00
Xuan	890a2ebd1a	YARN-4559. Make leader elector and zk store share the same curator ... client. Contributed by Jian He	2016-01-20 14:48:10 -08:00
Wangda Tan	89d1fd5dac	HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)	2016-01-19 21:27:38 +08:00
Jian He	edc43a9097	YARN-4565. Fix a bug that leads to AM resource limit not hornored when sizeBasedWeight enabled for FairOrderingPolicy. Contributed by Wangda Tan	2016-01-18 21:04:36 -08:00
Wangda Tan	a44ce3f14f	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)	2016-01-19 09:30:04 +08:00
Wangda Tan	150f5ae034	Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" ... This reverts commit 3fe5728563. Conflicts: hadoop-yarn-project/CHANGES.txt	2016-01-19 09:27:36 +08:00
Jian He	f385851141	YARN-4596. SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities. Contributed by Li Lu	2016-01-18 16:58:39 -08:00
Karthik Kambatla	d40859fab1	YARN-4526. Make SystemClock singleton so AppSchedulingInfo could use it. (kasha)	2016-01-18 10:58:14 +01:00
Wangda Tan	3fe5728563	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda) ... (cherry picked from commit 805a9ed85e)	2016-01-18 17:06:05 +08:00
Wangda Tan	adf260a728	Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)" ... This reverts commit 805a9ed85e.	2016-01-18 16:50:45 +08:00
Wangda Tan	b08ecf5c75	YARN-4304. AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics. (Sunil G via wangda)	2016-01-18 11:11:32 +08:00
Wangda Tan	805a9ed85e	YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)	2016-01-18 11:04:25 +08:00
Wangda Tan	9523648d57	YARN-4538. QueueMetrics pending cores and memory metrics wrong. (Bibin A Chundatt via wangda)	2016-01-18 10:57:14 +08:00
Junping Du	02f597c5db	YARN-4265. Provide new timeline plugin storage to support fine-grained entity caching. Contributed by Li Lu and Jason Lowe	2016-01-17 17:37:40 -08:00
Colin Patrick Mccabe	b2c155f810	HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)	2016-01-15 12:29:18 -08:00
Junping Du	fc6d3a3b23	YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee.	2016-01-15 08:40:56 -08:00
rohithsharmaks	f7736f464f	YARN-4389. Allow application to enable or disable am blacklisting. (Sunil G via rohithsharmaks)	2016-01-15 21:38:26 +05:30
Colin Patrick Mccabe	b1ed28fa77	HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)	2016-01-14 11:02:34 -08:00
Karthik Kambatla	9d04f26d4c	YARN-3446. FairScheduler headroom calculation should exclude nodes in the blacklist. (Zhihai Xu via kasha)	2016-01-14 08:33:23 -08:00
Varun Vasudev	3ddb92bd30	YARN-4553. Add cgroups support for docker containers. Contributed by Sidharta Seethana.	2016-01-14 14:29:29 +05:30
Karthik Kambatla	321072ba81	YARN-4551. Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions. (Sunil G via kasha)	2016-01-13 12:09:34 -08:00
Wangda Tan	c0537bcd2c	YARN-4571. Make app id/name available to the yarn authorizer provider for better auditing. (Jian He via wangda)	2016-01-13 13:18:31 +08:00
Jason Lowe	13de8359a1	YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li	2016-01-12 15:56:15 +00:00
Akira Ajisaka	da1e3e3c57	YARN-4567. javadoc failing on java 8. Contributed by Steve Loughran. This closes #67.	2016-01-12 15:12:17 +09:00
Wangda Tan	9e792da014	YARN-4582. Label-related invalid resource request exception should be able to properly handled by application. (Bibin A Chundatt via wangda)	2016-01-12 12:53:31 +08:00
Jian He	5fab4ec31c	Missing file for YARN-4580	2016-01-11 17:00:44 -08:00
Jian He	b8942be888	YARN-4537. Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy. Contributed by Rohith Sharma K S	2016-01-11 16:44:28 -08:00
Jian He	109e528ef5	YARN-4479. Change CS LeafQueue pendingOrderingPolicy to hornor recovered apps. Contributed by Rohith Sharma K S	2016-01-08 15:51:10 -08:00
Xuan	89022f8d4b	YARN-4438. Implement RM leader election with curator. Contributed by Jian He	2016-01-07 14:33:06 -08:00
Akira Ajisaka	52b77577c4	YARN-4544. All the log messages about rolling monitoring interval are shown with WARN level. Contributed by Takashi Ohnishi.	2016-01-08 01:12:46 +09:00
Steve Loughran	07d1cb612c	YARN-4550. Some tests in TestContainerLanch fails on non-english locale environment. (Takashi Ohnishi via stevel)	2016-01-07 14:30:20 +00:00
rohithsharmaks	791c1639ae	YARN-4393. Fix intermittent test failure for TestResourceLocalizationService#testFailedDirsResourceRelease (Varun Saxana via rohithsharmaks)	2016-01-07 09:38:47 +05:30
Junping Du	c1462a67ff	YARN-4546. ResourceManager crash due to scheduling opportunity overflow. Contributed by Jason Lowe.	2016-01-06 05:49:24 -08:00
rohithsharmaks	6da6d87872	YARN-4535. Fix checkstyle error in CapacityScheduler.java (Naganarasimha G R via rohithsharmaks)	2016-01-05 12:09:57 +05:30
Rohith Sharma K S	f9e36dea96	YARN-4530. LocalizedResource trigger a NPE Cause the NodeManager exit. (tangshangwen via rohithsharmaks)	2016-01-04 09:58:13 +05:30
Wangda Tan	4e4b3a8465	YARN-4524. Cleanup AppSchedulingInfo. (Karthik Kambatla via wangda) ... (cherry picked from commit 05fa852d7567b7590d6b53bbf925f8f424736514)	2015-12-30 15:39:34 -08:00
Wangda Tan	8310b2e9ff	YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)	2015-12-30 15:30:12 -08:00
Junping Du	223ce323bb	YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S.	2015-12-30 07:52:07 -08:00
Jian He	5273413411	YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong	2015-12-29 15:58:39 -08:00
Wangda Tan	561abb9fee	YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda)	2015-12-29 13:28:00 -08:00
Jian He	d0a22bae9b	YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan	2015-12-28 15:52:45 -08:00
Gera Shegalov	2c17b81569	YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)	2015-12-24 23:48:05 -08:00
Karthik Kambatla	0af492b4bd	YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha)	2015-12-23 17:52:36 -08:00
Junping Du	882f2f0464	YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.	2015-12-23 05:26:51 -08:00
rohithsharmaks	8c180a13c8	YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks)	2015-12-23 09:12:32 +05:30
Arun Suresh	e88422df45	YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh)	2015-12-21 22:41:09 -08:00
Wangda Tan	bc038b382c	YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)	2015-12-21 11:30:13 -08:00
Uma Mahesh	0f82b5d878	YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh)	2015-12-19 23:10:13 -08:00
Jian He	85c2466048	YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S	2015-12-18 14:13:48 -08:00
Junping Du	1de56b0448	YARN-3226. UI changes for decommissioning node. Contributed by Sunil G.	2015-12-17 15:20:17 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	4e7d32c0db	YARN-1856. Added cgroups based memory monitoring for containers as another alternative to custom memory-monitoring. Contributed by Varun Vasudev.	2015-12-17 12:13:03 -08:00
Jason Lowe	91828fef6b	YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne	2015-12-16 23:22:31 +00:00
Wangda Tan	9b856d9787	YARN-4416. Deadlock due to synchronised get Methods in AbstractCSQueue. (Naganarasimha G R via wangda)	2015-12-16 13:22:37 -08:00
Wangda Tan	7faa406f27	YARN-4225. Add preemption status to yarn queue -status for capacity scheduler. (Eric Payne via wangda)	2015-12-16 13:19:40 -08:00
Wangda Tan	79c41b1d83	YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)	2015-12-16 13:18:19 -08:00
Junping Du	50bd067e1d	YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R.	2015-12-16 10:57:39 -08:00
Zhihai Xu	2aaed10327	YARN-4440. FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time. Contributed by Lin Yiqun	2015-12-15 00:17:21 -08:00
Xuan	d8a45425eb	YARN-4439. Clarify NMContainerStatus#toString method. Contributed by ... Jian He	2015-12-14 15:41:28 -08:00
Jian He	915cd6c3f4	YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula	2015-12-14 14:59:01 -08:00
Jian He	1cb3299b48	YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du	2015-12-14 13:51:23 -08:00
Wangda Tan	07b0fb996a	YARN-4418. AM Resource Limit per partition can be updated to ResourceUsage as well. (Sunil G via wangda)	2015-12-14 11:24:30 -08:00
Wangda Tan	dfcbbddb09	YARN-4309. Add container launch related debug information to container logs when a container fails. (Varun Vasudev via wangda)	2015-12-14 11:13:22 -08:00
Wangda Tan	6cb0af3c39	YARN-3946. Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message. (Naganarasimha G R via wangda)	2015-12-14 10:52:46 -08:00
Arun Suresh	7fb212e5e6	YARN-4358 addendum patch to fix javadoc error	2015-12-12 22:22:55 -08:00
rohithsharmaks	a5e2e1ecb0	YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks)	2015-12-09 11:31:51 +05:30
rohithsharmaks	15c3e7ffe3	YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks)	2015-12-09 10:50:43 +05:30
Wangda Tan	7e4715186d	YARN-4424. Fix deadlock in RMAppImpl. (Jian he via wangda)	2015-12-08 14:25:16 -08:00
Chris Douglas	9f50e13d5d	YARN-4248. Followup patch adding asf-licence exclusions for json test files	2015-12-08 12:08:04 -08:00
=	c25a635459	YARN-4248. REST API for submit/update/delete Reservations. (curino)	2015-12-07 13:33:28 -08:00
Jonathan Eagles	4ff973f96a	YARN-4422. Generic AHS sometimes doesn't show started, node, or logs on App page (Eric Payne via jeagles)	2015-12-07 15:04:48 -06:00
Xuan	4546c7582b	YARN-4392. ApplicationCreatedEvent event time resets after RM ... restart/failover. Contributed by Naganarasimha G R and Xuan Gong	2015-12-07 12:24:55 -08:00
rohithsharmaks	01a641bc44	YARN-3456. Improve handling of incomplete TimelineEntities. (Varun Saxena via rohithsharmaks)	2015-12-07 15:16:56 +05:30
Steve Loughran	65f395226b	HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072]	2015-12-06 17:43:35 +00:00
Arun Suresh	742632e346	YARN-4358. Reservation System: Improve relationship between SharingPolicy and ReservationAgent. (Carlo Curino via asuresh)	2015-12-05 21:26:16 -08:00
Jian He	755dda8dd8	YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan	2015-12-03 17:45:31 -08:00
Wangda Tan	a2c3bfc8c1	YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda)	2015-12-03 14:28:32 -08:00
Jian He	9f77ccad73	YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena	2015-12-03 12:48:50 -08:00
Junping Du	62e9348bc1	YARN-4408. Fix issue that NodeManager still reports negative running containers. Contributed by Robert Kanter.	2015-12-03 06:36:37 -08:00
Jian He	6b9a5beb2b	YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding	2015-12-02 11:07:18 -08:00
Tsuyoshi Ozawa	0656d2dc83	YARN-4380. TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently. Contributed by Varun Saxena.	2015-11-26 01:10:02 +09:00
Jason Lowe	4ac6799d4a	YARN-4132. Separate configs for nodemanager to resourcemanager connection timeout and retries. Contributed by Chang Li	2015-11-24 22:35:37 +00:00
Tsuyoshi Ozawa	28dfe721b8	YARN-4387. Fix typo in FairScheduler log message. Contributed by Xin Wang.	2015-11-24 19:24:01 +09:00
Karthik Kambatla	52948bb20b	YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)	2015-11-24 13:47:17 +05:30
Jian He	8676a118a1	YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan	2015-11-23 17:19:48 -08:00
Jason Lowe	d36b6e045f	YARN-4344. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations. Contributed by Varun Vasudev	2015-11-23 20:30:26 +00:00
Arun Suresh	da1016365a	YARN-3454. Add efficient merge operation to RLESparseResourceAllocation (Carlo Curino via asuresh)	2015-11-21 09:59:41 -08:00
Wangda Tan	2346fa3141	YARN-3769. Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler. (Eric Payne via wangda)	2015-11-20 15:55:50 -08:00
Jason Lowe	060cdcbe5d	YARN-4374. RM capacity scheduler UI rounds user limit factor. Contributed by Chang Li	2015-11-20 23:12:29 +00:00
Xuan	f114e728da	YARN-2859.addendum: fix the remaining issue from the previous patch	2015-11-19 10:08:38 -08:00
Arun Suresh	6a61928fb7	YARN-4184. Remove update reservation state api from state store as its not used by ReservationSystem (Sean Po via asuresh)	2015-11-17 15:50:34 -08:00
Jian He	fcd7888029	Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan" ... This reverts commit 8fbea531d7. Conflicts: hadoop-yarn-project/CHANGES.txt	2015-11-16 20:18:44 -08:00
Junping Du	855d52927b	YARN-4354. Public resource localization fails with NPE. Contributed by Jason Lowe.	2015-11-15 04:43:57 -08:00
Wangda Tan	7f55a18071	YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda)	2015-11-12 11:23:40 -08:00
Wangda Tan	796638d9bc	YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda)	2015-11-12 11:09:37 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)	6351d3fa63	YARN-4183. Reverting the patch to fix behaviour change. ... Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)" This reverts commit c293c58954.	2015-11-11 10:40:43 -08:00
Jian He	8fbea531d7	YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan	2015-11-09 10:43:45 -08:00
Tsuyoshi Ozawa	ce31b22739	YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena.	2015-10-30 18:00:20 +09:00
Jian He	e5b1733e04	YARN-4127. RM fail with noAuth error if switched from failover to non-failover. Contributed by Varun Saxena	2015-10-29 15:42:57 -07:00
Jonathan Eagles	c293c58954	YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)	2015-10-29 16:41:10 -05:00
Arun Suresh	58d1df585c	YARN-4310. FairScheduler: Log skipping reservation messages at DEBUG level (asuresh)	2015-10-29 13:42:09 -07:00
Jason Lowe	e2267de207	YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena	2015-10-29 16:34:25 +00:00
Rohith Sharma K S	656c8f9527	YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks)	2015-10-29 12:22:44 +05:30
Xuan	27414dac66	YARN-2859. ApplicationHistoryServer binds to default port 8188 in ... MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli	2015-10-28 10:32:16 -07:00
Tsuyoshi Ozawa	96677bef00	YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula.	2015-10-27 12:35:01 +09:00
Akira Ajisaka	8a68630dd1	YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka)	2015-10-27 10:28:01 +09:00
Wangda Tan	56e4f6237a	YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda)	2015-10-26 16:44:39 -07:00
Wangda Tan	6f606214e7	YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda)	2015-10-26 16:36:34 -07:00
Wangda Tan	3cc73773eb	YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda)	2015-10-26 13:07:39 -07:00
Jason Lowe	33a03af3c3	YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee	2015-10-26 19:53:03 +00:00
Rohith Sharma K S	5acdde4744	YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks)	2015-10-26 15:42:42 +05:30
Tsuyoshi Ozawa	ce60b4fc8b	YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula.	2015-10-26 16:45:11 +09:00
Allen Wittenauer	1aa735c188	YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw)	2015-10-25 21:43:23 -07:00
Arun Suresh	ab8eb8770c	YARN-3738. Add support for recovery of reserved apps running under dynamic queues (subru via asuresh)	2015-10-24 22:53:10 -07:00
Akira Ajisaka	7781fe1b9e	YARN-4294. [JDK8] Fix javadoc errors caused by wrong reference and illegal tag. (aajisaka)	2015-10-24 11:54:42 +09:00
Jason Lowe	d3a34a4f38	YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G	2015-10-23 20:57:01 +00:00
Ming Ma	934d96a334	YARN-2913. Fair scheduler should have ability to set MaxResourceDefault for each queue. (Siqi Li via mingma)	2015-10-23 08:36:33 -07:00
Jonathan Eagles	f8adeb712d	YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles)	2015-10-23 10:34:08 -05:00
Junping Du	0fce5f9a49	YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong.	2015-10-22 13:41:09 -07:00
Zhihai Xu	960201b79b	YARN-4256. YARN fair scheduler vcores with decimal values. Contributed by Jun Gong	2015-10-22 12:28:03 -07:00
Anubhav Dhoot	2798723a54	YARN-3739. Add reservation system recovery to RM recovery process. Contributed by Subru Krishnan.	2015-10-22 06:51:00 -07:00
Jonathan Eagles	25f8f801d1	YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles)	2015-10-21 15:38:08 -05:00
Arun Suresh	506d1b1dbc	YARN-3985. Make ReservationSystem persist state using RMStateStore reservation APIs. (adhoot via asuresh)	2015-10-20 16:46:14 -07:00
Arun Suresh	7e2837f830	YARN-4270. Limit application resource reservation on nodes for non-node/rack specific requests (asuresh)	2015-10-19 20:00:38 -07:00
Varun Vasudev	151eab2a12	YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana.	2015-10-19 20:56:01 +05:30
Varun Vasudev	e39ae0e676	YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana.	2015-10-19 20:19:22 +05:30
Steve Loughran	e2d59e2c7b	YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel)	2015-10-18 12:03:57 +01:00
Jian He	f9da5cdb2b	YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G	2015-10-16 15:26:27 -07:00
Wangda Tan	4337b263aa	YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda)	2015-10-16 15:06:28 -07:00
Jian He	cf23f2c2b5	YARN-4000. RM crashes with NPE if leaf queue becomes parent queue during restart. Contributed by Varun Saxena	2015-10-15 17:12:46 -07:00
Varun Vasudev	63020c54c1	YARN-4258. Add support for controlling capabilities for docker containers. Contributed by Sidharta Seethana.	2015-10-15 13:41:20 +05:30
Steve Loughran	dfa7848463	HADOOP-12478. Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath(). (stevel)	2015-10-14 20:25:47 +01:00
rohithsharmaks	d6c8bad869	YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks)	2015-10-14 16:11:34 +05:30
Varun Vasudev	da1ee078f9	YARN-4255. container-executor does not clean up docker operation command files. Contributed by Sidharta Seethana.	2015-10-14 15:25:21 +05:30
Varun Vasudev	fb9c1519b3	YARN-4252. Log container-executor invocation details when exit code is non-zero. Contributed by Sidharta Seethana.	2015-10-14 15:18:08 +05:30
Varun Vasudev	8d59293089	YARN-4253. Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor. Contributed by Sidharta Seethana.	2015-10-14 14:58:10 +05:30
Steve Loughran	c59af2fdf8	HADOOP-10775. Shell operations to fail with meaningful errors on windows if winutils.exe not found. (stevel)	2015-10-13 21:49:28 +01:00
Varun Vasudev	5b6bae0094	YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana	2015-10-13 12:48:30 +05:30
Jian He	9849c8b386	YARN-4230. RM crashes with NPE when increasing container resource if there is no headroom left. Contributed by Meng Ding	2015-10-12 11:51:33 -07:00
Zhihai Xu	049c6e8dc0	YARN-4201. AMBlacklist does not work for minicluster. Contributed by Jun Gong.	2015-10-12 00:14:25 -07:00
Devaraj K	db93047881	YARN-3964. Support NodeLabelsProvider at Resource Manager side. ... Contributed by Dian Fu.	2015-10-11 11:21:29 +05:30
Wangda Tan	def374e666	YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda)	2015-10-09 16:38:59 -07:00
Karthik Kambatla	4aa9b3e75c	MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha)	2015-10-09 07:37:39 -07:00
Jason Lowe	a0bca2b5ad	YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S	2015-10-09 14:17:38 +00:00
Rohith Sharma K S	8f195387a4	YARN-4235. FairScheduler PrimaryGroup does not handle empty groups returned for a user. (Anubhav Dhoot via rohithsharmaks)	2015-10-09 10:09:26 +05:30
Jason Lowe	8d226225d0	YARN-3943. Use separate threshold configurations for disk-full detection and disk-not-full detection. Contributed by Zhihai Xu	2015-10-08 22:25:34 +00:00
Rohith Sharma K S	3793cbe4c3	YARN-4228. FileSystemRMStateStore use IOUtils#close instead of fs#close. (Bibin A Chundatt via rohithsharmaks)	2015-10-07 10:12:14 +05:30
Rohith Sharma K S	9156fc60c6	YARN-4209. RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition. (Zhihai Xu via rohithsharmaks)	2015-10-07 09:34:59 +05:30
Wangda Tan	29a582ada0	YARN-4215. RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request. (Naganarasimha G R via wangda)	2015-10-06 11:56:04 -07:00
Wangda Tan	30ac69c6bd	YARN-4176. Resync NM nodelabels with RM periodically for distributed nodelabels. (Bibin A Chundatt via wangda)	2015-10-05 15:47:21 -07:00
Vinod Kumar Vavilapalli	f1c19b9365	HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some Linux distributions after HADOOP-12317. Contributed by Wangda Tan.	2015-10-05 10:56:55 -07:00
Harsh J	c918f7be5e	HADOOP-12458. Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common. Contributed by Neelesh Srinivas Salian.	2015-10-03 18:37:58 +05:30
Xuan	8f08532bde	YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma	2015-10-02 18:50:47 -07:00
Jason Lowe	fdf02d1f26	YARN-3619. ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException. Contributed by Zhihai Xu	2015-10-02 20:20:31 +00:00
Jason Lowe	854d25b0c3	YARN-3727. For better error recovery, check if the directory exists before using it for localization. Contributed by Zhihai Xu	2015-09-30 14:59:44 +00:00
Karthik Kambatla	a0b5a0a419	YARN-4066. Large number of queues choke fair scheduler. (Johan Gustavsson via kasha)	2015-09-29 07:55:34 -07:00
Anubhav Dhoot	9735afe967	YARN-4180. AMLauncher does not retry on failures when talking to NM. (adhoot)	2015-09-28 16:13:41 -07:00
Jason Lowe	9f53a95ff6	YARN-4141. Runtime Application Priority change should not throw exception for applications at finishing states. Contributed by Sunil G	2015-09-28 22:55:20 +00:00
Anubhav Dhoot	fb2e525c07	YARN-4204. ConcurrentModificationException in FairSchedulerQueueInfo. (adhoot)	2015-09-28 09:05:45 -07:00
Xuan	d1b9b85244	YARN-3624. ApplicationHistoryServer should not reverse the order of the ... filters it gets. Contributed by Mit Desai	2015-09-24 15:01:17 -07:00
Rohith Sharma K S	a9aafad12b	YARN-4044. Running applications information changes such as movequeue is not published to TimeLine server. (Sunil G via rohithsharmaks)	2015-09-24 12:13:22 +05:30
Rohith Sharma K S	8ed0d4b744	YARN-4152. NodeManager crash with NPE when LogAggregationService#stopContainer called for absent container. (Bibin A Chundatt via rohithsharmaks)	2015-09-24 11:24:14 +05:30
Jian He	b3f6b641dc	YARN-4171. Fix findbugs warnings in YARN-1197 branch. Contributed by Wangda Tan	2015-09-23 13:29:38 -07:00
Jian He	89cab1ba5f	YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan	2015-09-23 13:29:38 -07:00
Jian He	c57eac5dfe	YARN-3868. Recovery support for container resizing. Contributed by Meng Ding	2015-09-23 13:29:38 -07:00
Jian He	c3dc1af072	YARN-1644. RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing. Contributed by Meng Ding	2015-09-23 13:29:37 -07:00
Jian He	c59ae4eeb1	YARN-1643. Make ContainersMonitor support changing monitoring size of an allocated container. Contributed by Meng Ding and Wangda Tan	2015-09-23 13:29:37 -07:00
Jian He	5f5a968d65	YARN-3867. ContainerImpl changes to support container resizing. Contributed by Meng Ding	2015-09-23 13:29:37 -07:00
Jian He	ffd820c27a	YARN-1645. ContainerManager implementation to support container resizing. Contributed by Meng Ding & Wangda Tan	2015-09-23 13:29:37 -07:00
Jian He	83a18add10	YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan)	2015-09-23 13:29:36 -07:00
Jason Lowe	692d51c09d	YARN-3975. WebAppProxyServlet should not redirect to RM page if AHS is enabled. Contributed by Mit Desai	2015-09-23 16:38:55 +00:00
Jason Lowe	c890c51a91	YARN-4095. Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Contributed by Zhihai Xu	2015-09-23 15:42:01 +00:00
Tsuyoshi Ozawa	dfd807afab	HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.	2015-09-22 12:54:29 +09:00
Rohith Sharma K S	c9cb6a5960	YARN-4167. NPE on RMActiveServices#serviceStop when store is null. (Bibin A Chundatt via rohithsharmaks)	2015-09-21 09:59:30 +05:30
Arun Suresh	94dec5a916	YARN-3920. FairScheduler container reservation on a node should be configurable to limit it to large containers (adhoot via asuresh)	2015-09-18 14:02:55 -07:00
Wangda Tan	9bc913a35c	YARN-3212. RMNode State Transition Update with DECOMMISSIONING state. (Junping Du via wangda)	2015-09-18 10:04:17 -07:00
Steve Loughran	a7201d635f	YARN-2597 MiniYARNCluster should propagate reason for AHS not starting	2015-09-18 09:45:35 +01:00
Rohith Sharma K S	723c31d45b	YARN-4135. Improve the assertion message in MockRM while failing after waiting for the state.(Nijel S F via rohithsharmaks)	2015-09-18 08:44:10 +05:30
Jian He	6c6e734f0b	YARN-4034. Render cluster Max Priority in scheduler metrics in RM web UI. Contributed by Rohith Sharma K S	2015-09-17 14:55:50 +08:00
Jian He	452079af8b	YARN-4078. Add getPendingResourceRequestForAttempt in YarnScheduler interface. Contributed by Naganarasimha G R	2015-09-16 14:59:20 +08:00
Xuan	34ef1a092b	YARN-4149. yarn logs -am should provide an option to fetch all the log ... files. Contributed by Varun Vasudev	2015-09-15 14:36:30 -07:00
Jason Lowe	8c1cdb17a0	YARN-4158. Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers. Contributed by Zhihai Xu	2015-09-15 20:21:33 +00:00
Wangda Tan	ae5308fe1d	YARN-3717. Expose app/am/queue's node-label-expression to RM web UI / CLI / REST-API. (Naganarasimha G R via wangda)	2015-09-15 11:40:50 -07:00
Junping Du	73e3a49eb0	YARN-313. Add Admin API for supporting node resource configuration in command line. (Contributed by Inigo Goiri, Kenji Kikushima and Junping Du)	2015-09-15 07:56:47 -07:00
Jian He	5468baa80a	YARN-3635. Refactored current queue mapping implementation in CapacityScheduler to use a generic PlacementManager framework. Contributed by Wangda Tan	2015-09-15 15:39:20 +08:00
Wangda Tan	e2a0270217	YARN-4151. Fix findbugs errors in hadoop-yarn-server-common module. (Meng Ding via wangda)	2015-09-14 16:00:43 -07:00
Jian He	e1b1d7e4ae	YARN-4126. RM should not issue delegation tokens in unsecure mode. Contributed by Bibin A Chundatt	2015-09-14 14:09:19 +08:00
Karthik Kambatla	332b520a48	YARN-3697. FairScheduler: ContinuousSchedulingThread can fail to shutdown. (Zhihai Xu via kasha)	2015-09-13 18:07:43 -07:00
Karthik Kambatla	81df7b586a	YARN-2005. Blacklisting support for scheduling AMs. (Anubhav Dhoot via kasha)	2015-09-13 17:03:15 -07:00
Steve Loughran	7269906254	HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).	2015-09-13 14:25:26 +01:00
Robert Kanter	ea4bb2749f	YARN-4145. Make RMHATestBase abstract so its not run when running all tests under that namespace (adhoot via rkanter)	2015-09-11 11:46:10 -07:00
Varun Vasudev	486d5cb803	YARN-4136. LinuxContainerExecutor loses info when forwarding ResourceHandlerException. Contributed by Bibin A Chundatt.	2015-09-11 14:37:48 +05:30
Wangda Tan	77666105b4	YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda)	2015-09-10 09:30:09 -07:00
Zhihai Xu	16b9037dc1	YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe.	2015-09-08 12:29:54 -07:00
Jian He	6f72f1e600	YARN-2884. Added a proxy service in NM to proxy the the communication between AM and RM. Contributed by Kishore Chaliparambil	2015-09-08 09:35:46 +08:00
Xuan	9b78e6e33d	YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when ... state-store error occurs. Contributed by Jian He	2015-09-07 17:45:47 -07:00
Varun Vasudev	1dbd8e34a7	YARN-3591. Resource localization on a bad disk causes subsequent containers failure. Contributed by Lavkesh Lahngir.	2015-09-07 11:32:12 +05:30
Wangda Tan	bcc85e3bab	YARN-4024. YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat. (Hong Zhiguo via wangda)	2015-09-04 15:13:53 -07:00
Jason Lowe	6eaca2e363	YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li	2015-09-04 15:30:53 +00:00
Varun Vasudev	40d222e862	YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.	2015-09-04 14:31:51 +05:30
Varun Vasudev	b469ac531a	YARN-3970. Add REST api support for Application Priority. Contributed by Naganarasimha G R.	2015-09-03 16:40:10 +05:30
Jian He	09c64ba1ba	YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong	2015-09-02 17:45:23 -07:00
Rohith Sharma K S	7d6687fe76	YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)	2015-09-02 15:22:48 +05:30
Rohith Sharma K S	095ab9ab5f	YARN-4073. Removed unused ApplicationACLsManager in ContainerManagerImpl constructor. (Naganarasimha G R via rohithsharmaks)	2015-09-02 14:13:33 +05:30
Varun Vasudev	bf669b6d9f	YARN-4082. Container shouldn't be killed when node's label updated. Contributed by Wangda Tan.	2015-09-01 14:19:11 +05:30
Jian He	a3fd2ccc86	YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong	2015-08-31 17:33:24 -07:00
Junping Du	beb65c9465	YARN-1556. NPE getting application report with a null appId. Contributed by Weiwei Yang.	2015-08-28 05:57:34 -07:00
Jian He	a9c8ea71aa	YARN-3250. Support admin cli interface in for Application Priority. Contributed by Rohith Sharma K S	2015-08-27 13:25:53 -07:00
Jian He	57c7ae1aff	YARN-4014. Support user cli interface in for Application Priority. Contributed by Rohith Sharma K S	2015-08-24 20:36:44 -07:00
Rohith Sharma K S	feaf034994	YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks)	2015-08-24 11:25:07 +05:30
Xuan	b71c6006f5	YARN-221. Addendum patch to compilation issue which is caused by missing ... AllContainerLogAggregationPolicy. Contributed by Xuan Gong	2015-08-23 16:46:30 -07:00
Xuan	37e1c3d82a	YARN-221. NM should provide a way for AM to tell it not to aggregate ... logs. Contributed by Ming Ma	2015-08-22 16:25:24 -07:00
Rohith Sharma K S	22de7c1dca	YARN-3986. getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface	2015-08-21 10:51:11 +05:30
Wangda Tan	fc07464d1a	YARN-2923. Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup. (Naganarasimha G R)	2015-08-20 11:51:03 -07:00
Xuan	22dc5fc209	YARN-4028. AppBlock page key update and diagnostics value null on ... recovery. Contributed by Bibin A Chundatt	2015-08-18 22:53:03 -07:00
Zhihai Xu	14215c8ef8	YARN-4057. If ContainersMonitor is not enabled, only print related log info one time. Contributed by Jun Gong.	2015-08-18 11:36:02 -07:00
Zhihai Xu	3a76a010b8	YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao.	2015-08-18 10:36:40 -07:00
Karthik Kambatla	13604bd5f1	YARN-4055. Report node resource utilization in heartbeat. (Inigo Goiri via kasha)	2015-08-16 15:08:53 -07:00
Karthik Kambatla	def12933b3	YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha)	2015-08-16 06:24:16 -07:00
Jian He	0a030546e2	YARN-3987. Send AM container completed msg to NM once AM finishes. Contributed by sandflee	2015-08-13 16:22:53 -07:00
Jian He	7a445fcfab	YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe	2015-08-13 16:02:57 -07:00
Jian He	38aed1a94e	YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong	2015-08-13 14:46:08 -07:00
Robert Kanter	dc2340c60e	YARN-4031. Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer (djp via rkanter)	2015-08-12 15:47:47 -07:00
Jian He	e5003be907	YARN-4026. Refactored ContainerAllocator to accept a list of priorites rather than a single priority. Contributed by Wangda Tan	2015-08-12 15:07:50 -07:00
rohithsharmaks	1c12adb71f	YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks)	2015-08-12 14:45:41 +05:30
Xuan	3ae716fa69	YARN-3999. RM hangs on draing events. Contributed by Jian He	2015-08-11 18:25:11 -07:00
Jian He	fa1d84ae27	YARN-3887. Support changing Application priority during runtime. Contributed by Sunil G	2015-08-10 20:51:54 -07:00
Wangda Tan	cf9d3c9256	YARN-3873. PendingApplications in LeafQueue should also use OrderingPolicy. (Sunil G via wangda)	2015-08-10 14:54:55 -07:00
Wangda Tan	4bc42d76e7	YARN-3966. Fix excessive loggings in CapacityScheduler. (Jian He via wangda)	2015-08-07 09:46:57 -07:00
Rohith Sharma K S	b6265d39c5	YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks)	2015-08-07 10:43:41 +05:30
Carlo Curino	8572a5a14b	YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino)	2015-08-02 01:55:31 -07:00
Junping Du	cfee02b3bd	YARN-4019. Add JvmPauseMonitor to ResourceManager and NodeManager. Contributed by Robert Kanter.	2015-08-06 06:49:45 -07:00
Arun Suresh	154c9d2e42	YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh)	2015-08-05 23:14:14 -07:00
rohithsharmaks	df9e7280db	YARN-3992. TestApplicationPriority.testApplicationPriorityAllocation fails intermittently. (Contributed by Sunil G)	2015-08-06 10:43:37 +05:30
Jian He	ba2313d614	YARN-3983. Refactored CapacityScheduleri#FiCaSchedulerApp to easier extend container allocation logic. Contributed by Wangda Tan	2015-08-05 13:47:40 -07:00
Arun Suresh	f271d37735	YARN-3736. Add RMStateStore apis to store and load accepted reservations for failover (adhoot via asuresh)	2015-08-05 12:57:12 -07:00
Xuan	c3364ca8e7	YARN-4004. container-executor should print output of docker logs if the ... docker container exits with non-0 exit status. Contributed by Varun Vasudev	2015-08-03 18:10:11 -07:00
Xuan	0306d902f5	YARN-3543. ApplicationReport should be able to tell whether the ... Application is AM managed or not. Contributed by Rohith Sharma K S	2015-08-03 15:46:00 -07:00
Jason Lowe	469cfcd695	YARN-3965. Add startup timestamp to nodemanager UI. Contributed by Hong Zhiguo	2015-08-03 15:53:32 +00:00
Jonathan Eagles	3cd02b9522	YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles)	2015-08-03 10:38:05 -05:00
Jason Lowe	32e490b6c0	YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt	2015-07-31 17:37:24 +00:00
Zhihai Xu	ab80e27703	YARN-433. When RM is catching up with node updates then it should not expire acquired containers. Contributed by Xuan Gong	2015-07-30 21:57:11 -07:00
Wangda Tan	91b42e7d6e	YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (Bibin A Chundatt via wangda)	2015-07-30 10:00:31 -07:00
Karthik Kambatla	5205a330b3	YARN-2768. Avoid cloning Resource in FSAppAttempt#updateDemand. (Hong Zhiguo via kasha)	2015-07-29 09:42:32 -07:00
Xuan	f170934215	YARN-3982. container-executor parsing of container-executor.cfg broken ... in trunk and branch-2. Contributed by Varun Vasudev	2015-07-27 23:45:58 -07:00
Jian He	3572ebd738	YARN-3846. RM Web UI queue filter is not working for sub queue. Contributed by Mohammad Shahid Khan	2015-07-27 17:12:05 -07:00
Varun Vasudev	3e6fce91a4	YARN-3853. Add docker container runtime support to LinuxContainterExecutor. Contributed by Sidharta Seethana.	2015-07-27 11:57:40 -07:00
Varun Vasudev	f36835ff9b	YARN-3852. Add docker container support to container-executor. Contributed by Abin Shahab.	2015-07-27 10:14:51 -07:00
ccurino	156f24ead0	YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)	2015-07-25 07:39:47 -07:00
Wangda Tan	a3bd7b4a59	YARN-3973. Recent changes to application priority management break reservation system from YARN-1051 (Carlo Curino via wangda)	2015-07-24 16:44:18 -07:00
Jason Lowe	ff9c13e0a7	YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu	2015-07-24 22:14:39 +00:00
Jian He	83fe34ac08	YARN-3026. Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp. Contributed by Wangda Tan	2015-07-24 14:00:25 -07:00
Karthik Kambatla	d19d187753	YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha)	2015-07-24 11:44:37 -07:00
Xuan	fbd6063269	YARN-3967. Fetch the application report from the AHS if the RM does not ... know about it. Contributed by Mit Desai	2015-07-24 10:15:54 -07:00
carlo curino	0fcb4a8cf2	YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)	2015-07-23 19:33:59 -07:00
Rohith Sharma K S	e202efaf93	YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan)	2015-07-24 12:43:06 +05:30
Robert Kanter	1d3026e7b3	YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter)	2015-07-23 14:46:54 -07:00
Wangda Tan	3bba180051	YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda)	2015-07-23 10:07:57 -07:00
Junping Du	ee98d6354b	YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He.	2015-07-22 17:52:35 -07:00
Wangda Tan	06e5dd2c84	YARN-3956. Fix TestNodeManagerHardwareUtils fails on Mac (Varun Vasudev via wangda)	2015-07-22 12:01:41 -07:00
Wangda Tan	76ec26de80	YARN-3932. SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources. (Bibin A Chundatt via wangda)	2015-07-22 11:54:02 -07:00
Wangda Tan	c39ca541f4	YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda)	2015-07-21 09:57:23 -07:00
Colin Patrick Mccabe	419c51d233	YARN-3844. Make hadoop-yarn-project Native code -Wall-clean (Alan Burlison via Colin P. McCabe)	2015-07-17 11:38:59 -07:00
Jonathan Eagles	7faae0e6fe	YARN-3905. Application History Server UI NPEs when accessing apps run after RM restart (Eric Payne via jeagles)	2015-07-17 11:02:11 -05:00
Arun Suresh	9b272ccae7	YARN-3535. Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED (rohithsharma and peng.zhang via asuresh)	2015-07-17 04:31:34 -07:00
Wangda Tan	3540d5fe4b	YARN-3885. ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level. (Ajith S via wangda)	2015-07-16 16:13:32 -07:00
Arun Suresh	ac94ba3e18	YARN-3453. Ensure preemption logic in FairScheduler uses DominantResourceCalculator in DRF queues to prevent unnecessary thrashing. (asuresh)	2015-07-14 00:23:55 -07:00
Akira Ajisaka	19295b36d9	YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula.	2015-07-13 17:52:13 +09:00
Wangda Tan	5ed1fead6b	YARN-3894. RM startup should fail for wrong CS xml NodeLabel capacity configuration. (Bibin A Chundatt via wangda)	2015-07-12 21:52:11 -07:00
Wangda Tan	1df39c1efc	YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda)	2015-07-11 10:26:46 -07:00
Zhijie Shen	1ea36299a4	YARN-3116. RM notifies NM whether a container is an AM container or normal task container. Contributed by Giovanni Matteo Fumarola.	2015-07-10 18:58:10 -07:00
Ming Ma	08244264c0	YARN-3445. Cache runningApps in RMNode for getting running apps on given NodeId. (Junping Du via mingma)	2015-07-10 08:30:10 -07:00
Xuan	5214876792	YARN-3888. ApplicationMaster link is broken in RM WebUI when appstate is ... NEW. Contributed by Bibin A Chundatt	2015-07-09 21:37:33 -07:00
carlo curino	0e602fa3a1	YARN-3800. Reduce storage footprint for ReservationAllocation. Contributed by Anubhav Dhoot.	2015-07-09 16:51:59 -07:00
Karthik Kambatla	527c40e4d6	YARN-1012. Report NM aggregated container resource utilization in heartbeat. (Inigo Goiri via kasha)	2015-07-09 09:35:14 -07:00
Varun Vasudev	63d0365088	YARN-2194. Addendum patch to fix failing unit test in TestPrivilegedOperationExecutor. Contributed by Sidharta Seethana.	2015-07-09 11:51:59 +05:30
Jian He	c9dd2cada0	YARN-3892. Fixed NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails. Contributed by Bibin A Chundatt	2015-07-07 14:16:21 -07:00
Varun Vasudev	c40bdb56a7	YARN-2194. Fix bug causing CGroups functionality to fail on RHEL7. Contributed by Wei Yan.	2015-07-07 16:59:29 +05:30
Devaraj K	af63427c6d	YARN-3837. javadocs of TimelineAuthenticationFilterInitializer give wrong ... prefix for auth options. Contributed by Bibin A Chundatt.	2015-07-07 12:06:30 +05:30
Devaraj K	37d7395773	YARN-3875. FSSchedulerNode#reserveResource() doesn't print Application Id ... properly in log. Contributed by Bibin A Chundatt.	2015-07-02 10:20:31 +05:30
Wangda Tan	0e4b06690f	YARN-3508. Prevent processing preemption events on the main RM dispatcher. (Varun Saxena via wangda)	2015-07-01 17:32:22 -07:00
Jason Lowe	b5cdf78e8e	YARN-3793. Several NPEs when deleting local files on NM recovery. Contributed by Varun Saxena	2015-07-01 21:13:32 +00:00
Devaraj K	80a68d6056	YARN-3830. AbstractYarnScheduler.createReleaseCache may try to clean a ... null attempt. Contributed by nijel.	2015-07-01 19:03:44 +05:30
Colin Patrick Mccabe	d0cc0380b5	YARN-3827. Migrate YARN native build to new CMake framework (Alan Burlison via Colin P. McCabe)	2015-06-30 16:24:19 -07:00
Jian He	62e583c7dc	YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti	2015-06-29 13:37:32 -07:00
Devaraj K	b543d1a390	YARN-3859. LeafQueue doesn't print user properly for application add. ... Contributed by Varun Saxena.	2015-06-28 10:04:50 +05:30
Xuan	fe6c1bd73a	YARN-2871. TestRMRestart#testRMRestartGetApplicationList sometime fails ... in trunk. Contributed by zhihai xu	2015-06-26 19:43:59 -07:00
Jason Lowe	40b256949a	YARN-3850. NM fails to read files from full disks which can lead to container logs being lost and other issues. Contributed by Varun Saxena	2015-06-26 15:47:07 +00:00
Devaraj K	57f1a01eda	YARN-3826. Race condition in ResourceTrackerService leads to wrong ... diagnostics messages. Contributed by Chengbing Liu.	2015-06-25 16:13:59 +05:30
Jonathan Eagles	4c659ddbf7	YARN-3360. Add JMX metrics to TimelineDataManager (Jason Lowe via jeagles)	2015-06-24 16:16:52 -05:00
rohithsharmaks	dd4b387d96	YARN-3790. usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container (Zhihai Xu via rohithsharmaks)	2015-06-24 23:00:14 +05:30
Jason Lowe	8d58512d6e	YARN-3832. Resource Localization fails on a cluster due to existing cache directories. Contributed by Brahma Reddy Battula	2015-06-24 16:37:39 +00:00
Jason Lowe	2a20dd9b61	YARN-3809. Failed to launch new attempts because ApplicationMasterLauncher's threads all hang. Contributed by Jun Gong	2015-06-24 16:23:48 +00:00
Robert Kanter	99271b7621	YARN-3835. hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml (vamsee via rkanter)	2015-06-22 18:02:27 -07:00
Karthik Kambatla	5ebf2817e5	YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha)	2015-06-22 17:47:47 -07:00
Xuan	6c7a9d502a	YARN-3834. Scrub debug logging of tokens during resource localization. Contributed by Chris Nauroth	2015-06-21 17:13:44 -07:00
Xuan	5b5bb8dcdc	YARN-3802. Two RMNodes for the same NodeId are used in RM sometimes ... after NM is reconnected. Contributed by zhihai xu	2015-06-18 14:37:49 -07:00
Xuan	a826d432f9	YARN-3804. Both RM are on standBy state when kerberos user not in yarn.admin.acl. Contributed by Varun Saxena	2015-06-17 16:23:27 -07:00
Devaraj K	ebb9a82519	YARN-3148. Allow CORS related headers to passthrough in ... WebAppProxyServlet. Contributed by Varun Saxena.	2015-06-17 15:56:18 +05:30
Xuan	e27d5a13b0	YARN-3714. AM proxy filter can not get RM webapp address from ... yarn.resourcemanager.hostname.rm-id. Contributed by Masatake Iwasaki	2015-06-16 14:06:16 -07:00
Devaraj K	b039e69bb0	YARN-3789. Improve logs for LeafQueue#activateApplications(). Contributed ... by Bibin A Chundatt.	2015-06-16 14:03:22 +05:30
Devaraj K	d8dcfa98e3	YARN-3794. TestRMEmbeddedElector fails because of ambiguous LOG reference. ... Contributed by Chengbing Liu.	2015-06-12 13:42:49 +05:30
Xuan	5583f88bf7	YARN-3785. Support for Resource as an argument during submitApp call in ... MockRM test class. Contributed by Sunil G	2015-06-10 21:40:48 -07:00
Zhijie Shen	8d0ef31632	YARN-3787. Allowed generic history service to load a number of applications whose started time is within the given range. Contributed by Xuan Gong.	2015-06-08 23:14:58 -07:00
Xuan	2b2465dfac	YARN-3778. Fix Yarn resourcemanger CLI usage. Contributed by Brahma Reddy Battula	2015-06-08 15:43:03 -07:00
Jian He	960b8f19ca	YARN-2716. Refactor ZKRMStateStore retry code with Apache Curator. Contributed by Karthik Kambatla	2015-06-08 14:50:58 -07:00
Devaraj K	126321eded	YARN-3747. TestLocalDirsHandlerService should delete the created test ... directory logDir2. Contributed by David Moore.	2015-06-08 15:32:13 +05:30
Devaraj K	c7ee6c151c	YARN-3780. Should use equals when compare Resource in ... RMNodeImpl#ReconnectNodeTransition. Contributed by zhihai xu.	2015-06-08 11:54:55 +05:30
Karthik Kambatla	bd69ea408f	YARN-3655. FairScheduler: potential livelock due to maxAMShare limitation and container reservation. (Zhihai Xu via kasha)	2015-06-07 11:37:52 -07:00
Xuan	3e000a919f	YARN-1462. AHS API and other AHS changes to handle tags for completed MR jobs. Contributed by Xuan Gong	2015-06-05 12:48:52 -07:00
Karthik Kambatla	75885852cc	YARN-3259. FairScheduler: Trigger fairShare updates on node events. (Anubhav Dhoot via kasha)	2015-06-05 09:39:41 -07:00
Zhijie Shen	18dd01d6bf	YARN-3766. Fixed the apps table column error of generic history web UI. Contributed by Xuan Gong.	2015-06-04 14:47:08 -07:00
Jian He	1970ca7cbc	YARN-2392. Add more diags about app retry limits on AM failures. Contributed by Steve Loughran	2015-06-04 11:14:09 -07:00
Jian He	6ad4e59cfc	YARN-3764. CapacityScheduler should forbid moving LeafQueue from one parent to another. Contributed by Wangda Tan	2015-06-04 10:52:59 -07:00
Wangda Tan	ebd797c48f	YARN-3733. Fix DominantRC#compare() does not work as expected if cluster resource is empty. (Rohith Sharmaks via wangda)	2015-06-04 10:22:57 -07:00
Junping Du	d7e7f6aa03	YARN-41. The RM should handle the graceful shutdown of the NM. Contributed by Devaraj K.	2015-06-04 04:59:27 -07:00
Xuan	5766a04428	YARN-3749. We should make a copy of configuration when init ... MiniYARNCluster with multiple RMs. Contributed by Chun Chen	2015-06-03 17:20:15 -07:00
Zhijie Shen	bc85959edd	Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong." ... This reverts commit 4a9ec1a824.	2015-06-03 14:15:56 -07:00
Karthik Kambatla	edb9cd0f7a	YARN-3762. FairScheduler: CME on FSParentQueue#getQueueUserAclInfo. (kasha)	2015-06-03 13:47:24 -07:00
Jason Lowe	e13b671aa5	YARN-3585. NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled. Contributed by Rohith Sharmaks	2015-06-03 19:44:07 +00:00
Zhijie Shen	dbc4f64937	YARN-3751. Fixed AppInfo to check if used resources are null. Contributed by Sunil G.	2015-06-03 11:51:41 -07:00
Wangda Tan	5cc3fced95	YARN-3725. App submission via REST API is broken in secure mode due to Timeline DT service address is empty. (Zhijie Shen via wangda)	2015-05-31 16:31:09 -07:00
Xuan	9686261ecb	YARN-2900. Application (Attempt and Container) Not Found in AHS results ... in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai	2015-05-31 15:37:05 -07:00
Xuan	da05361c3b	Revert "YARN-2900. Application (Attempt and Container) Not Found in AHS results" ... This reverts commit 06f8e9caba.	2015-05-31 00:26:04 -07:00
Xuan	06f8e9caba	YARN-2900. Application (Attempt and Container) Not Found in AHS results ... in Internal Server Error (500). Contributed by Zhijie Shen and Mit Desai	2015-05-30 21:56:19 -07:00
Zhijie Shen	4a9ec1a824	YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong.	2015-05-30 21:05:36 -07:00
Karthik Kambatla	a8acdd65b3	YARN-3467. Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI. (Anubhav Dhoot via kasha)	2015-05-30 13:36:24 -07:00
Zhijie Shen	eb6bf91eea	YARN-3740. Fixed the typo in the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS. Contributed by Xuan Gong.	2015-05-29 18:17:48 -07:00
Robert Kanter	6aec13cb33	YARN-3713. Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition (zxu via rkanter)	2015-05-29 15:34:37 -07:00
Karthik Kambatla	3ae2a62501	YARN-3547. FairScheduler: Apps that have no resource demand should not participate scheduling. (Xianyin Xin via kasha)	2015-05-29 15:17:22 -07:00
Andrew Wang	7673d4f205	HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang)	2015-05-29 14:54:18 -07:00
Vinod Kumar Vavilapalli	9acd24fec4	Fixed more FilesSystemRMStateStore issues. Contributed by Vinod Kumar Vavilapalli.	2015-05-28 15:25:56 -07:00
Zhijie Shen	54504133f4	YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong.	2015-05-27 16:52:22 -07:00
Allen Wittenauer	d6e3164d4a	YARN-2355. MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container (Darrell Taylor via aw)	2015-05-27 16:40:56 -07:00
cnauroth	4102e5882e	YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch.	2015-05-27 14:31:49 -07:00
Wangda Tan	ec0a852a37	YARN-3647. RMWebServices api's should use updated api from CommonNodeLabelsManager to get NodeLabel object. (Sunil G via wangda)	2015-05-27 12:51:20 -07:00
Wangda Tan	cdbd66be11	YARN-3686. CapacityScheduler should trim default_node_label_expression. (Sunil G via wangda)	2015-05-26 15:58:47 -07:00
Jian He	10732d515f	YARN-3632. Ordering policy should be allowed to reorder an application when demand changes. Contributed by Craig Welch	2015-05-26 12:00:51 -07:00
Vinod Kumar Vavilapalli	500a1d9c76	YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.	2015-05-26 11:38:35 -07:00
Tsuyoshi Ozawa	9a3d617b63	YARN-2336. Fair scheduler's REST API returns a missing '[' bracket JSON for deep queue tree. Contributed by Kenji Kikushima and Akira Ajisaka.	2015-05-26 19:07:40 +09:00
Jian He	446d51591e	YARN-3707. RM Web UI queue filter doesn't work. Contributed by Wangda Tan	2015-05-22 15:58:22 -07:00
Xuan	455b3acf0e	YARN-3701. Isolating the error of generating a single app report when ... getting all apps from generic history service. Contributed by Zhijie Shen	2015-05-22 14:34:39 -07:00
Vinayakumar B	55ed6558ba	HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin)	2015-05-22 16:45:19 +05:30
Junping Du	132d909d4a	YARN-3594. WintuilsProcessStubExecutor.startStreamReader leaks streams. Contributed by Lars Francke.	2015-05-22 04:23:25 -07:00
Vinod Kumar Vavilapalli	53fafcf061	YARN-3684. Changed ContainerExecutor's primary lifecycle methods to use a more extensible mechanism of context objects. Contributed by Sidharta Seethana.	2015-05-21 15:50:23 -07:00
Karthik Kambatla	4513761869	YARN-3675. FairScheduler: RM quits when node removal races with continuous-scheduling on the same node. (Anubhav Dhoot via kasha)	2015-05-21 13:44:42 -07:00
Jian He	6329bd00fa	YARN-3654. ContainerLogsPage web UI should not have meta-refresh. Contributed by Xuan Gong	2015-05-20 17:20:21 -07:00
Jian He	8966d42179	YARN-3609. Load node labels from storage inside RM serviceStart. Contributed by Wangda Tan	2015-05-20 16:30:07 -07:00
Tsuyoshi Ozawa	7401e5b5e8	YARN-3677. Fix findbugs warnings in yarn-server-resourcemanager. Contributed by Vinod Kumar Vavilapalli.	2015-05-20 08:59:26 +09:00
Wangda Tan	563eb1ad2a	YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda)	2015-05-19 16:54:38 -07:00
Wangda Tan	b37da52a1c	YARN-3565. NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String. (Naganarasimha G R via wangda)	2015-05-19 16:34:17 -07:00
Colin Patrick Mccabe	470c87dbc6	HADOOP-11970. Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom (Sean Busbey via Colin P. McCabe)	2015-05-19 10:50:15 -07:00
Ravi Prakash	c97f32e7b9	YARN-3302. TestDockerContainerExecutor should run automatically if it can detect docker in the usual place (Ravindra Kumar Naik via raviprak)	2015-05-19 10:28:11 -07:00
Xuan	76afd28862	YARN-3541. Add version info on timeline service / generic history web UI and REST API. Contributed by Zhijie Shen	2015-05-18 13:17:16 -07:00
Xuan	b0ad644083	YARN-3526. ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster. Contributed by Weiwei Yang	2015-05-15 22:39:49 -07:00
Jason Lowe	f7e051c431	YARN-2421. RM still allocates containers to an app in the FINISHING state. Contributed by Chang Li	2015-05-15 22:09:30 +00:00
Junping Du	03a293aed6	YARN-3505 addendum: fix an issue in previous patch.	2015-05-15 06:39:39 -07:00
Vinod Kumar Vavilapalli	9a2a9553ee	Fixing HDFS state-store. Contributed by Arun Suresh.	2015-05-14 16:13:51 -07:00
Ravi Prakash	53fe4eff09	YARN-1519. Check in container-executor if sysconf is implemented before using it (Radim Kolar and Eric Payne via raviprak)	2015-05-14 15:55:37 -07:00
Junping Du	15ccd967ee	YARN-3505. Node's Log Aggregation Report with SUCCEED should not cached in RMApps. Contributed by Xuan Gong.	2015-05-14 10:58:12 -07:00
Wangda Tan	0e85044e26	YARN-3362. Add node label usage in RM CapacityScheduler web UI. (Naganarasimha G R via wangda)	2015-05-13 17:00:36 -07:00
Jason Lowe	711d77cc54	YARN-3641. NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services. Contributed by Junping Du	2015-05-13 21:06:47 +00:00
Wangda Tan	7f19e7a254	YARN-3521. Support return structured NodeLabel objects in REST API (Sunil G via wangda)	2015-05-13 13:43:17 -07:00
Xuan	0f95921447	YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch	2015-05-13 13:10:53 -07:00
Wangda Tan	341a476812	YARN-2921. Fix MockRM/MockAM#waitForState sleep too long. (Tsuyoshi Ozawa via wangda)	2015-05-13 13:06:07 -07:00
Zhijie Shen	fcd0702c10	YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.	2015-05-12 21:13:22 -07:00
Karthik Kambatla	fe0df59627	YARN-3613. TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods. (nijel via kasha)	2015-05-12 10:45:33 -07:00
Devaraj K	5c2f05cd9b	YARN-3629. NodeID is always printed as "null" in node manager ... initialization log. Contributed by nijel.	2015-05-12 22:20:25 +05:30
Devaraj K	8badd82ce2	YARN-3513. Remove unused variables in ContainersMonitorImpl and add debug ... log for overall resource usage by all containers. Contributed by Naganarasimha G R.	2015-05-12 16:54:38 +05:30
Wangda Tan	d6f6741296	YARN-3489. RMServerUtils.validateResourceRequests should only obtain queue info once. (Varun Saxena via wangda)	2015-05-11 17:31:15 -07:00
Junping Du	7e543c27fa	YARN-3587. Fix the javadoc of DelegationTokenSecretManager in yarn, etc. projects. Contributed by Gabor Liptak.	2015-05-11 05:27:07 -07:00
Karthik Kambatla	a60f78e98e	YARN-3395. FairScheduler: Trim whitespaces when using username for queuename. (Zhihai Xu via kasha)	2015-05-09 15:41:20 -07:00
Karthik Kambatla	70fb37cd79	YARN-1287. Consolidate MockClocks. (Sebastian Wong and Anubhav Dhoot via kasha)	2015-05-09 14:34:54 -07:00
Xuan	6471d18bc7	YARN-1912. ResourceLocalizer started without any jvm memory control. ... Contributed by Masatake Iwasaki	2015-05-08 20:01:21 -07:00
Xuan	333f9a896d	YARN-3602. TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup. Contributed by zhihai xu	2015-05-08 17:52:54 -07:00
Karthik Kambatla	2fb44c8aaf	YARN-3271. FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability. (nijel via kasha)	2015-05-08 16:39:10 -07:00
Robert Kanter	5658998845	YARN-3473. Fix RM Web UI configuration for some properties (rchiang via rkanter)	2015-05-08 16:23:10 -07:00
Jason Lowe	25e2b02122	YARN-3476. Nodemanager can fail to delete local logs if log aggregation fails. Contributed by Rohith	2015-05-08 22:45:52 +00:00
Jian He	d0b73287c2	YARN-3604. Fixed ZKRMStateStore#removeApplication to also disable watch. Contributed Zhihai Xu	2015-05-08 15:12:33 -07:00
Xuan	088156de43	YARN-2331. Distinguish shutdown during supervision vs. shutdown for ... rolling upgrade. Contributed by Jason Lowe	2015-05-08 15:10:43 -07:00
Vinod Kumar Vavilapalli	f7a74d2491	YARN-3018. Unified the default value for the configuration property yarn.scheduler.capacity.node-locality-delay in code and default xml file. Contributed by Nijel SF.	2015-05-08 14:45:06 -07:00
Wangda Tan	f55d21d894	YARN-3593. Add label-type and Improve "DEFAULT_PARTITION" in Node Labels Page. (Naganarasimha G R via wangda)	2015-05-08 12:04:50 -07:00
Thomas Graves	5d708a4725	YARN-3600. AM container link is broken (Naganarasimha G R via tgraves	2015-05-08 16:35:40 +00:00
Robert (Bobby) Evans	bcf2890502	YARN-644: Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer	2015-05-08 11:11:01 -05:00
Devaraj K	241a72af0d	YARN-2784. Make POM project names consistent. Contributed by Rohith.	2015-05-08 19:23:53 +05:30
Tsuyoshi Ozawa	d18f10ad1b	MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi.	2015-05-08 15:59:46 +09:00
Devaraj K	ef3d66d462	YARN-3358. Audit log not present while refreshing Service ACLs. ... Contributed by Varun Saxena.	2015-05-08 12:14:10 +05:30
Devaraj K	a28cd02ba0	YARN-3592. Fix typos in RMNodeLabelsManager. Contributed by Sunil G.	2015-05-08 10:54:36 +05:30
Akira Ajisaka	b167fe7605	YARN-1832. Fix wrong MockLocalizerStatus#equals implementation. Contributed by Hong Zhiguo.	2015-05-08 11:14:45 +09:00
Jian He	f489a4ec96	YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan	2015-05-07 17:35:41 -07:00
Jian He	b88700dcd0	YARN-3584. Fixed attempt diagnostics format shown on the UI. Contributed by nijel	2015-05-07 13:54:07 -07:00
Zhijie Shen	daf3e4ef8b	YARN-3448. Added a rolling time-to-live LevelDB timeline store implementation. Contributed by Jonathan Eagles.	2015-05-07 10:01:51 -07:00
Akira Ajisaka	918af8efff	YARN-3577. Misspelling of threshold in log4j.properties for tests. Contributed by Brahma Reddy Battula.	2015-05-07 13:33:03 +09:00
Vinod Kumar Vavilapalli	4c7b9b6abe	YARN-3385. Fixed a race-condition in ResourceManager's ZooKeeper based state-store to avoid crashing on duplicate deletes. Contributed by Zhihai Xu.	2015-05-06 17:51:17 -07:00
Junping Du	31b627b2a8	YARN-3580. [JDK8] TestClientRMService.testGetLabelsToNodes fails. Contributed by Robert Kanter.	2015-05-06 16:51:05 -07:00
Robert Kanter	b72507810a	YARN-3491. PublicLocalizer#addResource is too slow. (zxu via rkanter)	2015-05-06 14:19:06 -07:00
Jian He	0d3188fd25	YARN-3301. Fixed the format issue of the new RM attempt web page. Contributed by Xuan Gong	2015-05-06 13:45:00 -07:00
Xuan	a583a40693	YARN-3582. NPE in WebAppProxyServlet. Contributed by Jian He	2015-05-05 21:42:19 -07:00
Jian He	e4c3b52c89	YARN-3343. Increased TestCapacitySchedulerNodeLabelUpdate#testNodeUpdate timeout. Contributed by Rohith Sharmaks	2015-05-05 11:33:47 -07:00
Xuan	b7dd3a4f04	YARN-2123. Progress bars in Web UI always at 100% due to non-US locale. ... Contributed by Akira AJISAKA	2015-05-05 10:40:16 -07:00
Junping Du	3810242062	YARN-3396. Handle URISyntaxException in ResourceLocalizationService. (Contributed by Brahma Reddy Battula)	2015-05-05 10:18:23 -07:00
Jason Lowe	9356cf8676	YARN-3552. RM Web UI shows -1 running containers for completed apps. Contributed by Rohith	2015-05-05 13:42:32 +00:00
Jian He	d701acc9c6	YARN-2725. Added test cases of retrying creating znode in ZKRMStateStore. Contributed by Tsuyoshi Ozawa	2015-05-04 16:13:29 -07:00
Wangda Tan	71f4de220c	YARN-3375. NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner (Devaraj K via wangda)	2015-05-04 15:49:19 -07:00
Jason Lowe	8f65c793f2	YARN-3097. Logging of resource recovery on NM restart has redundancies. Contributed by Eric Payne	2015-05-04 15:31:15 +00:00
Gera Shegalov	f8204e241d	YARN-2893. AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream. (Zhihai Xu via gera)	2015-05-01 18:18:55 -07:00
Robert Kanter	ac7d152901	YARN-3363. add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container. (zxu via rkanter)	2015-05-01 16:39:21 -07:00
Vinod Kumar Vavilapalli	1b3b9e5c31	YARN-2619. Added NodeManager support for disk io isolation through cgroups. Contributed by Varun Vasudev and Wei Yan.	2015-04-30 21:41:07 -07:00
Zhijie Shen	7e8639fda4	YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong.	2015-04-30 13:05:55 -07:00
Wangda Tan	e2e8f77118	YARN-3564. Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly. (Jian He via wangda)	2015-04-30 11:03:19 -07:00
Jian He	4c1af156ae	YARN-3533. Test: Fix launchAM in MockRM to wait for attempt to be scheduled. Contributed by Anubhav Dhoot	2015-04-29 14:50:01 -07:00
tgraves	2e215484bd	YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves)	2015-04-29 21:25:42 +00:00
Karthik Kambatla	8f82970e0c	YARN-3485. FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies. (kasha)	2015-04-28 21:00:35 -07:00
Wangda Tan	db1b674b50	YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda)	2015-04-27 16:24:38 -07:00
Xuan	7f07c4d810	YARN-3530. ATS throws exception on trying to filter results without ... otherinfo. Contributed by zhijie shen	2015-04-27 10:36:42 -07:00
Karthik Kambatla	47279c3228	YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha)	2015-04-26 09:13:46 -07:00
Jian He	d497f6ea2b	YARN-2498. Respect labels in preemption policy of capacity scheduler for inter-queue preemption. Contributed by Wangda Tan	2015-04-24 17:03:13 -07:00
Tsuyoshi Ozawa	4a3dabd94f	YARN-3406. Display count of running containers in the RM's Web UI. Contributed by Ryu Kobayashi.	2015-04-25 07:17:11 +09:00
Jason Lowe	5e093f0d40	YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula	2015-04-24 22:02:53 +00:00
Jian He	d03dcb9635	YARN-3387. Previous AM's container completed status couldn't pass to current AM if AM and RM restarted during the same time. Contributed by Sandflee	2015-04-24 12:13:29 -07:00
Xuan	eee9facbba	YARN-3511. Add errors and warnings page to ATS. Contributed by Varun Vasudev	2015-04-24 09:41:59 -07:00
Xuan	0b3f8957a8	YARN-3516. killing ContainerLocalizer action doesn't take effect when ... private localizer receives FETCH_FAILURE status. Contributed by zhihai xu	2015-04-23 16:40:40 -07:00
Vinod Kumar Vavilapalli	f5fe35e297	YARN-3413. Changed Nodelabel attributes (like exclusivity) to be settable only via addToClusterNodeLabels but not changeable at runtime. (Wangda Tan via vinodkv)	2015-04-23 11:19:55 -07:00
Wangda Tan	395205444e	YARN-3319. Implement a FairOrderingPolicy. (Craig Welch via wangda)	2015-04-23 10:47:15 -07:00
tgraves	189a63a719	YARN-3434. Interaction between reservations and userlimit can result in significant ULF violation	2015-04-23 14:39:25 +00:00
Steve Loughran	d9bcf99aef	YARN-2605. [RM HA] Rest api endpoints doing redirect incorrectly. (Xuan Gong via stevel)	2015-04-23 09:22:48 +01:00
Vinod Kumar Vavilapalli	a100be685c	YARN-3366. Enhanced NodeManager to support classifying/shaping outgoing network bandwidth traffic originating from YARN containers Contributed by Sidharta Seethana.	2015-04-22 17:26:13 -07:00
Junping Du	fad9d7e85b	New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K	2015-04-22 10:07:20 -07:00
Jian He	674c7ef649	YARN-3503. Expose disk utilization percentage and bad local and log dir counts in NM metrics. Contributed by Varun Vasudev	2015-04-21 20:57:02 -07:00
Jian He	bdd90110e6	YARN-3494. Expose AM resource limit and usage in CS QueueMetrics. Contributed by Rohith Sharmaks	2015-04-21 20:06:20 -07:00
Wangda Tan	e71d0d87d9	YARN-3410. YARN admin should be able to remove individual application records from RMStateStore. (Rohith Sharmaks via wangda)	2015-04-21 17:51:22 -07:00
Tsuyoshi Ozawa	105afd5477	YARN-3495. Confusing log generated by FairScheduler. Contributed by Brahma Reddy Battula.	2015-04-22 05:47:59 +09:00
Wangda Tan	44872b76fc	YARN-3463. Integrate OrderingPolicy Framework with CapacityScheduler. (Craig Welch via wangda)	2015-04-20 17:12:32 -07:00
Jian He	497c86b485	YARN-3136. Fixed a synchronization problem of AbstractYarnScheduler#getTransferredContainers. Contributed by Sunil G	2015-04-18 12:46:37 -07:00
Wangda Tan	f47a5763ac	YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda)	2015-04-17 17:22:27 -07:00
Wangda Tan	f65eeb412d	YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed. (Jian He via wangda)	2015-04-17 17:11:22 -07:00
Jian He	6779467ab6	YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks	2015-04-17 15:55:34 -07:00
Jian He	d573f09fb9	YARN-2696. Queue sorting in CapacityScheduler should consider node label. Contributed by Wangda Tan	2015-04-17 13:36:59 -07:00
Junping Du	1db355a875	YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong.	2015-04-17 13:18:59 -07:00
Jian He	bb6dde68f1	YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang	2015-04-16 19:43:37 -07:00
Akira Ajisaka	1fa8075794	MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.	2015-04-16 10:04:09 -05:00
Jian He	1b89a3e173	YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan	2015-04-15 13:57:06 -07:00
Jian He	b2e6cf607f	YARN-3404. Display queue name on application page. Contributed by Ryu Kobayashi	2015-04-15 13:52:50 -07:00
Tsuyoshi Ozawa	e48cedc663	YARN-3326. Support RESTful API for getLabelsToNodes. Contributed by Naganarasimha G R.	2015-04-15 14:03:55 -05:00
Wangda Tan	5004e75332	YARN-3318. Create Initial OrderingPolicy Framework and FifoOrderingPolicy. (Craig Welch via wangda)	2015-04-15 09:56:32 -07:00
Jian He	0fefda645b	YARN-3361. CapacityScheduler side changes to support non-exclusive node labels. Contributed by Wangda Tan	2015-04-14 11:45:58 -07:00
Jian He	b46ee1e7a3	YARN-3266. RMContext#inactiveNodes should have NodeId as map key. Contributed by Chengbing Liu	2015-04-14 10:54:22 -07:00
Junping Du	838b06ac87	YARN-3443. Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM. Contributed by Sidharta Seethana.	2015-04-13 18:35:56 -07:00
Jian He	a1afbc48b5	YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens. Contributed by Rohith Sharmaks	2015-04-13 14:07:17 -07:00
Jian He	944a16579f	YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root queue metrics. Contributed by Rohit Agarwal	2015-04-13 10:53:34 -07:00
Karthik Kambatla	e516706b89	YARN-3469. ZKRMStateStore: Avoid setting watches that are not required. (Jun Hong via kasha)	2015-04-10 11:20:34 -07:00
Jian He	577d755e4b	YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev	2015-04-10 09:57:17 -07:00
Junping Du	92431c9617	YARN-1376. NM need to notify the log aggregation status to RM through Node heartbeat. Contributed by Xuan Gong.	2015-04-10 08:56:18 -07:00
Xuan	afa5d4715a	YARN-3293. Track and display capacity scheduler health metrics in web ... UI. Contributed by Varun Vasudev	2015-04-09 23:38:04 -07:00
Vinod Kumar Vavilapalli	9c5911294e	YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp.	2015-04-09 13:08:53 -07:00
Wangda Tan	1885141e90	YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda)	2015-04-09 10:35:12 -07:00
Karthik Kambatla	6495940eae	YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha)	2015-04-09 00:07:49 -07:00
Hitesh Shah	265ed1fe80	YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai.	2015-04-08 14:13:10 -07:00
Tsuyoshi Ozawa	dd852f5b8c	YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt.	2015-04-08 15:56:18 +09:00
Xuan	d27e9241e8	YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for ... a fixed time period. Contributed by Varun Vasudev	2015-04-07 09:52:36 -07:00
Xuan	19a4feaf6f	YARN-3110. Few issues in ApplicationHistory web ui. Contributed by Naganarasimha G R	2015-04-07 08:22:39 -07:00
Robert Kanter	99b08a748e	YARN-2429. TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken (zxu via rkanter)	2015-04-06 14:11:20 -07:00
Tsuyoshi Ozawa	53959e69f7	TestFairScheduler.testContinuousScheduling fails Intermittently. Contributed by Zhihai Xu.	2015-04-06 20:19:13 +09:00
Xuan	96d72118f5	YARN-3435. AM container to be allocated Appattempt AM container shown as ... null. Contributed by Bibin A Chundatt	2015-04-05 00:40:57 -07:00
Wangda Tan	bad070fe15	YARN-2901. Add errors and warning metrics page to RM, NM web UI. (Varun Vasudev via wangda)	2015-04-02 17:23:20 -07:00
Vinod Kumar Vavilapalli	b21c72777a	YARN-3365. Enhanced NodeManager to support using the 'tc' tool via container-executor for outbound network traffic control. Contributed by Sidharta Seethana.	2015-04-02 16:53:59 -07:00
Sandy Ryza	6a6a59db7f	YARN-3415. Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue (Zhihai Xu via Sandy Ryza)	2015-04-02 13:56:08 -07:00
Zhijie Shen	8366a36ad3	YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong.	2015-04-01 13:47:54 -07:00
Xuan	4728bdfa15	YARN-3248. Display count of nodes blacklisted by apps in the web UI. ... Contributed by Varun Vasudev	2015-04-01 04:19:18 -07:00
Tsuyoshi Ozawa	c69ba81497	YARN-3424. Change logs for ContainerMonitorImpl's resourse monitoring from info to debug. Contributed by Anubhav Dhoot.	2015-04-01 17:44:25 +09:00
Karthik Kambatla	2daa478a64	YARN-3428. Debug log resources to be localized for a container. (kasha)	2015-03-31 17:34:47 -07:00
Karthik Kambatla	79f7f2aabf	YARN-3412. RM tests should use MockRM where possible. (kasha)	2015-03-31 09:14:15 -07:00
Tsuyoshi Ozawa	b5a22e9838	YARN-3258. FairScheduler: Need to add more logging to investigate allocations. Contributed by Anubhav Dhoot.	2015-03-31 17:42:44 +09:00
Wangda Tan	2a945d24f7	YARN-2495. Allow admin specify labels from each NM (Distributed configuration for node label). (Naganarasimha G R via wangda)	2015-03-30 12:05:21 -07:00
Vinod Kumar Vavilapalli	c358368f51	YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla.	2015-03-30 10:09:40 -07:00
Ravi Prakash	e0ccea33c9	YARN-3288. Document and fix indentation in the DockerContainerExecutor code	2015-03-28 08:00:41 -07:00
Haohui Mai	e4b8d9e72d	HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng.	2015-03-25 11:12:42 -07:00
Xuan	e556198e71	YARN-2213. Change proxy-user cookie log in AmIpFilter to DEBUG. ... Contributed by Varun Saxena	2015-03-25 04:49:43 -07:00
Wangda Tan	97a7277a2d	YARN-3383. AdminService should use warn instead of info to log exception when operation fails. (Li Lu via wangda)	2015-03-24 10:38:54 -07:00
Xuan	9fae455e26	YARN-3393. Getting application(s) goes wrong when app finishes before ... starting the attempt. Contributed by Zhijie Shen	2015-03-23 20:33:16 -07:00
Karthik Kambatla	972f1f1ab9	YARN-2868. FairScheduler: Metric for latency to allocate first container for an application. (Ray Chiang via kasha)	2015-03-23 14:07:05 -07:00
Karthik Kambatla	2bc097cd14	YARN-3241. FairScheduler handles invalid queue names inconsistently. (Zhihai Xu via kasha)	2015-03-23 13:22:03 -07:00
cnauroth	6ca1f12024	YARN-3336. FileSystem memory leak in DelegationTokenRenewer.	2015-03-23 10:45:50 -07:00
Tsuyoshi Ozawa	82eda771e0	YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R.	2015-03-24 00:25:30 +09:00
Jian He	e1feb4ea1a	YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan	2015-03-20 19:04:38 -07:00
Jian He	586348e4cb	YARN-3356. Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan	2015-03-20 13:54:01 -07:00
Junping Du	d81109e588	YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong	2015-03-20 13:41:22 -07:00
Wangda Tan	6bc7710ec7	YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda)	2015-03-20 10:42:05 -07:00
Jian He	4e886eb9cb	YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong	2015-03-19 22:27:21 -07:00
Devaraj K	93d0f4acc8	YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by Rohith ... Sharmaks.	2015-03-19 12:16:52 +05:30
Karthik Kambatla	20b49224eb	YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha)	2015-03-18 16:30:33 -07:00
Jian He	658097d6da	YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks	2015-03-17 21:30:23 -07:00
Tsuyoshi Ozawa	3bc72cc16d	YARN-3205. FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Contributed by Zhihai Xu.	2015-03-18 11:53:19 +09:00
Jian He	968425e9f7	YARN-3305. Normalize AM resource request on app submission. Contributed by Rohith Sharmaks	2015-03-17 13:49:59 -07:00
Karthik Kambatla	32b4330456	Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)" ... This reverts commit c2b185def8.	2015-03-17 12:31:15 -07:00
Jian He	487374b7fe	YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan.	2015-03-17 10:24:23 -07:00
Devaraj K	7179f94f9d	YARN-3197. Confusing log generated by CapacityScheduler. Contributed by ... Varun Saxena.	2015-03-17 15:57:57 +05:30
Ravi Prakash	56085203c4	YARN-3339. TestDockerContainerExecutor should pull a single image and not the entire centos repository. (Ravindra Kumar Naik via raviprak)	2015-03-16 16:17:58 -07:00
Tsuyoshi Ozawa	7522a643fa	YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu.	2015-03-17 08:09:55 +09:00
Tsuyoshi Ozawa	3da9a97cfb	YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.	2015-03-16 23:19:05 +09:00
Xuan	3ff1ba2a7b	YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't ... work in ATS / RM web ui. Contributed by Naganarasimha G R	2015-03-15 20:26:10 -07:00
Jonathan Eagles	8180e676ab	YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles)	2015-03-13 12:04:30 -05:00
Vinod Kumar Vavilapalli	863079bb87	YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.	2015-03-12 13:32:29 -07:00
Zhijie Shen	85f6d67fa7	YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.	2015-03-11 19:35:19 -07:00
Allen Wittenauer	a5cf985bf5	YARN-2280. Resource manager web service fields are not accessible (Krisztian Horvath via aw)	2015-03-10 16:32:20 -07:00
Jian He	c3003eba6f	YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong	2015-03-09 20:46:48 -07:00
Zhijie Shen	d6e05c5ee2	YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles.	2015-03-09 13:54:36 -07:00
Jason Lowe	27e8ea820f	YARN-3275. CapacityScheduler: Preemption happening on non-preemptable queues. Contributed by Eric Payne	2015-03-06 22:37:26 +00:00
Jian He	21101c01f2	YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu	2015-03-06 14:18:11 -08:00
Jian He	95bfd087dc	YARN-1809. Synchronize RM and TimeLineServer Web-UIs. Contributed by Zhijie Shen and Xuan Gong	2015-03-05 21:20:09 -08:00
Tsuyoshi Ozawa	1b67209612	YARN-3249. Add a 'kill application' button to Resource Manager's Web UI. Contributed by Ryu Kobayashi.	2015-03-05 19:55:56 +09:00
Karthik Kambatla	8d88691d16	YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)	2015-03-04 19:49:05 -08:00
Karthik Kambatla	22426a1c9f	YARN-3231. FairScheduler: Changing queueMaxRunningApps interferes with pending jobs. (Siqi Li via kasha)	2015-03-04 18:06:58 -08:00
Karthik Kambatla	53947f37c7	YARN-3122. Metrics for container's actual CPU usage. (Anubhav Dhoot via kasha)	2015-03-04 17:33:30 -08:00
Jian He	b2f1ec312e	YARN-3222. Fixed NPE on RMNodeImpl#ReconnectNodeTransition when a node is reconnected with a different port. Contributed by Rohith Sharmaks	2015-03-03 16:28:28 -08:00
Wangda Tan	e17e5ba9d7	YARN-3272. Surface container locality info in RM web UI (Jian He via wangda)	2015-03-03 11:49:01 -08:00
Tsuyoshi Ozawa	d1c6accb6f	HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)	2015-03-03 14:17:52 +09:00
Vinod Kumar Vavilapalli	14dd647c55	YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan.	2015-03-02 17:52:47 -08:00
Jian He	5d0bae550f	YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu	2015-03-02 14:39:49 -08:00
Wangda Tan	edcecedc1c	YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda)	2015-02-27 16:13:32 -08:00
Tsuyoshi Ozawa	01a1621930	YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu.	2015-02-28 00:56:44 +09:00
Konstantin V Shvachko	8ca0d957c4	YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko.	2015-02-26 17:12:19 -08:00
Tsuyoshi Ozawa	773b6515ac	YARN-3217. Remove httpclient dependency from hadoop-yarn-server-web-proxy. Contributed by Brahma Reddy Battula.	2015-02-27 00:24:29 +09:00
Devaraj K	0d4296f0e0	YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against ... all Schedulers even when using ParameterizedSchedulerTestBase. Contributed by Anubhav Dhoot.	2015-02-26 15:45:41 +05:30
Jason Lowe	1a68fc4346	YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params. Contributed by Jian He	2015-02-25 16:14:34 +00:00
Tsuyoshi Ozawa	6cbd9f1113	YARN-3247. TestQueueMappings should use CapacityScheduler explicitly. Contributed by Zhihai Xu.	2015-02-25 10:38:11 +09:00
Allen Wittenauer	d4ac6822e1	YARN-2980. Move health check script related functionality to hadoop-common (Varun Saxena via aw)	2015-02-24 11:25:26 -08:00
Tsuyoshi Ozawa	9cedad11d8	Revert "HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)" ... This reverts commit 946456c6d8. Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/QuotaByStorageTypeEntry.java	2015-02-25 00:32:04 +09:00
Xuan	fe7a302473	YARN-2797. TestWorkPreservingRMRestart should use ... ParametrizedSchedulerTestBase. Contributed by Karthik Kambatla	2015-02-21 19:17:29 -08:00
Xuan	e3d290244c	YARN-3236. Cleanup RMAuthenticationFilter#AUTH_HANDLER_PROPERTY. ... Contributed by zhihai xu	2015-02-21 16:18:40 -08:00
Xuan	f56c65bb3e	YARN-3237. AppLogAggregatorImpl fails to log error cause. Contributed by ... Rushabh S Shah	2015-02-20 14:02:40 -08:00
Wangda Tan	ce5bf927c3	YARN-3230. Clarify application states on the web UI. (Jian He via wangda)	2015-02-20 10:39:28 -08:00
Junping Du	c33ae271c2	YARN-2799. Cleanup TestLogAggregationService based on the change in YARN-90. Contributed by Zhihai Xu	2015-02-20 09:43:39 -08:00
Jason Lowe	a64dd3d24b	YARN-3194. RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node. Contributed by Rohith	2015-02-20 15:10:10 +00:00
Jian He	c0d9b93953	YARN-933. Fixed InvalidStateTransitonException at FINAL_SAVING state in RMApp. Contributed by Rohith Sharmaks	2015-02-19 15:42:39 -08:00
Wangda Tan	d49ae725d5	YARN-3076. Add API/Implementation to YarnClient to retrieve label-to-node mapping (Varun Saxena via wangda)	2015-02-19 11:00:57 -08:00
Tsuyoshi Ozawa	946456c6d8	HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa)	2015-02-19 13:06:53 +09:00
Tsuyoshi Ozawa	b8a14efdf5	YARN-1615. Fix typos in delay scheduler's description. Contributed by Akira Ajisaka.	2015-02-19 10:24:07 +09:00
Jian He	1c03376300	YARN-1514. Utility to benchmark ZKRMStateStore#loadState for RM HA. Contributed by Tsuyoshi OZAWA	2015-02-18 16:06:55 -08:00
Jian He	f5da5566d9	YARN-3132. RMNodeLabelsManager should remove node from node-to-label mapping when node becomes deactivated. Contributed by Wangda Tan	2015-02-18 11:51:51 -08:00
Xuan	57db50cbe3	YARN-3207. Secondary filter matches entites which do not have the key ... being filtered for. Contributed by Zhijie Shen	2015-02-17 18:17:29 -08:00
Tsuyoshi Ozawa	556386a070	YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and Devaraj K.	2015-02-17 01:53:31 +09:00
Tsuyoshi Ozawa	3f32357c36	Revert "YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj." ... This reverts commit 9aae81c934.	2015-02-17 01:52:22 +09:00
Tsuyoshi Ozawa	9aae81c934	YARN-1299. Improve a log message in AppSchedulingInfo by adding application id. Contributed by Ashutosh Jindal and devaraj.	2015-02-17 01:48:22 +09:00
Tsuyoshi Ozawa	447bd7b5a6	YARN-3203. Correct a log message in AuxServices. Contributed by Brahma Reddy Battula.	2015-02-16 23:55:58 +09:00
Junping Du	ab0b958a52	YARN-2749. Fix some testcases from TestLogAggregationService fails in trunk. (Contributed by Xuan Gong)	2015-02-15 06:46:32 -08:00
cnauroth	6804d68901	YARN-2899. Run TestDockerContainerExecutorWithMocks on Linux only. Contributed by Ming Ma.	2015-02-13 21:58:54 -08:00
Jason Lowe	1a0f508b63	YARN-2847. Linux native container executor segfaults if default banned user detected. Contributed by Olaf Flebbe	2015-02-13 20:20:55 +00:00
Tsuyoshi Ozawa	110cf6b9a3	YARN-3182. Cleanup switch statement in ApplicationMasterLauncher#handle(). Contributed by Ray Chiang.	2015-02-13 14:21:21 +09:00
Akira Ajisaka	6a49e58cb8	YARN-3191. Log object should be initialized with its own class. Contributed by Rohith.	2015-02-12 17:58:54 -08:00
Xuan	99f6bd4f7a	YARN-3158. Correct log messages in ResourceTrackerService. Contributed ... by Varun Saxena	2015-02-12 16:42:15 -08:00
Jian He	18297e0972	YARN-3104. Fixed RM to not generate new AMRM tokens on every heartbeat between rolling and activation. Contributed by Jason Lowe	2015-02-12 16:02:45 -08:00
Jian He	18a594257e	YARN-3124. Fixed CS LeafQueue/ParentQueue to use QueueCapacities to track capacities-by-label. Contributed by Wangda Tan	2015-02-12 14:58:09 -08:00
Karthik Kambatla	c2b185def8	YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)	2015-02-12 13:44:47 -08:00
Junping Du	04f5ef18f7	YARN-2079. Recover NonAggregatingLogHandler state upon nodemanager restart. (Contributed by Jason Lowe)	2015-02-12 11:46:47 -08:00
Xuan	83be450acc	YARN-3147. Clean up RM web proxy code. Contributed by Steve Loughran	2015-02-12 10:57:55 -08:00
Xuan	65c69e296e	YARN-3151. On Failover tracking url wrong in application cli for KILLED ... application. Contributed by Rohith	2015-02-11 21:19:48 -08:00
Jason Lowe	b379972ab3	YARN-3074. Nodemanager dies when localizer runner tries to write to a full disk. Contributed by Varun Saxena	2015-02-11 16:33:43 +00:00
Junping Du	c541a374d8	YARN-3160. Fix non-atomic operation on nodeUpdateQueue in RMNodeImpl. (Contributed by Chengbing Liu)	2015-02-11 03:44:31 -08:00
Zhijie Shen	d5855c0e46	YARN-2246. Made the proxy tracking URL always be http(s)://proxy addr:port/proxy/<appId> to avoid duplicate sections. Contributed by Devaraj K.	2015-02-10 15:24:01 -08:00
Jason Lowe	3f5431a22f	YARN-2809. Implement workaround for linux kernel panic when removing cgroup. Contributed by Nathan Roberts	2015-02-10 17:27:21 +00:00
Jason Lowe	4eb5f7fa32	YARN-3090. DeletionService can silently ignore deletion task failures. Contributed by Varun Saxena	2015-02-10 16:54:21 +00:00
Zhijie Shen	23bf6c7207	YARN-3100. Made YARN authorization pluggable. Contributed by Jian He.	2015-02-09 20:34:56 -08:00
Jian He	0af6a99a3f	YARN-3094. Reset timer for liveness monitors after RM recovery. Contributed by Jun Gong	2015-02-09 13:47:08 -08:00
Karthik Kambatla	7e42088abf	YARN-2990. FairScheduler's delay-scheduling always waits for node-local and rack-local delays, even for off-rack-only requests. (kasha)	2015-02-08 22:48:10 -08:00
Jason Lowe	da2fb2bc46	YARN-3143. RM Apps REST API can return NPE or entries missing id and other fields. Contributed by Jason Lowe	2015-02-06 21:47:32 +00:00
Jason Lowe	4c484320b4	YARN-3089. LinuxContainerExecutor does not handle file arguments to deleteAsUser. Contributed by Eric Payne	2015-02-06 20:39:01 +00:00
Jian He	c1957fef29	YARN-2694. Ensure only single node label specified in ResourceRequest. Contributed by Wangda Tan	2015-02-06 11:34:20 -08:00
Arun C. Murthy	02f154a001	YARN-1537. Fix race condition in TestLocalResourcesTrackerImpl.testLocalResourceCache. Contributed by Xuan Gong.	2015-02-05 23:58:52 -08:00
Arun C. Murthy	18b2507eda	YARN-1904. Ensure exceptions thrown in ClientRMService & ApplicationHistoryClientService are uniform when application-attempt is not found. Contributed by Zhijie Shen.	2015-02-05 23:48:55 -08:00
Jian He	4641196fe0	YARN-3145. Fixed ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo. Contributed by Tsuyoshi OZAWA	2015-02-05 16:12:53 -08:00
Jason Lowe	69c8a7f45b	YARN-1582. Capacity Scheduler: add a maximum-allocation-mb setting per queue. Contributed by Thomas Graves	2015-02-05 19:28:49 +00:00
Sandy Ryza	b6466deac6	YARN-3101. In Fair Scheduler, fix canceling of reservations for exceeding max share (Anubhav Dhoot via Sandy Ryza)	2015-02-05 09:39:28 -08:00
Tsuyoshi Ozawa	26dee1486b	YARN-3058. Fix error message of tokens' activation delay configuration. Contributed by Yi Liu.	2015-02-04 11:41:14 +09:00
Zhijie Shen	e5b56e2af6	YARN-2543. Made resource usage be published to the timeline server too. Contributed by Naganarasimha G R.	2015-02-03 17:34:22 -08:00
Xuan	b73e776abc	YARN-3056. Add verification for containerLaunchDuration in ... TestNodeManagerMetrics. Contributed by zhihai Xu	2015-02-03 15:12:54 -08:00
Wangda Tan	5bd984691b	YARN-3075. NodeLabelsManager implementation to retrieve label to node mapping (Varun Saxena via wangda)	2015-02-03 12:52:42 -08:00
Jian He	21d80b3dd9	YARN-3098. Created common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues. Contributed by Wangda Tan	2015-02-03 11:43:12 -08:00
Robert Kanter	f7a77819a1	YARN-3022. Expose Container resource information from NodeManager for monitoring (adhoot via ranter)	2015-02-03 10:39:41 -08:00
Jason Lowe	a761bf8726	YARN-3085. Application summary should include the application type. Contributed by Rohith	2015-02-03 14:56:34 +00:00
Jian He	054a947989	YARN-3077. Fixed RM to create zk root path recursively. Contributed by Chun Chen	2015-01-30 17:34:49 -08:00
Jian He	86358221fc	YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan	2015-01-30 15:15:20 -08:00
Jonathan Eagles	30a8778c63	YARN-3108. ApplicationHistoryServer doesn't process -D arguments (Chang Li via jeagles)	2015-01-29 16:51:38 -06:00
Akira Ajisaka	342efa110a	HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)	2015-01-30 02:49:10 +09:00
Allen Wittenauer	9dd0b7a2ab	YARN-2428. LCE default banned user list should have yarn (Varun Saxena via aw)	2015-01-29 09:30:26 -08:00
Wangda Tan	7882bc0f14	YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource. (Zhihai Xu via wangda)	2015-01-28 21:54:38 -08:00
Wangda Tan	18741adf97	YARN-2932. Add entry for preemptable status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging. (Eric Payne via wangda)	2015-01-27 15:36:09 -08:00
Jonathan Eagles	a8ad1e8089	YARN-2897. CrossOriginFilter needs more log statements (Mit Desai via jeagles)	2015-01-27 16:06:39 -06:00
Jian He	4e15fc0841	YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena	2015-01-27 13:31:22 -08:00
Tsuyoshi Ozawa	f56da3ce04	YARN-3086. Make NodeManager memory configurable in MiniYARNCluster. Contributed by Robert Metzger.	2015-01-28 00:15:34 +09:00
Jian He	6f9fe76918	YARN-3092. Created a common ResourceUsage class to track labeled resource usages in Capacity Scheduler. Contributed by Wangda Tan	2015-01-26 15:38:00 -08:00
Jason Lowe	902c6ea7e4	YARN-3088. LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error. Contributed by Eric Payne	2015-01-26 15:40:21 +00:00
Xuan	0d6bd62102	YARN-3024. LocalizerRunner should give DIE action when all resources are ... localized. Contributed by Chengbing Liu	2015-01-25 19:37:57 -08:00
Tsuyoshi Ozawa	24aa462673	YARN-2800. Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature. Contributed by Wangda Tan.	2015-01-23 20:37:05 +09:00
Tsuyoshi Ozawa	3aab354e66	YARN-3082. Non thread safe access to systemCredentials in NodeHeartbeatResponse processing. Contributed by Anubhav Dhoot.	2015-01-23 16:04:18 +09:00
Wangda Tan	0a2d3e717d	YARN-2933. Capacity Scheduler preemption policy should only consider capacity without labels temporarily. Contributed by Mayank Bansal	2015-01-19 16:48:50 -08:00
Zhijie Shen	43302f6f44	YARN-2815. Excluded transitive dependency of JLine in hadoop-yarn-server-common. Contributed by Ferdinand Xu.	2015-01-16 16:37:42 -08:00
Karthik Kambatla	84198564ba	YARN-2984. Metrics for container's actual memory usage. (kasha)	2015-01-17 05:44:04 +05:30
Junping Du	5d1cca34fa	YARN-3064. TestRMRestart/TestContainerResourceUsage/TestNodeManagerResync failure with allocation timeout. (Contributed by Jian He)	2015-01-16 00:08:36 -08:00
Jian He	9e33116d1d	YARN-2861. Fixed Timeline DT secret manager to not reuse RM's configs. Contributed by Zhijie Shen	2015-01-15 11:07:43 -08:00
Jian He	c53420f583	YARN-2637. Fixed max-am-resource-percent calculation in CapacityScheduler when activating applications. Contributed by Craig Welch	2015-01-13 17:32:07 -08:00
Robert Kanter	51881535e6	YARN-2643. Don't create a new DominantResourceCalculator on every FairScheduler.allocate call. (kasha via rkanter)	2015-01-12 17:51:00 -08:00
Robert Kanter	ae7bf31fe1	YARN-3027. Scheduler should use totalAvailable resource from node instead of availableResource for maxAllocation. (adhoot via rkanter)	2015-01-12 10:47:52 -08:00
Jian He	a260406268	YARN-3014. Replaces labels on a host should update all NM's labels on that host. Contributed by Wangda Tan	2015-01-09 17:49:53 -08:00
Jian He	cc2a745f7e	YARN-2997. Fixed NodeStatusUpdater to not send alreay-sent completed container statuses on heartbeat. Contributed by Chengbing Liu	2015-01-08 11:12:54 -08:00
Zhijie Shen	dc2eaa26b2	YARN-2996. Improved synchronization and I/O operations of FS- and Mem- RMStateStore. Contributed by Yi Liu.	2015-01-08 09:47:02 -08:00
Jian He	e13a484a2b	YARN-3010. Fixed findbugs warning in AbstractYarnScheduler. Contributed by Yi Liu	2015-01-07 14:12:20 -08:00
Zhijie Shen	60103fca04	YARN-2427. Added the API of moving apps between queues in RM web services. Contributed by Varun Vasudev.	2015-01-06 14:37:44 -08:00
Jian He	dd57c2047b	YARN-2978. Fixed potential NPE while getting queue info. Contributed by Varun Saxena	2015-01-06 14:15:57 -08:00
Karthik Kambatla	0c4b112677	YARN-2881. [YARN-2574] Implement PlanFollower for FairScheduler. (Anubhav Dhoot via kasha)	2015-01-06 04:42:10 +05:30
Zhijie Shen	562a701945	YARN-2958. Made RMStateStore not update the last sequence number when updating the delegation token. Contributed by Varun Saxena.	2015-01-05 13:33:07 -08:00
Tsuyoshi Ozawa	ddc5be48fc	YARN-2922. ConcurrentModificationException in CapacityScheduler's LeafQueue. Contributed by Rohith Sharmaks.	2015-01-05 00:08:31 +09:00
Karthik Kambatla	e7257acd8a	YARN-2998. Abstract out scheduler independent PlanFollower components. (Anubhav Dhoot via kasha)	2014-12-30 19:55:24 -08:00
Jian He	e2351c7ae2	YARN-2987. Fixed ClientRMService#getQueueInfo to check against queue and app ACLs. Contributed by Varun Saxena	2014-12-30 17:15:37 -08:00
Jian He	b7442bf92e	YARN-2493. Added node-labels page on RM web UI. Contributed by Wangda Tan	2014-12-30 16:49:01 -08:00
Jian He	746ad6e989	Revert "YARN-2492(wrong jira number). Added node-labels page on RM web UI. Contributed by Wangda Tan" ... This reverts commit 5f57b904f5.	2014-12-30 16:48:49 -08:00
Jian He	5f57b904f5	YARN-2492. Added node-labels page on RM web UI. Contributed by Wangda Tan	2014-12-30 15:38:28 -08:00
Zhijie Shen	241d3b3a50	YARN-2938. Fixed new findbugs warnings in hadoop-yarn-resourcemanager and hadoop-yarn-applicationhistoryservice. Contributed by Varun Saxena.	2014-12-29 09:59:35 -08:00
Jian He	1454efe5d4	YARN-2992. ZKRMStateStore crashes due to session expiry. Contributed by Karthik Kambatla	2014-12-26 17:59:58 -08:00
Junping Du	40ee4bff65	YARN-2993. Several fixes (missing acl check, error log msg ...) and some refinement in AdminService. (Contributed by Yi Liu)	2014-12-26 06:59:25 -08:00
Jian He	4f18018b7a	YARN-2946. Fixed potential deadlock in RMStateStore. Contributed by Rohith Sharmaks	2014-12-23 22:14:29 -08:00
Zhijie Shen	41a548a916	YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. Contributed by Varun Saxena.	2014-12-23 20:32:36 -08:00
Junping Du	d468c9aaf1	YARN-2940. Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu)	2014-12-23 20:04:33 -08:00
Junping Du	856b46cf47	Revert ca3381de61 and 20674255ad as missing JIRA number in commit message	2014-12-23 20:02:33 -08:00
Junping Du	ca3381de61	Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu)	2014-12-23 18:57:16 -08:00
Jian He	149512a837	YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen	2014-12-23 18:25:37 -08:00
Jian He	0d89859b51	YARN-2340. Fixed NPE when queue is stopped during RM restart. Contributed by Rohith Sharmaks	2014-12-22 21:53:22 -08:00
Jian He	fdf042dfff	YARN-2920. Changed CapacityScheduler to kill containers on nodes where node labels are changed. Contributed by Wangda Tan	2014-12-22 16:51:15 -08:00
Junping Du	a696fbb001	YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du)	2014-12-22 03:06:37 -08:00
Karthik Kambatla	24ee9e3431	YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha)	2014-12-20 12:17:50 -08:00
Jian He	808cba3821	YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks	2014-12-19 16:56:30 -08:00
Karthik Kambatla	954fb8581e	YARN-2675. containersKilled metrics is not updated when the container is killed during localization. (Zhihai Xu via kasha)	2014-12-19 16:02:20 -08:00
Karthik Kambatla	a22ffc3188	YARN-2738. [YARN-2574] Add FairReservationSystem for FairScheduler. (Anubhav Dhoot via kasha)	2014-12-19 15:37:12 -08:00
Jason Lowe	0402bada19	YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie). Contributed by Jian He	2014-12-18 23:28:18 +00:00
Junping Du	2b4b0e8847	YARN-2972. DelegationTokenRenewer thread pool never expands. Contributed by Jason Lowe	2014-12-17 17:40:00 -08:00
Karthik Kambatla	b7f64823e1	YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha)	2014-12-17 16:32:21 -08:00
Karthik Kambatla	a1bd140964	YARN-2944. InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance. (Chris Trezzo via kasha)	2014-12-17 16:23:52 -08:00
Karthik Kambatla	f2d150ea12	YARN-2964. FSLeafQueue#assignContainer - document the reason for using both write and read locks. (Tsuyoshi Ozawa via kasha)	2014-12-17 12:03:16 -08:00
cnauroth	e996a1bfd4	HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user has Full Control permissions. Contributed by Chris Nauroth.	2014-12-16 15:29:22 -08:00
Karthik Kambatla	e597249d36	YARN-2914. [YARN-1492] Potential race condition in Singleton implementation of SharedCacheUploaderMetrics, CleanerMetrics, ClientSCMMetrics. (Varun Saxena via kasha)	2014-12-15 12:00:12 -08:00
Jian He	a4f2995b9e	Revert "YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai." ... This reverts commit 51af8d367d. Conflicts: hadoop-yarn-project/CHANGES.txt	2014-12-15 11:04:09 -08:00
Steve Loughran	3681de2039	YARN-2912 Jersey Tests failing with port in use. (varun saxena via stevel)	2014-12-12 17:11:07 +00:00
Devaraj K	bda748ac3a	YARN-2243. Order of arguments for Preconditions.checkNotNull() is wrong in ... SchedulerApplicationAttempt ctor. Contributed by Devaraj K.	2014-12-12 12:34:43 +05:30
Jian He	2ed90a57fd	YARN-2930. Fixed TestRMRestart#testRMRestartRecoveringNodeLabelManager intermittent failure. Contributed by Wangda Tan	2014-12-09 16:48:04 -08:00
Karthik Kambatla	a2e07a5456	YARN-2910. FSLeafQueue can throw ConcurrentModificationException. (Wilfred Spiegelenburg via kasha)	2014-12-09 14:00:31 -08:00
Karthik Kambatla	db73cc9124	YARN-2931. PublicLocalizer may fail until directory is initialized by LocalizeRunner. (Anubhav Dhoot via kasha)	2014-12-08 22:26:18 -08:00
Jian He	e69af836f3	YARN-2869. CapacityScheduler should trim sub queue names when parse configuration. Contributed by Wangda Tan	2014-12-05 17:33:39 -08:00
Jason Lowe	4b13082199	YARN-2056. Disable preemption at Queue level. Contributed by Eric Payne	2014-12-05 21:06:48 +00:00
Karthik Kambatla	78968155d7	YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)	2014-12-04 17:36:32 -08:00
Jian He	258623ff8b	YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R	2014-12-04 12:53:18 -08:00
Jian He	73fbb3c66b	YARN-2880. Added a test to make sure node labels will be recovered if RM restart is enabled. Contributed by Rohith Sharmaks	2014-12-03 17:14:52 -08:00
Harsh J	a31e016491	YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh)	2014-12-04 03:17:15 +05:30
Karthik Kambatla	799353e2c7	YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha)	2014-12-03 13:44:41 -08:00
Jason Lowe	03ab24aa01	MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov	2014-12-03 17:02:14 +00:00
Junping Du	e65b7c5ff6	YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA)	2014-12-03 04:11:18 -08:00
Jian He	392c3aaea8	YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks	2014-12-02 17:16:35 -08:00
Jian He	52bcefca8b	YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena	2014-12-02 10:54:48 -08:00
Zhijie Shen	51af8d367d	YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.	2014-12-01 19:04:04 -08:00
Jian He	a7fba0bc28	YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe	2014-12-01 16:38:25 -08:00
Junping Du	c732ed760e	YARN-2907. SchedulerNode#toString should print all resource detail instead of only memory. (Contributed by Rohith)	2014-12-01 05:38:22 -08:00
Zhijie Shen	8f1454cc6d	YARN-2165. Added the sanity check for the numeric configuration values of the timeline service. Contributed by Vasanth kumar RJ.	2014-11-26 12:09:34 -08:00
Karthik Kambatla	fe1f2db5ee	YARN-2188. [YARN-1492] Client service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)	2014-11-25 16:21:46 -08:00
Jian He	8a7ca13b13	YARN-2906. CapacitySchedulerPage shows HTML tags for a queue's Active Users. Contributed by Jason Lowe	2014-11-25 16:16:56 -08:00
Jian He	5805a81efb	YARN-2404. Removed ApplicationAttemptState and ApplicationState class in RMStateStore. Contributed by Tsuyoshi OZAWA	2014-11-25 12:48:22 -08:00
Zhijie Shen	e37a4ff0c1	YARN-2697. Remove useless RMAuthenticationHandler. Contributed by Haosong Huang.	2014-11-24 14:58:59 -08:00
Jason Lowe	1ce4d33c2d	YARN-1984. LeveldbTimelineStore does not handle db exceptions properly. Contributed by Varun Saxena	2014-11-24 22:36:59 +00:00
Sandy Ryza	a128cca305	YARN-2669. FairScheduler: queue names shouldn't allow periods (Wei Yan via Sandy Ryza)	2014-11-21 16:06:41 -08:00
Karthik Kambatla	233b61e495	YARN-2679. Add metric for container launch duration. (Zhihai Xu via kasha)	2014-11-21 14:22:21 -08:00
Karthik Kambatla	3114d4731d	YARN-2604. Scheduler should consider max-allocation-* in conjunction with the largest node. (Robert Kanter via kasha)	2014-11-21 10:32:28 -08:00
Karthik Kambatla	a9a0cc3679	YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha)	2014-11-19 20:15:40 -08:00
Karthik Kambatla	c90fb84aaa	YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha)	2014-11-19 19:50:12 -08:00
Jian He	9cb8b75ba5	YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks	2014-11-19 19:48:52 -08:00
Karthik Kambatla	2fce6d6141	YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes independent of Scheduler type. (Anubhav Dhoot via kasha)	2014-11-17 16:45:57 -08:00
Jason Lowe	81c9d17af8	YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan	2014-11-17 21:15:48 +00:00
Vinod Kumar Vavilapalli	198fb58776	YARN-1703. Fixed ResourceManager web-proxy to close connections correctly. Contributed by Rohith Sharma.	2014-11-15 12:05:25 -08:00
Jian He	9b860661a5	YARN-2432. RMStateStore should process the pending events before close. Contributed by Varun Saxena	2014-11-14 17:24:09 -08:00
Sandy Ryza	1a47f890ba	YARN-2811. In Fair Scheduler, reservation fulfillments shouldn't ignore max share (Siqi Li via Sandy Ryza)	2014-11-14 15:18:56 -08:00
Jason Lowe	49c38898b0	YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu	2014-11-14 21:25:59 +00:00
Jian He	d005404ef7	YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks	2014-11-13 15:34:26 -08:00
Zhijie Shen	3648cb57c9	YARN-2766. Made ApplicationHistoryManager return a sorted list of apps, attempts and containers. Contributed by Robert Kanter.	2014-11-13 13:47:42 -08:00
Vinod Kumar Vavilapalli	3651fe1b08	YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user kill request races with ApplicationMaster finish. Contributed by Jian He.	2014-11-13 08:13:03 -08:00
Jason Lowe	33ea5ae92b	YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du	2014-11-13 16:11:04 +00:00
Zhijie Shen	be7bf956e9	YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He.	2014-11-12 11:07:57 -08:00
Karthik Kambatla	a04143039e	YARN-2236. [YARN-1492] Shared Cache uploader service on the Node Manager. (Chris Trezzo and Sanjin Lee via kasha)	2014-11-12 09:31:05 -08:00
Jason Lowe	f8aefa5e9c	YARN-2780. Log aggregated resource allocation in rm-appsummary.log. Contributed by Eric Payne	2014-11-12 17:01:15 +00:00
Ravi Prakash	53f64ee516	YARN-1964. Create Docker analog of the LinuxContainerExecutor in YARN	2014-11-11 21:28:11 -08:00
Karthik Kambatla	061bc293c8	YARN-2735. diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection. (Zhihai Xu via kasha)	2014-11-11 10:31:39 -08:00
Xuan	5c9a51f140	YARN-2841. RMProxy should retry EOFException. Contributed by Jian He	2014-11-10 18:25:01 -08:00
Vinod Kumar Vavilapalli	e76faebc95	YARN-2834. Fixed ResourceManager to ignore token-renewal failures on recovery consistent with the (somewhat incorrect) behaviour in the non-recovery case. Contributed by Jian He.	2014-11-09 18:56:58 -08:00
Arun C. Murthy	43cd07b408	YARN-2830. Add backwords compatible ContainerId.newInstance constructor. Contributed by Jonathan Eagles.	2014-11-09 14:57:37 -08:00
Zhijie Shen	9a4e0d343e	YARN-2505. Supported get/add/remove/change labels in RM REST API. Contributed by Craig Welch.	2014-11-07 20:35:46 -08:00
Vinod Kumar Vavilapalli	df36edf751	YARN-2826. Fixed user-groups mappings' refresh bug caused by YARN-2826. Contributed by Wangda Tan.	2014-11-07 19:43:55 -08:00
Xuan	4a114dd67a	YARN-2819. NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6. Contributed by Zhijie Shen	2014-11-07 16:11:30 -08:00
Jason Lowe	c3d475070a	YARN-2825. Container leak on NM. Contributed by Jian He	2014-11-07 23:16:37 +00:00
Vinod Kumar Vavilapalli	4cfd5bc7c1	YARN-2753. Fixed a bunch of bugs in the NodeLabelsManager classes. Contributed by Zhihai xu.	2014-11-07 14:15:53 -08:00
cnauroth	06b797947c	YARN-2803. MR distributed cache not working correctly on Windows after NodeManager privileged account changes. Contributed by Craig Welch.	2014-11-07 12:29:39 -08:00
Vinod Kumar Vavilapalli	2ac1be7dec	YARN-2824. Fixed Capacity Scheduler to not crash when some node-labels are not mapped to queues by making default capacities per label to be zero. Contributed by Wangda Tan.	2014-11-07 10:39:37 -08:00
Xuan	1e97f2f094	YARN-2810. TestRMProxyUsersConf fails on Windows VMs. Contributed by Varun Vasudev	2014-11-07 09:44:43 -08:00
Vinod Kumar Vavilapalli	a5657182a7	YARN-2823. Fixed ResourceManager app-attempt state machine to inform schedulers about previous finished attempts of a running appliation to avoid expectation mismatch w.r.t transferred containers. Contributed by Jian He.	2014-11-07 09:28:36 -08:00
Vinod Kumar Vavilapalli	a3839a9fbf	YARN-2744. Fixed CapacityScheduler to validate node-labels correctly against queues. Contributed by Wangda Tan.	2014-11-06 17:28:12 -08:00
Vinod Kumar Vavilapalli	f5b19bed7d	YARN-2818. Removed the now unnecessary user entity injection from Timeline service given we now have domains. Contributed by Zhijie Shen.	2014-11-06 11:48:40 -08:00
Xuan	b0b52c4e11	YARN-2812. TestApplicationHistoryServer is likely to fail on less powerful machine. Contributed by Zhijie Shen	2014-11-05 20:42:38 -08:00
Xuan	e4b4901d36	YARN-2813. Fixed NPE from MemoryTimelineStore.getDomains. Contributed by Zhijie Shen	2014-11-05 18:24:41 -08:00
Jian He	395275af86	YARN-2579. Fixed a deadlock issue when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time. Contributed by Rohith Sharmaks	2014-11-05 16:59:54 -08:00
Vinod Kumar Vavilapalli	834e931d8e	YARN-2805. Fixed ResourceManager to load HA configs correctly before kerberos login. Contributed by Wangda Tan.	2014-11-05 15:30:33 -08:00
Zhijie Shen	b4c951ab83	YARN-2767. Added a test case to verify that http static user cannot kill or submit apps in the secure mode. Contributed by Varun Vasudev.	2014-11-05 10:57:38 -08:00
Vinod Kumar Vavilapalli	b76179895d	YARN-2804. Fixed Timeline service to not fill the logs with JAXB bindings exceptions. Contributed by Zhijie Shen.	2014-11-04 18:00:06 -08:00
Haohui Mai	d794f785de	HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR and YARN. Contributed by Robert Kanter.	2014-11-04 17:52:03 -08:00
Karthik Kambatla	b2cd269802	YARN-2010. Handle app-recovery failures gracefully. (Jian He and Karthik Kambatla via kasha)	2014-11-04 17:45:24 -08:00
Vinod Kumar Vavilapalli	c5a46d4c8c	YARN-1922. Fixed NodeManager to kill process-trees correctly in the presence of races between the launch and the stop-container call and when root processes crash. Contributed by Billie Rinaldi.	2014-11-03 16:38:55 -08:00
Vinod Kumar Vavilapalli	ec6cbece8e	YARN-2795. Fixed ResourceManager to not crash loading node-label data from HDFS in secure mode. Contributed by Wangda Tan.	2014-11-03 13:44:06 -08:00
Vinod Kumar Vavilapalli	58e9f24e0f	YARN-2788. Fixed backwards compatiblity issues with log-aggregation feature that were caused when adding log-upload-time via YARN-2703. Contributed by Xuan Gong.	2014-11-03 13:16:29 -08:00
Jason Lowe	6157ace547	YARN-2730. DefaultContainerExecutor runs only one localizer at a time. Contributed by Siqi Li	2014-11-03 20:37:47 +00:00
Zhijie Shen	27715ec63b	YARN-2785. Fixed intermittent TestContainerResourceUsage failure. Contributed by Varun Vasudev.	2014-11-02 15:20:40 -08:00
Vinod Kumar Vavilapalli	5c0381c96a	YARN-2790. Fixed a NodeManager bug that was causing log-aggregation to fail beyond HFDS delegation-token expiry even when RM is a proxy-user (YARN-2704). Contributed by Jian He.	2014-11-01 16:32:35 -07:00
Zhijie Shen	1cd088fd9d	YARN-2711. Fixed TestDefaultContainerExecutor#testContainerLaunchError failure on Windows. Contributed by Varun Vasudev.	2014-10-31 17:43:30 -07:00
Vinod Kumar Vavilapalli	6ce32f593b	YARN-2789. Re-instated the NodeReport.newInstance private unstable API modified in YARN-2698 so that tests in YARN frameworks don't break. Contributed by Wangda Tan.	2014-10-31 15:32:21 -07:00
Xuan	86ff28dea0	YARN-2701. Addendum patch. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong	2014-10-31 14:36:25 -07:00
Jian He	1b4be91866	YARN-2770. Added functionality to renew/cancel TimeLineDelegationToken. Contributed by Zhijie Shen	2014-10-31 13:16:45 -07:00
Karthik Kambatla	256697acd5	YARN-2186. [YARN-1492] Node Manager uploader service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)	2014-10-31 13:00:42 -07:00
Vinod Kumar Vavilapalli	d1828d9443	YARN-2779. Fixed ResourceManager to not require delegation tokens for communicating with Timeline Service. Contributed by Zhijie Shen.	2014-10-30 23:16:19 -07:00
Vinod Kumar Vavilapalli	e0233c16eb	YARN-2698. Moved some node label APIs to be correctly placed in client protocol. Contributed by Wangda Tan.	2014-10-30 22:59:31 -07:00
Jason Lowe	73e626ad91	YARN-2755. NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661. Contributed by Siqi Li	2014-10-30 15:10:27 +00:00
Karthik Kambatla	179cab81e0	YARN-2712. TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks. (Tsuyoshi Ozawa via kasha)	2014-10-30 00:29:07 -07:00
Karthik Kambatla	782971ae7a	YARN-2742. FairSchedulerConfiguration should allow extra spaces between value and unit. (Wei Yan via kasha)	2014-10-29 10:24:57 -07:00
Jian He	d5e0a09721	YARN-2503. Added node lablels in web UI. Contributed by Wangda Tan	2014-10-28 17:57:54 -07:00
Zhijie Shen	8984e9b177	YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. Contributed by Craig Welch.	2014-10-28 14:11:19 -07:00
Xuan	69f79bee8b	YARN-2758. Update TestApplicationHistoryClientService to use the new generic history store. Contributed by Zhijie Shen	2014-10-28 13:28:42 -07:00
Xuan	0d3e7e2bd6	RN-2279. Add UTs to cover timeline server authentication. Contributed by Zhijie Shen	2014-10-28 11:16:49 -07:00
Vinod Kumar Vavilapalli	a16d022ca4	YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.	2014-10-27 15:49:47 -07:00
Jian He	c05b581a55	YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen	2014-10-27 10:45:53 -07:00
Xuan	ce1a4419a6	YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan	2014-10-27 10:26:21 -07:00
Vinod Kumar Vavilapalli	0186645505	YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He.	2014-10-26 11:14:34 -07:00
Karthik Kambatla	c51e53d7aa	YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)	2014-10-25 10:31:06 -07:00
Jian He	5864dd99a4	YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe	2014-10-24 22:47:56 -07:00
Zhijie Shen	f81dc3f995	YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong.	2014-10-24 14:10:46 -07:00
Zhijie Shen	0f3b6900be	YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.	2014-10-23 21:56:03 -07:00
Jian He	3b12fd6cfb	YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu	2014-10-22 15:57:46 -07:00
Zhijie Shen	7e3b5e6f5c	YARN-2721. Suppress NodeExist exception thrown by ZKRMStateStore when it retries creating znode. Contributed by Jian He.	2014-10-21 21:49:17 -07:00
Vinod Kumar Vavilapalli	c0e034336c	YARN-2715. Fixed ResourceManager to respect common configurations for proxy users/groups beyond just the YARN level config. Contributed by Zhijie Shen.	2014-10-21 20:09:40 -07:00
cnauroth	6637e3cf95	YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch.	2014-10-21 12:33:21 -07:00
Jason Lowe	6f2028bd15	YARN-90. NodeManager should identify failed disks becoming good again. Contributed by Varun Vasudev	2014-10-21 17:31:13 +00:00
Jian He	4fa1fb3193	Missing file for YARN-2701	2014-10-20 19:57:45 -07:00
Jian He	2839365f23	YARN-2701. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong	2014-10-20 18:45:47 -07:00
Vinod Kumar Vavilapalli	8256766498	YARN-2504. Enhanced RM Admin CLI to support management of node-labels. Contribyted by Wangda Tan.	2014-10-18 12:07:40 -07:00
Vinod Kumar Vavilapalli	39063cd36f	YARN-2676. Enhanced Timeline auth-filter to support proxy users. Contributed by Zhijie Shen.	2014-10-17 22:02:50 -07:00
Vinod Kumar Vavilapalli	e9c66e8fd2	YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing test-failures: added a dummy in-memory labels-manager. Contributed by Wangda Tan.	2014-10-17 18:26:12 -07:00
Jian He	c3de2412eb	YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over. Contributed by Tsuyoshi OZAWA	2014-10-17 16:35:27 -07:00
Jian He	a6aa6e42ca	YARN-2588. Standby RM fails to transitionToActive if previous transitionToActive failed with ZK exception. Contributed by Rohith Sharmaks	2014-10-17 10:54:24 -07:00
Vinod Kumar Vavilapalli	abae63caf9	YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.	2014-10-17 08:58:08 -07:00
Jian He	0fd0ebae64	YARN-2682. Updated WindowsSecureContainerExecutor to not use DefaultContainerExecutor#getFirstApplicationDir and use getWorkingDir() instead. Contributed by Zhihai Xu	2014-10-16 18:14:34 -07:00
Jian He	233d446be1	YARN-2621. Simplify the output when the user doesn't have the access for getDomain(s). Contributed by Zhijie Shen	2014-10-16 16:37:21 -07:00
Vinod Kumar Vavilapalli	b3056c266a	YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.	2014-10-15 18:47:26 -07:00
Vinod Kumar Vavilapalli	f2ea555ac6	YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan. ... YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.	2014-10-15 18:33:06 -07:00
Jian He	0af1a2b5bc	YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA	2014-10-15 15:22:07 -07:00
Zhijie Shen	1220bb72d4	YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen.	2014-10-14 21:50:46 -07:00
Zhijie Shen	cdce88376a	HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen.	2014-10-14 11:35:38 -07:00
Karthik Kambatla	cc93e7e683	YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha)	2014-10-13 16:32:01 -07:00
Karthik Kambatla	da709a2eac	YARN-2641. Decommission nodes on -refreshNodes instead of next NM-RM heartbeat. (Zhihai Xu via kasha)	2014-10-13 16:23:04 -07:00
Jian He	f9680d9a16	YARN-2308. Changed CapacityScheduler to explicitly throw exception if the queue ... to which the apps were submitted is changed across RM restart. Contributed by Craig Welch & Chang Li	2014-10-13 14:09:04 -07:00
Jason Lowe	a56ea01002	YARN-2377. Localization exception stack traces are not passed as diagnostic info. Contributed by Gera Shegalov	2014-10-13 18:31:16 +00:00
Zhijie Shen	4aed2d8e91	YARN-2651. Spun off LogRollingInterval from LogAggregationContext. Contributed by Xuan Gong.	2014-10-13 10:54:09 -07:00
Vinod Kumar Vavilapalli	db7f165319	YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.	2014-10-10 11:44:21 -07:00
Zhijie Shen	cb81bac002	YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong.	2014-10-10 00:11:30 -07:00
cnauroth	d3afd730ac	YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. Contributed by Chris Nauroth.	2014-10-09 22:44:44 -07:00
Karthik Kambatla	4f426fe223	YARN-2180. [YARN-1492] In-memory backing store for cache manager. (Chris Trezzo via kasha)	2014-10-09 17:16:06 -07:00
Mayank Bansal	df3becf080	YARN-2598 GHS should show N/A instead of null for the inaccessible information (Zhijie Shen via mayank)	2014-10-08 17:27:53 -07:00
Jian He	e16e25ab1b	YARN-2649. Fixed TestAMRMRPCNodeUpdates test failure. Contributed by Ming Ma	2014-10-08 10:58:51 -07:00
Jian He	30d56fdbb4	YARN-1857. CapacityScheduler headroom doesn't account for other AM's running. Contributed by Chen He and Craig Welch	2014-10-07 13:45:04 -07:00
Jian He	519e5a7dd2	YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch	2014-10-06 15:48:46 -07:00
Jian He	ea26cc0b4a	YARN-2615. Changed ClientToAMTokenIdentifier/RM(Timeline)DelegationTokenIdentifier to use protobuf as payload. Contributed by Junping Du	2014-10-06 10:47:43 -07:00
Chris Douglas	c8212bacb1	YARN-1051. Add a system for creating reservations of cluster capacity. ... Contributed by Subru Krishnan and Carlo Curino.	2014-10-03 17:09:02 -07:00
subru	a2986234be	YARN-2611. Fixing jenkins findbugs warning and TestRMWebServicesCapacitySched for branch YARN-1051. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit c47464aba407d1dafe10be23fe454f0489cc4367)	2014-10-03 15:43:23 -07:00
subru	5e10a13bb4	YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 90ac0be86b898aefec5471db4027554c8e1b310c)	2014-10-03 15:43:13 -07:00
subru	6261f7cc69	YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 8baeaead8532898163f1006276b731a237b1a559) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java	2014-10-03 15:42:43 -07:00
subru	3418c56bcf	YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 169085319b8b76641f8b9f6840a3fef06d221e2b)	2014-10-03 15:42:10 -07:00
carlo curino	b6df0dddcd	YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit c4918cb4cb5a267a8cfd6eace28fcfe7ad6174e8)	2014-10-03 15:42:03 -07:00
carlo curino	f66ffcf832	YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit aef7928899b37262773f3dc117157bb746bf8918)	2014-10-03 15:41:57 -07:00
subru	cf4b34282a	YARN-1709. In-memory data structures used to track resources over time to enable reservations. ... (cherry picked from commit 0d8b2cd88b958b1e602fd4ea4078ef8d4742a7c3)	2014-10-03 15:41:51 -07:00
carlo curino	1c6950354f	YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit f83a07f266f2c5e6eead554d8a331ed7e75e10d5)	2014-10-03 15:41:21 -07:00
carlo curino	eb3e40b833	YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan ... (cherry picked from commit aac47fda7fecda9fc18ade34d633eca895865a70) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java	2014-10-03 15:41:02 -07:00
Vinod Kumar Vavilapalli	34cdcaad71	YARN-2468. Enhanced NodeManager to support log handling APIs (YARN-2569) for use by long running services. Contributed by Xuan Gong.	2014-10-03 12:15:40 -07:00
Karthik Kambatla	80d11eb68e	YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha)	2014-10-03 11:49:49 -07:00
Jian He	054f285526	YARN-2628. Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free. Contributed by Varun Vasudev	2014-10-02 15:13:33 -07:00
Jason Lowe	29f520052e	YARN-2624. Resource Localization fails on a cluster due to existing cache directories. Contributed by Anubhav Dhoot	2014-10-02 17:39:34 +00:00
Karthik Kambatla	5e0b49da9c	YARN-2254. TestRMWebServicesAppsModification should run against both CS and FS. (Zhihai Xu via kasha)	2014-10-02 10:15:04 -07:00
Jian He	3ef1cf187f	YARN-2617. Fixed NM to not send duplicate container status whose app is not running. Contributed by Jun Gong	2014-10-02 10:04:09 -07:00
junping_du	c7cee9b455	YARN-1979. TestDirectoryCollection fails when the umask is unusual. (Contributed by Vinod Kumar Vavilapalli and Tsuyoshi OZAWA)	2014-10-02 08:02:59 -07:00
Vinod Kumar Vavilapalli	9e40de6af7	YARN-2446. Augmented Timeline service APIs to start taking in domains as a parameter while posting entities and events. Contributed by Zhijie Shen.	2014-10-01 17:52:03 -07:00
junping_du	0708827a93	YARN-2613. Support retry in NMClient for rolling-upgrades. (Contributed by Jian He)	2014-10-01 16:50:30 -07:00
Zhijie Shen	52bbe0f11b	YARN-2630. Prevented previous AM container status from being acquired by the current restarted AM. Contributed by Jian He.	2014-10-01 15:38:11 -07:00
Vinod Kumar Vavilapalli	ba7f31c2ee	YARN-1972. Added a secure container-executor for Windows. Contributed by Remus Rusanu.	2014-10-01 10:14:41 -07:00
Karthik Kambatla	17d1202c35	YARN-2179. [YARN-1492] Initial cache manager structure and context. (Chris Trezzo via kasha)	2014-09-30 19:01:47 -07:00
Jian He	bbff96be48	YARN-2602. Fixed possible NPE in ApplicationHistoryManagerOnTimelineStore. Contributed by Zhijie Shen	2014-09-30 16:44:17 -07:00
Karthik Kambatla	14d60dadc2	YARN-2594. Potential deadlock in RM when querying ApplicationResourceUsageReport. (Wangda Tan via kasha)	2014-09-30 16:12:27 -07:00
Zhijie Shen	9582a50176	YARN-2627. Added the info logs of attemptFailuresValidityInterval and number of previous failed attempts. Contributed by Xuan Gong.	2014-09-30 12:57:45 -07:00
Jonathan Eagles	e10eeaabce	YARN-2606. Application History Server tries to access hdfs before doing secure login (Mit Desai via jeagles)	2014-09-29 16:37:23 -05:00
Jason Lowe	9c22065109	YARN-1769. CapacityScheduler: Improve reservations. Contributed by Thomas Graves	2014-09-29 14:12:18 +00:00
Jian He	5391919b09	YARN-668. Changed NMTokenIdentifier/AMRMTokenIdentifier/ContainerTokenIdentifier to use protobuf object as the payload. Contributed by Junping Du.	2014-09-26 17:48:41 -07:00
Karthik Kambatla	f4357240a6	YARN-2608. FairScheduler: Potential deadlocks in loading alloc files and clock access. (Wei Yan via kasha)	2014-09-25 17:42:51 -07:00
Jason Lowe	8269bfa613	YARN-2523. ResourceManager UI showing negative value for "Decommissioned Nodes" field. Contributed by Rohith	2014-09-25 22:37:05 +00:00
Zhijie Shen	72b0881ca6	YARN-2546. Made REST API for application creation/submission use numeric and boolean types instead of the string of them. Contributed by Varun Vasudev.	2014-09-24 17:57:32 -07:00
Zhijie Shen	c86674a3a4	YARN-2581. Passed LogAggregationContext to NM via ContainerTokenIdentifier. Contributed by Xuan Gong.	2014-09-24 17:50:26 -07:00
Karthik Kambatla	39c87344e1	YARN-2596. TestWorkPreservingRMRestart fails with FairScheduler. (kasha)	2014-09-24 15:23:31 -07:00
Vinod Kumar Vavilapalli	d78b452a4f	YARN-2102. Added the concept of a Timeline Domain to handle read/write ACLs on Timeline service event data. Contributed by Zhijie Shen.	2014-09-24 11:27:53 -07:00
Allen Wittenauer	034df0e2eb	YARN-2161. Fix build on macosx: YARN parts (Binglin Chang via aw)	2014-09-24 08:47:55 -07:00
Karthik Kambatla	f5578207d2	YARN-2252. Intermittent failure of TestFairScheduler.testContinuousScheduling. (Ratandeep Ratti and kasha via kasha)	2014-09-23 00:03:16 -07:00
Karthik Kambatla	568d3dc2bb	YARN-1959. Fix headroom calculation in FairScheduler. (Anubhav Dhoot via kasha)	2014-09-22 23:49:39 -07:00
junping_du	a9a55db065	YARN-2584. TestContainerManagerSecurity fails on trunk. (Contributed by Jian He)	2014-09-22 22:45:06 -07:00
Karthik Kambatla	43efdd30b5	YARN-2539. FairScheduler: Set the default value for maxAMShare to 0.5. (Wei Yan via kasha)	2014-09-22 16:09:52 -07:00
Karthik Kambatla	23e17ce0ff	YARN-2540. FairScheduler: Queue filters not working on scheduler page in RM UI. (Ashwin Shankar via kasha)	2014-09-22 15:40:47 -07:00
Jian He	0a641496c7	YARN-1372. Ensure all completed containers are reported to the AMs across RM restart. Contributed by Anubhav Dhoot	2014-09-22 10:30:53 -07:00
Karthik Kambatla	9721e2c1fe	YARN-2453. TestProportionalCapacityPreemptionPolicy fails with FairScheduler. (Zhihai Xu via kasha)	2014-09-21 23:13:45 -07:00
Karthik Kambatla	c50fc92502	YARN-2452. TestRMApplicationHistoryWriter fails with FairScheduler. (Zhihai Xu via kasha)	2014-09-21 13:15:04 -07:00
Jian He	444acf8ea7	YARN-2565. Fixed RM to not use FileSystemApplicationHistoryStore unless explicitly set. Contributed by Zhijie Shen	2014-09-19 11:26:29 -07:00
Zhijie Shen	6fe5c6b746	YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He.	2014-09-18 21:56:56 -07:00
Jason Lowe	a337f0e354	YARN-2561. MR job client cannot reconnect to AM after NM restart. Contributed by Junping Du	2014-09-18 21:34:40 +00:00
Jason Lowe	9ea7b6c063	YARN-2363. Submitted applications occasionally lack a tracking URL. Contributed by Jason Lowe	2014-09-18 20:13:16 +00:00
Vinod Kumar Vavilapalli	485c96e3cb	YARN-2001. Added a time threshold for RM to wait before starting container allocations after restart/failover. Contributed by Jian He.	2014-09-18 11:03:12 -07:00
Jian He	ee21b13cbd	YARN-2559. Fixed NPE in SystemMetricsPublisher when retrieving FinalApplicationStatus. Contributed by Zhijie Shen	2014-09-17 21:44:15 -07:00
Jian He	f4886111aa	YARN-2558. Updated ContainerTokenIdentifier#read/write to use ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA.	2014-09-17 15:13:59 -07:00
junping_du	90a0c03f0a	YARN-1250. Generic history service should support application-acls. (Contributed by Zhijie Shen)	2014-09-16 18:20:49 -07:00
Vinod Kumar Vavilapalli	9f6891d9ef	YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev.	2014-09-16 10:14:46 -07:00
Jian He	88e329fdfb	YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen	2014-09-15 13:13:54 -07:00
cnauroth	9d4ec97c95	YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest classes. Contributed by Chris Nauroth.	2014-09-15 11:53:57 -07:00
Vinod Kumar Vavilapalli	14e2639fd0	YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong.	2014-09-13 18:04:05 -07:00
Zhijie Shen	98588cf044	YARN-2528. Relaxed http response split vulnerability protection for the origins header and made it accept multiple origins in CrossOriginFilter. Contributed by Jonathan Eagles.	2014-09-12 21:33:01 -07:00
XuanGong	e65ae575a0	YARN-2456. Possible livelock in CapacityScheduler when RM is recovering ... apps. Contributed by Jian He	2014-09-12 15:21:46 -07:00
Jonathan Eagles	54e5794806	YARN-2547. Cross Origin Filter throws UnsupportedOperationException upon destroy (Mit Desai via jeagles)	2014-09-12 15:35:17 -05:00
Jian He	3122daa802	YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA	2014-09-12 10:33:33 -07:00
Jason Lowe	78b048393a	YARN-2484. FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block. Contributed by Tsuyoshi OZAWA	2014-09-12 14:09:14 +00:00
Zhijie Shen	469ea3dcef	YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. Contributed by Xuan Gong.	2014-09-11 22:19:00 -07:00
junping_du	6b8b1608e6	YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen)	2014-09-12 10:04:51 +08:00
Karthik Kambatla	c11ada5ea6	YARN-2534. FairScheduler: Potential integer overflow calculating totalMaxShare. (Zhihai Xu via kasha)	2014-09-11 12:06:06 -07:00
Vinod Kumar Vavilapalli	4be95175cd	YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all containers to a preconfigured limit. Contributed by Varun Vasudev.	2014-09-10 19:22:52 -07:00
Jian He	83be3ad444	YARN-415. Capture aggregate memory allocation at the app-level for chargeback. Contributed by Eric Payne & Andrey Klochkov	2014-09-10 18:20:54 -07:00
Jian He	cbfe26370b	YARN-2158. Fixed TestRMWebServicesAppsModification#testSingleAppKill test failure. Contributed by Varun Vasudev	2014-09-10 12:47:34 -07:00
XUAN	47bdfa044a	YARN-2459. RM crashes if App gets rejected for any reason and HA is enabled. Contributed by Jian He	2014-09-10 11:44:41 -07:00
Vinod Kumar Vavilapalli	b67d5ba784	YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource types to the AMs. Contributed by Varun Vasudev.	2014-09-10 10:15:47 -07:00
Karthik Kambatla	3072c83b38	YARN-1458. FairScheduler: Zero weight can lead to livelock. (Zhihai Xu via kasha)	2014-09-10 08:26:14 -07:00
Zhijie Shen	a092cdf32d	YARN-2512. Allowed pattern matching for origins in CrossOriginFilter. Contributed by Jonathan Eagles.	2014-09-07 17:49:06 -07:00
Jonathan Eagles	e6420fec0a	YARN-2508. Cross Origin configuration parameters prefix are not honored (Mit Desai via jeagles)	2014-09-05 19:42:40 -05:00
Zhijie Shen	51a4faf521	YARN-2511. Allowed all origins by default when CrossOriginFilter is enabled. Contributed by Jonathan Eagles.	2014-09-04 15:01:01 -07:00
Jason Lowe	3fa5f728c4	YARN-2431. NM restart: cgroup is not removed for reacquired containers. Contributed by Jason Lowe	2014-09-04 21:11:27 +00:00
Jonathan Eagles	91d45f0f01	YARN-2509. Enable Cross Origin Filter for timeline server only and not all Yarn servers (Mit Desai via jeagles)	2014-09-04 11:53:52 -05:00
Karthik Kambatla	1dcaba9a7a	YARN-2394. FairScheduler: Configure fairSharePreemptionThreshold per queue. (Wei Yan via kasha)	2014-09-03 10:27:36 -07:00
Karthik Kambatla	0f34e6f387	YARN-2395. FairScheduler: Preemption timeout should be configurable per queue. (Wei Yan via kasha)	2014-08-30 01:17:13 -07:00
Jian He	5c14bc426b	YARN-1506. Changed RMNode/SchedulerNode to update resource with event notification. Contributed by Junping Du	2014-08-29 23:05:51 -07:00
Karthik Kambatla	270a271f53	YARN-2360. Fair Scheduler: Display dynamic fair share for queues on the scheduler page. (Ashwin Shankar and Wei Yan via kasha)	2014-08-29 17:15:38 -07:00
Jason Lowe	b03653f9a5	YARN-2462. TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync should have a test timeout. Contributed by Eric Payne	2014-08-29 20:15:40 +00:00
Jian He	c686aa3533	YARN-2447. RM web service app submission doesn't pass secrets correctly. Contributed by Varun Vasudev	2014-08-29 11:40:47 -07:00
Hitesh Shah	3de66011c2	YARN-2450. Fix typos in log messages. Contributed by Ray Chiang.	2014-08-29 11:16:36 -07:00
Zhijie Shen	4bd0194e6b	YARN-2449. Fixed the bug that TimelineAuthenticationFilterInitializer is not automatically added when hadoop.http.filter.initializers is not configured. Contributed by Varun Vasudev.	2014-08-29 09:40:39 -07:00
Karthik Kambatla	fa80ca49bd	YARN-2405. NPE in FairSchedulerAppsBlock. (Tsuyoshi Ozawa via kasha)	2014-08-28 23:21:37 -07:00
Jian	7b3e27ab73	YARN-2406. Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto. Contributed by Tsuyoshi OZAWA	2014-08-28 21:47:26 -07:00
Zhijie Shen	d778abf022	YARN-2035. FileSystemApplicationHistoryStore should not make working dir when it already exists. Contributed by Jonathan Eagles.	2014-08-27 02:01:00 -07:00
Karthik Kambatla	d16bfd1d0f	YARN-1326. RM should log using RMStore at startup time. (Tsuyoshi Ozawa via kasha)	2014-08-27 01:43:58 -07:00
Karthik Kambatla	0097b15e21	YARN-2393. FairScheduler: Add the notion of steady fair share. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619845 13f79535-47bb-0310-9956-ffa450edef68	2014-08-22 15:44:47 +00:00
Jason Darrell Lowe	4236c6600e	YARN-2434. RM should not recover containers from previously failed attempt when AM restart is not enabled. Contributed by Jian He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619614 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 22:41:34 +00:00
Allen Wittenauer	7e75226e68	YARN-2424. LCE should support non-cgroups, non-secure mode (Chris Douglas via aw) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619421 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 14:57:11 +00:00
Karthik Kambatla	e1dd210fa5	YARN-1919. Potential NPE in EmbeddedElectorService#stop. (Tsuyoshi Ozawa via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619251 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 22:10:52 +00:00
Jian He	e4539e88e3	YARN-2174. Enable HTTPs for the writer REST API of TimelineServer. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619160 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 17:05:07 +00:00
Zhijie Shen	f6a778c372	YARN-2249. Avoided AM release requests being lost on work preserving RM restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618972 13f79535-47bb-0310-9956-ffa450edef68	2014-08-19 20:33:49 +00:00
Jian He	375c221960	YARN-2409. RM ActiveToStandBy transition missing stoping previous rmDispatcher. Contributed by Rohith ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618915 13f79535-47bb-0310-9956-ffa450edef68	2014-08-19 17:49:39 +00:00
Jian He	519c4be95a	YARN-2411. Support simple user and group mappings to queues. Contributed by Ram Venkatesh ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618542 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 06:08:45 +00:00
Jian He	c3084d6c16	YARN-2389. Added functionality for schedulers to kill all applications in a queue. Contributed by Subramaniam Venkatraman Krishnan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618294 13f79535-47bb-0310-9956-ffa450edef68	2014-08-15 23:53:57 +00:00
Jian He	7360cec692	YARN-2378. Added support for moving applications across queues in CapacityScheduler. Contributed by Subramaniam Venkatraman Krishnan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618106 13f79535-47bb-0310-9956-ffa450edef68	2014-08-15 06:00:31 +00:00
Zhijie Shen	a9023c2736	YARN-2397. Avoided loading two authentication filters for RM and TS web interfaces. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618054 13f79535-47bb-0310-9956-ffa450edef68	2014-08-14 21:17:20 +00:00
Zhijie Shen	41aa4badf8	YARN-2277. Added cross-origin support for the timeline server web services. Contributed by Jonathan Eagles. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617832 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 20:29:23 +00:00
Karthik Kambatla	5197f8c3c5	YARN-1370. Fair scheduler to re-populate container allocation state. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617645 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 01:38:59 +00:00
Karthik Kambatla	4239695588	YARN-2399. Delete old versions of files. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617619 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 22:51:57 +00:00
Karthik Kambatla	486e718fc1	YARN-2399. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617600 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 21:43:27 +00:00
Junping Du	c2febdcbaa	YARN-1337. Recover containers upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617448 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 10:56:13 +00:00
Jian He	c4dc685343	YARN-2138. Cleaned up notifyDone* APIs in RMStateStore. Contributed by Varun Saxena ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617341 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 18:24:24 +00:00
Xuan Gong	946be75704	YARN-2400: Addendum fix for TestAMRestart failure. Contributed by Jian He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617333 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 17:42:53 +00:00
Karthik Kambatla	da7b508ffc	YARN-2361. RMAppAttempt state machine entries for KILLED state has duplicate event entries. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617190 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 01:42:26 +00:00
Karthik Kambatla	bdd3e2ce49	YARN-2337. ResourceManager sets ClientRMService in RMContext multiple times. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617183 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 00:13:27 +00:00
Junping Du	e91d099c4a	YARN-2302. Refactor TimelineWebServices. (Contributed by Zhijie Shen) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617055 13f79535-47bb-0310-9956-ffa450edef68	2014-08-10 07:21:15 +00:00
Xuan Gong	743f7f30da	YARN-2400. Fixed TestAMRestart fails intermittently. Contributed by Jian He: ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617028 13f79535-47bb-0310-9956-ffa450edef68	2014-08-09 23:31:11 +00:00
Karthik Kambatla	a7643f4de7	YARN-2026. Fair scheduler: Consider only active queues for computing fairshare. (Ashwin Shankar via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616915 13f79535-47bb-0310-9956-ffa450edef68	2014-08-09 02:10:00 +00:00
Xuan Gong	eeb4acd955	YARN-2212: ApplicationMaster needs to find a way to update the AMRMToken periodically. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616892 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:38:24 +00:00
Karthik Kambatla	6d39525f6b	YARN-2352. Add missing file. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616784 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 14:38:18 +00:00
Karthik Kambatla	14864e9c7c	YARN-2352. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616769 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 14:17:54 +00:00
Jian He	8437df8ba9	YARN-2008. Fixed CapacityScheduler to calculate headroom based on max available capacity instead of configured max capacity. Contributed by Craig Welch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616580 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 20:00:04 +00:00
Zhijie Shen	3bfdb0091d	YARN-2288. Made persisted data in LevelDB timeline store be versioned. Contributed by Junping Du. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616540 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 17:02:26 +00:00
Zhijie Shen	be6360593b	YARN-2388. Fixed TestTimelineWebServices failure due to HADOOP-10791. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616405 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 05:36:50 +00:00
Karthik Kambatla	8feddc4c84	YARN-2359. Application hangs when it fails to launch AM container. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616375 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 00:06:17 +00:00
Junping Du	b8f151231b	YARN-1354. Recover applications upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615550 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 13:25:37 +00:00
Junping Du	04ae560370	YARN-2370. Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo (Contributed by Wenwu Peng) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615469 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 01:15:46 +00:00
Jian He	a41c314373	YARN-2343. Improve NMToken expire exception message. Contributed by Li Lu ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615270 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 23:44:48 +00:00
Xuan Gong	e52f67e389	YARN-1994. Expose YARN/MR endpoints on multiple interfaces. Contributed by Craig Welch, Milan Potocnik,and Arpit Agarwal ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614981 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 20:06:02 +00:00
Zhijie Shen	1d6e178144	YARN-2347. Consolidated RMStateVersion and NMDBSchemaVersion into Version in yarn-server-common. Contributed by Junping Du. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614838 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 09:27:43 +00:00
Karthik Kambatla	c0b49ff107	YARN-2328. FairScheduler: Verify update and continuous scheduling threads are stopped when the scheduler is stopped. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614432 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 17:41:52 +00:00
Zhijie Shen	d6532d3a77	YARN-2247. Made RM web services authenticate users via kerberos and delegation token. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613821 13f79535-47bb-0310-9956-ffa450edef68	2014-07-27 17:55:06 +00:00
Aaron Myers	5d4677b57b	YARN-1796. container-executor shouldn't require o-r permissions. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613548 13f79535-47bb-0310-9956-ffa450edef68	2014-07-26 01:51:35 +00:00
Jian He	d4fec34933	YARN-2211. Persist AMRMToken master key in RMStateStore for RM recovery. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613515 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 20:42:37 +00:00
Karthik Kambatla	1e553858f9	YARN-2214. FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness. (Ashwin Shankar via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613459 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 16:13:07 +00:00
Devarajulu K	2050e0dad6	YARN-1342. Recover container tokens upon nodemanager restart. Contributed by Jason Lowe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612995 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 05:02:00 +00:00
Jason Darrell Lowe	28fca92521	YARN-2147. client lacks delegation token exception details when application submit fails. Contributed by Chen He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612950 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 21:40:57 +00:00
Sanford Ryza	c88402f36d	YARN-2313. Livelock can occur in FairScheduler when there are lots of running apps (Tsuyoshi Ozawa via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612769 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 05:00:52 +00:00
Karthik Kambatla	ff77582991	YARN-2273. NPE in ContinuousScheduling thread when we lose a node. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612720 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 22:44:38 +00:00
Zhijie Shen	eac0701c96	YARN-2319. Made the MiniKdc instance start/close before/after the class of TestRMWebServicesDelegationTokens. Contributed by Wenwu Peng. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612588 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 15:15:29 +00:00
Junping Du	afb9394c91	YARN-2242. Addendum patch. Improve exception information on AM launch crashes. (Contributed by Li Lu) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612565 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 13:07:23 +00:00
Junping Du	537c361f5b	YARN-2013. The diagnostics is always the ExitCodeException stack when the container crashes. (Contributed by Tsuyoshi OZAWA) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612449 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 03:01:58 +00:00
Karthik Kambatla	266a4ff6a5	YARN-2131. Addendum. Add a way to format the RMStateStore. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612443 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 01:30:36 +00:00
Jason Darrell Lowe	1ad2d7b405	YARN-2321. NodeManager web UI can incorrectly report Pmem enforcement. Contributed by Leitao Guo ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612411 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 21:55:06 +00:00
Jason Darrell Lowe	8a87085820	YARN-2045. Data persisted in NM should be versioned. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612285 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 14:43:59 +00:00
Sanford Ryza	7c71a3b876	YARN-2323. FairShareComparator creates too many Resource objects (Hong Zhiguo via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612187 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 05:00:27 +00:00
Karthik Kambatla	8871d8ed9f	YARN-2244. FairScheduler missing handling of containers for unknown application attempts. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611840 13f79535-47bb-0310-9956-ffa450edef68	2014-07-19 00:12:05 +00:00
Xuan Gong	f1b831ccfb	YARN-2208. AMRMTokenManager need to have a way to roll over AMRMToken. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611820 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 21:46:29 +00:00
Junping Du	403ec8ea80	YARN-1341. Recover NMTokens upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611512 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 23:33:22 +00:00
Jian He	3c193811ca	YARN-2219. Addendum patch for YARN-2219 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611240 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 03:28:39 +00:00
Vinod Kumar Vavilapalli	bda23181bf	YARN-2219. Changed ResourceManager to avoid AMs and NMs getting exceptions after RM recovery but before scheduler learns about apps and app-attempts. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611222 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 00:14:56 +00:00
Vinod Kumar Vavilapalli	030580387a	YARN-2233. Implemented ResourceManager web-services to create, renew and cancel delegation tokens. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610876 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 23:00:17 +00:00
Mayank Bansal	43589a8df7	YARN-1408 Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins. (Sunil G via mayank) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610860 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 21:48:58 +00:00
Vinod Kumar Vavilapalli	a6cd712ca7	YARN-2228. Augmented TimelineServer to load pseudo authentication filter when authentication = simple. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610575 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 04:33:48 +00:00
Vinod Kumar Vavilapalli	c6cc6a6a8e	YARN-2260. Fixed ResourceManager's RMNode to correctly remember containers when nodes resync during work-preserving RM restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610557 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 23:32:03 +00:00
Karthik Kambatla	4d211d5fde	YARN-2274. FairScheduler: Add debug information about cluster capacity, availability and reservations. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609942 13f79535-47bb-0310-9956-ffa450edef68	2014-07-12 15:10:19 +00:00
Jian He	c9fb040c87	YARN-2181. Added preemption info to logs and RM web UI. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609561 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 20:03:35 +00:00
Karthik Kambatla	8fbca62a90	YARN-2131. Add a way to format the RMStateStore. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609278 13f79535-47bb-0310-9956-ffa450edef68	2014-07-09 19:58:43 +00:00
Zhijie Shen	12c4197b35	YARN-2158. Improved assertion messages of TestRMWebServicesAppsModification. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608667 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 05:50:04 +00:00
Jian He	6d7dbd4fed	YARN-1367. Changed NM to not kill containers on NM resync if RM work-preserving restart is enabled. Contributed by Anubhav Dhoot ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608334 13f79535-47bb-0310-9956-ffa450edef68	2014-07-07 04:37:59 +00:00
Sanford Ryza	5644f529f3	YARN-2250. FairScheduler.findLowestCommonAncestorQueue returns null when queues not identical (Krisztian Horvath via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607872 13f79535-47bb-0310-9956-ffa450edef68	2014-07-04 15:16:43 +00:00
Junping Du	5cb489f9d3	YARN-2242. Improve exception information on AM launch crashes. (Contributed by Li Lu) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607655 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 14:15:19 +00:00
Vinod Kumar Vavilapalli	45b191e38c	YARN-2232. Fixed ResourceManager to allow DelegationToken owners to be able to cancel their own tokens in secure mode. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607484 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 21:36:42 +00:00
Karthik Kambatla	447c1c233b	YARN-2241. ZKRMStateStore: On startup, show nicer messages if znodes already exist. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607473 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 20:33:26 +00:00
Steve Loughran	d1f54f4f4b	YARN-2065 AM cannot create new containers after restart ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607441 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 18:35:10 +00:00
Karthik Kambatla	58e398f31d	YARN-2204. Explicitly enable vmem check in TestContainersMonitor#testContainerKillOnMemoryOverflow. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607231 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 02:05:37 +00:00
Mayank Bansal	03a25d2cc1	YARN-2022 Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy (Sunil G via mayank) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607227 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 01:54:47 +00:00
Vinod Kumar Vavilapalli	075ff276ca	YARN-1713. Added get-new-app and submit-app functionality to RM web services. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607216 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 00:23:07 +00:00
Xuan Gong	e5ae7c55d1	TestRMApplicationHistoryWriter sometimes fails in trunk. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606835 13f79535-47bb-0310-9956-ffa450edef68	2014-06-30 16:51:22 +00:00
Jian He	b0c51504c4	YARN-2052. Embedded an epoch number in container id to ensure the uniqueness of container id after RM restarts. Contributed by Tsuyoshi OZAWA ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606557 13f79535-47bb-0310-9956-ffa450edef68	2014-06-29 18:24:03 +00:00
Jian He	b717d44b52	YARN-614. Changed ResourceManager to not count disk failure, node loss and RM restart towards app failures. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606407 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 23:37:46 +00:00
Zhijie Shen	55a0aa0bad	YARN-2201. Made TestRMWebServicesAppsModification be independent of the changes on yarn-default.xml. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606285 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 03:30:44 +00:00
Jason Darrell Lowe	73927ba695	YARN-2104. Scheduler queue filter failed to work because index of queue column changed. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606265 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 23:11:12 +00:00
Karthik Kambatla	f911f5495b	YARN-2204. Addendum patch. TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606168 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 18:09:41 +00:00
Ravi Prakash	f084170a0a	YARN 2163. WebUI: Order of AppId in apps table should be consistent with ApplicationId.compareTo() ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605964 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 06:43:46 +00:00
Vinod Kumar Vavilapalli	9571db19eb	YARN-2171. Improved CapacityScheduling to not lock on nodemanager-count when AMs heartbeat in. Contributed by Jason Lowe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605616 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 21:56:42 +00:00
Karthik Kambatla	1a3a7e0c1a	YARN-2204. TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605548 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 18:50:53 +00:00
Jian He	c3f1c30e65	YARN-1365. Changed ApplicationMasterService to allow an app to re-register after RM restart. Contributed by Anubhav Dhoot ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605263 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 04:42:39 +00:00
Vinod Kumar Vavilapalli	e285b98f0f	YARN-2152. Added missing information into ContainerTokenIdentifier so that NodeManagers can report the same to RM when RM restarts. Contributed Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605205 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 21:43:22 +00:00
Thomas Graves	1f9a0fd927	YARN-2072. RM/NM UIs and webservices are missing vcore information. (Nathan Roberts via tgraves) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605162 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 19:34:34 +00:00
Karthik Kambatla	c0991d11eb	YARN-2109. Fix TestRM to work with both schedulers. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605142 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 17:30:53 +00:00
Karthik Kambatla	db4d277117	YARN-2192. TestRMHA fails when run with a mix of Schedulers. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605138 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 17:05:35 +00:00
Sanford Ryza	29c102cad0	YARN-2111. In FairScheduler.attemptScheduling, we don't count containers as assigned if they have 0 memory but non-zero cores (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605113 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 15:40:39 +00:00
Vinod Kumar Vavilapalli	d16470025a	YARN-2074. Changed ResourceManager to not count AM preemptions towards app failures. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605106 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 15:15:12 +00:00
Jian He	59b5e9fa15	YARN-2191. Added a new test to ensure NM will clean up completed applications in the case of RM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604949 13f79535-47bb-0310-9956-ffa450edef68	2014-06-23 22:52:38 +00:00
Karthik Kambatla	6fcbf9b848	YARN-2187. FairScheduler: Disable max-AM-share check by default. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604321 13f79535-47bb-0310-9956-ffa450edef68	2014-06-21 07:30:07 +00:00
Haohui Mai	22cbcd16cb	HADOOP-10717. Revert r1603571. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603620 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 20:37:25 +00:00
Steve Loughran	bae5837d3b	HADOOP-10717. Missing JSP support in Jetty ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603534 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 17:08:45 +00:00
Jason Darrell Lowe	98238a8d4a	YARN-2167. LeveldbIterator should get closed in NMLeveldbStateStoreService#loadLocalizationState() within finally block. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603039 13f79535-47bb-0310-9956-ffa450edef68	2014-06-17 02:12:03 +00:00
Junping Du	072360d128	YARN-1339. Recover DeletionService state upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603036 13f79535-47bb-0310-9956-ffa450edef68	2014-06-17 01:02:16 +00:00
Jian He	95897ca14b	YARN-1885. Fixed a bug that RM may not send application-clean-up signal to NMs where the completed applications previously ran in case of RM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603028 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 23:56:12 +00:00
Karthik Kambatla	082c2ab8b8	YARN-2159. Better logging in SchedulerNode#allocateContainer. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603003 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 20:45:38 +00:00
Vinod Kumar Vavilapalli	dc7dd1fa19	YARN-1702. Added kill app functionality to RM web services. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602298 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 21:31:52 +00:00
Karthik Kambatla	4bc91b44c9	YARN-2155. FairScheduler: Incorrect threshold check for preemption. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602295 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 21:23:32 +00:00
Jian He	c6e29a9f06	YARN-2125. Changed ProportionalCapacityPreemptionPolicy to log CSV in debug level. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601980 13f79535-47bb-0310-9956-ffa450edef68	2014-06-11 18:31:28 +00:00
Jian He	710a8693e5	YARN-2124. Fixed NPE in ProportionalCapacityPreemptionPolicy. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601964 13f79535-47bb-0310-9956-ffa450edef68	2014-06-11 17:30:18 +00:00
Bikas Saha	ecfd43a2f1	YARN-2091. Add more values to ContainerExitStatus and pass it from NM to RM and then to app masters (Tsuyoshi OZAWA via bikas) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601762 13f79535-47bb-0310-9956-ffa450edef68	2014-06-10 20:08:33 +00:00
Karthik Kambatla	5de6f72054	YARN-1424. RMAppAttemptImpl should return the DummyApplicationResourceUsageReport for all invalid accesses. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601742 13f79535-47bb-0310-9956-ffa450edef68	2014-06-10 19:03:06 +00:00
Jian He	c94f2cec3a	Augmented RMStateStore with state machine. Contributed by Binglin Chang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601491 13f79535-47bb-0310-9956-ffa450edef68	2014-06-09 19:44:31 +00:00
Vinod Kumar Vavilapalli	424fd9494f	YARN-1368. Added core functionality of recovering container state into schedulers after ResourceManager Restart so as to preserve running work in the cluster. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601303 13f79535-47bb-0310-9956-ffa450edef68	2014-06-09 03:09:21 +00:00
Karthik Kambatla	9958072d53	YARN-2132. ZKRMStateStore.ZKAction#runWithRetries doesn't log the exception it encounters. (Vamsee Yarlagadda via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601065 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 06:12:59 +00:00
Karthik Kambatla	85d4c787e0	YARN-2128. FairScheduler: Incorrect calculation of amResource usage. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601050 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 01:21:33 +00:00
Karthik Kambatla	969bef3c77	YARN-2122. In AllocationFileLoaderService, the reloadThread should be created in init() and started in start(). (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601045 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 00:49:20 +00:00
Zhijie Shen	08b4aa699a	YARN-2117. Fixed the issue that secret file reader is potentially not closed in TimelineAuthenticationFilterInitializer. Contributed by Chen He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600994 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 20:07:58 +00:00
Zhijie Shen	d7f5d76869	YARN-2118. Fixed the type mismatch in Map#containsKey check of TimelineWebServices#injectOwnerInfo. Contributed by Ted Yu. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600967 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 17:47:03 +00:00
Junping Du	0ceb742549	YARN-1977. Add tests on getApplicationRequest with filtering start time range. (Contributed by Junping Du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600644 13f79535-47bb-0310-9956-ffa450edef68	2014-06-05 13:15:44 +00:00
Karthik Kambatla	d1d6bb70f4	YARN-2061. Revisit logging levels in ZKRMStateStore. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600498 13f79535-47bb-0310-9956-ffa450edef68	2014-06-04 21:11:09 +00:00
Karthik Kambatla	731f417f67	YARN-2119. DEFAULT_PROXY_ADDRESS should use DEFAULT_PROXY_PORT. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600484 13f79535-47bb-0310-9956-ffa450edef68	2014-06-04 20:12:47 +00:00
Sanford Ryza	16caa3fd18	YARN-1913. With Fair Scheduler, cluster can logjam when all resources are consumed by AMs (Wei Yan via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599400 13f79535-47bb-0310-9956-ffa450edef68	2014-06-03 00:56:48 +00:00
Karthik Kambatla	0aad2d56df	YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599345 13f79535-47bb-0310-9956-ffa450edef68	2014-06-02 20:22:52 +00:00
Karthik Kambatla	a4ba451802	YARN-1474. Make schedulers services. (Tsuyoshi Ozawa via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598908 13f79535-47bb-0310-9956-ffa450edef68	2014-05-31 19:33:09 +00:00
Vinod Kumar Vavilapalli	23c325ad47	YARN-2115. Replaced RegisterNodeManagerRequest's ContainerStatus with a new NMContainerStatus which has more information that is needed for work-preserving RM-restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598790 13f79535-47bb-0310-9956-ffa450edef68	2014-05-31 00:20:50 +00:00
Junping Du	66598697a6	YARN-1338. Recover localized resource cache state upon nodemanager restart (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598640 13f79535-47bb-0310-9956-ffa450edef68	2014-05-30 15:37:27 +00:00
Karthik Kambatla	49a3a0cd0c	YARN-2054. Better defaults for YARN ZK configs for retries and retry-inteval when HA is enabled. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598630 13f79535-47bb-0310-9956-ffa450edef68	2014-05-30 15:24:49 +00:00
Arpit Agarwal	4a4868e523	HADOOP-10448. Support pluggable mechanism to specify proxy user settings (Contributed by Benoy Antony) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598396 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 20:52:01 +00:00
Vinod Kumar Vavilapalli	cd24e955cf	YARN-2112. Fixed yarn-common's pom.xml to include jackson dependencies so that both Timeline Server and client can access them. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598373 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 19:06:36 +00:00
Sanford Ryza	342da5b4d3	YARN-596. Use scheduling policies throughout the queue hierarchy to decide which containers to preempt (Wei Yan via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598197 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 04:01:24 +00:00
Zhijie Shen	001078e067	YARN-2107. Refactored timeline classes into o.a.h.y.s.timeline package. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598094 13f79535-47bb-0310-9956-ffa450edef68	2014-05-28 18:09:04 +00:00
Sanford Ryza	edfbc8ad4a	YARN-2105. Fix TestFairScheduler after YARN-2012. (Ashwin Shankar via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597902 13f79535-47bb-0310-9956-ffa450edef68	2014-05-27 23:46:22 +00:00
Vinod Kumar Vavilapalli	4dd2003373	YARN-2071. Modified levelDB store permissions to be readable only by the server user. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597231 13f79535-47bb-0310-9956-ffa450edef68	2014-05-24 01:24:26 +00:00
Karthik Kambatla	7dd378c274	YARN-2096. Race in TestRMRestart#testQueueMetricsOnRMRestart. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597223 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 23:51:00 +00:00
Sanford Ryza	a00b2d4f37	YARN-2073. Fair Scheduler: Add a utilization threshold to prevent preempting resources when cluster is free (Karthik Kambatla via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597209 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:52:46 +00:00
Vinod Kumar Vavilapalli	7f0724dddb	YARN-2059. Added admin ACLs support to Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597207 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:40:52 +00:00
Sanford Ryza	6c56612af5	YARN-2012. Fair Scheduler: allow default queue placement rule to take an arbitrary queue (Ashwin Shankar via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597204 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:38:52 +00:00
Vinod Kumar Vavilapalli	892ada8fb3	YARN-1937. Added owner-only ACLs support for Timeline Client and server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597186 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 21:19:15 +00:00
Vinod Kumar Vavilapalli	af8b09af75	YARN-1936. Added security support for the Timeline Client. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597153 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 18:47:57 +00:00
Vinod Kumar Vavilapalli	b867b69556	YARN-2049. Added delegation-token support for the Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597130 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 17:09:47 +00:00
Karthik Kambatla	619ec833fc	YARN-2089. FairScheduler: QueuePlacementPolicy and QueuePlacementRule are missing audience annotations. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596765 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 06:13:24 +00:00
Vinod Kumar Vavilapalli	82f3454f5a	YARN-2017. Merged some of the common scheduler code. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596753 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 05:32:26 +00:00
Vinod Kumar Vavilapalli	fdb5870d49	YARN-1938. Added kerberos login for the Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596710 13f79535-47bb-0310-9956-ffa450edef68	2014-05-21 23:20:08 +00:00
Jian He	0f9147c857	YARN-2053. Fixed a bug in AMS to not add null NMToken into NMTokens list from previous attempts for work-preserving AM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595116 13f79535-47bb-0310-9956-ffa450edef68	2014-05-16 06:22:22 +00:00
Sanford Ryza	561c014e77	YARN-2042. String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp (Chen He via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594482 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 06:55:04 +00:00
Sanford Ryza	84dfae2f8a	YARN-1986. In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE (Hong Zhiguo via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594476 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 06:41:20 +00:00
Junping Du	b29434a5c8	YARN-1362. Distinguish between nodemanager shutdown for decommission vs shutdown for restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594421 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 00:20:53 +00:00
Christopher Douglas	45b42676f9	YARN-1957. Consider the max capacity of the queue when computing the ideal ... capacity for preemption. Contributed by Carlo Curino git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594414 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 23:15:27 +00:00
Jonathan Turner Eagles	1c48142807	YARN-1981. Nodemanager version is not updated when a node reconnects (Jason Lowe via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594358 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 20:03:58 +00:00
Vinod Kumar Vavilapalli	2f87e77cb7	YARN-1861. Fixed a bug in RM to reset leader-election on fencing that was causing both RMs to be stuck in standby mode when automatic failover is enabled. Contributed by Karthik Kambatla and Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594356 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 20:00:44 +00:00
Jason Darrell Lowe	95ba9f47fc	YARN-1751. Improve MiniYarnCluster for log aggregation testing. Contributed by Ming Ma ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594275 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 16:43:59 +00:00
Jian He	41344a4a69	YARN-1975. Fix yarn application CLI to print the scheme of the tracking url of failed/killed applications. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593874 13f79535-47bb-0310-9956-ffa450edef68	2014-05-12 00:43:35 +00:00
Junping Du	ca95af7d23	YARN-2011. Fix typo and warning in TestLeafQueue (Contributed by Chen He) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593804 13f79535-47bb-0310-9956-ffa450edef68	2014-05-11 15:13:29 +00:00
Karthik Kambatla	4a19196a34	YARN-1987. Wrapper for leveldb DBIterator to aid in handling database exceptions. (Jason Lowe via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593757 13f79535-47bb-0310-9956-ffa450edef68	2014-05-11 06:11:04 +00:00