1346 Commits

Author	SHA1	Message	Date
Mayank Bansal	df3becf080	YARN-2598 GHS should show N/A instead of null for the inaccessible information (Zhijie Shen via mayank)	2014-10-08 17:27:53 -07:00
Jian He	e16e25ab1b	YARN-2649. Fixed TestAMRMRPCNodeUpdates test failure. Contributed by Ming Ma	2014-10-08 10:58:51 -07:00
Jian He	30d56fdbb4	YARN-1857. CapacityScheduler headroom doesn't account for other AM's running. Contributed by Chen He and Craig Welch	2014-10-07 13:45:04 -07:00
Jian He	519e5a7dd2	YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch	2014-10-06 15:48:46 -07:00
Jian He	ea26cc0b4a	YARN-2615. Changed ClientToAMTokenIdentifier/RM(Timeline)DelegationTokenIdentifier to use protobuf as payload. Contributed by Junping Du	2014-10-06 10:47:43 -07:00
Chris Douglas	c8212bacb1	YARN-1051. Add a system for creating reservations of cluster capacity. ... Contributed by Subru Krishnan and Carlo Curino.	2014-10-03 17:09:02 -07:00
subru	a2986234be	YARN-2611. Fixing jenkins findbugs warning and TestRMWebServicesCapacitySched for branch YARN-1051. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit c47464aba407d1dafe10be23fe454f0489cc4367)	2014-10-03 15:43:23 -07:00
subru	5e10a13bb4	YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 90ac0be86b898aefec5471db4027554c8e1b310c)	2014-10-03 15:43:13 -07:00
subru	6261f7cc69	YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 8baeaead8532898163f1006276b731a237b1a559) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java	2014-10-03 15:42:43 -07:00
subru	3418c56bcf	YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino. ... (cherry picked from commit 169085319b8b76641f8b9f6840a3fef06d221e2b)	2014-10-03 15:42:10 -07:00
carlo curino	b6df0dddcd	YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit c4918cb4cb5a267a8cfd6eace28fcfe7ad6174e8)	2014-10-03 15:42:03 -07:00
carlo curino	f66ffcf832	YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit aef7928899b37262773f3dc117157bb746bf8918)	2014-10-03 15:41:57 -07:00
subru	cf4b34282a	YARN-1709. In-memory data structures used to track resources over time to enable reservations. ... (cherry picked from commit 0d8b2cd88b958b1e602fd4ea4078ef8d4742a7c3)	2014-10-03 15:41:51 -07:00
carlo curino	1c6950354f	YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan. ... (cherry picked from commit f83a07f266f2c5e6eead554d8a331ed7e75e10d5)	2014-10-03 15:41:21 -07:00
carlo curino	eb3e40b833	YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan ... (cherry picked from commit aac47fda7fecda9fc18ade34d633eca895865a70) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java	2014-10-03 15:41:02 -07:00
Vinod Kumar Vavilapalli	34cdcaad71	YARN-2468. Enhanced NodeManager to support log handling APIs (YARN-2569) for use by long running services. Contributed by Xuan Gong.	2014-10-03 12:15:40 -07:00
Karthik Kambatla	80d11eb68e	YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha)	2014-10-03 11:49:49 -07:00
Jian He	054f285526	YARN-2628. Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free. Contributed by Varun Vasudev	2014-10-02 15:13:33 -07:00
Jason Lowe	29f520052e	YARN-2624. Resource Localization fails on a cluster due to existing cache directories. Contributed by Anubhav Dhoot	2014-10-02 17:39:34 +00:00
Karthik Kambatla	5e0b49da9c	YARN-2254. TestRMWebServicesAppsModification should run against both CS and FS. (Zhihai Xu via kasha)	2014-10-02 10:15:04 -07:00
Jian He	3ef1cf187f	YARN-2617. Fixed NM to not send duplicate container status whose app is not running. Contributed by Jun Gong	2014-10-02 10:04:09 -07:00
junping_du	c7cee9b455	YARN-1979. TestDirectoryCollection fails when the umask is unusual. (Contributed by Vinod Kumar Vavilapalli and Tsuyoshi OZAWA)	2014-10-02 08:02:59 -07:00
Vinod Kumar Vavilapalli	9e40de6af7	YARN-2446. Augmented Timeline service APIs to start taking in domains as a parameter while posting entities and events. Contributed by Zhijie Shen.	2014-10-01 17:52:03 -07:00
junping_du	0708827a93	YARN-2613. Support retry in NMClient for rolling-upgrades. (Contributed by Jian He)	2014-10-01 16:50:30 -07:00
Zhijie Shen	52bbe0f11b	YARN-2630. Prevented previous AM container status from being acquired by the current restarted AM. Contributed by Jian He.	2014-10-01 15:38:11 -07:00
Vinod Kumar Vavilapalli	ba7f31c2ee	YARN-1972. Added a secure container-executor for Windows. Contributed by Remus Rusanu.	2014-10-01 10:14:41 -07:00
Karthik Kambatla	17d1202c35	YARN-2179. [YARN-1492] Initial cache manager structure and context. (Chris Trezzo via kasha)	2014-09-30 19:01:47 -07:00
Jian He	bbff96be48	YARN-2602. Fixed possible NPE in ApplicationHistoryManagerOnTimelineStore. Contributed by Zhijie Shen	2014-09-30 16:44:17 -07:00
Karthik Kambatla	14d60dadc2	YARN-2594. Potential deadlock in RM when querying ApplicationResourceUsageReport. (Wangda Tan via kasha)	2014-09-30 16:12:27 -07:00
Zhijie Shen	9582a50176	YARN-2627. Added the info logs of attemptFailuresValidityInterval and number of previous failed attempts. Contributed by Xuan Gong.	2014-09-30 12:57:45 -07:00
Jonathan Eagles	e10eeaabce	YARN-2606. Application History Server tries to access hdfs before doing secure login (Mit Desai via jeagles)	2014-09-29 16:37:23 -05:00
Jason Lowe	9c22065109	YARN-1769. CapacityScheduler: Improve reservations. Contributed by Thomas Graves	2014-09-29 14:12:18 +00:00
Jian He	5391919b09	YARN-668. Changed NMTokenIdentifier/AMRMTokenIdentifier/ContainerTokenIdentifier to use protobuf object as the payload. Contributed by Junping Du.	2014-09-26 17:48:41 -07:00
Karthik Kambatla	f4357240a6	YARN-2608. FairScheduler: Potential deadlocks in loading alloc files and clock access. (Wei Yan via kasha)	2014-09-25 17:42:51 -07:00
Jason Lowe	8269bfa613	YARN-2523. ResourceManager UI showing negative value for "Decommissioned Nodes" field. Contributed by Rohith	2014-09-25 22:37:05 +00:00
Zhijie Shen	72b0881ca6	YARN-2546. Made REST API for application creation/submission use numeric and boolean types instead of the string of them. Contributed by Varun Vasudev.	2014-09-24 17:57:32 -07:00
Zhijie Shen	c86674a3a4	YARN-2581. Passed LogAggregationContext to NM via ContainerTokenIdentifier. Contributed by Xuan Gong.	2014-09-24 17:50:26 -07:00
Karthik Kambatla	39c87344e1	YARN-2596. TestWorkPreservingRMRestart fails with FairScheduler. (kasha)	2014-09-24 15:23:31 -07:00
Vinod Kumar Vavilapalli	d78b452a4f	YARN-2102. Added the concept of a Timeline Domain to handle read/write ACLs on Timeline service event data. Contributed by Zhijie Shen.	2014-09-24 11:27:53 -07:00
Allen Wittenauer	034df0e2eb	YARN-2161. Fix build on macosx: YARN parts (Binglin Chang via aw)	2014-09-24 08:47:55 -07:00
Karthik Kambatla	f5578207d2	YARN-2252. Intermittent failure of TestFairScheduler.testContinuousScheduling. (Ratandeep Ratti and kasha via kasha)	2014-09-23 00:03:16 -07:00
Karthik Kambatla	568d3dc2bb	YARN-1959. Fix headroom calculation in FairScheduler. (Anubhav Dhoot via kasha)	2014-09-22 23:49:39 -07:00
junping_du	a9a55db065	YARN-2584. TestContainerManagerSecurity fails on trunk. (Contributed by Jian He)	2014-09-22 22:45:06 -07:00
Karthik Kambatla	43efdd30b5	YARN-2539. FairScheduler: Set the default value for maxAMShare to 0.5. (Wei Yan via kasha)	2014-09-22 16:09:52 -07:00
Karthik Kambatla	23e17ce0ff	YARN-2540. FairScheduler: Queue filters not working on scheduler page in RM UI. (Ashwin Shankar via kasha)	2014-09-22 15:40:47 -07:00
Jian He	0a641496c7	YARN-1372. Ensure all completed containers are reported to the AMs across RM restart. Contributed by Anubhav Dhoot	2014-09-22 10:30:53 -07:00
Karthik Kambatla	9721e2c1fe	YARN-2453. TestProportionalCapacityPreemptionPolicy fails with FairScheduler. (Zhihai Xu via kasha)	2014-09-21 23:13:45 -07:00
Karthik Kambatla	c50fc92502	YARN-2452. TestRMApplicationHistoryWriter fails with FairScheduler. (Zhihai Xu via kasha)	2014-09-21 13:15:04 -07:00
Jian He	444acf8ea7	YARN-2565. Fixed RM to not use FileSystemApplicationHistoryStore unless explicitly set. Contributed by Zhijie Shen	2014-09-19 11:26:29 -07:00
Zhijie Shen	6fe5c6b746	YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He.	2014-09-18 21:56:56 -07:00
Jason Lowe	a337f0e354	YARN-2561. MR job client cannot reconnect to AM after NM restart. Contributed by Junping Du	2014-09-18 21:34:40 +00:00
Jason Lowe	9ea7b6c063	YARN-2363. Submitted applications occasionally lack a tracking URL. Contributed by Jason Lowe	2014-09-18 20:13:16 +00:00
Vinod Kumar Vavilapalli	485c96e3cb	YARN-2001. Added a time threshold for RM to wait before starting container allocations after restart/failover. Contributed by Jian He.	2014-09-18 11:03:12 -07:00
Jian He	ee21b13cbd	YARN-2559. Fixed NPE in SystemMetricsPublisher when retrieving FinalApplicationStatus. Contributed by Zhijie Shen	2014-09-17 21:44:15 -07:00
Jian He	f4886111aa	YARN-2558. Updated ContainerTokenIdentifier#read/write to use ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA.	2014-09-17 15:13:59 -07:00
junping_du	90a0c03f0a	YARN-1250. Generic history service should support application-acls. (Contributed by Zhijie Shen)	2014-09-16 18:20:49 -07:00
Vinod Kumar Vavilapalli	9f6891d9ef	YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev.	2014-09-16 10:14:46 -07:00
Jian He	88e329fdfb	YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen	2014-09-15 13:13:54 -07:00
cnauroth	9d4ec97c95	YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest classes. Contributed by Chris Nauroth.	2014-09-15 11:53:57 -07:00
Vinod Kumar Vavilapalli	14e2639fd0	YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong.	2014-09-13 18:04:05 -07:00
Zhijie Shen	98588cf044	YARN-2528. Relaxed http response split vulnerability protection for the origins header and made it accept multiple origins in CrossOriginFilter. Contributed by Jonathan Eagles.	2014-09-12 21:33:01 -07:00
XuanGong	e65ae575a0	YARN-2456. Possible livelock in CapacityScheduler when RM is recovering ... apps. Contributed by Jian He	2014-09-12 15:21:46 -07:00
Jonathan Eagles	54e5794806	YARN-2547. Cross Origin Filter throws UnsupportedOperationException upon destroy (Mit Desai via jeagles)	2014-09-12 15:35:17 -05:00
Jian He	3122daa802	YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA	2014-09-12 10:33:33 -07:00
Jason Lowe	78b048393a	YARN-2484. FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block. Contributed by Tsuyoshi OZAWA	2014-09-12 14:09:14 +00:00
Zhijie Shen	469ea3dcef	YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. Contributed by Xuan Gong.	2014-09-11 22:19:00 -07:00
junping_du	6b8b1608e6	YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen)	2014-09-12 10:04:51 +08:00
Karthik Kambatla	c11ada5ea6	YARN-2534. FairScheduler: Potential integer overflow calculating totalMaxShare. (Zhihai Xu via kasha)	2014-09-11 12:06:06 -07:00
Vinod Kumar Vavilapalli	4be95175cd	YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all containers to a preconfigured limit. Contributed by Varun Vasudev.	2014-09-10 19:22:52 -07:00
Jian He	83be3ad444	YARN-415. Capture aggregate memory allocation at the app-level for chargeback. Contributed by Eric Payne & Andrey Klochkov	2014-09-10 18:20:54 -07:00
Jian He	cbfe26370b	YARN-2158. Fixed TestRMWebServicesAppsModification#testSingleAppKill test failure. Contributed by Varun Vasudev	2014-09-10 12:47:34 -07:00
XUAN	47bdfa044a	YARN-2459. RM crashes if App gets rejected for any reason and HA is enabled. Contributed by Jian He	2014-09-10 11:44:41 -07:00
Vinod Kumar Vavilapalli	b67d5ba784	YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource types to the AMs. Contributed by Varun Vasudev.	2014-09-10 10:15:47 -07:00
Karthik Kambatla	3072c83b38	YARN-1458. FairScheduler: Zero weight can lead to livelock. (Zhihai Xu via kasha)	2014-09-10 08:26:14 -07:00
Zhijie Shen	a092cdf32d	YARN-2512. Allowed pattern matching for origins in CrossOriginFilter. Contributed by Jonathan Eagles.	2014-09-07 17:49:06 -07:00
Jonathan Eagles	e6420fec0a	YARN-2508. Cross Origin configuration parameters prefix are not honored (Mit Desai via jeagles)	2014-09-05 19:42:40 -05:00
Zhijie Shen	51a4faf521	YARN-2511. Allowed all origins by default when CrossOriginFilter is enabled. Contributed by Jonathan Eagles.	2014-09-04 15:01:01 -07:00
Jason Lowe	3fa5f728c4	YARN-2431. NM restart: cgroup is not removed for reacquired containers. Contributed by Jason Lowe	2014-09-04 21:11:27 +00:00
Jonathan Eagles	91d45f0f01	YARN-2509. Enable Cross Origin Filter for timeline server only and not all Yarn servers (Mit Desai via jeagles)	2014-09-04 11:53:52 -05:00
Karthik Kambatla	1dcaba9a7a	YARN-2394. FairScheduler: Configure fairSharePreemptionThreshold per queue. (Wei Yan via kasha)	2014-09-03 10:27:36 -07:00
Karthik Kambatla	0f34e6f387	YARN-2395. FairScheduler: Preemption timeout should be configurable per queue. (Wei Yan via kasha)	2014-08-30 01:17:13 -07:00
Jian He	5c14bc426b	YARN-1506. Changed RMNode/SchedulerNode to update resource with event notification. Contributed by Junping Du	2014-08-29 23:05:51 -07:00
Karthik Kambatla	270a271f53	YARN-2360. Fair Scheduler: Display dynamic fair share for queues on the scheduler page. (Ashwin Shankar and Wei Yan via kasha)	2014-08-29 17:15:38 -07:00
Jason Lowe	b03653f9a5	YARN-2462. TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync should have a test timeout. Contributed by Eric Payne	2014-08-29 20:15:40 +00:00
Jian He	c686aa3533	YARN-2447. RM web service app submission doesn't pass secrets correctly. Contributed by Varun Vasudev	2014-08-29 11:40:47 -07:00
Hitesh Shah	3de66011c2	YARN-2450. Fix typos in log messages. Contributed by Ray Chiang.	2014-08-29 11:16:36 -07:00
Zhijie Shen	4bd0194e6b	YARN-2449. Fixed the bug that TimelineAuthenticationFilterInitializer is not automatically added when hadoop.http.filter.initializers is not configured. Contributed by Varun Vasudev.	2014-08-29 09:40:39 -07:00
Karthik Kambatla	fa80ca49bd	YARN-2405. NPE in FairSchedulerAppsBlock. (Tsuyoshi Ozawa via kasha)	2014-08-28 23:21:37 -07:00
Jian	7b3e27ab73	YARN-2406. Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto. Contributed by Tsuyoshi OZAWA	2014-08-28 21:47:26 -07:00
Zhijie Shen	d778abf022	YARN-2035. FileSystemApplicationHistoryStore should not make working dir when it already exists. Contributed by Jonathan Eagles.	2014-08-27 02:01:00 -07:00
Karthik Kambatla	d16bfd1d0f	YARN-1326. RM should log using RMStore at startup time. (Tsuyoshi Ozawa via kasha)	2014-08-27 01:43:58 -07:00
Karthik Kambatla	0097b15e21	YARN-2393. FairScheduler: Add the notion of steady fair share. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619845 13f79535-47bb-0310-9956-ffa450edef68	2014-08-22 15:44:47 +00:00
Jason Darrell Lowe	4236c6600e	YARN-2434. RM should not recover containers from previously failed attempt when AM restart is not enabled. Contributed by Jian He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619614 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 22:41:34 +00:00
Allen Wittenauer	7e75226e68	YARN-2424. LCE should support non-cgroups, non-secure mode (Chris Douglas via aw) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619421 13f79535-47bb-0310-9956-ffa450edef68	2014-08-21 14:57:11 +00:00
Karthik Kambatla	e1dd210fa5	YARN-1919. Potential NPE in EmbeddedElectorService#stop. (Tsuyoshi Ozawa via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619251 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 22:10:52 +00:00
Jian He	e4539e88e3	YARN-2174. Enable HTTPs for the writer REST API of TimelineServer. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1619160 13f79535-47bb-0310-9956-ffa450edef68	2014-08-20 17:05:07 +00:00
Zhijie Shen	f6a778c372	YARN-2249. Avoided AM release requests being lost on work preserving RM restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618972 13f79535-47bb-0310-9956-ffa450edef68	2014-08-19 20:33:49 +00:00
Jian He	375c221960	YARN-2409. RM ActiveToStandBy transition missing stoping previous rmDispatcher. Contributed by Rohith ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618915 13f79535-47bb-0310-9956-ffa450edef68	2014-08-19 17:49:39 +00:00
Jian He	519c4be95a	YARN-2411. Support simple user and group mappings to queues. Contributed by Ram Venkatesh ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618542 13f79535-47bb-0310-9956-ffa450edef68	2014-08-18 06:08:45 +00:00
Jian He	c3084d6c16	YARN-2389. Added functionality for schedulers to kill all applications in a queue. Contributed by Subramaniam Venkatraman Krishnan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618294 13f79535-47bb-0310-9956-ffa450edef68	2014-08-15 23:53:57 +00:00
Jian He	7360cec692	YARN-2378. Added support for moving applications across queues in CapacityScheduler. Contributed by Subramaniam Venkatraman Krishnan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618106 13f79535-47bb-0310-9956-ffa450edef68	2014-08-15 06:00:31 +00:00
Zhijie Shen	a9023c2736	YARN-2397. Avoided loading two authentication filters for RM and TS web interfaces. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1618054 13f79535-47bb-0310-9956-ffa450edef68	2014-08-14 21:17:20 +00:00
Zhijie Shen	41aa4badf8	YARN-2277. Added cross-origin support for the timeline server web services. Contributed by Jonathan Eagles. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617832 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 20:29:23 +00:00
Karthik Kambatla	5197f8c3c5	YARN-1370. Fair scheduler to re-populate container allocation state. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617645 13f79535-47bb-0310-9956-ffa450edef68	2014-08-13 01:38:59 +00:00
Karthik Kambatla	4239695588	YARN-2399. Delete old versions of files. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617619 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 22:51:57 +00:00
Karthik Kambatla	486e718fc1	YARN-2399. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617600 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 21:43:27 +00:00
Junping Du	c2febdcbaa	YARN-1337. Recover containers upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617448 13f79535-47bb-0310-9956-ffa450edef68	2014-08-12 10:56:13 +00:00
Jian He	c4dc685343	YARN-2138. Cleaned up notifyDone* APIs in RMStateStore. Contributed by Varun Saxena ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617341 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 18:24:24 +00:00
Xuan Gong	946be75704	YARN-2400: Addendum fix for TestAMRestart failure. Contributed by Jian He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617333 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 17:42:53 +00:00
Karthik Kambatla	da7b508ffc	YARN-2361. RMAppAttempt state machine entries for KILLED state has duplicate event entries. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617190 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 01:42:26 +00:00
Karthik Kambatla	bdd3e2ce49	YARN-2337. ResourceManager sets ClientRMService in RMContext multiple times. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617183 13f79535-47bb-0310-9956-ffa450edef68	2014-08-11 00:13:27 +00:00
Junping Du	e91d099c4a	YARN-2302. Refactor TimelineWebServices. (Contributed by Zhijie Shen) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617055 13f79535-47bb-0310-9956-ffa450edef68	2014-08-10 07:21:15 +00:00
Xuan Gong	743f7f30da	YARN-2400. Fixed TestAMRestart fails intermittently. Contributed by Jian He: ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1617028 13f79535-47bb-0310-9956-ffa450edef68	2014-08-09 23:31:11 +00:00
Karthik Kambatla	a7643f4de7	YARN-2026. Fair scheduler: Consider only active queues for computing fairshare. (Ashwin Shankar via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616915 13f79535-47bb-0310-9956-ffa450edef68	2014-08-09 02:10:00 +00:00
Xuan Gong	eeb4acd955	YARN-2212: ApplicationMaster needs to find a way to update the AMRMToken periodically. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616892 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 21:38:24 +00:00
Karthik Kambatla	6d39525f6b	YARN-2352. Add missing file. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616784 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 14:38:18 +00:00
Karthik Kambatla	14864e9c7c	YARN-2352. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616769 13f79535-47bb-0310-9956-ffa450edef68	2014-08-08 14:17:54 +00:00
Jian He	8437df8ba9	YARN-2008. Fixed CapacityScheduler to calculate headroom based on max available capacity instead of configured max capacity. Contributed by Craig Welch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616580 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 20:00:04 +00:00
Zhijie Shen	3bfdb0091d	YARN-2288. Made persisted data in LevelDB timeline store be versioned. Contributed by Junping Du. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616540 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 17:02:26 +00:00
Zhijie Shen	be6360593b	YARN-2388. Fixed TestTimelineWebServices failure due to HADOOP-10791. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616405 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 05:36:50 +00:00
Karthik Kambatla	8feddc4c84	YARN-2359. Application hangs when it fails to launch AM container. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1616375 13f79535-47bb-0310-9956-ffa450edef68	2014-08-07 00:06:17 +00:00
Junping Du	b8f151231b	YARN-1354. Recover applications upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615550 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 13:25:37 +00:00
Junping Du	04ae560370	YARN-2370. Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo (Contributed by Wenwu Peng) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615469 13f79535-47bb-0310-9956-ffa450edef68	2014-08-04 01:15:46 +00:00
Jian He	a41c314373	YARN-2343. Improve NMToken expire exception message. Contributed by Li Lu ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1615270 13f79535-47bb-0310-9956-ffa450edef68	2014-08-01 23:44:48 +00:00
Xuan Gong	e52f67e389	YARN-1994. Expose YARN/MR endpoints on multiple interfaces. Contributed by Craig Welch, Milan Potocnik,and Arpit Agarwal ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614981 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 20:06:02 +00:00
Zhijie Shen	1d6e178144	YARN-2347. Consolidated RMStateVersion and NMDBSchemaVersion into Version in yarn-server-common. Contributed by Junping Du. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614838 13f79535-47bb-0310-9956-ffa450edef68	2014-07-31 09:27:43 +00:00
Karthik Kambatla	c0b49ff107	YARN-2328. FairScheduler: Verify update and continuous scheduling threads are stopped when the scheduler is stopped. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1614432 13f79535-47bb-0310-9956-ffa450edef68	2014-07-29 17:41:52 +00:00
Zhijie Shen	d6532d3a77	YARN-2247. Made RM web services authenticate users via kerberos and delegation token. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613821 13f79535-47bb-0310-9956-ffa450edef68	2014-07-27 17:55:06 +00:00
Aaron Myers	5d4677b57b	YARN-1796. container-executor shouldn't require o-r permissions. Contributed by Aaron T. Myers. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613548 13f79535-47bb-0310-9956-ffa450edef68	2014-07-26 01:51:35 +00:00
Jian He	d4fec34933	YARN-2211. Persist AMRMToken master key in RMStateStore for RM recovery. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613515 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 20:42:37 +00:00
Karthik Kambatla	1e553858f9	YARN-2214. FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness. (Ashwin Shankar via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1613459 13f79535-47bb-0310-9956-ffa450edef68	2014-07-25 16:13:07 +00:00
Devarajulu K	2050e0dad6	YARN-1342. Recover container tokens upon nodemanager restart. Contributed by Jason Lowe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612995 13f79535-47bb-0310-9956-ffa450edef68	2014-07-24 05:02:00 +00:00
Jason Darrell Lowe	28fca92521	YARN-2147. client lacks delegation token exception details when application submit fails. Contributed by Chen He ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612950 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 21:40:57 +00:00
Sanford Ryza	c88402f36d	YARN-2313. Livelock can occur in FairScheduler when there are lots of running apps (Tsuyoshi Ozawa via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612769 13f79535-47bb-0310-9956-ffa450edef68	2014-07-23 05:00:52 +00:00
Karthik Kambatla	ff77582991	YARN-2273. NPE in ContinuousScheduling thread when we lose a node. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612720 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 22:44:38 +00:00
Zhijie Shen	eac0701c96	YARN-2319. Made the MiniKdc instance start/close before/after the class of TestRMWebServicesDelegationTokens. Contributed by Wenwu Peng. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612588 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 15:15:29 +00:00
Junping Du	afb9394c91	YARN-2242. Addendum patch. Improve exception information on AM launch crashes. (Contributed by Li Lu) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612565 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 13:07:23 +00:00
Junping Du	537c361f5b	YARN-2013. The diagnostics is always the ExitCodeException stack when the container crashes. (Contributed by Tsuyoshi OZAWA) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612449 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 03:01:58 +00:00
Karthik Kambatla	266a4ff6a5	YARN-2131. Addendum. Add a way to format the RMStateStore. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612443 13f79535-47bb-0310-9956-ffa450edef68	2014-07-22 01:30:36 +00:00
Jason Darrell Lowe	1ad2d7b405	YARN-2321. NodeManager web UI can incorrectly report Pmem enforcement. Contributed by Leitao Guo ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612411 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 21:55:06 +00:00
Jason Darrell Lowe	8a87085820	YARN-2045. Data persisted in NM should be versioned. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612285 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 14:43:59 +00:00
Sanford Ryza	7c71a3b876	YARN-2323. FairShareComparator creates too many Resource objects (Hong Zhiguo via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612187 13f79535-47bb-0310-9956-ffa450edef68	2014-07-21 05:00:27 +00:00
Karthik Kambatla	8871d8ed9f	YARN-2244. FairScheduler missing handling of containers for unknown application attempts. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611840 13f79535-47bb-0310-9956-ffa450edef68	2014-07-19 00:12:05 +00:00
Xuan Gong	f1b831ccfb	YARN-2208. AMRMTokenManager need to have a way to roll over AMRMToken. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611820 13f79535-47bb-0310-9956-ffa450edef68	2014-07-18 21:46:29 +00:00
Junping Du	403ec8ea80	YARN-1341. Recover NMTokens upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611512 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 23:33:22 +00:00
Jian He	3c193811ca	YARN-2219. Addendum patch for YARN-2219 ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611240 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 03:28:39 +00:00
Vinod Kumar Vavilapalli	bda23181bf	YARN-2219. Changed ResourceManager to avoid AMs and NMs getting exceptions after RM recovery but before scheduler learns about apps and app-attempts. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1611222 13f79535-47bb-0310-9956-ffa450edef68	2014-07-17 00:14:56 +00:00
Vinod Kumar Vavilapalli	030580387a	YARN-2233. Implemented ResourceManager web-services to create, renew and cancel delegation tokens. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610876 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 23:00:17 +00:00
Mayank Bansal	43589a8df7	YARN-1408 Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins. (Sunil G via mayank) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610860 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 21:48:58 +00:00
Vinod Kumar Vavilapalli	a6cd712ca7	YARN-2228. Augmented TimelineServer to load pseudo authentication filter when authentication = simple. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610575 13f79535-47bb-0310-9956-ffa450edef68	2014-07-15 04:33:48 +00:00
Vinod Kumar Vavilapalli	c6cc6a6a8e	YARN-2260. Fixed ResourceManager's RMNode to correctly remember containers when nodes resync during work-preserving RM restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610557 13f79535-47bb-0310-9956-ffa450edef68	2014-07-14 23:32:03 +00:00
Karthik Kambatla	4d211d5fde	YARN-2274. FairScheduler: Add debug information about cluster capacity, availability and reservations. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609942 13f79535-47bb-0310-9956-ffa450edef68	2014-07-12 15:10:19 +00:00
Jian He	c9fb040c87	YARN-2181. Added preemption info to logs and RM web UI. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609561 13f79535-47bb-0310-9956-ffa450edef68	2014-07-10 20:03:35 +00:00
Karthik Kambatla	8fbca62a90	YARN-2131. Add a way to format the RMStateStore. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1609278 13f79535-47bb-0310-9956-ffa450edef68	2014-07-09 19:58:43 +00:00
Zhijie Shen	12c4197b35	YARN-2158. Improved assertion messages of TestRMWebServicesAppsModification. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608667 13f79535-47bb-0310-9956-ffa450edef68	2014-07-08 05:50:04 +00:00
Jian He	6d7dbd4fed	YARN-1367. Changed NM to not kill containers on NM resync if RM work-preserving restart is enabled. Contributed by Anubhav Dhoot ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1608334 13f79535-47bb-0310-9956-ffa450edef68	2014-07-07 04:37:59 +00:00
Sanford Ryza	5644f529f3	YARN-2250. FairScheduler.findLowestCommonAncestorQueue returns null when queues not identical (Krisztian Horvath via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607872 13f79535-47bb-0310-9956-ffa450edef68	2014-07-04 15:16:43 +00:00
Junping Du	5cb489f9d3	YARN-2242. Improve exception information on AM launch crashes. (Contributed by Li Lu) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607655 13f79535-47bb-0310-9956-ffa450edef68	2014-07-03 14:15:19 +00:00
Vinod Kumar Vavilapalli	45b191e38c	YARN-2232. Fixed ResourceManager to allow DelegationToken owners to be able to cancel their own tokens in secure mode. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607484 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 21:36:42 +00:00
Karthik Kambatla	447c1c233b	YARN-2241. ZKRMStateStore: On startup, show nicer messages if znodes already exist. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607473 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 20:33:26 +00:00
Steve Loughran	d1f54f4f4b	YARN-2065 AM cannot create new containers after restart ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607441 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 18:35:10 +00:00
Karthik Kambatla	58e398f31d	YARN-2204. Explicitly enable vmem check in TestContainersMonitor#testContainerKillOnMemoryOverflow. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607231 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 02:05:37 +00:00
Mayank Bansal	03a25d2cc1	YARN-2022 Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy (Sunil G via mayank) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607227 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 01:54:47 +00:00
Vinod Kumar Vavilapalli	075ff276ca	YARN-1713. Added get-new-app and submit-app functionality to RM web services. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1607216 13f79535-47bb-0310-9956-ffa450edef68	2014-07-02 00:23:07 +00:00
Xuan Gong	e5ae7c55d1	TestRMApplicationHistoryWriter sometimes fails in trunk. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606835 13f79535-47bb-0310-9956-ffa450edef68	2014-06-30 16:51:22 +00:00
Jian He	b0c51504c4	YARN-2052. Embedded an epoch number in container id to ensure the uniqueness of container id after RM restarts. Contributed by Tsuyoshi OZAWA ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606557 13f79535-47bb-0310-9956-ffa450edef68	2014-06-29 18:24:03 +00:00
Jian He	b717d44b52	YARN-614. Changed ResourceManager to not count disk failure, node loss and RM restart towards app failures. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606407 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 23:37:46 +00:00
Zhijie Shen	55a0aa0bad	YARN-2201. Made TestRMWebServicesAppsModification be independent of the changes on yarn-default.xml. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606285 13f79535-47bb-0310-9956-ffa450edef68	2014-06-28 03:30:44 +00:00
Jason Darrell Lowe	73927ba695	YARN-2104. Scheduler queue filter failed to work because index of queue column changed. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606265 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 23:11:12 +00:00
Karthik Kambatla	f911f5495b	YARN-2204. Addendum patch. TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606168 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 18:09:41 +00:00
Ravi Prakash	f084170a0a	YARN 2163. WebUI: Order of AppId in apps table should be consistent with ApplicationId.compareTo() ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605964 13f79535-47bb-0310-9956-ffa450edef68	2014-06-27 06:43:46 +00:00
Vinod Kumar Vavilapalli	9571db19eb	YARN-2171. Improved CapacityScheduling to not lock on nodemanager-count when AMs heartbeat in. Contributed by Jason Lowe. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605616 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 21:56:42 +00:00
Karthik Kambatla	1a3a7e0c1a	YARN-2204. TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605548 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 18:50:53 +00:00
Jian He	c3f1c30e65	YARN-1365. Changed ApplicationMasterService to allow an app to re-register after RM restart. Contributed by Anubhav Dhoot ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605263 13f79535-47bb-0310-9956-ffa450edef68	2014-06-25 04:42:39 +00:00
Vinod Kumar Vavilapalli	e285b98f0f	YARN-2152. Added missing information into ContainerTokenIdentifier so that NodeManagers can report the same to RM when RM restarts. Contributed Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605205 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 21:43:22 +00:00
Thomas Graves	1f9a0fd927	YARN-2072. RM/NM UIs and webservices are missing vcore information. (Nathan Roberts via tgraves) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605162 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 19:34:34 +00:00
Karthik Kambatla	c0991d11eb	YARN-2109. Fix TestRM to work with both schedulers. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605142 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 17:30:53 +00:00
Karthik Kambatla	db4d277117	YARN-2192. TestRMHA fails when run with a mix of Schedulers. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605138 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 17:05:35 +00:00
Sanford Ryza	29c102cad0	YARN-2111. In FairScheduler.attemptScheduling, we don't count containers as assigned if they have 0 memory but non-zero cores (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605113 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 15:40:39 +00:00
Vinod Kumar Vavilapalli	d16470025a	YARN-2074. Changed ResourceManager to not count AM preemptions towards app failures. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1605106 13f79535-47bb-0310-9956-ffa450edef68	2014-06-24 15:15:12 +00:00
Jian He	59b5e9fa15	YARN-2191. Added a new test to ensure NM will clean up completed applications in the case of RM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604949 13f79535-47bb-0310-9956-ffa450edef68	2014-06-23 22:52:38 +00:00
Karthik Kambatla	6fcbf9b848	YARN-2187. FairScheduler: Disable max-AM-share check by default. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1604321 13f79535-47bb-0310-9956-ffa450edef68	2014-06-21 07:30:07 +00:00
Haohui Mai	22cbcd16cb	HADOOP-10717. Revert r1603571. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603620 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 20:37:25 +00:00
Steve Loughran	bae5837d3b	HADOOP-10717. Missing JSP support in Jetty ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603534 13f79535-47bb-0310-9956-ffa450edef68	2014-06-18 17:08:45 +00:00
Jason Darrell Lowe	98238a8d4a	YARN-2167. LeveldbIterator should get closed in NMLeveldbStateStoreService#loadLocalizationState() within finally block. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603039 13f79535-47bb-0310-9956-ffa450edef68	2014-06-17 02:12:03 +00:00
Junping Du	072360d128	YARN-1339. Recover DeletionService state upon nodemanager restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603036 13f79535-47bb-0310-9956-ffa450edef68	2014-06-17 01:02:16 +00:00
Jian He	95897ca14b	YARN-1885. Fixed a bug that RM may not send application-clean-up signal to NMs where the completed applications previously ran in case of RM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603028 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 23:56:12 +00:00
Karthik Kambatla	082c2ab8b8	YARN-2159. Better logging in SchedulerNode#allocateContainer. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603003 13f79535-47bb-0310-9956-ffa450edef68	2014-06-16 20:45:38 +00:00
Vinod Kumar Vavilapalli	dc7dd1fa19	YARN-1702. Added kill app functionality to RM web services. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602298 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 21:31:52 +00:00
Karthik Kambatla	4bc91b44c9	YARN-2155. FairScheduler: Incorrect threshold check for preemption. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1602295 13f79535-47bb-0310-9956-ffa450edef68	2014-06-12 21:23:32 +00:00
Jian He	c6e29a9f06	YARN-2125. Changed ProportionalCapacityPreemptionPolicy to log CSV in debug level. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601980 13f79535-47bb-0310-9956-ffa450edef68	2014-06-11 18:31:28 +00:00
Jian He	710a8693e5	YARN-2124. Fixed NPE in ProportionalCapacityPreemptionPolicy. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601964 13f79535-47bb-0310-9956-ffa450edef68	2014-06-11 17:30:18 +00:00
Bikas Saha	ecfd43a2f1	YARN-2091. Add more values to ContainerExitStatus and pass it from NM to RM and then to app masters (Tsuyoshi OZAWA via bikas) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601762 13f79535-47bb-0310-9956-ffa450edef68	2014-06-10 20:08:33 +00:00
Karthik Kambatla	5de6f72054	YARN-1424. RMAppAttemptImpl should return the DummyApplicationResourceUsageReport for all invalid accesses. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601742 13f79535-47bb-0310-9956-ffa450edef68	2014-06-10 19:03:06 +00:00
Jian He	c94f2cec3a	Augmented RMStateStore with state machine. Contributed by Binglin Chang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601491 13f79535-47bb-0310-9956-ffa450edef68	2014-06-09 19:44:31 +00:00
Vinod Kumar Vavilapalli	424fd9494f	YARN-1368. Added core functionality of recovering container state into schedulers after ResourceManager Restart so as to preserve running work in the cluster. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601303 13f79535-47bb-0310-9956-ffa450edef68	2014-06-09 03:09:21 +00:00
Karthik Kambatla	9958072d53	YARN-2132. ZKRMStateStore.ZKAction#runWithRetries doesn't log the exception it encounters. (Vamsee Yarlagadda via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601065 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 06:12:59 +00:00
Karthik Kambatla	85d4c787e0	YARN-2128. FairScheduler: Incorrect calculation of amResource usage. (Wei Yan via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601050 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 01:21:33 +00:00
Karthik Kambatla	969bef3c77	YARN-2122. In AllocationFileLoaderService, the reloadThread should be created in init() and started in start(). (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1601045 13f79535-47bb-0310-9956-ffa450edef68	2014-06-07 00:49:20 +00:00
Zhijie Shen	08b4aa699a	YARN-2117. Fixed the issue that secret file reader is potentially not closed in TimelineAuthenticationFilterInitializer. Contributed by Chen He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600994 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 20:07:58 +00:00
Zhijie Shen	d7f5d76869	YARN-2118. Fixed the type mismatch in Map#containsKey check of TimelineWebServices#injectOwnerInfo. Contributed by Ted Yu. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600967 13f79535-47bb-0310-9956-ffa450edef68	2014-06-06 17:47:03 +00:00
Junping Du	0ceb742549	YARN-1977. Add tests on getApplicationRequest with filtering start time range. (Contributed by Junping Du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600644 13f79535-47bb-0310-9956-ffa450edef68	2014-06-05 13:15:44 +00:00
Karthik Kambatla	d1d6bb70f4	YARN-2061. Revisit logging levels in ZKRMStateStore. (Ray Chiang via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600498 13f79535-47bb-0310-9956-ffa450edef68	2014-06-04 21:11:09 +00:00
Karthik Kambatla	731f417f67	YARN-2119. DEFAULT_PROXY_ADDRESS should use DEFAULT_PROXY_PORT. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1600484 13f79535-47bb-0310-9956-ffa450edef68	2014-06-04 20:12:47 +00:00
Sanford Ryza	16caa3fd18	YARN-1913. With Fair Scheduler, cluster can logjam when all resources are consumed by AMs (Wei Yan via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599400 13f79535-47bb-0310-9956-ffa450edef68	2014-06-03 00:56:48 +00:00
Karthik Kambatla	0aad2d56df	YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1599345 13f79535-47bb-0310-9956-ffa450edef68	2014-06-02 20:22:52 +00:00
Karthik Kambatla	a4ba451802	YARN-1474. Make schedulers services. (Tsuyoshi Ozawa via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598908 13f79535-47bb-0310-9956-ffa450edef68	2014-05-31 19:33:09 +00:00
Vinod Kumar Vavilapalli	23c325ad47	YARN-2115. Replaced RegisterNodeManagerRequest's ContainerStatus with a new NMContainerStatus which has more information that is needed for work-preserving RM-restart. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598790 13f79535-47bb-0310-9956-ffa450edef68	2014-05-31 00:20:50 +00:00
Junping Du	66598697a6	YARN-1338. Recover localized resource cache state upon nodemanager restart (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598640 13f79535-47bb-0310-9956-ffa450edef68	2014-05-30 15:37:27 +00:00
Karthik Kambatla	49a3a0cd0c	YARN-2054. Better defaults for YARN ZK configs for retries and retry-inteval when HA is enabled. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598630 13f79535-47bb-0310-9956-ffa450edef68	2014-05-30 15:24:49 +00:00
Arpit Agarwal	4a4868e523	HADOOP-10448. Support pluggable mechanism to specify proxy user settings (Contributed by Benoy Antony) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598396 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 20:52:01 +00:00
Vinod Kumar Vavilapalli	cd24e955cf	YARN-2112. Fixed yarn-common's pom.xml to include jackson dependencies so that both Timeline Server and client can access them. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598373 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 19:06:36 +00:00
Sanford Ryza	342da5b4d3	YARN-596. Use scheduling policies throughout the queue hierarchy to decide which containers to preempt (Wei Yan via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598197 13f79535-47bb-0310-9956-ffa450edef68	2014-05-29 04:01:24 +00:00
Zhijie Shen	001078e067	YARN-2107. Refactored timeline classes into o.a.h.y.s.timeline package. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598094 13f79535-47bb-0310-9956-ffa450edef68	2014-05-28 18:09:04 +00:00
Sanford Ryza	edfbc8ad4a	YARN-2105. Fix TestFairScheduler after YARN-2012. (Ashwin Shankar via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597902 13f79535-47bb-0310-9956-ffa450edef68	2014-05-27 23:46:22 +00:00
Vinod Kumar Vavilapalli	4dd2003373	YARN-2071. Modified levelDB store permissions to be readable only by the server user. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597231 13f79535-47bb-0310-9956-ffa450edef68	2014-05-24 01:24:26 +00:00
Karthik Kambatla	7dd378c274	YARN-2096. Race in TestRMRestart#testQueueMetricsOnRMRestart. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597223 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 23:51:00 +00:00
Sanford Ryza	a00b2d4f37	YARN-2073. Fair Scheduler: Add a utilization threshold to prevent preempting resources when cluster is free (Karthik Kambatla via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597209 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:52:46 +00:00
Vinod Kumar Vavilapalli	7f0724dddb	YARN-2059. Added admin ACLs support to Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597207 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:40:52 +00:00
Sanford Ryza	6c56612af5	YARN-2012. Fair Scheduler: allow default queue placement rule to take an arbitrary queue (Ashwin Shankar via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597204 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 22:38:52 +00:00
Vinod Kumar Vavilapalli	892ada8fb3	YARN-1937. Added owner-only ACLs support for Timeline Client and server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597186 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 21:19:15 +00:00
Vinod Kumar Vavilapalli	af8b09af75	YARN-1936. Added security support for the Timeline Client. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597153 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 18:47:57 +00:00
Vinod Kumar Vavilapalli	b867b69556	YARN-2049. Added delegation-token support for the Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597130 13f79535-47bb-0310-9956-ffa450edef68	2014-05-23 17:09:47 +00:00
Karthik Kambatla	619ec833fc	YARN-2089. FairScheduler: QueuePlacementPolicy and QueuePlacementRule are missing audience annotations. (Zhihai Xu via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596765 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 06:13:24 +00:00
Vinod Kumar Vavilapalli	82f3454f5a	YARN-2017. Merged some of the common scheduler code. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596753 13f79535-47bb-0310-9956-ffa450edef68	2014-05-22 05:32:26 +00:00
Vinod Kumar Vavilapalli	fdb5870d49	YARN-1938. Added kerberos login for the Timeline Server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596710 13f79535-47bb-0310-9956-ffa450edef68	2014-05-21 23:20:08 +00:00
Jian He	0f9147c857	YARN-2053. Fixed a bug in AMS to not add null NMToken into NMTokens list from previous attempts for work-preserving AM restart. Contributed by Wangda Tan ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595116 13f79535-47bb-0310-9956-ffa450edef68	2014-05-16 06:22:22 +00:00
Sanford Ryza	561c014e77	YARN-2042. String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp (Chen He via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594482 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 06:55:04 +00:00
Sanford Ryza	84dfae2f8a	YARN-1986. In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE (Hong Zhiguo via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594476 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 06:41:20 +00:00
Junping Du	b29434a5c8	YARN-1362. Distinguish between nodemanager shutdown for decommission vs shutdown for restart. (Contributed by Jason Lowe) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594421 13f79535-47bb-0310-9956-ffa450edef68	2014-05-14 00:20:53 +00:00
Christopher Douglas	45b42676f9	YARN-1957. Consider the max capacity of the queue when computing the ideal ... capacity for preemption. Contributed by Carlo Curino git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594414 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 23:15:27 +00:00
Jonathan Turner Eagles	1c48142807	YARN-1981. Nodemanager version is not updated when a node reconnects (Jason Lowe via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594358 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 20:03:58 +00:00
Vinod Kumar Vavilapalli	2f87e77cb7	YARN-1861. Fixed a bug in RM to reset leader-election on fencing that was causing both RMs to be stuck in standby mode when automatic failover is enabled. Contributed by Karthik Kambatla and Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594356 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 20:00:44 +00:00
Jason Darrell Lowe	95ba9f47fc	YARN-1751. Improve MiniYarnCluster for log aggregation testing. Contributed by Ming Ma ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594275 13f79535-47bb-0310-9956-ffa450edef68	2014-05-13 16:43:59 +00:00
Jian He	41344a4a69	YARN-1975. Fix yarn application CLI to print the scheme of the tracking url of failed/killed applications. Contributed by Junping Du ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593874 13f79535-47bb-0310-9956-ffa450edef68	2014-05-12 00:43:35 +00:00
Junping Du	ca95af7d23	YARN-2011. Fix typo and warning in TestLeafQueue (Contributed by Chen He) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593804 13f79535-47bb-0310-9956-ffa450edef68	2014-05-11 15:13:29 +00:00
Karthik Kambatla	4a19196a34	YARN-1987. Wrapper for leveldb DBIterator to aid in handling database exceptions. (Jason Lowe via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593757 13f79535-47bb-0310-9956-ffa450edef68	2014-05-11 06:11:04 +00:00
Junping Du	72ba2b35d8	YARN-766. TestNodeManagerShutdown in branch-2 should use Shell to form the output path and a format issue in trunk. (Contributed by Siddharth Seth) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593660 13f79535-47bb-0310-9956-ffa450edef68	2014-05-10 03:45:01 +00:00
Sanford Ryza	1c5902fba2	YARN-1864. Add missing file FSQueueType.java ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593191 13f79535-47bb-0310-9956-ffa450edef68	2014-05-08 07:22:42 +00:00
Sanford Ryza	cfc97a4e88	YARN-1864. Fair Scheduler Dynamic Hierarchical User Queues (Ashwin Shankar via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593190 13f79535-47bb-0310-9956-ffa450edef68	2014-05-08 07:21:11 +00:00
Arpit Agarwal	f4b687b873	YARN-2018. TestClientRMService.testTokenRenewalWrongUser fails after HADOOP-10562. (Contributed by Ming Ma) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592783 13f79535-47bb-0310-9956-ffa450edef68	2014-05-06 15:45:49 +00:00
Junping Du	2ad1cee5da	YARN-1201. TestAMAuthorization fails with local hostname cannot be resolved. (Wangda Tan via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592197 13f79535-47bb-0310-9956-ffa450edef68	2014-05-03 13:03:27 +00:00
Haohui Mai	d777cb8996	HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1592069 13f79535-47bb-0310-9956-ffa450edef68	2014-05-02 22:26:02 +00:00
Vinod Kumar Vavilapalli	7a241aee90	YARN-1929. Fixed a deadlock in ResourceManager that occurs when failover happens right at the time of shutdown. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591071 13f79535-47bb-0310-9956-ffa450edef68	2014-04-29 19:49:44 +00:00
Jason Darrell Lowe	a9775b4e49	YARN-738. TestClientRMTokens is failing irregularly while running all yarn tests. Contributed by Ming Ma ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1591030 13f79535-47bb-0310-9956-ffa450edef68	2014-04-29 17:47:11 +00:00
Jing Zhao	6d4c7df434	HADOOP-10535. Make the retry numbers in ActiveStandbyElector configurable. Contributed by Jing Zhao. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589905 13f79535-47bb-0310-9956-ffa450edef68	2014-04-24 23:03:30 +00:00
Jason Darrell Lowe	c02ea74551	YARN-1975. Used resources shows escaped html in CapacityScheduler and FairScheduler page. Contributed by Mit Desai ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589859 13f79535-47bb-0310-9956-ffa450edef68	2014-04-24 20:02:44 +00:00
Chris Nauroth	84388525a3	YARN-1970. Prepare YARN codebase for JUnit 4.11. Contributed by Chris Nauroth. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589001 13f79535-47bb-0310-9956-ffa450edef68	2014-04-21 23:31:18 +00:00
Ivan Mitic	4810e2b849	YARN-1865. ShellScriptBuilder does not check for some error conditions. Contributed by Remus Rusanu. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588693 13f79535-47bb-0310-9956-ffa450edef68	2014-04-19 18:55:07 +00:00
Jason Darrell Lowe	cda8646cfa	YARN-1940. deleteAsUser() terminates early without deleting more files on error. Contributed by Rushabh S Shah ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588546 13f79535-47bb-0310-9956-ffa450edef68	2014-04-18 19:24:13 +00:00
Vinod Kumar Vavilapalli	bad021534c	YARN-1281. Fixed TestZKRMStateStoreZKClientConnections to not fail intermittently due to ZK-client timeouts. Contributed by Tsuyoshi Ozawa. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588369 13f79535-47bb-0310-9956-ffa450edef68	2014-04-17 20:57:15 +00:00
Junping Du	bd43d2481e	YARN-1947. TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently. (Jian He via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588365 13f79535-47bb-0310-9956-ffa450edef68	2014-04-17 20:27:37 +00:00
Junping Du	0d087f7941	YARN-1750. TestNodeStatusUpdater#testNMRegistration is incorrect in test case. (Wangda Tan via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1588343 13f79535-47bb-0310-9956-ffa450edef68	2014-04-17 19:06:48 +00:00
Jian He	38d5ca2e47	YARN-1934. Fixed a potential NPE in ZKRMStateStore caused by handling Disconnected event from ZK. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587776 13f79535-47bb-0310-9956-ffa450edef68	2014-04-16 02:02:18 +00:00
Zhijie Shen	44b6261bfa	YARN-1892. Improved some logs in the scheduler. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587717 13f79535-47bb-0310-9956-ffa450edef68	2014-04-15 20:37:44 +00:00
Vinod Kumar Vavilapalli	eb7b33c298	YARN-1928. Fixed a race condition in TestAMRMRPCNodeUpdates which caused it to fail occassionally. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587114 13f79535-47bb-0310-9956-ffa450edef68	2014-04-13 22:40:16 +00:00
Vinod Kumar Vavilapalli	c6b70f4760	YARN-1933. Fixed test issues with TestAMRestart and TestNodeHealthService. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1587104 13f79535-47bb-0310-9956-ffa450edef68	2014-04-13 21:51:38 +00:00
Sanford Ryza	9274626a11	YARN-1923. Make Fair Scheduler resource ratio calculations terminate faster (Anubhav Dhoot via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586796 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 23:24:40 +00:00
Zhijie Shen	dc84800184	YARN-1924. Made ZKRMStateStore updateApplication(Attempt)StateInternal work when Application(Attempt) state hasn't been stored before. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586547 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 03:36:36 +00:00
Jian He	ed78328d50	YARN-1903. Set exit code and diagnostics when container is killed at NEW/LOCALIZING state. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586522 13f79535-47bb-0310-9956-ffa450edef68	2014-04-11 01:26:36 +00:00
Zhijie Shen	3993d646d7	YARN-1920. Fixed TestFileSystemApplicationHistoryStore failure on windows. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586414 13f79535-47bb-0310-9956-ffa450edef68	2014-04-10 18:57:02 +00:00
Vinod Kumar Vavilapalli	791f2f6f1b	YARN-1910. Fixed a race condition in TestAMRMTokens that causes the test to fail more often on Windows. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1586192 13f79535-47bb-0310-9956-ffa450edef68	2014-04-10 01:36:50 +00:00
Kihwal Lee	c3f6d71726	YARN-1907. TestRMApplicationHistoryWriter#testRMWritingMassiveHistory intermittently fails. Contributed by Mit Desai. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585992 13f79535-47bb-0310-9956-ffa450edef68	2014-04-09 15:33:25 +00:00
Karthik Kambatla	1e1200d594	YARN-1784. TestContainerAllocation assumes CapacityScheduler. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585894 13f79535-47bb-0310-9956-ffa450edef68	2014-04-09 05:49:24 +00:00
Karthik Kambatla	245012a9d9	YARN-1757. NM Recovery. Auxiliary service support. (Jason Lowe via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1585783 13f79535-47bb-0310-9956-ffa450edef68	2014-04-08 17:15:58 +00:00
Arun Murthy	05da90ee2f	YARN-1898. Addendum patch to ensure /jmx and /metrics are re-directed to Active RM. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584954 13f79535-47bb-0310-9956-ffa450edef68	2014-04-05 02:51:08 +00:00
Jian He	15ac36a216	YARN-1837. Fixed TestMoveApplication#testMoveRejectedByScheduler failure. Contributed by Hong Zhiguo ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1584862 13f79535-47bb-0310-9956-ffa450edef68	2014-04-04 18:42:35 +00:00
Zhijie Shen	b0180afc9c	YARN-1898. Made Standby RM links conf, stacks, logLevel, metrics, jmx, logs and static not be redirected to Active RM. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583833 13f79535-47bb-0310-9956-ffa450edef68	2014-04-02 00:01:50 +00:00
Sanford Ryza	7bd62b8da0	YARN-1889. In Fair Scheduler, avoid creating objects on each call to AppSchedulable comparator (Hong Zhiguo via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583491 13f79535-47bb-0310-9956-ffa450edef68	2014-03-31 23:40:45 +00:00
Jian He	3532d96ff6	YARN-1893. Mark AtMostOnce annotation to ApplicationMasterProtocol#allocate. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1583203 13f79535-47bb-0310-9956-ffa450edef68	2014-03-30 21:35:54 +00:00
Jonathan Turner Eagles	6d2e1fde63	YARN-1883. TestRMAdminService fails due to inconsistent entries in UserGroups (Mit Desai via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582862 13f79535-47bb-0310-9956-ffa450edef68	2014-03-28 19:30:08 +00:00
Tsz-wo Sze	3f7aa79e58	HDFS-6168. Remove a deprecated constructor and the deprecated methods reportChecksumFailure, getDelegationToken(Text), renewDelegationToken and cancelDelegationToken from DistributedFileSystem. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1582856 13f79535-47bb-0310-9956-ffa450edef68	2014-03-28 18:29:31 +00:00
Jian He	71c2b159ab	YARN-1521. Mark Idempotent/AtMostOnce annotations to the APIs in ApplicationClientProtcol, ResourceManagerAdministrationProtocol and ResourceTrackerProtocol so that they work in HA scenario. Contributed by Xuan Gong ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581678 13f79535-47bb-0310-9956-ffa450edef68	2014-03-26 03:43:41 +00:00
Vinod Kumar Vavilapalli	8a9ae9e3ec	YARN-1867. Fixed a bug in ResourceManager that was causing invalid ACL checks in the web-services after fail-over. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581662 13f79535-47bb-0310-9956-ffa450edef68	2014-03-26 03:03:17 +00:00
Vinod Kumar Vavilapalli	d14eff7d38	YARN-1866. Fixed an issue with renewal of RM-delegation tokens on restart or fail-over. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581448 13f79535-47bb-0310-9956-ffa450edef68	2014-03-25 18:21:55 +00:00
Jian He	0febaa1b3d	YARN-1852. Fixed RMAppAttempt to not resend AttemptFailed/AttemptKilled events to already recovered Failed/Killed RMApps. Contributed by Rohith Sharmaks ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580997 13f79535-47bb-0310-9956-ffa450edef68	2014-03-24 19:04:57 +00:00
Zhijie Shen	0f1eda6bbf	YARN-1838. Enhanced timeline service getEntities API to get entities from a given entity ID or insertion timestamp. Contributed by Billie Rinaldi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580960 13f79535-47bb-0310-9956-ffa450edef68	2014-03-24 18:14:13 +00:00
Zhijie Shen	ef9634bf79	YARN-1577. Made UnmanagedAMLauncher do launchAM after the attempt reaches the LAUNCHED state. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580164 13f79535-47bb-0310-9956-ffa450edef68	2014-03-22 04:35:46 +00:00
Jian He	ce56616037	YARN-1776. Fixed DelegationToken renewal to survive RM failover. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580154 13f79535-47bb-0310-9956-ffa450edef68	2014-03-22 04:12:57 +00:00
Karthik Kambatla	cbb3914c89	YARN-1536. Cleanup: Get rid of ResourceManager#get*SecretManager() methods and use the RMContext methods instead. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580128 13f79535-47bb-0310-9956-ffa450edef68	2014-03-22 02:35:52 +00:00
Vinod Kumar Vavilapalli	dc594101cc	YARN-1854. Fixed test failure in TestRMHA#testStartAndTransitions. Contributed by Rohith Sharma KS. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580097 13f79535-47bb-0310-9956-ffa450edef68	2014-03-22 00:29:43 +00:00
Vinod Kumar Vavilapalli	06579878df	YARN-1775. Enhanced ProcfsBasedProcessTree to optionally add the ability to use smaps for obtaining used memory information. Contributed by Rajesh Balamohan. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580087 13f79535-47bb-0310-9956-ffa450edef68	2014-03-22 00:01:59 +00:00
Jian He	f67218809c	YARN-1849. Fixed NPE in ResourceTrackerService#registerNodeManager for UAM. Contributed by Karthik Kambatla ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1580077 13f79535-47bb-0310-9956-ffa450edef68	2014-03-21 22:53:49 +00:00
Vinod Kumar Vavilapalli	4224e61340	YARN-1811. Fixed AMFilters in YARN to correctly accept requests from either web-app proxy or the RMs when HA is enabled. Contributed by Robert Kanter. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579877 13f79535-47bb-0310-9956-ffa450edef68	2014-03-21 04:20:46 +00:00
Vinod Kumar Vavilapalli	1c49cfbeb7	YARN-1859. Fixed WebAppProxyServlet to correctly handle applications absent on the ResourceManager. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579866 13f79535-47bb-0310-9956-ffa450edef68	2014-03-21 02:02:41 +00:00
Vinod Kumar Vavilapalli	bf428cc474	YARN-1855. Made Application-history server to be optional in MiniYARNCluster and thus avoid the failure of TestRMFailover#testRMWebAppRedirect. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579838 13f79535-47bb-0310-9956-ffa450edef68	2014-03-21 00:18:33 +00:00
Vinod Kumar Vavilapalli	764af69aa0	YARN-1640. Fixed manual failover of ResourceManagers to work correctly in secure clusters. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579510 13f79535-47bb-0310-9956-ffa450edef68	2014-03-20 02:40:21 +00:00
Zhijie Shen	fd1c424548	YARN-1690. Made DistributedShell send timeline entities+events. Contributed by Mayank Bansal. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579123 13f79535-47bb-0310-9956-ffa450edef68	2014-03-19 03:49:29 +00:00
Karthik Kambatla	bfafc1d0ce	YARN-1705. Reset cluster-metrics on transition to standby. (Rohith via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1579014 13f79535-47bb-0310-9956-ffa450edef68	2014-03-18 19:00:46 +00:00
Karthik Kambatla	e52c1535b8	YARN-1846. TestRM#testNMTokenSentForNormalContainer assumes CapacityScheduler. (Robert Kanter via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578763 13f79535-47bb-0310-9956-ffa450edef68	2014-03-18 06:56:15 +00:00
Vinod Kumar Vavilapalli	57cdf8626a	YARN-1512. Enhanced CapacityScheduler to be able to decouple scheduling from node-heartbeats. Contributed by Arun C Murthy. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578722 13f79535-47bb-0310-9956-ffa450edef68	2014-03-18 02:53:20 +00:00
Vinod Kumar Vavilapalli	92317e3459	YARN-1839. Fixed handling of NMTokens in ResourceManager such that containers launched by AMs running on the same machine as the AM are correctly propagated. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578631 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 22:22:15 +00:00
Vinod Kumar Vavilapalli	81a456e638	YARN-1591. Fixed AsyncDispatcher to handle interrupts on shutdown in a sane manner and thus fix failure of TestResourceTrackerService. Contributed by Tsuyoshi Ozawa. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578628 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 22:17:43 +00:00
Jian He	6a89e57b8d	YARN-1206. Fixed AM container log to show on NM web page after application finishes if log-aggregation is disabled. Contributed by Rohith Sharmaks ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578614 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 21:49:06 +00:00
Vinod Kumar Vavilapalli	8314674947	YARN-1685. Fixed few bugs related to handling of containers' log-URLs on ResourceManager and history-service. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578602 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 21:36:21 +00:00
Jonathan Turner Eagles	7944eab64a	YARN-1136. Replace junit.framework.Assert with org.junit.Assert (Chen He via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578539 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 20:03:35 +00:00
Jian He	bc00bc966b	YARN-1830. Fixed TestRMRestart#testQueueMetricsOnRMRestart failure due to race condition when app is submitted. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578486 13f79535-47bb-0310-9956-ffa450edef68	2014-03-17 18:03:06 +00:00
Vinod Kumar Vavilapalli	96e0ca2d27	YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He. ... MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1578135 13f79535-47bb-0310-9956-ffa450edef68	2014-03-16 18:32:05 +00:00
Jonathan Turner Eagles	95b7f50813	YARN-1833. TestRMAdminService Fails in trunk and branch-2 (Mit Desais via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577737 13f79535-47bb-0310-9956-ffa450edef68	2014-03-14 21:58:42 +00:00
Zhijie Shen	b3ea4aebff	YARN-1717. Enabled periodically discarding old data in LeveldbTimelineStore. Contributed by Billie Rinaldi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577693 13f79535-47bb-0310-9956-ffa450edef68	2014-03-14 20:35:00 +00:00
Vinod Kumar Vavilapalli	d9cdcb9474	YARN-1658. Modified web-app framework to let standby RMs redirect web-service calls to the active RM. Contributed by Cindy Li. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577408 13f79535-47bb-0310-9956-ffa450edef68	2014-03-14 02:39:59 +00:00
Christopher Douglas	53790d3300	YARN-1771. Reduce the number of NameNode operations during localization of ... public resources using a cache. Contributed by Sangjin Lee git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577391 13f79535-47bb-0310-9956-ffa450edef68	2014-03-14 00:30:35 +00:00
Zhijie Shen	6af044bb75	YARN-1389. Made ApplicationClientProtocol and ApplicationHistoryProtocol expose analogous getApplication(s)/Attempt(s)/Container(s) APIs. Contributed by Mayank Bansal. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577052 13f79535-47bb-0310-9956-ffa450edef68	2014-03-13 07:42:29 +00:00
Jason Darrell Lowe	135700a611	YARN-1789. ApplicationSummary does not escape newlines in the app name. Contributed by Tsuyoshi OZAWA ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576960 13f79535-47bb-0310-9956-ffa450edef68	2014-03-12 22:25:01 +00:00
Vinod Kumar Vavilapalli	197217c95d	YARN-1816. Fixed ResourceManager to get RMApp correctly handle ATTEMPT_FINISHED event at ACCEPTED state that can happen after RM restarts. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576911 13f79535-47bb-0310-9956-ffa450edef68	2014-03-12 21:18:55 +00:00
Vinod Kumar Vavilapalli	4de17c6052	YARN-1812. Fixed ResourceManager to synchrously renew tokens after recovery and thus recover app itself synchronously and avoid races with resyncing NodeManagers. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576843 13f79535-47bb-0310-9956-ffa450edef68	2014-03-12 18:25:33 +00:00
Arun Murthy	4ce0e4bf2e	YARN-1444. Fix CapacityScheduler to deal with cases where applications specify host/rack requests without off-switch request. Contributed by Wangda Tan. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576751 13f79535-47bb-0310-9956-ffa450edef68	2014-03-12 14:36:27 +00:00
Vinod Kumar Vavilapalli	8aab8533a1	YARN-1800. Fixed NodeManager to gracefully handle RejectedExecutionException in the public-localizer thread-pool. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576545 13f79535-47bb-0310-9956-ffa450edef68	2014-03-11 23:33:56 +00:00
Karthik Kambatla	477ed62b3f	YARN-1821. NPE on registerNodeManager if the request has containers for UnmanagedAMs (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576525 13f79535-47bb-0310-9956-ffa450edef68	2014-03-11 22:18:54 +00:00
Vinod Kumar Vavilapalli	0edda25373	YARN-1764. Modified YarnClient to correctly handle failover of ResourceManager after the submitApplication call goes through. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576160 13f79535-47bb-0310-9956-ffa450edef68	2014-03-11 00:52:03 +00:00
Vinod Kumar Vavilapalli	e4190b2a97	YARN-1788. Fixed a bug in ResourceManager to set the apps-completed and apps-killed metrics correctly for killed applications. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576072 13f79535-47bb-0310-9956-ffa450edef68	2014-03-10 20:36:34 +00:00
Jian He	7da07461ff	YARN-1793. Fixed ClientRMService#forceKillApplication not killing unmanaged application. Contributed by Karthik Kambatla ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1576023 13f79535-47bb-0310-9956-ffa450edef68	2014-03-10 17:58:55 +00:00
Sanford Ryza	e2530de4ea	YARN-1790. Fair Scheduler UI not showing apps table (bc Wong via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575487 13f79535-47bb-0310-9956-ffa450edef68	2014-03-08 05:12:45 +00:00
Vinod Kumar Vavilapalli	8497b870af	YARN-1410. Added tests to validate that clients can fail-over to a new RM ... after getting an application-ID but before submission and can still submit to the newly active RM with no issues. Contributed by Xuan Gong. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575478 13f79535-47bb-0310-9956-ffa450edef68	2014-03-08 04:43:29 +00:00
Vinod Kumar Vavilapalli	0b1304d098	YARN-1781. Modified NodeManagers to allow admins to specify max disk utilization for local disks so as to be able to offline full disks. Contributed by Varun Vasudev. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575463 13f79535-47bb-0310-9956-ffa450edef68	2014-03-08 00:52:06 +00:00
Vinod Kumar Vavilapalli	1c4047b0e4	YARN-1783. Fixed a bug in NodeManager's status-updater that was losing completed container statuses when NodeManager is forced to resync by the ResourceManager. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575437 13f79535-47bb-0310-9956-ffa450edef68	2014-03-07 22:36:47 +00:00
Karthik Kambatla	b06cc16f7d	YARN-1774. FS: Submitting to non-leaf queue throws NPE. (Anubhav Dhoot and Karthik Kambatla via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575415 13f79535-47bb-0310-9956-ffa450edef68	2014-03-07 21:34:19 +00:00
Karthik Kambatla	9b15c5b11a	YARN-1525. Web UI should redirect to active RM when HA is enabled. (Cindy Li via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575166 13f79535-47bb-0310-9956-ffa450edef68	2014-03-07 04:34:16 +00:00
Vinod Kumar Vavilapalli	f4eb6ddec9	YARN-1780. Improved logging in the Timeline client and server. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1575141 13f79535-47bb-0310-9956-ffa450edef68	2014-03-07 03:52:53 +00:00
Jian He	8cd23c5b48	YARN-1752. Fixed ApplicationMasterService to reject unregister request if AM did not register before. Contributed by Rohith Sharma. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574623 13f79535-47bb-0310-9956-ffa450edef68	2014-03-05 19:04:58 +00:00
Karthik Kambatla	2e7c512270	YARN-1785. FairScheduler treats app lookup failures as ERRORs. (bc Wong via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574604 13f79535-47bb-0310-9956-ffa450edef68	2014-03-05 18:22:25 +00:00
Vinod Kumar Vavilapalli	82e8c8bd71	YARN-1766. Fixed a bug in ResourceManager to use configuration loaded from the configuration-provider when booting up. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574252 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 23:35:20 +00:00
Vinod Kumar Vavilapalli	88245b6a41	YARN-986. Changed client side to be able to figure out the right RM Delegation token for the right ResourceManager when HA is enabled. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574190 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 20:39:06 +00:00
Vinod Kumar Vavilapalli	40464fba22	YARN-1730. Implemented simple write-locking in the LevelDB based timeline-store. Contributed by Billie Rinaldi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574145 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 17:32:41 +00:00
Zhijie Shen	33714d9ad6	YARN-1729. Made TimelineWebServices deserialize the string primary- and secondary-filters param into the JSON-compatible object. Contributed by Billie Rinaldi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573825 13f79535-47bb-0310-9956-ffa450edef68	2014-03-04 00:20:43 +00:00
Vinod Kumar Vavilapalli	5bf449e402	YARN-1748. Excluded core-site.xml from hadoop-yarn-server-tests package's jar and thus avoid breaking downstream tests. Contributed by Sravya Tirukkovalur. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573795 13f79535-47bb-0310-9956-ffa450edef68	2014-03-03 23:09:08 +00:00
Vinod Kumar Vavilapalli	c26bdddcc3	YARN-1675. Added the previously missed new file. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573736 13f79535-47bb-0310-9956-ffa450edef68	2014-03-03 20:39:01 +00:00
Vinod Kumar Vavilapalli	a60434368c	YARN-1758. Fixed ResourceManager to not mandate the presence of site specific configuration files and thus fix failures in downstream tests. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573695 13f79535-47bb-0310-9956-ffa450edef68	2014-03-03 19:41:52 +00:00
Karthik Kambatla	8caeb0af9d	YARN-1760. Addendum patch. TestRMAdminService assumes Capacity Scheduler. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573134 13f79535-47bb-0310-9956-ffa450edef68	2014-03-01 08:46:29 +00:00
Karthik Kambatla	1ba26e3e68	YARN-1528. Allow setting auth for ZK connections. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1573014 13f79535-47bb-0310-9956-ffa450edef68	2014-02-28 17:34:08 +00:00
Vinod Kumar Vavilapalli	94b29b3348	MAPREDUCE-5770. Fixed MapReduce ApplicationMaster to correctly redirect to the YARN's web-app proxy with the correct scheme prefix. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572711 13f79535-47bb-0310-9956-ffa450edef68	2014-02-27 19:23:55 +00:00
Zhijie Shen	faddccc216	YARN-1301. Added the INFO level log of the non-empty blacklist additions and removals inside ApplicationMasterService. Contributed by Tsuyoshi Ozawa. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572400 13f79535-47bb-0310-9956-ffa450edef68	2014-02-27 02:07:16 +00:00
Vinod Kumar Vavilapalli	0fbc7fe816	YARN-1588. Enhanced RM and the scheduling protocol to also send NMTokens of transferred containers from previous app-attempts to new AMs after YARN-1490. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1572230 13f79535-47bb-0310-9956-ffa450edef68	2014-02-26 20:20:07 +00:00
Junping Du	c7142e7761	YARN-1561. Fix a generic type warning in FairScheduler. (Chen He via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571924 13f79535-47bb-0310-9956-ffa450edef68	2014-02-26 05:14:51 +00:00
Karthik Kambatla	5a42e1b7c3	YARN-1760. TestRMAdminService assumes CapacityScheduler. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571777 13f79535-47bb-0310-9956-ffa450edef68	2014-02-25 18:06:45 +00:00
Vinod Kumar Vavilapalli	ad70f26b1f	YARN-1734. Fixed ResourceManager to update the configurations when it transits from standby to active mode so as to assimilate any changes that happened while it was in standby mode. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571539 13f79535-47bb-0310-9956-ffa450edef68	2014-02-25 02:07:19 +00:00
Vinod Kumar Vavilapalli	d07f855892	YARN-1686. Fixed NodeManager to properly handle any errors during re-registration after a RESYNC and thus avoid hanging. Contributed by Rohith Sharma. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571474 13f79535-47bb-0310-9956-ffa450edef68	2014-02-24 22:41:24 +00:00
Sanford Ryza	1ab2f5a916	YARN-1678. Fair scheduler gabs incessantly about reservations (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571468 13f79535-47bb-0310-9956-ffa450edef68	2014-02-24 22:35:27 +00:00
Vinod Kumar Vavilapalli	e167e585e9	YARN-1749. Updated application-history related configs to reflect the latest reality and to be consistently named. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570948 13f79535-47bb-0310-9956-ffa450edef68	2014-02-23 02:04:58 +00:00
Vinod Kumar Vavilapalli	84425fb435	YARN-1687. Renamed user-facing records for the timeline-service to be simply named after 'timeline' instead of 'apptimeline'. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570922 13f79535-47bb-0310-9956-ffa450edef68	2014-02-22 20:55:06 +00:00
Vinod Kumar Vavilapalli	e06226126c	YARN-1732. Changed types of related-entities and primary-filters in the timeline-service to be sets instead of maps. Contributed by Billie Rinaldi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570914 13f79535-47bb-0310-9956-ffa450edef68	2014-02-22 20:46:54 +00:00
Karthik Kambatla	87dce7b2d2	YARN-1470. Add audience annotations to MiniYARNCluster. (Anubhav Dhoot via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570708 13f79535-47bb-0310-9956-ffa450edef68	2014-02-21 21:20:59 +00:00
Zhijie Shen	da20095284	YARN-1071. Enabled ResourceManager to recover cluster metrics numDecommissionedNMs after restarting. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570469 13f79535-47bb-0310-9956-ffa450edef68	2014-02-21 06:46:24 +00:00
Vinod Kumar Vavilapalli	772ead791c	YARN-1398. Fixed a deadlock in ResourceManager between users requesting queue-acls and completing containers. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570415 13f79535-47bb-0310-9956-ffa450edef68	2014-02-21 02:20:20 +00:00
Karthik Kambatla	12a8aa1510	YARN-1736. FS: AppSchedulable.assignContainer's priority argument is redundant. (Naren Koneru via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570336 13f79535-47bb-0310-9956-ffa450edef68	2014-02-20 20:09:54 +00:00
Vinod Kumar Vavilapalli	5fd5c9900c	YARN-713. Fixed ResourceManager to not crash while building tokens when DNS issues happen transmittently. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569979 13f79535-47bb-0310-9956-ffa450edef68	2014-02-19 23:39:13 +00:00
Sanford Ryza	0e3e91a06d	YARN-1718. Fix a couple isTerminals in Fair Scheduler queue placement rules (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569928 13f79535-47bb-0310-9956-ffa450edef68	2014-02-19 21:36:51 +00:00
Vinod Kumar Vavilapalli	9da9f7d4d8	YARN-1666. Modified RM HA handling of include/exclude node-lists to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569856 13f79535-47bb-0310-9956-ffa450edef68	2014-02-19 17:52:57 +00:00
Jonathan Turner Eagles	996acc834e	YARN-1479. Invalid NaN values in Hadoop REST API JSON response (Chen He via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569853 13f79535-47bb-0310-9956-ffa450edef68	2014-02-19 17:49:21 +00:00
Jian He	3a7e7b3671	YARN-1428. Fixed RM to write the final state of RMApp/RMAppAttempt to the application history store in the transition to the final state. (Contributed by Zhijie Shen) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569585 13f79535-47bb-0310-9956-ffa450edef68	2014-02-19 01:19:07 +00:00
Vinod Kumar Vavilapalli	6b03174aae	YARN-1590. Fixed ResourceManager, web-app proxy and MR JobHistoryServer to expand _HOST properly in their kerberos principles. Contributed by Mohammad Kamrul Islam. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569537 13f79535-47bb-0310-9956-ffa450edef68	2014-02-18 21:50:37 +00:00
Sanford Ryza	bbbe808a51	YARN-1724. Race condition in Fair Scheduler when continuous scheduling is turned on (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569447 13f79535-47bb-0310-9956-ffa450edef68	2014-02-18 18:00:56 +00:00
Sanford Ryza	e60f5b6c40	YARN-1721. When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569443 13f79535-47bb-0310-9956-ffa450edef68	2014-02-18 17:51:40 +00:00
Vinod Kumar Vavilapalli	990cffdcfa	YARN-1553. Modified YARN and MR to stop using HttpConfig.isSecure() and ... instead rely on the http policy framework. And also fix some bugs related to https handling in YARN web-apps. Contributed by Haohui Mai. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568501 13f79535-47bb-0310-9956-ffa450edef68	2014-02-14 20:01:02 +00:00
Vinod Kumar Vavilapalli	d0a5e43de7	YARN-1417. Modified RM to generate container-tokens not at creation time, but at allocation time so as to prevent RM ... from shelling out containers with expired tokens. Contributed by Omkar Vinit Joshi and Jian He. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568060 13f79535-47bb-0310-9956-ffa450edef68	2014-02-13 22:02:11 +00:00
Vinod Kumar Vavilapalli	2b916db60b	YARN-1676. Modified RM HA handling of user-to-group mappings to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568041 13f79535-47bb-0310-9956-ffa450edef68	2014-02-13 21:23:33 +00:00
Jian He	dab635980d	YARN-1345. Remove FINAL_SAVING state from YarnApplicationAttemptState. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567820 13f79535-47bb-0310-9956-ffa450edef68	2014-02-13 00:59:19 +00:00
Zhijie Shen	0185a57847	YARN-1578. Fixed reading incomplete application attempt and container data in FileSystemApplicationHistoryStore. Contributed by Shinichi Yamashita. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567816 13f79535-47bb-0310-9956-ffa450edef68	2014-02-13 00:08:47 +00:00
Sanford Ryza	bc939f7ae6	YARN-1692. ConcurrentModificationException in fair scheduler AppSchedulable (Sangjin Lee via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567788 13f79535-47bb-0310-9956-ffa450edef68	2014-02-12 23:04:42 +00:00
Karthik Kambatla	41ec3cce76	YARN-1641. ZK store should attempt a write periodically to ensure it is still Active. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567628 13f79535-47bb-0310-9956-ffa450edef68	2014-02-12 14:09:13 +00:00
Zhijie Shen	1b5254a4de	YARN-1719. Fixed the root path related Jersey warnings produced in ATSWebServices. Contributed by Billie Rinaldi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567498 13f79535-47bb-0310-9956-ffa450edef68	2014-02-12 02:13:23 +00:00
Sanford Ryza	9024ad4aa0	YARN-1697. NodeManager reports negative running containers (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567356 13f79535-47bb-0310-9956-ffa450edef68	2014-02-11 20:14:30 +00:00
Vinod Kumar Vavilapalli	7fce641c49	YARN-1698. Fixed default TimelineStore in code to match what is documented in yarn-default.xml. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566937 13f79535-47bb-0310-9956-ffa450edef68	2014-02-11 01:05:16 +00:00
Vinod Kumar Vavilapalli	1fa6ab249b	YARN-1459. Changed ResourceManager to depend its service initialization on the configuration-provider mechanism during startup too. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566791 13f79535-47bb-0310-9956-ffa450edef68	2014-02-10 22:50:15 +00:00
Zhijie Shen	23b2e43f5d	YARN-1635. Implemented a Leveldb based ApplicationTimelineStore. Contributed by Billie Rinaldi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565868 13f79535-47bb-0310-9956-ffa450edef68	2014-02-08 02:15:46 +00:00
Karthik Kambatla	d57c6e0fe7	YARN-1672. YarnConfiguration is missing a default for yarn.nodemanager.log.retain-seconds (Naren Koneru via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565866 13f79535-47bb-0310-9956-ffa450edef68	2014-02-08 01:55:33 +00:00
Vinod Kumar Vavilapalli	8b2336fcef	YARN-1660. Simplified the RM HA configuration to accept and be able to simply depend just on ... configuration properties of the form yarn.resourcemanager.hostname.RMID and use the default ports for all service addresses. Contributed by Xuan Gong. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565523 13f79535-47bb-0310-9956-ffa450edef68	2014-02-07 03:18:39 +00:00
Vinod Kumar Vavilapalli	30294a2196	YARN-1665. Simplify the configuration of RM HA by having better default values. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565517 13f79535-47bb-0310-9956-ffa450edef68	2014-02-07 02:39:32 +00:00
Zhijie Shen	943b2190d7	YARN-1689. Made RMAppAttempt get killed when RMApp is at ACCEPTED. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565497 13f79535-47bb-0310-9956-ffa450edef68	2014-02-07 00:18:46 +00:00
Zhijie Shen	24775c10ef	YARN-1628. Fixed the test failure in TestContainerManagerSecurity. Contributed by Vinod Kumar Vavilapalli. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565094 13f79535-47bb-0310-9956-ffa450edef68	2014-02-06 07:21:42 +00:00
Sanford Ryza	e6eccf20de	YARN-1499. Fair Scheduler changes for moving apps between queues (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564856 13f79535-47bb-0310-9956-ffa450edef68	2014-02-05 18:09:07 +00:00
Vinod Kumar Vavilapalli	484faadffe	YARN-1636. Augmented Application-history server's web-services to also expose new APIs for retrieving and storing timeline information. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564829 13f79535-47bb-0310-9956-ffa450edef68	2014-02-05 17:02:26 +00:00
Zhijie Shen	ebe0c17a95	YARN-1461. Added tags for YARN applications and changed RM to handle them. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564633 13f79535-47bb-0310-9956-ffa450edef68	2014-02-05 04:55:00 +00:00
Vinod Kumar Vavilapalli	96578f0e01	YARN-1634. Added a testable in-memory implementation of ApplicationTimelineStore. Contributed by Zhijie Shen. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564583 13f79535-47bb-0310-9956-ffa450edef68	2014-02-05 00:32:02 +00:00
Vinod Kumar Vavilapalli	b812af964d	YARN-1669. Modified RM HA handling of protocol level service-ACLS to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564549 13f79535-47bb-0310-9956-ffa450edef68	2014-02-04 22:46:52 +00:00
Vinod Kumar Vavilapalli	24fa232707	YARN-1667. Modified RM HA handling of super users (with proxying ability) to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564100 13f79535-47bb-0310-9956-ffa450edef68	2014-02-03 22:10:56 +00:00
Vinod Kumar Vavilapalli	eff1e809f2	YARN-1668. Modified RM HA handling of admin-acls to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564043 13f79535-47bb-0310-9956-ffa450edef68	2014-02-03 20:16:28 +00:00
Vinod Kumar Vavilapalli	eac066b13f	YARN-1659. Defined the ApplicationTimelineStore store as an abstraction for implementing different storage impls for storing timeline information. Contributed by Billie Rinaldi. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564037 13f79535-47bb-0310-9956-ffa450edef68	2014-02-03 20:07:01 +00:00
Vinod Kumar Vavilapalli	3e7d56678c	YARN-1639. Modified RM HA configuration handling to have a way of not requiring separate configuration files for each RM. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564032 13f79535-47bb-0310-9956-ffa450edef68	2014-02-03 19:53:46 +00:00
Sanford Ryza	cb5e0787a6	YARN-1498 addendum to fix findbugs warning ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564018 13f79535-47bb-0310-9956-ffa450edef68	2014-02-03 19:30:55 +00:00
Vinod Kumar Vavilapalli	ca72e11158	YARN-1611. Introduced the concept of a configuration provider which can be used by ResourceManager to read configuration locally or from remote systems so as to help RM failover. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564002 13f79535-47bb-0310-9956-ffa450edef68	2014-02-03 19:07:55 +00:00
Sanford Ryza	1079c37128	YARN-1504. RM changes for moving apps between queues (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563371 13f79535-47bb-0310-9956-ffa450edef68	2014-02-01 04:03:36 +00:00
Jonathan Turner Eagles	5d4bd6a15a	YARN-1632. TestApplicationMasterServices should be under org.apache.hadoop.yarn.server.resourcemanager package (Chen He via jeagles) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563157 13f79535-47bb-0310-9956-ffa450edef68	2014-01-31 16:00:39 +00:00
Sanford Ryza	981679e6d7	YARN-1498. Common scheduler changes for moving apps between queues (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563021 13f79535-47bb-0310-9956-ffa450edef68	2014-01-31 00:14:47 +00:00
Sanford Ryza	1cac66ce68	YARN-1617. Remove ancient comment and surround LOG.debug in AppSchedulingInfo.allocate (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563004 13f79535-47bb-0310-9956-ffa450edef68	2014-01-30 22:40:22 +00:00
Karthik Kambatla	f1cef4cd29	YARN-1618. Fix invalid RMApp transition from NEW to FINAL_SAVING (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562529 13f79535-47bb-0310-9956-ffa450edef68	2014-01-29 18:02:40 +00:00
Sanford Ryza	7f2b01a742	YARN-1629. IndexOutOfBoundsException in MaxRunningAppsEnforcer (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561996 13f79535-47bb-0310-9956-ffa450edef68	2014-01-28 08:34:55 +00:00
Suresh Srinivas	33a47743a5	HADOOP-10255. Rename HttpServer to HttpServer2 to retain older HttpServer in branch-2 for compatibility. Contributed by Haohui Mai. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561959 13f79535-47bb-0310-9956-ffa450edef68	2014-01-28 07:32:52 +00:00
Vinod Kumar Vavilapalli	cbee889711	YARN-321. Merging YARN-321 branch to trunk. ... svn merge ../branches/YARN-321 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561452 13f79535-47bb-0310-9956-ffa450edef68	2014-01-26 04:51:10 +00:00
Jason Darrell Lowe	3497e76e19	YARN-1575. Public localizer crashes with "Localized unkown resource". Contributed by Jason Lowe ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561110 13f79535-47bb-0310-9956-ffa450edef68	2014-01-24 18:54:48 +00:00
Karthik Kambatla	482993ac53	YARN-1573. ZK store should use a private password for root-node-acls. (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560594 13f79535-47bb-0310-9956-ffa450edef68	2014-01-23 06:22:05 +00:00
Sanford Ryza	163348701c	YARN-1623. Include queue name in RegisterApplicationMasterResponse (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560545 13f79535-47bb-0310-9956-ffa450edef68	2014-01-22 22:25:03 +00:00
Sanford Ryza	8ceddeb0c3	YARN-1607. TestRM relies on the scheduler assigning multiple containers in a single node update (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560533 13f79535-47bb-0310-9956-ffa450edef68	2014-01-22 22:08:04 +00:00
Sanford Ryza	1a7e158844	YARN-1624. QueuePlacementPolicy format is not easily readable via a JAXB parser (Aditya Acharya via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560470 13f79535-47bb-0310-9956-ffa450edef68	2014-01-22 18:51:23 +00:00
Karthik Kambatla	e0ce554b86	YARN-1616. RMFatalEventDispatcher should log the cause of the event (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1559902 13f79535-47bb-0310-9956-ffa450edef68	2014-01-21 02:01:51 +00:00
Sanford Ryza	67cbde3008	YARN-1496. Protocol additions to allow moving apps between queues (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1559050 13f79535-47bb-0310-9956-ffa450edef68	2014-01-17 08:56:22 +00:00
Jason Darrell Lowe	a6ea460a91	MAPREDUCE-5672. Provide optional RollingFileAppender for container log4j (syslog). Contributed by Gera Shegalov ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558948 13f79535-47bb-0310-9956-ffa450edef68	2014-01-16 22:56:09 +00:00
Karthik Kambatla	752441434c	YARN-1608. LinuxContainerExecutor has a few DEBUG messages at INFO level (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558874 13f79535-47bb-0310-9956-ffa450edef68	2014-01-16 18:42:25 +00:00
Sanford Ryza	7274b5ff93	YARN-1351. Invalid string format in Fair Scheduler log warn message (Konstantin Weitz via Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558597 13f79535-47bb-0310-9956-ffa450edef68	2014-01-15 23:09:32 +00:00
Junping Du	4d413350d7	YARN-1603. Remove two *.orig files which were unexpectedly committed. (Zhijie Shen via junping_du) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558340 13f79535-47bb-0310-9956-ffa450edef68	2014-01-15 11:05:15 +00:00
Karthik Kambatla	d13c2eeca6	YARN-1598. HA-related rmadmin commands don't work on a secure cluster (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558251 13f79535-47bb-0310-9956-ffa450edef68	2014-01-15 00:57:28 +00:00
Sanford Ryza	f4fd050dee	YARN-1567. In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558228 13f79535-47bb-0310-9956-ffa450edef68	2014-01-14 22:33:56 +00:00
Vinod Kumar Vavilapalli	7c8b654ba5	YARN-888. Cleaned up POM files so that non-leaf modules don't include any dependencies and thus compact the dependency list for leaf modules. Contributed by Alejandro Abdelnur. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557801 13f79535-47bb-0310-9956-ffa450edef68	2014-01-13 18:34:02 +00:00
Vinod Kumar Vavilapalli	25bc68d15e	YARN-1041. Added the ApplicationMasterProtocol API for applications to use the ability in ResourceManager to optionally not kill containers when the ApplicationMaster exits. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557318 13f79535-47bb-0310-9956-ffa450edef68	2014-01-11 07:07:17 +00:00
Jian He	f677175f35	YARN-1166. Fixed app-specific and attempt-specific QueueMetrics to be triggered by accordingly app event and attempt event. Contributed by Zhijie Shen ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557296 13f79535-47bb-0310-9956-ffa450edef68	2014-01-11 01:15:49 +00:00
Karthik Kambatla	6608b75829	YARN-1574. RMDispatcher should be reset on transition to standby. (Xuan Gong via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557248 13f79535-47bb-0310-9956-ffa450edef68	2014-01-10 20:15:00 +00:00
Karthik Kambatla	a0ecb98a77	YARN-1033. Expose RM active/standby state to Web UI and REST API (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557181 13f79535-47bb-0310-9956-ffa450edef68	2014-01-10 16:35:52 +00:00
Vinod Kumar Vavilapalli	1393581bce	YARN-1490. Introduced the ability to make ResourceManager optionally not kill all containers when an ApplicationMaster exits. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557143 13f79535-47bb-0310-9956-ffa450edef68	2014-01-10 15:04:39 +00:00
Karthik Kambatla	49ec397340	YARN-1568. Rename clusterid to clusterId in ActiveRMInfoProto (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556435 13f79535-47bb-0310-9956-ffa450edef68	2014-01-08 03:30:49 +00:00
Vinod Kumar Vavilapalli	4931545f76	YARN-1482. Modified WebApplicationProxy to make it work across ResourceManager fail-over. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556380 13f79535-47bb-0310-9956-ffa450edef68	2014-01-07 22:16:30 +00:00
Jian He	332c2704d4	YARN-1293. Fixed TestContainerLaunch#testInvalidEnvSyntaxDiagnostics failure caused by non-English system locale. Contributed by Tsuyoshi OZAWA. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556318 13f79535-47bb-0310-9956-ffa450edef68	2014-01-07 19:00:21 +00:00
Jason Darrell Lowe	785c12056c	YARN-1409. NonAggregatingLogHandler can throw RejectedExecutionException. Contributed by Tsuyoshi OZAWA ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556282 13f79535-47bb-0310-9956-ffa450edef68	2014-01-07 17:11:09 +00:00
Vinod Kumar Vavilapalli	c3cc855d27	YARN-1029. Added embedded leader election in the ResourceManager. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556103 13f79535-47bb-0310-9956-ffa450edef68	2014-01-07 01:56:11 +00:00
Karthik Kambatla	2cddd21db9	YARN-1559. Race between ServerRMProxy and ClientRMProxy setting RMProxy#INSTANCE. (kasha and vinodkv via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555970 13f79535-47bb-0310-9956-ffa450edef68	2014-01-06 18:40:15 +00:00
Vinod Kumar Vavilapalli	a45017a5f1	YARN-1493. Changed ResourceManager and Scheduler interfacing to recognize app-attempts separately from apps. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554896 13f79535-47bb-0310-9956-ffa450edef68	2014-01-02 20:19:45 +00:00
Vinod Kumar Vavilapalli	bb2e2fee60	YARN-1549. Fixed a bug in ResourceManager's ApplicationMasterService that was causing unamanged AMs to not finish correctly. Contributed by haosdent. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554886 13f79535-47bb-0310-9956-ffa450edef68	2014-01-02 19:54:07 +00:00
Vinod Kumar Vavilapalli	50480f892a	YARN-1522. Fixed a race condition in the test TestApplicationCleanup that was causing it to randomly fail. Contributed by Liyin Liang. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554328 13f79535-47bb-0310-9956-ffa450edef68	2013-12-30 22:21:55 +00:00
Karthik Kambatla	e7120079bd	YARN-1481. Reverting addendum patch ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553994 13f79535-47bb-0310-9956-ffa450edef68	2013-12-29 05:43:31 +00:00
Karthik Kambatla	1152e23ed0	YARN-1463. Tests should avoid starting http-server where possible or creates spnego keytab/principals (vinodkv via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553790 13f79535-47bb-0310-9956-ffa450edef68	2013-12-28 06:55:30 +00:00
Vinod Kumar Vavilapalli	8f0bf54d34	YARN-1541. Changed ResourceManager to invalidate ApplicationMaster host/port information once an AM crashes. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553772 13f79535-47bb-0310-9956-ffa450edef68	2013-12-28 01:09:07 +00:00
Karthik Kambatla	defeef6fe4	YARN-1481. Addendum patch to fix synchronization in AdminService ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553738 13f79535-47bb-0310-9956-ffa450edef68	2013-12-27 21:10:14 +00:00
Karthik Kambatla	1c9ac9adeb	YARN-1523. Use StandbyException instead of RMNotYetReadyException (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553616 13f79535-47bb-0310-9956-ffa450edef68	2013-12-27 03:28:23 +00:00
Karthik Kambatla	d841a0f474	YARN-1172. Convert SecretManagers in RM to services (Tsuyoshi OZAWA via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553431 13f79535-47bb-0310-9956-ffa450edef68	2013-12-26 00:21:56 +00:00
Vinod Kumar Vavilapalli	93907baa0b	YARN-1307. Redesign znode structure for Zookeeper based RM state-store for better organization and scalability. Contributed by Tsuyoshi OZAWA. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552209 13f79535-47bb-0310-9956-ffa450edef68	2013-12-19 02:33:05 +00:00
Vinod Kumar Vavilapalli	ca125153b3	YARN-1028. Added FailoverProxyProvider capability to ResourceManager to help with RM failover. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551739 13f79535-47bb-0310-9956-ffa450edef68	2013-12-17 22:32:38 +00:00
Vinod Kumar Vavilapalli	b774d7b3de	YARN-1446. Changed client API to retry killing application till RM acknowledges so as to account for RM crashes/failover. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551444 13f79535-47bb-0310-9956-ffa450edef68	2013-12-17 02:16:20 +00:00
Karthik Kambatla	a6754bbb81	YARN-1451. TestResourceManager relies on the scheduler assigning multiple containers in a single node update. (Sandy Ryza via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551440 13f79535-47bb-0310-9956-ffa450edef68	2013-12-17 01:47:23 +00:00
Vinod Kumar Vavilapalli	49ad07af97	YARN-312. Introduced ResourceManagerAdministrationProtocol changes to support changing resources on node. Contributed by Junping Du. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551403 13f79535-47bb-0310-9956-ffa450edef68	2013-12-16 23:36:16 +00:00
Vinod Kumar Vavilapalli	5a1b33507b	YARN-1145. Fixed a potential file-handle leak in the web interface for displaying aggregated logs. Contributed by Rohith Sharma. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551326 13f79535-47bb-0310-9956-ffa450edef68	2013-12-16 19:27:48 +00:00
Vinod Kumar Vavilapalli	d38fb71d00	YARN-1505. Fixed Webapplication proxy server to not hardcode its bind address. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551314 13f79535-47bb-0310-9956-ffa450edef68	2013-12-16 19:09:44 +00:00
Vinod Kumar Vavilapalli	1182ca04d4	YARN-1485. Modified RM HA configuration validation to also ensure that service-address configuration are configured for every RM. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550854 13f79535-47bb-0310-9956-ffa450edef68	2013-12-13 23:54:44 +00:00
Jian He	28db28d491	YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550613 13f79535-47bb-0310-9956-ffa450edef68	2013-12-13 01:44:16 +00:00
Jian He	791e43c53b	Reverting YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550594 13f79535-47bb-0310-9956-ffa450edef68	2013-12-12 23:45:01 +00:00
Jian He	38c32ed239	YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550579 13f79535-47bb-0310-9956-ffa450edef68	2013-12-12 23:07:17 +00:00
Vinod Kumar Vavilapalli	8a79be36bd	YARN-1325. Modified RM HA configuration validation to also ensure that multiple RMs are configured. Contributed by Xuan Gong. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550524 13f79535-47bb-0310-9956-ffa450edef68	2013-12-12 20:50:11 +00:00
Vinod Kumar Vavilapalli	4ff1a8203b	YARN-408. Change CapacityScheduler to not disable delay-scheduling by default. Contributed by Mayank Bansal. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550245 13f79535-47bb-0310-9956-ffa450edef68	2013-12-11 20:14:30 +00:00
Karthik Kambatla	94e2e78ab7	YARN-1481. Move internal services logic from AdminService to ResourceManager. (vinodkv via kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550167 13f79535-47bb-0310-9956-ffa450edef68	2013-12-11 15:13:46 +00:00
Vinod Kumar Vavilapalli	48fb53bc49	YARN-1405. Fixed ResourceManager to not hang when init/start fails with an exception w.r.t state-store. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548992 13f79535-47bb-0310-9956-ffa450edef68	2013-12-08 04:30:32 +00:00
Vinod Kumar Vavilapalli	305ae48136	YARN-1378. Implemented a cleaner of old finished applications from the RM state-store. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548990 13f79535-47bb-0310-9956-ffa450edef68	2013-12-08 04:17:51 +00:00
Sanford Ryza	e1d3670f4c	YARN-807. When querying apps by queue, iterating over all apps is inefficient and limiting (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548983 13f79535-47bb-0310-9956-ffa450edef68	2013-12-08 03:09:34 +00:00
Sanford Ryza	eccd7b2093	YARN-546. Allow disabling the Fair Scheduler event log. (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548360 13f79535-47bb-0310-9956-ffa450edef68	2013-12-06 01:32:27 +00:00
Arun Murthy	ef1f556cef	YARN-1438. Ensure container diagnostics includes exception from container launch. Contributed by Steve Loughran. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548336 13f79535-47bb-0310-9956-ffa450edef68	2013-12-06 00:25:02 +00:00
Karthik Kambatla	368d9769f4	YARN-1181. Augment MiniYARNCluster to support HA mode (kasha) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548330 13f79535-47bb-0310-9956-ffa450edef68	2013-12-05 23:48:37 +00:00
Sanford Ryza	6d5f8ebed6	YARN-1403. Separate out configuration loading from QueueManager in the Fair Scheduler (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548006 13f79535-47bb-0310-9956-ffa450edef68	2013-12-05 03:26:11 +00:00
Vinod Kumar Vavilapalli	7fe953ed90	YARN-1454. Fixed test failure issue with TestRMRestart. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547651 13f79535-47bb-0310-9956-ffa450edef68	2013-12-04 00:22:12 +00:00
Vinod Kumar Vavilapalli	9c95015bb4	YARN-895. Changed RM state-store to not crash immediately if RM restarts while the state-store is down. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547538 13f79535-47bb-0310-9956-ffa450edef68	2013-12-03 19:28:02 +00:00
Vinod Kumar Vavilapalli	c58ae266e9	YARN-1318. Promoted AdminService to an Always-On service and merged it into RMHAProtocolService. Contributed by Karthik Kambatla. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547212 13f79535-47bb-0310-9956-ffa450edef68	2013-12-02 22:18:44 +00:00
Sanford Ryza	61b6ed73f8	YARN-1241: Include missing files ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546625 13f79535-47bb-0310-9956-ffa450edef68	2013-11-29 19:08:48 +00:00
Sanford Ryza	7545d8bf99	YARN-1241. In Fair Scheduler, maxRunningApps does not work for non-leaf queues. (Sandy Ryza) ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546623 13f79535-47bb-0310-9956-ffa450edef68	2013-11-29 19:02:41 +00:00
Vinod Kumar Vavilapalli	6369c8d819	YARN-1239. Modified ResourceManager state-store implementations to start storing version numbers. Contributed by Jian He. ... git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546229 13f79535-47bb-0310-9956-ffa450edef68	2013-11-27 23:22:33 +00:00