Arun Suresh
3552c2b99d
YARN-5637. Changes in NodeManager to support Container rollback and commit. (asuresh)
2016-09-18 10:55:18 -07:00
Arun Suresh
f67237cbe7
YARN-5657. Fix TestDefaultContainerExecutor. (asuresh)
2016-09-17 09:32:05 -07:00
Naganarasimha
4174b9756c
YARN-5642. Typos in 9 log messages. Contributed by Mehran Hassani
2016-09-17 10:35:39 +05:30
Naganarasimha
ade7c2bc9c
YARN-4232. TopCLI console support for HA mode. Contributed by Bibin A Chundatt
2016-09-17 09:52:39 +05:30
Kai Zheng
58bae35447
YARN-5163. Migrate TestClientToAMTokens and TestClientRMTokens tests from the old RPC engine. Contributed by Wei Zhou and Kai Zheng
2016-09-18 08:43:36 +08:00
Arun Suresh
40b5a59b72
YARN-5620. Core changes in NodeManager to support re-initialization of Containers with new launchContext. (asuresh)
2016-09-15 07:15:11 -07:00
Jason Lowe
e793309735
YARN-5630. NM fails to start after downgrade from 2.8 to 2.7. Contributed by Jason Lowe
2016-09-13 14:41:27 +00:00
Rohith Sharma K S
729de3e6b6
YARN-5631. Missing refreshClusterMaxPriority usage in rmadmin help message. Contributed by Kai Sasaki.
2016-09-13 15:23:24 +05:30
Allen Wittenauer
58ed4fa544
HADOOP-13341. Deprecate HADOOP_SERVERNAME_OPTS; replace with (command)_(subcommand)_OPTS
...
This commit includes the following changes:
HADOOP-13356. Add a function to handle command_subcommand_OPTS
HADOOP-13355. Handle HADOOP_CLIENT_OPTS in a function
HADOOP-13554. Add an equivalent of hadoop_subcmd_opts for secure opts
HADOOP-13562. Change hadoop_subcommand_opts to use only uppercase
HADOOP-13358. Modify HDFS to use hadoop_subcommand_opts
HADOOP-13357. Modify common to use hadoop_subcommand_opts
HADOOP-13359. Modify YARN to use hadoop_subcommand_opts
HADOOP-13361. Modify hadoop_verify_user to be consistent with hadoop_subcommand_opts (ie more granularity)
HADOOP-13564. modify mapred to use hadoop_subcommand_opts
HADOOP-13563. hadoop_subcommand_opts should print name not actual content during debug
HADOOP-13360. Documentation for HADOOP_subcommand_OPTS
This closes apache/hadoop#126
2016-09-12 11:10:00 -07:00
Karthik Kambatla
c0e492e50f
YARN-5616. Clean up WeightAdjuster. (Yufei Gu via kasha)
2016-09-06 22:40:20 -07:00
Varun Vasudev
e6fcfe28e3
YARN-5576. Allow resource localization while container is running. Contributed by Jian He.
2016-09-06 20:01:45 +05:30
Rohith Sharma K S
f9557127b3
YARN-5608. TestAMRMClient.setup() fails with ArrayOutOfBoundsException. Contributed by Daniel Templeton.
2016-09-06 14:09:45 +05:30
Karthik Kambatla
f6ea9be547
YARN-5264. Store all queue-specific information in FSQueue. (Yufei Gu via kasha)
2016-09-02 14:56:29 -07:00
Ray Chiang
378f624a39
YARN-5549. AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately. (Daniel Templeton via rchiang)
2016-09-02 11:14:35 -07:00
Varun Vasudev
05f5c0f631
YARN-5555. Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Contributed by Eric Payne.
2016-09-02 16:02:01 +05:30
Karthik Kambatla
74f4bae455
YARN-5566. Client-side NM graceful decom is not triggered when jobs finish. (Robert Kanter via kasha)
2016-09-01 14:44:01 -07:00
Varun Vasudev
08f55ccbb0
YARN-5596. Fix failing unit test in TestDockerContainerRuntime. Contributed by Sidharta Seethana.
2016-09-01 14:08:51 +05:30
Arun Suresh
d6d9cff21b
YARN-5221. Expose UpdateResourceRequest API to allow AM to request for change in container properties. (asuresh)
2016-08-30 15:52:29 -07:00
Zhe Zhang
ed6ff5cd78
YARN-5550. TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN. Contributed by Jonathan Hung.
2016-08-29 14:46:00 -07:00
Jason Lowe
4cbe61407d
YARN-5560. Clean up bad exception catching practices in TestYarnClient. Contributed by Sean Po
2016-08-29 16:14:55 +00:00
Wangda Tan
19c743c1bb
YARN-4889. Changes in AMRMClient for identifying resource-requests explicitly. (Arun Suresh via wangda)
2016-08-26 17:14:12 -07:00
Subru Krishnan
b930dc3ec0
YARN-5327. API changes required to support recurring reservations in the YARN ReservationSystem. (Sangeetha Abdu Jyothi via Subru).
2016-08-26 16:58:47 -07:00
Karthik Kambatla
cde3a00526
YARN-5373. NPE listing wildcard directory in containerLaunch. (Daniel Templeton via kasha)
2016-08-26 11:04:33 -07:00
Junping Du
9ef632f3b0
YARN-5557. Add localize API to the ContainerManagementProtocol. Contributed by Jian He.
2016-08-26 09:04:44 -07:00
Naganarasimha
46e02ab719
YARN-3940. Application moveToQueue should check NodeLabel permission. Contributed by Bibin A Chundatt
2016-08-26 20:19:11 +05:30
Varun Vasudev
bfb4d95059
YARN-5430. Return container's ip and host from NM ContainerStatus call. Contributed by Jian He.
2016-08-26 16:30:18 +05:30
Naganarasimha
27c3b86252
YARN-5564. Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLE. Contributed by Ray Chiang
2016-08-26 08:47:21 +05:30
Jason Lowe
3d86110a5c
YARN-5389. TestYarnClient#testReservationDelete fails. Contributed by Sean Po
2016-08-25 14:42:06 +00:00
Varun Vasudev
525d52bf7c
YARN-5042. Mount /sys/fs/cgroup into Docker containers as read only mount. Contributed by luhuichun.
2016-08-25 14:18:26 +05:30
Varun Saxena
79603f5882
YARN-5537. Fix intermittent failure of TestAMRMClient#testAMRMClientWithContainerResourceChange (Bibin A Chundatt via Varun Saxena)
2016-08-25 14:10:34 +05:30
Naganarasimha
143c59e4c5
YARN-4491. yarn list command to support filtering by tags. Contributed by Varun Saxena
2016-08-24 01:53:02 +05:30
Rohith Sharma K S
0d5997d2b9
YARN-5544. TestNodeBlacklistingOnAMFailures fails on trunk. Contributed by Sunil G.
2016-08-23 14:37:39 +05:30
Wangda Tan
2da32a6ef9
YARN-4685. Disable AM blacklisting by default to mitigate situations that application get hanged. (Rohith Sharma K S via wangda)
2016-08-19 16:31:16 -07:00
Wangda Tan
444b2ea7af
YARN-3388. Allocation in LeafQueue could get stuck because DRF calculator isn't well supported when computing user-limit. (Nathan Roberts via wangda)
2016-08-19 16:28:32 -07:00
Varun Saxena
091dd19e86
YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)
2016-08-19 17:30:17 +05:30
Varun Saxena
8aed374182
Revert "YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)"
...
This reverts commit 59557e85a4
.
2016-08-19 16:14:16 +05:30
Varun Saxena
59557e85a4
YARN-5533. JMX AM Used metrics for queue wrong when app submited to nodelabel partition (Bibin A Chundatt via Varun Saxena)
2016-08-19 15:01:48 +05:30
Junping Du
0da69c324d
YARN-4676. Automatic and Asynchronous Decommissioning Nodes Status Tracking. Contributed by Diniel Zhi.
...
(cherry picked from commit d464483bf7f0b3e3be3ba32cd6c3eee546747ab5)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ResourceTrackerService.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
2016-08-18 07:27:23 -07:00
Varun Saxena
913a895136
YARN=5526. DrainDispacher#serviceStop blocked if setDrainEventsOnStop invoked (sandflee via Varun Saxena)
2016-08-18 11:38:13 +05:30
Karthik Kambatla
20f0eb871c
YARN-4702. FairScheduler: Allow setting maxResources for ad hoc queues. (Daniel Templeton via kasha)
2016-08-17 17:40:20 -07:00
Varun Saxena
e3037c5641
YARN-5523. Yarn running container log fetching causes OutOfMemoryError (Xuan Gong via Varun Saxena)
2016-08-18 01:45:33 +05:30
Varun Vasudev
7f05ff7a4e
YARN-5455. Update Javadocs for LinuxContainerExecutor. Contributed by Daniel Templeton.
2016-08-17 15:34:58 +05:30
Varun Saxena
b427ce12bc
YARN-5475. Fix test failure of TestAggregatedLogFormat#testReadAcontainerLogs1 (Jun Gong via Varun Saxena)
2016-08-16 20:24:53 +05:30
Varun Saxena
ffe1fff526
YARN-5514. Clarify DecommissionType.FORCEFUL comment (Vrushali C via Varun Saxena)
2016-08-16 14:05:41 +05:30
Varun Saxena
24249115bf
YARN-5521. Fix random failure of TestCapacityScheduler#testKillAllAppsInQueue (sandflee via Varun Saxena)
2016-08-16 00:03:29 +05:30
Varun Saxena
d677b68c25
YARN-5491. Fix random failure of TestCapacityScheduler#testCSQueueBlocked (Bibin A Chundatt via Varun Saxena)
2016-08-15 03:31:21 +05:30
Varun Saxena
23c6e3c4e4
YARN-5476. Non existent application reported as ACCEPTED by YarnClientImpl (Junping Du via Varun Saxena)
2016-08-12 20:37:58 +05:30
Naganarasimha
874577a67d
YARN-4833. For Queue AccessControlException client retries multiple times on both RM. Contributed by Bibin A Chundatt
2016-08-12 01:09:41 +05:30
Rohith Sharma K S
5199db387d
YARN-5492. TestSubmitApplicationWithRMHA is failing sporadically during precommit builds. Contributed by Vrushali C.
2016-08-11 11:50:46 +05:30
Rohith Sharma K S
666ad0b67b
YARN-2398. TestResourceTrackerOnHA crashes. Contributed by Ajith S.
2016-08-11 11:27:00 +05:30
Ray Chiang
aea3e65749
YARN-5137. Make DiskChecker pluggable in NodeManager. (Yufei Gu via rchiang)
2016-08-10 19:23:29 -07:00
Naganarasimha
89c0bff719
YARN-5495. Remove import wildcard in CapacityScheduler. Contributed by Ray Chiang.
2016-08-11 00:35:19 +05:30
Jason Lowe
5c95bb315b
YARN-5382. RM does not audit log kill request for active applications. Contributed by Vrushali C
2016-08-10 18:25:54 +00:00
Jason Lowe
e0b570dffb
YARN-5483. Optimize RMAppAttempt#pullJustFinishedContainers. Contributed by sandflee
2016-08-10 18:04:18 +00:00
Karthik Kambatla
7992c0b42c
YARN-5343. TestContinuousScheduling#testSortedNodes fails intermittently. (Yufei Gu via kasha)
2016-08-09 16:51:03 -07:00
Rohith Sharma K S
3cd386bd97
YARN-5474. Typo mistake in AMRMClient#getRegisteredTimeineClient API. Contributed by Naganarasimha G R.
2016-08-09 22:28:54 +05:30
Varun Vasudev
522ddbde79
YARN-5394. Remove bind-mount /etc/passwd for Docker containers. Contributed by Zhankun Tang.
2016-08-09 16:04:09 +05:30
Arun Suresh
82c9e06101
YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh)
2016-08-09 00:42:29 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
83a2ffec40
YARN-5470. Addedum to differentiate exactly matching of log-files with regex in yarn log CLI. Contributed by Xuan Gong.
2016-08-08 14:28:07 -07:00
Varun Saxena
37d939a453
YARN-4910. Fix incomplete log info in ResourceLocalizationService (Jun Gong via Varun Saxena)
2016-08-08 22:12:53 +05:30
Naganarasimha
131d58a24e
YARN-5287. LinuxContainerExecutor fails to set proper permission. Contributed by Ying Zhang
2016-08-07 01:08:13 +05:30
Naganarasimha
d81b8163b4
YARN-4624. NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI. Contributed by Brahma Reddy Battula
2016-08-06 01:13:36 +05:30
Junping Du
e605d47df0
YARN-5470. Differentiate exactly match with regex in yarn log CLI. Contributed by Xuan Gong.
2016-08-05 10:55:29 -07:00
Wangda Tan
3f100d76ff
YARN-4888. Changes in scheduler to identify resource-requests explicitly by allocation-id. (Subru Krishnan via wangda)
2016-08-05 10:43:35 -07:00
Wangda Tan
e0d131f055
YARN-4091. Add REST API to retrieve scheduler activity. (Chen Ge and Sunil G via wangda)
2016-08-05 10:27:34 -07:00
Rohith Sharma K S
d9a354c2f3
YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong.
2016-08-05 21:35:49 +05:30
Varun Saxena
4a26221021
YARN-5429. Fix return related javadoc warnings in yarn-api (Vrushali C via Varun Saxena)
2016-08-05 16:27:53 +05:30
Varun Vasudev
08e33381f5
YARN-5459. Add support for docker rm. Contributed by Shane Kumpf.
2016-08-04 14:08:34 +05:30
Jason Lowe
db4a61dc61
YARN-5469. Increase timeout of TestAmFilter.testFilter. Contributed by Eric Badger
2016-08-03 19:51:44 +00:00
Jason Lowe
db646540f0
YARN-5462. TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently. Contributed by Eric Badger
2016-08-03 19:17:25 +00:00
Jason Lowe
4d92aefd35
YARN-4280. CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster. Contributed by Kuhu Shukla
2016-08-03 18:53:14 +00:00
Varun Vasudev
d848184e90
YARN-5460. Change container runtime type logging in DelegatingLinuxContainerRuntime to debug. Contributed by Shane Kumpf.
2016-08-03 12:02:39 +05:30
Chris Nauroth
b913677365
YARN-5456. container-executor support for FreeBSD, NetBSD, and others if conf path is absolute. Contributed by Allen Wittenauer.
2016-08-02 22:24:34 -07:00
Junping Du
3818393297
YARN-5226. Remove AHS enable check from LogsCLI#fetchAMContainerLogs. Contributed by Xuan Gong.
2016-08-02 10:41:46 -07:00
Varun Vasudev
7fc70c6422
YARN-5458. Rename DockerStopCommandTest to TestDockerStopCommand. Contributed by Shane Kumpf.
2016-08-02 16:56:45 +05:30
Varun Vasudev
2e7c2a13a8
YARN-5443. Add support for docker inspect command. Contributed by Shane Kumpf.
2016-08-02 16:55:10 +05:30
Varun Vasudev
95694b70cd
YARN-5444. Fix failing unit tests in TestLinuxContainerExecutorWithMocks. Contributed by Yufei Gu.
2016-08-01 16:08:38 +05:30
Arun Suresh
e5766b1dbe
YARN-5113. Refactoring and other clean-up for distributed scheduling. (Konstantinos Karanasos via asuresh)
2016-07-31 11:48:25 -07:00
Chris Nauroth
ef501b1a0b
YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer.
2016-07-30 08:26:19 -07:00
Junping Du
95f2b98597
YARN-5434. Add -client|server argument for graceful decommmission. Contributed by Robert Kanter.
2016-07-29 10:26:11 -07:00
Li Lu
7086fc72ee
YARN-5436. Race in AsyncDispatcher can cause random test failures in Tez (probably YARN also). (Zhiyuan Yang via gtcarrera9)
2016-07-28 16:50:57 -07:00
Subru Krishnan
4e756d7271
YARN-5203.Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API. Contributed by Ellen Hui.
2016-07-28 16:03:24 -07:00
Jason Lowe
a1890c32c5
YARN-5438. TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOM. Contributed by Rohith Sharma K S
2016-07-28 21:47:13 +00:00
Li Lu
26de4f0de7
YARN-5440. Use AHSClient in YarnClient when TimelineServer is running. (Xuan Gong via gtcarrera9)
2016-07-28 10:23:18 -07:00
Junping Du
7f3c306e2e
YARN-5432. Lock already held by another process while LevelDB cache store creation for dag. Contributed by Li Lu.
2016-07-28 06:35:24 -07:00
Varun Saxena
8d06bda337
YARN-5431. TimelineReader daemon start should allow to pass its own reader opts (Rohith Sharma K S via Varun Saxena)
2016-07-28 08:36:09 +05:30
Subru Krishnan
d2cbfd7de3
YARN-5441. Fixing minor Scheduler test case failures
2016-07-27 18:21:58 -07:00
Akira Ajisaka
54fe17a607
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
2016-07-27 19:41:09 +09:00
Wangda Tan
d62e121ffc
YARN-5195. RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. (sandflee via wangda)
2016-07-26 21:22:59 -07:00
Arun Suresh
2d8d183b19
YARN-5351. ResourceRequest should take ExecutionType into account during comparison. (Konstantinos Karanasos via asuresh)
2016-07-26 19:08:30 -07:00
Wangda Tan
49969b16cd
YARN-5342. Improve non-exclusive node partition resource allocation in Capacity Scheduler. (Sunil G via wangda)
2016-07-26 18:14:09 -07:00
Arun Suresh
5aace38b74
YARN-5392. Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerRequestKey. (asuresh and subru)
2016-07-26 14:54:03 -07:00
Varun Saxena
da6adf5151
Revert "YARN-5431. TimelineReader daemon start should allow to pass its own reader opts (Rohith Sharma K S via Varun Saxena)"
...
This reverts commit 8e2614592d
.
2016-07-26 21:13:12 +05:30
Varun Saxena
8e2614592d
YARN-5431. TimelineReader daemon start should allow to pass its own reader opts (Rohith Sharma K S via Varun Saxena)
2016-07-26 20:49:06 +05:30
Chris Douglas
d383bfdcd4
YARN-5164. Use plan RLE to improve CapacityOverTimePolicy efficiency
2016-07-25 16:37:50 -07:00
mattf-horton
12aa184479
HADOOP-13382. Remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects, while adding it in to the only place it is still needed, hadoop-openstack. Contributed by Matt Foley.
2016-07-21 14:43:57 -07:00
Rohith Sharma K S
557a245d83
YARN-5092. TestRMDelegationTokens fails intermittently. Contributed by Jason Lowe.
2016-07-21 12:47:27 +05:30
Rohith Sharma K S
be34b2a8fd
YARN-1126. Add validation of users input nodes-states options to nodes CLI. Contributed by Wei Yan.
2016-07-21 12:20:47 +05:30
Akira Ajisaka
c63afdbe14
YARN-4883. Make consistent operation name in AdminService. Contributed by Kai Sasaki.
2016-07-20 16:51:01 -07:00
Vinod Kumar Vavilapalli
1c9d2ab503
YARN-5340. Fixed a race condition in RollingLevelDBTimelineStore that caused loss of Timeline events. Contributed by Li Lu.
2016-07-20 08:36:36 -07:00
Varun Vasudev
9ccf935b2c
YARN-5309. Fix SSLFactory truststore reloader thread leak in TimelineClientImpl. Contributed by Weiwei Yang.
2016-07-20 12:48:32 +05:30
Arun Suresh
8fbe6ece24
YARN-5350. Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost. (asuresh)
2016-07-19 23:03:58 -07:00
Arun Suresh
cda0a280dd
YARN-5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)
2016-07-19 10:43:37 -07:00
Arun Suresh
5f2d33a551
Revert "YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)"
...
This reverts commit e905a42a2c
.
2016-07-19 10:43:19 -07:00
Junping Du
dc2f4b6ac8
YARN-5213. Fix a bug in LogCLIHelpers which cause TestLogsCLI#testFetchApplictionLogs fails intermittently. Contributed by Xuan Gong.
2016-07-19 07:17:58 -07:00
Varun Saxena
fe20494a72
YARN-4996. Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic (Kai Sasaki via Varun Saxena)
2016-07-19 16:03:28 +05:30
Andrew Wang
da456ffd62
Preparing for 3.0.0-alpha2 development
2016-07-15 19:04:17 -07:00
Ray Chiang
f5f1c81e7d
YARN-5272. Handle queue names consistently in FairScheduler. (Wilfred Spiegelenburg via rchiang)
2016-07-15 14:38:50 -07:00
Arun Suresh
e905a42a2c
YARN=5181. ClusterNodeTracker: add method to get list of nodes matching a specific resourceName. (kasha via asuresh)
2016-07-15 14:35:12 -07:00
Wangda Tan
24db9167f1
YARN-4484. Available Resource calculation for a queue is not correct when used with labels. (Sunil G via wangda)
2016-07-15 11:40:12 -07:00
Varun Saxena
a72cb3825a
YARN-5383. Fix findbugs and checkstyle issues in ContainerExecutor. (Vrushali C via Varun Saxena)
2016-07-15 23:17:04 +05:30
Junping Du
7e5355c14e
YARN-5339. Passing file to -out for YARN log CLI doesnt give warning or error code. Contributed by Xuan Gong.
2016-07-15 09:23:11 -07:00
Naganarasimha
b5ee7dbd8d
YARN-5380. NMTimelinePublisher should use getMemorySize instead of getMemory. Contributed by Vrushali C
2016-07-15 14:34:48 +05:30
Sangjin Lee
e549a9af31
YARN-5379. TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently (Vrushali C via sjlee)
2016-07-14 15:19:03 -07:00
Akira Ajisaka
6cf017558a
YARN-5159. Wrong Javadoc tag in MiniYarnCluster. Contributed by Andras Bokor.
2016-07-14 10:45:11 -07:00
Xuan
429347289c
YARN-5363. For AM containers, or for containers of running-apps, "yarn logs" incorrectly only (tries to) shows syslog file-type by default. (Contributed by Vinod Kumar Vavilapalli)
2016-07-14 10:20:08 -07:00
Varun Vasudev
54bf14f80b
YARN-5303. Clean up ContainerExecutor JavaDoc. Contributed by Daniel Templeton.
2016-07-14 19:28:11 +05:30
Varun Vasudev
e5e558b0a3
YARN-4759. Fix signal handling for docker containers. Contributed by Shane Kumpf.
2016-07-14 19:27:16 +05:30
Varun Vasudev
58e1850801
YARN-5298. Mount usercache and NM filecache directories into Docker container. Contributed by Sidharta Seethana.
2016-07-14 16:11:07 +05:30
Rohith Sharma K S
dbe97aa768
YARN-5299. Log Docker run command when container fails. Contributed by Varun Vasudev.
2016-07-14 11:48:10 +05:30
Vinod Kumar Vavilapalli
d18050522c
YARN-5339. Fixed "yarn logs" to fail when a file is passed to -out option instead of a directory. Contributed by Xuan Gong.
2016-07-13 14:52:30 -07:00
Naganarasimha
af8f480c24
YARN-5364. timelineservice modules have indirect dependencies on mapreduce artifacts. Contributed by Sangjin Lee
2016-07-14 01:43:37 +05:30
Vinod Kumar Vavilapalli
eb47163234
YARN-5200. Enhanced "yarn logs" to be able to get a list of containers whose logs are aggregated via a "show_container_log_info" option. Contributed by Xuan Gong.
2016-07-13 10:54:15 -07:00
Varun Saxena
56142171b9
YARN-5359. FileSystemTimelineReader/Writer uses unix-specific default storage path (Sangjin Lee via Varun Saxena)
2016-07-13 21:15:41 +05:30
Rohith Sharma K S
d6d41e820a
YARN-5362. TestRMRestart#testFinishedAppRemovalAfterRMRestart can fail. Contributed by sandflee.
2016-07-13 19:12:35 +05:30
Varun Saxena
06c56ff79b
YARN-5353. ResourceManager can leak delegation tokens when they are shared across apps. (Jason Lowe via Varun Saxena).
2016-07-13 07:55:34 +05:30
Robert Kanter
bf6f4a3b98
YARN-4366. Fix Lint Warnings in YARN Common (templedf via rkanter)
2016-07-12 15:12:25 -07:00
Jason Lowe
10b704c594
YARN-5317. testAMRestartNotLostContainerCompleteMsg may fail. Contributed by sandflee
2016-07-12 20:27:41 +00:00
Junping Du
7705812c7e
New addendum to YARN-5080. Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM.
2016-07-12 08:29:49 -07:00
Varun Saxena
a3ac1c1943
YARN-5354. TestDistributedShell.checkTimelineV2 fails randomly for concurrent tests. (Sangjin Lee via Varun Saxena).
2016-07-12 20:41:52 +05:30
Jian He
819224dcf9
YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan
2016-07-11 22:36:20 -07:00
Varun Saxena
0fd3980a1f
YARN-5037. Fix random failure of TestRMRestart#testQueueMetricsOnRMRestart (sandflee via Varun Saxena).
2016-07-10 21:28:52 +05:30
Sangjin Lee
6cf6ab7b78
Made a number of miscellaneous fixes for javac, javadoc, and checstyle warnings.
2016-07-10 08:46:05 -07:00
Sangjin Lee
c5dbde0cc4
Fixed the build after the rebase with trunk.
2016-07-10 08:46:05 -07:00
Sangjin Lee
b313ce06b2
YARN-5174. [documentation] several updates/corrections to timeline service documentation (Sangjin Lee, Varun Saxena, Naganarasimha G R, and Li Lu via sjlee)
2016-07-10 08:46:04 -07:00
Vrushali
6d943038f6
Cleanup changes during rebase with trunk (Vrushali C)
2016-07-10 08:46:04 -07:00
Sangjin Lee
1a227744ac
YARN-5070. upgrade HBase version for first merge (Vrushali C via sjlee)
2016-07-10 08:46:04 -07:00
Varun Saxena
1ff6833bba
YARN-5243. fix several rebase and other miscellaneous issues before merge. (Sangjin Lee via Varun Saxena)
2016-07-10 08:46:03 -07:00
Vrushali Channapattan
32b033d57c
YARN-5052 Update timeline service v2 documentation to capture information about filters (Varun Saxena via Vrushali C)
2016-07-10 08:46:03 -07:00
Varun Saxena
892b193bd7
YARN-5170. Eliminate singleton converters and static method access. (Joep Rottinghuis via Varun Saxena)
2016-07-10 08:46:03 -07:00
Vrushali Channapattan
3832795e3c
YARN-5210 NPE in Distributed Shell while publishing DS_CONTAINER_START event (Varun Saxena via Vrushali C)
2016-07-10 08:46:02 -07:00
Varun Saxena
c65020075e
YARN-5167. Escape occurences of encodedValues. (Sangjin Lee via Varun Saxena)
2016-07-10 08:46:02 -07:00
Varun Saxena
9c926cf432
YARN-5142. fix findbugs warnings/errors for hadoop-yarn-server-timelineservice-hbase-tests. (Vrushali C via Varun Saxena)
2016-07-10 08:46:02 -07:00
Li Lu
0a9b085f05
YARN-5189. Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl. (Joep Rottinghuis and Sangjin Lee via gtcarrera9)
2016-07-10 08:46:01 -07:00
Sangjin Lee
c81a2e1d19
YARN-5015. entire time series is returned for YARN container system metrics (CPU and memory) (Varun Saxena via sjlee)
2016-07-10 08:46:01 -07:00
Sangjin Lee
497d1c7f51
YARN-5111. YARN container system metrics are not aggregated to application (Naganarasimha G R via sjlee)
2016-07-10 08:46:01 -07:00
Sangjin Lee
7b8cfa5c2f
YARN-5109. timestamps are stored unencoded causing parse errors (Varun Saxena via sjlee)
2016-07-10 08:46:01 -07:00
Li Lu
d729e8211b
YARN-5138. fix "no findbugs output file" error for hadoop-yarn-server-timelineservice-hbase-tests. (Vrushali C via gtcarrera9)
2016-07-10 08:46:00 -07:00
Sangjin Lee
702236129b
YARN-5095. flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled (Varun Saxena via sjlee)
2016-07-10 08:46:00 -07:00
Sangjin Lee
831a3ffd6e
YARN-5097. NPE in Separator.joinEncoded() (Vrushali C via sjlee)
2016-07-10 08:46:00 -07:00
Sangjin Lee
a1b6d7456f
YARN-5018. Online aggregation logic should not run immediately after collectors got started (Li Lu via sjlee)
2016-07-10 08:45:59 -07:00
Sangjin Lee
8c8183e515
YARN-5093. created time shows 0 in most REST output (Varun Saxena via sjlee)
2016-07-10 08:45:59 -07:00
Sangjin Lee
d5dfee24b1
YARN-5050. Code cleanup for TestDistributedShell (Li Lu via sjlee)
2016-07-10 08:45:59 -07:00
Sangjin Lee
4a7011a45f
YARN-5096 addendum. Turned another logging statement to debug. Contributed by Sangjin Lee.
2016-07-10 08:45:59 -07:00
Varun Saxena
bcdb382600
YARN-5096. timelinereader has a lot of logging that's not useful. (Sangjin Lee via Varun Saxena)
2016-07-10 08:45:58 -07:00
Varun Saxena
bc6f978cd3
YARN-5045. hbase unit tests fail due to dependency issues. (Sangjin Lee via varunsaxena)
2016-07-10 08:45:58 -07:00
Sangjin Lee
089caf49fe
YARN-4447. Provide a mechanism to represent complex filters and parse them at the REST layer (Varun Saxena via sjlee)
2016-07-10 08:45:57 -07:00
Li Lu
c2055a97d5
YARN-3150. Documenting the timeline service v2. (Sangjin Lee and Vrushali C via gtcarrera9)
2016-07-10 08:45:57 -07:00
Sangjin Lee
69dc561b61
YARN-4986. Add a check in the coprocessor for table to operated on (Vrushali C via sjlee)
2016-07-10 08:45:56 -07:00
Sangjin Lee
39cce4e629
YARN-3816. [Aggregation] App-level aggregation and accumulation for YARN system metrics (Li Lu via sjlee)
2016-07-10 08:45:56 -07:00
Sangjin Lee
c2efdc415a
YARN-3863. Support complex filters in TimelineReader (Varun Saxena via sjlee)
2016-07-10 08:45:55 -07:00
Varun Saxena
a3cf40e532
YARN-3461. Consolidate flow name/version/run defaults. (Sangjin Lee via Varun Saxena)
2016-07-10 08:45:55 -07:00
Sangjin Lee
84c35ac6c4
YARN-4711. NM is going down with NPE's due to single thread processing of events by Timeline client (Naganarasimha G R via sjlee)
2016-07-10 08:45:55 -07:00
Varun Saxena
6f6cc647d6
YARN-4712. CPU Usage Metric is not captured properly in YARN-2928. (Naganarasimha G R via Varun Saxena)
2016-07-10 08:45:54 -07:00
Sangjin Lee
9bdd455dce
YARN-4062. Add the flush and compaction functionality via coprocessors and scanners for flow run table (Vrushali C via sjlee)
2016-07-10 08:45:54 -07:00
Varun Saxena
d56dde490b
YARN-4700. ATS storage has one extra record each time the RM got restarted. (Naganarasimha G R via Varun Saxena)
2016-07-10 08:45:53 -07:00
Sangjin Lee
0d02ab8729
YARN-3367. Replace starting a separate thread for post entity with event loop in TimelineClient (Naganarasimha G R via sjlee)
2016-07-10 08:45:53 -07:00
Sangjin Lee
960af7d471
YARN-4409. Fix javadoc and checkstyle issues in timelineservice code (Varun Saxena via sjlee)
2016-07-10 08:45:53 -07:00
Sangjin Lee
9cb1287e9b
YARN-4446. Refactor reader API for better extensibility (Varun Saxena via sjlee)
2016-07-10 08:45:52 -07:00
Naganarasimha
06f0b50a28
YARN-4644. TestRMRestart fails and findbugs issue in YARN-2928 branch (Varun Saxena via Naganarasimha G R)
2016-07-10 08:45:52 -07:00
Li Lu
9d40d9d34c
YARN-4224. Support fetching entities by UID and change the REST
...
interface to conform to current REST APIs' in YARN. (Varun Saxena via
gtcarrera9)
2016-07-10 08:45:52 -07:00
Naganarasimha
6934b05c71
YARN-4238. createdTime and modifiedTime is not reported while publishing entities to ATSv2. (Varun Saxena via Naganarasimha G R)
2016-07-10 08:45:52 -07:00
Varun Saxena
f5380d850e
YARN-4622. TestDistributedShell fails for v2 test cases after modifications for 1.5. (Naganarasimha G R via Varun Saxena)
2016-07-10 08:45:51 -07:00
Li Lu
34f02f07d5
Rebase to latest trunk
2016-07-10 08:45:51 -07:00
Li Lu
88f0294114
YARN-4200. Refactor reader classes in storage to nest under hbase
...
specific package name. Contributed by Li Lu.
2016-07-10 08:45:51 -07:00
Sangjin Lee
cc16683cef
YARN-3995. Some of the NM events are not getting published due race condition when AM container finishes in NM (Naganarasimha G R via sjlee)
2016-07-10 08:45:50 -07:00
Varun Saxena
829cceebc0
YARN-3586. RM to only get back addresses of Collectors that NM needs to know.
...
(Junping Du via Varun Saxena).
2016-07-10 08:45:50 -07:00
Varun Saxena
eb0ac8efb1
YARN-4350. TestDistributedShell fails for V2 scenarios. (Naganarasimha G R via Varun Saxena)
2016-07-10 08:45:50 -07:00
Li Lu
8ef546c1ee
YARN-4445. Unify the term flowId and flowName in timeline v2 codebase.
...
Contributed by Zhan Zhang.
2016-07-10 08:45:49 -07:00
Varun Saxena
c4d7bbda5c
YARN-4460. [Bug fix] RM fails to start when SMP is enabled. (Li Lu via Varun Saxena)
2016-07-10 08:45:49 -07:00
Xuan
2e2dbf59d1
YARN-4392. ApplicationCreatedEvent event time resets after RM
...
restart/failover. Contributed by Naganarasimha G R and Xuan Gong
(cherry picked from commit 4546c7582b
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/RMAppImpl.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestRMAppTransitions.java
2016-07-10 08:45:49 -07:00
Li Lu
b7d484aead
YARN-4450. TestTimelineAuthenticationFilter and
...
TestYarnConfigurationFields fail. Contributed by Sangjin Lee.
2016-07-10 08:45:49 -07:00
Li Lu
89e5c44f9e
YARN-4356. Ensure the timeline service v.2 is disabled cleanly and has no
...
impact when it's turned off. Contributed by Sangjin Lee.
2016-07-10 08:45:48 -07:00
Junping Du
cf4666bb8c
YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong.
...
(cherry picked from commit f910e4f639
)
2016-07-10 08:45:48 -07:00
Sangjin Lee
1f710484e5
YARN-3862. Support for fetching specific configs and metrics based on prefixes (Varun Saxena via sjlee)
2016-07-10 08:45:48 -07:00
Sangjin Lee
ae72f1dc77
YARN-4297. TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch (Varun Saxena via sjlee)
2016-07-10 08:45:47 -07:00
Sangjin Lee
51254a6b51
YARN-4053. Change the way metric values are stored in HBase Storage (Varun Saxena via sjlee)
2016-07-10 08:45:47 -07:00
Sangjin Lee
09649005ca
YARN-4221. Store user in app to flow table (Varun Saxena via sjlee)
2016-07-10 08:45:47 -07:00
Sangjin Lee
10ec5586fb
YARN-4129. Refactor the SystemMetricPublisher in RM to better support newer events (Naganarasimha G R via sjlee)
2016-07-10 08:45:46 -07:00
Sangjin Lee
e3e857866d
YARN-4179. [reader implementation] support flow activity queries based on time (Varun Saxena via sjlee)
2016-07-10 08:45:46 -07:00
Li Lu
d014f2ffd2
YARN-4237 Support additional queries for ATSv2 Web UI. Contributed by
...
Varun Saxena.
2016-07-10 08:45:46 -07:00
Sangjin Lee
b51d0fef56
YARN-4178. [storage implementation] app id as string in row keys can cause incorrect ordering (Varun Saxena via sjlee)
2016-07-10 08:45:45 -07:00
Sangjin Lee
0f44b5508d
YARN-3864. Implement support for querying single app and all apps for a flow run (Varun Saxena via sjlee)
2016-07-10 08:45:45 -07:00
Vrushali Channapattan
708fa8b1ae
YARN-4210. HBase reader throws NPE if Get returns no rows (Varun Saxena via vrushali)
2016-07-10 08:45:45 -07:00
Vrushali Channapattan
da2b7bd08e
YARN-4203. Add request/response logging & timing for each REST endpoint call (Varun Saxena via vrushali)
2016-07-10 08:45:45 -07:00
Vrushali Channapattan
d95dc89a02
YARN-4075 [reader REST API] implement support for querying for flows and flow runs (Varun Saxena via vrushali)
2016-07-10 08:45:44 -07:00
Vrushali
10fa6da7d8
YARN-4074. [timeline reader] implement support for querying for flows and flow runs (sjlee via vrushali)
2016-07-10 08:45:44 -07:00
Sangjin Lee
a68e383921
YARN-3901. Populate flow run data in the flow_run & flow activity tables (Vrushali C via sjlee)
2016-07-10 08:45:44 -07:00
Sangjin Lee
ee081018e4
YARN-4102. Add a "skip existing table" mode for timeline schema creator (Li Lu via sjlee)
2016-07-10 08:45:43 -07:00
Sangjin Lee
8d9476ec5f
YARN-4058. Miscellaneous issues in NodeManager project (Naganarasimha G R via sjlee)
2016-07-10 08:45:43 -07:00
Sangjin Lee
451c13b1de
YARN-3814. REST API implementation for getting raw entities in TimelineReader (Varun Saxena via sjlee)
2016-07-10 08:45:43 -07:00
Sangjin Lee
c7224a285c
YARN-4064. build is broken at TestHBaseTimelineWriterImpl.java (sjlee)
2016-07-10 08:45:43 -07:00
Junping Du
7a41b5501e
YARN-4025. Deal with byte representations of Longs in writer code. Contributed by Sangjin Lee and Vrushali C.
2016-07-10 08:45:42 -07:00
Junping Du
477a30f536
YARN-3045. Implement NM writing container lifecycle events to Timeline Service v2. Contributed by Naganarasimha G R.
2016-07-10 08:45:42 -07:00
Sangjin Lee
102b56ee96
YARN-3904. Refactor timelineservice.storage to add support to online and offline aggregation writers (Li Lu via sjlee)
2016-07-10 08:45:42 -07:00
Zhijie Shen
5088f6c76a
MAPREDUCE-6337. Added a mode to replay MR job history files and put them into the timeline service v2. Contributed by Sangjin Lee.
...
(cherry picked from commit 463e070a8e7c882706a96eaa20ea49bfe9982875)
2016-07-10 08:45:41 -07:00
Junping Du
00e85e7a2b
YARN-3906. Split the application table from the entity table. Contributed by Sangjin Lee.
...
(cherry picked from commit bcd755eba9466ce277d3c14192c31da6462c4ab3)
2016-07-10 08:45:41 -07:00
Sangjin Lee
9e5155be36
YARN-3049. [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend (Zhijie Shen via sjlee)
...
(cherry picked from commit 07433c2ad52df9e844dbd90020c277d3df844dcd)
2016-07-10 08:45:41 -07:00
Zhijie Shen
9422d9b50d
YARN-3984. Adjusted the event column key schema and avoided missing empty event. Contributed by Vrushali C.
...
(cherry picked from commit 895ccfa1ab9e701f2908586e323249f670fe5544)
2016-07-10 08:45:40 -07:00
Zhijie Shen
57e2498cd4
YARN-3993. Changed to use the AM flag in ContainerContext determine AM container in TestPerNodeTimelineCollectorsAuxService. Contributed by Sunil G.
...
(cherry picked from commit 9e48f9ff2ce08f3dcdd8d60bacb697664b92196f)
2016-07-10 08:45:40 -07:00
Zhijie Shen
a9fab9b644
YARN-3908. Fixed bugs in HBaseTimelineWriterImpl. Contributed by Vrushali C and Sangjin Lee.
...
(cherry picked from commit df0ec473a84871b0effd7ca6faac776210d7df09)
2016-07-10 08:45:40 -07:00
Junping Du
8603736ef2
YARN-3949. Ensure timely flush of timeline writes. Contributed by Sangjin Lee.
...
(cherry picked from commit 967bef7e0396d857913caa2574afb103a5f0b81b)
2016-07-10 08:45:39 -07:00
Sangjin Lee
57d8dc2fb7
YARN-3836. add equals and hashCode to TimelineEntity and other classes in the data model (Li Lu via sjlee)
...
(cherry picked from commit 2d4a8f4563c06339717ca9410b2794754603fba3)
2016-07-10 08:45:39 -07:00
Sangjin Lee
e27642abf4
YARN-3047. [Data Serving] Set up ATS reader with basic request serving structure and lifecycle (Varun Saxena via sjlee)
...
(cherry picked from commit 4c5f88fb0f04b7919738d07598b0f006a9ff91f2)
2016-07-10 08:45:39 -07:00
Zhijie Shen
2d59bc4458
YARN-3051. Created storage oriented reader interface for fetching raw entity data and made the filesystem based implementation. Contributed by Varun Saxena.
...
(cherry picked from commit 499ce52c7b645ec0b1cc8ac62dc9a3127b987a20)
2016-07-10 08:45:38 -07:00
Sangjin Lee
22e7ae5771
YARN-3792. Test case failures in TestDistributedShell and some issue fixes related to ATSV2 (Naganarasimha G R via sjlee)
...
(cherry picked from commit 84f37f1c7eefec6d139cbf091c50d6c06f734323)
2016-07-10 08:45:38 -07:00
Sangjin Lee
92d90c3a24
YARN-3706. Generalize native HBase writer for additional tables (Joep Rottinghuis via sjlee)
...
(cherry picked from commit 9137aeae0dec83f9eff40d12cae712dfd508c0c5)
2016-07-10 08:45:38 -07:00
Zhijie Shen
f3c661e8dd
YARN-3044. Made RM write app, attempt and optional container lifecycle events to timeline service v2. Contributed by Naganarasimha G R.
2016-07-10 08:45:37 -07:00
Zhijie Shen
42d7864b84
YARN-3276. Code cleanup for timeline service API records. Contributed by Junping Du.
...
(cherry picked from commit d88f30ba5359f59fb71b93a55e1c1d9a1c0dff8e)
2016-07-10 08:45:37 -07:00
Sangjin Lee
f668212529
YARN-3721. build is broken on YARN-2928 branch due to possible dependency cycle (Li Lu via sjlee)
...
(cherry picked from commit a9738ceb17b50cce8844fd42bb800c7f83f15caf)
2016-07-10 08:45:37 -07:00
Sangjin Lee
db891f51d0
YARN-3726. Fix TestHBaseTimelineWriterImpl unit test failure by fixing its test data (Vrushali C via sjlee)
...
(cherry picked from commit 4c0b6d73914f2e249795deb292f508177ea54884)
2016-07-10 08:45:36 -07:00
Sangjin Lee
5a4278ccbd
YARN-3411. [Storage implementation] explore the native HBase write schema for storage (Vrushali C via sjlee)
...
(cherry picked from commit 7a3068854d27eadae1c57545988f5b2029bf119a)
2016-07-10 08:45:36 -07:00
Junping Du
d275677e24
YARN-3634. TestMRTimelineEventHandling and TestApplication are broken. Contributed by Sangjin Lee.
...
(cherry picked from commit b059dd4882fd759e4762cc11c019be4b68fb74c1)
2016-07-10 08:45:36 -07:00
Zhijie Shen
51d092faef
YARN-3529. Added mini HBase cluster and Phoenix support to timeline service v2 unit tests. Contributed by Li Lu.
2016-07-10 08:45:36 -07:00
Zhijie Shen
41fb5c7381
YARN-3134. Implemented Phoenix timeline writer to access HBase backend. Contributed by Li Lu.
...
(cherry picked from commit b3b791be466be79e4e964ad068f7a6ec701e22e1)
2016-07-10 08:45:35 -07:00
Sangjin Lee
dc1f306fdc
YARN-3562. unit tests failures and issues found from findbug from earlier ATS checkins (Naganarasimha G R via sjlee)
2016-07-10 08:45:35 -07:00
Sangjin Lee
fc8485d893
YARN-3551. Consolidate data model change according to the backend implementation (Zhijie Shen via sale)
...
(cherry picked from commit 557a3950bddc837469244835f5577899080115d8)
2016-07-10 08:45:35 -07:00
Junping Du
2bdefbc4a0
YARN-3431. Sub resources of timeline entity needs to be passed to a separate endpoint. Contributed By Zhijie Shen.
...
(cherry picked from commit fa5cc75245a6dba549620a8b26c7b4a8aed9838e)
2016-07-10 08:45:34 -07:00
Sangjin Lee
11e8905d8d
YARN-3390. Reuse TimelineCollectorManager for RM (Zhijie Shen via sjlee)
...
(cherry picked from commit 58221188811e0f61d842dac89e1f4ad4fd8aa182)
2016-07-10 08:45:33 -07:00
Junping Du
47f35a30bb
YARN-3391. Clearly define flow ID/ flow run / flow version in API and storage. Contributed by Zhijie Shen
...
(cherry picked from commit 68c6232f8423e55b4d152ef3d1d66aeb2d6a555e)
2016-07-10 08:45:33 -07:00
Zhijie Shen
5712b8f9fd
YARN-3334. NM uses timeline client to publish container metrics to new timeline service. Contributed by Junping Du.
2016-07-10 08:45:33 -07:00
Junping Du
42e49399ce
YARN-3374. Collector's web server should randomly bind an available port. Contributed by Zhijie Shen
...
(cherry picked from commit 3aa898e734a1e4368ddf1d0bbd31f9b4de53ceba)
2016-07-10 08:45:32 -07:00
Junping Du
d67c9bdb4d
YARN-3040. Make putEntities operation be aware of the app's context. Contributed by Zhijie Shen
2016-07-10 08:45:32 -07:00
Junping Du
5e3d9a477b
YARN-3034. Implement RM starting its timeline collector. Contributed by Naganarasimha G R
2016-07-10 08:45:32 -07:00
Zhijie Shen
19c1132146
YARN-3377. Fixed test failure in TestTimelineServiceClientIntegration. Contributed by Sangjin Lee.
...
(cherry picked from commit 04de2ceccd02edb00bd671a63e04855c132e9735)
2016-07-10 08:45:31 -07:00
Junping Du
2188a07e5b
YARN-3333. Rename TimelineAggregator etc. to TimelineCollector. Contributed by Sangjin Lee
2016-07-10 08:45:31 -07:00
Zhijie Shen
9b56364080
YARN-3039. Implemented the app-level timeline aggregator discovery service. Contributed by Junping Du.
2016-07-10 08:45:31 -07:00
Zhijie Shen
f0e752c14b
YARN-3264. Created backing storage write interface and a POC only FS based storage implementation. Contributed by Vrushali C.
...
(cherry picked from commit 821b68d05d246fd57d7b7286eb2ccc075ed1eae8)
2016-07-10 08:45:30 -07:00
Zhijie Shen
bf54d32750
YARN-3210. Refactored timeline aggregator according to new code organization proposed in YARN-3166. Contributed by Li Lu.
...
(cherry picked from commit d3ff7f06cbc66d3a23c2551e7d4c752689f46afe)
2016-07-10 08:45:30 -07:00
Zhijie Shen
d45ff878c4
YARN-3125. Made the distributed shell use timeline service next gen and add an integration test for it. Contributed by Junping Du and Li Lu.
...
(cherry picked from commit bf08f7f0ed4900ce52f98137297dd1a47ba2a536)
2016-07-10 08:45:30 -07:00
Zhijie Shen
9d57c9c015
YARN-3087. Made the REST server of per-node aggregator work alone in NM daemon. Conntributed by Li Lu.
...
(cherry picked from commit 41a08ad404d4278fe598d6c222b2ae0e84bae0df)
2016-07-10 08:45:29 -07:00
Zhijie Shen
309592b9e5
YARN-3240. Added ".keep" file which was missed before.
...
(cherry picked from commit 6b4dc96414b3f15537670c67a0dccd048862f4f4)
2016-07-10 08:45:29 -07:00
Junping Du
4f0c7eaff3
YARN-3240. Implement client API to put generic entities. Contributed by Zhijie Shen
...
(cherry picked from commit 4487da249f448d5c67b712cd0aa723e764eed77d)
2016-07-10 08:45:29 -07:00
Zhijie Shen
c77f86bf63
YARN-3041. Added the overall data model of timeline service next gen. Contributed by Zhijie Shen.
...
(cherry picked from commit fdff5d2625c129c20c44f90a0517b28cee1522bd)
2016-07-10 08:45:29 -07:00
Zhijie Shen
7c8abec0a8
YARN-3030. Set up TS aggregator with basic request serving structure and lifecycle. Contributed by Sangjin Lee.
...
(cherry picked from commit f26941b39028ac30c77547e2be2d657bb5bf044a)
2016-07-10 08:45:28 -07:00
Zhijie Shen
0d2da08f35
YARN-3063. Bootstrapping TimelineServer next generation module. Contributed by Zhijie Shen.
...
(cherry picked from commit fe7d0e7c8fc88e0721b18e1531b0899d9dbed296)
2016-07-10 08:45:28 -07:00
Junping Du
9bdb5bebea
Fix OOM issue in DistributedShell. Contributed by Jian He.
2016-07-09 05:09:53 -07:00
Varun Saxena
c04c5ec501
YARN-5318. Fix intermittent test failure of TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider. (Jun Gong via Varun Saxena).
2016-07-09 01:13:18 +05:30
Varun Saxena
5252562edf
YARN-5297. Avoid printing a stack trace when recovering an app after the RM restarts. (Junping Du via Varun Saxena).
2016-07-09 00:09:25 +05:30
Junping Du
30ee57ceb1
YARN-4939. The decommissioning Node should keep alive during NM restart. Contributed by sandflee.
2016-07-08 04:14:53 -07:00