big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,820 Commits 2 Branches 2 Tags 264 MiB
61cda39e4e
Commit Graph

541 Commits

Author SHA1 Message Date
Akira Ajisaka
8a99eba96d
Revert "YARN-5007. Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster. Contributed by Andras Bokor." 
This reverts commit 34ab8e73d4.
 2017-04-26 15:34:23 +09:00
Robert Kanter
3721cfe1fb MAPREDUCE-6871. Allow users to specify racks and nodes for strict locality for AMs (rkanter) 2017-04-21 16:12:01 -07:00
Haibo Chen
ac3cfdf3e5 MAPREDUCE-6673. Add a test example job that grows in memory usage over time (Karthik Kambatla via Haibo Chen) 
Change-Id: Iccfc8c67c38c526cc61726d87bfcbcf69ac36fea
 2017-04-17 11:15:39 -05:00
Robert Kanter
e7167e4a13 MAPREDUCE-6201. TestNetworkedJob fails on trunk (pbacsko via rkanter) 2017-04-06 17:44:47 -07:00
Akira Ajisaka
34ab8e73d4
YARN-5007. Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster. Contributed by Andras Bokor. 2017-04-05 17:33:07 +09:00
Chris Douglas
7297e82cb4 HADOOP-14250. Correct spelling of 'separate' and variants. Contributed by Doris Gu 2017-03-30 10:17:11 -07:00
Robert Kanter
9bae6720cb YARN-6050. AMs can't be scheduled on racks or nodes (rkanter) 2017-03-27 17:23:13 -07:00
Jason Lowe
4ebe8a6a23 MAPREDUCE-6859. hadoop-mapreduce-client-jobclient.jar sets a main class that isn't in the JAR. Contributed by Daniel Templeton 2017-03-08 10:27:57 -06:00
Akira Ajisaka
14413989ca
MAPREDUCE-6855. Specify charset when create String in CredentialsTestJob. Contributed by Kai Sasaki. 2017-03-07 13:10:59 +09:00
Akira Ajisaka
209ecd1a5c
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma. 2017-03-07 01:34:51 +09:00
Akira Ajisaka
19a1fc6373 MAPREDUCE-6753. Variable in byte printed directly in mapreduce client. Contributed by Kai Sasaki. 2017-03-03 16:11:10 +09:00
Rakesh Radhakrishnan
82ef9accaf HDFS-11428. Change setErasureCodingPolicy to take a required string EC policy name. Contributed by Andrew Wang. 2017-03-01 16:06:02 +05:30
Daniel Templeton
732ee6f0b5 MAPREDUCE-6825. YARNRunner#createApplicationSubmissionContext method is longer than 150 lines (Contributed by Gergely Novák via Daniel Templeton) 2017-02-22 15:38:11 -08:00
Wangda Tan
1a6ca75f38 YARN-6143. Fix incompatible issue caused by YARN-3583. (Sunil G via wangda) 2017-02-22 11:17:09 -08:00
Karthik Kambatla
c65f884fc7 MAPREDUCE-6829. Add peak memory usage counter for each task. (Miklos Szegedi via kasha) 2017-01-26 11:08:13 -08:00
Jason Lowe
69fa81679f YARN-5910. Support for multi-cluster delegation tokens. Contributed by Jian He 2017-01-23 17:12:51 +00:00
Andrew Wang
5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Akira Ajisaka
7ee8be1aa3 MAPREDUCE-6819. Replace UTF8 with Text in MRBench. Contributed by Peter Bacsko. 2017-01-17 17:56:10 +09:00
Arun Suresh
85826f6ca5 YARN-6066. Opportunistic containers Minor fixes : API annotations, parameter name changes, checkstyles. (asuresh) 
(cherry picked from commit 4985217de453a04ddffd7b52644bdc8d153f753c)
 2017-01-08 09:04:20 -08:00
Brahma Reddy Battula
6938b67711 HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin. 2016-12-31 16:16:02 +05:30
Jian He
523411d69b YARN-4844 (Addendum). Change JobStatus(usedMem,reservedMem,neededMem) 
back to int for compatibility. Contributed by Wangda Tan
 2016-12-20 11:28:44 -08:00
Arun Suresh
2273a74c1f YARN-5646. Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers. (Konstantinos Karanasos via asuresh) 2016-12-16 08:14:34 -08:00
Daniel Templeton
6d8b4f6c27 YARN-4395. Typo in comment in ClientServiceDelegate (Contributed by Alison Yu via Daniel Templeton) 2016-11-29 15:30:22 -08:00
Akira Ajisaka
209e805430 HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki. 2016-11-28 14:34:57 +09:00
Varun Saxena
b8690a9d25 MAPREDUCE-6811. TestPipeApplication#testSubmitter fails after HADOOP-13802 (Brahma Reddy Battula via Varun Saxena) 2016-11-17 00:51:07 +05:30
Jason Lowe
7ef290cfef MAPREDUCE-6804. Add timeout when starting JobHistoryServer in MiniMRYarnCluster. Contributed by Andras Bokor 2016-11-16 15:23:12 +00:00
Arun Suresh
3219b7b4ac YARN-4597. Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle. (asuresh) 2016-11-15 07:56:25 -08:00
Jian He
bcc15c6290 YARN-5611. Provide an API to update lifetime of an application. Contributed by Rohith Sharma K S 2016-11-09 16:08:05 -08:00
Akira Ajisaka
ca33bdd5c6 MAPREDUCE-6790. Update jackson from 1.9.13 to 2.x in hadoop-mapreduce. 2016-11-07 11:19:21 +09:00
Naganarasimha
28660f51af MAPREDUCE-2631. Potential resource leaks in BinaryProtocol$TeeOutputStream.java. Contributed by Sunil G. 2016-10-28 05:50:13 +05:30
Robert Kanter
5877f20f9c HADOOP-10075. Update jetty dependency to version 9 (rkanter) 2016-10-27 16:09:00 -07:00
Akira Ajisaka
d3bb69a667 YARN-5575. Many classes use bare yarn. properties instead of the defined constants. Contributed by Daniel Templeton. 2016-10-26 15:32:07 +09:00
Robert Kanter
29caf6d7df MAPREDUCE-6791. remove unnecessary dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle (haibochen via rkanter) 2016-10-18 18:00:29 -07:00
Robert Kanter
f3f37e6fb8 MAPREDUCE-6776. yarn.app.mapreduce.client.job.max-retries should have a more useful default (miklos.szegedi@cloudera.com via rkanter) 2016-10-07 14:47:06 -07:00
Naganarasimha
d0372dc613 YARN-3692. Allow REST API to set a user generated message when killing an application. Contributed by Rohith Sharma K S 2016-09-23 06:30:49 +05:30
Kai Zheng
501a77856d MAPREDUCE-6774. Add support for HDFS erasure code policy to TestDFSIO. Contributed by Sammi Chen 2016-09-18 09:03:15 +08:00
Akira Ajisaka
5a6fc5f483 MAPREDUCE-6767. TestSlive fails after a common change. Contributed by Daniel Templeton. 2016-08-25 10:55:00 +09:00
Kai Zheng
0ce1ab95cc MAPREDUCE-6578. Add support for HDFS heterogeneous storage testing to TestDFSIO. Contributed by Wei Zhou and Sammi Chen 2016-08-24 22:17:05 +08:00
Naganarasimha
143c59e4c5 YARN-4491. yarn list command to support filtering by tags. Contributed by Varun Saxena 2016-08-24 01:53:02 +05:30
Wangda Tan
3d937457ee MAPREDUCE-6310. Add jdiff support to MapReduce. (Li Lu/vinodkv via wangda) 2016-08-19 16:26:29 -07:00
Jason Lowe
f80a729832 MAPREDUCE-6690. Limit the number of resources a single map reduce job can submit for localization. Contributed by Chris Trezzo 2016-08-17 16:22:31 +00:00
Arun Suresh
82c9e06101 YARN-5457. Refactor DistributedScheduling framework to pull out common functionality. (asuresh) 2016-08-09 00:42:29 -07:00
Brahma Reddy Battula
8f1c374bec MAPREDUCE-6682. TestMRCJCFileOutputCommitter fails intermittently Contributed by Akira Ajisaka. 2016-08-04 11:21:47 +05:30
Akira Ajisaka
ce93595d7a MAPREDUCE-6729. Accurately compute the test execute time in DFSIO. Contributed by mingleizhang. 
This closes #112
 2016-07-30 22:13:19 +09:00
Akira Ajisaka
54fe17a607 HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák. 2016-07-27 19:41:09 +09:00
Jason Lowe
703fdf86c6 MAPREDUCE-6744. Increase timeout on TestDFSIO tests. Contributed by Eric Badger 2016-07-25 21:54:48 +00:00
Andrew Wang
da456ffd62 Preparing for 3.0.0-alpha2 development 2016-07-15 19:04:17 -07:00
Varun Saxena
d14e729a55 MAPREDUCE-6731. TestMRTimelineEventHandling#testMRNewTimelineServiceEventHandling fails randomly for concurrent tests. (Sangjin Lee via Varun Saxena). 2016-07-12 20:45:53 +05:30
Jian He
819224dcf9 YARN-5270. Solve miscellaneous issues caused by YARN-4844. Contributed by Wangda Tan 2016-07-11 22:36:20 -07:00
Sangjin Lee
6cf6ab7b78 Made a number of miscellaneous fixes for javac, javadoc, and checstyle warnings. 2016-07-10 08:46:05 -07:00