Eric E Payne
b897f6834b
MAPREDUCE-7079: JobHistory#ServiceStop implementation is incorrect. Contributed by Ahmed Hussein (ahussein)
2020-01-29 16:54:45 +00:00
Szilard Nemeth
7f3e1e0c07
MAPREDUCE-7260. Cross origin request support for Job history server web UI. Contributed by Adam Antal
2020-01-29 14:42:52 +01:00
Ahmed Hussein
08251538fe
MAPREDUCE-7259. testSpeculateSuccessfulWithUpdateEvents fails Intermittently
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-01-28 10:57:33 -06:00
Ahmed Hussein
3f01c48106
MAPREDUCE-7262. MRApp helpers block for long intervals (500ms)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-01-27 15:50:13 -06:00
Szilard Nemeth
9520b2ad79
YARN-10083. Provide utility to ask whether an application is in final status. Contributed by Adam Antal
2020-01-22 16:25:07 +01:00
kevinzhao1661
b8518e6dab
MAPREDUCE-7247. Modify HistoryServerRest.html content,change The job attempt id‘s datatype from string to int ( #1684 )
2020-01-16 12:53:56 +09:00
Masatake Iwasaki
a2fdd7c2b5
MAPREDUCE-7256. Fix javadoc error in SimpleExponentialSmoothing. ( #1804 )
2020-01-15 12:09:09 +09:00
Szilard Nemeth
13cea0412c
YARN-10028. Integrate the new abstract log servlet to the JobHistory server. Contributed by Adam Antal
2020-01-14 11:00:08 +01:00
Eric E Payne
93233a7d6e
YARN-9018. Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path. Contributed by Kuhu Shukla (kshukla)
2020-01-09 17:18:44 +00:00
Ahmed Hussein
cdd6efd3ab
MAPREDUCE-7252. Handling 0 progress in SimpleExponential task runtime estimator
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2020-01-08 11:08:13 -06:00
Sergey Pogorelov
b343e1533b
MAPREDUCE-7255. Fix typo in MapReduce documentaion example ( #1793 )
2020-01-06 12:36:11 +09:00
Sunil G
682e6fdeda
YARN-9052. Replace all MockRM submit method definitions with a builder. Contributed by Szilard Nemeth.
2019-12-05 13:26:23 +05:30
prabhujoseph
da9aa9c909
MAPREDUCE-7250. FrameworkUploader skip replication check if timeout is 0.
...
Contributed by Peter Bacsko.
2019-12-05 12:32:57 +05:30
prabhujoseph
304e75a48b
Revert "MAPREDUCE-7250. FrameworkUploader skip replication check if timeout is 0."
...
This reverts commit 8d82c44102
.
2019-12-05 12:31:13 +05:30
prabhujoseph
8d82c44102
MAPREDUCE-7250. FrameworkUploader skip replication check if timeout is 0.
...
Contributed by Peter Bacsko.
2019-12-04 20:20:56 +05:30
prabhujoseph
013c6e51b6
MAPREDUCE-7249. Fix Invalid event TA_TOO_MANY_FETCH_FAILURE at SUCCESS_CONTAINER_CLEANUP causes job failure.
...
Contributed by Wilfred Spiegelenburg.
2019-11-28 10:57:15 +05:30
prabhujoseph
7f2ea2ac46
MAPREDUCE-7240. Fix Invalid event: TA_TOO_MANY_FETCH_FAILURE at SUCCESS_FINISHING_CONTAINER.
...
Contributed by Huachao and Peter Bacsko. Reviewed by Wilfred Spiegelenburg.
2019-11-27 14:27:27 +05:30
Ahmed Hussein
ed302f1fed
MAPREDUCE-7208. Tuning TaskRuntimeEstimator. (Ahmed Hussein via jeagles)
...
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
2019-11-05 14:55:20 -06:00
Jonathan Hung
e6137d0e50
Make upstream aware of 2.10.0 release
2019-10-30 20:58:32 -07:00
Eric Yang
ac6b6a6a85
HADOOP-16614. Add aarch64 support for dependent leveldbjni.
...
Contributed by liusheng
close #1546
2019-10-24 11:45:57 -04:00
Jonathan Hung
5462d2176f
YARN-9760. Support configuring application priorities on a workflow level. Contributed by Varun Saxena
2019-10-08 11:20:13 -07:00
Steve Loughran
1921e94292
HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3
...
Contributed by Steve Loughran.
Includes
-S3A glob scans don't bother trying to resolve symlinks
-stack traces don't get lost in getFileStatuses() when exceptions are wrapped
-debug level logging of what is up in Globber
-Contains HADOOP-13373. Add S3A implementation of FSMainOperationsBaseTest.
-ITestRestrictedReadAccess tests incomplete read access to files.
This adds a builder API for constructing globbers which other stores can use
so that they too can skip symlink resolution when not needed.
Change-Id: I23bcdb2783d6bd77cf168fdc165b1b4b334d91c7
2019-10-01 18:11:05 +01:00
Duo Zhang
e8e7d7b4cd
HADOOP-16561. [MAPREDUCE] use protobuf-maven-plugin to generate protobuf classes ( #1500 )
...
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
2019-09-24 08:52:12 +08:00
Daisuke Kobayashi
bc2d3a71d6
HADOOP-16549. Remove Unsupported SSL/TLS Versions from Docs/Properties. Contributed by Daisuke Kobayashi.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2019-09-10 10:51:47 +08:00
Tao Yang
5d497abe21
YARN-9817. Fix failing testcases due to not initialized AsyncDispatcher - ArithmeticException: / by zero. Contributed by Prabhu Joseph.
2019-09-07 07:39:02 +08:00
Szilard Nemeth
3f4f097f1f
MAPREDUCE-7230. TestHSWebApp.testLogsViewSingle fails. Contributed by Prabhu Joseph
2019-08-15 17:07:43 +02:00
Szilard Nemeth
ac6c4f0b29
MAPREDUCE-7197. Fix order of actual and expected expression in assert statements. Contributed by Adam Antal
2019-08-12 13:54:28 +02:00
Szilard Nemeth
a7371a779c
MAPREDUCE-7225: Fix broken current folder expansion during MR job start. Contributed by Peter Bacsko.
2019-08-01 13:01:30 +02:00
Chen Zhang
8a59cd1b8a
HDFS-12967. NNBench should support multi-cluster access. Contributed by Chen Zhang.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-07-29 05:55:12 -07:00
Mehul Garnara
c0a0c353e8
MAPREDUCE-6973. Fix comments on creating _SUCCESS file.
...
This closes #280
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-26 21:21:26 +09:00
pingsutw
ee87e9a42e
MAPREDUCE-7076. TestNNBench#testNNBenchCreateReadAndDelete failing in our internal build
...
This closes #1089
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-23 10:34:10 +09:00
Masatake Iwasaki
79f6118dcc
MAPREDUCE-6521. MiniMRYarnCluster should not create /tmp/hadoop-yarn/staging on local filesystem in unit test.
...
Contributed by Masatake Iwasaki.
Change-Id: Id74b90eb7cfb9d676188fc5aa47249ee8904a3d5
2019-07-18 13:15:18 +01:00
Wanqiang Ji
b417a4c854
MAPREDUCE-7214. Remove unused pieces related to mapreduce.job.userlog.retain.hours
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-06-11 18:40:35 +09:00
Akira Ajisaka
3ea4f41d9f
MAPREDUCE-6794. Remove unused properties from TTConfig.java
2019-06-07 10:27:41 +09:00
Wanqiang Ji
e7e30a5f8b
MAPREDUCE-7210. Replace mapreduce.job.counters.limit
with mapreduce.job.counters.max
in mapred-default.xml
...
This closes #878
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-06-05 10:45:23 +09:00
Akira Ajisaka
afd844059c
HADOOP-16331. Fix ASF License check in pom.xml
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
2019-05-29 17:25:13 +09:00
Akira Ajisaka
9f933e6446
HADOOP-16323. https everywhere in Maven settings.
2019-05-27 15:24:59 +09:00
Akira Ajisaka
5565f2c532
MAPREDUCE-7198. mapreduce.task.timeout=0 configuration used to disable timeout doesn't work.
2019-05-23 10:21:11 +09:00
Wanqiang Ji
67f9a7b165
MAPREDUCE-7205. Treat container scheduler kill exit code as a task attempt killing event.
...
This closes #821
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-05-22 14:23:13 +09:00
Akira Ajisaka
afe6613ee6
MAPREDUCE-7200. Remove stale eclipse templates. Contributed by Wanqiang Ji.
2019-04-25 11:18:39 +09:00
Gabor Bota
d7979079ea
HADOOP-16210. Update guava to 27.0-jre in hadoop-project trunk. Contributed by Gabor Bota.
2019-04-03 12:59:39 -06:00
Adam Antal
856cbf62d3
MAPREDUCE-7190. Add SleepJob additional parameter to make parallel runs distinguishable. Contributed by Adam Antal.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-04-01 10:25:38 -07:00
David Mollitor
246ab77f28
HADOOP-16196. Path Parameterize Comparable.
...
Author: David Mollitor <david.mollitor@cloudera.com>
2019-03-22 10:26:24 +00:00
Steve Loughran
9f1c017f44
HADOOP-16058. S3A tests to include Terasort.
...
Contributed by Steve Loughran.
This includes
- HADOOP-15890. Some S3A committer tests don't match ITest* pattern; don't run in maven
- MAPREDUCE-7090. BigMapOutput example doesn't work with paths off cluster fs
- MAPREDUCE-7091. Terasort on S3A to switch to new committers
- MAPREDUCE-7092. MR examples to work better against cloud stores
2019-03-21 11:15:37 +00:00
Shweta Yakkali
cb4d911a82
MAPREDUCE-7188. [Clean-up] Remove NULL check before instanceof and fix checkstyle issue in TaskResult
...
(Contributed by Shweta Yakkali via Daniel Templeton)
Change-Id: Ie5eb9462f94e45cfd9d2a4b85c081ac8be949c07
2019-03-18 04:45:01 -07:00
Weiwei Yang
159a715eef
MAPREDUCE-7192. JobHistoryServer attempts page support jump to containers log page in NM when logAggregation is disable. Contributed by Jiandan Yang.
2019-03-13 17:00:35 +08:00
Weiwei Yang
f0605146b3
MAPREDUCE-7191. JobHistoryServer should log exception when loading/parsing history file failed. Contributed by Jiandan Yang.
2019-03-11 15:02:54 +08:00
Wangda Tan
308f3168fa
Make upstream aware of 3.1.2 release
...
Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365
2019-02-05 14:03:18 -08:00
Steve Loughran
f365957c63
HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile();
...
S3A to implement S3 Select through this API.
The new openFile() API is asynchronous, and implemented across FileSystem and FileContext.
The MapReduce V2 inputs are moved to this API, and you can actually set must/may
options to pass in.
This is more useful for setting things like s3a seek policy than for S3 select,
as the existing input format/record readers can't handle S3 select output where
the stream is shorter than the file length, and splitting plain text is suboptimal.
Future work is needed there.
In the meantime, any/all filesystem connectors are now free to add their own filesystem-specific
configuration parameters which can be set in jobs and used to set filesystem input stream
options (seek policy, retry, encryption secrets, etc).
Contributed by Steve Loughran
2019-02-05 11:51:02 +00:00
Akira Ajisaka
c991e2ca5a
MAPREDUCE-7177. Disable speculative execution in TestDFSIO. Contributed by Zhaohui Xin.
2019-02-04 14:03:34 +09:00
Akira Ajisaka
1129288cf5
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki.
2019-01-29 18:29:56 -08:00
Eric Yang
1ab69a9543
YARN-9221. Added flag to disable dynamic auxiliary service feature.
...
Contributed by Billie Rinaldi
2019-01-25 19:05:36 -05:00
Eric Yang
a33ef4fd31
YARN-8867. Added resource localization status to YARN service status call.
...
Contributed by Chandni Singh
2019-01-24 18:43:21 -05:00
Eric Yang
2fa9389c2e
YARN-9146. Added REST API to configure auxiliary service.
...
Contributed by Billie Rinaldi
2019-01-22 18:24:43 -05:00
Steve Loughran
6d0bffe17e
HADOOP-14556. S3A to support Delegation Tokens.
...
Contributed by Steve Loughran and Daryn Sharp.
2019-01-14 17:59:27 +00:00
Akira Ajisaka
7f78397036
Revert "HADOOP-14556. S3A to support Delegation Tokens."
...
This reverts commit d7152332b3
.
2019-01-08 14:51:30 +09:00
Steve Loughran
d7152332b3
HADOOP-14556. S3A to support Delegation Tokens.
...
Contributed by Steve Loughran.
2019-01-07 13:18:03 +00:00
Weiwei Yang
9e7196749e
MAPREDUCE-7174. Mapreduce example wordmedian should handle generic options. Contributed by Fei Hui.
2019-01-02 21:39:45 +08:00
Eric Yang
f82922dcfa
YARN-5168. Added exposed port information for Docker container.
...
Contributed by Xun Liu
2018-12-21 19:44:07 -05:00
Eric Yang
7affa3053c
YARN-9131. Updated document usage for dynamic auxiliary service.
...
Contributed by Billie Rinaldi
2018-12-20 18:45:49 -05:00
Akira Ajisaka
499c70eda5
MAPREDUCE-7166. map-only job should ignore node lost event when task is already succeeded. Contributed by Lei Li.
2018-12-20 10:09:50 +09:00
Eric Yang
c7a5a4435e
YARN-9075. Add ability to register/remove auxiliary service without restart node manager.
...
Contributed by Billie Rinaldi
2018-12-18 17:05:51 -05:00
Akira Ajisaka
e0d75088f2
MAPREDUCE-7170. Doc typo in PluggableShuffleAndPluggableSort.md. Contributed by Zhaohui Xin.
2018-12-13 16:26:25 +09:00
Haibo Chen
881230da21
YARN-9051. Integrate multiple CustomResourceTypesConfigurationProvider implementations into one. (Contributed by Szilard Nemeth)
2018-12-11 11:41:32 -08:00
Jason Lowe
9886c27c71
MAPREDUCE-7159. FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used. Contributed by Peter Bacsko
2018-12-06 14:48:17 -06:00
Jason Lowe
4d8de7ab69
MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla
2018-11-28 14:54:59 -06:00
Akira Ajisaka
13a21f6607
MAPREDUCE-6190. If a task stucks before its first heartbeat, it never timeouts and the MR job becomes stuck. Contributed by Zhaohui Xin.
2018-11-28 17:57:42 +09:00
Akira Ajisaka
1aad99a718
MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin.
2018-11-27 20:01:11 +09:00
Billie Rinaldi
27ffec7ba7
YARN-8778. Add command line interface to invoke interactive docker shell. Contributed by Eric Yang
2018-11-19 17:59:12 -08:00
Arpit Agarwal
1e15c7e855
HADOOP-15936. [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier. Contributed by Zsolt Venczel.
2018-11-15 12:42:31 -08:00
Wangda Tan
762a56cc64
MAPREDUCE-7158. Inefficient Flush Logic in JobHistory EventWriter. (Zichen Sun via wangda)
...
Change-Id: I99ace87980da03bb35a8012cea7218d602a8817a
2018-11-13 11:25:41 -08:00
Jason Lowe
0b6625a973
MAPREDUCE-7148. Fast fail jobs when exceeds dfs quota limitation. Contributed by Wang Yan
2018-11-07 08:20:49 -06:00
Jason Lowe
ba1f9d66d9
MAPREDUCE-7156. NullPointerException when reaching max shuffle connections. Contributed by Peter Bacsko
2018-11-06 17:55:51 -06:00
Jason Lowe
ab6aa4c726
YARN-8865. RMStateStore contains large number of expired RMDelegationToken. Contributed by Wilfred Spiegelenburg
2018-11-06 08:40:59 -06:00
bibinchundatt
74a5e683fe
MAPREDUCE-7151. RMContainerAllocator#handleJobPriorityChange expects application_priority always. Contributed by Bilwa S T.
2018-10-24 23:22:05 +05:30
Haibo Chen
823bb5dda8
MAPREDUCE-4669. MRAM web UI does not work with HTTPS. (Contributed by Robert Kanter)
2018-10-23 15:28:13 -07:00
Haibo Chen
babd1449bf
MAPREDUCE-7150. Optimize collections used by MR JHS to reduce its memory. (Contributed by Misha Dmitriev)
2018-10-16 13:44:41 -07:00
Xiao Chen
25f8fcb064
MAPREDUCE-7132. JobSplitWriter prints unnecessary warnings if EC(RS10,4) is used. Contributed by Peter Bacsko.
2018-10-16 10:23:31 -07:00
Steve Loughran
735a36afd5
MAPREDUCE-7149. Javadocs for FileInputFormat and OutputFormat to mention DT collection.
...
Contributed by Steve Loughran.
2018-10-11 20:01:42 +01:00
Akira Ajisaka
6fa3feb577
HADOOP-15832. Upgrade BouncyCastle to 1.60. Contributed by Robert Kanter.
2018-10-10 10:16:57 +09:00
Akira Ajisaka
5b1cfcaeff
MAPREDUCE-7035. Skip javadoc build for auto-generated sources in hadoop-mapreduce-client. Contributed by Mukul Kumar Singh.
2018-10-09 21:13:04 +09:00
Akira Ajisaka
31fa9bb799
HADOOP-15767. [JDK10] Building native package on JDK10 fails due to missing javah. Contributed by Takanobu Asanuma.
2018-10-03 11:29:18 +09:00
Sunil G
58fa96b697
Changed version in trunk to 3.3.0-SNAPSHOT.
2018-10-02 22:41:41 +05:30
Wangda Tan
230d90c5b9
MAPREDUCE-7125. JobResourceUploader creates LocalFileSystem when it's not necessary. (Peter Cseh via wangda)
...
Change-Id: I1aa720ed03739f6f4abeec46f6068e2ab332987a
2018-09-24 13:52:53 -07:00
Jason Lowe
8382b860d4
MAPREDUCE-7138. ThrottledContainerAllocator in MRAppBenchmark should implement RMHeartbeatHandler. Contributed by Oleksandr Shevchenko
2018-09-18 17:06:32 -05:00
Jason Lowe
34b2237e42
MAPREDUCE-7137. MRAppBenchmark.benchmark1() fails with NullPointerException. Contributed by Oleksandr Shevchenko
2018-09-18 16:56:31 -05:00
Eric E Payne
2cf8927683
MAPREDUCE-3801: org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently. Contributed by Jason Lowe
2018-09-18 20:26:28 +00:00
Jason Lowe
488806baca
MAPREDUCE-7140. Refactoring TaskAttemptInfo to separate Map and Reduce tasks. Contributed by Oleksandr Shevchenko
2018-09-14 15:10:27 -05:00
Jason Lowe
2886024ac3
MAPREDUCE-7133. History Server task attempts REST API returns invalid data. Contributed by Oleksandr Shevchenko
2018-09-13 14:41:38 -05:00
bibinchundatt
8cf6a9a2bd
YARN-7892. Revisit NodeAttribute class structure. Contributed by Naganarasimha G R.
2018-09-12 16:01:00 +05:30
Naganarasimha
5dc7d6e0f3
YARN-8104. Add API to fetch node to attribute mapping. Contributed by Bibin A Chundatt.
2018-09-12 16:01:00 +05:30
Naganarasimha
0a01b1350d
YARN-8100. Support API interface to query cluster attributes and attribute to nodes. Contributed by Bibin A Chundatt.
2018-09-12 16:01:00 +05:30
Jason Lowe
598380ad5a
MAPREDUCE-7136. TestMRAppMetrics should shutdown DefaultMetricsSystem after completion. Contributed by Oleksandr Shevchenko
2018-09-11 13:10:50 -05:00
Jason Lowe
7ce997af97
MAPREDUCE-7135. TestTaskAttemptContainerRequest should reset UserGroupInformation. Contributed by Oleksandr Shevchenko
2018-09-11 11:16:33 -05:00
Jason Lowe
eb0b5a844f
MAPREDUCE-7131. Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate. Contributed by Anthony Hsu
2018-09-06 14:13:29 -05:00
Steve Loughran
5a0babf765
HADOOP-15107. Stabilize/tune S3A committers; review correctness & docs.
...
Contributed by Steve Loughran.
2018-08-30 14:49:53 +01:00
Haibo Chen
84973d1049
MAPREDUCE-6861. Add metrics tags for ShuffleClientMetrics. (Contributed by Zoltan Siegl)
2018-08-27 16:53:06 +02:00
Márton Elek
77b015000a
HADOOP-8807. Update README and website to reflect HADOOP-8662. Contributed by Andras Bokor.
2018-08-17 11:10:29 +02:00
Wangda Tan
b3b4d4ccb5
MAPREDUCE-7118. Distributed cache conflicts breaks backwards compatability. (Jason Lowe via wangda)
...
Change-Id: I89ab4852b4ad305fec19812e8931c59d96581376
2018-07-19 14:26:05 -07:00
Akira Ajisaka
88625f5cd9
HADOOP-15531. Use commons-text instead of commons-lang in some classes to fix deprecation warnings. Contributed by Takanobu Asanuma.
2018-07-13 11:42:12 -04:00
Todd Lipcon
7a3c6e9c3c
HADOOP-15550. Avoid static initialization of ObjectMappers
2018-06-25 15:36:45 -07:00
Miklos Szegedi
ae055622ed
MAPREDUCE-7114. Make FrameworkUploader symlink ignore improvement. Contributed by Gergo Repas.
2018-06-22 13:05:41 -07:00
Miklos Szegedi
d6ee4290df
MAPREDUCE-7113. Typos in test names in TestTaskAttempt: "testAppDiognostic". Contributed by Szilard Nemeth.
2018-06-20 12:04:44 -07:00
Vidura Mudalige
1e94e5977f
MAPREDUCE-7063. Fix log level inconsistency in CombineFileInputFormat.java
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-06-18 14:25:11 -07:00
Arun Suresh
5670e89b2e
MAPREDUCE-7101. Add config parameter to allow JHS to alway scan user dir irrespective of modTime. (Thomas Marquardt via asuresh)
2018-06-12 15:36:52 -07:00
Gera Shegalov
04b74eddc6
MAPREDUCE-7108. TestFileOutputCommitter fails on Windows. (Zuoming Zhang via gera)
2018-06-12 11:21:51 -07:00
Inigo Goiri
0afc036deb
MAPREDUCE-7103. Fix TestHistoryViewerPrinter on windows due to a mismatch line separator. Contributed by Giovanni Matteo Fumarola.
2018-06-05 12:24:57 -07:00
Xiao Chen
6d5e87aec2
HADOOP-15507. Add MapReduce counters about EC bytes read.
2018-06-04 21:13:47 -07:00
Inigo Goiri
dad1bb868f
MAPREDUCE-7105. Fix TestNativeCollectorOnlyHandler.testOnCall on Windows because of the path format. Contributed by Giovanni Matteo Fumarola.
2018-06-04 12:55:54 -07:00
Inigo Goiri
a804b7c9d2
MAPREDUCE-7102. Fix TestJavaSerialization for Windows due a mismatch line separator. Contributed by Giovanni Matteo Fumarola.
2018-06-02 20:25:42 -07:00
Rohith Sharma K S
d5e69d8994
MapReduce JHS should honor yarn.webapp.filter-entity-list-by-user(addendum). Contributed by Sunil Govindan.
2018-06-02 09:27:03 +05:30
Takanobu Asanuma
d1e2b80980
MAPREDUCE-7098. Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-31 18:31:10 +09:00
Rohith Sharma K S
88cbe57c06
MAPREDUCE-7097. MapReduce JHS should honor yarn.webapp.filter-entity-list-by-user. Contributed by Sunil Govindan.
2018-05-28 14:05:49 +05:30
Miklos Szegedi
a2cdffb95a
MAPREDUCE-7094. LocalDistributedCacheManager leaves classloaders open, which leaks FDs. Contributed by Adam Szita.
2018-05-17 11:16:04 -07:00
Haibo Chen
274eee3284
MAPREDUCE-7095. Race conditions in closing FadvisedChunkedFile. (Miklos Szegedi via Haibo Chen)
2018-05-10 10:46:55 -07:00
Robert Kanter
c8b53c4364
YARN-8202. DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation (snemeth via rkanter)
2018-05-10 09:31:59 -07:00
Abhishek Modi
e9159db623
MAPREDUCE-7093. Use assertEquals instead of assertTrue(a == b) in TestMapReduceJobControlWithMocks
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-07 01:15:14 +09:00
Eric Yang
8cdb032aff
YARN-8223. Improved yarn auxiliary service to load jar file from HDFS.
...
Contributed by Zian Chen
2018-05-04 12:36:31 -04:00
Bibin A Chundatt
1a95a4524a
MAPREDUCE-7073. Optimize TokenCache#obtainTokensForNamenodesInternal
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-05-02 16:14:28 +09:00
Jason Lowe
68c6ec719d
MAPREDUCE-7086. Add config to allow FileInputFormat to ignore directories when recursive=false. Contributed by Sergey Shelukhin
2018-05-01 16:19:53 -05:00
Ewan Higgs
84ecfe3ceb
HADOOP-14188. Remove the usage of org.mockito.internal.util.reflection.Whitebox
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-27 19:21:37 +09:00
Sunil G
83e60cd2db
MAPREDUCE-7042. Killed MR job data does not move to mapreduce.jobhistory.done-dir when ATS v2 is enabled. Contributed by Rohith Sharma K S.
2018-04-26 13:54:40 -07:00
Anu Engineer
42e248372c
Revert "HDFS-12515. Ozone: mvn package compilation fails on HDFS-7240. Contributed by Anu Engineer."
...
This fix was need because of change in Trunk. That patch has been reverted and change proposed by this
patch will be applied in trunk. So reverting now to match the changes in trunk. Please see the JIRA for
details.
This reverts commit 244e7a5f65c3611d2091d91a8899ac5785fcff3c.
2018-04-26 05:36:04 -07:00
Anu Engineer
c14e8b17ec
HDFS-12515. Ozone: mvn package compilation fails on HDFS-7240. Contributed by Anu Engineer.
2018-04-26 05:36:04 -07:00
Robert Kanter
1b9ecc264a
MAPREDUCE-7072. mapred job -history prints duplicate counter in human output (wilfreds via rkanter)
2018-04-24 11:30:38 -07:00
Shashikant Banerjee
e4c39f3247
HADOOP-15396. Some java source files are executable
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-04-19 08:35:38 +09:00
Haibo Chen
bb92bfb4ef
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
2018-04-17 11:15:20 -07:00
Haibo Chen
86dfb70875
Revert "YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)"
...
This reverts commit 0c14b6f0d8
.
2018-04-17 06:04:38 -07:00
Haibo Chen
0c14b6f0d8
YARN-7088. Add application launch time to Resource Manager REST API. (Kanwaljeet Sachdev via Haibo Chen)
2018-04-17 05:59:03 -07:00
Wangda Tan
995cba65fe
MAPREDUCE-7077. Pipe mapreduce job fails with Permission denied for jobTokenPassword. (Akira Ajisaka via wangda)
...
Change-Id: Ie8f01425d58409fa3661f768205b7616128c8aa4
(cherry picked from commit 035e0f97ea44b0495707949a781d8792dcf6ea6b)
2018-04-13 13:52:10 -07:00
Erik Krogen
1a407bc990
HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen
2018-04-12 23:27:51 -07:00
Jason Lowe
4571351ccc
MAPREDUCE-7069. Add ability to specify user environment variables individually. Contributed by Jim Brennan
2018-04-12 11:12:46 -05:00
Eric E Payne
6bb128dfb8
YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
2018-04-12 16:04:23 +00:00
Rohith Sharma K S
6cc59a09e7
MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri.
2018-04-11 09:45:39 +05:30
Wangda Tan
6cf023f9b7
Added CHANGES/RELEASES/Jdiff for 3.1.0 release
...
Change-Id: Ied5067a996151c04d15cad46c46ac98b60c37b39
(cherry picked from commit 2d96570452a72569befdf9cfe9b90c9fa2e0e261)
2018-04-05 15:52:39 -07:00
Vrushali C
345e7624d5
YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
2018-04-04 15:08:03 -07:00
Steve Loughran
dde1579096
HADOOP-15146. Remove DataOutputByteBuffer.
...
Contributed by BELUGA BEHR.
2018-04-02 15:52:40 +01:00
Robert Kanter
edb202e493
MAPREDUCE-6441. Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes (wattsinabox, rchiang, haibochen via rkanter)
2018-03-26 14:55:53 -07:00
Takanobu Asanuma
86816da5b4
MAPREDUCE-7066. TestQueue fails on Java9
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-19 09:39:49 +09:00
Jason Lowe
2626ec35e9
MAPREDUCE-7064. Flaky test TestTaskAttempt#testReducerCustomResourceTypes. Contributed by Peter Bacsko
2018-03-14 15:05:24 -05:00
Owen O'Malley
3a8dade9b1
Revert "HADOOP-14077. Add ability to access jmx via proxy. Contributed by Yuanbo Liu."
...
This reverts commit 172b23af33
.
(cherry picked from commit d0d2d4c51e9534e08893ae14cf3fff7b2ee70b1d)
2018-03-09 22:46:30 -08:00
Jason Lowe
32fa3a63e0
MAPREDUCE-6930. mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml. Contributed by Sen Zhao
2018-03-09 10:41:16 -06:00
Takanobu Asanuma
4971276631
HADOOP-15271. Remove unicode multibyte characters from JavaDoc
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-03-05 15:07:58 -08:00
Weiwei Yang
6e6945cd78
MAPREDUCE-7059. Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster. Contributed by Jiandan Yang.
2018-03-01 10:18:53 +08:00
Billie Rinaldi
7dd385098c
MAPREDUCE-7010. Make Job History File Permissions configurable. Contributed by Gergely Novák
2018-02-26 14:32:46 -08:00
Arpit Agarwal
2fa7963c3d
HADOOP-15254. Correct the wrong word spelling 'intialize'. Contributed by fang zhenyi.
2018-02-24 14:41:55 -08:00
Sean Mackrory
2bc3351eaf
HADOOP-6852. apparent bug in concatenated-bzip2 support (decoding). Contributed by Zsolt Venczel.
2018-02-21 12:57:14 -07:00
Jason Lowe
0898ff42e9
HADOOP-15206. BZip2 drops and duplicates records when input split size is small. Contributed by Aki Tanaka
2018-02-16 14:49:00 -06:00
Eric Payne
82f029f7b5
MAPREDUCE-7053: Timed out tasks can fail to produce thread dump. Contributed by Jason Lowe.
2018-02-16 08:15:09 -06:00
Jason Lowe
a53d62ab26
MAPREDUCE-7052. TestFixedLengthInputFormat#testFormatCompressedIn is flaky. Contributed by Peter Bacsko
2018-02-15 15:12:57 -06:00
Jason Lowe
87e2570a14
MAPREDUCE-7048. Uber AM can crash due to unknown task in statusUpdate. Contributed by Peter Bacsko
2018-02-12 13:21:09 -06:00
Wangda Tan
60f9e60b3b
Preparing for 3.2.0 development
...
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
2018-02-11 11:17:38 +08:00
Anu Engineer
4304fcd5bd
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
2018-02-06 13:43:45 -08:00
Eric Payne
5a725bb886
MAPREDUCE-7033: Map outputs implicitly rely on permissive umask for shuffle. Contributed by Jason Lowe
2018-01-31 15:45:30 -06:00
Arun Suresh
38af237969
YARN-6599. Support anti-affinity constraint via AppPlacementAllocator. (Wangda Tan via asuresh)
2018-01-31 01:30:17 -08:00
Takanobu Asanuma
56feaa40bb
MAPREDUCE-7036. ASF License warning in hadoop-mapreduce-client
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-01-30 00:39:39 +09:00
Jason Lowe
6eef3d7f1a
MAPREDUCE-7020. Task timeout in uber mode can crash AM. Contributed by Peter Bacsko
2018-01-26 15:31:43 -06:00
Jason Lowe
a37e7f0ad8
MAPREDUCE-7022. Fast fail rogue jobs based on task scratch dir size. Contributed by Johan Gustavsson
2018-01-26 14:36:45 -06:00
Haibo Chen
cc10852252
MAPREDUCE-7041. MR should not try to clean up at first job attempt. (Gergo Repas via Haibo Chen)
2018-01-25 16:11:30 -08:00
Jason Lowe
cff9edd4b5
MAPREDUCE-7015. Possible race condition in JHS if the job is not loaded. Contributed by Peter Bacsko
2018-01-24 14:44:07 -06:00
Robert Kanter
836643d793
MAPREDUCE-6995. Uploader tool for Distributed Cache Deploy documentation (miklos.szegedi@cloudera.com via rkanter)
2018-01-19 17:57:54 -08:00
Vrushali C
c191538ed1
HADOOP-15166 CLI MiniCluster fails with ClassNotFoundException o.a.h.yarn.server.timelineservice.collector.TimelineCollectorManager. Contributed by Gera Shegalov
2018-01-19 16:15:55 -08:00
Haibo Chen
cce71dceef
MAPREDUCE-6984. MR AM to clean up temporary files from previous attempt in case of no recovery. (Gergo Repas via Haibo Chen)
2018-01-19 12:56:17 -08:00
Jason Lowe
6e42d05829
MAPREDUCE-7029. FileOutputCommitter is slow on filesystems lacking recursive delete. Contributed by Karthik Palaniappan
2018-01-17 08:14:11 -06:00
Robert Kanter
d716084f45
MAPREDUCE-7032. Add the ability to specify a delayed replication count (miklos.szegedi@cloudera.com via rkanter)
2018-01-16 10:45:45 -08:00
Takanobu Asanuma
1a9c5d479e
MAPREDUCE-7034. Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2018-01-15 15:38:03 +09:00
Robert Kanter
e404650f48
MAPREDUCE-7030. Uploader tool should ignore symlinks to the same directory (miklos.szegedi@cloudera.com via rkanter)
2018-01-12 14:18:01 -08:00
Jason Lowe
fe35103591
MAPREDUCE-7028. Concurrent task progress updates causing NPE in Application Master. Contributed by Gergo Repas
2018-01-03 11:01:38 -06:00
Junping Du
a7f8caf58e
Add 2.8.3 release jdiff files.
...
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
2017-12-18 22:39:01 -08:00
Chen Liang
c7a4dda3c5
HADOOP-15109. TestDFSIO -read -random doesn't work on file sized 4GB. Contributed by Ajay Kumar.
2017-12-18 13:25:47 -08:00
Robert Kanter
2316f52690
MAPREDUCE-7018. Apply erasure coding properly to framework tarball and support plain tar (miklos.szegedi@cloudera.com via rkanter)
2017-12-11 14:00:42 -08:00
Akira Ajisaka
c2e8a5c229
MAPREDUCE-7000. Moving logging APIs over to slf4j in hadoop-mapreduce-client-nativetask. Contributed by Jinjiang Ling.
2017-12-07 16:27:08 +09:00
Akira Ajisaka
d4cae977a2
MAPREDUCE-6998. Moving logging APIs over to slf4j in hadoop-mapreduce-client-jobclient. Contributed by Gergely Novák.
2017-12-07 16:21:25 +09:00
Arpit Agarwal
e00c7f78c1
HADOOP-14976. Set HADOOP_SHELL_EXECNAME explicitly in scripts.
2017-12-04 21:02:04 -08:00
Robert Kanter
3b78607a02
MAPREDUCE-6994. Uploader tool for Distributed Cache Deploy code changes (miklos.szegedi@cloudera.com via rkanter)
2017-12-01 12:12:15 -08:00
Jason Lowe
21d3627355
MAPREDUCE-5124. AM lacks flow control for task events. Contributed by Peter Bacsko
2017-12-01 14:04:25 -06:00
Rohith Sharma K S
3cd75845da
MAPREDUCE-7014. Fix java doc errors in jdk1.8. Contributed by Steve Loughran.
2017-11-27 22:01:00 +05:30
Steve Loughran
de8b6ca5ef
HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints.
...
Contributed by Steve Loughran and Ryan Blue.
2017-11-22 15:28:12 +00:00
Chris Douglas
782ba3bf9d
MAPREDUCE-7011. TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec
2017-11-21 20:42:28 -08:00
Arun Suresh
5eb7dbe9b3
Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
2017-11-09 15:15:51 -08:00
Akira Ajisaka
e4c220ee4f
MAPREDUCE-7001. Moving logging APIs over to slf4j in hadoop-mapreduce-client-shuffle. Contributed by Jinjiang Ling.
2017-11-08 19:28:08 +09:00
Akira Ajisaka
ffee10b68e
MAPREDUCE-6997. Moving logging APIs over to slf4j in hadoop-mapreduce-client-hs. Contributed by Gergely Novák.
2017-11-08 19:21:43 +09:00
Naganarasimha
61bbdc511e
MAPREDUCE-6975. Logging task counters. Contributed by Prabhu Joseph.
2017-11-06 12:58:38 +05:30
Xiao Chen
e565b5277d
HDFS-12682. ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED.
2017-11-02 21:27:35 -07:00
Akira Ajisaka
178751ed8c
MAPREDUCE-6983. Moving logging APIs over to slf4j in hadoop-mapreduce-client-core. Contributed by Jinjiang Ling.
2017-11-02 17:43:08 +09:00
Jason Lowe
2fae63aa60
HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
2017-10-31 09:30:13 -05:00
Daniel Templeton
9a7e810838
YARN-6927. Add support for individual resource types requests in MapReduce
...
(Contributed by Gergo Repas via Daniel Templeton)
2017-10-30 11:04:22 -07:00
Jason Lowe
665bb147aa
YARN-7244. ShuffleHandler is not aware of disks that are added. Contributed by Kuhu Shukla
2017-10-27 16:56:05 -05:00
Steve Loughran
de09716fb8
MAPREDUCE-6977 Move logging APIs over to slf4j in hadoop-mapreduce-client-common.
...
Contributed by Jinjiang Ling.
2017-10-27 10:45:03 +01:00
Junping Du
a25b5aa0cf
Add several jdiff xml files for 2.8.2 release.
2017-10-26 19:30:48 -07:00
Akira Ajisaka
2523e1cce5
MAPREDUCE-6972. Enable try-with-resources for RecordReader. Contributed by Zoltan Haindrich.
2017-10-18 11:18:39 +09:00
Chris Trezzo
e46d5bb962
MAPREDUCE-5951. Add support for the YARN Shared Cache.
2017-10-12 10:59:20 -07:00
Rohith Sharma K S
639f98cc9d
MAPREDUCE-6951. Improve exception message when mapreduce.jobhistory.webapp.address is in wrong format. Contributed by Prabhu Joseph.
2017-10-11 14:27:38 +05:30
Akira Ajisaka
453d48bdfb
MAPREDUCE-6971. Moving logging APIs over to slf4j in hadoop-mapreduce-client-app. Contributed by Jinjiang Ling.
2017-10-03 12:14:54 +09:00
Jason Lowe
9df05005ac
MAPREDUCE-6968. Staging directory erasure coding config property has a typo. Contributed by Jason Lowe
2017-09-26 14:52:27 -05:00
Jason Lowe
908d8e914e
MAPREDUCE-6965. QuasiMonteCarlo should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari
2017-09-22 09:34:53 -05:00
Akira Ajisaka
c71d137960
MAPREDUCE-6966. DistSum should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari.
2017-09-22 15:07:59 +09:00
Akira Ajisaka
53be075241
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergely Novák.
2017-09-22 13:27:59 +09:00
Jason Lowe
b9db0afa1e
MAPREDUCE-6964. BaileyBorweinPlouffe should use Time.monotonicNow for measuring durations. Contributed by Chetna Chaudhari
2017-09-21 09:37:19 -05:00
Akira Ajisaka
53047f934e
Revert "MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák."
...
This reverts commit 2018538fdb
.
2017-09-21 11:16:05 +09:00
Andrew Wang
51edaacd09
HDFS-12445. Correct spellings of choosen to chosen. Contributed by hu xiaodong.
2017-09-19 13:48:23 -07:00
Eric Payne
595d478408
MAPREDUCE-6960. Shuffle Handler prints disk error stack traces for every read failure.
2017-09-19 10:35:15 -05:00
Jason Lowe
3a20debdde
MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe
2017-09-19 09:13:17 -05:00
Jason Lowe
ea845ba58c
Revert "MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe"
...
This reverts commit b3d61304f2
.
2017-09-19 08:45:05 -05:00
Akira Ajisaka
2018538fdb
MAPREDUCE-6947. Moving logging APIs over to slf4j in hadoop-mapreduce-examples. Contributed by Gergery Novák.
2017-09-19 11:05:54 +09:00
Andrew Wang
3cf3540f19
HADOOP-14835. mvn site build throws SAX errors. Contributed by Andrew Wang and Sean Mackrory.
2017-09-18 15:13:42 -07:00
Jason Lowe
b3d61304f2
MAPREDUCE-6958. Shuffle audit logger should log size of shuffle transfer. Contributed by Jason Lowe
2017-09-18 17:04:43 -05:00
Robert Kanter
0adc0471d0
MAPREDUCE-6954. Disable erasure coding for files that are uploaded to the MR staging area (pbacsko via rkanter)
2017-09-18 10:40:06 -07:00
Robert Kanter
5f496683fb
Revert "YARN-7162. Remove XML excludes file format (rkanter)" - wrong commit message
...
This reverts commit 3a8d57a0a2
.
2017-09-18 10:32:08 -07:00
Robert Kanter
3a8d57a0a2
YARN-7162. Remove XML excludes file format (rkanter)
2017-09-15 12:00:26 -07:00
Steve Loughran
11390c2d11
MAPREDUCE-6956 FileOutputCommitter to gain abstract superclass PathOutputCommitter.
...
Contributed by Steve Loughran
2017-09-15 16:59:04 +01:00
Andrew Wang
c3f35c422b
HADOOP-14089. Automated checking for malformed client. Contributed by Sean Busbey.
2017-09-13 16:57:50 -07:00
Jason Lowe
4d98936eec
MAPREDUCE-6957. shuffle hangs after a node manager connection timeout. Contributed by Jooseong Kim
2017-09-13 17:21:13 -05:00
Ray Chiang
556812c179
HADOOP-14799. Update nimbus-jose-jwt to 4.41.1. (rchiang)
2017-09-12 10:19:34 -07:00
Wangda Tan
df3855541a
YARN-6789. Add Client API to get all supported resource types from RM. (Sunil G via wangda)
...
Change-Id: I366d8db6f6700acd087db5acb7a1be7e41b2b68d
2017-09-12 09:19:12 -07:00
Varun Vasudev
c2032e251e
YARN-5708. Implement APIs to get resource profiles from the RM. Contributed by Varun Vasudev.
2017-09-12 09:19:10 -07:00
Robert Kanter
a323f73bae
MAPREDUCE-6953. Skip the testcase testJobWithChangePriority if FairScheduler is used (pbacsko via rkanter)
2017-09-08 13:14:36 -07:00
Anu Engineer
c35510a465
HADOOP-14849. some wrong spelling words update. Contributed by Chen Hongfei.
2017-09-08 10:02:34 -07:00
Andrew Wang
0d419c984f
Preparing for 3.1.0 development
2017-09-01 11:53:48 -07:00
Allen Wittenauer
190410085b
HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build
...
Signed-off-by: Andrew Wang <wang@apache.org>
2017-08-31 19:06:49 -07:00
Allen Wittenauer
71bbb86d69
HADOOP-14670. Increase minimum cmake version for all platforms
...
Signed-off-by: Chris Douglas <cdouglas@apache.org>
2017-08-30 21:47:24 -07:00
Konstantin V Shvachko
3e0e2033cc
MAPREDUCE-6931. Remove TestDFSIO "Total Throughput" calculation. Contributed by Dennis Huo.
2017-08-30 14:07:23 -07:00
Haibo Chen
d04f85f387
MAPREDUCE-6892. Issues with the count of failed/killed tasks in the jhist file. (Peter Bacsko via Haibo Chen)
2017-08-30 10:07:48 -07:00
Varun Saxena
3d00c8f394
Made fixes for whitespace errors and checstyle warnings before merge.
2017-08-30 11:29:54 +05:30
Jian He
08f40bcc7f
MAPREDUCE-6838. [ATSv2 Security] Add timeline delegation token received in allocate response to UGI. Contributed by Varun Saxena
2017-08-30 11:29:54 +05:30
Rohith Sharma K S
7594d1de7b
YARN-6130. [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM. Contributed by Varun Saxena.
2017-08-30 11:29:53 +05:30
Sangjin Lee
684de1a902
YARN-4675. Reorganize TimelineClient and TimelineClientImpl into separate classes for ATSv1.x and ATSv2. Contributed by Naganarasimha G R.
2017-08-30 11:29:52 +05:30
Sangjin Lee
8499299740
MAPREDUCE-6818. Remove direct reference to TimelineClientImpl. Contributed by Li Lu.
2017-08-30 11:29:51 +05:30
Sangjin Lee
092fead5d9
YARN-5792. Adopt the id prefix for YARN, MR, and DS entities. Contributed by Varun Saxena.
2017-08-30 11:29:51 +05:30
Mingliang Liu
ae7abad3d9
MAPREDUCE-6945. TestMapFileOutputFormat missing @after annotation. Contributed by Ajay Kumar
2017-08-27 15:19:55 -07:00
Arpit Agarwal
8b7cbe3840
HADOOP-14729. Upgrade JUnit 3 test cases to JUnit 4. Contributed by Ajay Kumar.
2017-08-25 09:55:46 -07:00
Andrew Wang
dd7916d3cd
HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas.
2017-08-17 09:35:36 -07:00
Robert Kanter
ab051bd42e
MAPREDUCE-6936. Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-common (haibochen via rkanter)
2017-08-16 16:14:04 -07:00
Jason Lowe
0acc5e0036
MAPREDUCE-6940. Copy-paste error in the TaskAttemptUnsuccessfulCompletionEvent constructor. Contributed by Oleg Danilov
2017-08-16 16:34:06 -05:00
Chris Douglas
645a8f2a4d
HADOOP-14726. Mark FileStatus::isDir as final
2017-08-14 21:57:20 -07:00
Lei Xu
ce797a1706
HDFS-12221. Replace xcerces in XmlEditsVisitor. (Ajay Kumar via lei)
2017-08-14 10:27:47 -07:00
Allen Wittenauer
4222c97108
HADOOP-10392. Use FileSystem#makeQualified(Path) instead of Path#makeQualified(FileSystem) (ajisakaa via aw)
2017-08-11 09:25:56 -07:00
Haibo Chen
a32e0138fb
MAPREDUCE-6870. Add configuration for MR job to finish when all reducers are complete. (Peter Bacsko via Haibo Chen)
2017-08-10 15:17:36 -07:00
Ravi Prakash
ac7d0604bc
MAPREDUCE-6923. Optimize MapReduce Shuffle I/O for small partitions. Contributed by Robert Schmidtke.
2017-08-09 15:39:52 -07:00
Jason Lowe
735fce5bec
MAPREDUCE-6927. MR job should only set tracking url if history was successfully written. Contributed by Eric Badger
2017-08-08 14:46:47 -05:00
Arun Suresh
35dc782923
YARN-5977. ContainerManagementProtocol changes to support change of container ExecutionType. (Kartheek Muthyala via asuresh)
2017-08-03 21:15:40 -07:00
Yufei Gu
b8e8241854
MAPREDUCE-6914. Tests use assertTrue(....equals(...)) instead of assertEquals()). (Daniel Templeton via Yufei Gu)
2017-08-03 11:44:34 -07:00
Sean Mackrory
1a1bf6b7d0
HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.
2017-08-02 12:25:05 -06:00
Akira Ajisaka
ceacadc51e
MAPREDUCE-6921. TestUmbilicalProtocolWithJobToken#testJobTokenRpc fails.
2017-08-01 14:56:42 +09:00
Junping Du
fbb7d6bcbb
Revert "MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)"
...
This reverts commit e8a31f2e1c
.
2017-07-31 14:09:16 -07:00
Junping Du
713349a9af
Revert "MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)"
...
This reverts commit 390a7c12f5
.
2017-07-28 14:21:04 -07:00
Junping Du
e15f928295
Revert "MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu."
...
This reverts commit 433542904a
.
2017-07-28 14:06:59 -07:00
Akira Ajisaka
38c6fa5c7a
HADOOP-11875. [JDK9] Adding a second copy of Hamlet without _ as a one-character identifier.
2017-07-28 09:10:52 +09:00
Varun Saxena
f66fd11e51
YARN-5548. Use MockRMMemoryStateStore to reduce test failures (Bibin A Chundatt via Varun Saxena)
2017-07-27 23:14:50 +05:30
Akira Ajisaka
cca51e916b
HADOOP-14681. Remove MockitoMaker class. Contributed by Andras Bokor.
2017-07-25 15:24:56 +09:00