big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
12,407 Commits 2 Branches 2 Tags 264 MiB
8676a118a1
Commit Graph

478 Commits

Author SHA1 Message Date
Jian He
8676a118a1 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan 2015-11-23 17:19:48 -08:00
Jian He
fcd7888029 Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan" 
This reverts commit 8fbea531d7.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-11-16 20:18:44 -08:00
Jian He
6502d59e73 MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du 2015-11-16 17:06:41 -08:00
Jian He
8fbea531d7 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan 2015-11-09 10:43:45 -08:00
Jason Lowe
cf953b6258 MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G 2015-10-29 18:05:01 +00:00
Karthik Kambatla
4aa9b3e75c MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 2015-10-09 07:37:39 -07:00
rohithsharmaks
439f43ad3d MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks) 2015-10-02 20:34:34 +05:30
Akira Ajisaka
195793c6f3 MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita. 2015-10-01 10:22:45 +02:00
Jason Lowe
ab11085b81 MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt 2015-09-28 22:12:03 +00:00
Tsuyoshi Ozawa
dfd807afab HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 2015-09-22 12:54:29 +09:00
Jason Lowe
ee4ee6af6a MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li 2015-09-17 21:37:39 +00:00
Jason Lowe
3f82f582e5 MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li 2015-09-17 18:17:29 +00:00
Karthik Kambatla
8dfec7a197 MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha) 2015-08-15 00:52:11 -07:00
Karthik Kambatla
27d24f96ab MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) 2015-08-14 12:29:50 -07:00
Zhihai Xu
93d50b7824 MAPREDUCE-6433. launchTime may be negative. Contributed by Zhihai Xu 2015-07-30 23:07:31 -07:00
Allen Wittenauer
cf74772064 MAPREDUCE-5801. Uber mode's log message is missing a vcore reason (Steven Wong via aw) 2015-07-21 10:58:52 -07:00
Chris Douglas
f4ccdb11dc MAPREDUCE-6427. Fix typo in JobHistoryEventHandler. Contributed by Ray Chiang 2015-07-14 14:55:43 -07:00
Akira Ajisaka
19295b36d9 YARN-3381. Fix typo InvalidStateTransitonException. Contributed by Brahma Reddy Battula. 2015-07-13 17:52:13 +09:00
Jason Lowe
eac1d18943 MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li 2015-07-01 18:01:22 +00:00
Jason Lowe
826715622e MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li 2015-07-01 17:50:02 +00:00
Jason Lowe
2ac87df578 MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang 2015-07-01 16:00:03 +00:00
Jason Lowe
b6ba56457c MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li 2015-06-30 21:22:30 +00:00
Gera Shegalov
11ac848207 MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera) 2015-06-22 14:40:32 -07:00
Gera Shegalov
63d40d5286 MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera) 2015-06-20 11:38:21 -07:00
Devaraj K
311a4179cc MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by 
Siqi Li and Gera Shegalov.
 2015-06-20 10:35:04 +05:30
Gera Shegalov
10107243be MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera) 2015-06-19 02:22:59 -07:00
Devaraj K
6785661e55 MAPREDUCE-6350. JobHistory doesn't support fully-functional search. 
Contributed by Siqi Li.
 2015-06-10 12:40:29 +05:30
cnauroth
4102e5882e YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch. 2015-05-27 14:31:49 -07:00
Wangda Tan
3164e7d838 MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda) 2015-05-27 14:26:03 -07:00
Tsuyoshi Ozawa
022f49d59e MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi. 2015-05-26 23:59:02 +09:00
Vinod Kumar Vavilapalli
6b710a42e0 Fixing MR intermediate spills. Contributed by Arun Suresh. 2015-05-14 16:07:56 -07:00
Devaraj K
05ff54c66c MAPREDUCE-5708. Duplicate String.format in 
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.
 2015-05-14 22:09:54 +05:30
Jason Lowe
444836b3dc MAPREDUCE-5465. Tasks are often killed before they exit on their own. Contributed by Ming Ma 2015-05-11 22:37:35 +00:00
Karthik Kambatla
1773aac780 MAPREDUCE-6353. Divide by zero error in MR AM when calculating available containers. (Anubhav Dhoot via kasha) 2015-05-09 14:43:18 -07:00
Junping Du
df36ad0a08 MAPREDUCE-6359. In RM HA setup, Cluster tab links populated with AM hostname instead of RM. Contributed by zhaoyunjiong. 2015-05-09 06:11:13 -07:00
Akira Ajisaka
ecfa052274 MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. Contributed by Tsuyoshi Ozawa. 2015-05-08 18:16:58 +09:00
Tsuyoshi Ozawa
d18f10ad1b MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi. 2015-05-08 15:59:46 +09:00
Jason Lowe
f30065c8b6 MAPREDUCE-6279. AM should explicity exit JVM after all services have stopped. Contributed by Eric Payne 2015-05-07 22:05:12 +00:00
Xuan
b7dd3a4f04 YARN-2123. Progress bars in Web UI always at 100% due to non-US locale. 
Contributed by Akira AJISAKA
 2015-05-05 10:40:16 -07:00
Jason Lowe
bf70c5ae28 MAPREDUCE-6259. IllegalArgumentException due to missing job submit time. Contributed by zhihai xu 2015-05-04 20:39:18 +00:00
Devaraj K
f5b38477f9 MAPREDUCE-6339. Job history file is not flushed correctly because 
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.
 2015-04-30 12:33:22 +05:30
Vinod Kumar Vavilapalli
9fc32c5c4d MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe. 2015-04-27 14:58:16 -07:00
Gera Shegalov
725eb52ddc MAPREDUCE-6293. Set job classloader on uber-job's LocalContainerLauncher event thread. (Sangjin Lee via gera) 2015-04-21 13:57:22 -07:00
Akira Ajisaka
1fa8075794 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. 2015-04-16 10:04:09 -05:00
Akira Ajisaka
2c17da4208 Revert "MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li." 
This reverts commit 6ac98b4804.
 2015-04-11 12:37:12 +09:00
Akira Ajisaka
6ac98b4804 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. 2015-04-11 01:31:31 +09:00
Jason Lowe
30da99cbaf MAPREDUCE-6277. Job can post multiple history files if attempt loses connection to the RM. Contributed by Chang Li 2015-03-18 19:30:37 +00:00
Tsuyoshi Ozawa
9d38520c8e MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers. Contributed by Zhihai Xu 2015-03-14 16:44:02 +09:00
Tsuyoshi Ozawa
348208014b MAPREDUCE-6136. MRAppMaster doesn't shutdown file systems. Contributed by Brahma Reddy Battula. 2015-03-05 14:12:47 +09:00
Junping Du
4228de9402 MAPREDUCE-5583. Ability to limit running map and reduce tasks. Contributed by Jason Lowe. 2015-03-03 02:02:28 -08:00