big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13,130 Commits 2 Branches 2 Tags 264 MiB
f84af8bd58
Commit Graph

2325 Commits

Author SHA1 Message Date
Jason Lowe
e5df366707 Add MR-5982 and MR-6492 to 2.6.4 2016-01-11 18:31:10 +00:00
Junping Du
8c1adeaa26 MAPREDUCE-6068. Illegal progress value warnings in map tasks. Contributed by Binglin Chang. 2016-01-11 06:12:19 -08:00
Sangjin Lee
355c0ce723 MAPREDUCE-6577 addendum. Moved the changelog to 2.6.4 which is the earliest target. 2016-01-05 15:43:10 -08:00
Sangjin Lee
f6f16118d3 MAPREDUCE-6577. MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set (sjlee) 2016-01-05 15:22:50 -08:00
Akira Ajisaka
7dafee11d8 MAPREDUCE-6593. TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE. Contributed by Naganarasimha G R. 2016-01-04 16:30:55 +09:00
Akira Ajisaka
db99e30f67 Set release date for 2.6.3 2016-01-04 16:12:12 +09:00
Akira Ajisaka
2a59d01503 MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka) 2015-12-30 01:33:47 +09:00
Akira Ajisaka
bee542817d MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka) 2015-12-30 01:03:12 +09:00
Wangda Tan
32b3dc11eb MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda) 2015-12-28 11:03:23 -08:00
Rohith Sharma K S
a308e86621 MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks) 2015-12-24 11:55:42 +05:30
Akira Ajisaka
7995a6ea4d MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki. 2015-12-21 00:16:14 +09:00
Jian He
85c2466048 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2015-12-18 14:13:48 -08:00
Xuan
d4e766de93 MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev 2015-12-16 15:26:03 -08:00
Vinod Kumar Vavilapalli
60fe6d53d9 Revert "MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev" 
This reverts commit fc470840a0.
 2015-12-16 15:11:38 -08:00
Zhihai Xu
7092d47fc0 Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE 2015-12-15 21:43:19 -08:00
Zhihai Xu
5b7078d069 MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki 2015-12-15 00:58:23 -08:00
Xuan
fc470840a0 MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev 2015-12-07 14:15:14 -08:00
Steve Loughran
65f395226b HADOOP-12321. Make JvmPauseMonitor an AbstractService. (Sunil G via Stevel) [includes HDFS-8947 MAPREDUCE-6462 and YARN-4072] 2015-12-06 17:43:35 +00:00
Jian He
9f77ccad73 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999). Contributed by Mohammad Shahid Khan and Varun Saxena 2015-12-03 12:48:50 -08:00
Junping Du
028894281b Creating 2.6.4 entries in CHANGES.txt files. 2015-12-01 08:16:39 -08:00
Jason Lowe
43acf9ab8e Update CHANGES.txt for commit of MR-6549 to branch-2.7 and branch-2.6. 2015-11-30 17:54:39 +00:00
cnauroth
c37c3f41b3 Revert "HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw)" 
This reverts commit 6725e7f1be.
 2015-11-28 17:21:11 -08:00
Allen Wittenauer
6725e7f1be HADOOP-11505. Various native parts use bswap incorrectly and unportably (Alan Burlison via aw) 2015-11-27 18:25:45 -08:00
Vinod Kumar Vavilapalli
d57fd181c7 Adding release 2.8.0 to CHANGES.txt 2015-11-25 17:33:26 -08:00
Robert Kanter
6d84cc16b3 MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter) 2015-11-25 17:12:40 -08:00
Robert Kanter
7fd00b3db4 MAPREDUCE-6549. multibyte delimiters with LineRecordReader cause duplicate records (wilfreds via rkanter) 2015-11-25 17:03:38 -08:00
Junping Du
15d577bfbb Tests in mapreduce-client-app are writing outside of target. Contributed by Akira AJISAKA. 2015-11-25 09:15:26 -08:00
Tsuyoshi Ozawa
3e85542a7a MAPREDUCE-6555. TestMRAppMaster fails on trunk. (Junping Du via ozawa) 2015-11-26 01:02:27 +09:00
Akira Ajisaka
177975e962 Fix indents in the 2.8.0 section of MapReduce CHANGES.txt. 2015-11-25 16:42:22 +09:00
Akira Ajisaka
5ec44fc35c MAPREDUCE-6553. Replace '\u2b05' with '<-' in rendering job configuration. Contributed by Gabor Liptak. 2015-11-25 16:30:23 +09:00
Jason Lowe
f634505d48 MAPREDUCE-5870. Support for passing Job priority through Application Submission Context in Mapreduce Side. Contributed by Sunil G 2015-11-24 22:07:26 +00:00
Jason Lowe
cab3c7c889 MAPREDUCE-5883. "Total megabyte-seconds" in job counters is slightly misleading. Contributed by Nathan Roberts 2015-11-24 22:01:03 +00:00
Jian He
8676a118a1 YARN-4349. Support CallerContext in YARN. Contributed by Wangda Tan 2015-11-23 17:19:48 -08:00
Haohui Mai
4bff073b4d Revert "HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling." 
This reverts commit 4c061e607e.
 2015-11-23 15:00:56 -08:00
Jason Lowe
aa2009c37b Update CHANGES.txt for recent commits to branch-2.6. 2015-11-23 21:57:18 +00:00
Haohui Mai
000e12f6fa HDFS-9153. Pretty-format the output for DFSIO. Contributed by Kai Zheng. 2015-11-22 16:18:07 -08:00
Haohui Mai
4c061e607e HADOOP-12572. Update Hadoop's lz4 to r131. Contributed by Kevin Bowling. 2015-11-22 15:18:24 -08:00
Jason Lowe
be9f3bba73 Update CHANGES.txt to reflect commit of MR-6377 to branch-2.7 and branch-2.6. 2015-11-18 17:20:15 +00:00
Akira Ajisaka
a7f776ffdf MAPREDUCE-6499. Add elapsed time for retired job in JobHistoryServer WebUI. Contributed by Lin Yiqun. 2015-11-17 15:16:47 +09:00
Jian He
fcd7888029 Revert "YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan" 
This reverts commit 8fbea531d7.

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-11-16 20:18:44 -08:00
Jian He
6502d59e73 MAPREDUCE-5485. Allow repeating job commit by extending OutputCommitter API. Contributed by Junping Du 2015-11-16 17:06:41 -08:00
Sangjin Lee
9ad708a0df MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee) 2015-11-11 15:37:24 -08:00
Jason Lowe
df68eac825 MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li 2015-11-11 17:26:16 +00:00
Jian He
8fbea531d7 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan 2015-11-09 10:43:45 -08:00
Tsuyoshi Ozawa
668e897538 MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA. 2015-11-09 15:25:31 +09:00
Allen Wittenauer
b76b0ce51e HADOOP-12366. expose calculated paths (aw) 2015-11-07 08:32:56 -08:00
Allen Wittenauer
19a0c2660c MAPREDUCE-1125. SerialUtils.cc: deserializeFloat is out of sync with SerialUtils.hh (Simone Leo via aw) 2015-11-05 16:57:22 -08:00
Allen Wittenauer
fc7cd46faf MAPREDUCE-3914. Mismatched free() / delete / delete [] in HadoopPipes (Joe Mudd via aw) 2015-11-05 16:53:32 -08:00
Jason Lowe
0383a3973b Add 2.7.3 release to CHANGES.txt 2015-11-04 16:26:14 +00:00
Varun Vasudev
73b9c7b82b HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer. 2015-11-04 15:56:17 +05:30
Akira Ajisaka
04d97f8abb MAPREDUCE-6525. Fix test failure of TestMiniMRClientCluster.testRestart. Contributed by Masatake Iwasaki. 2015-11-03 01:50:07 +09:00
Sangjin Lee
a4a6b5b4b4 Updated the 2.6.2 final release date. 2015-10-30 18:47:16 -07:00
Kihwal Lee
2868ca0328 MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla. 2015-10-30 14:56:41 -05:00
Jason Lowe
6344b6a769 MAPREDUCE-6528. Memory leak for HistoryFileManager.getJobSummary(). Contributed by Junping Du 2015-10-30 15:31:38 +00:00
Jason Lowe
6ae9efaf59 Update CHANGES.txt to reflect commit of MR-6273 to branch-2.6 2015-10-30 15:18:53 +00:00
Jason Lowe
eadf7b3096 Creating 2.6.3 entries in CHANGES.txt files. 2015-10-30 14:50:50 +00:00
Tsuyoshi Ozawa
ce31b22739 YARN-4320. TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188. Contributed by Varun Saxena. 2015-10-30 18:00:20 +09:00
Xuan
7412ff48ee YARN-4313. Race condition in MiniMRYarnCluster when getting history 
server address. Contributed by Jian He
 2015-10-29 17:36:36 -07:00
Jason Lowe
ecad1253b7 Update CHANGES.txt to reflect commit of MR-6273 to branch-2.7 2015-10-29 18:32:25 +00:00
Jason Lowe
cf953b6258 MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G 2015-10-29 18:05:01 +00:00
Sangjin Lee
b0c818b60d Set the release date for 2.6.2 2015-10-28 20:43:35 -07:00
Allen Wittenauer
68ce93c32e MAPREDUCE-6435. MapReduce client assumes the world is x86 (Alan Burlison via aw) 2015-10-27 12:29:41 -07:00
Allen Wittenauer
5c24fe7f91 MAPREDUCE-6416. Not all platforms have d_type in struct dirent (Alan Burlison via aw) 2015-10-27 12:22:08 -07:00
Allen Wittenauer
ab99d953e4 MAPREDUCE-6412. Make hadoop-mapreduce-client Native code -Wall-clean (Alan Burlison via aw) 2015-10-27 12:15:11 -07:00
Allen Wittenauer
0e344902aa fix changes.txt for MAPREDUCE-6391. 2015-10-27 12:07:18 -07:00
Allen Wittenauer
bcc4c746a8 MAPREDUCE-6391. util/Timer.cc completely misunderstands _POSIX_CPUTIME (Alan Burlison via aw) 2015-10-27 12:04:55 -07:00
Tsuyoshi Ozawa
96677bef00 YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula. 2015-10-27 12:35:01 +09:00
Junping Du
eb6379ca25 MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA 2015-10-23 10:05:46 -07:00
Jason Lowe
ee9b80acf8 MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li 2015-10-21 21:44:43 +00:00
Jason Lowe
cb26cd4bee MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh 2015-10-21 14:01:23 +00:00
Robert Kanter
0c4af0f998 MAPREDUCE-6495. Docs for archive-logs tool (rkanter) 2015-10-20 17:34:34 -07:00
Sangjin Lee
58590fef49 YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee) 2015-10-16 16:53:20 -07:00
Haohui Mai
da8441d0fe HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu. 2015-10-13 15:24:24 -07:00
Karthik Kambatla
4aa9b3e75c MAPREDUCE-6302. Incorrect headroom can lead to a deadlock between map and reduce allocations. (kasha) 2015-10-09 07:37:39 -07:00
Jason Lowe
a0bca2b5ad YARN-261. Ability to fail AM attempts. Contributed by Andrey Klochkov and Rohith Sharma K S 2015-10-09 14:17:38 +00:00
Akira Ajisaka
584cf3bb35 MAPREDUCE-6479. Add missing mapred job command options in mapreduce document. Contributed by nijel. 2015-10-09 10:54:12 +09:00
Robert Kanter
1bca1bb517 MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter) 2015-10-06 16:49:50 -07:00
Xuan
8f08532bde YARN-1897. CLI and core support for signal container functionality. Contributed by Ming Ma 2015-10-02 18:50:47 -07:00
rohithsharmaks
439f43ad3d MAPREDUCE-6485. Create a new task attempt with failed map task priority if in-progress attempts are unassigned. (Xianyin Xin via rohithsharmaks) 2015-10-02 20:34:34 +05:30
Akira Ajisaka
195793c6f3 MAPREDUCE-6497. Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler. Contributed by Shinichi Yamashita. 2015-10-01 10:22:45 +02:00
Robert Kanter
5db371f52f MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter) 2015-09-30 17:33:53 -07:00
Jason Lowe
ab11085b81 MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt 2015-09-28 22:12:03 +00:00
Harsh J
66dad854c0 MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian. 2015-09-28 13:12:43 +05:30
Robert Kanter
d3c49e7662 MAPREDUCE-6480. archive-logs tool may miss applications (rkanter) 2015-09-25 15:02:42 -07:00
Zhihai Xu
97a08807ec MAPREDUCE-6484. Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Contributed by Zhihai Xu 2015-09-24 08:12:07 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
1f707ecffd Release process for 2.6.1: Set the release date for 2.6.1 2015-09-23 15:10:50 -07:00
Jian He
89cab1ba5f YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan 2015-09-23 13:29:38 -07:00
Jian He
83a18add10 YARN-1449. AM-NM protocol changes to support container resizing. Contributed by Meng Ding & Wangda Tan) 2015-09-23 13:29:36 -07:00
Jian He
dfe2cb849f YARN-3866. AM-RM protocol changes to support container resizing. Contributed by Meng Ding 2015-09-23 13:29:36 -07:00
Harsh J
cc2b473990 MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian. 2015-09-22 21:38:06 +05:30
Tsuyoshi Ozawa
dfd807afab HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang. 2015-09-22 12:54:29 +09:00
Zhihai Xu
e3ace31e2b MAPREDUCE-6460. TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails. Contributed by Zhihai Xu. 2015-09-19 00:10:06 -07:00
Haohui Mai
602335dfe6 MAPREDUCE-6483. Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials. Contributed by Mingliang Liu. 2015-09-18 13:36:09 -07:00
Jason Lowe
f97dc034fe Update CHANGES.txt to reflect commit of MR-5982 to 2.7.2 2015-09-18 19:24:10 +00:00
Wangda Tan
372ad270a0 MAPREDUCE-6478. Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob. (Junping Du via wangda) 2015-09-18 10:10:32 -07:00
Jason Lowe
288c8854a6 Update CHANGES.txt to reflect LineRecordReader fixes committed to 2.7.2 2015-09-18 15:14:18 +00:00
Jason Lowe
ee4ee6af6a MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li 2015-09-17 21:37:39 +00:00
Jason Lowe
3f82f582e5 MAPREDUCE-5002. AM could potentially allocate a reduce container to a map attempt. Contributed by Chang Li 2015-09-17 18:17:29 +00:00
Jason Lowe
58d1a02b8d MAPREDUCE-6481. LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Contributed by Zhihai Xu 2015-09-17 14:30:18 +00:00
Haohui Mai
941001bfa6 MAPREDUCE-6477. Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem. Contributed by Mingliang Liu. 2015-09-16 13:06:26 -07:00