big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,266 Commits 2 Branches 2 Tags 264 MiB
fc6182d5ed
Commit Graph

1390 Commits

Author SHA1 Message Date
Chris Douglas
7e2fe8c9f2 MAPREDUCE-6038. A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial. Contributed by Tsuyoshi Ozawa 2015-07-07 10:27:04 -07:00
Devaraj K
bff67dfe2f MAPREDUCE-6425. ShuffleHandler passes wrong "base" parameter to 
getMapOutputInfo if mapId is not in the cache. Contributed by zhihai xu.
 2015-07-06 13:46:37 +05:30
Jason Lowe
eac1d18943 MAPREDUCE-6418. MRApp should not shutdown LogManager during shutdown. Contributed by Chang Li 2015-07-01 18:01:22 +00:00
Jason Lowe
826715622e MAPREDUCE-6420. Interrupted Exception in LocalContainerLauncher should be logged in warn/info level. Contributed by Chang Li 2015-07-01 17:50:02 +00:00
Jason Lowe
2ac87df578 MAPREDUCE-6376. Add avro binary support for jhist files. Contributed by Ray Chiang 2015-07-01 16:00:03 +00:00
Robert Kanter
3a72bfd082 MAPREDUCE-6121. JobResourceUpdater#compareFs() doesn't handle HA namespaces (rchiang via rkanter) 2015-06-30 16:49:27 -07:00
Colin Patrick Mccabe
9c63825f10 MAPREDUCE-6407. Migrate MAPREDUCE native build to new CMake framework (Alan Burlison via Colin P. McCabe) 2015-06-30 16:17:06 -07:00
Jason Lowe
b6ba56457c MAPREDUCE-6384. Add the last reporting reducer info for too many fetch failure diagnostics. Contributed by Chang Li 2015-06-30 21:22:30 +00:00
Jason Lowe
aa5b15b03b MAPREDUCE-6413. TestLocalJobSubmission is failing with unknown host. Contributed by zhihai xu 2015-06-25 19:50:07 +00:00
Jason Lowe
72d08a0e41 MAPREDUCE-6400. Multiple shuffle transfer fails because input is closed too early. Contributed by Brahma Reddy Battula, Akira AJISAKA, and Gera Shegalov. 2015-06-24 15:29:11 +00:00
Vinod Kumar Vavilapalli
d481684c7c MAPREDUCE-6410. Fixed MapReduce JobHistory server to use the right (login) UGI to refresh log and cleaner settings. Contributed by Varun Saxena. 2015-06-23 11:39:55 -07:00
Devaraj K
41ae7768eb MAPREDUCE-6406. Update 
FileOutputCommitter.FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT to match
mapred-default.xml. Contributed by Ray Chiang.
 2015-06-23 10:23:44 +05:30
Jason Lowe
077250d8d7 MAPREDUCE-5948. org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well. Contributed by Vinayakumar B, Rushabh Shah, and Akira AJISAKA 2015-06-22 21:59:20 +00:00
Gera Shegalov
11ac848207 MAPREDUCE-6408. Queue name and user name should be printed on the job page. (Siqi Li via gera) 2015-06-22 14:40:32 -07:00
Akira Ajisaka
445b13240c MAPREDUCE-6403. Fix typo in the usage of NNBench. Contributed by Jagadesh Kiran N. 2015-06-22 15:32:39 +09:00
Gera Shegalov
055cd5a9a1 MAPREDUCE-6305. AM/Task log page should be able to link back to the job. (Siqi Li via gera) 2015-06-20 12:38:36 -07:00
Gera Shegalov
63d40d5286 MAPREDUCE-6316. Task Attempt List entries should link to the task overview. (Siqi Li via gera) 2015-06-20 11:38:21 -07:00
Devaraj K
311a4179cc MAPREDUCE-6405. NullPointerException in App Attempts page. Contributed by 
Siqi Li and Gera Shegalov.
 2015-06-20 10:35:04 +05:30
Gera Shegalov
10107243be MAPREDUCE-6395. Improve the commit failure messages in MRAppMaster recovery. (Brahma Reddy Battula via gera) 2015-06-19 02:22:59 -07:00
Devaraj K
1babe50a2c MAPREDUCE-6373. The logger reports total input paths but it is referring 
to input files. Contributed by Bibin A Chundatt.
 2015-06-18 11:42:22 +05:30
Akira Ajisaka
85cc644f92 MAPREDUCE-6396. TestPipeApplication fails by NullPointerException. Contributed by Brahma Reddy Battula. 2015-06-15 15:28:31 -07:00
Akira Ajisaka
75a2560e51 MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Brahma Reddy Battula. 2015-06-15 14:52:26 -07:00
Devaraj K
6785661e55 MAPREDUCE-6350. JobHistory doesn't support fully-functional search. 
Contributed by Siqi Li.
 2015-06-10 12:40:29 +05:30
cnauroth
025a3a8be0 MAPREDUCE-6392. Document mapred class path options. Contributed by Brahma Reddy Battula. 2015-06-08 16:22:03 -07:00
Tsuyoshi Ozawa
6afe20a7a4 MAPREDUCE-6388. Remove deprecation warnings from JobHistoryServer classes. Contributed by Ray Chiang. 2015-06-08 15:06:10 -07:00
Jason Lowe
b3ffa87003 MAPREDUCE-6354. ShuffleHandler should be able to log shuffle connections. Contributed by Chang Li 2015-06-05 22:38:31 +00:00
Karthik Kambatla
6786daab33 MAPREDUCE-6387. Serialize the recently added Task#encryptedSpillKey field at the end. (Arun Suresh via kasha) 2015-06-05 09:14:06 -07:00
Devaraj K
790a861766 MAPREDUCE-6377. JHS sorting on state column not working in webUi. 
Contributed by zhihai xu.
 2015-06-05 15:50:16 +05:30
Akira Ajisaka
dbed757cba HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii. 2015-06-05 01:45:34 +09:00
Gera Shegalov
e8302071ff MAPREDUCE-6382. Don't escape HTML links in Diagnostics in JHS job overview. (Siqi Li via gera) 2015-06-03 23:46:06 -07:00
Gera Shegalov
d90c13e2da MAPREDUCE-6174. Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. (Eric Payne via gera) 2015-06-03 16:50:26 -07:00
Zhijie Shen
bc85959edd Revert "YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong." 
This reverts commit 4a9ec1a824.
 2015-06-03 14:15:56 -07:00
Jason Lowe
107da29ff9 MAPREDUCE-6374. Distributed Cache File visibility should check permission of full path. Contributed by Chang Li 2015-06-03 20:19:27 +00:00
Zhijie Shen
4a9ec1a824 YARN-1462. Made RM write application tags to timeline server and exposed them to users via generic history web UI and REST API. Contributed by Xuan Gong. 2015-05-30 21:05:36 -07:00
Andrew Wang
7673d4f205 HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. (wang) 2015-05-29 14:54:18 -07:00
Gera Shegalov
788406e90c MAPREDUCE-6336. Enable v2 FileOutputCommitter by default. (Siqi Li via gera) 2015-05-27 15:14:46 -07:00
cnauroth
4102e5882e YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch. 2015-05-27 14:31:49 -07:00
Wangda Tan
3164e7d838 MAPREDUCE-6304. Specifying node labels when submitting MR jobs. (Naganarasimha G R via wangda) 2015-05-27 14:26:03 -07:00
Colin Patrick Mccabe
7dba7005b7 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) 2015-05-26 12:15:46 -07:00
Tsuyoshi Ozawa
022f49d59e MAPREDUCE-6364. Add a Kill link to Task Attempts page. Contributed by Ryu Kobayashi. 2015-05-26 23:59:02 +09:00
Tsuyoshi Ozawa
b27ce3c531 MAPREDUCE-6204. TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS. 2015-05-22 23:29:53 +09:00
Vinayakumar B
55ed6558ba HADOOP-11743. maven doesn't clean all the site files (Contributed by ramtin) 2015-05-22 16:45:19 +05:30
Wangda Tan
563eb1ad2a YARN-3583. Support of NodeLabel object instead of plain String in YarnClient side. (Sunil G via wangda) 2015-05-19 16:54:38 -07:00
Devaraj K
1ea90144d5 MAPREDUCE-6273. HistoryFileManager should check whether summaryFile exists 
to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED
state. Contributed by zhihai xu.
 2015-05-15 12:31:32 +05:30
Vinod Kumar Vavilapalli
6b710a42e0 Fixing MR intermediate spills. Contributed by Arun Suresh. 2015-05-14 16:07:56 -07:00
Devaraj K
05ff54c66c MAPREDUCE-5708. Duplicate String.format in 
YarnOutputFiles.getSpillFileForWrite. Contributed by Konstantin Weitz.
 2015-05-14 22:09:54 +05:30
Xuan
0f95921447 YARN-3626. On Windows localized resources are not moved to the front of the classpath when they should be. Contributed by Craig Welch 2015-05-13 13:10:53 -07:00
Vinod Kumar Vavilapalli
f24452d14e MAPREDUCE-6251. Added a new config for JobClient to retry JobStatus calls so that they don't fail on history-server backed by DFSes with not so strong guarantees. Contributed by Craig Welch. 2015-05-12 12:11:42 -07:00
Tsuyoshi Ozawa
f4e2b3cc0b MAPREDUCE-6361. NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host. Contributed by Junping Du. 2015-05-13 00:28:17 +09:00
Vinayakumar B
360dff5903 MAPREDUCE-6360. TestMapreduceConfigFields is placed in wrong dir, introducing compile error (Contributed by Arshad Mohammad) 2015-05-12 12:49:16 +05:30