big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
10,236 Commits 2 Branches 2 Tags 264 MiB
b49c3a1813
Commit Graph

1613 Commits

Author SHA1 Message Date
Gera Shegalov
aa92b764a7 MAPREDUCE-4815. Speed up FileOutputCommitter#commitJob for many output files. (Siqi Li via gera) 2015-03-10 11:32:08 -07:00
Tsuyoshi Ozawa
20b8ee1350 MAPREDUCE-4742. Fix typo in nnbench#displayUsage. Contributed by Liang Xie. 2015-03-11 00:41:12 +09:00
Junping Du
d39bc903a0 Configurable timeout between YARNRunner terminate the application and forcefully kill. Contributed by Eric Payne. 2015-03-10 06:21:59 -07:00
Vinod Kumar Vavilapalli
b3e699271b Adding 2.8 section in CHANGES.txt 2015-03-08 20:24:33 -07:00
Tsuyoshi Ozawa
dfd8da777f Moving CHANGES.txt entry for MAPREDUCE-5657 to branch-2. 2015-03-09 12:05:08 +09:00
Tsuyoshi Ozawa
348208014b MAPREDUCE-6136. MRAppMaster doesn't shutdown file systems. Contributed by Brahma Reddy Battula. 2015-03-05 14:12:47 +09:00
Karthik Kambatla
c66c3ac6bf MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own class. (Chris Trezzo via kasha) 2015-03-04 14:42:07 -08:00
Vinod Kumar Vavilapalli
5af693fde2 MAPREDUCE-6248. Exposed the internal MapReduce job's information as a public API in DistCp. Contributed by Jing Zhao. 2015-03-03 16:28:41 -08:00
Junping Du
4228de9402 MAPREDUCE-5583. Ability to limit running map and reduce tasks. Contributed by Jason Lowe. 2015-03-03 02:02:28 -08:00
Tsuyoshi Ozawa
9ae7f9eb7b MAPREDUCE-5657. Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA. 2015-03-03 18:06:26 +09:00
Tsuyoshi Ozawa
742f9d90c0 MAPREDUCE-6268. Fix typo in Task Attempt API's URL. Contributed by Ryu Kobayashi. 2015-03-03 16:21:16 +09:00
Allen Wittenauer
039366e3b4 MAPREDUCE-5653. DistCp does not honour config-overrides for mapreduce.[map,reduce].memory.mb (Ratandeep Ratti via aw) 2015-02-28 22:53:38 -08:00
Akira Ajisaka
bfbf076b7d MAPREDUCE-5612. Add javadoc for TaskCompletionEvent.Status. Contributed by Chris Palmer. 2015-02-26 15:05:17 -08:00
Karthik Kambatla
1047c883ba MAPREDUCE-6223. TestJobConf#testNegativeValueForTaskVmem failures. (Varun Saxena via kasha) 2015-02-26 14:24:19 -08:00
Akira Ajisaka
9a37247a67 MAPREDUCE-2815. JavaDoc does not generate correctly for MultithreadedMapRunner. Contributed by Chris Palmer. 2015-02-24 12:10:17 -08:00
Akira Ajisaka
0d7d508c82 MAPREDUCE-6264. Remove httpclient dependency from hadoop-mapreduce-client. Contributed by Brahma Reddy Battula. 2015-02-24 11:34:26 -08:00
Plamen Jeliazkov
a19820f2fb MAPREDUCE-6228. Add truncate operation to SLive. Constributed by Plamen Jeliazkov. 2015-02-19 00:02:49 -08:00
Jason Lowe
4981d082d4 MAPREDUCE-6261. NullPointerException if MapOutputBuffer.flush invoked twice. Contributed by Tsuyoshi OZAWA 2015-02-18 19:28:02 +00:00
Tsuyoshi Ozawa
7c782047c6 MAPREDUCE-4286. TestClientProtocolProviderImpls passes on failure conditions. Contributed by Devaraj K. 2015-02-18 15:45:52 +09:00
Karthik Kambatla
409113d8f9 MAPREDUCE-6234. TestHighRamJob fails due to the change in MAPREDUCE-5785. (Masatake Iwasaki via kasha) 2015-02-17 14:38:00 -08:00
Allen Wittenauer
8b787e2fdb MAPREDUCE-6260. Convert site documentation to markdown (Masatake Iwasaki via aw) 2015-02-17 06:52:14 -10:00
Junping Du
814afa46ef MAPREDUCE-6225. Fix new findbug warnings in hadoop-mapreduce-client-core. Contributed by Varun Saxena 2015-02-16 09:38:05 -08:00
Tsuyoshi Ozawa
3338f6d907 MAPREDUCE-6256. Removed unused private methods in o.a.h.mapreduce.Job.java. Contributed by Naganarasimha G R. 2015-02-15 10:09:42 +09:00
Tsuyoshi Ozawa
ba3c80a5ca MAPREDUCE-6255. Fix JobCounter's format to use grouping separator. Contributed by Ryu Kobayashi. 2015-02-13 16:11:00 +09:00
Allen Wittenauer
6f5290b030 MAPREDUCE-6250. deprecate sbin/mr-jobhistory-daemon.sh (aw) 2015-02-12 13:48:47 -08:00
Tsuyoshi Ozawa
9b0ba59b82 MAPREDUCE-6221. Stringifier is left unclosed in Chain#getChainElementConf(). Contributed by Ted Yu. 2015-02-13 02:27:54 +09:00
Tsuyoshi Ozawa
ac8d52bf50 MAPREDUCE-4431. mapred command should print the reason on killing already completed jobs. Contributed by Devaraj K. 2015-02-12 20:35:57 +09:00
Tsuyoshi Ozawa
b42d09eb62 MAPREDUCE-5335. Rename Job Tracker terminology in ShuffleSchedulerImpl. Contributed by Devaraj K. 2015-02-12 20:08:29 +09:00
Devaraj K
76e309ead0 MAPREDUCE-6253. Update use of Iterator to Iterable. Contributed by Ray 
Chiang.
 2015-02-12 13:45:19 +05:30
Allen Wittenauer
aab459c904 MAPREDUCE-4413. MR lib dir contains jdiff (which is gpl) (Nemon Lou via aw) 2015-02-09 14:02:47 -08:00
Tsuyoshi Ozawa
241336ca2b MAPREDUCE-6237. Multiple mappers with DBInputFormat don't work because of reusing conections. Contributed by Kannan Rajah. 2015-02-10 03:52:42 +09:00
yliu
ef01768333 MAPREDUCE-6227. DFSIO for truncate. (shv via yliu) 2015-02-08 02:43:43 +08:00
Robert Kanter
e2ee2ff7d7 MAPREDUCE-6233. org.apache.hadoop.mapreduce.TestLargeSort.testLargeSort failed in trunk (zxu via rkanter) 2015-02-05 14:20:28 -08:00
Jason Lowe
e1990ab427 MAPREDUCE-6186. Redundant call to requireJob() while displaying the conf page. Contributed by Rohit Agarwal 2015-02-05 20:13:31 +00:00
Jason Lowe
afbecbb2cc Update CHANGES.txt to move MR-6059 to 2.7 2015-02-05 16:43:08 +00:00
Akira Ajisaka
cc6bbfceae MAPREDUCE-5988. Fix dead links to the javadocs in mapreduce project. (aajisaka) 2015-02-04 17:46:01 -08:00
Allen Wittenauer
fd57ab2002 MAPREDUCE-6059. Speed up history server startup time (Siqi Li via aw) 2015-02-04 17:36:28 -08:00
Akira Ajisaka
34fe11c987 MAPREDUCE-6243. Fix findbugs warnings in hadoop-rumen. Contributed by Masatake Iwasaki. 2015-02-04 09:25:44 -08:00
Akira Ajisaka
bd69fb2d44 MAPREDUCE-5800. Use Job#getInstance instead of deprecated constructors. (aajisaka) 2015-02-03 14:30:09 -08:00
Robert Kanter
8acc5e9b4b MAPREDUCE-6143. add configuration for mapreduce speculative execution in MR2 (zxu via rkanter) 2015-02-02 13:51:08 -08:00
Allen Wittenauer
12e883007c MAPREDUCE-6151. Update document of GridMix (Masatake Iwasaki via aw) 2015-01-30 11:08:20 -08:00
Allen Wittenauer
3f982c5c26 MAPREDUCE-6150. Update document of Rumen (Masatake Iwasaki via aw) 2015-01-29 14:17:44 -08:00
Akira Ajisaka
fe2188a042 MAPREDUCE-6231. Grep example job is not working on a fully-distributed cluster. (aajisaka) 2015-01-30 01:10:02 +09:00
Jian He
cff05bff1f MAPREDUCE-6230. Fixed RMContainerAllocator to update the new AMRMToken service name properly. Contributed by Jason Lowe 2015-01-28 15:51:30 -08:00
Jason Lowe
56b7ec71a6 MAPREDUCE-6141. History server leveldb recovery store. Contributed by Jason Lowe 2015-01-26 16:28:55 +00:00
Gera Shegalov
a003f71cac MAPREDUCE-5785. Derive heap size or mapreduce.*.memory.mb automatically. (Gera Shegalov and Karthik Kambatla via gera) 2015-01-21 18:42:03 -08:00
cnauroth
0742591335 MAPREDUCE-3283. mapred classpath CLI does not display the complete classpath. Contributed by Varun Saxena. 2015-01-21 13:50:39 -08:00
Akira Ajisaka
d336d13678 MAPREDUCE-6210. Use getApplicationAttemptId() instead of getApplicationID() for logging AttemptId in RMContainerAllocator.java (Contributed by Leitao Guo) 2015-01-14 17:38:35 +09:00
Xuan
10ac5abb86 MAPREDUCE-6173. Document the configuration of deploying MR over 
distributed cache with enabling wired encryption at the same time.
Contributed by Junping Du.
 2015-01-13 10:04:31 -08:00
Tsuyoshi Ozawa
a6ed4894b5 HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch. (ozawa) 2015-01-08 14:51:57 +09:00