big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,104 Commits 2 Branches 2 Tags 264 MiB
88ff272cfd
Commit Graph

1104 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Arun Murthy
03c1015d6e MAPREDUCE-2800. Set final progress for tasks to ensure all task information is correctly logged to JobHistory. Contributed by Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165930 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 23:36:19 +00:00
Konstantin Shvachko
3a3f277017 MAPREDUCE-2767. CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165894 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 21:59:09 +00:00
Arun Murthy
f560a1066f MAPREDUCE-2687. Fix NodeManager to use the right version of LocalDirAllocator.getLocalPathToWrite. Contributed by mahadev & acmurthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165890 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 21:49:46 +00:00
Konstantin Shvachko
fd804b5993 MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165864 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 21:29:26 +00:00
Todd Lipcon
42d443fb79 HDFS-2314. MRV1 test compilation broken after HDFS-2197. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165860 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 21:25:35 +00:00
Jitendra Nath Pandey
bdc3720d5b HDFS-2018. Move all journal stream management code into one place. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165826 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 20:27:38 +00:00
Vinod Kumar Vavilapalli
e20f135174 MAPREDUCE-2936. Contrib Raid compilation broken after HDFS-1620. Contributed by Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165657 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 13:19:10 +00:00
Aaron Myers
9e95326a2c HDFS-2313. Rat excludes has a typo for excluding editsStored files. (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165477 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 01:51:30 +00:00
Arun Murthy
c2e1756d7a HADOOP-7580. Add a version of getLocalPathForWrite to LocalDirAllocator which doesn't create dirs. Contributed by Chris Douglas & Siddharth Seth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165473 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 01:36:34 +00:00
Todd Lipcon
b0632df93a HDFS-2197. Refactor RPC call implementations out of NameNode class. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165463 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 00:41:47 +00:00
Todd Lipcon
d1438b501d HDFS-2310. TestBackupNode fails since HADOOP-7524 went in. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165461 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-06 00:34:57 +00:00
Todd Lipcon
ae367be8f3 MAPREDUCE-2882. TestLineRecordReader depends on ant jars. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165449 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-05 23:23:35 +00:00
Arun Murthy
6b608aad7d MAPREDUCE-2697. Enhance CapacityScheduler to cap concurrently running applications per-queue & per-user. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165403 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-05 19:49:47 +00:00
Aaron Myers
458c34a2ab Follow-up commit for HDFS-1620 since I missed some files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165103 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-04 19:38:50 +00:00
Aaron Myers
8ae98a9d1c HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants -> HdfsConstants. (Harsh J Chouraria via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1165096 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-04 19:30:12 +00:00
Vinod Kumar Vavilapalli
6bdf5746d5 MAPREDUCE-2716. MRReliabilityTest job fails because of missing job-file. Contributed by Jeffrey Naisbitt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164805 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 06:22:03 +00:00
Aaron Myers
6c33846767 HADOOP-7606. Upgrade Jackson to version 1.7.1 to match the version required by Jersey (Alejandro Abdelnur via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164779 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 00:53:40 +00:00
Sanjay Radia
b97a4d40c8 HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164771 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-03 00:31:05 +00:00
Aaron Myers
2566043c2f HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164624 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-02 16:47:59 +00:00
Eli Collins
07c5741c9a HADOOP-7552. FileUtil#fullyDelete doesn't throw IOE but lists it in the throws clause. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164339 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-02 03:20:12 +00:00
Arun Murthy
5d4f16b93c MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164301 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 23:58:12 +00:00
Arun Murthy
a9bf33445e MAPREDUCE-2756. Better error handling in JobControl for failed jobs. Contributed by Robert Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164255 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 20:24:38 +00:00
Aaron Myers
c5ef34a1e7 Revert 1164192 given review feedback provided after initial commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164199 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 18:25:51 +00:00
Aaron Myers
d873f1155a HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164192 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 18:07:38 +00:00
Aaron Myers
a2b1aa9471 HADOOP-7595. Upgrade dependency to Avro 1.5.3. (Alejandro Abdelnur via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1164174 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 17:13:44 +00:00
Tsz-wo Sze
99af7d85d3 set svn:ignore for hadoop-auth-examples. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163981 13f79535-47bb-0310-9956-ffa450edef68
 2011-09-01 10:20:05 +00:00
Tsz-wo Sze
19523b6a2b HADOOP-7594. Support HTTP REST in HttpServer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163858 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 22:58:03 +00:00
Tsz-wo Sze
2b016dac82 HADOOP-7579. Rename package names from alfredo to auth. Contributed by Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163852 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 22:40:03 +00:00
Konstantin Shvachko
4f1a0e36fa HDFS-2258. Reset lease limits to default values in TestLeaseRecovery2. Contributed by Konstantin Shvachko 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163821 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 21:18:37 +00:00
Arun Murthy
b9a5fd5190 MAPREDUCE-2917. Fixed corner case in container reservation which led to starvation and hung jobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163768 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 19:52:20 +00:00
Vinod Kumar Vavilapalli
ade0f0560f MAPREDUCE-2652. Enabled multiple NMs to be runnable on a single node by making shuffle service port to be truely configurable. Contributed by Robert Joseph Evans. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163585 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 11:38:32 +00:00
Mahadev Konar
5786efbfa6 MAPREDUCE-2916. Ivy build for MRv1 fails with bad organization for common daemon. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163490 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 05:48:02 +00:00
Tsz-wo Sze
f10c97d390 HADOOP-7593. Fix AssertionError in TestHttpServer.testMaxThreads(). Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163465 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 01:16:47 +00:00
Matthew Foley
1cd3791172 HDFS-1330 and HADOOP-6889. Added additional unit tests. Contributed by John George. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163463 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 00:58:19 +00:00
Tsz-wo Sze
8c9c8c72cc Remove svn:mergeinfo from TestSequenceFile.java 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163462 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 00:56:25 +00:00
Tsz-wo Sze
4b661b3670 HADOOP-7576. Fix findbugs warnings and javac warnings in hadoop-auth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163456 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-31 00:18:55 +00:00
Tsz-wo Sze
aba0e225fc HDFS-1217. Change some NameNode methods from public to package private. Constributed by Laxman 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163081 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-30 04:02:22 +00:00
Arun Murthy
c2b851b0f2 MAPREDUCE-2897. Javadoc for ClientRMProtocol protocol and related records. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163069 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-30 01:22:28 +00:00
Mahadev Konar
fb6ecb9b27 MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1163050 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 23:27:47 +00:00
Mahadev Konar
aad81a15ec MAPREDUCE-2737. Update the progress of jobs on client side. (Siddharth Seth and Mahadev Konar via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162979 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 20:23:17 +00:00
Arun Murthy
3380d8f70c MAPREDUCE-2904. Fixed bin/yarn to correctly include HDFS jars and clean up of stale refs to pre-mavenized Hadoop Common and HDFS. Contributed by Sharad Agarwal and Arun C. Murthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162954 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 19:36:26 +00:00
Mahadev Konar
602dd3c7dc HADOOP-7589. Prefer mvn test -DskipTests over mvn compile in test-patch.sh (Robert Evans via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162928 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 18:24:21 +00:00
Arun Murthy
b9259a2710 MAPREDUCE-2898. Javadoc for ContainerManager protocol and related records. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162613 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-29 00:04:06 +00:00
Arun Murthy
00d2263908 MAPREDUCE-2891. Javadoc for AMRMProtocol and related records. Contributed by acmurthy. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162499 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-28 11:41:36 +00:00
Arun Murthy
c9cbd8e4e6 MAPREDUCE-2893. Remove duplicate entry of YarnClientProtocolProvider in ClientProtocolProvider services file. Contributed by Liang-Chi Hsieh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162491 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-28 10:37:24 +00:00
Arun Murthy
8b56463315 HDFS-2289. Ensure jsvc is bundled with the HDFS distribution artifact. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162421 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-27 19:07:04 +00:00
Arun Murthy
d8c3e63dce MAPREDUCE-2885. Fix mapred-config.sh to look for hadoop-config.sh in HADOOP_COMMON_HOME/libexec. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162188 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 17:55:53 +00:00
Tsz-wo Sze
56dd8ba0b8 HADOOP-7547. Add generic type in WritableComparable subclasses. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162008 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 06:58:52 +00:00
Todd Lipcon
23e7fc4f46 HDFS-2287. TestParallelRead has a small off-by-one bug. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162005 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 06:51:57 +00:00
Todd Lipcon
7cf49f5d9c HDFS-2286. DataXceiverServer logs AsynchronousCloseException at shutdown. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1162003 13f79535-47bb-0310-9956-ffa450edef68
 2011-08-26 06:44:13 +00:00