big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,703 Commits 2 Branches 2 Tags 264 MiB
7584901685
Commit Graph

1703 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Eli Collins
7584901685 HADOOP-7870. fix SequenceFile#createWriter with boolean createParent arg to respect createParent. Contributed by Jon Hsieh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212084 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 20:20:16 +00:00
Eli Collins
2deaca4415 HADOOP-6886. LocalFileSystem Needs createNonRecursive API. Contributed by Nicolas Spiegelberg and Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212073 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:57:14 +00:00
Eli Collins
dec526076f HADOOP-6840. Support non-recursive create() in FileSystem and SequenceFile.Writer. Contributed by Jitendra and Eli 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212062 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:29:02 +00:00
Alejandro Abdelnur
3334306512 HDFS-2178. Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212060 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 19:25:28 +00:00
Suresh Srinivas
8cd80b3cbc HADOOP-7898. Fix javadoc warnings in AuthenticationToken.java. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212021 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 18:24:30 +00:00
Suresh Srinivas
4283ac6d7a HADOOP-7897. ProtobufRpcEngine client side exception mechanism is not consistent with WritableRpcEngine. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1212004 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 17:47:06 +00:00
Sanjay Radia
9f69ae5a9e HDFS-2597 ClientNameNodeProtocol in Protocol Buffers (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211769 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 06:48:45 +00:00
Aaron Myers
d9690b0922 HADOOP-7888. TestFailoverProxy fails intermittently on trunk. Contributed by Jason Lowe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211728 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 01:21:24 +00:00
Alejandro Abdelnur
58361d3f34 HADOOP-7887. KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211673 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 22:17:35 +00:00
Aaron Myers
a27adf3de4 HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211650 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 21:47:13 +00:00
Suresh Srinivas
c17bb83644 HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211249 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 01:05:56 +00:00
Mahadev Konar
ec87e163d4 MAPREDUCE-3147. Handle leaf queues with the same name properly. (Ravi Prakash via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211243 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-07 00:29:45 +00:00
Suresh Srinivas
7a59150bff HDFS-2629. Implement protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1211206 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 22:19:10 +00:00
Jakob Homan
788f28b679 HADOOP-7886. Add toString to FileStatus. Contributed by SreeHari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210793 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 06:35:02 +00:00
Jitendra Nath Pandey
b981daa07f HDFS-1580. Committing the test case, it was missed in earlier commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210749 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 02:15:56 +00:00
Jitendra Nath Pandey
8c0f2a0d59 HDFS-2618. Fix for the build failure caused by previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210746 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 02:08:48 +00:00
Arun Murthy
a55599062c MAPREDUCE-3496. Fixed client to print queue acls in consistent order. Contributed by Jonathan Eagles. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210738 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 01:34:03 +00:00
Suresh Srinivas
0a713035f2 HDFS-2618. Implement protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210719 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-06 00:25:25 +00:00
Suresh Srinivas
c256f8266d HDFS-2581. Implement protobuf service for JournalProtocol. Contributed Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210657 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 21:52:23 +00:00
Jitendra Nath Pandey
d18e5b3844 HDFS-1580. Add interface for generic Write Ahead Logging mechanisms. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210602 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 20:10:27 +00:00
Alejandro Abdelnur
6a358ee140 MAPREDUCE-3389. MRApps loads the 'mrapp-generated-classpath' file with classpath from the build machine. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210548 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 18:02:47 +00:00
Suresh Srinivas
0acc00bbab HADOOP-7876. Provided access to encoded key in DelegationKey for use in protobuf based RPCs. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210320 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 03:40:34 +00:00
Suresh Srinivas
560c8946ea HADOOP-7875. Add helper class to unwrap protobuf ServiceException. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210319 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 03:33:15 +00:00
Sanjay Radia
65200998c0 HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210208 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:44:36 +00:00
Mahadev Konar
e948247715 MAPREDUCE-3485. DISKS_FAILED -101 error code should be defined in same location as ABORTED_CONTAINER_EXIT_STATUS. (Ravi Gummadi via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210192 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 20:11:08 +00:00
Mahadev Konar
1972a76e5a MAPREDUCE-3458. Fix findbugs warnings in hadoop-examples. (Devaraj K via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1210190 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-04 19:58:32 +00:00
Mahadev Konar
bb2b8f565c MAPREDUCE-3456. /bin/yarn should set defaults for *_HOME (Eric Payne via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209825 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 03:38:05 +00:00
Alejandro Abdelnur
f7eda5a8d3 MAPREDUCE-3500. MRJobConfig creates an LD_LIBRARY_PATH using the platform ARCH. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209813 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 01:07:39 +00:00
Thomas White
72e9ec7a45 MAPREDUCE-3479. JobClient#getJob cannot find local jobs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209791 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-03 00:16:30 +00:00
Siddharth Seth
6b2cbe1198 MAPREDUCE-3453. RM web ui application details page shows RM cluster about information. (Contributed by Jonathan Eagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209759 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 22:51:01 +00:00
Siddharth Seth
a3f37e15f7 MAPREDUCE-3460. MR AM can hang if containers are allocated on a node blacklisted by the AM. (Contributed by Hitesh Shah and Robert Joseph Evans) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209737 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-02 22:18:38 +00:00
Alejandro Abdelnur
c5777e0375 HADOOP-7874. native libs should be under lib/native/ dir. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209286 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 22:44:29 +00:00
Thomas White
714ae6e62f MAPREDUCE-3369. Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169. Contributed by Ahmed Radwan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209281 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 22:29:42 +00:00
Tsz-wo Sze
6b555008f3 HADOOP-7877. Update balancer CLI usage documentation to include the new -policy option. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209246 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 21:19:01 +00:00
Siddharth Seth
449554f782 MAPREDUCE-3169 amendment. Deprecate MiniMRCluster. Contributed by Ahmed Radwan) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209235 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 21:00:28 +00:00
Siddharth Seth
102541b12b MAPREDUCE-3443. JobClient and Job should function in the context of the UGI which created them. (Contributed by Mahadev Konar) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1209231 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 20:39:37 +00:00
Mahadev Konar
6a9624dcec MAPREDUCE-3452. fifoscheduler web ui page always shows 0% used for the queue (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208999 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 08:43:29 +00:00
Mahadev Konar
08da8ea5db MAPREDUCE-3463. Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job. (Siddharth Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208994 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 08:35:20 +00:00
Alejandro Abdelnur
f5cffab738 HDFS-2614. hadoop dist tarball is missing hdfs headers. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208928 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 01:19:35 +00:00
Jitendra Nath Pandey
efc83da2a0 HADOOP-7854. UGI getCurrentUser is not synchronized. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208926 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-01 01:13:42 +00:00
Mahadev Konar
e2a78da87b MAPREDUCE-3488. Streaming jobs are failing because the main class isnt set in the pom files. (mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208792 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 21:17:06 +00:00
Alejandro Abdelnur
ff9bae6b7d MAREDUCE-3477. Hadoop site documentation cannot be built anymore. (jeagles via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208768 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 20:48:47 +00:00
Alejandro Abdelnur
d8930feeae HADOOP-7853. multiple javax security configurations cause conflicts. (daryn via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208751 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 20:26:36 +00:00
Mahadev Konar
94bf0dacba MAPREDUCE-3450. NM port info no longer available in JobHistory. (Siddharth Seth via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208327 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 08:43:00 +00:00
Eli Collins
68ff73c802 Ammend HDFS-2570 to shorten description. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208313 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 07:49:15 +00:00
Alejandro Abdelnur
afbc3aa30c HDFS-2606. webhdfs client filesystem impl must set the content-type header for create/append. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208157 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 00:25:54 +00:00
Eli Collins
670fa8770b HADOOP-7864. Building mvn site with Maven < 3.0.2 causes OOM errors. Contributed by Andrew Bayer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208153 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-30 00:03:40 +00:00
Jitendra Nath Pandey
65681d5716 HADOOP-7804. Enable hadoop config generator to set configurations to enable short circuit read. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208144 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 23:43:57 +00:00
Tsz-wo Sze
0398a9e88d HDFS-2604. Add a log message to show if WebHDFS is enabled and a configuration section in the forrest doc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208140 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 23:38:59 +00:00
Mahadev Konar
03e8ec7faf MAPREDUCE-3448. TestCombineOutputCollector javac unchecked warning on mocked generics (Jonathan Eagles via mahadev) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1208136 13f79535-47bb-0310-9956-ffa450edef68
 2011-11-29 23:33:13 +00:00