Commit Graph

3742 Commits

Author SHA1 Message Date
Eli Collins
8a9debd0ef HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386780 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 19:25:05 +00:00
Suresh Srinivas
6afabd7e57 HADOOP-8819. Incorrectly & is used instead of && in some file system implementations. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386451 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 01:39:11 +00:00
Suresh Srinivas
5d37911882 HADOOP-8821. Fix findbugs warning related concatenating string in a for loop in Configuration#dumpDeprecatedKeys(). Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385389 13f79535-47bb-0310-9956-ffa450edef68
2012-09-16 22:33:13 +00:00
Suresh Srinivas
0c53ed4cd1 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385374 13f79535-47bb-0310-9956-ffa450edef68
2012-09-16 21:10:39 +00:00
Alejandro Abdelnur
0de9642514 HDFS-3938. remove current limitations from HttpFS docs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384842 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 16:28:47 +00:00
Thomas White
d89828573d HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 16:05:30 +00:00
Aaron Myers
d8e386f01a HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384627 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 01:44:23 +00:00
Aaron Myers
86635168fe HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384602 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 23:48:25 +00:00
Aaron Myers
cae6885b71 HADOOP-8795. BASH tab completion doesn't look in PATH, assumes path to executable is specified. Contributed by Sean Mackrory.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384436 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 17:57:40 +00:00
Eli Collins
eb7f8a71e0 HADOOP-8801. ExitUtil#terminate should capture the exception stack trace. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384435 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 17:56:49 +00:00
Suresh Srinivas
d543140089 HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384209 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 05:46:18 +00:00
Vinod Kumar Vavilapalli
7c491887e5 YARN-93. Fixed RM to propagate diagnostics from applications that have finished but failed Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384169 13f79535-47bb-0310-9956-ffa450edef68
2012-09-13 00:46:39 +00:00
Eli Collins
4f312cfa70 HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384092 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 19:15:38 +00:00
Eli Collins
2ba149f85c HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 18:36:01 +00:00
Todd Lipcon
80a8d57ffc HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384078 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 18:32:57 +00:00
Eli Collins
f0c3ed79dd HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383759 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 04:21:31 +00:00
Eli Collins
414abe6918 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383753 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 04:10:58 +00:00
Vinod Kumar Vavilapalli
229a79bbc3 MAPREDUCE-4646. Fixed MR framework to send diagnostic information correctly to clients in case of failed jobs also. Contributed by Jason Lowe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383709 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 00:59:15 +00:00
Vinod Kumar Vavilapalli
11cf00b08a YARN-78. Changed UnManagedAM application to use YarnClient. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383705 13f79535-47bb-0310-9956-ffa450edef68
2012-09-12 00:49:17 +00:00
Eli Collins
dc1fd84bd1 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 21:24:12 +00:00
Doug Cutting
de2efbe3ba HADOOP-8597. Permit FsShell's text command to read Avro files. Contributed by Ivan Vladimirov.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383607 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 20:38:45 +00:00
Suresh Srinivas
043a27a3ef HADOOP-8767. Secondary namenode is started on slave nodes instead of master nodes. Contributed by Giovanni Delussu.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383560 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 19:10:01 +00:00
Eli Collins
aa4c3fc8aa HADOOP-8789. Tests setLevel(Level.OFF) should be Level.ERROR. Contributed by Andy Isaacson
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383494 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 17:56:19 +00:00
Thomas White
c406e65f24 Update CHANGES.txt for MAPREDUCE-4607 commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383423 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 14:06:51 +00:00
Thomas White
3b46295c28 MAPREDUCE-4607. Race condition in ReduceTask completion can result in Task being incorrectly failed. Contributed by Bikas Saha.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383422 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 14:04:03 +00:00
Todd Lipcon
bdcbc2d1ef HADOOP-8786. HttpServer continues to start even if AuthenticationFilter fails to init. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383254 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 06:37:17 +00:00
Alejandro Abdelnur
1d42944962 HADOOP-8781. hadoop-config.sh should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383142 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 22:48:12 +00:00
Eli Collins
e1ffefa860 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 18:46:13 +00:00
Tsz-wo Sze
009235f4a9 HDFS-2656. Add libwebhdfs, a pure C client based on WebHDFS. Contributed by Jaimin D Jetly and Jing Zhao
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382836 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 13:43:28 +00:00
Eli Collins
3a4dcfba57 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382409 13f79535-47bb-0310-9956-ffa450edef68
2012-09-09 06:37:31 +00:00
Arun Murthy
681408f898 Set date for hadoop-2.0.2-alpha
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382199 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:39:45 +00:00
Arun Murthy
7851676f22 Preparing for hadoop-2.0.2-alpha release.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382191 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 22:09:48 +00:00
Aaron Myers
6ba9ff9177 HADOOP-8775. MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete. Contributed by Sandy Ryza.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382119 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 18:40:30 +00:00
Alejandro Abdelnur
a7998921a7 MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382093 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 17:05:11 +00:00
Robert Joseph Evans
77805c7ae4 MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382088 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 16:45:03 +00:00
Arun Murthy
a1aa1b9349 YARN-57. Allow process-tree based resource calculation et al. to be pluggable to support it on multiple platforms. Contributed by Radim Kolar.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382072 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 15:48:39 +00:00
Arun Murthy
56d72dfdf1 YARN-80. Add support for delaying rack-local containers in CapacityScheduler. Contributed by Arun C. Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381872 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 05:10:51 +00:00
Arun Murthy
0056914773 MAPREDUCE-4638. MR AM supplies MapReduce jars in classpath rather than rely on YARN. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381868 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 04:56:32 +00:00
Tsz-wo Sze
e8c193bf24 HADOOP-8754. Deprecate all the RPC.getServer() variants. Contributed by Brandon Li
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381845 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 03:09:53 +00:00
Eli Collins
404ab8ec66 HADOOP-8431. Running distcp wo args throws IllegalArgumentException. Contributed by Sandy Ryza
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381840 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 01:25:30 +00:00
Vinod Kumar Vavilapalli
e4679b5caf YARN-75. Missing test. Ugh.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381811 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 00:04:40 +00:00
Vinod Kumar Vavilapalli
e9411ae5e3 YARN-75. Added file missing from previous commit. Bad day with svn.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381809 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:55:10 +00:00
Vinod Kumar Vavilapalli
68ad1716b2 YARN-75. Removing spurious file from the previous commit.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381807 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:47:41 +00:00
Vinod Kumar Vavilapalli
3a4e87e813 YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE event at RUNNING state. Contributed by Siddharth Seth.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381806 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:46:31 +00:00
Vinod Kumar Vavilapalli
d3224aff28 YARN-15. Fixing CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381801 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:36:27 +00:00
Vinod Kumar Vavilapalli
d093dcce45 YARN-15. Updated default classpath for YARN applications to reflect split of YARN into a sub-project. Contributed by Arun C Murthy.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381794 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 23:06:35 +00:00
Robert Joseph Evans
09038b741d MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381784 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 22:20:15 +00:00
Alejandro Abdelnur
9da626af41 HDFS-3895. hadoop-client must include commons-cli (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381719 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 19:03:37 +00:00
Alejandro Abdelnur
11312adedb HADOOP-8749. HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. (ahmed via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381703 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 18:15:37 +00:00
Uma Maheswara Rao G
0654590853 Removed unnecessary .org files added in previous commit HDFS-3809
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381700 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 18:05:30 +00:00