Commit Graph

4246 Commits

Author SHA1 Message Date
Daryn Sharp
f46b6ea55c HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373090 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:56:49 +00:00
Todd Lipcon
b38bd555e8 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 20:11:40 +00:00
Tsz-wo Sze
0c27c77080 HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372707 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 03:02:43 +00:00
Todd Lipcon
ab3ab17a43 HDFS-3792. Fix two findbugs introduced by HDFS-3695. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372690 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 00:52:10 +00:00
Aaron Myers
4139298b61 HDFS-3790. test_fuse_dfs.c doesn't compile on centos 5. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372676 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 00:04:55 +00:00
Eli Collins
c959c1ac75 HADOOP-8687. Upgrade log4j to 1.2.17. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372649 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 22:08:39 +00:00
Alejandro Abdelnur
d71ea73012 HADOOP-8581 Amendment to CHANGES.txt setting right JIRA number, add support for HTTPS to the web UIs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372644 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 22:00:33 +00:00
Thomas Graves
dfad16fed2 MAPREDUCE-4053. Counters group names deprecation is wrong, iterating over group names deprecated names don't show up (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372636 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:48:33 +00:00
Todd Lipcon
4b67401565 Merge trunk into branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1372630 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:31:44 +00:00
Todd Lipcon
c93185df66 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372628 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:26:39 +00:00
Todd Lipcon
c9ed8342f5 Move HDFS-2330 and HDFS-3190 to branch-2 section, since they have been backported from trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372605 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 20:52:17 +00:00
Eli Collins
783a0f4d8b Amend HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372583 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 20:27:14 +00:00
Todd Lipcon
7aacfd5a08 HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372566 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 19:36:31 +00:00
Aaron Myers
bbe0e823db Revert HDFS-3719. See discussion there and HDFS-3770 for more info.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372544 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 18:42:51 +00:00
Eli Collins
bcb715459c HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371555 13f79535-47bb-0310-9956-ffa450edef68
2012-08-10 03:42:36 +00:00
Alejandro Abdelnur
4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 22:52:56 +00:00
Todd Lipcon
302f1e96ce Merge trunk into branch.
Branch will not build after this commit: need to implement new JournalManager
interfaces in QuorumJournalManager in a follow-up.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1371518 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 22:29:36 +00:00
Todd Lipcon
9d0f8792a9 HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371513 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 22:13:54 +00:00
Todd Lipcon
0733adf670 HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM. Contributed by Trevor Robinson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371507 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 21:58:21 +00:00
Aaron Myers
9ea7c06468 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371495 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 21:31:12 +00:00
Robert Joseph Evans
82910ecaa3 YARN-14. Symlinks to peer distributed cache files no longer work (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371390 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 19:15:56 +00:00
Robert Joseph Evans
201d0ecb78 MAPREDUCE-3782. teragen terasort jobs fail when using webhdfs:// (Jason Lowe via bobby)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371325 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 17:29:36 +00:00
Aaron Myers
fb970f3df7 HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371231 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 14:44:05 +00:00
Jakob Homan
ac31ae6a79 HDFS-3768. Exception in TestJettyHelper is incorrect. Contributed by Eli Reisman.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370952 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 20:34:03 +00:00
Alejandro Abdelnur
ffb4d5b04c Adding hadoop-yarn-project/target to svn:ignore
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370948 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 20:26:42 +00:00
Todd Lipcon
6dcf2e4815 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370937 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 20:15:40 +00:00
Aaron Myers
b587af4631 HDFS-3710. libhdfs misuses O_RDONLY/WRONLY/RDWR. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370898 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 19:11:30 +00:00
Arun Murthy
4920387b8a YARN-12. Fix findbugs warnings in FairScheduler. Contributed by Junping Du.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370889 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 18:53:29 +00:00
Aaron Myers
bc88c7b043 HDFS-3773. TestNNWithQJM fails after HDFS-3741. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370846 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 17:21:27 +00:00
Alejandro Abdelnur
b6080a93d4 HADOOP-8660. TestPseudoAuthenticator failing with NPE. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370812 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 15:32:06 +00:00
Arun Murthy
b5683210b6 YARN-1. Fixed message in CHANGES.txt
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370668 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 05:36:50 +00:00
Arun Murthy
e1fdf62123 YARN-1. Promote YARN to be a sub-project of Apache Hadoop.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370666 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 05:22:27 +00:00
Aaron Myers
34554d1e11 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370649 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 02:53:56 +00:00
Todd Lipcon
3a53ef4a80 HDFS-3741. Exhaustive failure injection test for skipped RPCs. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370497 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 20:24:01 +00:00
Eli Collins
c12e994eda HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370495 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 20:17:59 +00:00
Alejandro Abdelnur
754fd7b2fb HDFS-3291. add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370387 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 17:43:32 +00:00
Aaron Myers
9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 16:40:03 +00:00
Alejandro Abdelnur
1799046f7a MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration. (ahmed.radwan via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370120 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 05:15:25 +00:00
Alejandro Abdelnur
c2cac2748e MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists. (ahmed.radwan via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370118 13f79535-47bb-0310-9956-ffa450edef68
2012-08-07 05:11:22 +00:00
Alejandro Abdelnur
5383694df9 HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370045 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 22:22:32 +00:00
Aaron Myers
b4545bf5aa Add two new files missed by last commit of HDFS-3579.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370017 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 21:04:33 +00:00
Aaron Myers
f7b37c009b HDFS-3579. libhdfs: fix exception handling. Contributed by Colin Patrick McCabe.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370015 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 21:02:30 +00:00
Alejandro Abdelnur
117145f1ad MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 18:14:47 +00:00
Aaron Myers
294b514596 HDFS-3719. Re-enable append-related tests in TestFileConcurrentReader. Contributed by Andrew Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369848 13f79535-47bb-0310-9956-ffa450edef68
2012-08-06 13:59:00 +00:00
Jonathan Turner Eagles
72789336b2 MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369197 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 20:29:29 +00:00
Alejandro Abdelnur
42d071ab6f HDFS-3756. DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368733 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 22:10:51 +00:00
Siddharth Seth
3eb0cb27e8 MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368718 13f79535-47bb-0310-9956-ffa450edef68
2012-08-02 21:55:37 +00:00
Alejandro Abdelnur
08e8966217 HDFS-3724. add InterfaceAudience annotations to HttpFS classes and making inner enum static. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368308 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 23:14:08 +00:00
Alejandro Abdelnur
fe17d871d0 HDFS-3513. HttpFS should cache filesystems. (tucu)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368304 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 23:09:19 +00:00
Thomas Graves
28320c5220 MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368294 13f79535-47bb-0310-9956-ffa450edef68
2012-08-01 22:14:13 +00:00