big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,443 Commits 2 Branches 2 Tags 264 MiB
42cdc1b083
Commit Graph

3443 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Todd Lipcon
42cdc1b083 HDFS-3797. QJM: add segment txid as a parameter to journal() RPC. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373571 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 18:58:51 +00:00
Todd Lipcon
c95a1674b6 HDFS-3799. QJM: handle empty log segments during recovery. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373183 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:57:24 +00:00
Todd Lipcon
4a9b3c693d HDFS-3798. Avoid throwing NPE when finalizeSegment() is called on invalid segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373179 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:54:49 +00:00
Todd Lipcon
160bfcd6c2 HDFS-3795. QJM: validate journal dir at startup. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373178 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:52:24 +00:00
Todd Lipcon
f765fdb657 HDFS-3793. Implement genericized format() in QJM. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373177 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-15 00:48:11 +00:00
Todd Lipcon
4b67401565 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1372630 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:31:44 +00:00
Todd Lipcon
c93185df66 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372628 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 21:26:39 +00:00
Todd Lipcon
c9ed8342f5 Move HDFS-2330 and HDFS-3190 to branch-2 section, since they have been backported from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372605 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 20:52:17 +00:00
Eli Collins
783a0f4d8b Amend HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372583 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 20:27:14 +00:00
Todd Lipcon
7aacfd5a08 HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372566 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 19:36:31 +00:00
Aaron Myers
bbe0e823db Revert HDFS-3719. See discussion there and HDFS-3770 for more info. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372544 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-13 18:42:51 +00:00
Eli Collins
bcb715459c HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371555 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-10 03:42:36 +00:00
Alejandro Abdelnur
4bca22005f HADOOP-8681. add support for HTTPS to the web UIs. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371525 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:52:56 +00:00
Todd Lipcon
302f1e96ce Merge trunk into branch. 
Branch will not build after this commit: need to implement new JournalManager
interfaces in QuorumJournalManager in a follow-up.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1371518 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:29:36 +00:00
Todd Lipcon
9d0f8792a9 HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371513 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 22:13:54 +00:00
Todd Lipcon
0733adf670 HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM. Contributed by Trevor Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371507 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 21:58:21 +00:00
Aaron Myers
9ea7c06468 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371495 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 21:31:12 +00:00
Robert Joseph Evans
82910ecaa3 YARN-14. Symlinks to peer distributed cache files no longer work (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371390 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 19:15:56 +00:00
Robert Joseph Evans
201d0ecb78 MAPREDUCE-3782. teragen terasort jobs fail when using webhdfs:// (Jason Lowe via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371325 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 17:29:36 +00:00
Aaron Myers
fb970f3df7 HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371231 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-09 14:44:05 +00:00
Jakob Homan
ac31ae6a79 HDFS-3768. Exception in TestJettyHelper is incorrect. Contributed by Eli Reisman. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370952 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 20:34:03 +00:00
Alejandro Abdelnur
ffb4d5b04c Adding hadoop-yarn-project/target to svn:ignore 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370948 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 20:26:42 +00:00
Todd Lipcon
6dcf2e4815 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370937 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 20:15:40 +00:00
Aaron Myers
b587af4631 HDFS-3710. libhdfs misuses O_RDONLY/WRONLY/RDWR. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370898 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 19:11:30 +00:00
Arun Murthy
4920387b8a YARN-12. Fix findbugs warnings in FairScheduler. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370889 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 18:53:29 +00:00
Aaron Myers
bc88c7b043 HDFS-3773. TestNNWithQJM fails after HDFS-3741. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370846 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 17:21:27 +00:00
Alejandro Abdelnur
b6080a93d4 HADOOP-8660. TestPseudoAuthenticator failing with NPE. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370812 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 15:32:06 +00:00
Arun Murthy
b5683210b6 YARN-1. Fixed message in CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370668 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 05:36:50 +00:00
Arun Murthy
e1fdf62123 YARN-1. Promote YARN to be a sub-project of Apache Hadoop. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370666 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 05:22:27 +00:00
Aaron Myers
34554d1e11 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370649 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-08 02:53:56 +00:00
Todd Lipcon
3a53ef4a80 HDFS-3741. Exhaustive failure injection test for skipped RPCs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370497 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 20:24:01 +00:00
Eli Collins
c12e994eda HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370495 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 20:17:59 +00:00
Alejandro Abdelnur
754fd7b2fb HDFS-3291. add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370387 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 17:43:32 +00:00
Aaron Myers
9b4a7900c7 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370354 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 16:40:03 +00:00
Alejandro Abdelnur
1799046f7a MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration. (ahmed.radwan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370120 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 05:15:25 +00:00
Alejandro Abdelnur
c2cac2748e MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists. (ahmed.radwan via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370118 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-07 05:11:22 +00:00
Alejandro Abdelnur
5383694df9 HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370045 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 22:22:32 +00:00
Aaron Myers
b4545bf5aa Add two new files missed by last commit of HDFS-3579. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370017 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 21:04:33 +00:00
Aaron Myers
f7b37c009b HDFS-3579. libhdfs: fix exception handling. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370015 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 21:02:30 +00:00
Alejandro Abdelnur
117145f1ad MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 18:14:47 +00:00
Aaron Myers
294b514596 HDFS-3719. Re-enable append-related tests in TestFileConcurrentReader. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369848 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-06 13:59:00 +00:00
Jonathan Turner Eagles
72789336b2 MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369197 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-03 20:29:29 +00:00
Alejandro Abdelnur
42d071ab6f HDFS-3756. DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368733 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-02 22:10:51 +00:00
Siddharth Seth
3eb0cb27e8 MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368718 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-02 21:55:37 +00:00
Alejandro Abdelnur
08e8966217 HDFS-3724. add InterfaceAudience annotations to HttpFS classes and making inner enum static. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368308 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 23:14:08 +00:00
Alejandro Abdelnur
fe17d871d0 HDFS-3513. HttpFS should cache filesystems. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368304 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 23:09:19 +00:00
Thomas Graves
28320c5220 MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368294 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 22:14:13 +00:00
Eli Collins
ade55f9573 HADOOP-8480. The native build should honor -DskipTests. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368257 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 21:28:49 +00:00
Eli Collins
1264b8e707 HADOOP-8620. Add -Drequire.fuse and -Drequire.snappy. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368251 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 21:23:10 +00:00
Thomas Graves
12d0e02591 HADOOP-8633. Interrupted FsShell copies may leave tmp files (Daryn Sharp via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368002 13f79535-47bb-0310-9956-ffa450edef68
 2012-08-01 14:02:22 +00:00