big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,300 Commits 2 Branches 2 Tags 264 MiB
69f7a329ba
Commit Graph

3300 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Eli Collins
69f7a329ba HDFS-3537. Move libhdfs and fuse-dfs source to native subdirectories. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362119 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 16:42:53 +00:00
Robert Joseph Evans
612443951b MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 14:19:36 +00:00
Harsh J
0f122c209d HADOOP-8531. SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361933 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 08:33:13 +00:00
Harsh J
0e8e499ff4 HDFS-3659. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361894 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-16 02:58:03 +00:00
Arun Murthy
ae6cc14611 MAPREDUCE-4427. Added an 'unmanaged' mode for AMs so as to ease development of new applications. Contributed by Bikas Saha. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361813 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 21:46:07 +00:00
Eli Collins
64fc2cb03d HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 19:43:39 +00:00
Harsh J
7351a01259 HADOOP-7818. DiskChecker#checkDir should fail if the directory is not executable. Contributed by Madhukara Phatak. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361717 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 15:33:27 +00:00
Harsh J
385f31ad85 HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. Contributed by Madhukara Phatak and Suresh Srinivas (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361712 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-15 15:07:02 +00:00
Eli Collins
2eb39c55d6 HDFS-3610. fuse_dfs: Provide a way to use the default (configured) NN URI. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361565 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 17:19:01 +00:00
Eli Collins
3e5e1008db Amend HDFS-799. Remove unnecessary tls check. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361561 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 17:02:05 +00:00
Eli Collins
32d4c148df HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361463 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 01:07:57 +00:00
Eli Collins
f5dd4583bb HDFS-3539. libhdfs code cleanups. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361459 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:47:43 +00:00
Eli Collins
cfd692b866 HDFS-3609. libhdfs: don't force the URI to look like hdfs://hostname:port. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361454 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:34:28 +00:00
Eli Collins
06d635cd2c HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361449 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:18:56 +00:00
Eli Collins
8c2a2f909c HDFS-470. libhdfs should handle 0-length reads from FSInputStream correctly. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361446 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-14 00:03:58 +00:00
Eli Collins
dcf0ac7a8a HDFS-3606. libhdfs: create self-contained unit test. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361440 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 23:28:03 +00:00
Eli Collins
bf34f62e43 HADOOP-8499. Lower min.user.id to 500 for the tests. Contributed Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361438 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 23:04:21 +00:00
Alejandro Abdelnur
27b5f5a0e6 MAPREDUCE-3451. Amendment, excluding findbugs warnings (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361436 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 22:56:08 +00:00
Robert Joseph Evans
17de78a43e MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361397 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:53:43 +00:00
Robert Joseph Evans
228736ab51 MAPREDUCE-4419. ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> (Devaraj K via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361389 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:42:48 +00:00
Alejandro Abdelnur
9dcd317d9b MAPREDUCE-4441. Fix build issue caused by MR-3451 (kkambatl via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361387 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 20:42:00 +00:00
Harsh J
af0e0b1676 MAPREDUCE-4432. Confusing warning message when GenericOptionsParser is not used. Contributed by Gabriel Reid. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361273 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 15:22:15 +00:00
Harsh J
bea60b6c86 Reverting MAPREDUCE-4422 from trunk until all comments are addressed 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361107 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 08:52:03 +00:00
Harsh J
48c1a2bdfc MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. Contributed by Ahmed Radwan. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361061 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 07:26:54 +00:00
Harsh J
d9911e923d HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361059 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 07:20:27 +00:00
Eli Collins
bfa51a33d0 HDFS-3306. fuse_dfs: don't lock release operations. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361021 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 00:44:27 +00:00
Alejandro Abdelnur
1ef64e64c0 MAPREDUCE-3451. Port Fair Scheduler to MR2 (pwendell via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361020 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 00:43:01 +00:00
Eli Collins
0f3ba4870b HDFS-799. libhdfs must call DetachCurrentThread when a thread is destroyed. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361008 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-13 00:10:04 +00:00
Eli Collins
e2318c2895 HDFS-3633. libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361005 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 23:52:48 +00:00
Sanjay Radia
6a59f08a15 HDFS-3630 Modify TestPersistBlocks to use both flush and hflush (sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360991 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 22:46:53 +00:00
Eli Collins
4a5ba3b7bd HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360858 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 19:01:49 +00:00
Robert Joseph Evans
26910fd058 MAPREDUCE-4416. Some tests fail if Clover is enabled (Kihwal Lee via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360735 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 15:52:12 +00:00
Aaron Myers
b5b0ac64a1 HADOOP-8541. Better high-percentile latency metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360501 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 01:31:40 +00:00
Aaron Myers
96d77c17cc HADOOP-8585. Fix initialization circularity between UserGroupInformation and HadoopConfiguration. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360498 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 01:22:34 +00:00
Eli Collins
8ced7381a4 HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360485 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-12 00:12:15 +00:00
Eli Collins
4c13b6f34e HADOOP-8587. HarFileSystem access of harMetaCache isn't threadsafe. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360448 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 22:28:54 +00:00
Eli Collins
cdae6953e8 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 17:58:02 +00:00
Aaron Myers
664ca6b75e HDFS-3615. Two BlockTokenSecretManager findbugs warnings. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360255 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 16:09:18 +00:00
Robert Joseph Evans
9c87911c4a HADOOP-8521. Port StreamInputFormat to new Map Reduce API (madhukara phatak via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360238 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 15:44:43 +00:00
Harsh J
e5ea2aa765 HADOOP-3886. Error in javadoc of Reporter, Mapper and Progressable. Contributed by Jingguo Yao. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360222 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 15:06:42 +00:00
Eli Collins
43e37b96f8 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360056 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:21:22 +00:00
Eli Collins
151a1b0185 Revert previous commit, accidentally included HADOOP-8587. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360055 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:19:59 +00:00
Eli Collins
c41b97860d HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360048 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 08:10:00 +00:00
Harsh J
2c27b5826d HDFS-3611. NameNode prints unnecessary WARNs about edit log normally skipping a few bytes. Contributed by Colin Patrick McCabe. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360001 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 03:37:07 +00:00
Harsh J
c81aed0271 HDFS-3613. GSet prints some INFO level values, which aren't really very useful to all. Contributed by Andrew Wang. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359999 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-11 03:15:03 +00:00
Vinod Kumar Vavilapalli
3bfb26ad3b MAPREDUCE-3940. ContainerTokens should have an expiry interval. Contributed by Siddharth Seth and Vinod Kumar Vavilapalli. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359910 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 21:26:48 +00:00
Harsh J
3b5ea87502 HDFS-3629. Fix the typo in the error message about inconsistent storage layout version. Contributed by Brandon Li. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359905 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 21:14:27 +00:00
Eli Collins
8c37dcbde0 Fixup CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359904 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 21:10:15 +00:00
Eli Collins
9a2c19e582 HADOOP-8584. test-patch.sh should not immediately exit when no tests are added or modified. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359902 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 21:05:41 +00:00
Thomas Graves
58a8826fb5 HADOOP-8573. Configuration tries to read from an inputstream resource multiple times (Robert Evans via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359891 13f79535-47bb-0310-9956-ffa450edef68
 2012-07-10 20:50:17 +00:00