big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,963 Commits 2 Branches 2 Tags 264 MiB
7ee5ce3176
Commit Graph

3963 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Robert Joseph Evans
0e9f40df97 MAPREDUCE-4521. mapreduce.user.classpath.first incompatibility with 0.20/1.x (Ravi Prakash via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399011 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 22:00:03 +00:00
Eli Collins
e074b5816a HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399010 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:59:15 +00:00
Robert Joseph Evans
224de4f92c HADOOP-8926. hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (Gopal V via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399005 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:52:10 +00:00
Eli Collins
be2b9d0236 HADOOP-8931. Add Java version to startup message. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398998 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:29:18 +00:00
Suresh Srinivas
0ef9c6f71a HDFS-4059. Add number of stale DataNodes to metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398949 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 19:39:50 +00:00
Robert Joseph Evans
6a059dc40e HADOOP-8922. Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard (Damien Hardy via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398904 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 18:00:01 +00:00
Alejandro Abdelnur
ec43a33e2c HADOOP-8883. Anonymous fallback in KerberosAuthenticator is broken. (rkanter via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398895 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 17:39:27 +00:00
Suresh Srinivas
9757f7407a HADOOP-8923. JNI-based user-group mapping modules can be too chatty on lookup failures. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398883 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 16:52:42 +00:00
Eli Collins
b245adb163 HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398874 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 16:29:21 +00:00
Todd Lipcon
e0db1e9e10 HADOOP-8929. Add toString, other improvements for SampleQuantiles. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398658 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 06:06:20 +00:00
Suresh Srinivas
41eec8a32b HADOOP-8920. Add more javadoc to metrics2 related classes. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398640 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 04:29:50 +00:00
Suresh Srinivas
b7887f31fb HDFS-4052. BlockManager#invalidateWork should print log outside the lock. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398631 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 03:37:49 +00:00
Eli Collins
a75673cbd8 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398612 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 02:12:59 +00:00
Aaron Myers
557ffe2101 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 01:59:46 +00:00
Aaron Myers
f5f763eb15 Update CHANGES.txt to have HDFS-3678 under release 2.0.3 instead of 3.0.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398603 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 01:31:26 +00:00
Todd Lipcon
ded304e6a6 HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398591 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 00:55:29 +00:00
Todd Lipcon
73e9366510 HADOOP-8901. GZip and Snappy support may not work without unversioned libraries. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398416 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 17:44:02 +00:00
Tsz-wo Sze
698fa5077a HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..). Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398293 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 14:05:31 +00:00
Tsz-wo Sze
ad06a08713 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398288 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 13:48:56 +00:00
Jason Darrell Lowe
f8bdac0a1b HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:49:40 +00:00
Suresh Srinivas
611ff4ec89 HADOOP-8910. Add examples to GlobExpander#expand method. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397691 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:03:10 +00:00
Daryn Sharp
22ef03bc76 HADOOP-8784. Improve IPC.Client's token use (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397634 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 16:27:26 +00:00
Suresh Srinivas
89b66da42c HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397580 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 14:32:16 +00:00
Suresh Srinivas
62c70a228f HADOOP-8912. Adding missing CHANGES.txt changes in the previous commit 1397437. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397438 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:57:21 +00:00
Suresh Srinivas
1dd6522903 HADOOP-8912. Add .gitattributes file to prevent CRLF and LF mismatches for source and text files. Contributed by Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397437 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:55:30 +00:00
Suresh Srinivas
94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Suresh Srinivas
e8693d08b2 HADOOP-8918. test-patch.sh is parsing modified files wrong. Contributed by Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397411 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 01:17:10 +00:00
Suresh Srinivas
4e64e6f860 HDFS-4041. Hadoop HDFS Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397362 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 23:10:47 +00:00
Todd Lipcon
7ca007b241 Merge CHANGES for HDFS-3077 into the main CHANGES.txt file 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397352 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 22:51:34 +00:00
Suresh Srinivas
8114457844 HADOOP-8909. Hadoop Common Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397338 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 22:24:11 +00:00
Suresh Srinivas
2887bbb33c HDFS-3912. Detect and avoid stale datanodes for writes. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397211 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 18:08:27 +00:00
Arun Murthy
f174adfc15 MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397182 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 17:21:45 +00:00
Thomas White
3d76be910d YARN-146. Add unit tests for computing fair share in the fair scheduler. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396972 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 10:07:01 +00:00
Todd Lipcon
adb50a3537 Merge HDFS-3077 into trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396943 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 08:11:51 +00:00
Suresh Srinivas
bfce95d463 HADOOP-8878. Uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396922 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 06:30:40 +00:00
Todd Lipcon
ff8f84ccf6 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1396918 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 06:14:26 +00:00
Suresh Srinivas
33c16f2a24 HADOOP-8913. hadoop-metrics2.properties should give units in comment for sampling period. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396904 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 05:17:03 +00:00
Aaron Myers
8078e16015 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396881 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 00:32:46 +00:00
Jason Darrell Lowe
08f35a04c6 HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396798 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 21:15:06 +00:00
Eli Collins
c9a1d4dc33 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396725 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:42:54 +00:00
Thomas Graves
a0a96eb142 HDFS-3824. TestHftpDelegationToken fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396705 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:35:18 +00:00
Siddharth Seth
0e2d93557e YARN-150. Fixes AppRejectedTransition does not unregister a rejected app-attempt from the ApplicationMasterService (Contributed by Bikas Saha) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396429 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 00:08:25 +00:00
Vinod Kumar Vavilapalli
a5ebccd7bc YARN-30. Fixed tests verifying web-services to work on JDK7. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396391 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 22:54:11 +00:00
Vinod Kumar Vavilapalli
bca57d471f YARN-94. Modify DistributedShell to point to main-class by default, clean up the help message, and hard-code the AM class. Contributed by Hitesh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396226 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 19:40:31 +00:00
Thomas White
aa934616dd MAPREDUCE-4654. TestDistCp is ignored. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396047 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 14:37:46 +00:00
Harsh J
0aa8188d18 MAPREDUCE-3678. The Map tasks logs should have the value of input split it processed. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396032 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 13:39:26 +00:00
Harsh J
5c3a331040 MAPREDUCE-4574. Fix TotalOrderParitioner to work with non-WritableComparable key types. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395936 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 09:58:21 +00:00
Siddharth Seth
8ac3910ae0 MAPREDUCE-4705. Fix a bug in job history lookup, which makes older jobs inaccessible despite the presence of a valid history file. (Contributed by Jason Lowe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395850 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 03:23:07 +00:00
Siddharth Seth
1e30e49bf6 YARN-33. Change LocalDirsHandlerService to validate the configured local and log dirs. (Contributed by Mayank Bansal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395844 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 02:26:24 +00:00
Siddharth Seth
c074cfd6f0 YARN-134. Fixes ClientToAMSecretManager creates keys without checking for validity of the appID. (Contributed by Vinod Kumar Vavilapalli) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395841 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 01:56:05 +00:00