big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
17,404 Commits 2 Branches 2 Tags 264 MiB
d6c31a3e6b
Commit Graph

17404 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsz-wo Sze
b9189f7b15 HDFS-2134. Move DecommissionManager to the blockmanagement package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1145393 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-11 23:06:36 +00:00
Tsz-wo Sze
e8eed98feb HADOOP-7361. Provide an option, -overwrite/-f, in put and copyFromLocal shell commands. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144858 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-10 13:28:01 +00:00
Tsz-wo Sze
6ec9b178c6 HDFS-2034. Length in DFSInputStream.getBlockRange(..) becomes -ve when reading only from a currently being written block. Contributed by John George 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144480 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 20:13:26 +00:00
Amar Kamat
787dcfb8cd MAPREDUCE-2596. [Gridmix] Summarize Gridmix runs. (amarrk) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144403 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 17:53:36 +00:00
Todd Lipcon
209fd3f9fc HDFS-2111. Add tests for ensuring that the DN will start with a few bad data directories. Contributed by Harsh J Chouraria. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144100 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 00:16:07 +00:00
Todd Lipcon
86236dd6c4 MAPREDUCE-2249. Check the reflexive property of Counters objects when comparing equality. Contributed by Devaraj K. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144097 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-08 00:01:00 +00:00
Eli Collins
637cdaefc2 HADOOP-7380. Add client failover functionality to o.a.h.io.(ipc|retry). Contributed by Aaron T. Myers 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1144043 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-07 21:16:05 +00:00
Matthew Foley
473b189390 HADOOP-7449. Add Data(In,Out)putByteBuffer to work with ByteBuffer similar to Data(In,Out)putBuffer for byte[]. Merge from yahoo-merge branch, -r 1079163. Fix missing Apache license headers. Contributed by Chris Douglas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143681 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-07 07:05:40 +00:00
Matthew Foley
f9e04d7544 HADOOP-7451. Generalize StringUtils#join. Contributed by Chris Douglas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143624 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-07 01:31:58 +00:00
Matthew Foley
d381ff25f4 HADOOP-7448. Merge from yahoo-merge branch -r 1079157 and -r 1079164: HttpServer /stacks servlet should use plain text content type, without escaping. Contributed by Luke Lu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143613 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-07 00:14:10 +00:00
Matthew Foley
96e62036bf Added Data(In,Out)putByteBuffer to work with ByteBuffer similar to Data(In,Out)putBuffer for byte[]. Contributed by Chris Douglas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143606 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-06 23:14:33 +00:00
Todd Lipcon
952d970480 HADOOP-7419. new hadoop-config.sh doesn't manage classpath for HADOOP_CONF_DIR correctly. Contributed by Bing Zheng and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143511 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-06 18:02:20 +00:00
Matthew Foley
ff0511019c HADOOP-7327. FileSystem.listStatus() throws NullPointerException instead of IOException upon access permission failure. Contributed by Matt Foley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143491 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-06 16:37:19 +00:00
Todd Lipcon
99f0b7d8cd MAPREDUCE-2323. Add metrics to the fair scheduler. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143252 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-06 05:11:42 +00:00
Aaron Myers
d782c40d58 HADOOP-7442. Docs in core-default.xml still reference deprecated config "topology.script.file.name" (atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143219 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-05 22:39:36 +00:00
Todd Lipcon
b908c9eb0e HADOOP-7440. HttpServer.getParameterValues throws NPE for missing parameters. Contributed by Uma Maheswara Rao G and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143212 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-05 22:09:54 +00:00
Tsz-wo Sze
d7f712cd42 HADOOP-7090. Fix resource leaks in s3.INode, BloomMapFile, WritableUtils and CBZip2OutputStream. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143149 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-05 17:28:27 +00:00
Tsz-wo Sze
5c778cdee3 HDFS-1990. Fix resource leaks in BlockReceiver.close(). Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143147 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-05 17:19:07 +00:00
Eli Collins
1e5e03c73c HDFS-1753. Resource Leak in StreamFile. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1143106 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-05 15:31:58 +00:00
Tsz-wo Sze
eadb1a0323 Add .classpath, .project, build and build-fi to svn:ignore. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1142556 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-04 06:20:59 +00:00
Tsz-wo Sze
6d9820ab3d HADOOP-7437. IOUtils.copybytes will suppress the stream closure exceptions. Contributed by Uma Maheswara Rao G 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1142535 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-04 02:39:14 +00:00
Tsz-wo Sze
09c8adfb18 HDFS-2109. Store uMask as member variable to DFSClient.Conf. Contributed by Bharath Mundlapudi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141767 13f79535-47bb-0310-9956-ffa450edef68
 2011-07-01 00:21:51 +00:00
Matthew Foley
7bd41f031f HDFS-2011. Removal and restoration of storage directories on checkpointing failure doesn't work properly. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141748 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-30 23:21:58 +00:00
Eli Collins
3af51887b4 HDFS-2118. Couple dfs data dir improvements. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141713 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-30 20:56:37 +00:00
Matthew Foley
5147e283ad HDFS-1955. FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826. Contributed by Matt Foley. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141658 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-30 18:38:01 +00:00
Eli Collins
f853b52a3b HADOOP-7428. IPC connection is orphaned with null 'out' member. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141638 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-30 17:54:20 +00:00
Eli Collins
8851db12a1 Minor update to HDFS-2110. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141416 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-30 07:05:32 +00:00
Eli Collins
ad95cb1f0d Minor update to HADOOP-7429. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141415 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-30 07:04:58 +00:00
Tsz-wo Sze
61fa4153dc MAPREDUCE-2624. Update RAID for HDFS-2107. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140942 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-29 01:51:34 +00:00
Tsz-wo Sze
09b6f98de4 HDFS-2107. Move block management code from o.a.h.h.s.namenode to a new package o.a.h.h.s.blockmanagement. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140939 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-29 01:31:15 +00:00
Tsz-wo Sze
97b6ca4dd7 Revert 1140913 and 1140909 for HDFS-2107. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140920 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-29 00:26:41 +00:00
Tsz-wo Sze
d58e3efe92 Fix CHANGES.txt (HDFS-2106 should be HDFS-2107) and add NumberReplicas.java. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140913 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-28 23:57:02 +00:00
Tsz-wo Sze
1bcfe45e47 HDFS-2106. Move block management code from o.a.h.h.s.namenode to a new package o.a.h.h.s.blockmanagement. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140909 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-28 23:43:03 +00:00
Eli Collins
1834fb99f5 HDFS-2053. Bug in INodeDirectory#computeContentSummary warning. Contributed by Michael Noll 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140707 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-28 16:21:46 +00:00
Eli Collins
7663caab5a HDFS-2110. StreamFile and ByteRangeInputStream cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140694 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-28 15:59:31 +00:00
Eli Collins
3ebc992e58 HADOOP-7429. Add another IOUtils#copyBytes method. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140442 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-28 05:34:20 +00:00
Aaron Myers
f43e0ffa7e HDFS-1723. quota errors messages should use the same scale. (Jim Plush via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140030 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-27 07:05:50 +00:00
Aaron Myers
b866ff64d9 HADOOP-310. Additional constructor requested in BytesWritable. (Brock Noland via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140010 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-27 03:39:04 +00:00
Tanping Wang
9c83d16c81 HADOOP-7329. Add the capability of getting invividual attribute of a mbean using JMXProxyServlet. (tanping) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139947 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-26 21:52:43 +00:00
Aaron Myers
604383b22d HDFS-1381. HDFS javadocs hard-code references to dfs.namenode.name.dir and dfs.datanode.data.dir parameters (Jim Plush via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139715 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-26 05:39:50 +00:00
Eli Collins
8014dfa1db HADOOP-7206. Support Snappy compression. Contributed by Issei Yoshida and Alejandro Abdelnur 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139476 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-25 01:02:41 +00:00
Aaron Myers
6894edebd9 HDFS-1321. If service port and main port are the same, there is no clear log message explaining the issue. (Jim Plush via atm) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139473 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-25 00:39:29 +00:00
Tsz-wo Sze
d09e2475b6 MAPREDUCE-2620. Update RAID for HDFS-2087. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139400 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-24 18:21:55 +00:00
Aaron Myers
4c4eed13d5 HDFS-2082. SecondaryNameNode web interface doesn't show the right info. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139397 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-24 18:18:55 +00:00
Eli Collins
75de23c0d3 Revert commit 1137690 (HADOOP-7206) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139387 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-24 17:40:15 +00:00
Eli Collins
c37819c08a Revert commit 1137724 (HADOOP-7407) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139386 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-24 17:38:52 +00:00
Tsz-wo Sze
2f48fae72a HDFS-2087. Declare methods in DataTransferProtocol interface, and change Sender and Receiver to implement the interface. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139124 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-23 23:57:18 +00:00
Tanping Wang
1191be630f HADOOP-7385 Remove StringUtils.stringifyException(ie) in logger functions. Contributed by Bharath Mundlapudi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139123 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-23 23:55:30 +00:00
Tsz-wo Sze
fd9997989c HDFS-2092. Remove some object references to Configuration in DFSClient. Contributed by Bharath Mundlapudi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139097 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-23 22:24:59 +00:00
Tanping Wang
42863b9baf HDFS-2086. If the include hosts list contains host names, after restarting namenode, data nodes registration is denied. Contributed by Tanping Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139090 13f79535-47bb-0310-9956-ffa450edef68
 2011-06-23 22:13:58 +00:00