Commit Graph

934 Commits

Author SHA1 Message Date
Tsz-wo Sze
6d9820ab3d HADOOP-7437. IOUtils.copybytes will suppress the stream closure exceptions. Contributed by Uma Maheswara Rao G
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1142535 13f79535-47bb-0310-9956-ffa450edef68
2011-07-04 02:39:14 +00:00
Tsz-wo Sze
09c8adfb18 HDFS-2109. Store uMask as member variable to DFSClient.Conf. Contributed by Bharath Mundlapudi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141767 13f79535-47bb-0310-9956-ffa450edef68
2011-07-01 00:21:51 +00:00
Matthew Foley
7bd41f031f HDFS-2011. Removal and restoration of storage directories on checkpointing failure doesn't work properly. Contributed by Ravi Prakash.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141748 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 23:21:58 +00:00
Eli Collins
3af51887b4 HDFS-2118. Couple dfs data dir improvements. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141713 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 20:56:37 +00:00
Matthew Foley
5147e283ad HDFS-1955. FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826. Contributed by Matt Foley.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141658 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 18:38:01 +00:00
Eli Collins
f853b52a3b HADOOP-7428. IPC connection is orphaned with null 'out' member. Contributed by Todd Lipcon
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141638 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 17:54:20 +00:00
Eli Collins
8851db12a1 Minor update to HDFS-2110.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141416 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 07:05:32 +00:00
Eli Collins
ad95cb1f0d Minor update to HADOOP-7429.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1141415 13f79535-47bb-0310-9956-ffa450edef68
2011-06-30 07:04:58 +00:00
Tsz-wo Sze
61fa4153dc MAPREDUCE-2624. Update RAID for HDFS-2107.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140942 13f79535-47bb-0310-9956-ffa450edef68
2011-06-29 01:51:34 +00:00
Tsz-wo Sze
09b6f98de4 HDFS-2107. Move block management code from o.a.h.h.s.namenode to a new package o.a.h.h.s.blockmanagement.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140939 13f79535-47bb-0310-9956-ffa450edef68
2011-06-29 01:31:15 +00:00
Tsz-wo Sze
97b6ca4dd7 Revert 1140913 and 1140909 for HDFS-2107.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140920 13f79535-47bb-0310-9956-ffa450edef68
2011-06-29 00:26:41 +00:00
Tsz-wo Sze
d58e3efe92 Fix CHANGES.txt (HDFS-2106 should be HDFS-2107) and add NumberReplicas.java.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140913 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 23:57:02 +00:00
Tsz-wo Sze
1bcfe45e47 HDFS-2106. Move block management code from o.a.h.h.s.namenode to a new package o.a.h.h.s.blockmanagement.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140909 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 23:43:03 +00:00
Eli Collins
1834fb99f5 HDFS-2053. Bug in INodeDirectory#computeContentSummary warning. Contributed by Michael Noll
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140707 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 16:21:46 +00:00
Eli Collins
7663caab5a HDFS-2110. StreamFile and ByteRangeInputStream cleanup. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140694 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 15:59:31 +00:00
Eli Collins
3ebc992e58 HADOOP-7429. Add another IOUtils#copyBytes method. Contributed by Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140442 13f79535-47bb-0310-9956-ffa450edef68
2011-06-28 05:34:20 +00:00
Aaron Myers
f43e0ffa7e HDFS-1723. quota errors messages should use the same scale. (Jim Plush via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140030 13f79535-47bb-0310-9956-ffa450edef68
2011-06-27 07:05:50 +00:00
Aaron Myers
b866ff64d9 HADOOP-310. Additional constructor requested in BytesWritable. (Brock Noland via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1140010 13f79535-47bb-0310-9956-ffa450edef68
2011-06-27 03:39:04 +00:00
Tanping Wang
9c83d16c81 HADOOP-7329. Add the capability of getting invividual attribute of a mbean using JMXProxyServlet. (tanping)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139947 13f79535-47bb-0310-9956-ffa450edef68
2011-06-26 21:52:43 +00:00
Aaron Myers
604383b22d HDFS-1381. HDFS javadocs hard-code references to dfs.namenode.name.dir and dfs.datanode.data.dir parameters (Jim Plush via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139715 13f79535-47bb-0310-9956-ffa450edef68
2011-06-26 05:39:50 +00:00
Eli Collins
8014dfa1db HADOOP-7206. Support Snappy compression. Contributed by Issei Yoshida and Alejandro Abdelnur
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139476 13f79535-47bb-0310-9956-ffa450edef68
2011-06-25 01:02:41 +00:00
Aaron Myers
6894edebd9 HDFS-1321. If service port and main port are the same, there is no clear log message explaining the issue. (Jim Plush via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139473 13f79535-47bb-0310-9956-ffa450edef68
2011-06-25 00:39:29 +00:00
Tsz-wo Sze
d09e2475b6 MAPREDUCE-2620. Update RAID for HDFS-2087.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139400 13f79535-47bb-0310-9956-ffa450edef68
2011-06-24 18:21:55 +00:00
Aaron Myers
4c4eed13d5 HDFS-2082. SecondaryNameNode web interface doesn't show the right info. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139397 13f79535-47bb-0310-9956-ffa450edef68
2011-06-24 18:18:55 +00:00
Eli Collins
75de23c0d3 Revert commit 1137690 (HADOOP-7206)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139387 13f79535-47bb-0310-9956-ffa450edef68
2011-06-24 17:40:15 +00:00
Eli Collins
c37819c08a Revert commit 1137724 (HADOOP-7407)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139386 13f79535-47bb-0310-9956-ffa450edef68
2011-06-24 17:38:52 +00:00
Tsz-wo Sze
2f48fae72a HDFS-2087. Declare methods in DataTransferProtocol interface, and change Sender and Receiver to implement the interface.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139124 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 23:57:18 +00:00
Tanping Wang
1191be630f HADOOP-7385 Remove StringUtils.stringifyException(ie) in logger functions. Contributed by Bharath Mundlapudi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139123 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 23:55:30 +00:00
Tsz-wo Sze
fd9997989c HDFS-2092. Remove some object references to Configuration in DFSClient. Contributed by Bharath Mundlapudi
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139097 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 22:24:59 +00:00
Tanping Wang
42863b9baf HDFS-2086. If the include hosts list contains host names, after restarting namenode, data nodes registration is denied. Contributed by Tanping Wang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1139090 13f79535-47bb-0310-9956-ffa450edef68
2011-06-23 22:13:58 +00:00
Tanping Wang
15e68cb374 HDFS-2083 Query JMX statistics over http via JMXJsonServlet. (tanping)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1138645 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 21:42:46 +00:00
Amar Kamat
c7c8f2fe48 MAPREDUCE-2603. Disable High-Ram emulation in system tests. (Vinay Kumar Thota via amarrk)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1138301 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 04:48:53 +00:00
Aaron Myers
a851ce5dcb HDFS-2100. Improve TestStorageRestore. Contributed by Aaron T. Myers.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1138262 13f79535-47bb-0310-9956-ffa450edef68
2011-06-22 00:14:49 +00:00
Tsz-wo Sze
3f190b3e1a HDFS-1568. Improve the log messages in DataXceiver. Contributed by Joey Echeverria
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1138098 13f79535-47bb-0310-9956-ffa450edef68
2011-06-21 17:12:06 +00:00
Thomas White
92aba1eeca HADOOP-7407. Snappy integration breaks HDFS build. Contributed by Alejandro Abdelnur.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1137724 13f79535-47bb-0310-9956-ffa450edef68
2011-06-20 18:02:20 +00:00
Thomas White
7e1e4bf50f HADOOP-7206. Integrate Snappy compression. Contributed by T Jake Luciani.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1137690 13f79535-47bb-0310-9956-ffa450edef68
2011-06-20 16:32:27 +00:00
Eli Collins
e45025c7ce HDFS-420. Fuse-dfs should cache fs handles. Contributed by Brian Bockelman and Eli Collins
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1137675 13f79535-47bb-0310-9956-ffa450edef68
2011-06-20 16:03:11 +00:00
Eli Collins
47b416b346 HADOOP-7402. TestConfiguration doesn't clean up after itself. Contributed by Aaron T. Myers
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1137065 13f79535-47bb-0310-9956-ffa450edef68
2011-06-17 22:53:10 +00:00
Todd Lipcon
5f81b0f421 MAPREDUCE-2550. Fix bin/mapred to work properly from within a source checkout. Contributed by Eric Yang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1137017 13f79535-47bb-0310-9956-ffa450edef68
2011-06-17 20:51:22 +00:00
Jitendra Nath Pandey
7964df9c94 HDFS-1734. 'Chunk size to view' option is not working in Name Node UI. Contributed by Uma Maheswara Rao G.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136975 13f79535-47bb-0310-9956-ffa450edef68
2011-06-17 18:42:23 +00:00
Suresh Srinivas
58dc1381e0 HDFS-1692. In secure mode, Datanode process doesn't exit when disks fail. Contributed by Bharath Mundlapudi.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136741 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 23:35:11 +00:00
Eli Collins
9185f8b003 HDFS-2055. Add hflush support to libhdfs. Contributed by Travis Crawford
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136646 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 20:14:54 +00:00
Matthew Foley
01a407d9df HDFS-1656. Fixes an issue to do with fetching of delegation tokens in HftpFileSystem. Contributed by Kan Zhang.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136608 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 19:04:26 +00:00
Suresh Srinivas
3361e76e30 Moved HDFS-1359 and HDFS-1439 description under trunk.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136565 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 17:45:00 +00:00
Jakob Homan
c52787d287 MAPREDUCE-2576. Typo in comment in SimulatorLaunchTaskAction.java. Contributed by Tim Sell.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136261 13f79535-47bb-0310-9956-ffa450edef68
2011-06-16 01:13:34 +00:00
Mahadev Konar
f5c604f49c HADOOP-6929. RPC should have a way to pass Security information other than protocol annotations. (sharad and omalley via mahadev)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136249 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 23:38:44 +00:00
Suresh Srinivas
53268e2155 HDFS-2073. Add @Override annotation to NameNode. Contributed by Suresh Srinivas.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136230 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 22:41:46 +00:00
Matthew Foley
4c290b51fa HADOOP-7377. Fix command name handling affecting DFSAdmin. Contributed by Daryn Sharp.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136223 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 22:24:07 +00:00
Todd Lipcon
7728f03f08 HADOOP-7379. Add the ability to serialize and deserialize protocol buffers in ObjectWritable. Contributed by Todd Lipcon.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136222 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 22:21:31 +00:00
Aaron Myers
de5bf9d5ca HADOOP-7390. VersionInfo not generated properly in git after unsplit. (todd via atm)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1136220 13f79535-47bb-0310-9956-ffa450edef68
2011-06-15 22:16:36 +00:00