big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,229 Commits 2 Branches 2 Tags 264 MiB
cda2564e1c
Commit Graph

1834 Commits

Author SHA1 Message Date
Aaron Myers
dcd27ff778 Merge trunk into HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1440579 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 18:32:00 +00:00
Konstantin Shvachko
481b6cccf0 HDFS-3598. WebHDFS support for file concat. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 06:51:57 +00:00
Aaron Myers
73066dc958 HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440245 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-30 01:52:14 +00:00
Tsz-wo Sze
f352b4ce0c Merge r1438306 through r1440221 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1440222 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 23:53:59 +00:00
Tsz-wo Sze
6f4fe09687 HDFS-4447. Refactor INodeDirectoryWithSnapshot for supporting general INode diff lists. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1440216 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 23:25:49 +00:00
Kihwal Lee
8acfa66897 HDFS-4288. NN accepts incremental BR as IBR in safemode. contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1440192 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 22:44:35 +00:00
Suresh Srinivas
66ea187228 HDFS-4131. Add capability to namenode to get snapshot diff. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1440152 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 21:31:44 +00:00
Aaron Myers
33cee25aad HADOOP-9190. packaging docs is broken. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439796 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-29 09:17:40 +00:00
Suresh Srinivas
5988208b7d HDFS-4432. Support INodeFileUnderConstructionWithSnapshot in FSImage saving/loading. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1439682 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 22:48:58 +00:00
Suresh Srinivas
58c0c6f069 HDFS-4444. Add space between total transaction time and number of transactions in FSEditLog#printStatistics. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439559 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-28 18:56:37 +00:00
Harsh J
9639f37ee2 HDFS-4259. Improve pipeline DN replacement failure message. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1439126 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-27 17:42:25 +00:00
Tsz-wo Sze
86f6dfb338 HDFS-4443. Remove a trailing '`' character from the HTML code generated by NamenodeJspHelper.generateNodeData(..). Contributed by Christian Rohling 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438808 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-26 01:17:45 +00:00
Tsz-wo Sze
a3bf208386 HDFS-4441. Move INodeDirectoryWithSnapshot.Diff and the related classes to a package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1438782 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-26 00:01:51 +00:00
Tsz-wo Sze
12e8ba804f HDFS-4429. When the latest snapshot exists, INodeFileUnderConstruction should be replaced with INodeFileWithSnapshot but not INodeFile. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1438304 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-25 03:09:26 +00:00
Aaron Myers
c0e16efe91 HDFS-4440. Avoid annoying log message when dfs.domain.socket.path is not set. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1438280 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-25 00:44:37 +00:00
Aaron Myers
554774c6d1 HDFS-4438. TestDomainSocket fails when system umask is set to 0002. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1438279 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-25 00:39:02 +00:00
Tsz-wo Sze
bb80f2fb29 HDFS-4436. Change INode.recordModification(..) to return only the current inode and remove the updateCircularList parameter from some methods in INodeDirectoryWithSnapshot.Diff. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1438203 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-24 21:33:34 +00:00
Tsz-wo Sze
74d1e5c302 Merge r1432789 through r1437840 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1437843 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-24 02:45:45 +00:00
Todd Lipcon
4e74c52e60 HDFS-4433. Make TestPeerCache not flaky. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437680 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 20:01:33 +00:00
Suresh Srinivas
a1e6df6bc4 HDFS-4426. Secondary namenode shuts down immediately after startup. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437627 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 19:00:39 +00:00
Todd Lipcon
797465820b Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437623 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 18:51:24 +00:00
Todd Lipcon
d12f465c67 HDFS-4417. Fix case where local reads get disabled incorrectly. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437616 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 18:38:56 +00:00
Suresh Srinivas
fe3584aadf HDFS-4126. Add reading/writing snapshot information to FSImage. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1437256 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-23 02:48:01 +00:00
Todd Lipcon
cfae13306a HDFS-4403. DFSClient can infer checksum type when not provided by reading first byte. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436730 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-22 02:59:25 +00:00
Todd Lipcon
89bd14913a HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1436568 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-21 19:29:06 +00:00
Aaron Myers
d3d350ef0f HDFS-4359. Slow RPC responses from NN can prevent metrics collection on DNs. Contributed by liang xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1435299 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-18 18:39:24 +00:00
Tsz-wo Sze
b71d386890 HDFS-4098. Add FileWithSnapshot, INodeFileUnderConstructionWithSnapshot and INodeFileUnderConstructionSnapshot for supporting append to snapshotted files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1434966 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 23:38:30 +00:00
Todd Lipcon
52c5b8ea9f HDFS-4418. increase default FileInputStreamCache size. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1434953 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 23:11:30 +00:00
Aaron Myers
b3b9485271 HDFS-4415. HostnameFilter should handle hostname resolution failures and continue processing. Contributed by Robert Kanter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434951 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 23:08:47 +00:00
Suresh Srinivas
8f70a25b1c HDFS-4393. Make empty request and responses in protocol translators can be static final members. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434844 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 18:21:29 +00:00
Todd Lipcon
e322e0a05f HADOOP-9215. when using cmake-2.6, libhadoop.so doesn't get created (only libhadoop.so.1.0.0). Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434530 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-17 01:37:41 +00:00
Thomas Graves
f266efcd10 Preparing for release 0.23.6 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434030 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 16:43:12 +00:00
Tsz-wo Sze
7856221d4a HDFS-4407. Change INodeDirectoryWithSnapshot.Diff.combinePostDiff(..) to merge-sort like and keep the postDiff parameter unmodified. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1433918 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 12:43:51 +00:00
Todd Lipcon
5b0187dcd3 Revert r1433755: HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp. 
This commit caused TestBlockManager to fail.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433820 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 04:22:38 +00:00
Todd Lipcon
27d068b684 HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433755 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-16 00:09:54 +00:00
Todd Lipcon
347cf6e176 HADOOP-8712. Change default hadoop.security.group.mapping to JniBasedUnixGroupsNetgroupMappingWithFallback. Contributed by Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433624 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 20:43:32 +00:00
Suresh Srinivas
4a579d4de9 HDFS-4392. Use NetUtils#getFreeSocketPort in MiniDFSCluster. Contributed by Andrew Purtell. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433578 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 18:47:51 +00:00
Arun Murthy
fabecd7f25 HDFS-4399. Fix RAT warnings by excluding images sub-dir in docs. Contributed by Thomas Graves. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433461 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 15:39:54 +00:00
Tsz-wo Sze
00d318378e HDFS-4397. Fix a bug in INodeDirectoryWithSnapshot.Diff.combinePostDiff(..) that it may put the wrong node into the deleted list. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1433293 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 06:20:22 +00:00
Tsz-wo Sze
397835acdf svn merge -c -1432788 for reverting HDFS-4098. Add FileWithLink, INodeFileUnderConstructionWithLink and INodeFileUnderConstructionSnapshot in order to support append to snapshotted files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1433284 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 04:33:14 +00:00
Eli Collins
e6dbad4f6f HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433275 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 03:25:12 +00:00
Todd Lipcon
2f4e2c607e Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433249 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:42:06 +00:00
Todd Lipcon
2fd41b3b42 HDFS-4402. Some small DomainSocket fixes: avoid findbugs warning, change log level, etc. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433242 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:31:35 +00:00
Suresh Srinivas
8767a37b9b HDFS-4375. Use token request messages defined in hadoop common. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433235 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:26:23 +00:00
Todd Lipcon
d79868d3e5 Add branch-specific CHANGES.txt file to RAT excludes list 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433232 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:20:34 +00:00
Todd Lipcon
35a145d92f HDFS-4401. Fix bug in DomainSocket path validation. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433229 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-15 00:12:47 +00:00
Suresh Srinivas
6dbc7e03e5 HDFS-4369. GetBlockKeysResponseProto does not handle null response. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433206 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:13:27 +00:00
Suresh Srinivas
0671176111 HDFS-4364. GetLinkTargetResponseProto does not handle null path. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433194 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 23:01:39 +00:00
Todd Lipcon
d08b1af26a HDFS-4400. DFSInputStream#getBlockReader: last retries should ignore the cache. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433144 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 21:34:22 +00:00
Todd Lipcon
12bf674e8e Merge trunk into branch. 
Fixed a couple trivial conflicts due to HDFS-4363, which moved some methods
from HdfsProtoUtil to PBHelper


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433133 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 21:12:16 +00:00
Todd Lipcon
3052ad1f00 HDFS-3429. DataNode reads checksums even if client does not need them. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433117 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 20:47:08 +00:00
Thomas Graves
e26da77544 HDFS-4385. Maven RAT plugin is not checking all source files (tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432933 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 14:36:40 +00:00
Tsz-wo Sze
686e13db2f HDFS-4395. In INodeDirectorySnapshottable's constructor, the passed-in dir could be an INodeDirectoryWithSnapshot. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432838 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 08:40:13 +00:00
Tsz-wo Sze
90d6d55a4b Merge r1426019 through r1432788 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432796 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 03:44:35 +00:00
Tsz-wo Sze
25116c26fd HDFS-4098. Add FileWithLink, INodeFileUnderConstructionWithLink and INodeFileUnderConstructionSnapshot in order to support append to snapshotted files. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432788 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-14 02:30:15 +00:00
Tsz-wo Sze
bc0aff27a4 HDFS-4245. Include snapshot related operations in TestOfflineEditsViewer. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432592 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-13 11:29:14 +00:00
Konstantin Shvachko
43f17f6e10 HDFS-1245. Change typo in Pluggable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432542 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-13 01:31:10 +00:00
Konstantin Shvachko
06406d7056 HDFS-1245. Plugable block id generation. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432539 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-13 01:13:29 +00:00
Todd Lipcon
d2737575ad HDFS-4390. Bypass UNIX domain socket unit tests when they cannot be run. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432350 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-12 01:19:27 +00:00
Todd Lipcon
6f8ee865de HDFS-4388. DomainSocket should throw AsynchronousCloseException when appropriate. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432339 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-12 00:12:30 +00:00
Todd Lipcon
9a4030e0e8 HDFS-4356. BlockReaderLocal should use passed file descriptors rather than paths. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432335 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 23:52:22 +00:00
Eli Collins
e1a3043382 Update CHANGES.txt to reflect HDFS-4274 merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432316 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 22:19:24 +00:00
Suresh Srinivas
ad1cd71b10 HDFS-4381. Merge change r1432149 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432247 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 19:42:11 +00:00
Suresh Srinivas
93c1b4b25a Merge r1414455:r1426018 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1432246 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 19:40:23 +00:00
Eli Collins
c4976aee4b Update CHANGES.txt to move HDFS-4328. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432227 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 18:56:23 +00:00
Eli Collins
ebfa3ab1fa HDFS-4384. test_libhdfs_threaded gets SEGV if JNIEnv cannot be initialized. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432221 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 18:47:52 +00:00
Suresh Srinivas
bbc21ad5d4 HDFS-4381. Document fsimage format details in FSImageFormat class javadoc. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432149 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 16:57:12 +00:00
Aaron Myers
91c28d4409 HDFS-4328. TestLargeBlock#testLargeBlockSize is timing out. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431867 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 03:44:36 +00:00
Eli Collins
82b218c605 HDFS-4377. Some trivial DN comment cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431753 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-11 00:09:37 +00:00
Suresh Srinivas
be5509c537 HDFS-4382. Fix typo MAX_NOT_CHANGED_INTERATIONS. Contributed by Ted Yu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431726 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 23:20:46 +00:00
Suresh Srinivas
2bd35d8de3 HDFS-4367. GetDataEncryptionKeyResponseProto does not handle null response. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431459 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 16:03:37 +00:00
Eli Collins
6449f52455 HDFS-4032. Specify the charset explicitly rather than rely on the default. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431179 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-10 02:30:05 +00:00
Aaron Myers
7e599d9e3b HADOOP-9155. FsPermission should have different default value, 777 for directory and 666 for file. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431148 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 23:30:41 +00:00
Aaron Myers
3555e7c574 HDFS-4306. PBHelper.convertLocatedBlock miss convert BlockToken. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431117 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 22:29:41 +00:00
Todd Lipcon
d94621a0cd HDFS-4354. Create DomainSocket and DomainPeer and associated unit tests. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431102 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:37:34 +00:00
Todd Lipcon
c9db06f2e4 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431097 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:34:13 +00:00
Suresh Srinivas
3cd17b614e HDFS-4363. Combine PBHelper and HdfsProtoUtil and remove redundant methods. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431088 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 21:20:38 +00:00
Tsz-wo Sze
2d4097840c HDFS-4244. Support snapshot deletion. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1430953 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 16:44:05 +00:00
Tsz-wo Sze
eae2a30462 HDFS-4261. Fix bugs in Balaner causing infinite loop and TestBalancerWithNodeGroup timeing out. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430917 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 15:55:49 +00:00
Tsz-wo Sze
fab2cbc2c1 svn merge -c -1428729 . for reverting HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430663 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 02:41:34 +00:00
Tsz-wo Sze
837e17b2ea svn merge -c -1430507 . for reverting HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430662 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-09 02:39:15 +00:00
Eli Collins
4ca58bd57c HDFS-4035. LightWeightGSet and LightWeightHashSet increment a volatile without synchronization. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430595 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 22:43:40 +00:00
Eli Collins
6d4a091567 HDFS-4034. Remove redundant null checks. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430585 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 22:38:36 +00:00
Eli Collins
7c91f59ee5 Updated CHANGES.txt to add HDFS-4033. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430581 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 22:36:45 +00:00
Eli Collins
5cdb7e5ce7 HDFS-4033. Miscellaneous findbugs 2 fixes. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430534 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 21:05:33 +00:00
Todd Lipcon
239b2742d0 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430507 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 20:44:09 +00:00
Eli Collins
db99f7f67d HDFS-4031. Update findbugsExcludeFile.xml to include findbugs 2 exclusions. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430468 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 19:51:44 +00:00
Eli Collins
43295b9f7b HDFS-4030. BlockManager excessBlocksCount and postponedMisreplicatedBlocksCount should be AtomicLongs. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430462 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 19:41:04 +00:00
Suresh Srinivas
18e731074e HDFS-4362. GetDelegationTokenResponseProto does not handle null token. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430137 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-08 04:28:45 +00:00
Aaron Myers
d3949058b8 HDFS-3970. Fix bug causing rollback of HDFS upgrade to result in bad VERSION file. Contributed by Vinay and Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430037 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 21:47:41 +00:00
Tsz-wo Sze
6a76ec14ad HDFS-4351. In BlockPlacementPolicyDefault.chooseTarget(..), numOfReplicas needs to be updated when avoiding stale nodes. Contributed by Andrew Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429653 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 03:05:08 +00:00
Tsz-wo Sze
93872b58e5 HDFS-4230. Support listing of all the snapshottable directories. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1429643 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-07 01:43:21 +00:00
Suresh Srinivas
251b485af5 HADOOP-9173. Add security token protobuf definition to common and use it in hdfs. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428972 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 16:49:49 +00:00
Tsz-wo Sze
f96d0a3585 HDFS-4357. Fix a bug that if an inode is replaced, further INode operations should apply to the new inode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1428780 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 10:45:57 +00:00
Tsz-wo Sze
2c15726999 HDFS-4270. Introduce soft and hard limits for max replication so that replications of the highest priority are allowed to choose a source datanode that has reached its soft limit but not the hard limit. Contributed by Derek Dagit 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428739 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 08:09:43 +00:00
Todd Lipcon
32052a1e3a HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428729 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-04 06:59:12 +00:00
Todd Lipcon
228de3c987 HDFS-4302. Fix fatal exception when starting NameNode with DEBUG logs. Contributed by Eugene Koontz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428590 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 20:55:05 +00:00
Tsz-wo Sze
36c5fe9961 HDFS-4346. Add SequentialNumber as a base class for INodeId and GenerationStamp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428167 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 05:12:40 +00:00
Aaron Myers
6f0eb6f5b1 HDFS-4338. TestNameNodeMetrics#testCorruptBlock is flaky. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428144 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-03 02:25:08 +00:00
Konstantin Shvachko
7b70a688ac HDFS-4349. Add test for reading files from BackupNode. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1427290 13f79535-47bb-0310-9956-ffa450edef68
 2013-01-01 03:39:31 +00:00
Konstantin Shvachko
df09a85ca9 HDFS-4347. Avoid infinite waiting checkpoint to complete in TestBackupNode. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426705 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-29 04:26:54 +00:00
Konstantin Shvachko
fc105796d1 HDFS-4308. addBlock() should persist file blocks once. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426700 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-29 04:11:58 +00:00
Tsz-wo Sze
c82961be0f HDFS-4330. Support snapshots up to the snapshot limit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1426432 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-28 08:49:33 +00:00
Tsz-wo Sze
0fa9c7a825 HDFS-4334. Add a unique id to INode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1426429 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-28 08:26:33 +00:00
Arun Murthy
8a576d67a1 HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425560 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-24 00:14:59 +00:00
Arun Murthy
30cb35bd35 Reverting HDFS-4326 since it caused 'mvn package' to break. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425399 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-23 03:51:36 +00:00
Tsz-wo Sze
b9f965de12 HDFS-4103. Support O(1) snapshot creation. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1424782 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-21 01:30:49 +00:00
Alejandro Abdelnur
b324a6134e HADOOP-8427. Convert Forrest docs to APT, incremental. (adi2 via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424459 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-20 13:41:43 +00:00
Alejandro Abdelnur
4e73119e1a HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424062 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-19 20:00:03 +00:00
Aaron Myers
a1279e68bf HDFS-4140. fuse-dfs handles open(O_TRUNC) poorly. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423257 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-18 02:38:14 +00:00
Aaron Myers
721095474d HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422778 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-17 07:52:32 +00:00
Tsz-wo Sze
cbbaa93ae0 HDFS-4317. Change INode and its subclasses to support HDFS-4103. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1422748 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-17 03:40:27 +00:00
Suresh Srinivas
3363c45d69 HDFS-4275. MiniDFSCluster-based tests fail on Windows due to failure to delete test namenode directory. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422278 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 15:50:52 +00:00
Suresh Srinivas
8aee71d1bc HDFS-4274. BlockPoolSliceScanner does not close verification log during shutdown. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422276 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-15 15:31:18 +00:00
Aaron Myers
f6f7152995 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421572 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-13 22:09:02 +00:00
Aaron Myers
23586e1ae5 HDFS-4310. fix test org.apache.hadoop.hdfs.server.datanode.TestStartSecureDataNode Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1421560 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-13 21:45:15 +00:00
Sanjay Radia
cd80628ec4 HADOOP-8957 AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420965 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 20:54:30 +00:00
Suresh Srinivas
aa208941d1 HDFS-4296. Reserve layout version for release 1.2.0. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420700 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 14:26:15 +00:00
Suresh Srinivas
f31b8270db HDFS-4269. Datanode rejects all datanode registrations from localhost in single-node developer setup on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420492 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-12 00:14:26 +00:00
Tsz-wo Sze
99d072d072 svn -c -1419192 . for reverting HDFS-4261 since TestBalancerWithNodeGroup failed in the recent Jenkins builds. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420010 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 06:17:35 +00:00
Aaron Myers
47ae6831e9 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419949 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-11 00:52:17 +00:00
Suresh Srinivas
39d25fbac3 HDFS-4293. Fix TestSnapshot failure. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1419882 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 23:54:26 +00:00
Aaron Myers
6e82da0dea HDFS-4294. Backwards compatibility is not maintained for TestVolumeId. Contributed by Ivan A. Veselovsky and Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419875 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 23:46:10 +00:00
Todd Lipcon
64cbb3c2ff HDFS-4295. Using port 1023 should be valid when starting Secure DataNode. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419854 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 22:46:46 +00:00
Todd Lipcon
cb9f516756 HDFS-4292. Sanity check not correct in RemoteBlockReader2.newBlockReader. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419675 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 19:13:03 +00:00
Todd Lipcon
8114bcc6d3 HDFS-4291. edit log unit tests leave stray test_edit_log_file around. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419663 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 18:54:59 +00:00
Uma Maheswara Rao G
103eff1fad HDFS-4130. BKJM: The reading for editlog at NN starting using bkjm is not efficient. Contributed by Han Xiao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419649 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 18:42:53 +00:00
Tsz-wo Sze
f4a723249e Merge r1415804 through r1419190 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1419193 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 03:37:32 +00:00
Tsz-wo Sze
8f5bd5f1bc HDFS-4261. Fix bugs in Balancer that it does not terminate in some cases and it checks BlockPlacementPolicy instance incorrectly. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419192 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-10 03:31:34 +00:00
Aaron Myers
e7cb3fd39c HDFS-4279. NameNode does not initialize generic conf keys when started with -recover. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418559 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 23:52:08 +00:00
Sanjay Radia
ad619d34d0 HDFS-4260 Fix HDFS tests to set test dir to a valid HDFS path as opposed to the local build path (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418424 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 18:32:27 +00:00
Suresh Srinivas
e1ba3f8158 HDFS-4236. Remove artificial limit on username length introduced in HDFS-4171. Contributed by Alejandro Abdelnur. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418356 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 15:23:49 +00:00
Todd Lipcon
6681523c87 HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418214 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-07 08:18:14 +00:00
Aaron Myers
df2fb006b2 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418114 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 22:27:27 +00:00
Konstantin Shvachko
8bb0dc34e4 HDFS-4268. Remove redundant enum NNHAStatusHeartbeat.State. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417752 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-06 07:20:20 +00:00
Todd Lipcon
adb8941cc2 HDFS-4238. Standby namenode should not do purging of shared storage edits. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417651 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 21:18:06 +00:00
Todd Lipcon
d6c50b4a67 Move QJM-related backports into 2.0.3 release section in CHANGES.txt after backport to branch-2 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417601 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 19:33:05 +00:00
Aaron Myers
6cc49f1a8b HDFS-4199. Provide test for HdfsVolumeId. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417263 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-05 01:45:29 +00:00
Tsz-wo Sze
1f4b135b1f HDFS-4234. Use generic code for choosing datanode in Balancer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417130 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-04 19:22:51 +00:00
Suresh Srinivas
9821af9ce8 Reverting the previous merge r1416603 which committed some extra changes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1416712 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 22:43:00 +00:00
Tsz-wo Sze
c0a8957c2b HDFS-4243. When replacing an INodeDirectory, the parent pointers of the children of the child have to be updated to the new child. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416709 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 22:38:33 +00:00
Tsz-wo Sze
8f7c92094d HDFS-4240. For nodegroup-aware block placement, when a node is excluded, the nodes in the same nodegroup should also be excluded. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416691 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 21:59:36 +00:00
Suresh Srinivas
d500d59cbe Merging trunk to HDFS-2802 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1416603 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-03 18:04:51 +00:00
Konstantin Shvachko
cbed126eec HDFS-4231. BackupNode: Introduce BackupState. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416288 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-02 23:17:03 +00:00
Harsh J
5954e4f1ac HDFS-3358. Specify explicitly that the NN UI status total is talking of persistent objects on heap. Contributed by Harsh J. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416245 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-02 20:05:54 +00:00
Tsz-wo Sze
88eea21572 HDFS-4248. Renaming directories may incorrectly remove the paths in leases under the tree. Contributed by daryn 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416064 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-01 22:29:54 +00:00
Daryn Sharp
64fe19e0d4 HDFS-4247. saveNamespace should be tolerant of dangling lease (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1416034 13f79535-47bb-0310-9956-ffa450edef68
 2012-12-01 18:18:58 +00:00
Tsz-wo Sze
6ad4752853 Merge r1414455 through r1415803 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1415809 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:52:49 +00:00
Tsz-wo Sze
571da54179 HDFS-4213. Add an API to hsync for updating the last block length at the namenode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415799 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:24:30 +00:00
Aaron Myers
d866f81edb Reverting initial commit of HDFS-3680 pending further comments. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415797 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:19:01 +00:00
Aaron Myers
a85a0293c7 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415794 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 19:11:24 +00:00
Tsz-wo Sze
6b08d7de5f HDFS-4242. Map.Entry is incorrectly used in LeaseManager since the behavior of it is undefined after the iteration or modifications of the map. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415480 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-30 02:51:25 +00:00
Tsz-wo Sze
1634e980af HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414874 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 19:19:27 +00:00
Aaron Myers
2b8824853b HDFS-4214. OfflineEditsViewer should print out the offset at which it encountered an error. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414500 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-28 01:38:31 +00:00
Tsz-wo Sze
1ce3274dd5 Merge r1412283 through r1414454 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1414456 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 23:02:00 +00:00
Tsz-wo Sze
9047eb5162 HDFS-4209. Clean up the addNode/addChild/addChildNoQuotaCheck methods in FSDirectory and INodeDirectory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414447 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-27 22:36:20 +00:00
Suresh Srinivas
7e56bfe405 HDFS-4200. Reduce the size of synchronized sections in PacketResponder. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413826 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-26 20:47:58 +00:00
Tsz-wo Sze
3dd84fcef7 Merge r1410998 through r1412282 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1412297 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 21:08:45 +00:00
Tsz-wo Sze
0f1899ee19 HDFS-4216. Do not ignore QuotaExceededException when adding symlinks. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412237 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 19:27:48 +00:00
Thomas White
d6af507199 HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412077 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 12:29:37 +00:00
Tsz-wo Sze
506938f0b3 HDFS-4215. Remove locking from addToParent(..) since it is used in image loading, and add INode.isFile(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411947 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-21 00:13:53 +00:00
Eli Collins
c3f13a7fef HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Contributed by Colin McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411879 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 21:13:48 +00:00
Suresh Srinivas
f83f2300cf HDFS-4175. Add the jira to CHANGES.HDFS-2802.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1411690 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 14:49:21 +00:00
Konstantin Shvachko
573c41c266 HDFS-4179. BackupNode: allow reads, fix checkpointing, safeMode. (shv) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411508 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 02:00:20 +00:00
Suresh Srinivas
1253e02f66 HDFS-4175. Additional snapshot tests for more complicated directory structure and modifications. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1411503 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-20 01:51:19 +00:00
Daryn Sharp
c944d0666c HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411229 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-19 15:04:28 +00:00
Tsz-wo Sze
d8ffea5943 Merge r1408927 through r1410997 from trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1411007 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 22:31:28 +00:00
Tsz-wo Sze
d66f9e8269 HDFS-4206. Change the fields in INode and its subclasses to private. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410996 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 22:03:11 +00:00
Tsz-wo Sze
9bed64a6fc HDFS-4196. Support renaming of snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1410986 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 20:44:10 +00:00
Alejandro Abdelnur
6f80a2a76c HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410824 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 04:10:29 +00:00
Eli Collins
ecbb41923c HDFS-4156. Seeking to a negative position should throw an IOE. Contributed by Eli Reisman 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410812 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-18 02:11:50 +00:00
Jitendra Nath Pandey
1cbc38a878 HDFS-4105. The SPNEGO user for secondary namenode should use the web keytab. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410691 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-17 03:30:48 +00:00
Aaron Myers
320c32a289 HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410587 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 21:51:39 +00:00
Todd Lipcon
51ca2fd3e9 HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410584 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-16 21:45:48 +00:00
Tsz-wo Sze
b5a2dd19c4 HDFS-4187. Add tests for replication handling in snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1410097 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 23:08:25 +00:00
Tsz-wo Sze
8ca8687fb2 HDFS-4188. Add Snapshot.ID_COMPARATOR for comparing IDs and fix a bug in ReadOnlyList.Util.binarySearch(..). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1410027 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 21:34:54 +00:00
Eli Collins
96f28d878e HDFS-4100. Fix all findbug security warings. Contributed by Liang Xie 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409995 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 20:37:41 +00:00
Daryn Sharp
298eb42657 HDFS-4186. logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409988 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 20:33:30 +00:00
Uma Maheswara Rao G
8a2de21315 HDFS-3623. BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409905 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 18:25:55 +00:00
Daryn Sharp
97e52dd71e HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409848 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 15:51:03 +00:00
Robert Joseph Evans
d158daecb5 Updated CHANGES.txt in preparation for 0.23.5 release 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409818 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-15 14:57:23 +00:00
Robert Joseph Evans
59e4199d84 HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409311 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 19:21:25 +00:00
Robert Joseph Evans
b2456ca3b8 svn merge -r 1409087:1409086 reverting HDFS-4171 until test failures can be fixed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409266 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 17:32:55 +00:00
Eli Collins
a780f0ac33 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409088 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 06:17:19 +00:00
Alejandro Abdelnur
368f628ce5 HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409087 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 06:12:03 +00:00
Uma Maheswara Rao G
0800aa90dd HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409071 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 03:10:10 +00:00
Suresh Srinivas
a5976bee37 Moving HDFS-4106 to Release 2.0.3 section in CHANGES.txt. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409038 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-14 00:02:53 +00:00
Suresh Srinivas
2116d0520e HDFS-4148. Disallow write/modify operations on files and directories in a snapshot. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1409023 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 23:26:40 +00:00
Tsz-wo Sze
2a9f450511 Merge r1407704 through r1408926 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1408938 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 20:21:39 +00:00
Tsz-wo Sze
099762a0bc HDFS-4177. Add a snapshot parameter to INodeDirectory.getChildrenList() for selecting particular snapshot children list views. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1408923 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 19:59:55 +00:00
Daryn Sharp
4741064250 HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408779 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 15:29:04 +00:00
Eli Collins
3492ab6de0 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 01:28:33 +00:00
Aaron Myers
b3e42a1ed5 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408531 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-13 01:26:20 +00:00
Eli Collins
c1a2098304 HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408477 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 22:20:43 +00:00
Robert Joseph Evans
7ff7f67a82 HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408401 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 18:51:27 +00:00
Thomas White
42f4691ead Add new files missed from HADOOP-8860 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408288 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-12 13:54:27 +00:00
Tsz-wo Sze
40fe1ffbaa Merge r1406415 through r1407703 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1407706 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-10 00:49:15 +00:00
Tsz-wo Sze
5120bfca0a HDFS-4170. Add snapshot information to INodesInPath. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1407703 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-10 00:27:59 +00:00
Alejandro Abdelnur
9d5205aadd HADOOP-8860. Split MapReduce and YARN sections in documentation navigation. (tomwhite via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407658 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 21:44:00 +00:00
Suresh Srinivas
a4b1c675b6 Moving HDFS-4080 to Incompatible Change section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407567 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 18:09:21 +00:00
Suresh Srinivas
db71de2e11 HDFS-4080. Add a separate logger for block state change logs to enable turning off those logs. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407566 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 18:07:04 +00:00
Suresh Srinivas
c7ab9779d2 HDFS-4162. Some malformed and unquoted HTML strings are returned from datanode web ui. Contributed by Darek Dagit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407556 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 17:39:20 +00:00
Eli Collins
312eb23598 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407345 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 02:57:05 +00:00
Daryn Sharp
be94bf6b57 HDFS-3990. NN's health report has severe performance problems (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407333 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-09 00:53:11 +00:00
Suresh Srinivas
0f7a4337ac HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407245 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 19:54:55 +00:00
Konstantin Shvachko
d511052be5 Move HDFS-3625 and HDFS-4138 under 2.0.3 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407189 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 18:01:38 +00:00
Uma Maheswara Rao G
f1fe91ec95 HDFS-3810. Implement format() for BKJM. Contributed by Ivan Kelly. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407182 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-08 17:45:46 +00:00
Tsz-wo Sze
b94cf83a11 HDFS-4159. Rename should fail when the destination directory is snapshottable and has snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406771 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 19:38:29 +00:00
Tsz-wo Sze
8a577a16f9 HDFS-4150. Update the inode in the block map when a snapshotted file or a snapshot file is deleted. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406763 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 19:30:36 +00:00
Konstantin Shvachko
c44f37a7a5 Move HDFS-3625 under 0.23.5 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406739 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 17:59:35 +00:00
Konstantin Shvachko
1ab97373de HDFS-4138. BackupNode startup fails due to uninitialized edit log. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406734 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 17:45:01 +00:00
Aaron Myers
817a26b6c8 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by liang xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406473 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 06:29:37 +00:00
Tsz-wo Sze
7160c01f61 Merge r1406327 through r1406414 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406415 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 01:03:16 +00:00
Suresh Srinivas
c013142a12 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406413 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-07 00:48:17 +00:00
Tsz-wo Sze
1e7010cf38 HDFS-3979. For hsync, datanode should wait for the local sync to complete before sending ack. Contributed by Lars Hofhansl 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406382 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:34:29 +00:00
Suresh Srinivas
251230a126 HADOOP-9004. Reverting the commit r1406202 to address patch issue 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406379 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:23:51 +00:00
Todd Lipcon
a3f3a6c5a3 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406372 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 22:05:34 +00:00
Tsz-wo Sze
92c440c115 Merge r1406007 through r1406326 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406337 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 21:11:42 +00:00
Tsz-wo Sze
1734215a10 HDFS-4152. Add a new class BlocksMapUpdateInfo for the parameter in INode.collectSubtreeBlocksAndClear(..). Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406326 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 21:04:32 +00:00
Daryn Sharp
54b70db347 HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406278 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 19:27:47 +00:00
Suresh Srinivas
b13a5cdcb7 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406202 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 16:12:43 +00:00
Daryn Sharp
3a698e6aea HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406198 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 15:57:58 +00:00
Suresh Srinivas
dca8dd7a20 Add HDFS-4046 to Release 2.0.3 section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406019 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-06 00:22:23 +00:00
Tsz-wo Sze
34413c2000 svn merge -c 1406006 from trunk for HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1406014 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:56:53 +00:00
Suresh Srinivas
159e507995 HDFS-4046. Adding the missed file in revision 1406011 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406012 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:50:29 +00:00
Suresh Srinivas
e0ce1b2475 HDFS-4046. Rename ChecksumTypeProto enum NULL since it is illegal in C/C++. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406011 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:49:33 +00:00
Tsz-wo Sze
7ee5ce3176 HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406006 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 23:26:34 +00:00
Tsz-wo Sze
b3bc2fb76e HDFS-4147. When there is a snapshot in a subtree, deletion of the subtree should fail. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405688 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 01:22:54 +00:00
Tsz-wo Sze
f84000900a HDFS-4149. Implement the disallowSnapshot(..) in FSNamesystem and add resetSnapshottable(..) to SnapshotManager. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405683 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-05 00:40:54 +00:00
Tsz-wo Sze
deaf979d41 HDFS-4146. Use getter and setter in INodeFileWithLink to access blocks and initialize root directory as snapshottable. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405648 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-04 22:00:13 +00:00
Tsz-wo Sze
554fb4d2b2 Merge r1404624 through r1405251 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405253 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-03 01:38:41 +00:00
Tsz-wo Sze
e5a7b3d430 HDFS-4141. Support directory diff - the difference between the current state and a previous snapshot of an INodeDirectory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1405250 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-03 01:31:51 +00:00
Tsz-wo Sze
d174f574ba HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405237 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-03 00:20:03 +00:00
Todd Lipcon
a9e4b08f2b HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405149 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 20:35:51 +00:00
Daryn Sharp
19befa0748 HDFS-3804. TestHftpFileSystem fails intermittently with JDK7 (Trevor Robinson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404985 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 14:56:22 +00:00
Suresh Srinivas
77fe43ac14 HDFS-4095. Add some snapshot related metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404881 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 05:01:10 +00:00
Suresh Srinivas
98c0f13b19 HDFS-4116. Add auditlog for some snapshot operations. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404860 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-02 02:26:58 +00:00
Suresh Srinivas
8b71399abb HDFS-4133. Add testcases for testing basic snapshot functionalities. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404498 13f79535-47bb-0310-9956-ffa450edef68
 2012-11-01 08:29:41 +00:00
Tsz-wo Sze
e341184d54 Merge r1403306 through r1404284 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1404285 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 18:34:51 +00:00
Suresh Srinivas
f3b9963d46 HDFS-4118. Change INodeDirectory.getExistingPathINodes(..) to work with snapshots. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403959 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 03:13:20 +00:00
Suresh Srinivas
07e0d7730d HDFS-4129. Add utility methods to dump NameNode in memory tree for testing. Contributed by Tsz Wo (Nicholas), SZE. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403956 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-31 02:33:44 +00:00
Suresh Srinivas
cd0d206bb8 HDFS-3916. libwebhdfs testing code cleanup. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403922 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 23:12:12 +00:00
Uma Maheswara Rao G
b2822e3742 Moved HDFS-3809 entry in CHANGES.txt from trunk to 2.0.3-alpha section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403769 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 16:32:01 +00:00
Uma Maheswara Rao G
7ccdb67d5c Moved HDFS-3789 entry in CHANGES.txt from trunk to 2.0.3-alpha section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403765 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 16:22:42 +00:00
Uma Maheswara Rao G
52df4b3e78 Moved HDFS-3695 entry in CHANGES.txt from trunk to 2.0.3-alpha section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403748 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 15:51:49 +00:00
Uma Maheswara Rao G
1e07fece6e Moved HDFS-3573 entry in CHANGES.txt from trunk to 2.0.3-alpha section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403740 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 15:38:12 +00:00
Daryn Sharp
deef03c5d6 HADOOP-8994. TestDFSShell creates file named "noFileHere", making further tests hard to understand (Andy Isaacson via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403714 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 14:21:00 +00:00
Suresh Srinivas
7604a276a7 HDFS-4127. Log message is not correct in case of short of replica. Contributed by Junping Du. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403616 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-30 05:48:58 +00:00
Suresh Srinivas
ba7a2e3898 Moved HDFS-4122 to Release 2.0.3 section. It is also moved to Incompatible Changes section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403570 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 22:43:58 +00:00
Suresh Srinivas
783124488c Merging changes from trunk to pick HDFS-4124 changes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403306 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:17:28 +00:00
Suresh Srinivas
1b3b09d947 HDFS-4124. Refactor INodeDirectory#getExistingPathINodes() to enable returningmore than INode array. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403304 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:11:04 +00:00
Suresh Srinivas
564adec5b5 Merging trunk to HDFS-2802 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403301 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 14:09:47 +00:00
Suresh Srinivas
4bcf516d0e HDFS-3920. libwebdhfs string processing and using strerror consistently to handle all errors. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403173 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-29 05:10:29 +00:00
Suresh Srinivas
cea7bbc630 HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403120 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 23:10:53 +00:00
Tsz-wo Sze
f60a844e7a HDFS-4119. Complete the allowSnapshot code and add a test for it. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1403087 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 20:02:54 +00:00
Suresh Srinivas
fd7de4c4eb HDFS-4106. BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be volatile. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403075 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 19:03:57 +00:00
Suresh Srinivas
abe3676e50 HDFS-4115. TestHDFSCLI.testAll fails one test due to number format. Contributed by Trevor Robinson. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403074 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-28 18:59:11 +00:00
Suresh Srinivas
b6d09f67ab Moving HDFS-4121 from trunk to Release 2.0.3 section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402843 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-27 18:41:43 +00:00
Suresh Srinivas
cd2e9d2fce HDFS-4121. Add namespace declarations in hdfs .proto files for languages other than java. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402836 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-27 18:25:02 +00:00
Suresh Srinivas
9e26fdcda7 HDFS-4111. Support snapshot of subtrees. Contributed by Tsz Wo (Nicholas), Sze. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402684 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 22:02:30 +00:00
Tsz-wo Sze
3335e50244 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402608 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:22:49 +00:00
Tsz-wo Sze
b5355e5050 Merge r1402274 through r1402603 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402605 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:17:03 +00:00
Tsz-wo Sze
0e796b61e8 HDFS-4112. A few improvements on INodeDirectory include adding a utility method for casting; avoiding creation of new empty lists; cleaning up some code and rewriting some javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402599 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-26 18:08:38 +00:00
Tsz-wo Sze
719279ea8a HDFS-4092. Update file deletion logic for snapshot so that the current inode is removed from the circular linked list; and if some blocks at the end of the block list no longer belong to any other inode, collect them and update the block list. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402287 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 19:32:26 +00:00
Tsz-wo Sze
40d2b6f308 Merge r1401869 through r1402273 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1402278 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 19:09:34 +00:00
Tsz-wo Sze
2d74f68054 HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402270 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:53:25 +00:00
Tsz-wo Sze
ba2ee1d7fb HDFS-4107. Add utility methods for casting INode to INodeFile and INodeFileUnderConstruction. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402265 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:44:46 +00:00
Suresh Srinivas
163577f905 HDFS-4067. TestUnderReplicatedBlocks intermittently fails due to ReplicaAlreadyExistsException. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402261 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 18:32:41 +00:00
Suresh Srinivas
611684e2e5 HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402203 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 16:15:59 +00:00
Suresh Srinivas
2d5334931e HDFS-4097. Provide CLI support for createSnapshot. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401971 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-25 04:08:36 +00:00
Tsz-wo Sze
14d8d0a670 Merge r1400738 through r1401868 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401869 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 20:42:03 +00:00
Tsz-wo Sze
b897bb8992 HDFS-4091. Add snapshot quota to limit the number of snapshots allowed. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401868 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-24 20:39:26 +00:00
Suresh Srinivas
464edf2439 Moving HDFS-2434 from Release 2.0.3 section to trunk section. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401446 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:27:16 +00:00
Suresh Srinivas
4fde5c0190 HDFS-4084. Provide CLI support to allow and disallow snapshot on a directory. Contributed by Brondon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1401444 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:26:08 +00:00
Suresh Srinivas
aa42e2161d HDFS-2434. TestNameNodeMetrics.testCorruptBlock fails intermittently. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401423 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 20:02:09 +00:00
Daryn Sharp
a92313f7bd HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401309 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-23 15:03:53 +00:00
Tsz-wo Sze
75cdb5bb49 HDFS-4099. Clean up replication code and add more javadoc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400986 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 18:30:16 +00:00
Tsz-wo Sze
9a0651b4b8 HDFS-4078. Handle replication in snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400743 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-22 00:11:25 +00:00
Suresh Srinivas
f29724956a Merging trunk changes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400740 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 23:10:11 +00:00
Tsz-wo Sze
820b5495ca HDFS-4079. Add SnapshotManager which maintains a list for all the snapshottable directories and supports snapshot methods such as setting a directory to snapshottable and creating a snapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400728 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 21:35:13 +00:00
Suresh Srinivas
625d7cf20b HDFS-4087. Protocol changes for listSnapshots functionality. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400698 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 19:05:49 +00:00
Uma Maheswara Rao G
35ec20b7c6 HDFS-4022. Replication not happening for appended block. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400578 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-21 06:31:31 +00:00
Tsz-wo Sze
d9a9daeb2d Merge r1399946 through r1400349 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400351 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-20 00:33:57 +00:00
Suresh Srinivas
a2d837b0e9 HDFS-4077. Adding a file missed in the commit r1400318. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400350 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-20 00:31:57 +00:00
Tsz-wo Sze
661a8d176a HDFS-4088. Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400345 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-20 00:06:12 +00:00
Suresh Srinivas
af130d4baf HDFS-4077. Add support for Snapshottable Directory. Contributed by Nicholas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400318 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 22:21:50 +00:00
Suresh Srinivas
f5c4defcb3 HDFS-4083. Protocol changes for snapshots. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400316 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 22:15:27 +00:00
Suresh Srinivas
ecffab63af HDFS-4086. Add editlog opcodes to allow and disallow snapshots on a directory. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400298 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 21:15:11 +00:00
Suresh Srinivas
79e7257bb1 Moving HDFS-2802 related changes to a separate CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400291 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 21:06:08 +00:00
Suresh Srinivas
40f8b7dcfb Reverting the change r1400285 since it included unrelated changes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400290 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 21:04:29 +00:00
Suresh Srinivas
4cccdc2a96 Moving HDFS-2802 related changes to a separate CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400285 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 21:01:26 +00:00
Tsz-wo Sze
e75424544f HDFS-4082. Add editlog opcodes for snapshot create and delete operations. Contributed by suresh 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400247 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 19:38:48 +00:00
Tsz-wo Sze
5c1a7b9d5d HDFS-4076. Support snapshot of single files. (szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1400245 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 19:35:19 +00:00
Alejandro Abdelnur
a4f30ff53c reverting commit 1399898 (HADOOP-8887) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399972 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 05:38:26 +00:00
Suresh Srinivas
0603447f2a HDFS-4072. On file deletion remove corresponding blocks pending replications. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399965 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-19 04:55:11 +00:00
Eli Collins
7da5d03c35 HDFS-4053. Increase the default block size. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399908 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 22:56:30 +00:00
Alejandro Abdelnur
53c598ab11 HADOOP-8887. Use a Maven plugin to build the native code using CMake. (cmccabe via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399898 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 22:40:41 +00:00
Eli Collins
57ee22e589 HADOOP-8925. Remove the packaging. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399889 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 22:30:11 +00:00
Tsz-wo Sze
4af8761e4c HDFS-4074. Remove the unused default constructor from INode. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399866 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 21:29:12 +00:00
Tsz-wo Sze
c1bd54daa3 HDFS-4073. Two minor improvements to FSDirectory. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399861 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-18 21:18:25 +00:00
Eli Collins
4d5600f6c7 HDFS-4068. DatanodeID and DatanodeInfo member should be private. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399443 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 21:34:48 +00:00
Eli Collins
a258263ecf HDFS-4029. GenerationStamp should use an AtomicLong. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399096 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 04:58:24 +00:00
Eli Collins
24015b7684 HDFS-4055. TestAuditLogs is flaky. Contributed by Binglin Chang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399093 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 04:39:07 +00:00
Aaron Myers
402836479f HDFS-3997. OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element. Contributed by Mithun Radhakrishnan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399062 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-17 01:10:55 +00:00
Eli Collins
e074b5816a HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399010 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 21:59:15 +00:00
Suresh Srinivas
0ef9c6f71a HDFS-4059. Add number of stale DataNodes to metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398949 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 19:39:50 +00:00
Eli Collins
b245adb163 HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398874 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 16:29:21 +00:00
Suresh Srinivas
b7887f31fb HDFS-4052. BlockManager#invalidateWork should print log outside the lock. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398631 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 03:37:49 +00:00
Eli Collins
a75673cbd8 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398612 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 02:12:59 +00:00
Aaron Myers
557ffe2101 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 01:59:46 +00:00
Aaron Myers
f5f763eb15 Update CHANGES.txt to have HDFS-3678 under release 2.0.3 instead of 3.0.0. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398603 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 01:31:26 +00:00
Todd Lipcon
ded304e6a6 HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398591 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-16 00:55:29 +00:00
Tsz-wo Sze
698fa5077a HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..). Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398293 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 14:05:31 +00:00
Tsz-wo Sze
ad06a08713 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication(). 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398288 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-15 13:48:56 +00:00
Jason Darrell Lowe
f8bdac0a1b HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397704 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 19:49:40 +00:00
Suresh Srinivas
89b66da42c HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397580 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 14:32:16 +00:00
Suresh Srinivas
94ed14c48c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397432 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-12 04:35:42 +00:00
Suresh Srinivas
4e64e6f860 HDFS-4041. Hadoop HDFS Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397362 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 23:10:47 +00:00
Todd Lipcon
7ca007b241 Merge CHANGES for HDFS-3077 into the main CHANGES.txt file 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397352 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 22:51:34 +00:00
Suresh Srinivas
2887bbb33c HDFS-3912. Detect and avoid stale datanodes for writes. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397211 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 18:08:27 +00:00
Todd Lipcon
ff8f84ccf6 Merge trunk into branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1396918 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 06:14:26 +00:00
Suresh Srinivas
33c16f2a24 HADOOP-8913. hadoop-metrics2.properties should give units in comment for sampling period. Contributed by Sandy Ryza. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396904 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 05:17:03 +00:00
Aaron Myers
8078e16015 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396881 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-11 00:32:46 +00:00
Jason Darrell Lowe
08f35a04c6 HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396798 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 21:15:06 +00:00
Eli Collins
c9a1d4dc33 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396725 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 18:42:54 +00:00
Thomas Graves
a0a96eb142 HDFS-3824. TestHftpDelegationToken fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396705 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-10 17:35:18 +00:00
Eli Collins
03c96ef29e HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395821 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-09 00:18:27 +00:00
Todd Lipcon
17b32bb2de HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395731 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:19:21 +00:00
Todd Lipcon
70fc5cf01c HDFS-4017. Unclosed FileInputStream in GetJournalEditServlet. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1395727 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 19:11:48 +00:00
Eli Collins
5dcdc8aa58 HDFS-4003. test-patch should build the common native libs before running hdfs tests. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395708 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:34:14 +00:00
Eli Collins
3a4cf1c064 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395700 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-08 18:11:53 +00:00
Eli Collins
5a5473b29f HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395387 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-07 21:35:51 +00:00
Eli Collins
e32af6034b HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395385 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-07 21:16:08 +00:00
Aaron Myers
353958dccc HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394864 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-06 00:13:28 +00:00
Thomas Graves
d35169d9ba HDFS-3829. TestHftpURLTimeouts fails intermittently with JDK7 (Trevor Robinson via tgraves) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394609 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 15:51:10 +00:00
Suresh Srinivas
dfb8369c29 HDFS-3735. NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. Contributed by Brahma Reddy Battula. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394385 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 07:02:52 +00:00
Suresh Srinivas
a41f808c3c HDFS-3995. Use DFSTestUtil.createFile() for file creation and writing in test cases. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394376 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 06:22:26 +00:00
Aaron Myers
6582da034b HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394340 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-05 00:54:05 +00:00
Alejandro Abdelnur
016b86867b HDFS-3999. HttpFS OPEN operation expects len parameter, it should be length. (tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394169 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 17:45:42 +00:00
Eli Collins
ee13fb4f69 HDFS-3916. libwebhdfs (C client) code cleanups. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393890 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:53:28 +00:00
Eli Collins
38943644e0 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393884 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:41:04 +00:00
Eli Collins
2c66a9f5ae HDFS-2127. Add a test that ensure AccessControlExceptions contain a full path. Contributed by Stephen Chu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393878 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 02:06:56 +00:00
Todd Lipcon
10a0eaaf0a HDFS-4004. TestJournalNode#testJournal fails because of test case execution order. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1393870 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-04 01:40:12 +00:00
Eli Collins
5c19b6b7b6 Amend HDFS-3753 to ignore TestHdfsNativeCodeLoader. To be fixed in HDFS-4003. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393830 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 23:38:08 +00:00
Eli Collins
43ae84761f HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393777 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-03 21:30:45 +00:00
Eli Collins
f8f79a02aa HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393113 13f79535-47bb-0310-9956-ffa450edef68
 2012-10-02 19:13:53 +00:00
Robert Joseph Evans
af647bb3ce Preparing for release 0.23.4 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391805 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 14:15:39 +00:00
Harsh J
34becbb019 HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu). Contributed by Christopher Berner and Andy Isaacson. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391780 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 10:57:53 +00:00
Aaron Myers
648ba4a36b HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391763 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 07:30:45 +00:00
Aaron Myers
e8dc3b3a8a HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391708 13f79535-47bb-0310-9956-ffa450edef68
 2012-09-29 00:51:48 +00:00