big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
9,707 Commits 2 Branches 2 Tags 264 MiB
f761bd8fe4
Commit Graph

2198 Commits

Author SHA1 Message Date
Chris Nauroth
4449247410 HDFS-6008. Namenode dead node link is giving HTTP error 500. Contributed by Benoy Antony. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571881 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-26 00:25:29 +00:00
Arpit Agarwal
9df1c533dc HDFS-6017. Query the status of rolling upgrade in the preparation stage in TestRollingUpgrade and TestRollingUpgradeRollback. (Contributed by Haohui Mai) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571875 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-26 00:13:53 +00:00
Jing Zhao
e3d2e4c156 HDFS-6000. Avoid saving namespace when starting rolling upgrade. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571840 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 21:58:53 +00:00
Tsz-wo Sze
abc9a6dad5 Merge r1569890 through r1571813 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571814 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 20:24:57 +00:00
Kihwal Lee
fa6e59891c HDFS-5498. Improve datanode startup time. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571797 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 19:27:53 +00:00
Kihwal Lee
57b28693ee HDFS-5924. Utilize OOB upgrade message processing for writes. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571792 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 19:24:15 +00:00
Kihwal Lee
6780b086d8 HDFS-6015. Fix TestBlockRecovery#testRaceBetweenReplicaRecoveryAndFinalizeBlock. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571785 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 18:51:14 +00:00
Jing Zhao
df6e1ab491 HDFS-5939. WebHdfs returns misleading error code and logs nothing if trying to create a file with no DNs in cluster. Contributed by Yongjun Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571781 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 18:36:46 +00:00
Chris Nauroth
6c9c3144dd HDFS-5623. NameNode: add tests for skipping ACL enforcement when permission checks are disabled, user is superuser or user is member of supergroup. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571745 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 17:02:59 +00:00
Chris Nauroth
d5639c85fb HADOOP-10361. Correct alignment in CLI output for ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571573 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 05:54:51 +00:00
Tsz-wo Sze
98db64dd49 Merge r1569890 through r1571553 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571554 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 03:30:24 +00:00
Arpit Agarwal
440c3cd105 HDFS-5922. DN heartbeat thread can get stuck in tight loop. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571542 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 02:16:29 +00:00
Tsz-wo Sze
0809f32f4b Merge r1569890 through r1571508 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571509 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-25 01:16:30 +00:00
Kihwal Lee
1c6b5d2b58 HDFS-5583. Make DN send an OOB Ack on shutdown before restarting. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571491 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-24 23:38:04 +00:00
Michael Stack
17db74a1c1 HDFS-5776 Support 'hedged' reads in DFSClient 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1571466 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-24 22:34:41 +00:00
Arpit Agarwal
c066cef587 HDFS-6004. Change DFSAdmin for rolling upgrade commands. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571463 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-24 22:05:07 +00:00
Arpit Agarwal
dbf14320c0 HDFS-6005. Simplify Datanode rollback and downgrade. (Contributed by Suresh Srinivas) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1571431 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-24 20:46:35 +00:00
Tsz-wo Sze
3f7852bd27 HDFS-5994. Fix TestDataNodeRollingUpgrade. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570734 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 22:40:06 +00:00
Tsz-wo Sze
78325b08c5 Merge r1569890 through r1570692 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570694 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 20:08:08 +00:00
Tsz-wo Sze
0ad6cdd031 HDFS-5992. Fix NPE in MD5FileUtils and update editsStored for TestOfflineEditsViewer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570690 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 20:02:27 +00:00
Chris Nauroth
4f8a487fcd HDFS-5981. loadGenerator exit code is not reliable. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570468 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 06:39:08 +00:00
Chris Nauroth
327d2ceca2 HADOOP-10352. Recursive setfacl erroneously attempts to apply default ACL to files. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570466 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 06:29:52 +00:00
Andrew Wang
b00817b54a HDFS-5988. Bad fsimage always generated after upgrade. (wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570429 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 02:48:40 +00:00
Jing Zhao
4da6de1ca3 HDFS-5982. Need to update snapshot manager when applying editlog for deleting a snapshottable directory. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570395 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-21 00:15:11 +00:00
Tsz-wo Sze
37afb4d683 Merge r1569890 through r1570391 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570392 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 23:47:58 +00:00
Arpit Agarwal
329c705181 HDFS-5987. Fix findbugs warnings in Rolling Upgrade branch. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570389 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 23:21:11 +00:00
Brandon Li
7568e2f193 HDFS-5944. LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ and cause SecondaryNameNode failed do checkpoint. Contributed by Yunjiong Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570366 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 22:27:13 +00:00
Kihwal Lee
0b51bdd94f HDFS-5985. SimulatedFSDataset#disableAndPurgeTrashStorage should not throw UnsupportedOperationException. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570363 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 21:57:52 +00:00
Tsz-wo Sze
016d3b8171 HDFS-5984. Fix TestEditLog and TestStandbyCheckpoints. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570361 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 21:42:10 +00:00
Jing Zhao
8b196816d8 HADOOP-10348. Deprecate hadoop.ssl.configuration in branch-2, and remove it in trunk. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570295 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 18:34:24 +00:00
Kihwal Lee
b23f6cc1f2 HDFS-5962. Mtime and atime are not persisted for symbolic links. Contributed by Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570252 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 16:09:20 +00:00
Tsz-wo Sze
55aec006f4 Merge r1569890 through r1570083 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570084 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 04:38:30 +00:00
Tsz-wo Sze
2088584864 HDFS-5980. Rollback does not need to load edits. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570078 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 03:57:59 +00:00
Arpit Agarwal
e2c0af8e7b HDFS-5742. DatanodeCluster (mini cluster of DNs) fails to start. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570067 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 03:20:29 +00:00
Arpit Agarwal
b95294416c HDFS-5483. NN should gracefully handle multiple block replicas on same DN. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1570040 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 01:43:12 +00:00
Arpit Agarwal
50a0bedead HDFS-5976. Create unit tests for downgrade and finalize rolling upgrade. (Contributed by Haohui Mai) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1570019 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 00:47:15 +00:00
Arpit Agarwal
0cd98fd482 HDFS-5963. Remove empty file TestEditLogUpgradeMarker.java 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569996 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-20 00:01:03 +00:00
Arpit Agarwal
e891c55f8b HDFS-5963. TestRollingUpgrade#testSecondaryNameNode causes subsequent tests to fail. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569993 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-19 23:56:02 +00:00
Arpit Agarwal
2f341414dd HDFS-5318. Support read-only and read-write paths to shared replicas. (Contributed by Eric Sirianni) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569951 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-19 22:59:37 +00:00
Tsz-wo Sze
d69985d90b HDFS-5974. Fix compilation error, NameNodeLayoutVersion and DataNodeLayoutVersion after merge from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569931 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-19 21:40:42 +00:00
Tsz-wo Sze
72c214c89b Merge r1555021 through r1569889 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569890 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-19 19:57:36 +00:00
Tsz-wo Sze
377424e36a HDFS-5966. Fix rollback of rolling upgrade in NameNode HA setup. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569885 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-19 19:41:22 +00:00
Chris Nauroth
909eb7e4f1 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1569833 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-19 17:24:02 +00:00
Tsz-wo Sze
99b4caa888 Merge r1555021 through r1569522 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569524 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-18 20:42:26 +00:00
Tsz-wo Sze
bc962d6df4 HDFS-5945. Add rolling upgrade information to fsimage; and disallow upgrade and rolling upgrade to be started simultaneously. Contributed by szetszwo & jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1569515 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-18 20:12:17 +00:00
Jing Zhao
a845a18c67 HDFS-5893. HftpFileSystem.RangeHeaderUrlOpener uses the default URLConnectionFactory which does not import SSL certificates. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569477 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-18 19:06:31 +00:00
Kihwal Lee
62b023c241 HDFS-5803. TestBalancer.testBalancer0 fails. Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569391 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-18 15:39:59 +00:00
Kihwal Lee
4aa664f677 HDFS-5780. TestRBWBlockInvalidation times out intemittently. Contributed by Mit Desai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1569368 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-18 14:53:05 +00:00
Chris Nauroth
e288316acf Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1569142 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-17 23:22:32 +00:00
Andrew Wang
3f6a6c88bb HDFS-5953. TestBlockReaderFactory fails in trunk. (Akira Ajisaka via wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568568 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-15 00:52:47 +00:00
Jing Zhao
470d4253b2 HDFS-5920. Support rollback of rolling upgrade in NameNode and JournalNodes. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568563 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-15 00:28:21 +00:00
Brandon Li
ef90940594 HDFS-5716. Allow WebHDFS to use pluggable authentication filter. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568547 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-15 00:04:44 +00:00
Arpit Agarwal
a57550914f HDFS-5948. TestBackupNode flakes with port in use error. (Contributed by Haohui Mai) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568532 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-14 21:57:26 +00:00
Arpit Agarwal
8741c3b951 HDFS-5907. Add test cases missed in previous checkin 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568529 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-14 21:37:16 +00:00
Andrew Wang
04888258b7 HDFS-3128. Unit tests should not use a test root in /tmp. (wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1568526 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-14 21:29:27 +00:00
Kihwal Lee
1a68f13521 HDFS-5585. Provide admin commands for data node upgrade. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568523 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-14 21:20:02 +00:00
Arpit Agarwal
a795bc42d0 HDFS-5494. Merge Protobuf-based-FSImage code from trunk - fix build break after merge. (Contributed by Jing Zhao) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568517 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-14 20:56:24 +00:00
Jing Zhao
ba4b10354c Merging r1566359 through r1568420 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568437 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-14 18:32:37 +00:00
Arpit Agarwal
5df82fa01d HDFS-5907. BlockPoolSliceStorage trash to handle block deletions during rolling upgrade. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1568346 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-14 16:37:42 +00:00
Chris Nauroth
a49dee06fb Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567994 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 18:21:46 +00:00
Chris Nauroth
e291c7905f HDFS-5937. Fix TestOfflineEditsViewer on HDFS-4685 branch. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567986 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 17:52:26 +00:00
Kihwal Lee
b0456745f9 HDFS-5904. TestFileStatus fails intermittently. Contributed by Mit Desai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567946 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 15:06:17 +00:00
Tsz-wo Sze
a4f152db96 Merge r1555021 through r1566358 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1567874 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 09:53:52 +00:00
Tsz-wo Sze
4f9bbaa301 HDFS-5889. When starting rolling upgrade, create a fs image for rollback so that the standby namenode can create checkpoints during upgrade. Contributed by szetszwo & jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1567861 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 08:04:58 +00:00
Colin McCabe
f0d64a078d HDFS-5940. Minor cleanups to ShortCircuitReplica, FsDatasetCache, and DomainSocketWatcher (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567835 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-13 03:10:48 +00:00
Brandon Li
256adb2106 HDFS-5891. webhdfs should not try connecting the DN during redirection. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567810 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 23:57:35 +00:00
Chris Nauroth
fc14360b03 HDFS-5923. Do not persist the ACL bit in the FsPermission. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567784 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 22:54:49 +00:00
Colin McCabe
beb0d25d2a HDFS-5810. Unify mmap cache and short-circuit file descriptor cache (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567720 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 19:08:52 +00:00
Suresh Srinivas
5efc9978dd HDFS-5879. Some TestHftpFileSystem tests do not close streams. Contributed by Gera Shegalov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567704 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 18:02:21 +00:00
Colin McCabe
53fed66d91 HADOOP-10338. Cannot get the FileStatus of the root inode from the new Globber (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1567497 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-12 02:12:11 +00:00
Chris Nauroth
6d2a0aa1db HDFS-5925. ACL configuration flag must only reject ACL API calls, not ACLs present in fsimage or edits. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1567450 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 23:13:48 +00:00
Chris Nauroth
d03acc7560 HDFS-5914. Incorporate ACLs with the changes from HDFS-5698. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566991 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 06:25:13 +00:00
Chris Nauroth
3bf2f04bac Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566988 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-11 06:00:56 +00:00
Chris Nauroth
5c978a43c3 HDFS-5915. Refactor FSImageFormatProtobuf to simplify cross section reads. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566824 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-10 23:13:06 +00:00
Konstantin Shvachko
204704a92d HDFS-5837. dfs.namenode.replication.considerLoad should consider decommissioned nodes. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566410 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-09 20:49:18 +00:00
Haohui Mai
2ed075e1bb Merging r1566042 through r1566364 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566375 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-09 19:45:00 +00:00
Jing Zhao
a2edb11b68 HDFS-5698. Use protobuf to serialize / deserialize FSImage. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1566359 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-09 19:18:51 +00:00
Chris Nauroth
c6505f0499 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566100 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-08 19:05:12 +00:00
Chris Nauroth
dd2eb97ddd HDFS-5899. Add configuration flag to disable/enable support for ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1566041 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-08 16:20:29 +00:00
Chris Nauroth
c89c516b95 HDFS-5616. NameNode: implement default ACL handling. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1565845 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-07 23:11:27 +00:00
Andrew Wang
60eca33e83 HDFS-5900. Cannot set cache pool limit of unlimited via CacheAdmin. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565841 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-07 22:58:23 +00:00
Colin McCabe
d01158a498 HDFS-5882. TestAuditLogs is flaky (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565840 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-07 22:55:27 +00:00
Tsz-wo Sze
ccf08d9dc8 Merge r1555021 through r1565516 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1565519 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-07 02:43:04 +00:00
Tsz-wo Sze
c780454413 HDFS-5869. When starting rolling upgrade or NN restarts, NN should create a checkpoint right before the upgrade marker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1565516 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-07 02:08:05 +00:00
Kihwal Lee
fe2fb24a61 HDFS-5807. TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails intermittently. Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565505 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-07 00:43:45 +00:00
Colin McCabe
e0cda48959 HDFS-4911. Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565435 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-06 21:08:09 +00:00
Jing Zhao
d598b6ef9f HDFS-5873. dfs.http.policy should have higher precedence over dfs.https.enable. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564973 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-05 22:48:06 +00:00
Jing Zhao
69dbf0b225 HDFS-5876. SecureDataNodeStarter does not pick up configuration in hdfs-site.xml. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564897 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-05 19:43:56 +00:00
Andrew Wang
dcaaeefeaf Addendum patch for HDFS-5709, add missing license header. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564885 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-05 19:17:20 +00:00
Aaron Myers
d6bd920bba HDFS-5709. Improve NameNode upgrade with existing reserved paths and path components. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564645 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-05 06:48:00 +00:00
Todd Lipcon
0aa09f6d5a HDFS-5399. Revisit SafeModeException and corresponding retry policies. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564629 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-05 04:18:31 +00:00
Brandon Li
cd1e8d2e34 HDFS-5791. TestHttpsFileSystem should use a random port to avoid binding error during testing. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564198 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-04 05:11:11 +00:00
Junping Du
94b512bc51 HDFS-5828. BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true. (Buddy via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563640 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-02 15:39:02 +00:00
Tsz-wo Sze
35e59eeaa2 Merge r1555021 through r1563384 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1563385 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-01 09:01:41 +00:00
Tsz-wo Sze
4f92eb2f61 HDFS-5848. Add rolling upgrade status to heartbeat response. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1563384 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-01 08:58:55 +00:00
Chris Nauroth
0abf8e58b7 HDFS-5861. Add CLI test for Ls output for extended ACL marker. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563375 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-01 05:58:31 +00:00
Colin McCabe
140246bad8 HDFS-5746. Add ShortCircuitSharedMemorySegment (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563362 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-01 02:25:33 +00:00
Chris Nauroth
9e8cabf8ce Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563327 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 23:05:23 +00:00
Chris Nauroth
fa99a8471d HDFS-5858. Refactor common ACL test cases to be run through multiple FileSystem implementations. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563325 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 23:02:45 +00:00
Chris Nauroth
14f1f76bf6 HDFS-5614. NameNode: implement handling of ACLs in combination with snapshots. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563304 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 22:21:19 +00:00
Arpit Agarwal
5beeb30169 HDFS-5153. Datanode should send block reports for each storage in a separate message. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563254 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 21:00:33 +00:00
Chris Nauroth
d5f4f76a23 HADOOP-10270. getfacl does not display effective permissions of masked. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563219 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 18:59:16 +00:00
Chris Nauroth
c654c2e8b9 HDFS-5849. Removing ACL from an inode fails if it has only a default ACL. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563205 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 18:33:56 +00:00
Suresh Srinivas
7039b776c6 HDFS-5856. DataNode.checkDiskError might throw NPE. Contributed by Josh Elser. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1563064 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 05:35:30 +00:00
Tsz-wo Sze
f2972402b7 Merge r1555021 through r1563041 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1563042 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 03:24:24 +00:00
Tsz-wo Sze
00067895a0 HDFS-5754. Split LayoutVerion into NameNodeLayoutVersion and DataNodeLayoutVersion. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1563041 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-31 03:21:45 +00:00
Chris Nauroth
7a03dc0482 HDFS-5608. WebHDFS: implement ACL APIs. Contributed by Sachin Jose and Renil Joseph. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1563013 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-30 23:13:24 +00:00
Jing Zhao
3d9ad8e3b6 HDFS-5843. DFSClient.getFileChecksum() throws IOException if checksum is disabled. Contributed by Laurent Goujon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562927 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-30 19:15:13 +00:00
Chris Nauroth
10ef8a4b56 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1562670 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-30 01:55:14 +00:00
Chris Nauroth
4b4241c06d HDFS-5702. FsShell Cli: Add XML based End-to-End test for getfacl and setfacl commands. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1562668 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-30 01:46:19 +00:00
Andrew Wang
c96d078033 HDFS-5845. SecondaryNameNode dies when checkpointing with cache pools. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1562644 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-29 23:59:21 +00:00
Suresh Srinivas
33a47743a5 HADOOP-10255. Rename HttpServer to HttpServer2 to retain older HttpServer in branch-2 for compatibility. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561959 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-28 07:32:52 +00:00
Tsz-wo Sze
efcdf81ca9 Merge r1555021 through r1561943 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1561944 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-28 05:37:13 +00:00
Tsz-wo Sze
917502ef31 HDFS-5835. Add a new option for starting Namenode when rolling upgrade is in progress. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1561943 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-28 05:35:47 +00:00
Colin McCabe
07c004db06 HDFS-5830. WebHdfsFileSystem.getFileBlockLocations throws IllegalArgumentException when accessing another cluster. (Yongjun Zhang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561885 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-27 22:19:30 +00:00
Arpit Agarwal
70165d84eb HDFS-5825. Use FileUtils.copyFile() to implement DFSTestUtils.copyFile(). (Contributed by Haohui Mai) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561792 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-27 19:01:19 +00:00
Chris Nauroth
ad240d6b3a Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1561771 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-27 18:09:22 +00:00
Tsz-wo Sze
a9110e1788 Merge r1555021 through r1561510 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1561516 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-26 16:34:30 +00:00
Todd Lipcon
edb6dc5f30 HDFS-5138. Support HDFS upgrade in HA. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561381 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-25 20:01:26 +00:00
Uma Maheswara Rao G
befb254e61 HDFS-5343. When cat command is issued on snapshot files, getting unexpected result. Contributed by Sathish. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561325 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-25 15:50:42 +00:00
Kihwal Lee
dd1bc7e1c7 HDFS-5728. Block recovery will fail if the metafile does not have crc for all chunks of the block. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561223 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-24 22:56:05 +00:00
Chris Nauroth
738b076cc6 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1560768 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-23 17:49:24 +00:00
Daryn Sharp
a4e66e09e9 HDFS-5241. Provide alternate queuing audit logger to reduce logging contention (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560761 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-23 17:15:27 +00:00
Kihwal Lee
ff43021946 HDFS-5788. listLocatedStatus response can be very large. Contributed by Nathan Roberts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560750 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-23 17:01:30 +00:00
Haohui Mai
2af05fb1cf HDFS-5615. NameNode: implement handling of ACLs in combination with sticky bit. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1560131 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-21 18:33:02 +00:00
Tsz-wo Sze
d8bc523754 HDFS-5753. Add new NN startup options for downgrade and rollback using upgrade marker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559907 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-21 02:38:46 +00:00
Haohui Mai
9df33876ff HDFS-5613. NameNode: implement handling of ACLs in combination with symlinks. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559804 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-20 18:47:30 +00:00
Chris Nauroth
8a9a6dbd7e Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559324 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-18 06:50:19 +00:00
Tsz-wo Sze
1025121874 Merge r1555021 through r1559304 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559305 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-18 02:24:38 +00:00
Tsz-wo Sze
09b8ce5b44 HDFS-5786. Support QUERY and FINALIZE actions of rolling upgrade. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559304 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-18 02:07:09 +00:00
Haohui Mai
5300294fbe HDFS-5758. NameNode: complete implementation of inode modifications for ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559267 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-17 22:05:47 +00:00
Colin McCabe
a7ec44d41b HDFS-5784. Reserve space in edit log header and fsimage header for feature flag section (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558974 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-17 01:32:05 +00:00
Jing Zhao
e02ded811f HDFS-5777. Update LayoutVersion for the new editlog op OP_ADD_BLOCK. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558675 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-16 02:28:10 +00:00
Colin McCabe
037a89abc5 HDFS-5762. BlockReaderLocal does not return -1 on EOF when doing zero-length reads (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558526 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 19:17:50 +00:00
Tsz-wo Sze
4a1abe5a3d Merge r1555021 through r1558254 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1558303 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 06:06:31 +00:00
Tsz-wo Sze
5fe73a986e HDFS-5752. Add a new DFSAdmin command to query, start and finalize rolling upgrade. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1558299 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 05:56:17 +00:00
Jing Zhao
578dae9ef3 HDFS-5704. Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558255 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 01:06:53 +00:00
Jing Zhao
e210519d32 HDFS-5579. Under construction files make DataNode decommission take very long hours. Contributed by zhaoyunjiong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557904 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-14 02:02:15 +00:00
Chris Nauroth
c90211af7a Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1557294 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-11 00:37:23 +00:00
Tsz-wo Sze
1c7aa44d62 Merge r1555021 through r1557038 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1557039 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-10 06:07:24 +00:00
Tsz-wo Sze
4563ba08e7 HDFS-5645. Support upgrade marker in editlog streams. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1557038 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-10 06:06:10 +00:00
Kihwal Lee
b4d6c5823b HDFS-5449. WebHdfs compatibility broken between 2.2 and 1.x / 23.x. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556927 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-09 19:24:07 +00:00
Chris Nauroth
17ab35314f Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556665 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 23:10:02 +00:00
Chris Nauroth
21d4167179 HDFS-5739. ACL RPC must allow null name or unspecified permissions in ACL entries. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556663 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 22:47:57 +00:00
Chris Nauroth
023c11ec7e HDFS-5737. Replacing only the default ACL can fail to copy unspecified base entries from the access ACL. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556652 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 22:02:53 +00:00
Tsz-wo Sze
f3ee35ab28 Merge r1555021 through r1556550 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1556552 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 14:36:09 +00:00
Jing Zhao
70cff9e2f0 HDFS-5715. Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiff. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556353 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-07 20:52:48 +00:00
Chris Nauroth
2fbb3d694e Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556097 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-07 01:07:33 +00:00
Chris Nauroth
c658567571 HDFS-5673. Implement logic for modification of ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556090 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-07 00:47:49 +00:00
Colin McCabe
8deb7a6057 HDFS-5589. Namenode loops caching and uncaching when data should be uncached. (awang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555996 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-06 19:45:02 +00:00
Colin McCabe
2a1ecd00da HDFS-5220. Expose group resolution time as metric (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555976 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-06 18:59:10 +00:00
Arpit Agarwal
410f3a9f60 HDFS-5667. Add test missed in previous checkin 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555956 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-06 18:14:05 +00:00
Arpit Agarwal
f8a9329f2b HDFS-5667. Include DatanodeStorage in StorageReport. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555929 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-06 17:28:23 +00:00
Jing Zhao
71e6ea4be1 HDFS-5695. Clean up TestOfflineEditsViewer and OfflineEditsViewerHelper. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555164 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-03 17:36:16 +00:00
Tsz-wo Sze
498f9674ff Merge r1550130 through r1555020 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1555021 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-03 07:26:52 +00:00
Andrew Wang
d85c017d04 HDFS-5651. Remove dfs.namenode.caching.enabled and improve CRM locking. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555002 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-03 02:45:53 +00:00
Andrew Wang
b4eb963c3c HDFS-5659. dfsadmin -report doesn't output cache information properly. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554893 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-02 20:11:41 +00:00
Andrew Wang
07e4fb1455 HDFS-5708. The CacheManager throws a NPE in the DataNode logs when processing cache reports that refer to a block not known to the BlockManager. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554594 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-01 00:01:12 +00:00
Colin McCabe
e596f17734 HDFS-5582. hdfs getconf -excludeFile or -includeFile always failed (satish via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554295 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-30 19:35:43 +00:00
Andrew Wang
c179d58eee Add updated editsStored files missing from initial HDFS-5636 commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554293 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-30 19:02:08 +00:00
Konstantin Shvachko
5a54b91df9 HDFS-5675. Add Mkdirs operation to NNThroughputBenchmark. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554071 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-29 21:22:04 +00:00
Chris Nauroth
eaa5321619 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553226 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-23 22:19:12 +00:00
Chris Nauroth
c3b56ed1c8 HDFS-5619. NameNode: record ACL modifications to edit log. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553224 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-23 22:12:45 +00:00
Colin McCabe
b9ae3087c0 HDFS-5636. Enforce a max TTL per cache pool (awang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552841 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 23:27:20 +00:00
Chris Nauroth
72b0b1881f Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1552467 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 01:01:18 +00:00
Chris Nauroth
c552d5d72e HDFS-5685. Implement ACL as a INode feature. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1552465 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 00:48:24 +00:00
Andrew Wang
c7153e182a HDFS-5679. TestCacheDirectives should handle the case where native code is not available. (wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552461 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 00:00:45 +00:00
Junping Du
42e7446add HDFS-5540. Fix intermittent failure in TestBlocksWithNotEnoughRacks. (Binglin Chang via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552256 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-19 09:21:19 +00:00
Colin McCabe
90122f25e1 HDFS-5676. fix inconsistent synchronization of CachingStrategy (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552162 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 23:29:05 +00:00
Brandon Li
fc966461e0 HDFS-5662. Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552131 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 22:26:33 +00:00
Jing Zhao
788fca4124 HDFS-5496. Make replication queue initialization asynchronous. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1552109 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 21:30:37 +00:00
Tsz-wo Sze
504bd0bca3 HDFS-5674. Editlog code cleanup: remove @SuppressWarnings("deprecation") in FSEditLogOp; change FSEditLogOpCodes.fromByte(..) to be more efficient; and change Some fields in FSEditLog to final. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551812 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 02:46:00 +00:00
Colin McCabe
124e507674 HDFS-5634. Allow BlockReaderLocal to switch between checksumming and not (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551701 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-17 20:57:00 +00:00
Colin McCabe
991c453ca3 HDFS-5431. Support cachepool-based limit management in path-based caching. (awang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551651 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-17 18:47:04 +00:00
Andrew Wang
0fc2929d13 HDFS-5350. Name Node should report fsimage transfer time as a metric. Contributed by Jimmy Xiang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551415 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-17 00:30:06 +00:00
Chris Nauroth
740605cde6 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1551332 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 20:08:58 +00:00
Arpit Agarwal
89a374afcb HDFS-5454. DataNode UUID should be assigned prior to FsDataset initialization. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551296 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 18:16:56 +00:00
Arpit Agarwal
121137789c HDFS-5406. Add file missed in previous commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551110 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 04:05:53 +00:00
Arpit Agarwal
938565925a HDFS-5406. Send incremental block reports for all storages in a single call. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551093 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 00:58:40 +00:00
Tsz-wo Sze
44a6560b5d HDFS-5632. Flatten INodeDirectory hierarchy: Replace INodeDirectoryWithSnapshot with DirectoryWithSnapshotFeature. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550917 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-14 10:13:30 +00:00
Chris Nauroth
f24e0c1563 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550774 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-13 17:28:14 +00:00
Chris Nauroth
9263f3bb14 HDFS-5596. Implement RPC stubs. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550544 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 21:47:46 +00:00
Jing Zhao
5fd7230671 HDFS-5647. Merge INodeDirectory.Feature and INodeFile.Feature. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550469 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 18:26:40 +00:00
Arpit Agarwal
329093ae1b HDFS-2832: Update binary file editsStored for TestOfflineEditsViewer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550364 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 07:47:09 +00:00
Arpit Agarwal
cd083aa807 Merging r1549949 through r1550312 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1550313 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 23:18:29 +00:00
Colin McCabe
9678020e59 HDFS-4201. NPE in BPServiceActor#sendHeartBeat (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550269 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 21:30:16 +00:00
Jonathan Turner Eagles
ed4d318d68 HDFS-5023. TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7 (Mit Desai via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550261 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 21:16:48 +00:00
Aaron Myers
512a18a8d9 HDFS-5074. Allow starting up from an fsimage checkpoint in the middle of a segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550016 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 01:32:22 +00:00
Arpit Agarwal
f3cef1c673 Merging r1549626 through r1549948 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1549949 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-10 19:50:02 +00:00
Jing Zhao
87a6db45b7 HDFS-5629. Support HTTPS in JournalNode and SecondaryNameNode. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1549692 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-09 21:58:47 +00:00
Arpit Agarwal
43c33491fc Merging r1548329 through r1549625 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1549626 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-09 17:38:20 +00:00
Jing Zhao
155020a6f4 HDFS-5353. Short circuit reads fail when dfs.encrypt.data.transfer is enabled. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548987 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-08 03:52:18 +00:00
Jing Zhao
91d0b47270 HDFS-4983. Numeric usernames do not work with WebHDFS FS. Contributed by Yongjun Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548968 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-07 21:10:53 +00:00
Tsz-wo Sze
4c87a27ad8 HDFS-5554. Flatten INodeFile hierarchy: Replace INodeFileWithSnapshot with FileWithSnapshotFeature. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548796 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-07 06:17:46 +00:00
Jing Zhao
045dc880e1 HDFS-5312. Generate HTTP/HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548629 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-06 18:01:58 +00:00
Jing Zhao
9df84c35d5 HDFS-5590. Block ID and generation stamp may be reused when persistBlocks is set to false. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548368 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-06 01:55:13 +00:00
Arpit Agarwal
00718c2ffa Merging r1547658 through r1548328 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1548329 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 23:41:09 +00:00
Andrew Wang
55e5b0653c HDFS-5630. Hook up cache directive and pool usage statistics. (wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548309 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 21:09:30 +00:00
Daryn Sharp
6828337d85 HDFS-5514. FSNamesystem's fsLock should allow custom implementation (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548161 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 15:28:12 +00:00
Andrew Wang
859e425dfa Revert HDFS-4983 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547970 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 00:05:10 +00:00
Andrew Wang
f5e83a0b3e HDFS-4983. Numeric usernames do not work with WebHDFS FS. Contributed by Yongjun Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547935 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-04 22:24:45 +00:00
Jing Zhao
d02baff9a0 HDFS-5536. Implement HTTP policy for Namenode and DataNode. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547925 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-04 21:40:57 +00:00
Colin McCabe
f791e291ca HDFS-5555. CacheAdmin commands fail when first listed NameNode is in Standby (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547895 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-04 20:06:25 +00:00
Arpit Agarwal
674d51e62e Merging r1547121 through r1547473 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1547492 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-03 17:33:46 +00:00
Arpit Agarwal
a1aa1836fb HDFS-5484. StorageType and State in DatanodeStorageInfo in NameNode is not accurate. (Contributed by Eric Sirianni) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1547462 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-03 16:30:29 +00:00
Kihwal Lee
38a04a3042 HDFS-5557. Write pipeline recovery for the last packet in the block may cause rejection of valid replicas. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547173 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-02 20:18:52 +00:00
Arpit Agarwal
18159be495 Merging r1544666 through r1547120 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1547122 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-02 17:41:44 +00:00
Andrew Wang
9da451cac5 HDFS-5430. Support TTL on CacheDirectives. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546301 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-28 07:20:21 +00:00
Andrew Wang
bb11d47758 HDFS-5562. TestCacheDirectives and TestFsDatasetCache should stub out native mlock. Contributed by Colin Patrick McCabe and Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546246 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-28 00:44:54 +00:00
Tsz-wo Sze
8df119da21 HDFS-5537. Remove FileWithSnapshot interface. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546184 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-27 20:32:16 +00:00
Colin McCabe
13edb391d0 HDFS-5556. Add some more NameNode cache statistics, cache pool stats (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546143 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-27 17:55:52 +00:00
Uma Maheswara Rao G
b6d483b122 HDFS-5568. Support includeSnapshots option with Fsck command. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545987 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-27 10:59:54 +00:00
Colin McCabe
05a9a80bd4 HDFS-5565. CacheAdmin help should match against non-dashed commands (wang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545850 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 21:38:46 +00:00
Jing Zhao
740cf232bd HDFS-5561. FSNameSystem#getNameJournalStatus() in JMX should return plain text instead of HTML. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545791 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 19:28:09 +00:00
Tsz-wo Sze
82ff2d3f2e HDFS-5286. Flatten INodeDirectory hierarchy: Replace INodeDirectoryWithQuota with DirectoryWithQuotaFeature. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545768 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 18:33:22 +00:00
Jing Zhao
d8a2383461 HDFS-5538. URLConnectionFactory should pick up the SSL related configuration by default. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545491 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 01:16:51 +00:00
Jing Zhao
eb3c1607b0 HDFS-5533. Symlink delete/create should be treated as DELETE/CREATE in snapshot diff report. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545357 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-25 18:05:36 +00:00
Kihwal Lee
65ee88b0de HDFS-5526. Datanode cannot roll back to previous layout version. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545322 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-25 15:33:52 +00:00
Arpit Agarwal
81211123d8 HDFS-5559. Fix TestDatanodeConfig in HDFS-2832. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1544891 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-23 23:27:13 +00:00
Arpit Agarwal
f48ea1b516 Merging r1544304 through r1544665 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1544672 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-22 20:51:06 +00:00
Arpit Agarwal
97acde2d33 HDFS-5542. Fix TODO and clean up the code in HDFS-2832. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1544664 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-22 20:07:10 +00:00
Uma Maheswara Rao G
8034d04c49 HDFS-5544. Adding Test case For Checking dfs.checksum.type as NULL value. Contributed by Sathish. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544596 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-22 16:11:26 +00:00
Tsz-wo Sze
ce68f410b0 HDFS-5285. Flatten INodeFile hierarchy: Replace INodeFileUnderConstruction and INodeFileUnderConstructionWithSnapshot with FileUnderContructionFeature. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544389 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-22 01:39:02 +00:00
Colin McCabe
9863cb1905 HDFS-5543. Fix narrow race condition in TestPathBasedCacheRequests (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544310 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 20:15:07 +00:00
Arpit Agarwal
16f7fb80d9 Merging r1543902 through r1544303 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1544306 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 20:06:09 +00:00
Colin McCabe
f91a45a96c HDFS-5473. Consistent naming of user-visible caching classes and methods (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544252 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 17:12:58 +00:00
Jing Zhao
39950cee7f HDFS-5532. Enable the webhdfs by default to support new HDFS web UI. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544047 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 07:16:16 +00:00
Tsz-wo Sze
5f458ef23f HDFS-5531. Combine the getNsQuota() and getDsQuota() methods in INode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544018 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 03:17:47 +00:00
Jing Zhao
3cae2ba63f HDFS-3987. Support webhdfs over HTTPS. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543962 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 21:51:58 +00:00
Andrew Wang
916ab9286b HDFS-5451. Add byte and file statistics to PathBasedCacheEntry. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543958 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 21:31:41 +00:00
Arpit Agarwal
75747754d2 Merging r1543710 through r1543901 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543902 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 18:37:22 +00:00
Uma Maheswara Rao G
f26d2adbf9 HDFS-4516. Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543829 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 14:43:11 +00:00
Arpit Agarwal
59393e0162 Merging r1543613 through r1543709 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543710 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 05:31:02 +00:00
Colin McCabe
efea68dc35 HDFS-5511. improve CacheManipulator interface to allow better unit testing (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543676 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 00:48:05 +00:00
Andrew Wang
00d9b8eedb HDFS-5513. CacheAdmin commands fail when using . as the path. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543670 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 00:29:59 +00:00
Jonathan Turner Eagles
587f68b160 HDFS-1386. TestJMXGet fails in jdk7 (jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543612 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 22:44:13 +00:00
Arpit Agarwal
3c9cbc6893 Merging r1543111 through r1543509 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543510 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 17:26:23 +00:00
Jing Zhao
aa002344d0 HDFS-5428. Under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543329 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 07:31:40 +00:00
Arpit Agarwal
c3c626d32b HDFS-5073. TestListCorruptFileBlocks fails intermittently. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543303 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 04:07:28 +00:00
Colin McCabe
4f15d0af4f HDFS-5520. loading cache path directives from edit log doesnt update nextEntryId (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543286 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 02:01:28 +00:00
Arpit Agarwal
bd5ab41a90 Merging r1542123 through r1543110 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543115 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-18 19:22:42 +00:00
Jing Zhao
fef8f49c58 HDFS-5502. Fix HTTPS support in HsftpFileSystem. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542438 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-16 01:00:42 +00:00
Arpit Agarwal
cd768489f3 HDFS-5515. Fix TestDFSStartupVersions for HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1542176 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-15 05:21:58 +00:00
Jing Zhao
620890fcc0 HDFS-5489. Use TokenAspect in WebHDFSFileSystem. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542158 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-15 02:11:38 +00:00
Arpit Agarwal
132a8ff7c7 Merging r1541618 through r1542122 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1542125 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 23:56:56 +00:00
Kihwal Lee
ceea91c9cd HDFS-5438. Flaws in block report processing can cause data loss. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542054 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 20:11:50 +00:00
Jing Zhao
43fa41fdee HDFS-5506. Use URLConnectionFactory in DelegationTokenFetcher. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542011 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 18:40:36 +00:00
Kihwal Lee
fe67e30bc2 HDFS-4995. Make getContentSummary less expensive. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541971 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 16:49:31 +00:00
Jing Zhao
b771197ed5 HDFS-5487. Introduce unit test for TokenAspect. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541776 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 01:14:38 +00:00
Jing Zhao
735aae32e4 HDFS-5504. In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541773 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 01:03:34 +00:00
Jing Zhao
1c211f6749 HDFS-5440. Extract the logic of handling delegation tokens in HftpFileSystem to the TokenAspect class. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541665 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 19:25:09 +00:00
Colin McCabe
3c591aa442 HDFS-5366. recaching improvements (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541647 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 18:18:37 +00:00
Arpit Agarwal
bf9f8511fa Merging r1541342 through r1541617 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1541620 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 17:15:36 +00:00
Colin McCabe
39def49661 HDFS-5485. add command-line support for modifyDirective (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541377 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 03:29:02 +00:00
Tsz-wo Sze
ba98e8f737 merge r1535792 through r1541341 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1541342 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 01:14:37 +00:00
Andrew Wang
9d06631719 HDFS-5450. better API for getting the cached blocks locations. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541338 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 00:31:55 +00:00
Colin McCabe
ce35e0950c HDFS-5471. CacheAdmin -listPools fails when user lacks permissions to view all pools (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541323 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 23:52:23 +00:00
Jing Zhao
8162fdcdbc HDFS-5425. Renaming underconstruction file with snapshots can make NN failure on restart. Contributed by Vinay and Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541261 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 22:10:09 +00:00
Andrew Wang
646fcc8a56 HDFS-5495. Remove further JUnit3 usages from HDFS. Contributed by Jarek Jarcec Cecho. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540914 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 01:56:56 +00:00
Arpit Agarwal
ec5eebc450 Merging r1540548 through r1540909 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540910 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 01:16:10 +00:00
Arpit Agarwal
26f2bd67f2 HDFS-5491. Update editsStored for HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540903 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 00:48:55 +00:00
Jing Zhao
f10642a8fd HDFS-5488. Clean up TestHftpURLTimeout. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540894 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 00:21:57 +00:00
Andrew Wang
9673baa7e8 HDFS-5320. Add datanode caching metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540796 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-11 18:30:07 +00:00
Arpit Agarwal
a161ff8f09 HDFS-5486. Fix TestNameNodeMetrics for HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540619 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-11 06:40:06 +00:00
Arpit Agarwal
bb5bd30df6 Merging r1540239 through r1540547 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540549 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-10 21:01:12 +00:00
Arpit Agarwal
907fb15ee8 HDFS-5480. Update Balancer for HDFS-2832. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540547 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-10 20:59:32 +00:00
Chris Nauroth
25ebe6bfd7 HDFS-5482. DistributedFileSystem#listPathBasedCacheDirectives must support relative paths. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540257 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-09 05:54:19 +00:00
Tsz-wo Sze
fccbb5072c merge of r1535792 through r1540238 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540239 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-09 01:34:22 +00:00
Jing Zhao
37bc8e0c14 HDFS-5325. Remove WebHdfsFileSystem#ConnRunner. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540235 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-09 01:19:54 +00:00
Arpit Agarwal
90d1b1b6a4 HDFS-5481. Fix TestDataNodeVolumeFailure in branch HDFS-2832. (Contributed by Junping Du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540228 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-09 00:19:48 +00:00
Jing Zhao
f2ad787a27 HDFS-5476. Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540142 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-08 18:18:03 +00:00
Colin McCabe
97199baea1 HDFS-5394: Fix race conditions in DN caching and uncaching (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539909 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-08 03:00:19 +00:00
Arpit Agarwal
6b0611ed24 Merging r1539737 through r1539896 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539898 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-08 01:44:24 +00:00
Colin McCabe
f79b3e6b17 HDFS-5326. add modifyDirective to cacheAdmin (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539839 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 22:07:16 +00:00
Colin McCabe
77afc605fd HDFS-5468. CacheAdmin help command does not recognize commands (Stephen Chu via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539786 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 19:58:52 +00:00
Jing Zhao
9964a94386 HDFS-5443. Delete 0-sized block when deleting an under-construction file that is included in snapshot. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539754 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 18:37:38 +00:00
Arpit Agarwal
a604e3b73b HDFS-5472. Fix TestDatanodeManager, TestSafeMode and TestNNThroughputBenchmark. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539736 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 17:57:30 +00:00
Tsz-wo Sze
75777f1626 HDFS-5470. Add back trunk's reportDiff algorithm to the branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539504 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 00:13:05 +00:00
Arpit Agarwal
fa5ba6d977 HDFS-5439. Fix TestPendingReplication. (Contributed by Junping Du, Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539247 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-06 06:50:33 +00:00
Arpit Agarwal
103fd6c6d8 Merging r1538408 through r1539244 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539245 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-06 06:14:13 +00:00
Jing Zhao
a6250a4943 HDFS-5427. Not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1538875 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-05 06:38:50 +00:00
Chris Nauroth
c47b3d7502 HDFS-5456. NameNode startup progress creates new steps if caller attempts to create a counter for a step that doesn't already exist. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1538872 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-05 06:04:07 +00:00
Arpit Agarwal
d2b7b6589d HDFS-5457. Fix TestDatanodeRegistration, TestFsck and TestAddBlockRetry. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1538794 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-04 22:49:00 +00:00
Tsz-wo Sze
7e46025f91 Merge r1537584 through r1538407 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1538408 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-03 17:51:52 +00:00
Tsz-wo Sze
26a1fda51e HDFS-5452. Fix TestReplicationPolicy and TestBlocksScheduledCounter. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1538407 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-03 17:49:08 +00:00
Arpit Agarwal
cbdeba29bd HDFS-5447. Fix TestJspHelper in branch HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1538145 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-02 05:21:48 +00:00
Andrew Wang
3b91b7dece HDFS-5037. Active NN should trigger its own edit log rolls. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1538059 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-01 20:49:54 +00:00
Arpit Agarwal
2af5083a35 HDFS-5437. Fix TestBlockReport and TestBPOfferService failures. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1537365 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-31 02:32:25 +00:00
Arpit Agarwal
4eebf56ccf Merging r1536890 through r1537251 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1537252 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-30 19:28:44 +00:00
Chris Nauroth
9c29b86cab HDFS-5432. TestDatanodeJsp fails on Windows due to assumption that loopback address resolves to host name localhost. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1537230 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-30 18:37:48 +00:00
Andrew Wang
75a162ff92 HDFS-5433. When reloading fsimage during checkpointing, we should clear existing snapshottable directories. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1537192 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-30 17:27:51 +00:00
Arpit Agarwal
68a79b0d3f HDFS-5436. Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web. (Contributed by Haohui Mai) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1536921 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-29 22:44:34 +00:00
Arpit Agarwal
c2495a7bff Merging r1536572 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1536889 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-29 21:04:31 +00:00
Colin McCabe
1b48f44feb Merge HDFS-4949 branch back into trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1536572 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-29 00:49:20 +00:00
Arpit Agarwal
67b93d6e25 Merging r1535792 through r1536181 from trunk to HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1536182 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-27 18:43:58 +00:00
Arpit Agarwal
b9d561c548 HDFS-5214. Fix NPEs in BlockManager and DirectoryScanner. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1536179 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-27 18:29:49 +00:00
Jing Zhao
5829029154 HDFS-5257. addBlock() retry should return LocatedBlock with locations else client will get AIOBE. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1535811 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-25 18:43:06 +00:00
Tsz-wo Sze
ec01db59ce HDFS-5417. Fix storage IDs in PBHelper and UpgradeUtilities. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1535791 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-25 17:21:49 +00:00
Andrew Wang
dc2ee20aec HDFS-5419. Fixup test-patch.sh warnings on HDFS-4949 branch. (wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1535607 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-25 01:56:05 +00:00
Andrew Wang
e87b2a3684 merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1535563 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-24 21:38:25 +00:00
Arpit Agarwal
1fcc24d56a Merging r1535122 through r1535532 from trunk to HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1535534 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-24 20:33:04 +00:00
Andrew Wang
4004a42d53 HDFS-5404 Resolve regressions in Windows compatibility on HDFS-4949 branch. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1535217 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-24 00:08:15 +00:00
Jing Zhao
1387fb1394 HDFS-5363. Refactor WebHdfsFileSystem: move SPENGO-authenticated connection creation to URLConnectionFactory. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1535169 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-23 20:48:25 +00:00
Tsz-wo Sze
b442fe92fb Merge r1534894 through r1535121 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1535122 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-23 19:00:35 +00:00
Aaron Myers
82ed72d1d4 HDFS-5403. WebHdfs client cannot communicate with older WebHdfs servers post HDFS-5306. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1535056 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-23 15:15:29 +00:00
Arpit Agarwal
01f37e42f0 HDFS-5390. Send one incremental block report per storage directory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1534891 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-23 01:28:48 +00:00
Arpit Agarwal
b884af72c5 HDFS-5398. NameNode changes to process storage reports per storage directory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1534847 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-22 23:29:40 +00:00
Arpit Agarwal
ef17685f79 Merging r1534279 through r1534706 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1534707 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-22 17:24:52 +00:00
Arpit Agarwal
0ebab3a88a HDFS-5377. Heartbeats from Datandode should include one storage report per storage directory 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1534464 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-22 02:22:17 +00:00
Tsz-wo Sze
df87ed34f2 HDFS-4885. Improve the verifyBlockPlacement() API in BlockPlacementPolicy. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1534426 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-22 00:20:39 +00:00
Tsz-wo Sze
40fec97bef svn merge -c -1534417 . for reverting HDFS-4885, which should be committed to trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1534424 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-22 00:19:04 +00:00
Tsz-wo Sze
12ed24af66 HDFS-4885. Improve the verifyBlockPlacement() API in BlockPlacementPolicy. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1534417 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-21 23:48:08 +00:00
Colin McCabe
69e5f90e9f HDFS-5385. Caching RPCs are AtMostOnce, but do not persist client ID and call ID to edit log. (Chris Nauroth via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1534345 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-21 19:42:35 +00:00
Colin McCabe
f9c08d02eb HDFS-5378. In CacheReport, don't send genstamp and length on the wire (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1534334 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-21 19:29:46 +00:00
Arpit Agarwal
62f95b003b Merging r1533208 through r1534278 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1534279 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-21 17:11:34 +00:00
Colin McCabe
d61af97810 HDFS-5203. Concurrent clients that add a cache directive on the same path may prematurely uncache each other. (Chris Nauroth via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1533651 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-18 22:15:26 +00:00
Jonathan Turner Eagles
a19b956975 HDFS-4511. Cover package org.apache.hadoop.hdfs.tools with unit test (Andrey Klochkov via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1533270 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-17 21:49:30 +00:00
Andrew Wang
dcb0b85333 HDFS-5383. fix broken caching unit tests (Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1533253 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-17 20:31:13 +00:00
Arpit Agarwal
f8d5755a69 Merging r1532911 through r1533207 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1533208 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-17 18:54:53 +00:00
Andrew Wang
34f08944b7 merge trunk to branch HDFS-4949 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532952 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-17 02:14:33 +00:00
Andrew Wang
e432b4fe5e HDFS-5360. Improvement of usage message of renameSnapshot and deleteSnapshot. Contributed by Shinichi Yamashita. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532930 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 22:59:51 +00:00
Jonathan Turner Eagles
b838776163 HADOOP-9078. enhance unit-test coverage of class org.apache.hadoop.fs.FileContext (Ivan A. Veselovsky via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532928 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 22:42:12 +00:00
Colin McCabe
3cc7a38a53 HDFS-5096. Automatically cache new data added to a cached path (contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532924 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 22:15:33 +00:00
Arpit Agarwal
168b133337 Merging r1527684 through r1532876 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1532910 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 21:07:28 +00:00
Chris Nauroth
8da82eba1c HDFS-5373. hdfs cacheadmin -addDirective short usage does not mention -replication parameter. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532888 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 20:23:14 +00:00
Chris Nauroth
2cf5084c32 HDFS-5358: Add updated editsStored file for tests. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532863 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 18:58:38 +00:00
Tsz-wo Sze
c46525ef27 Add TestOpenFilesWithSnapshot.java for HDFS-5283. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532860 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 18:44:21 +00:00
Tsz-wo Sze
ffe347151e HDFS-5283. Under construction blocks only inside snapshots should not be counted in safemode threshhold. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532857 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-16 18:38:31 +00:00
Jing Zhao
2145486ea9 HDFS-5130. Add test for snapshot related FsShell and DFSAdmin commands. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532580 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-15 22:45:08 +00:00
Andrew Wang
efe545b0c2 HDFS-5358. Add replication field to PathBasedCacheDirective. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532124 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-14 22:56:11 +00:00
Colin McCabe
15d08c4778 HDFS-5349. DNA_CACHE and DNA_UNCACHE should be by blockId only (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1532116 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-14 22:19:10 +00:00
Jing Zhao
cf0cf0a691 HDFS-5342. Provide more information in the FSNamesystem JMX interfaces. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532090 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-14 20:56:37 +00:00
Brandon Li
7cd044b1aa HDFS-5329. Update FSNamesystem#getListing() to handle inode path in startAfter token. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531617 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-13 04:28:49 +00:00
Andrew Wang
09e9e57a0b HDFS-5348. Fix error message when dfs.datanode.max.locked.memory is improperly configured. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1531460 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 23:13:13 +00:00
Jing Zhao
f7eaacc103 HDFS-5322. HDFS delegation token not found in cache errors seen on secure HA clusters. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531436 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 21:49:01 +00:00
Chris Nauroth
8111c3af6b HDFS-5224. Refactor PathBasedCache* methods to use a Path rather than a String. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1531406 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-11 19:44:20 +00:00
Suresh Srinivas
f2f5cdb555 HDFS-5335. Hive query failed with possible race in dfs output stream. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1531152 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-10 23:58:08 +00:00
Colin McCabe
b8ae4e2a8e HDFS-5323. Remove some deadcode in BlockManager (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530814 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 22:27:27 +00:00
Andrew Wang
3fc8792b5c HDFS-5304. Expose if a block replica is cached in getFileBlockLocations. (Contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530802 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 21:30:08 +00:00
Kihwal Lee
f6a2cac321 HDFS-4510. Cover classes ClusterJspHelper/NamenodeJspHelper with unit tests. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530669 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 15:10:33 +00:00
Daryn Sharp
b858b812b7 HADOOP-9470. eliminate duplicate FQN tests in different Hadoop modules (Ivan A. Veselovsky via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530667 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-09 15:09:37 +00:00
Andrew Wang
54801ba4f9 Addenum for HDFS-5309, update binary edits again 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1530410 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 20:01:48 +00:00
Brandon Li
09998741ac HDFS-5316. Namenode ignores the default https port. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530150 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 04:26:01 +00:00
Brandon Li
61c1dd96c3 HDFS-5317. Go back to DFS Home link does not work on datanode webUI. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530114 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 00:07:12 +00:00
Jing Zhao
1fe1942328 HDFS-5291. Standby namenode after transition to active goes into safemode. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530112 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 23:58:44 +00:00
Brandon Li
267a606831 HDFS-5307. Support both HTTP and HTTPS in jsp pages. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530027 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 19:02:55 +00:00
Jing Zhao
7317e97bd7 HDFS-5299. DFS client hangs in updatePipeline RPC when failover happened. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529660 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-06 18:39:03 +00:00
Andrew Wang
633b693517 HDFS-5309. Fix failing caching unit tests. (Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1529646 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-06 17:06:03 +00:00
Jing Zhao
cb5a51565a HADOOP-10017. Fix NPE in DFSClient#getDelegationToken when doing Distcp from a secured cluster to an insecured cluster. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529571 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-06 06:15:31 +00:00
Brandon Li
8e08046661 HDFS-5306. Datanode https port is not available at the namenode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529562 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-06 03:22:57 +00:00
Jing Zhao
cae1ed9f6c HDFS-5308. Replace HttpConfig#getSchemePrefix with implicit schemes in HDFS JSP. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529512 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-05 20:40:48 +00:00
Andrew Wang
eb2175db1a HDFS-5190. Move cache pool related CLI commands to CacheAdmin. (Contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1529334 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-04 22:28:23 +00:00
Jing Zhao
3c1f18de43 HDFS-5300. FSNameSystem#deleteSnapshot() should not check owner in case of permissions disabled. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529294 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-04 20:54:06 +00:00
Andrew Wang
af1ac9a5e8 HDFS-5119. Persist CacheManager state in the edit log. (Contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1529238 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-04 17:46:18 +00:00
Aaron Myers
65a55f2294 HDFS-5289. Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528693 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-03 00:38:00 +00:00
Chris Nauroth
fc5bd930df HDFS-5279. Guard against NullPointerException in NameNode JSP pages before initialization of FSNamesystem. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528308 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-02 05:25:18 +00:00
Arpit Agarwal
b99d160437 HDFS-5255. Distcp job fails with hsftp when https is enabled in insecure cluster. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528279 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-02 00:03:15 +00:00
Kihwal Lee
4fe912df9c HDFS-4512. Cover package org.apache.hadoop.hdfs.server.common with tests. Contributed by Vadim Bondarev. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1528097 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-01 14:02:19 +00:00
Kihwal Lee
6d5577fe7b HDFS-4517. Cover class RemoteBlockReader with unit tests. Contributed by Vadim Bondarev and Dennis Y. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527807 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-30 22:31:00 +00:00
Arpit Agarwal
6331ff024c Merging r1526971 through r1527683 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1527697 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-30 18:28:07 +00:00
Chris Nauroth
eccdb9aa8b HDFS-5260. Merge zero-copy memory-mapped HDFS client reads to trunk and branch-2. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527113 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-27 22:51:12 +00:00
Jing Zhao
b2e174c9a5 HDFS-5265. Namenode fails to start when dfs.https.port is unspecified. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527093 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-27 21:45:00 +00:00
Arpit Agarwal
46099ce7f1 HDFS-4988. Datanode must support all the volumes as individual storages. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1526969 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-27 16:05:39 +00:00
Arpit Agarwal
8062d8c239 Merging r1526366 through r1526708 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1526717 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-26 21:49:18 +00:00
Chris Nauroth
ae501ceeb7 HDFS-5186. TestFileJournalManager fails on Windows due to file handle leaks. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526615 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-26 17:33:07 +00:00
Chris Nauroth
269eb42b2f HDFS-5258. Skip tests in TestHDFSCLI that are not applicable on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526610 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-26 17:23:16 +00:00
Arpit Agarwal
77856140f4 Merging r1525759 through r1526365 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1526366 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-26 03:41:09 +00:00
Colin McCabe
464470e715 HADOOP-9981. globStatus should minimize its listStatus and getFileStatus calls. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526297 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-25 20:51:09 +00:00
Colin McCabe
9a361c5821 HDFS-5191. Revisit zero-copy API in FSDataInputStream to make it more intuitive (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1526020 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 21:40:53 +00:00
Tsz-wo Sze
5827d1667c HDFS-5228. The RemoteIterator returned by DistributedFileSystem.listFiles may throw NullPointerException. Contributed by szetszwo and cnauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525828 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 10:16:14 +00:00
Suresh Srinivas
b838ac89a6 HDFS-5251. Race between the initialization of NameNode and the http server. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525787 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 05:31:02 +00:00
Arpit Agarwal
114aa229de Merging r1525409 through r1525758 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525759 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-24 00:57:43 +00:00
Arpit Agarwal
eef16dadaf HDFS-5139. Remove redundant -R option from setrep. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525659 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 17:57:23 +00:00
Daryn Sharp
3dfadca6f5 HDFS-5239. Allow FSNamesystem lock fairness to be configurable (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525624 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-23 15:27:08 +00:00
Arpit Agarwal
5133d78c1a Merging r1524587 through r1525408 from trunk to branch HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525410 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-22 18:23:22 +00:00
Arpit Agarwal
4551da302d HDFS-5233. Use Datanode UUID to identify Datanodes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1525407 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-22 18:03:02 +00:00
Andrew Wang
a0d9a155a4 HDFS-5236. Change PathBasedCacheDirective APIs to be a single value rather than batch. (Contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1525183 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-21 00:20:36 +00:00
Andrew Wang
aae86e4f3f merge changes from trunk to HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1524865 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 23:42:10 +00:00
Colin McCabe
1c4f4a38ca HADOOP-9929. Insufficient permission for a path reported as file not found. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524611 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-19 02:09:43 +00:00
Arpit Agarwal
a80b826eef Merging r1523878 through r1524586 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1524590 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 21:54:21 +00:00
Jing Zhao
7a2443e9f8 HDFS-5122. Support failover and retry in WebHdfsFileSystem for NN HA. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524562 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 20:47:16 +00:00
Andrew Wang
e202d4d154 HDFS-5213. Separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1524561 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 20:43:40 +00:00
Arpit Agarwal
22b401284b HDFS-5031. BlockScanner scans the block multiple times. (Vinay via Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524553 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 20:08:50 +00:00
Jing Zhao
f278a491dc HDFS-5219. Add configuration keys for retry policy in WebHDFSFileSystem. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524498 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 17:29:27 +00:00
Tsz-wo Sze
abf09f090f HDFS-4990. Change BlockPlacementPolicy to choose storages instead of datanodes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1524444 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 15:12:52 +00:00
Tsz-wo Sze
0398943572 Merge r1523804 through r1523877 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1523878 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 02:59:14 +00:00
Tsz-wo Sze
f98c343c7f HDFS-5207. In BlockPlacementPolicy.chooseTarget(..), change the writer and the excludedNodes parameter types respectively to Node and Set. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523875 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-17 02:38:47 +00:00
Andrew Wang
85c2036029 HDFS-5210. Fix some failing unit tests on HDFS-4949 branch. (Contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523754 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-16 18:41:27 +00:00
Tsz-wo Sze
959635f0e7 Merge r1523109 through r1523401 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1523402 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-15 04:32:39 +00:00
Tsz-wo Sze
d01caeee77 HDFS-5188. In BlockPlacementPolicy, reduce the number of chooseTarget(..) methods; replace HashMap with Map in parameter declarations and cleanup some related code. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523400 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-15 04:15:57 +00:00
Colin McCabe
50af34f778 HDFS-5201. NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523153 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-14 00:05:29 +00:00
Andrew Wang
40eb94ade3 HDFS-5053. NameNode should invoke DataNode APIs to coordinate caching. (Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1523145 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-13 23:27:22 +00:00
Arpit Agarwal
06eb46eda3 Merging r1521566 through r1523108 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1523110 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-13 21:27:58 +00:00
Jing Zhao
1260d598d3 HDFS-4096. Add snapshot information to namenode WebUI. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523091 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-13 20:41:11 +00:00
Jing Zhao
965ce2041a HDFS-5192. NameNode may fail to start when dfs.client.test.drop.namenode.response.number is set. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522775 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-13 04:29:50 +00:00
Colin McCabe
02e0e158a2 HDFS-5158. Add command-line support for manipulating cache directives 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1522272 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-12 03:55:10 +00:00
Tsz-wo Sze
b2976af140 HDFS-5157. Add StorageType to FsVolume. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1521743 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-11 06:30:01 +00:00
Arpit Agarwal
23bf148a2f Merging r1520450 through r1521565 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1521566 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-10 18:03:08 +00:00
Colin McCabe
3a9cd79e9d HDFS-5120. Add command-line support for manipulating cache pools. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1521240 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-09 18:53:01 +00:00
Tsz-wo Sze
282be1b38e HDFS-5134. Move blockContentsStale, heartbeatedSinceFailover and firstBlockReport from DatanodeDescriptor to DatanodeStorageInfo; and fix a synchronization problem in DatanodeStorageInfo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1520938 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-08 22:53:36 +00:00
Andrew Wang
efc1048ffe Revert HADOOP-9877 because of breakage reported in HADOOP-9912 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520713 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-06 22:57:44 +00:00
Colin McCabe
6431192c0e HDFS-4879. Add BlockedArrayList collection to avoid CMS full GCs (Contributed by Todd Lipcon) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520667 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-06 19:05:26 +00:00
Colin McCabe
f41f8b8842 HDFS-5163. Miscellaneous cache pool RPC fixes (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1520665 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-06 18:52:50 +00:00
Chris Nauroth
e10dbf41bc HDFS-4491. Add/delete files missed in prior commit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520482 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-06 03:14:20 +00:00
Chris Nauroth
5eb618ee1f HDFS-4491. Parallel testing HDFS. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520479 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-06 03:06:41 +00:00
Arpit Agarwal
bbce64c8c5 Merging r1519884 through r1520449 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1520454 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-05 23:01:00 +00:00
Aaron Myers
8aea748ec3 HDFS-5159. Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1520363 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-05 16:21:26 +00:00
Colin McCabe
d56d0b46e1 commit correct version of HDFS-5121 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1520090 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-04 18:23:51 +00:00
Arpit Agarwal
ec57e3019f Merge r1518851 from trunk (reconcile branch conflicts with the fix for HDFS-5077) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519882 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-03 23:15:28 +00:00
Colin McCabe
97b7267977 HDFS-5121. Add RPCs for creating and manipulating cache pools. (Contributed by Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1519841 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-03 20:38:45 +00:00
Tsz-wo Sze
336c0344f5 Merge r1517887 through r1518850 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519796 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-03 19:01:19 +00:00
Tsz-wo Sze
3f070e83b1 HDFS-5009. Include storage information in the LocatedBlock. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519691 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-03 14:03:35 +00:00
Tsz-wo Sze
f7e3bc553d HDFS-5154. Fix TestBlockManager and TestDatanodeDescriptor after HDFS-4987. Contributed by Junping Du 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1519548 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-03 04:04:22 +00:00
Andrew Wang
fc14a92c6b HDFS-5141. Add cache status information to datanode heartbeat. (Contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1519101 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-30 22:15:51 +00:00
Konstantin Shvachko
eb484bb562 HDFS-5077. NPE in FSNamesystem.commitBlockSynchronization(). Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518851 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-29 23:08:02 +00:00
Tsz-wo Sze
5d9d702607 HDFS-4987. Namenode changes to track multiple storages per datanode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1518087 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-28 06:30:15 +00:00
Kihwal Lee
dfaa2e305d Adding the new test file for HDFS-3245 that was accidentally dropped 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517994 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-27 21:14:12 +00:00
Kihwal Lee
10a62366a5 HDFS-5128. Allow multiple net interfaces to be used with HA namenode RPC server. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517981 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-27 20:53:31 +00:00
Arpit Agarwal
73d14311bc HDFS-5000. DataNode configuration should allow specifying storage type 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517417 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-26 03:18:40 +00:00
Colin McCabe
b992219fa1 HDFS-5050. Add DataNode support for mlock and munlock (contributed by Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1517106 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-24 03:41:25 +00:00
Arpit Agarwal
c41df254fe Merge all changes from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1517030 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-23 20:57:00 +00:00
Jonathan Turner Eagles
e588ffe3c0 HDFS-4329. DFSShell issues with directories with spaces in name (Cristina L. Abad via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516904 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-23 15:48:43 +00:00
Colin McCabe
920b4cc06f HDFS-5052. Add cacheRequest/uncacheRequest support to NameNode. (Contributed by Colin Patrick McCabe.) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1516669 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-22 23:37:51 +00:00
Arpit Agarwal
6f699e8ea5 HDFS-5115. Make StorageID a UUID. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1516666 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-22 23:21:07 +00:00
Jing Zhao
6fd8766a51 HDFS-5045. Add more unit tests for retry cache to cover all AtMostOnce methods. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516348 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-22 01:06:57 +00:00
Arpit Agarwal
5e27288c1e HDFS-4985. Add storage type to the protocol and expose it in block report and block locations 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1516323 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-21 23:07:29 +00:00
Luke Lu
782191f1ba HADOOP-9784. Add a builder for HttpServer. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516128 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-21 10:12:13 +00:00
Chris Nauroth
5e68bc4cd6 HDFS-4594. WebHDFS open sets Content-Length header to what is specified by length parameter rather than how much data is actually returned. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515989 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 22:15:22 +00:00
Andrew Wang
b7a6c5ebb4 HADOOP-9877. Fix listing of snapshot directories in globStatus. (Binglin Chang via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515955 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 20:19:07 +00:00
Andrew Wang
67f86baab0 HDFS-4953. Enable HDFS local reads via mmap. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1515906 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-20 18:07:47 +00:00
Brandon Li
214d4377fc HDFS-5104 Support dotdot name in NFS LOOKUP operation. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515042 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-17 21:16:50 +00:00
Chris Nauroth
9ba95136e2 HDFS-5106. TestDatanodeBlockScanner fails on Windows due to incorrect path format. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514911 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 22:28:41 +00:00
Arpit Agarwal
218ea7380c HDFS-5105. TestFsck fails on Windows. (Contributed by Chuan Liu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514852 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 19:04:43 +00:00
Jing Zhao
8d21926c26 HDFS-5102. Snapshot names should not be allowed to contain slash characters. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514797 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 17:14:34 +00:00
Chris Nauroth
d9de6a928d HDFS-5103. TestDirectoryScanner fails on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514576 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 04:38:03 +00:00
Chris Nauroth
99064ec905 HDFS-5100. TestNamenodeRetryCache fails on Windows due to incorrect cleanup. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514573 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-16 04:17:08 +00:00
Colin McCabe
8df7e7deec HADOOP-9865. FileContext#globStatus has a regression with respect to relative path. (Contributed by Chaun Lin) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514531 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 23:05:41 +00:00
Konstantin Shvachko
10ec8a248e HDFS-2994. If lease soft limit is recovered successfully the append can fail. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514500 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 21:21:10 +00:00
Jing Zhao
02b19e0738 HDFS-5076. Add MXBean methods to query NN's transaction information and JournalNode's journal status. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514422 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 18:22:52 +00:00
Jing Zhao
8172215e56 HDFS-5080. BootstrapStandby not working with QJM when the existing NN is active. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514386 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 17:19:52 +00:00
Chris Nauroth
26c5a490e5 HDFS-5093. TestGlobPaths should re-use the MiniDFSCluster to avoid failure on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514366 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 16:51:07 +00:00
Chris Nauroth
97d04ae132 HDFS-4632. globStatus using backslash for escaping does not work on Windows. Contributed by Chuan Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514168 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 06:03:07 +00:00
Konstantin Shvachko
9cf82b6a7b HDFS-5068. Convert NNThroughputBenchmark to a Tool to allow generic options. Contributed by Konstantin Shvachko. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514114 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 01:12:21 +00:00
Andrew Wang
dd00bb71aa merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1514105 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-15 00:15:11 +00:00
Andrew Wang
49a892056d HDFS-4816. transitionToActive blocks if the SBN is doing checkpoint image transfer. (Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1514095 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-14 23:32:29 +00:00
Doug Cutting
36cedca874 HADOOP-9740. Fix FsShell '-text' command to be able to read Avro files stored in HDFS. Contributed by Allan Yan. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513684 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-13 23:04:55 +00:00
Colin McCabe
70527c8754 merge trunk into HDFS-4949 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1513658 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-13 21:19:53 +00:00
Andrew Wang
d748123e2c TestGlobPath symlink tests fail to cleanup properly. (cmccabe via wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1513251 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-12 20:44:23 +00:00
Ivan Mitic
5726834cae HDFS-5065. TestSymlinkHdfsDisable fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512870 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-11 04:38:19 +00:00
Kihwal Lee
2f988135e3 HDFS-4993. Fsck can fail if a file is renamed or deleted. Contributed by Robert Parker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1512451 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-09 19:13:22 +00:00
Colin McCabe
2a4031940c HDFS-5049. Add JNI mlock support. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4949@1512427 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-09 18:14:07 +00:00
Andrew Wang
95f9a515aa HADOOP-9817. FileSystem#globStatus and FileContext#globStatus need to work with symlinks. (Colin Patrick McCabe via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510807 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 23:28:14 +00:00
Chris Nauroth
ed2c62012a HDFS-4905. Add appendToFile command to "hdfs dfs". Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510773 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 22:05:10 +00:00
Kihwal Lee
ccdb978603 HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. Contributed by Derek Dagit. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1510724 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-05 20:48:59 +00:00
Colin McCabe
f216f22915 HADOOP-9761. ViewFileSystem#rename fails when using DistributedFileSystem (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509874 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-02 21:42:38 +00:00
Tsz-wo Sze
134557da47 HADOOP-9803. Add a generic type parameter to RetryInvocationHandler. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509070 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-01 02:20:33 +00:00
Colin McCabe
9ad19eec6f HADOOP-9758. Provide configuration option for FS/FC symlink resolution. (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509064 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-01 01:04:29 +00:00
Suresh Srinivas
8c7a7e6196 HDFS-5025. Record ClientId and CallId in EditLog to enable rebuilding retry cache in case of HA failover. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1508332 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-30 07:51:38 +00:00
Konstantin Boudnik
dc17bda4b6 HDFS-5004. Add additional JMX bean for NameNode status data. Contributed by Trevor Lorimer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507530 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 23:59:37 +00:00
Colin McCabe
02d5830a00 HDFS-5035. getFileLinkStatus and rename do not correctly check permissions of symlinks (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507525 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 23:54:17 +00:00
Suresh Srinivas
7723b139d5 HDFS-5016. Deadlock in pipeline recovery causes Datanode to be marked dead. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507189 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 04:42:41 +00:00
Suresh Srinivas
1b531c1dbb HDFS-4979. Implement retry cache on Namenode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1507170 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-26 01:09:27 +00:00
Jing Zhao
f138ae68f9 HDFS-5024. Make DatanodeProtocol#commitBlockSynchronization idempotent. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506789 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-25 00:32:40 +00:00
Jing Zhao
538653d94c HDFS-5020. Make DatanodeProtocol#blockReceivedAndDeleted idempotent. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1506421 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-24 07:18:11 +00:00
Suresh Srinivas
d35f66f3f0 HDFS-4974. Add Idempotent and AtMostOnce annotations to namenode protocol methods. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505911 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-23 06:40:33 +00:00
Suresh Srinivas
9dbd2e7efc HADOOP-9760. Move GSet and related classes to common from HDFS. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505875 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-23 01:40:58 +00:00
Jing Zhao
11c073134a HDFS-5008. Make ClientProtocol#abandonBlock() idempotent. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505761 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-22 18:22:38 +00:00
Colin McCabe
c1314eb2a3 HDFS-4817. Make HDFS advisory caching configurable on a per-file basis. (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1505753 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-22 18:15:18 +00:00
Jing Zhao
7e2aba0ab5 HDFS-5007. Replace hard-coded property keys with DFSConfigKeys fields. Contributed by Kousuke Saruta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504764 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-19 05:41:33 +00:00
Chris Nauroth
e2efe52ac8 HDFS-4996. ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504679 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 21:57:24 +00:00
Chris Nauroth
a5cd4b9bee HDFS-5003. TestNNThroughputBenchmark failed caused by existing directories. Contributed by Xi Fang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504352 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 03:28:19 +00:00
Jing Zhao
68faa67f1b HDFS-5005. Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1504326 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-18 00:04:28 +00:00
Kihwal Lee
d26334b410 HDFS-4998. TestUnderReplicatedBlocks fails intermittently. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503971 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 01:57:35 +00:00
Jason Darrell Lowe
febc5040b9 HADOOP-9734. Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503954 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-17 00:06:48 +00:00
Suresh Srinivas
afaec5f52d HDFS-4903. Print trash configuration and trash emptier state in namenode log. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1503570 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-16 06:33:40 +00:00
Suresh Srinivas
b47df4e3b9 HDFS-4912. Cleanup FSNamesystem#startFileInternal. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502634 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 17:44:00 +00:00
Jing Zhao
3630a23c55 HDFS-4978. Make disallowSnapshot idempotent. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502400 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-12 00:11:31 +00:00
Colin McCabe
8767e4cde1 HADOOP-9418. Add symlink support to DistributedFileSystem (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502373 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 21:31:04 +00:00
Chris Nauroth
2409882a47 HDFS-4374. Display NameNode startup progress in UI. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502331 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 19:20:38 +00:00
Chris Nauroth
19346d8ca6 HDFS-4373. Add HTTP API for querying NameNode startup progress. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502328 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 19:04:26 +00:00
Chris Nauroth
da8e962e39 HDFS-4372. Track NameNode startup progress. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1502120 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-11 05:35:29 +00:00
Kihwal Lee
3a3109f8bf HDFS-4887. TestNNThroughputBenchmark exits abruptly. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501841 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-10 16:39:37 +00:00
Tsz-wo Sze
6770de7ec4 HDFS-4645. Move from randomly generated block ID to sequentially generated block ID. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500580 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-08 05:29:10 +00:00
Harsh J
81620ca1c9 HADOOP-8844. Add a plaintext fs -text test-case. Contributed by Akira AJISAKA. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500190 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-06 02:16:27 +00:00
Konstantin Boudnik
ed70fb1608 HDFS-4860. Add additional attributes to JMX beans. Contributed by Trevor Lorimer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1500139 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-05 21:36:20 +00:00
Aaron Myers
5428bfbf53 HDFS-4465. Optimize datanode ReplicasMap and ReplicaInfo. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499659 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-04 05:52:13 +00:00
Tsz-wo Sze
05fd0a706a HDFS-4943. WebHdfsFileSystem does not work when original file path has encoded chars. Contributed by Jerry He 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498962 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-02 14:58:35 +00:00
Kihwal Lee
ead7fa0413 HDFS-4888. Refactor and fix FSNamesystem.getTurnOffTip. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498665 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-01 20:20:27 +00:00
Chris Nauroth
750442812c HDFS-4944. WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1498055 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-30 03:38:09 +00:00
Colin McCabe
b6c7de68bc HADOOP-9673. NetworkTopology: When a node cannot be added, print out its location for diagnostic purposes 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1497176 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-27 01:22:43 +00:00
Colin McCabe
03601136dd HADOOP-9355. Abstract Symlink tests to use either FileContext or FileSystem (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496690 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-26 00:35:39 +00:00
Chris Nauroth
d74908bdb6 HDFS-4927. CreateEditsLog creates inodes with an invalid inode ID, which then cannot be loaded by a namenode. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1496350 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-25 05:05:20 +00:00
Jason Darrell Lowe
1087be1df4 HDFS-4205. fsck fails with symlinks. Contributed by Jason Lowe 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495648 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-22 00:41:34 +00:00
Konstantin Shvachko
92cbba386f HDFS-4883. complete() should verify fileId. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495302 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-21 07:28:38 +00:00
Brandon Li
6ecf78a99b HDFS-4772. Add number of children in HdfsFileStatus. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1495253 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-21 00:32:23 +00:00
Tsz-wo Sze
c02953dbc3 HDFS-4908. Reduce snapshot inode memory usage. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494858 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-20 05:10:39 +00:00
Tsz-wo Sze
c68b1d1b31 HDFS-4914. Use DFSClient.Conf instead of Configuration. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494854 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-20 04:43:07 +00:00
Colin McCabe
57006e1c8c HDFS-4461. DirectoryScanner: volume prefix takes up memory for every block that is scanned (Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494401 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-19 00:34:08 +00:00
Aaron Myers
1c309f763b HDFS-4906. HDFS Output streams should not accept writes after being closed. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494303 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 21:05:16 +00:00
Chris Nauroth
364b379cb8 HDFS-4818. Several HDFS tests that attempt to make directories unusable do not work correctly on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1494023 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 04:47:16 +00:00
Colin McCabe
52ebd9c389 HDFS-4626. ClientProtocol#getLinkTarget should throw an exception for non-symlink and non-existent paths. (Andrew Wang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493980 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-18 01:07:13 +00:00
Jing Zhao
eff5e6da1d HDFS-4875. Add a test for testing snapshot file length. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493850 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-17 17:23:45 +00:00
Chris Nauroth
0d1a994fbb HDFS-4904. Remove JournalService. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493235 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-14 20:27:17 +00:00
Chris Nauroth
0ef156a86e HDFS-4783. TestDelegationTokensWithHA#testHAUtilClonesDelegationTokens fails on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493149 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-14 16:44:22 +00:00
Jing Zhao
7e1744ccf9 HDFS-4902. DFSClient#getSnapshotDiffReport should use string path rather than o.a.h.fs.Path. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492791 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-13 18:11:42 +00:00
Chris Nauroth
c5821cf38b HADOOP-9638. Parallel test changes caused invalid test path for several HDFS tests on Windows. Contributed by Andrey Klochkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1492297 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-12 17:21:47 +00:00
Jing Zhao
390eca2cde HDFS-4873. callGetBlockLocations returns incorrect number of blocks for snapshotted files. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491957 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-11 21:03:09 +00:00
Konstantin Shvachko
8e0f166cf3 HDFS-4878. On Remove Block, block is not removed from neededReplications queue. Contributed by Tao Luo. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491671 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-11 01:39:32 +00:00
Suresh Srinivas
8e23270e0d HDFS-4752. TestRBWBlockInvalidation fails on Windows due to file locking. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491631 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-10 22:37:36 +00:00
Ivan Mitic
cb11d68f40 HDFS-4677. Editlog should support synchronous writes. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1491096 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-08 23:28:37 +00:00
Kihwal Lee
2a76cddcd5 HDFS-4832. Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490803 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-07 20:01:55 +00:00
Kihwal Lee
0e889e77c5 HDFS-4862. SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually. Contributed by Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490486 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-07 01:15:28 +00:00
Konstantin Shvachko
8854c210bd HDFS-4867. metaSave NPEs when there are invalid blocks in repl queue. Contributed by Plamen Jeliazkov and Ravi Prakash. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490433 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-06 20:44:40 +00:00
Jing Zhao
d46e160862 HDFS-4877. Snapshot: fix the scenario where a directory is renamed under its prior descendant. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490421 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-06 20:15:07 +00:00
Jing Zhao
496b80b28c HDFS-4850. Fix OfflineImageViewer to work on fsimages with empty files or snapshots. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490080 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-05 23:32:53 +00:00
Aaron Myers
8171203692 HDFS-4815. TestRBWBlockInvalidation: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed. Contributed by Tian Hong Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489668 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-04 23:01:37 +00:00
Colin McCabe
4ee1ec2126 Remove extra code that code erroneously committed in HDFS-3934 (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489083 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-03 17:58:44 +00:00
Colin McCabe
a7bfb25d2b HDFS-3934. duplicative dfs_hosts entries handled wrong. (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1489065 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-03 17:14:27 +00:00
Jason Darrell Lowe
85623a2d75 HADOOP-9287. Parallel-testing hadoop-common. Contributed by Andrey Klochkov 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1488040 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 22:43:16 +00:00
Brandon Li
bf99961d67 HDFS-4848. copyFromLocal and renaming a file to .snapshot should output that .snapshot is a reserved name. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487942 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 17:26:25 +00:00
Jing Zhao
a0abed41a0 HDFS-4863. The root directory should be added to the snapshottable directory list while loading fsimage. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487698 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-30 01:38:54 +00:00
Jing Zhao
01f27f5c23 HDFS-4857. Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487655 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-29 22:22:44 +00:00
Brandon Li
719034c12c HDFS-4846. Clean up snapshot CLI commands output stacktrace for invalid arguments. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487647 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-29 21:25:01 +00:00
Jing Zhao
973017cab7 HDFS-4842. Identify the correct prior snapshot when deleting a snapshot under a renamed subtree. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1487643 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-29 20:54:53 +00:00
Aaron Myers
8c62c46046 HDFS-4298. StorageRetentionManager spews warnings when used with QJM. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485371 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-22 19:37:41 +00:00
Vinod Kumar Vavilapalli
27e6673ec3 MAPREDUCE-5156. Change hadoop examples ProgramDriver to be able to run 1.x examples jar on top of YARN. This change breaks 0.23.x direct usages of ProgramDriver. Contributed by Zhijie Shen. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1485085 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-22 06:36:24 +00:00
Kihwal Lee
98a692fd63 HDFS-3875. Issue handling checksum errors in write pipeline. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1484808 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-21 13:42:23 +00:00
Aaron Myers
0cd0f64656 HDFS-4830. Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483603 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-16 23:21:35 +00:00
Aaron Myers
58e191f0c5 HDFS-4787. Create a new HdfsConfiguration before each TestDFSClientRetries testcases. Contributed by Tian Hong Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483235 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-16 08:11:23 +00:00
Tsz-wo Sze
da05873e0e HDFS-4826. TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk. Contributed by Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1483150 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-16 02:00:03 +00:00
Tsz-wo Sze
f7af4a014c HDFS-3180. Add socket timeouts to WebHdfsFileSystem. Contributed by Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482661 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-15 02:23:56 +00:00
Kihwal Lee
d027b947d6 HDFS-4805. Webhdfs client is fragile to token renewal errors. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1482121 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-13 22:03:43 +00:00
Aaron Myers
09593530fb HDFS-4300. TransferFsImage.downloadEditsToStorage should use a tmp file for destination. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481987 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-13 17:47:04 +00:00
Aaron Myers
6521b5ee42 HDFS-4765. Permission check of symlink deletion incorrectly throws UnresolvedLinkException. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481976 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-13 17:22:00 +00:00
Aaron Myers
945cb2ecaa HADOOP-9485. No default value in the code for hadoop.rpc.socket.factory.class.default. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481200 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 21:45:32 +00:00
Aaron Myers
b9a0286223 HDFS-4751. TestLeaseRenewer#testThreadName flakes. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481160 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 19:43:48 +00:00
Aaron Myers
4ed1fc58c0 HDFS-4698. Provide client-side metrics for remote reads, local reads, and short-circuit reads. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481121 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 17:58:07 +00:00
Kihwal Lee
1161ceb2c9 HDFS-4799. Corrupt replica can be prematurely removed from corruptReplicas map. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1481084 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 16:36:20 +00:00
Aaron Myers
7e5b63af13 HDFS-4810. several HDFS HA tests have timeouts that are too short. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480841 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 00:16:18 +00:00
Aaron Myers
a18fd620d0 HDFS-4661. A few little code cleanups of some HDFS-347-related code. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1480839 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-10 00:03:17 +00:00
Tsz-wo Sze
5980139140 HDFS-4809. When a QuotaExceededException is thrown during rename, the quota usage should be subtracted back. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480508 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-09 00:23:57 +00:00
Tsz-wo Sze
08ec505d6b HDFS-4806. In INodeDirectoryWithSnapshot, use isInLatestSnapshot() to determine if an added/removed child should be recorded in the snapshot diff. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480146 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-08 01:17:24 +00:00
Tsz-wo Sze
41312abe84 HDFS-4802. Disallowing snapshot on / twice should throw SnapshotException but not IllegalStateException. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1480015 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 18:45:03 +00:00
Tsz-wo Sze
393188c445 Merge r1477868 through r1479732 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479733 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-07 00:17:50 +00:00
Tsz-wo Sze
98b416f5ac HDFS-4801. lsSnapshottableDir throws IllegalArgumentException when root is snapshottable. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479709 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-06 22:48:54 +00:00
Tsz-wo Sze
424b270c94 HDFS-4798. Update computeContentSummary() for the reference nodes in snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1479671 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-06 18:48:24 +00:00
Suresh Srinivas
a4bae51b7d HDFS-4784. NPE in FSDirectory.resolvePath(). Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478276 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 06:02:12 +00:00
Suresh Srinivas
03ba436d42 HDFS-4785. Concat operation does not remove concatenated files from InodeMap. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1478267 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-02 04:51:21 +00:00
Tsz-wo Sze
7c14f1557b HDFS-4781. Fix a NullPointerException when listing .snapshot under a non-existing directory. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1478135 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-01 18:33:08 +00:00
Sanjay Radia
6096cb3435 HDFS-4659 Support setting execution bit for regular files (Brandon Li via sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477994 13f79535-47bb-0310-9956-ffa450edef68
 2013-05-01 13:31:08 +00:00
Tsz-wo Sze
faca77f227 Merge r1476453 through r1477867 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477868 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 23:02:35 +00:00
Tsz-wo Sze
98c0421fbf HDFS-4758. Disallow nested snapshottable directories and unwrap RemoteException. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477867 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 22:55:38 +00:00
Devaraj Das
2542d69d65 HDFS-4778. Fixes some issues that the first patch on HDFS-2576 missed. Contributed by Devaraj Das. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477849 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 21:46:02 +00:00
Tsz-wo Sze
3a3e0f5731 HDFS-4760. Update inodeMap after node replacement. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477827 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 21:05:20 +00:00
Suresh Srinivas
3704e091a8 HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute. Contrbitued by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477427 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-30 00:35:53 +00:00
Suresh Srinivas
e2091275dc HDFS-4610. Reverting the patch Jenkins build is not run. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477396 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 22:40:03 +00:00
Suresh Srinivas
fb30240b87 HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable & FileUtil#canRead/Write/Execute. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477385 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 22:26:53 +00:00
Aaron Myers
ce7e5565f4 HDFS-4305. Add a configurable limit on number of blocks per file, and min block size. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477354 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 21:28:48 +00:00
Aaron Myers
ce73b3b01f HDFS-4687. TestDelegationTokenForProxyUser#testWebHdfsDoAs is flaky with JDK7. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1477344 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 21:10:50 +00:00
Tsz-wo Sze
884cbb681a HDFS-4578. Restrict snapshot IDs to 24-bit wide. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1477181 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 16:37:30 +00:00
Suresh Srinivas
e17d5a9683 HDFS-4734. HDFS Tests that use ShellCommandFencer are broken on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476877 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-29 02:07:58 +00:00
Suresh Srinivas
3e00835dad HDFS-4705. Address HDFS test failures on Windows because of invalid dfs.namenode.name.dir. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476610 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 16:16:19 +00:00
Suresh Srinivas
f55fd818e0 HDFS-4722. TestGetConf#testFederation times out on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476597 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:53:37 +00:00
Suresh Srinivas
fbf10b2604 HDFS-4740. Fixes for a few test failures on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476596 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:47:15 +00:00
Suresh Srinivas
0181ce03af HDFS-4743. TestNNStorageRetentionManager fails on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476591 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:38:02 +00:00
Suresh Srinivas
90612f6423 HDFS-4748. MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476587 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:29:41 +00:00
Suresh Srinivas
b7afde6d52 HDFS-4741. TestStorageRestore#testStorageRestoreFailure fails on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476585 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 14:16:32 +00:00
Tsz-wo Sze
5276f4e04d HDFS-4767. If a directory is snapshottable, do not replace it when clearing quota. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476454 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-27 00:05:49 +00:00
Tsz-wo Sze
60341dae19 Merge r1476010 through r1476452 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476453 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 23:50:17 +00:00
Tsz-wo Sze
75b4231a8c HDFS-4761. When resetting FSDirectory, the inodeMap should also be reset. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476452 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 23:47:57 +00:00
Tsz-wo Sze
a5ae562d70 HDFS-4650. When passing two non-existing snapshot names to snapshotDiff, it returns success if the names are the same. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476408 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 21:30:53 +00:00
Tsz-wo Sze
d2495d553f HDFS-4721. Speed up lease recovery by avoiding stale datanodes and choosing the datanode with the most recent heartbeat as the primary. Contributed by Varun Sharma 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476399 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 20:51:45 +00:00
Devaraj Das
5d2ffde68e HDFS-2576. Enhances the DistributedFileSystem's create API so that clients can specify favored datanodes for a file's blocks. Contributed by Devaraj Das and Pritam Damania. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476395 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 20:39:51 +00:00
Tsz-wo Sze
9da3865841 HDFS-4650. Fix a bug in FSDirectory and add more unit tests for rename with existence of snapshottable directories and snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476012 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 01:31:43 +00:00
Tsz-wo Sze
fa500825fa Merge r1471229 through r1476009 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476011 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 01:19:00 +00:00
Tsz-wo Sze
43ac0739ce svn merge -c -1476006 . for reverting the previous trunk merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476008 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 01:02:45 +00:00
Tsz-wo Sze
a259e0ba79 Merge r1471229 through r1476005 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1476006 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 00:55:45 +00:00
Tsz-wo Sze
06fb184d4d HDFS-4757. Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1476005 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-26 00:50:09 +00:00
Tsz-wo Sze
36f43dcb4f HDFS-4742. Fix appending to a renamed file with snapshot. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1475903 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 18:53:14 +00:00
Tsz-wo Sze
745bfa0311 HDFS-4749. Use INodeId to identify the corresponding directory node in FSImage saving/loading. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1475902 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 18:51:00 +00:00
Suresh Srinivas
16ef8dd3a5 HDFS-4745. TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1475623 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-25 04:25:58 +00:00
Aaron Myers
e6b5b01561 HDFS-4739. NN can miscalculate the number of extra edit log segments to retain. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471769 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 23:29:30 +00:00
Tsz-wo Sze
e8b64d3851 HDFS-4729. Fix OfflineImageViewer and permission checking for snapshot operations. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471665 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 20:47:13 +00:00
Tsz-wo Sze
0fa5cad0b2 HDFS-4686. Update quota computation for rename and INodeReference. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471647 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 20:31:06 +00:00
Tsz-wo Sze
5f1e3b561a Merge r1470760 through r1471228 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471229 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 02:21:58 +00:00
Tsz-wo Sze
65752c09ab HDFS-4735. DisallowSnapshot throws IllegalStateException for nested snapshottable directories. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1471214 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-24 00:28:07 +00:00
Tsz-wo Sze
631be95398 HDFS-4732. Fix TestDFSUpgradeFromImage which fails on Windows due to failure to unpack old image tarball that contains hard links. Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1471090 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-23 18:47:47 +00:00
Tsz-wo Sze
fd24c6e833 HDFS-4725. Fix HDFS file handle leaks in FSEditLog, NameNode, OfflineEditsBinaryLoader and some tests. Contributed by Chris Nauroth 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1470771 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-23 01:18:36 +00:00
Tsz-wo Sze
43bdc22e92 HDFS-4726. Fix test failures after merging the INodeId-INode mapping from trunk. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470735 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-22 22:13:58 +00:00
Suresh Srinivas
27b3f84fe5 Merge trunk to HDFS-2802 branch. This involves fixing many conflict with HDFS-4434. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470225 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 20:22:21 +00:00
Suresh Srinivas
0b101bd7e8 HDFS-4434. Reverting change r1470089 that merges trunk to HDFS-2802. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470194 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 16:57:44 +00:00
Suresh Srinivas
9af0babe7e Merging trunk after fixing conflict with HDFS-4434. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1470089 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-20 00:02:43 +00:00
Kihwal Lee
16cc4a6e86 HDFS-4699. TestPipelinesFailover#testPipelineRecoveryStress fails sporadically. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469839 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 14:08:29 +00:00
Tsz-wo Sze
9ab8fa36f2 HDFS-4717. Change the path parameter type of the snapshot methods in HdfsAdmin from String to Path. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469664 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 02:07:52 +00:00
Suresh Srinivas
980e6c54ba HDFS-4434. Provide a mapping from INodeId to INode. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469644 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-19 00:10:09 +00:00
Tsz-wo Sze
419fd3999c HDFS-4706. Do not replace root inode for disallowSnapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469122 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-18 01:39:12 +00:00
Tsz-wo Sze
2186912ff9 Merge r1467713 through r1469041 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1469042 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-17 19:41:50 +00:00
Suresh Srinivas
d090a3b600 HDFS-4695. TestEditLog leaks open file handles between tests. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1469015 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-17 18:11:31 +00:00
Tsz-wo Sze
9280468b1a HDFS-4550. Refactor INodeDirectory.INodesInPath to a standalone class. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468725 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-17 02:41:38 +00:00
Tsz-wo Sze
6bda1f20ad HDFS-4700. Fix the undo section of rename with snapshots. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468632 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-16 22:03:58 +00:00
Suresh Srinivas
1822529e88 HDFS-4693. Some test cases in TestCheckpoint do not clean up after themselves. Contributed by Arpit Agarwal and Suresh. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1468457 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-16 15:10:47 +00:00
Tsz-wo Sze
d13f6ebe20 HDFS-4666. Define ".snapshot" as a reserved inode name so that users cannot create a file/directory with ".snapshot" as the name. If ".snapshot" is used in a previous version of HDFS, it must be renamed before upgrade; otherwise, upgrade will fail. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1468238 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-15 21:42:06 +00:00
Tsz-wo Sze
bf807063bc Merging r1466653 through r1467712 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467713 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 23:05:54 +00:00
Tsz-wo Sze
0f78c50ea7 HDFS-4692. Use timestamp as default snapshot names. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467706 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 21:41:33 +00:00
Tsz-wo Sze
9c6a7bebe2 HDFS-4675. Fix rename across snapshottable directories. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1467540 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 02:48:34 +00:00
Aaron Myers
801b484f97 HDFS-347. DFS read performance suboptimal when client co-located on nodes with data. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467538 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 02:13:59 +00:00
Konstantin Shvachko
242028a3fb HDFS-4639. startFileInternal() should not increment generation stamp. Contributed by Plamen Jeliazkov. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467534 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-13 01:35:58 +00:00
Aaron Myers
b7aaa1b74c Merge trunk into the HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1467511 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-12 23:05:28 +00:00
Kihwal Lee
f863543206 HDFS-4477. Secondary namenode may retain old tokens. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1467307 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-12 15:18:07 +00:00
Suresh Srinivas
fd1000bcef HDFS-4679. Namenode operation checks should be done in a consistent manner. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466721 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 22:45:23 +00:00
Tsz-wo Sze
3209d4a3c4 Merge r1464808 through r1466652 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1466658 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-10 20:17:39 +00:00
Todd Lipcon
f0351527d5 HDFS-4643. Fix flakiness in TestQuorumJournalManager. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466253 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 21:34:12 +00:00
Suresh Srinivas
d9593621b5 HDFS-4669. TestBlockPoolManager fails using IBM java. Contributed by Tian Hong Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466176 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 19:04:28 +00:00
Suresh Srinivas
e73db45185 HDFS-4674. TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466148 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 17:33:05 +00:00
Suresh Srinivas
425f495591 HDFS-4676. TestHDFSFileSystemContract should set MiniDFSCluster variable to null to free up memory. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1466099 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 16:17:06 +00:00
Suresh Srinivas
f680865d99 HDFS-3940. Add Gset#clear method and clear the block map when namenode is shutdown. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465851 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-09 01:21:48 +00:00
Suresh Srinivas
19201622be HDFS-4339. Persist inode id in fsimage and editlog. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465835 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-08 23:57:31 +00:00
Todd Lipcon
087acf8fd6 HDFS-3981. Fix handling of FSN lock in getBlockLocations. Contributed by Xiaobo Peng and Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465751 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-08 19:57:16 +00:00
Uma Maheswara Rao G
c5bb615317 HDFS-4525. Provide an API for knowing that whether file is closed or not. Contributed by SreeHari. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465434 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-07 18:01:17 +00:00
Aaron Myers
a9d515aed8 HDFS-1804. Add a new block-volume device choosing policy that looks at free space. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1465183 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-06 04:08:09 +00:00
Tsz-wo Sze
07d7d92179 Merge r1462698 through r1464807 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1464815 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-05 02:43:29 +00:00
Tsz-wo Sze
ca848beb53 HDFS-4647. Rename should call setLocalName after an inode is removed from snapshots. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1464795 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 23:52:38 +00:00
Suresh Srinivas
999ce497f0 HDFS-4625. Make TestNNWithQJM#testNewNamenodeTakesOverWriter work on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464780 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 22:54:09 +00:00
Luke Lu
d088d2ddea HDFS-4665. Move TestNetworkTopologyWithNodeGroup to common. (Junping Du via llu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1464303 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-04 07:12:28 +00:00
Kihwal Lee
8293e22565 HDFS-4649. Webhdfs cannot list large directories. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1463698 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-02 19:11:56 +00:00
Tsz-wo Sze
1096917649 HDFS-4611. Update FSImage for INodeReference. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1463332 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-01 23:24:42 +00:00
Tsz-wo Sze
8ee6ecaea4 HDFS-4637. INodeDirectory#replaceSelf4Quota may incorrectly convert a newly created directory to an INodeDirectoryWithSnapshot. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1463075 13f79535-47bb-0310-9956-ffa450edef68
 2013-04-01 01:53:21 +00:00
Tsz-wo Sze
9602869d19 HDFS-4648. For snapshot deletion, when merging the diff from to-delete snapshot to the prior snapshot, make sure files/directories created after the prior snapshot get deleted. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462865 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-30 23:57:27 +00:00
Tsz-wo Sze
f5bbc2d950 Merge r1460409 through r1462697 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462698 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-30 03:50:03 +00:00
Todd Lipcon
bbb24fbf5d Merge trunk into branch. 
Conflicts resolved:
C       hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestShortCircuitLocalRead.java
!     C hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/SocketCache.java
C       hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java
C       hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
C       hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
C       hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/BlockReaderLocal.java

(thanks to Colin for help resolving)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1462652 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-29 21:33:35 +00:00
Todd Lipcon
1611b51a97 HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1462303 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-28 20:58:45 +00:00
Tsz-wo Sze
25aab4203c HDFS-4636. Update quota usage when deleting files/dirs that were created after taking the latest snapshot. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1462192 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-28 16:18:04 +00:00
Sanjay Radia
0e6604aab3 HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly (Chris Nauroth via Sanjay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461846 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 20:49:48 +00:00
Todd Lipcon
694a672131 HDFS-4538. Allow use of legacy blockreader. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1461818 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-27 19:28:12 +00:00
Suresh Srinivas
fdf1e6e07e HDFS-4635. Move BlockManager#computeCapacity to LightWeightGSet. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461364 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-26 23:01:03 +00:00
Tsz-wo Sze
ca3e09bab5 HDFS-4598. Fix the default value of ConcatSourcesParam and the WebHDFS doc. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1461040 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-26 09:54:48 +00:00
Suresh Srinivas
698e3f8ae5 Merging trunk to branch HDFS-2802 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460410 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-24 15:56:18 +00:00
Suresh Srinivas
993a76f2dd HDFS-4627. Fix FSImageFormat#Loader NPE and synchronization issues. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1460389 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-24 14:53:52 +00:00
Tsz-wo Sze
7ed618e324 HDFS-4584. Skip TestNNWithQJM.testNewNamenodeTakesOverWriter() on Windows. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459592 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 23:56:06 +00:00
Tsz-wo Sze
c2e186bae6 HDFS-4615. Fix TestDFSShell failures on Windows. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459586 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 23:48:39 +00:00
Tsz-wo Sze
e976294d35 HDFS-4609. TestAuditLogs should release log handles between tests. Contributed by Ivan Mitic 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459576 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 23:18:26 +00:00
Tsz-wo Sze
1b98d8dda3 HDFS-4607. In TestGetConf.testGetSpecificKey(), use a platform-specific line separator; otherwise, it fails on Windows. Contributed by Ivan Mitic 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459573 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 23:11:20 +00:00
Aaron Myers
a10fbb93e7 HDFS-4246. The exclude node list should be more forgiving, for each output stream. Contributed by Harsh J. Chouraria. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1459475 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-21 18:58:06 +00:00
Aaron Myers
64741f4635 HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457878 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 17:20:13 +00:00
Tsz-wo Sze
a5a66330a8 Merge r1455389 through r1457712 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1457716 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-18 11:45:07 +00:00
Suresh Srinivas
415d038319 HDFS-4604. TestJournalNode fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457069 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 18:59:20 +00:00
Suresh Srinivas
9c7c2f4f27 HDFS-4603. TestMiniDFSCluster fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1457057 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-15 18:41:18 +00:00
Aaron Myers
807e08334e HDFS-4596. Shutting down namenode during checkpointing can lead to md5sum error. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456630 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-14 20:01:03 +00:00
Aaron Myers
bcabbcdf4c HDFS-3277. fail over to loading a different FSImage if the first one we try to load is corrupt. Contributed by Colin Patrick McCabe and Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456578 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-14 18:04:04 +00:00
Kihwal Lee
7987bcf3f4 HDFS-3344. Unreliable corrupt blocks counting in TestProcessCorruptBlocks. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456172 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 21:58:19 +00:00
Aaron Myers
3bf09c5150 HDFS-4591. HA clients can fail to fail over while Standby NN is performing long checkpoint. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456107 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 19:51:19 +00:00
Suresh Srinivas
1f3a18ff44 HDFS-4582. TestHostsFiles fails on Windows. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456060 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 17:43:34 +00:00
Suresh Srinivas
c390683bcc HDFS-4583. TestNodeCount fails. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456052 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 17:15:38 +00:00
Suresh Srinivas
8c20a8f495 HDFS-4595. When short circuit read is fails, DFSClient does not fallback to regular reads. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1456047 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 16:45:31 +00:00
Suresh Srinivas
e4e13618e8 HDFS-4593. TestSaveNamespace fails on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455956 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 14:28:55 +00:00
Suresh Srinivas
b8f3133e04 Adding file missed in the revision 1455805 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455807 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 06:06:21 +00:00
Suresh Srinivas
719c313be1 HDFS-4144. Create test for all snapshot-related metrics. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455805 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-13 06:05:00 +00:00
Suresh Srinivas
c5017c71e4 HDFS-4013. TestHftpURLTimeouts throws NPE. Contributed by Chao Shi. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455755 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 23:37:03 +00:00
Aaron Myers
813e97494a HDFS-4586. TestDataDirs.testGetDataDirsFromURIs fails with all directories in dfs.datanode.data.dir are invalid. Contributed by Ivan Mitic. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455708 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 20:55:33 +00:00
Tsz-wo Sze
3b3ea5c422 HDFS-4563. Update namespace/diskspace usage after deleting snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455396 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 02:41:25 +00:00
Tsz-wo Sze
f35cd45811 Merge r1454237 through r1455388 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1455390 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-12 01:58:43 +00:00
Suresh Srinivas
9daa958c5a HDFS-4572. Fix TestJournal failures on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455360 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 23:13:55 +00:00
Aaron Myers
9d62cdd680 HDFS-4391. TestDataTransferKeepalive fails when tests are executed in a certain order. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1455343 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 21:44:25 +00:00
Tsz-wo Sze
43f8d0b9c9 HDFS-4574. Move Diff to the util package. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454988 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-11 03:45:52 +00:00
Suresh Srinivas
d32fb8a62b HDFS-4579. Annotate snapshot tests. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454748 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-09 18:14:30 +00:00
Suresh Srinivas
c1fabc5e91 HDFS-4573. Fix TestINodeFile on Windows. Contributed by Arpit Agarwal. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454616 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 22:54:50 +00:00
Kihwal Lee
140076fb57 HDFS-4577. Webhdfs operations should declare if authentication is required. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454517 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 20:01:58 +00:00
Kihwal Lee
94a22114b9 HDFS-4567. Webhdfs does not need a token for token operations. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454460 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 16:56:34 +00:00
Suresh Srinivas
82230367ba Merging trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1454238 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-08 04:13:41 +00:00
Daryn Sharp
8a4f03cb70 HDFS-4566. Webdhfs token cancelation should use authentication (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1454059 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 19:58:04 +00:00
Daryn Sharp
97c4668312 HDFS-4560. Webhdfs cannot use tokens obtained by another user (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453955 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 16:56:19 +00:00
Tsz-wo Sze
3145cf1ab2 Merge r1449958 through r1453659 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1453669 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-07 02:57:40 +00:00
Jonathan Turner Eagles
b427fe9de8 HADOOP-9209. Add shell command to dump file checksums (Todd Lipcon via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453613 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 23:17:14 +00:00
Suresh Srinivas
638801cce1 HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453486 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-06 19:15:18 +00:00
Suresh Srinivas
a82e67af6c HDFS-4540. Namenode http server should use the web authentication keytab for spnego principal. Contributed by Arpit Gupta. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1453025 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 21:47:22 +00:00
Kihwal Lee
97ccd64401 HDFS-4542. Webhdfs doesn't support secure proxy users. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452978 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-05 20:17:56 +00:00
Daryn Sharp
cfa86e6110 HDFS-4128. 2NN gets stuck in inconsistent state if edit log replay fails in the middle (kihwal via daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1452384 13f79535-47bb-0310-9956-ffa450edef68
 2013-03-04 16:44:23 +00:00
Suresh Srinivas
2e02b92664 HDFS-4518. Finer grained metrics for HDFS capacity. Contributed by Suresh Srinivas. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1451348 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 21:13:59 +00:00
Tsz-wo Sze
c7cf85ccb4 HDFS-4507. Update quota verification for snapshots. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1451081 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-28 03:08:08 +00:00
Tsz-wo Sze
e2a618e1cc HDFS-4523. Fix INodeFile replacement, TestQuota and javac errors from trunk merge. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1450477 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 22:04:35 +00:00
Aaron Myers
7e2d98da40 HDFS-4235. When outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449984 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 00:44:52 +00:00
Tsz-wo Sze
aa82b03823 Merge r1448505 through r1449957 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449976 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-26 00:10:17 +00:00
Tsz-wo Sze
d8ccf4e521 Add the new test file by HDFS-4520. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449863 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-25 19:49:52 +00:00
Tsz-wo Sze
0deff1727e HDFS-4524. Update SnapshotManager#snapshottables when loading fsimage. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1449265 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-23 02:44:05 +00:00
Aaron Myers
019d6a22b1 HDFS-4304. Make FSEditLogOp.MAX_OP_SIZE configurable. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1449218 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-22 21:21:16 +00:00
Tsz-wo Sze
f29fa9e820 HDFS-4499. Fix file/directory/snapshot deletion for file diff. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1448504 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-21 03:27:36 +00:00
Tsz-wo Sze
fac3883188 HDFS-4503. Update computeContentSummary(..), spaceConsumedInTree(..) and diskspaceConsumed(..) in INode for snapshot. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1448373 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-20 20:02:24 +00:00
Aaron Myers
f61581501a Merge trunk into HDFS-347 branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1446832 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-16 01:12:07 +00:00
Suresh Srinivas
a9f6a27e93 Merge trunk to HDFS-2802 branch 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446507 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-15 10:57:34 +00:00
Tsz-wo Sze
d9e2514d21 HDFS-4487. Fix snapshot diff report for HDFS-4446. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446385 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 23:07:49 +00:00
Tsz-wo Sze
02e6b72ae1 HDFS-4481. Change fsimage to support snapshot file diffs. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1446000 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-14 00:43:28 +00:00
Kihwal Lee
a9974c791a HDFS-4495. Allow client-side lease renewal to be retried beyond soft-limit. Contributed by Kihwal Lee 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445965 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-13 22:51:21 +00:00
Tsz-wo Sze
969e84decb HDFS-4342. Directories configured in dfs.namenode.edits.dir.required but not in dfs.namenode.edits.dir are silently ignored. Contributed by Arpit Agarwal 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1445006 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-12 00:50:00 +00:00
Tsz-wo Sze
fa8bafbd46 Merge r1441206 through r1444434 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1444439 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-09 21:29:44 +00:00
Tsz-wo Sze
afe77ce53d HDFS-4480. Eliminate the file snapshot circular linked list. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1444280 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-08 23:19:32 +00:00
Tsz-wo Sze
4f7d921324 HDFS-4446. Support file snapshots with diff lists. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802@1443825 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-08 02:18:55 +00:00
Suresh Srinivas
7114a61318 HDFS-4470. Several HDFS tests attempt file operations on invalid HDFS paths when running on Windows. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443744 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 21:52:55 +00:00
Tsz-wo Sze
90c3700c52 HDFS-4458. In DFSUtil.getNameServiceUris(..), convert default fs URI using NetUtils.createSocketAddr(..) for being consistent with other addresses. Contributed by Binglin Chang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443297 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 03:04:18 +00:00
Aaron Myers
3d46863e12 HDFS-4473. Don't create domain socket unless we need it. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1443283 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-07 00:02:12 +00:00
Suresh Srinivas
4525c4a25b HDFS-4340. Update addBlock() to inculde inode id as additional argument. Contributed Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443169 13f79535-47bb-0310-9956-ffa450edef68
 2013-02-06 19:52:34 +00:00