big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,125 Commits 2 Branches 2 Tags 264 MiB
ee663fad14
Commit Graph

1988 Commits

Author SHA1 Message Date
Uma Maheswara Rao G
befb254e61 HDFS-5343. When cat command is issued on snapshot files, getting unexpected result. Contributed by Sathish. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561325 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-25 15:50:42 +00:00
Kihwal Lee
dd1bc7e1c7 HDFS-5728. Block recovery will fail if the metafile does not have crc for all chunks of the block. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1561223 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-24 22:56:05 +00:00
Chris Nauroth
738b076cc6 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1560768 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-23 17:49:24 +00:00
Chris Nauroth
cd7cd94e3f HDFS-5799. Make audit logging consistent across ACL APIs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1560766 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-23 17:41:53 +00:00
Daryn Sharp
a4e66e09e9 HDFS-5241. Provide alternate queuing audit logger to reduce logging contention (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560761 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-23 17:15:27 +00:00
Kihwal Lee
ff43021946 HDFS-5788. listLocatedStatus response can be very large. Contributed by Nathan Roberts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560750 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-23 17:01:30 +00:00
Uma Maheswara Rao G
824dcdbd42 HDFS-5789. Some of snapshot APIs missing checkOperation double check in fsn. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560731 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-23 16:35:05 +00:00
Andrew Wang
1c602f7198 HDFS-5806. Balancer should set soTimeout to avoid indefinite hangs. Contributed by Nathan Roberts. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560548 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-22 22:33:00 +00:00
Arpit Agarwal
83280a45de HDFS-5434. Change block placement policy constructors from package private to protected. (Buddy Taylor via Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560217 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-21 23:11:15 +00:00
Brandon Li
cc7cc5a4d9 HDFS-5748. Too much information shown in the dfs health page. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1560215 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-21 22:55:35 +00:00
Tsz-wo Sze
d8bc523754 HDFS-5753. Add new NN startup options for downgrade and rollback using upgrade marker. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559907 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-21 02:38:46 +00:00
Chris Nauroth
2fbe8235dc Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559794 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-20 18:02:27 +00:00
Tsz-wo Sze
602f71a8da HDFS-5800. Fix a typo in DFSClient.renewLease(). Contributed by Kousuke Saruta 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1559701 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-20 14:08:00 +00:00
Chris Nauroth
8a9a6dbd7e Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559324 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-18 06:50:19 +00:00
Tsz-wo Sze
1025121874 Merge r1555021 through r1559304 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559305 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-18 02:24:38 +00:00
Tsz-wo Sze
09b8ce5b44 HDFS-5786. Support QUERY and FINALIZE actions of rolling upgrade. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1559304 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-18 02:07:09 +00:00
Haohui Mai
6a52febfbd HDFS-5612. NameNode: change all permission checks to enforce ACLs in addition to permissions. Contributued by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559281 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-17 23:28:45 +00:00
Haohui Mai
5300294fbe HDFS-5758. NameNode: complete implementation of inode modifications for ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1559267 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-17 22:05:47 +00:00
Jing Zhao
fb01200153 HDFS-5794. Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1559209 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-17 18:18:36 +00:00
Colin McCabe
a7ec44d41b HDFS-5784. Reserve space in edit log header and fsimage header for feature flag section (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558974 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-17 01:32:05 +00:00
Jing Zhao
e02ded811f HDFS-5777. Update LayoutVersion for the new editlog op OP_ADD_BLOCK. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558675 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-16 02:28:10 +00:00
Brandon Li
a506df8e48 HDFS-5775. Consolidate the code for serialization in CacheManager. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558599 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 23:15:24 +00:00
Brandon Li
ca5d73d1ab HDFS-5768. Consolidate the serialization code in DelegationTokenSecretManager. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558598 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 23:11:01 +00:00
Colin McCabe
c3b236ce5d HDFS-5766. In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange (Liang Xie via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558536 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 19:23:31 +00:00
Colin McCabe
037a89abc5 HDFS-5762. BlockReaderLocal does not return -1 on EOF when doing zero-length reads (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558526 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 19:17:50 +00:00
Tsz-wo Sze
4a1abe5a3d Merge r1555021 through r1558254 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1558303 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 06:06:31 +00:00
Tsz-wo Sze
5fe73a986e HDFS-5752. Add a new DFSAdmin command to query, start and finalize rolling upgrade. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1558299 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 05:56:17 +00:00
Jing Zhao
578dae9ef3 HDFS-5704. Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558255 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-15 01:06:53 +00:00
Konstantin Boudnik
4b16c2b65e HDFS-5677. Need error checking for HA cluster configuration. Contributed by Vincent Sheffer. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1558217 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-14 21:59:51 +00:00
Jing Zhao
e210519d32 HDFS-5579. Under construction files make DataNode decommission take very long hours. Contributed by zhaoyunjiong. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557904 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-14 02:02:15 +00:00
Jing Zhao
e06ae2d567 HDFS-5710. FSDirectory#getFullPathName should check inodes against null. Contributed by Uma Maheswara Rao G. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557803 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-13 18:37:56 +00:00
Chris Nauroth
c90211af7a Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1557294 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-11 00:37:23 +00:00
Arpit Agarwal
9d382a4174 HDFS-5747. Fix NPEs in BlockManager. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557289 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-11 00:05:55 +00:00
Andrew Wang
7354547a02 HDFS-5756. hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1557244 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-10 20:10:44 +00:00
Tsz-wo Sze
1c7aa44d62 Merge r1555021 through r1557038 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1557039 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-10 06:07:24 +00:00
Tsz-wo Sze
4563ba08e7 HDFS-5645. Support upgrade marker in editlog streams. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1557038 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-10 06:06:10 +00:00
Kihwal Lee
b4d6c5823b HDFS-5449. WebHdfs compatibility broken between 2.2 and 1.x / 23.x. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556927 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-09 19:24:07 +00:00
Junping Du
7186000367 HDFS-5721. sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns. (Ted Yu via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556803 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-09 13:33:08 +00:00
Chris Nauroth
17ab35314f Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556665 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 23:10:02 +00:00
Chris Nauroth
21d4167179 HDFS-5739. ACL RPC must allow null name or unspecified permissions in ACL entries. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556663 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 22:47:57 +00:00
Chris Nauroth
023c11ec7e HDFS-5737. Replacing only the default ACL can fail to copy unspecified base entries from the access ACL. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556652 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 22:02:53 +00:00
Tsz-wo Sze
f3ee35ab28 Merge r1555021 through r1556550 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1556552 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 14:36:09 +00:00
Jing Zhao
076ecf79ca HDFS-5726. Fix compilation error in AbstractINodeDiff for JDK7. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556433 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-08 03:19:41 +00:00
Colin McCabe
53b27fc60b HDFS-5724. modifyCacheDirective logging audit log command wrongly as addCacheDirective (Uma Maheswara Rao G via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556386 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-07 22:27:06 +00:00
Jing Zhao
70cff9e2f0 HDFS-5715. Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiff. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556353 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-07 20:52:48 +00:00
Chris Nauroth
2fbb3d694e Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556097 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-07 01:07:33 +00:00
Chris Nauroth
c658567571 HDFS-5673. Implement logic for modification of ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1556090 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-07 00:47:49 +00:00
Brandon Li
bfd227bf09 HDFS-5719. FSImage#doRollback() should close prevState before return. Contributed by Ted Yu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556057 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-06 22:58:18 +00:00
Colin McCabe
8deb7a6057 HDFS-5589. Namenode loops caching and uncaching when data should be uncached. (awang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555996 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-06 19:45:02 +00:00
Colin McCabe
2a1ecd00da HDFS-5220. Expose group resolution time as metric (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555976 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-06 18:59:10 +00:00
Arpit Agarwal
f8a9329f2b HDFS-5667. Include DatanodeStorage in StorageReport. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555929 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-06 17:28:23 +00:00
Brandon Li
b80343a55f HDFS-5705. TestSecondaryNameNodeUpgrade#testChangeNsIDFails may fail due to ConcurrentModificationException. Contributed by Ted Yu 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555190 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-03 18:29:44 +00:00
Tsz-wo Sze
498f9674ff Merge r1550130 through r1555020 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1555021 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-03 07:26:52 +00:00
Andrew Wang
d85c017d04 HDFS-5651. Remove dfs.namenode.caching.enabled and improve CRM locking. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1555002 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-03 02:45:53 +00:00
Andrew Wang
b4eb963c3c HDFS-5659. dfsadmin -report doesn't output cache information properly. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554893 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-02 20:11:41 +00:00
Andrew Wang
07e4fb1455 HDFS-5708. The CacheManager throws a NPE in the DataNode logs when processing cache reports that refer to a block not known to the BlockManager. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554594 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-01 00:01:12 +00:00
Uma Maheswara Rao G
97e881b955 HDFS-5671. Fix socket leak in DFSInputStream#getBlockReader. Contributed by JamesLi 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554553 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-31 16:24:02 +00:00
Andrew Wang
7f86c8114e HDFS-5701. Fix the CacheAdmin -addPool -maxTtl option name. Contributed by Stephen Chu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554305 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-30 20:02:36 +00:00
Colin McCabe
e596f17734 HDFS-5582. hdfs getconf -excludeFile or -includeFile always failed (satish via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1554295 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-30 19:35:43 +00:00
Chris Nauroth
eaa5321619 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553226 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-23 22:19:12 +00:00
Chris Nauroth
c3b56ed1c8 HDFS-5619. NameNode: record ACL modifications to edit log. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553224 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-23 22:12:45 +00:00
Chris Nauroth
25e9d2e895 HDFS-5618. NameNode: persist ACLs in fsimage. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1553221 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-23 21:45:03 +00:00
Jing Zhao
e8de319789 HDFS-5690. DataNode fails to start in secure mode when dfs.http.policy equals to HTTP_ONLY. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1553167 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-23 18:23:43 +00:00
Colin McCabe
b9ae3087c0 HDFS-5636. Enforce a max TTL per cache pool (awang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552841 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 23:27:20 +00:00
Kihwal Lee
04d139e2a0 HDFS-5681. renewLease should not hold fsn write lock. Contributed by Daryn Sharp. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552711 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 16:05:03 +00:00
Chris Nauroth
72b0b1881f Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1552467 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 01:01:18 +00:00
Chris Nauroth
c552d5d72e HDFS-5685. Implement ACL as a INode feature. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1552465 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-20 00:48:24 +00:00
Michael Stack
b0947f9305 HDFS-5663 make the retry time and interval value configurable in openInfo() 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552232 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-19 05:21:46 +00:00
Jing Zhao
a9d80ae59d HDFS-5661. Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address. Contributed by Benoy Antony. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552177 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-19 00:27:16 +00:00
Colin McCabe
90122f25e1 HDFS-5676. fix inconsistent synchronization of CachingStrategy (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552162 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 23:29:05 +00:00
Brandon Li
fc966461e0 HDFS-5662. Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1552131 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 22:26:33 +00:00
Jing Zhao
788fca4124 HDFS-5496. Make replication queue initialization asynchronous. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535@1552109 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 21:30:37 +00:00
Tsz-wo Sze
504bd0bca3 HDFS-5674. Editlog code cleanup: remove @SuppressWarnings("deprecation") in FSEditLogOp; change FSEditLogOpCodes.fromByte(..) to be more efficient; and change Some fields in FSEditLog to final. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551812 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-18 02:46:00 +00:00
Colin McCabe
124e507674 HDFS-5634. Allow BlockReaderLocal to switch between checksumming and not (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551701 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-17 20:57:00 +00:00
Colin McCabe
991c453ca3 HDFS-5431. Support cachepool-based limit management in path-based caching. (awang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551651 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-17 18:47:04 +00:00
Andrew Wang
0fc2929d13 HDFS-5350. Name Node should report fsimage transfer time as a metric. Contributed by Jimmy Xiang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551415 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-17 00:30:06 +00:00
Chris Nauroth
740605cde6 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1551332 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 20:08:58 +00:00
Colin McCabe
8e32e6aff1 HDFS-5666. Fix inconsistent synchronization in BPOfferService (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551301 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 18:35:40 +00:00
Arpit Agarwal
89a374afcb HDFS-5454. DataNode UUID should be assigned prior to FsDataset initialization. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551296 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 18:16:56 +00:00
Andrew Wang
6c641339d1 HDFS-5665. Remove the unnecessary writeLock while initializing CacheManager in FsNameSystem Ctor. (Uma Maheswara Rao G via Andrew Wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551270 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 17:12:55 +00:00
Uma Maheswara Rao G
1dabd42999 HDFS-5592. statechangeLog of completeFile should be logged only in case of success. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551145 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 09:53:57 +00:00
Arpit Agarwal
938565925a HDFS-5406. Send incremental block reports for all storages in a single call. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1551093 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-16 00:58:40 +00:00
Tsz-wo Sze
44a6560b5d HDFS-5632. Flatten INodeDirectory hierarchy: Replace INodeDirectoryWithSnapshot with DirectoryWithSnapshotFeature. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550917 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-14 10:13:30 +00:00
Chris Nauroth
f24e0c1563 Merge trunk to HDFS-4685. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550774 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-13 17:28:14 +00:00
Junping Du
a31a3a68ea HDFS-5652. Refactor invalid block token exception handling in DFSInputStream. (Liang Xie via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550620 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-13 02:47:04 +00:00
Chris Nauroth
9263f3bb14 HDFS-5596. Implement RPC stubs. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-4685@1550544 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 21:47:46 +00:00
Jing Zhao
5fd7230671 HDFS-5647. Merge INodeDirectory.Feature and INodeFile.Feature. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550469 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 18:26:40 +00:00
Arpit Agarwal
fba994ffe2 HDFS-5648. Get rid of FsDatasetImpl#perVolumeReplicaMap. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1550357 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 07:01:24 +00:00
Arpit Agarwal
c656562556 Merging r1550313 through r1550355 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1550356 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 06:51:54 +00:00
Junping Du
8373c4134a HDFS-5637. Try to refeatchToken while local read InvalidToken occurred. (Liang Xie via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550335 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-12 03:04:43 +00:00
Arpit Agarwal
cd083aa807 Merging r1549949 through r1550312 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1550313 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 23:18:29 +00:00
Colin McCabe
9678020e59 HDFS-4201. NPE in BPServiceActor#sendHeartBeat (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550269 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 21:30:16 +00:00
Junping Du
327a995561 HDFS-5580. Fix infinite loop in Balancer.waitForMoveCompletion. (Binglin Chang via junping_du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550074 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 08:51:12 +00:00
Aaron Myers
512a18a8d9 HDFS-5074. Allow starting up from an fsimage checkpoint in the middle of a segment. Contributed by Todd Lipcon. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1550016 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-11 01:32:22 +00:00
Arpit Agarwal
f3cef1c673 Merging r1549626 through r1549948 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1549949 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-10 19:50:02 +00:00
Jing Zhao
87a6db45b7 HDFS-5629. Support HTTPS in JournalNode and SecondaryNameNode. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1549692 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-09 21:58:47 +00:00
Arpit Agarwal
43c33491fc Merging r1548329 through r1549625 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1549626 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-09 17:38:20 +00:00
Jing Zhao
155020a6f4 HDFS-5353. Short circuit reads fail when dfs.encrypt.data.transfer is enabled. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548987 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-08 03:52:18 +00:00
Jing Zhao
91d0b47270 HDFS-4983. Numeric usernames do not work with WebHDFS FS. Contributed by Yongjun Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548968 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-07 21:10:53 +00:00
Tsz-wo Sze
4c87a27ad8 HDFS-5554. Flatten INodeFile hierarchy: Replace INodeFileWithSnapshot with FileWithSnapshotFeature. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548796 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-07 06:17:46 +00:00
Jing Zhao
045dc880e1 HDFS-5312. Generate HTTP/HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548629 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-06 18:01:58 +00:00
Jing Zhao
9df84c35d5 HDFS-5590. Block ID and generation stamp may be reused when persistBlocks is set to false. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548368 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-06 01:55:13 +00:00
Jing Zhao
6b459506c3 HDFS-5633. Improve OfflineImageViewer to use less memory. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548359 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-06 01:30:22 +00:00
Arpit Agarwal
00718c2ffa Merging r1547658 through r1548328 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1548329 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 23:41:09 +00:00
Andrew Wang
55e5b0653c HDFS-5630. Hook up cache directive and pool usage statistics. (wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548309 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 21:09:30 +00:00
Daryn Sharp
99aed805f8 Neglected to add new file in HDFS-5514 (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548167 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 15:31:35 +00:00
Daryn Sharp
6828337d85 HDFS-5514. FSNamesystem's fsLock should allow custom implementation (daryn) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548161 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 15:28:12 +00:00
Colin McCabe
950e0644b7 HDFS-5626. dfsadmin report shows incorrect values (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548000 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 02:59:14 +00:00
Andrew Wang
859e425dfa Revert HDFS-4983 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547970 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 00:05:10 +00:00
Andrew Wang
f5e83a0b3e HDFS-4983. Numeric usernames do not work with WebHDFS FS. Contributed by Yongjun Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547935 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-04 22:24:45 +00:00
Jing Zhao
d02baff9a0 HDFS-5536. Implement HTTP policy for Namenode and DataNode. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547925 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-04 21:40:57 +00:00
Colin McCabe
f791e291ca HDFS-5555. CacheAdmin commands fail when first listed NameNode is in Standby (jxiang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547895 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-04 20:06:25 +00:00
Arpit Agarwal
b7ce46887b Merging r1547474 through r1547657 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1547658 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-04 00:45:38 +00:00
Colin McCabe
61c45aae4d HDFS-4997. libhdfs does not return correct error code in most cases (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547637 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-03 23:13:02 +00:00
Arpit Agarwal
674d51e62e Merging r1547121 through r1547473 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1547492 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-03 17:33:46 +00:00
Arpit Agarwal
a1aa1836fb HDFS-5484. StorageType and State in DatanodeStorageInfo in NameNode is not accurate. (Contributed by Eric Sirianni) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1547462 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-03 16:30:29 +00:00
Kihwal Lee
7af12ab207 HDFS-5558. LeaseManager monitor thread can crash if the last block is complete but another block is not. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547393 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-03 14:12:43 +00:00
Kihwal Lee
38a04a3042 HDFS-5557. Write pipeline recovery for the last packet in the block may cause rejection of valid replicas. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547173 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-02 20:18:52 +00:00
Arpit Agarwal
18159be495 Merging r1544666 through r1547120 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1547122 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-02 17:41:44 +00:00
Colin McCabe
13331a6863 HDFS-5581. NameNodeFsck should use only one instance of BlockPlacementPolicy (vinay via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1547088 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-02 16:31:03 +00:00
Andrew Wang
9da451cac5 HDFS-5430. Support TTL on CacheDirectives. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546301 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-28 07:20:21 +00:00
Andrew Wang
bb11d47758 HDFS-5562. TestCacheDirectives and TestFsDatasetCache should stub out native mlock. Contributed by Colin Patrick McCabe and Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546246 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-28 00:44:54 +00:00
Tsz-wo Sze
8df119da21 HDFS-5537. Remove FileWithSnapshot interface. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546184 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-27 20:32:16 +00:00
Jing Zhao
2214871d91 HDFS-5545. Allow specifying endpoints for listeners in HttpServer. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546151 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-27 18:20:14 +00:00
Colin McCabe
13edb391d0 HDFS-5556. Add some more NameNode cache statistics, cache pool stats (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1546143 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-27 17:55:52 +00:00
Uma Maheswara Rao G
b6d483b122 HDFS-5568. Support includeSnapshots option with Fsck command. Contributed by Vinay 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545987 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-27 10:59:54 +00:00
Colin McCabe
05a9a80bd4 HDFS-5565. CacheAdmin help should match against non-dashed commands (wang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545850 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 21:38:46 +00:00
Jing Zhao
740cf232bd HDFS-5561. FSNameSystem#getNameJournalStatus() in JMX should return plain text instead of HTML. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545791 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 19:28:09 +00:00
Tsz-wo Sze
82ff2d3f2e HDFS-5286. Flatten INodeDirectory hierarchy: Replace INodeDirectoryWithQuota with DirectoryWithQuotaFeature. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545768 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 18:33:22 +00:00
Jing Zhao
d8a2383461 HDFS-5538. URLConnectionFactory should pick up the SSL related configuration by default. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545491 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 01:16:51 +00:00
Jing Zhao
eb3c1607b0 HDFS-5533. Symlink delete/create should be treated as DELETE/CREATE in snapshot diff report. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545357 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-25 18:05:36 +00:00
Kihwal Lee
65ee88b0de HDFS-5526. Datanode cannot roll back to previous layout version. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545322 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-25 15:33:52 +00:00
Arpit Agarwal
f48ea1b516 Merging r1544304 through r1544665 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1544672 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-22 20:51:06 +00:00
Arpit Agarwal
97acde2d33 HDFS-5542. Fix TODO and clean up the code in HDFS-2832. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1544664 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-22 20:07:10 +00:00
Jing Zhao
105a31e21d HDFS-5552. Fix wrong information of Cluster summay in dfshealth.html. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544627 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-22 18:23:42 +00:00
Tsz-wo Sze
ce68f410b0 HDFS-5285. Flatten INodeFile hierarchy: Replace INodeFileUnderConstruction and INodeFileUnderConstructionWithSnapshot with FileUnderContructionFeature. Contributed by jing9 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544389 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-22 01:39:02 +00:00
Arpit Agarwal
b33ff7b5f2 HDFS-5547. Fix build break after merge from trunk to HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1544342 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 22:07:46 +00:00
Arpit Agarwal
16f7fb80d9 Merging r1543902 through r1544303 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1544306 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 20:06:09 +00:00
Colin McCabe
f91a45a96c HDFS-5473. Consistent naming of user-visible caching classes and methods (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544252 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 17:12:58 +00:00
Jing Zhao
39950cee7f HDFS-5532. Enable the webhdfs by default to support new HDFS web UI. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544047 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 07:16:16 +00:00
Tsz-wo Sze
5f458ef23f HDFS-5531. Combine the getNsQuota() and getDsQuota() methods in INode. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544018 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 03:17:47 +00:00
Jing Zhao
3cae2ba63f HDFS-3987. Support webhdfs over HTTPS. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543962 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 21:51:58 +00:00
Andrew Wang
916ab9286b HDFS-5451. Add byte and file statistics to PathBasedCacheEntry. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543958 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 21:31:41 +00:00
Arpit Agarwal
75747754d2 Merging r1543710 through r1543901 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543902 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 18:37:22 +00:00
Jing Zhao
c131ae39fc HDFS-5525. Inline dust templates for new Web UI. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543895 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 18:17:41 +00:00
Arpit Agarwal
2d9692a36d HDFS-5527. Fix TestUnderReplicatedBlocks on branch HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543885 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 17:13:35 +00:00
Uma Maheswara Rao G
04cf2a768c HDFS-5014. Process register commands with out holding BPOfferService lock. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543861 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 16:27:28 +00:00
Uma Maheswara Rao G
f26d2adbf9 HDFS-4516. Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543829 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 14:43:11 +00:00
Arpit Agarwal
59393e0162 Merging r1543613 through r1543709 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543710 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 05:31:02 +00:00
Colin McCabe
efea68dc35 HDFS-5511. improve CacheManipulator interface to allow better unit testing (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543676 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 00:48:05 +00:00
Andrew Wang
00d9b8eedb HDFS-5513. CacheAdmin commands fail when using . as the path. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543670 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-20 00:29:59 +00:00
Jonathan Turner Eagles
587f68b160 HDFS-1386. TestJMXGet fails in jdk7 (jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543612 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 22:44:13 +00:00
Arpit Agarwal
3c9cbc6893 Merging r1543111 through r1543509 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543510 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 17:26:23 +00:00
Jing Zhao
aa002344d0 HDFS-5428. Under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543329 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 07:31:40 +00:00
Colin McCabe
70234e2213 HDFS-5512. CacheAdmin -listPools fails with NPE when user lacks permissions to view all pools (awang via cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543293 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 02:35:34 +00:00
Colin McCabe
4f15d0af4f HDFS-5520. loading cache path directives from edit log doesnt update nextEntryId (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543286 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 02:01:28 +00:00
Jing Zhao
e68e3e429d HDFS-5393. Serve bootstrap and jQuery locally. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1543248 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-19 00:37:54 +00:00
Arpit Agarwal
bd5ab41a90 Merging r1542123 through r1543110 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1543115 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-18 19:22:42 +00:00
Uma Maheswara Rao G
e3d7ef36ef HDFS-5372. In FSNamesystem, hasReadLock() returns false if the current thread holds the write lock (Contributed by Vinay) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542887 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-18 04:18:44 +00:00
Jing Zhao
fef8f49c58 HDFS-5502. Fix HTTPS support in HsftpFileSystem. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542438 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-16 01:00:42 +00:00
Arpit Agarwal
cd768489f3 HDFS-5515. Fix TestDFSStartupVersions for HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1542176 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-15 05:21:58 +00:00
Jing Zhao
620890fcc0 HDFS-5489. Use TokenAspect in WebHDFSFileSystem. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542158 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-15 02:11:38 +00:00
Arpit Agarwal
132a8ff7c7 Merging r1541618 through r1542122 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1542125 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 23:56:56 +00:00
Kihwal Lee
ceea91c9cd HDFS-5438. Flaws in block report processing can cause data loss. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542054 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 20:11:50 +00:00
Jing Zhao
43fa41fdee HDFS-5506. Use URLConnectionFactory in DelegationTokenFetcher. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1542011 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 18:40:36 +00:00
Arpit Agarwal
ea1c5ea086 HDFS-5510. Fix a findbug warning in DataStorage.java on HDFS-2832 branch. (Contributed by Junping Du) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1542006 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 18:16:02 +00:00
Kihwal Lee
fe67e30bc2 HDFS-4995. Make getContentSummary less expensive. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541971 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 16:49:31 +00:00
Jing Zhao
735aae32e4 HDFS-5504. In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode. Contributed by Vinay. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541773 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-14 01:03:34 +00:00
Jing Zhao
de9271686a HDFS-5444. Choose default web UI based on browser capabilities. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541753 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 22:57:53 +00:00
Jing Zhao
ced740e580 HDFS-5474. Deletesnapshot can make Namenode in safemode on NN restarts. Contributed by Sathish. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541685 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 19:59:55 +00:00
Jing Zhao
1c211f6749 HDFS-5440. Extract the logic of handling delegation tokens in HftpFileSystem to the TokenAspect class. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541665 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 19:25:09 +00:00
Colin McCabe
3c591aa442 HDFS-5366. recaching improvements (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541647 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 18:18:37 +00:00
Arpit Agarwal
bf9f8511fa Merging r1541342 through r1541617 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1541620 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 17:15:36 +00:00
Colin McCabe
39def49661 HDFS-5485. add command-line support for modifyDirective (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541377 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 03:29:02 +00:00
Arpit Agarwal
d06a782c1e HDFS-5501. Fix pendingReceivedRequests tracking in BPServiceActor. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1541371 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 02:59:46 +00:00
Arpit Agarwal
46cbce9af1 HDFS-5508. Fix compilation error after merge. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1541352 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 02:00:41 +00:00
Tsz-wo Sze
ba98e8f737 merge r1535792 through r1541341 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1541342 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 01:14:37 +00:00
Andrew Wang
9d06631719 HDFS-5450. better API for getting the cached blocks locations. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541338 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-13 00:31:55 +00:00
Colin McCabe
ce35e0950c HDFS-5471. CacheAdmin -listPools fails when user lacks permissions to view all pools (Andrew Wang via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541323 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 23:52:23 +00:00
Jing Zhao
8162fdcdbc HDFS-5425. Renaming underconstruction file with snapshots can make NN failure on restart. Contributed by Vinay and Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1541261 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 22:10:09 +00:00
Arpit Agarwal
e5b3171c3b HDFS-5494. Fix findbugs warnings for HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540924 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 02:36:24 +00:00
Arpit Agarwal
ec5eebc450 Merging r1540548 through r1540909 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540910 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 01:16:10 +00:00
Arpit Agarwal
26f2bd67f2 HDFS-5491. Update editsStored for HDFS-2832. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540903 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-12 00:48:55 +00:00
Andrew Wang
2b3e1abcda HDFS-5467. Remove tab characters in hdfs-default.xml. Contributed by Shinichi Yamashita. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540816 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-11 19:25:47 +00:00
Andrew Wang
9673baa7e8 HDFS-5320. Add datanode caching metrics. Contributed by Andrew Wang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540796 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-11 18:30:07 +00:00
Arpit Agarwal
bb5bd30df6 Merging r1540239 through r1540547 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540549 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-10 21:01:12 +00:00
Arpit Agarwal
907fb15ee8 HDFS-5480. Update Balancer for HDFS-2832. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540547 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-10 20:59:32 +00:00
Chris Nauroth
25ebe6bfd7 HDFS-5482. DistributedFileSystem#listPathBasedCacheDirectives must support relative paths. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540257 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-09 05:54:19 +00:00
Tsz-wo Sze
fccbb5072c merge of r1535792 through r1540238 from trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1540239 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-09 01:34:22 +00:00
Jing Zhao
37bc8e0c14 HDFS-5325. Remove WebHdfsFileSystem#ConnRunner. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540235 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-09 01:19:54 +00:00
Jing Zhao
f2ad787a27 HDFS-5476. Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540142 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-08 18:18:03 +00:00
Colin McCabe
97199baea1 HDFS-5394: Fix race conditions in DN caching and uncaching (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539909 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-08 03:00:19 +00:00
Arpit Agarwal
6b0611ed24 Merging r1539737 through r1539896 from trunk to branch HDFS-2832 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539898 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-08 01:44:24 +00:00
Arpit Agarwal
06d24efed0 HDFS-5475. NN incorrectly tracks more than one replica per DN. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539890 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-08 01:01:18 +00:00
Colin McCabe
f79b3e6b17 HDFS-5326. add modifyDirective to cacheAdmin (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539839 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 22:07:16 +00:00
Colin McCabe
77afc605fd HDFS-5468. CacheAdmin help command does not recognize commands (Stephen Chu via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539786 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 19:58:52 +00:00
Jing Zhao
9964a94386 HDFS-5443. Delete 0-sized block when deleting an under-construction file that is included in snapshot. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539754 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 18:37:38 +00:00
Arpit Agarwal
a604e3b73b HDFS-5472. Fix TestDatanodeManager, TestSafeMode and TestNNThroughputBenchmark. (Contributed by szetszwo) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539736 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 17:57:30 +00:00
Tsz-wo Sze
75777f1626 HDFS-5470. Add back trunk's reportDiff algorithm to the branch. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539504 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 00:13:05 +00:00
Arpit Agarwal
fa5ba6d977 HDFS-5439. Fix TestPendingReplication. (Contributed by Junping Du, Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832@1539247 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-06 06:50:33 +00:00