big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,700 Commits 2 Branches 2 Tags 264 MiB
0ec6fc9e3c
Commit Graph

2984 Commits

Author SHA1 Message Date
Brandon Li
0ec6fc9e3c HDFS-6411. nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597895 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-27 22:58:55 +00:00
Brandon Li
1c867b1de8 HDFS-6416. Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs. Contributed by Abhiraj Butala 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597868 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-27 20:21:33 +00:00
Jing Zhao
8d9e8cec9f HDFS-6227. ShortCircuitCache#unref should purge ShortCircuitReplicas whose streams have been closed by java interrupts. Contributed by Colin Patrick McCabe. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597829 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-27 17:21:41 +00:00
Michael Stack
1228f8f6fb HBASE-6110 adding more slow action log in critical write path (Liang Xie via stack) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597633 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-26 19:38:05 +00:00
Arpit Agarwal
978e3a6813 HDFS-6443. Fix MiniQJMHACluster related test failures. (Contributed by Zesheng Wu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597238 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-24 05:09:04 +00:00
Andrew Wang
1ba203e3e0 HDFS-6435. Add support for specifying a static uid/gid mapping for the NFS gateway. (atm via wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596966 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 20:44:30 +00:00
Jing Zhao
3671a5e16f MAPREDUCE-5899. Support incremental data copy in DistCp. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596931 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 18:17:11 +00:00
Jing Zhao
5b1e88b6d2 HDFS-6423. Diskspace quota usage should be updated when appending data to partial block. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596774 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 08:07:16 +00:00
Jing Zhao
752a9d84bb HDFS-6438. DeleteSnapshot should be a DELETE request in WebHdfs. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596772 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 07:30:18 +00:00
Chris Nauroth
6b2e615f5f HDFS-6433. Replace BytesMoved class with AtomicLong. Contributed by Benoy Antony. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596742 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 04:50:53 +00:00
Chris Nauroth
b2f4e53e2b HDFS-6409. Fix typo in log message about NameNode layout version upgrade. Contributed by Chen He. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596739 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 04:38:20 +00:00
Andrew Wang
4dfedd81a4 HDFS-6396. Remove support for ACL feature from INodeSymlink. Contributed by Charles Lamb. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596713 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 00:10:30 +00:00
Uma Maheswara Rao G
ac23a55547 Merge HDFS-2006 HDFS XAttrs branch to Trunk 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596575 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-21 13:57:33 +00:00
Kihwal Lee
cb5682b859 HDFS-6419. TestBookKeeperHACheckpoints.TestSBNCheckpoints fails on trunk. Contributed by Akira AJISAKA. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596344 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-20 18:13:01 +00:00
Jing Zhao
44e9d346e9 HDFS-6432. Add snapshot related APIs to webhdfs. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596334 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-20 17:33:31 +00:00
Colin McCabe
668f70db66 HDFS-6421. Fix vecsum.c compile on BSD and some other systems (Mit Desai via Colin Patrick McCabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596324 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-20 17:19:39 +00:00
Kihwal Lee
35058fc020 HDFS-6397. NN shows inconsistent value in deadnode count. Contributed by Mohammad Kamrul Islam. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595978 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-19 17:52:55 +00:00
Konstantin Boudnik
9a0ed1c4af HDFS-6325. Append should fail if the last block has insufficient number of replicas (Keith Pak via cos) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595744 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-19 05:24:24 +00:00
Colin McCabe
f25c33b65f HDFS-4913. Deleting file through fuse-dfs when using trash fails, requiring root permissions (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595371 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-16 22:24:33 +00:00
Aaron Myers
da3992b4e3 HDFS-6406. Add capability for NFS gateway to reject connections from unprivileged ports. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595351 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-16 21:23:03 +00:00
Chris Nauroth
11be7334c4 MAPREDUCE-5809. Enhance distcp to support preserving HDFS ACLs. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595283 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-16 18:25:23 +00:00
Junping Du
0fb47dbe4e HDFS-6250. Fix test failed in TestBalancerWithNodeGroup.testBalancerWithRackLocality (Contributed by Binglin Chang and Chen He) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595145 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-16 09:56:24 +00:00
Andrew Wang
8f48760663 HDFS-6345. DFS.listCacheDirectives() should allow filtering based on cache directive ID. (wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595086 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-16 01:18:03 +00:00
Chris Nauroth
68867fd1bc HDFS-6402. Suppress findbugs warning for failure to override equals and hashCode in FsAclPermission. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595070 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-15 23:12:12 +00:00
Arpit Agarwal
9a0fcae5bc HDFS-6362. InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID. (Arpit Agarwal) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595056 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-15 21:30:16 +00:00
Andrew Wang
1959afe113 HDFS-5683. Better audit log messages for caching operations. Contributed by Abhiraj Butala. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595054 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-15 21:29:19 +00:00
Brandon Li
1c0e7a318e HDFS-6361. TestIdUserGroup.testUserUpdateSetting failed due to out of range nfsnobody Id. Contributed by Yongjun Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595050 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-15 21:23:38 +00:00
Kihwal Lee
046ad2e40e HDFS-6400. Cannot execute hdfs oiv_legacy. Contributed by Akira AJISAKA. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594917 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-15 13:53:19 +00:00
Colin McCabe
f2933f2535 HDFS-6287. Add vecsum test of libhdfs read access times (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594751 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-15 00:29:41 +00:00
Chris Nauroth
65158e478f HDFS-6326. WebHdfs ACL compatibility is broken. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594743 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-14 22:35:56 +00:00
Kihwal Lee
88e76f9c45 HDFS-2949. Add check to active state transition to prevent operator-induced split brain. Contributed by Rushabh S Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594709 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-14 20:45:07 +00:00
Jing Zhao
cf7dddb603 HDFS-6381. Fix a typo in INodeReference.java. Contributed by Binglin Chang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594447 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-14 02:50:56 +00:00
Kihwal Lee
97f58955a6 HDFS-6293. Issues with OIV processing PB-based fsimages. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594439 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-14 01:15:16 +00:00
Chris Nauroth
4b54bd8320 HDFS-6370. Web UI fails to display in intranet under IE. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594362 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 20:09:38 +00:00
Colin McCabe
dac9028ef9 HDFS-6355. Fix divide-by-zero, improper use of wall-clock time in BlockPoolSliceScanner (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594338 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 19:24:22 +00:00
Jing Zhao
8e5b5165c1 HDFS-6186. Pause deletion of blocks when the namenode starts up. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594314 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 18:22:33 +00:00
Brandon Li
29c5ed30c3 HADOOP-10572. Example NFS mount command must pass noacl as it isn't supported by the server yet. Contributed by Harsh J. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594289 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 17:07:46 +00:00
Suresh Srinivas
0077999972 HADOOP-10566. Refactor proxyservers out of ProxyUsers. Contributed by Benoy Antony. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594280 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 16:53:38 +00:00
Jonathan Turner Eagles
e4ee1d111b HDFS-6305. WebHdfs response decoding may throw RuntimeExceptions (Daryn Sharp via jeagles) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594273 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 16:40:15 +00:00
Kihwal Lee
33ade356b3 HDFS-6334. Client failover proxy provider for IP failover based NN HA. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594263 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 16:19:07 +00:00
Uma Maheswara Rao G
4f399bb4ba HDFS-6367. EnumSetParam$Domain#parse fails for parameter containing more than one enum. Contributed by Yi Liu. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594150 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-13 07:34:32 +00:00
Kihwal Lee
e9459baec5 HDFS-5522. Datanode disk error check may be incorrectly skipped. Contributed by Rushabh Shah. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594055 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-12 19:08:06 +00:00
Haohui Mai
09002d9341 HDFS-6230. Expose upgrade status through NameNode web UI. Contributed by Mit Desai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594040 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-12 18:02:24 +00:00
Andrew Wang
e9c6840b24 Command hdfs dfs -rm -r can't remove empty directory. Contributed by Yongjun Zhang. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1594036 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-12 17:54:35 +00:00
Haohui Mai
ae9109b911 HDFS-6328. Clean up dead code in FSDirectory. Contributed by Haohui Mai. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593755 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-11 05:06:22 +00:00
Colin McCabe
f131dba8a3 HDFS-6294. Use INode IDs to avoid conflicts when a file open for write is renamed (cmccabe) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593634 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 22:36:04 +00:00
Haohui Mai
ed6f32c540 HDFS-6240. WebImageViewer returns 404 if LISTSTATUS to an empty directory. Contributed by Akira Ajisaka. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593591 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 18:43:46 +00:00
Kihwal Lee
5323d5e388 HDFS-6313. WebHdfs may use the wrong NN when configured for multiple HA NNs. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593475 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 02:01:37 +00:00
Kihwal Lee
87215cb9f6 Fix CHANGES.txt 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593473 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 01:52:35 +00:00
Kihwal Lee
eac832f92d HDFS-6329. WebHdfs does not work if HA is enabled on NN but logical URI is not configured. Contributed by Kihwal Lee. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1593470 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-09 01:46:42 +00:00