big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
25,148 Commits 2 Branches 2 Tags 264 MiB
8616591b0c
Commit Graph

112 Commits

Author SHA1 Message Date
Brandon Li
42d8858c5d HDFS-7516. Fix findbugs warnings in hdfs-nfs project. Contributed by Brandon Li 2014-12-15 11:28:56 -08:00
Haohui Mai
2cc868dede HADOOP-11296. Nfs3FileAttributes should not change the values of rdev, nlink and size in the constructor. Contributed by Brandon Li. 2014-11-10 15:42:58 -08:00
Haohui Mai
eace218411 HADOOP-11289. Fix typo in RpcUtil log message. Contributed by Charles Lamb. 2014-11-10 11:06:20 -08:00
Haohui Mai
05b66ca074 HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li. 2014-10-29 17:54:26 -07:00
Brandon Li
72a556d3b0 HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang 2014-10-29 11:05:29 -07:00
Harsh J
2429b31656 HADOOP-11236. NFS: Fix javadoc warning in RpcProgram.java. Contributed by Abhiraj Butala. (harsh) 2014-10-27 19:09:52 +05:30
Brandon Li
4e134a02a4 HDFS-7215.Add JvmPauseMonitor to NFS gateway. Contributed by Brandon Li 2014-10-21 11:49:10 -07:00
Brandon Li
b6f9d5538c HDFS-7259. Unresponseive NFS mount point due to deferred COMMIT response. Contributed by Brandon Li 2014-10-21 10:20:29 -07:00
Haohui Mai
f679ca38ce HADOOP-11160. Fix typo in nfs3 server duplicate entry reporting. Contributed by Charles Lamb. 2014-10-02 14:07:36 -07:00
Haohui Mai
875aa797ca HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li. 2014-10-01 13:18:56 -07:00
Brandon Li
c88c6c57aa HADOOP-11130. NFS updateMaps OS check is reversed. Contributed by Brandon Li 2014-09-29 15:05:59 -07:00
Brandon Li
bad5f38d47 HADOOP-10990. Add missed NFSv3 request and response classes. Contributed by Brandon Li 2014-09-02 11:27:28 -07:00
brandonli
cd9182d8b5 HDFS-6892. Add XDR packaging method for each NFS request. Contributed by Brandon Li 2014-08-27 11:06:01 -07:00
Brandon Li
2a5f1029a5 HDFS-6455. NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hosts. Contributed by Abhiraj Butala 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1612947 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-23 21:22:50 +00:00
Brandon Li
fb1f5bc618 HDFS-6456. NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts. Contributed by Abhiraj Butala 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610840 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-15 20:35:07 +00:00
Brandon Li
3d9bea277a HDFS-6378. NFS registration should timeout instead of hanging when portmap/rpcbind is not available. Contributed by Abhiraj Butala 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1610543 13f79535-47bb-0310-9956-ffa450edef68
 2014-07-14 21:48:44 +00:00
Aaron Myers
5f880f79d2 HADOOP-10701. NFS should not validate the access premission only based on the user's primary group. Contributed by Harsh J. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1606042 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-27 12:00:55 +00:00
Brandon Li
2ecab65e3e HDFS-6439. NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1603622 13f79535-47bb-0310-9956-ffa450edef68
 2014-06-18 20:45:53 +00:00
Brandon Li
42391d260d HDFS-6056. Clean up NFS config settings. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1598782 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-30 23:53:00 +00:00
Brandon Li
0ec6fc9e3c HDFS-6411. nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1597895 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-27 22:58:55 +00:00
Andrew Wang
1ba203e3e0 HDFS-6435. Add support for specifying a static uid/gid mapping for the NFS gateway. (atm via wang) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596966 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-22 20:44:30 +00:00
Brandon Li
674c523db1 HADOOP-10612. NFS failed to refresh the user group id mapping table. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1596075 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-19 22:16:11 +00:00
Aaron Myers
da3992b4e3 HDFS-6406. Add capability for NFS gateway to reject connections from unprivileged ports. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595351 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-16 21:23:03 +00:00
Brandon Li
1c0e7a318e HDFS-6361. TestIdUserGroup.testUserUpdateSetting failed due to out of range nfsnobody Id. Contributed by Yongjun Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1595050 13f79535-47bb-0310-9956-ffa450edef68
 2014-05-15 21:23:38 +00:00
Aaron Myers
7bad941152 HDFS-6281. Provide option to use the NFS Gateway without having to use the Hadoop portmapper. Contributed by Aaron T. Myers. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589914 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-25 00:16:47 +00:00
Chris Nauroth
7bd5718594 HADOOP-10503. Move junit up to v 4.11. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1589273 13f79535-47bb-0310-9956-ffa450edef68
 2014-04-22 19:47:53 +00:00
Brandon Li
3bfd18c6b0 HDFS-6050. NFS does not handle exceptions correctly in a few places. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1581055 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-24 20:49:30 +00:00
Christopher Douglas
6988a4fc71 HADOOP-3679. Fixup assert ordering in unit tests to yield meaningful error 
messages. Contributed by Jay Vyas


git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577396 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-14 00:46:50 +00:00
Brandon Li
842aa2bc94 HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1577319 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-13 21:03:59 +00:00
Brandon Li
206e2b0cd2 HDFS-6044. Add property for setting the NFS look up time for users. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1574622 13f79535-47bb-0310-9956-ffa450edef68
 2014-03-05 19:01:05 +00:00
Arpit Agarwal
0bf97bda18 HADOOP-10330. TestFrameDecoder fails if it cannot bind port 12345. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1565507 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-07 01:12:52 +00:00
Brandon Li
6439cd0f69 HDFS-5767. NFS implementation assumes userName userId mapping to be unique, which is not true sometimes. Contributed by Yongjun Zhang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1564141 13f79535-47bb-0310-9956-ffa450edef68
 2014-02-04 00:27:25 +00:00
Brandon Li
1be8ee2424 HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1556405 13f79535-47bb-0310-9956-ffa450edef68
 2014-01-07 23:43:04 +00:00
Brandon Li
aa4fba6d92 HDFS-5587. add debug information when NFS fails to start with duplicate user or group names. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1548028 13f79535-47bb-0310-9956-ffa450edef68
 2013-12-05 07:13:21 +00:00
Brandon Li
4a1acfc96f HDFS-5548. Use ConcurrentHashMap in portmap. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1545756 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-26 18:13:04 +00:00
Brandon Li
a379a7bbb9 HDFS-5288. Close idle connections in portmap. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1544352 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-21 22:43:55 +00:00
Brandon Li
ec9ec0084e HDFS-5469. Add configuration property for the sub-directroy export path. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1540443 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-10 04:07:39 +00:00
Brandon Li
3fccdec6e0 HDFS-5364. Add OpenFileCtx cache. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539834 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 21:49:13 +00:00
Brandon Li
16c6755554 HDFS-5252. Stable write is not handled correctly in someplace. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1539740 13f79535-47bb-0310-9956-ffa450edef68
 2013-11-07 18:02:37 +00:00
Chris Nauroth
7e820b9965 HADOOP-10072. TestNfsExports#testMultiMatchers fails due to non-deterministic timing around cache expiry check. Contributed by Chris Nauroth. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1535918 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-26 04:25:50 +00:00
Brandon Li
a9befa6f0a HDFS-5330. fix readdir and readdirplus for large directories. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1532539 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-15 21:23:00 +00:00
Brandon Li
5c02d2f622 HDFS-5281. COMMIT request should not block. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1530461 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-08 23:40:21 +00:00
Brandon Li
caa4abd30c HDFS-5259. Support client which combines appended data with old data before sends it to NFS server. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1529730 13f79535-47bb-0310-9956-ffa450edef68
 2013-10-07 02:57:24 +00:00
Brandon Li
25cdbdb71a HDFS-5230. Introduce RpcInfo to decouple XDR classes from the RPC API. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1527726 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-30 19:21:17 +00:00
Brandon Li
c2634123c3 Delete the missed file in r1525104 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526728 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-26 22:51:30 +00:00
Brandon Li
3582026204 HDFS-5246. Make Hadoop nfs server port and mount daemon port configurable. Contributed by Jinghui Wang 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1526316 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-25 21:59:35 +00:00
Brandon Li
d8d3d3eaed HDFS-5234 Move RpcFrameDecoder out of the public API. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1525104 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-20 19:03:51 +00:00
Jing Zhao
5e18410e06 HDFS-5212. Refactor RpcMessage and NFS3Response to support different types of authentication information. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524298 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 06:08:23 +00:00
Brandon Li
c16442c459 HADOOP-9669 Reduce the number of byte array creations and copies in XDR data manipulation. Contributed by Haohui Mai 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1524259 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-18 00:06:12 +00:00
Alejandro Abdelnur
27e7feb777 HADOOP-9961. versions of a few transitive dependencies diverged between hadoop subprojects. (rvs via tucu) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1523596 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-16 11:30:47 +00:00
Brandon Li
ede10b8a1f HDFS-5067 Support symlink operations in NFS gateway. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1522774 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-13 04:21:46 +00:00
Jing Zhao
613979c8fd HDFS-5085. Refactor o.a.h.nfs to support different types of authentications. Contributed by Jing Zhao. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1521601 13f79535-47bb-0310-9956-ffa450edef68
 2013-09-10 19:29:45 +00:00
Brandon Li
cbca166831 HDFS-5136 MNT EXPORT should give the full group list which can mount the exports. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1519222 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-31 21:12:22 +00:00
Brandon Li
30b8ef91a3 HDFS-5078 Support file append in NFSv3 gateway to enable data streaming to HDFS. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1518292 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-28 17:23:55 +00:00
Brandon Li
15632cd76f HDFS-4947 Add NFS server export table to control export by hostname or IP range. Contributed by Jing Zhao 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1517040 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-23 21:14:43 +00:00
Brandon Li
270eaceba8 HDFS-5069 Include hadoop-nfs and hadoop-hdfs-nfs into hadoop dist for NFS deployment. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1516232 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-21 17:54:08 +00:00
Brandon Li
b7fb6fd6c4 HDFS-5107 Fix array copy error in Readdir and Readdirplus responses. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1515166 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-18 16:49:27 +00:00
Brandon Li
60be5fb9ed HADOOP-9806 PortmapInterface should check if the procedure is out-of-range. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1509347 13f79535-47bb-0310-9956-ffa450edef68
 2013-08-01 17:48:01 +00:00
Jing Zhao
58d75576c4 HDFS-4962. Use enum for nfs constants. Contributed by Tsz Wo (Nicholas) SZE. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1501851 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-10 17:01:28 +00:00
Brandon Li
70e9e58ff3 Add the missed file in commit r1499029 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1499041 13f79535-47bb-0310-9956-ffa450edef68
 2013-07-02 18:03:59 +00:00
Brandon Li
4d63b7a016 HADOOP-9515. Add general interface for NFS and Mount. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1493924 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-17 20:32:13 +00:00
Brandon Li
8ef140d38b HADOOP-9509. Implement ONCRPC and XDR. Contributed by Brandon Li 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1490845 13f79535-47bb-0310-9956-ffa450edef68
 2013-06-07 21:45:06 +00:00