Simbarashe Dzinamarira
|
61f369c43e
|
HDFS-16890: RBF: Ensures router periodically refreshes its record of a namespace's state. (#5298)
|
2023-02-27 17:56:24 +00:00 |
|
Owen O'Malley
|
8025a60ae7
|
HDFS-16901: Minor fix for unit test.
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
|
2023-02-22 16:37:49 -08:00 |
|
Simbarashe Dzinamarira
|
4cc33e5e37
|
HDFS-16901: RBF: Propagates real user's username via the caller context, when a proxy user is being used. (#5346)
|
2023-02-22 21:58:44 +00:00 |
|
hchaverr
|
fb31393b65
|
HADOOP-18535. Implement token storage solution based on MySQL
Fixes #1240
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
|
2023-02-22 10:38:50 -08:00 |
|
Viraj Jasani
|
90de1ff151
|
HADOOP-18206 Cleanup the commons-logging references and restrict its usage in future (#5315)
|
2023-02-14 03:24:06 +08:00 |
|
hfutatzhanghb
|
f3c4277576
|
HDFS-16882. RBF: Add cache hit rate metric in MountTableResolver#getDestinationForPath (#5276)
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Tao Li <tomscut@apache.org>
|
2023-02-11 08:00:43 +08:00 |
|
hchaverri
|
d310642626
|
HDFS-16895. [RBF] NamenodeHeartbeatService should use credentials of logged in user
|
2023-02-07 18:45:05 +00:00 |
|
sunhao
|
0ae075a2af
|
HDFS-16848. RBF: Improve StateStoreZooKeeperImpl performance (#5147)
|
2023-02-05 09:33:05 +08:00 |
|
Simbarashe Dzinamarira
|
b56d483258
|
HDFS-16876: Changes cleanup of shared RouterStateIdContext to be driven by namenodeResolver data. (#5282)
|
2023-01-09 23:55:13 +00:00 |
|
Simbarashe Dzinamarira
|
cd19da1309
|
HDFS-16877: Enables state context for namenode in TestObserverWithRouter (#5257)
|
2023-01-07 00:18:35 +00:00 |
|
Neil
|
d25c1be517
|
HDFS-16861. RBF. Truncate API always fails when dirs use AllResolver oder on Router (#5184)
Co-authored-by: xiezhineng <xiezhineng@corp.netease.com>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Tao Li <tomscut@apache.org>
|
2022-12-26 21:19:33 +08:00 |
|
ZanderXu
|
df093ef9af
|
HDFS-16831. [RBF SBN] GetNamenodesForNameserviceId should shuffle Observer NameNodes every time (#5098)
|
2022-12-23 14:16:42 +08:00 |
|
ZanderXu
|
8a9bdb1edc
|
HDFS-16837. [RBF SBN] ClientGSIContext should merge RouterFederatedStates to get the max state id for each namespaces (#5123)
|
2022-12-05 16:15:47 +08:00 |
|
Owen O'Malley
|
03471a736c
|
HDFS-16851: RBF: Add a utility to dump the StateStore. (#5155)
|
2022-11-29 22:12:35 +00:00 |
|
Simbarashe Dzinamarira
|
909aeca86c
|
HDFS-16845: Adds configuration flag to allow clients to use router observer reads without using the ObserverReadProxyProvider. (#5142)
|
2022-11-29 00:49:10 +00:00 |
|
Simbarashe Dzinamarira
|
ec2856d79c
|
HDFS-16847: RBF: Prevents StateStoreFileSystemImpl from committing tmp file after encountering an IOException. (#5145)
|
2022-11-29 00:47:01 +00:00 |
|
ZanderXu
|
e0974298ce
|
HDFS-16826. [RBF SBN] ConnectionManager should advance the client stateId for each request (#5086)
|
2022-11-25 09:23:33 +08:00 |
|
Owen O'Malley
|
c71a68ca80
|
HDFS-16844: Adds resilancy when StateStore gets exceptions. (#5138)
Allows the StateStore to stay up when there are errors reading the data.
|
2022-11-18 17:24:08 +00:00 |
|
Simbarashe Dzinamarira
|
552ee44eba
|
HDFS-16834: Removes request stateID consistency constraint between clients in different connection pools. (#5121)
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Zander Xu <zanderxu@apache.org>
|
2022-11-11 15:26:31 +08:00 |
|
Simbarashe Dzinamarira
|
44b8bb7224
|
HDFS-16821: Fixes regression in HDFS-13522 that enables observer reads by default (#5078)
|
2022-11-07 08:43:04 -08:00 |
|
Simbarashe Dzinamarira
|
6422eaf301
|
HDFS-16767: RBF: Support observer node in Router-Based Federation.
Fixes #4127
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
|
2022-09-14 16:00:14 -07:00 |
|
Simbarashe Dzinamarira
|
e77d54d1ee
|
HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.
Fixes #4311
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
|
2022-09-09 15:43:28 -07:00 |
|
ZanderXu
|
4a01fadb94
|
HDFS-16756. RBF proxies the client's user by the login user to enable CacheEntry (#4853). Contributed by ZanderXu.
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-09-09 12:47:36 +05:30 |
|
ZanderXu
|
be4c638e4c
|
HDFS-16748. RBF: DFSClient should uniquely identify writing files by namespace id and iNodeId via RBF (#4813). Contributed by ZanderXu.
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-09-05 17:46:15 +05:30 |
|
ZanderXu
|
5567154f71
|
HDFS-16734. RBF: fix some bugs when handling getContentSummary RPC (#4763)
|
2022-08-26 16:04:33 -07:00 |
|
ZanderXu
|
8d4f51c432
|
HDFS-16728. RBF throw IndexOutOfBoundsException with disableNameServices (#4734). Contributed by ZanderXu.
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-08-24 20:27:15 +05:30 |
|
ZanderXu
|
c37f01d95b
|
HDFS-16724. RBF should support get the information about ancestor mount points (#4719)
|
2022-08-23 13:25:42 -07:00 |
|
Simba Dzinamarira
|
a3b1bafa34
|
HDFS-16669: Enhance client protocol to propagate last seen state IDs for multiple nameservices.
Fixes #4584
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
|
2022-08-23 11:12:50 -07:00 |
|
jianghuazhu
|
7f176d080c
|
HDFS-16729. RBF: fix some unreasonably annotated docs. (#4745)
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-08-21 07:29:31 +09:00 |
|
xuzq
|
e0c8c6eed4
|
HDFS-16678. RBF should supports disable getNodeUsage() in RBFMetrics (#4606)
|
2022-08-12 12:01:58 -07:00 |
|
xuzq
|
09cabaad68
|
HDFS-13274. RBF: Extend RouterRpcClient to use multiple sockets (#4531)
|
2022-08-11 13:23:32 -07:00 |
|
xuzq
|
f80fab2b90
|
HDFS-16671. RBF: RouterRpcFairnessPolicyController supports configurable permit acquire timeout (#4597)
|
2022-07-28 15:42:53 +08:00 |
|
xuzq
|
2c96357051
|
HDFS-15079. RBF: Namenode needs to use the actual client Id and callId when going through RBF proxy. (#4530)
|
2022-07-23 22:19:37 +08:00 |
|
slfan1989
|
2f6916a313
|
HDFS-16605. Improve Code With Lambda in hadoop-hdfs-rbf moudle. (#4375)
|
2022-07-21 18:42:55 -07:00 |
|
xuzq
|
6f9c4359ec
|
HDFS-16283. RBF: reducing the load of renewLease() RPC (#4524). Contributed by ZanderXu.
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-07-14 07:26:40 +05:30 |
|
Samrat
|
e8fd914c58
|
HDFS-16616. remove use of org.apache.hadoop.util.Sets (#4400)
Co-Authored by: Samrat Deb
|
2022-06-22 10:17:36 +05:30 |
|
章锡平
|
f8c7e67fdc
|
HDFS-16628 RBF: Correct target directory when move to trash for kerberos login user. (#4424). Contributed by Xiping Zhang.
|
2022-06-15 21:16:24 +08:00 |
|
Ashutosh Gupta
|
6e11c94170
|
HDFS-16576. Remove unused imports in HDFS project (#4389)
Co-authored-by: Ashutosh Gupta <ashugpt@amazon.com>
Reviewed-by: Tao Li <tomscut@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2022-06-09 22:39:00 +09:00 |
|
slfan1989
|
5952934ad5
|
HDFS-16599. Fix typo in hadoop-hdfs-rbf module (#4368). Contributed by fanshilun.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-05-31 01:59:17 +05:30 |
|
slfan1989
|
995f7b0956
|
HDFS-16597. RBF: Improve RouterRpcServer#reload With Lambda (#4362). Contributed by fanshilun.
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-05-28 09:48:34 +05:30 |
|
Ayush Saxena
|
96985f4c45
|
HDFS-15225. RBF: Add snapshot counts to content summary in router. (#4356). Contributed by Ayush Saxena.
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
|
2022-05-27 09:06:07 +05:30 |
|
Hui Fei
|
dad2900b87
|
Revert "HDFS-14750. RBF: Support dynamic handler allocation in routers (#4199)" (#4306)
|
2022-05-13 14:44:41 +08:00 |
|
Felix Nguyen
|
680af27aa6
|
HDFS-14750. RBF: Support dynamic handler allocation in routers (#4199)
|
2022-05-13 14:28:53 +08:00 |
|
Viraj Jasani
|
2dfa928a20
|
HDFS-16521. DFS API to retrieve slow datanodes (#4107)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2022-05-03 05:05:40 +08:00 |
|
Felix Nguyen
|
b4ff49a394
|
HDFS-16539. RBF: Support refreshing/changing router fairness policy controller without rebooting router (#4168)
|
2022-04-27 14:42:30 +08:00 |
|
litao
|
34b3275bf4
|
HDFS-16477. [SPS]: Add metric PendingSPSPaths for getting the number of paths to be processed by SPS (#4009). Contributed by tomscut.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-04-03 01:36:03 +05:30 |
|
litao
|
e5549a2a68
|
HDFS-16503. Should verify whether the path name is valid in the WebHDFS (#4067). Contributed by tomscut.
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
|
2022-03-21 12:40:51 +05:30 |
|
Owen O'Malley
|
7b5eac27ff
|
HDFS-16495: RBF should prepend the client ip rather than append it.
Fixes #4054
Signed-off-by: Owen O'Malley <oomalley@linkedin.com>
|
2022-03-14 10:21:35 -07:00 |
|
YulongZ
|
48bef285a8
|
HDFS-16440. RBF: Support router get HAServiceStatus with Lifeline RPC address (#3971)
|
2022-02-15 08:44:17 -08:00 |
|
YulongZ
|
3e7a7c3c4a
|
HDFS-16411 RBF: RouterId is NULL when disable RourterRpcServer (#3878)
|
2022-02-08 08:40:57 -08:00 |
|