hadoop/hadoop-tools
sreeb-msft 3f256fa209 HADOOP-18498. ABFS: Remove unwanted ? prefix from SAS Tokens (#5136)
This commit parses SAS Tokens and removes the unwanted prefix of '?' from them, if present.

At present, SAS Tokens are provided to the driver through customer implementations of the SASTokenProvider interface. The SAS token providers should not assume that the token will be the first query parameter in the URIs that communicate with the backend. However, it was observed that certain public interfaces provided by Storage to generate SAS can include the '?' as the first character of the SAS Token, which would ideally be the case when it is the first query parameter. Thus, tokens that contain this prefix will lead to an error in the driver due to a clash of query parameters.

To avoid failures for use of such SAS tokens, after receiving the SAS Token from the provider, the code checks for whether any ? prefix is present or not. If yes, it is removed before further usage of the token. This way, users would not have to manually remove the prefix before passing it on as a configuration.

Contributed by Sree Bhattacharya
2022-11-28 11:49:02 +00:00
..
hadoop-aliyun HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-archive-logs HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-archives HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-aws HADOOP-18233. Possible race condition with TemporaryAWSCredentialsProvider (#5024) 2022-10-31 18:16:14 +00:00
hadoop-azure HADOOP-18498. ABFS: Remove unwanted ? prefix from SAS Tokens (#5136) 2022-11-28 11:49:02 +00:00
hadoop-azure-datalake HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-benchmark HADOOP-18507. VectorIO FileRange type to support a "reference" field (#5076) 2022-11-01 09:53:11 +00:00
hadoop-datajoin HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-distcp HADOOP-18442. Remove openstack support (#4855) 2022-10-07 12:03:55 +01:00
hadoop-dynamometer HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-extras HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-fs2img HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-gridmix HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-kafka HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-openstack HADOOP-18442. Remove openstack support (#4855) 2022-10-07 12:03:55 +01:00
hadoop-pipes HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-resourceestimator HADOOP-15983. Use jersey-json that is built to use jackson2 (#3988) 2022-10-21 11:34:09 +01:00
hadoop-rumen HADOOP-18469. Add secure XML parser factories to XMLUtils (#4940) 2022-10-07 11:03:31 +01:00
hadoop-sls HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-streaming HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00
hadoop-tools-dist HADOOP-18442. Remove openstack support (#4855) 2022-10-07 12:03:55 +01:00
pom.xml HADOOP-18470. Release hadoop 3.3.5 2022-09-27 11:30:18 -05:00