fang zhenyi
|
5e013d50d1
|
HADOOP-15305. Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings.
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-03-15 16:12:07 +09:00 |
|
Steve Loughran
|
52babbb4a0
|
HADOOP-15086. NativeAzureFileSystem file rename is not atomic.
Contributed by Thomas Marquardt
|
2017-12-22 11:39:55 +00:00 |
|
Steve Loughran
|
0ea182d0fa
|
HADOOP-15042. Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0.
Contributed by Rajesh Balamohan
|
2017-11-28 11:52:59 +00:00 |
|
John Zhuge
|
bf6a660232
|
HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
|
2017-11-09 10:16:12 -08:00 |
|
Steve Loughran
|
9fcc3a1fc8
|
HADOOP-14935. Azure: POSIX permissions are taking effect in access() method even when authorization is enabled.
Contributed by Santhosh G Nayak
|
2017-10-16 16:01:47 +01:00 |
|
Steve Loughran
|
3de574413c
|
HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB.
Contributed by Varada Hemeswari.
|
2017-10-11 18:06:43 +01:00 |
|
Steve Loughran
|
572cdb5463
|
HADOOP-14899. Restrict Access to setPermission operation when authorization is enabled in WASB
Contributed by Kannapiran Srinivasan.
|
2017-10-06 17:43:38 +01:00 |
|
Steve Loughran
|
9288206cb3
|
HADOOP-14845. Azure wasb: getFileStatus not making any auth check.
Contributed by Sivaguru Sankaridurg
|
2017-10-05 15:05:23 +01:00 |
|
Steve Loughran
|
a530e7ab3b
|
HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB
Contributed by Varada Hemeswari
|
2017-09-28 19:52:56 +01:00 |
|
Steve Loughran
|
2d2d97fa7d
|
HADOOP-14553. Add (parallelized) integration tests to hadoop-azure
Contributed by Steve Loughran
|
2017-09-15 17:03:01 +01:00 |
|
Steve Loughran
|
13eda50003
|
HADOOP-14520. WASB: Block compaction for Azure Block Blobs.
Contributed by Georgi Chalakov
|
2017-09-07 18:35:03 +01:00 |
|
Steve Loughran
|
792eff9ea7
|
HADOOP-14820 Wasb mkdirs security checks inconsistent with HDFS.
Contributed by Sivaguru Sankaridurg
|
2017-09-05 14:16:57 +01:00 |
|
Steve Loughran
|
9374f38820
|
HADOOP-14583. wasb throws an exception if you try to create a file and there's no parent directory
Contributed by Esfandiar Manii and Thomas Marquardt.
|
2017-08-29 19:03:44 +01:00 |
|
Steve Loughran
|
021974f4cb
|
HADOOP-14802. Add support for using container saskeys for all accesses.
Contributed by Sivaguru Sankaridurg
|
2017-08-29 19:02:43 +01:00 |
|
Steve Loughran
|
c6b4e656b7
|
HADOOP-14769. WASB: delete recursive should not fail if a file is deleted.
Contributed by Thomas Marquardt
|
2017-08-18 14:13:40 +01:00 |
|
Chris Douglas
|
645a8f2a4d
|
HADOOP-14726. Mark FileStatus::isDir as final
|
2017-08-14 21:57:20 -07:00 |
|
Steve Loughran
|
54356b1e83
|
HADOOP-14183. Remove service loader config file for wasb fs.
Contributed by Esfandiar Manii.
|
2017-08-10 16:46:33 +01:00 |
|
Steve Loughran
|
f4e1aa0508
|
HADOOP-14715. TestWasbRemoteCallHelper failing.
Contributed by Esfandiar Manii.
|
2017-08-08 23:37:47 +01:00 |
|
Steve Loughran
|
d91b7a8451
|
HADOOP-14722. Azure: BlockBlobInputStream position incorrect after seek.
Contributed by Thomas Marquardt
|
2017-08-06 20:19:23 +01:00 |
|
Steve Loughran
|
778d4edd9a
|
HADOOP-14660 wasb: improve throughput by 34% when account limit exceeded.
Contributed by Thomas Marquardt.
|
2017-08-01 21:36:28 +01:00 |
|
Jitendra Pandey
|
a92bf39e23
|
HADOOP-14680. Azure: IndexOutOfBoundsException in BlockBlobInputStream. Contributed by Thomas Marquardt.
|
2017-07-25 16:26:48 -07:00 |
|
Jitendra Pandey
|
f2921e51f0
|
HADOOP-14518. Customize User-Agent header sent in HTTP/HTTPS requests by WASB. Contributed by Georgi Chalakov.
|
2017-07-24 23:01:01 -07:00 |
|
Jitendra Pandey
|
2843c688bc
|
HADOOP-14642. wasb: add support for caching Authorization and SASKeys. Contributed by Sivaguru Sankaridurg.
|
2017-07-19 00:13:06 -07:00 |
|
Jitendra Pandey
|
b0e78ae085
|
HADOOP-14640. Azure: Support affinity for service running on localhost and reuse SPNEGO hadoop.auth cookie for authorization, SASKey and delegation token generation. Contributed by Santhosh G Nayak.
|
2017-07-17 02:27:55 -07:00 |
|
Steve Loughran
|
7d272ea124
|
HADOOP-14581. Restrict setOwner to list of user when security is enabled in wasb.
Contributed by Varada Hemeswari
(cherry picked from commit 1e69e5260351effc8077d1bdc397cec57cf1ff1b)
|
2017-07-12 10:37:39 +01:00 |
|
Steve Loughran
|
d670c3a4da
|
HADOOP-14535 wasb: implement high-performance random access and seek of block blobs.
Contributed by Thomas Marquardt
|
2017-07-11 21:34:27 +01:00 |
|
Mingliang Liu
|
38996fdcf0
|
HADOOP-14443. Azure: Support retry and client side failover for authorization, SASKey and delegation token generation. Contributed by Santhosh G Nayak
|
2017-06-30 16:53:48 -07:00 |
|
Mingliang Liu
|
b08cc97396
|
HADOOP-14601. Azure: Reuse ObjectMapper. Contributed by Mingliang Liu
|
2017-06-29 09:22:00 -07:00 |
|
Mingliang Liu
|
990aa34de2
|
HADOOP-14609. NPE in AzureNativeFileSystemStore.checkContainer() if StorageException lacks an error code. Contributed by Steve Loughran
|
2017-06-28 14:18:59 -07:00 |
|
Mingliang Liu
|
7e031c2c18
|
HADOOP-14546. Azure: Concurrent I/O does not work when secure.mode is enabled. Contributed by Thomas
|
2017-06-27 17:32:07 -07:00 |
|
Mingliang Liu
|
686a634f01
|
HADOOP-14573. regression: Azure tests which capture logs failing with move to SLF4J. Contributed by Steve Loughran
|
2017-06-27 16:48:47 -07:00 |
|
Steve Loughran
|
48f4a229a9
|
HADOOP-14461 Azure: handle failure gracefully in case of missing account access key.
Contributed by Mingliang Liu.
|
2017-06-26 13:39:47 +01:00 |
|
Steve Loughran
|
c6bd73c6c5
|
HADOOP-14547. [WASB] the configured retry policy is not used for all storage operations.
Contributed by Thomas.
|
2017-06-23 21:38:41 +01:00 |
|
Akira Ajisaka
|
3369540653
|
HADOOP-14296. Move logging APIs over to slf4j in hadoop-tools.
|
2017-06-20 13:18:26 +09:00 |
|
Mingliang Liu
|
325163f23f
|
HADOOP-14512. WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename. Contributed by Duo Xu
|
2017-06-09 13:07:11 -07:00 |
|
Mingliang Liu
|
df35e4cc3b
|
HADOOP-14500. Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} fails. Contributed by Rajesh Balamohan
|
2017-06-07 13:54:52 -07:00 |
|
Mingliang Liu
|
536f057158
|
HADOOP-14491. Azure has messed doc structure. Contributed by Mingliang Liu
|
2017-06-06 11:09:28 -07:00 |
|
Mingliang Liu
|
6b5285bbcb
|
HADOOP-14472. Azure: TestReadAndSeekPageBlobAfterWrite fails intermittently. Contributed by Mingliang Liu
|
2017-06-06 11:06:49 -07:00 |
|
Mingliang Liu
|
5fd9742c83
|
HADOOP-14478. Optimize NativeAzureFsInputStream for positional reads. Contributed by Rajesh Balamohan
|
2017-06-05 15:56:43 -07:00 |
|
Mingliang Liu
|
ece33208b8
|
HADOOP-14460. Azure: update doc for live and contract tests. Contributed by Mingliang Liu
|
2017-06-01 11:52:11 -07:00 |
|
Mingliang Liu
|
89bb8bfe58
|
HADOOP-14442. Owner support for ranger-wasb integration. Contributed by Varada Hemeswari
|
2017-05-26 17:54:00 -07:00 |
|
Akira Ajisaka
|
6a52b5e144
|
HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu.
|
2017-05-25 15:36:44 +09:00 |
|
Mingliang Liu
|
b415c6fe74
|
HADOOP-14416. Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-Ranger. Contributed by Sivaguru Sankaridurg
|
2017-05-16 11:22:32 -07:00 |
|
Mingliang Liu
|
eed731496f
|
HADOOP-14361. Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently. Contributed by Santhosh G Nayak
|
2017-05-10 15:05:11 -07:00 |
|
Akira Ajisaka
|
2ba9903932
|
HADOOP-14400. Fix warnings from spotbugs in hadoop-tools. Contributed by Weiwei Yang.
|
2017-05-10 05:57:12 -05:00 |
|
Andrew Wang
|
54fd0e44b7
|
HDFS-11644. Support for querying outputstream capabilities. Contributed by Manoj Govindassamy.
|
2017-05-08 21:59:49 -07:00 |
|
Mingliang Liu
|
8b5f2c372e
|
HADOOP-14351. Azure: RemoteWasbAuthorizerImpl and RemoteSASKeyGeneratorImpl should not use Kerberos interactive user cache. Contributed by Santhosh G Nayak
|
2017-04-26 13:47:18 -07:00 |
|
Mingliang Liu
|
0cab57223e
|
HADOOP-14274. Azure: Simplify Ranger-WASB policy model. Contributed by Sivaguru Sankaridurg
|
2017-04-12 16:07:10 -07:00 |
|
Mingliang Liu
|
56ab02eed9
|
HADOOP-14273. Azure: NativeAzureFileSystem should respect config for kerberosSupportEnabled flag. Contributed by Santhosh G Nayak
|
2017-04-04 11:10:28 -07:00 |
|
Mingliang Liu
|
27a44b60c1
|
HADOOP-14272. Azure: WasbRemoteCallHelper should use String equals for comparison. Contributed by Santhosh G Nayak
|
2017-04-04 11:03:59 -07:00 |
|
Chris Douglas
|
6eba79232f
|
HADOOP-14271. Correct spelling of 'occurred' and variants. Contributed by Yeliang Cang
|
2017-04-03 20:13:14 -07:00 |
|
Mingliang Liu
|
8e15e24059
|
HADOOP-13945. Azure: Add Kerberos and Delegation token support to WASB client. Contributed by Santhosh G Nayak
Change-Id: I39fb0a3b0491bf2160571366939a0502a0045429
|
2017-03-20 16:31:24 -07:00 |
|
Mingliang Liu
|
28daaf0eb2
|
HADOOP-14150. Implement getHomeDirectory() method in NativeAzureFileSystem. Contributed by Santhosh G Nayak
|
2017-03-07 14:55:52 -08:00 |
|
Mingliang Liu
|
686823529b
|
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
|
2017-03-06 17:16:36 -08:00 |
|
Mingliang Liu
|
52d7d5aa1a
|
Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth"
This reverts commit 6b7cd62b8c.
|
2017-03-06 17:10:11 -08:00 |
|
Mingliang Liu
|
c571cda5c7
|
HADOOP-14048. REDO operation of WASB#AtomicRename should create placeholder blob for destination folder. Contributed by NITIN VERMA
|
2017-03-06 17:00:13 -08:00 |
|
Mingliang Liu
|
6b7cd62b8c
|
HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth
|
2017-03-03 17:09:12 -08:00 |
|
Mingliang Liu
|
82607fce39
|
HADOOP-14091. AbstractFileSystem implementaion for 'wasbs' scheme. Contributed Varada Hemeswari.
|
2017-02-23 13:48:44 -08:00 |
|
Mingliang Liu
|
c6a5b689db
|
HADOOP-13942. Build failure due to errors of javadoc build in hadoop-azure. Contributed by Kai Sasaki
|
2016-12-29 16:24:06 -08:00 |
|
Mingliang Liu
|
e92a77099b
|
HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
|
2016-12-22 20:15:18 -08:00 |
|
Mingliang Liu
|
f92913c35b
|
HADOOP-13831. Correct check for error code to detect Azure Storage Throttling and provide retries. Contributed by Gaurav Kanade
|
2016-12-15 12:35:08 -08:00 |
|
Mingliang Liu
|
15dd1f3381
|
HADOOP-13675. Bug in return value for delete() calls in WASB. Contributed by Dushyanth
|
2016-12-05 12:04:07 -08:00 |
|
Wei-Chiu Chuang
|
c0b1a44f6c
|
HADOOP-13660. Upgrade commons-configuration version. Contributed by Sean Mackrory.
|
2016-11-17 22:48:35 -06:00 |
|
Mingliang Liu
|
5af572b644
|
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
|
2016-11-15 10:57:00 -08:00 |
|
Xiao Chen
|
20c4d8efab
|
HADOOP-13787. Azure testGlobStatusThrowsExceptionForUnreadableDir fails. Contributed by John Zhuge.
|
2016-11-03 11:16:07 -07:00 |
|
Robert Kanter
|
5877f20f9c
|
HADOOP-10075. Update jetty dependency to version 9 (rkanter)
|
2016-10-27 16:09:00 -07:00 |
|
Steve Loughran
|
2cc841f16e
|
HADOOP-13678 Update jackson from 1.9.13 to 2.x in hadoop-tools. Contributed by Akira Ajisaka.
|
2016-10-06 16:31:00 +01:00 |
|
Xiaoyu Yao
|
8b57be108f
|
HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth.
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
(cherry picked from commit a65e159c59de41d26e12212dd1b7c28c28265cc3)
|
2016-08-29 15:30:49 -07:00 |
|
Chris Nauroth
|
ae4db25443
|
HADOOP-13513. Java 1.7 support for org.apache.hadoop.fs.azure testcases. Contributed by Tibor Kiss.
|
2016-08-18 10:44:36 -07:00 |
|
Chris Nauroth
|
2ed58c40e5
|
HADOOP-13403. AzureNativeFileSystem rename/delete performance improvements. Contributed by Subramanyam Pattipaka.
|
2016-08-08 12:28:40 -07:00 |
|
Chris Nauroth
|
4ef1bc0bdb
|
HADOOP-13459. hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. Contributed by Chris Nauroth.
|
2016-08-02 22:32:21 -07:00 |
|
Chris Nauroth
|
b43de80031
|
HADOOP-13354. Update WASB driver to use the latest version (4.2.0) of SDK for Microsoft Azure Storage Clients. Contributed by Sivaguru Sankaridurg.
|
2016-07-27 15:50:38 -07:00 |
|
Akira Ajisaka
|
54fe17a607
|
HADOOP-9427. Use JUnit assumptions to skip platform-specific tests. Contributed by Gergely Novák.
|
2016-07-27 19:41:09 +09:00 |
|
Steve Loughran
|
c918286b17
|
HADOOP-13145 In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Contributed by Chris Nauroth.
|
2016-05-20 12:21:59 +01:00 |
|
Chris Nauroth
|
843ee8d59d
|
HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
|
2016-04-08 13:36:58 -07:00 |
|
Allen Wittenauer
|
738155063e
|
HADOOP-12857. rework hadoop-tools (aw)
|
2016-03-23 13:46:38 -07:00 |
|
Chris Nauroth
|
c50aad0f85
|
HADOOP-12717. NPE when trying to rename a directory in Windows Azure Storage FileSystem. Contributed by Robert Yokota and Gaurav Kanade.
|
2016-03-04 22:57:43 -08:00 |
|
Chris Nauroth
|
f98dff329b
|
HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
|
2016-03-01 13:18:42 -08:00 |
|
Chris Nauroth
|
7634d404b7
|
HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
|
2016-02-28 11:22:55 -08:00 |
|
cnauroth
|
3369a4f691
|
HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
|
2016-02-23 21:37:50 -08:00 |
|
cnauroth
|
27b77751c1
|
HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
|
2016-02-22 17:30:13 -08:00 |
|
cnauroth
|
d4f5fc23b2
|
HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
|
2016-02-22 13:39:38 -08:00 |
|
cnauroth
|
91a96eaa53
|
HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
|
2016-02-12 15:50:10 -08:00 |
|
cnauroth
|
8bc93db2e7
|
HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
|
2016-01-18 09:08:58 -08:00 |
|
cnauroth
|
0e76f1fcea
|
HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
|
2016-01-09 22:18:11 -08:00 |
|
cnauroth
|
f0fa6d869b
|
HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
|
2016-01-08 20:18:59 -08:00 |
|
cnauroth
|
978bbdfeb2
|
HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
|
2016-01-06 11:15:59 -08:00 |
|
cnauroth
|
0fb1867fd6
|
HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade.
|
2015-11-04 10:28:44 -08:00 |
|
cnauroth
|
9e7dcab185
|
HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade.
|
2015-11-02 10:21:39 -08:00 |
|
cnauroth
|
3ce0a6502e
|
HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth.
|
2015-11-02 10:17:41 -08:00 |
|
cnauroth
|
2d10cb8e00
|
HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth.
|
2015-10-28 09:44:10 -07:00 |
|
cnauroth
|
1f7ecb0c84
|
HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu.
|
2015-10-27 22:56:22 -07:00 |
|
cnauroth
|
73822de7c3
|
HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth.
|
2015-10-27 22:48:56 -07:00 |
|
cnauroth
|
cb282d5b89
|
HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade.
|
2015-10-22 14:29:57 -07:00 |
|
cnauroth
|
47641fcbc9
|
HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade.
|
2015-10-22 12:21:32 -07:00 |
|
cnauroth
|
5f6edb30c2
|
HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth.
|
2015-10-05 20:11:41 -07:00 |
|
Kihwal Lee
|
3abbdc929b
|
HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu.
|
2015-09-28 17:31:51 -05:00 |
|
cnauroth
|
3da0bedaec
|
HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth.
|
2015-08-05 14:56:41 -07:00 |
|
cnauroth
|
efa97243ec
|
HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
|
2015-07-22 11:16:49 -07:00 |
|
cnauroth
|
460e98f7b3
|
HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
|
2015-06-29 13:48:02 -07:00 |
|