big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
21,377 Commits 2 Branches 2 Tags 264 MiB
945b504c25
Commit Graph

58 Commits

Author SHA1 Message Date
Vishwajeet Dusane
784ea3aff6
HADOOP-15965. Upgrade to ADLS SDK which has major performance improvement for ingress/egress. 
Contributed by Vishwajeet Dusane.
 2018-12-20 18:00:05 +00:00
Sunil G
58fa96b697 Changed version in trunk to 3.3.0-SNAPSHOT. 2018-10-02 22:41:41 +05:30
Akira Ajisaka
2b2399d623
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma. 2018-06-28 14:37:22 +09:00
Sean Mackrory
1cfe7506f7 HADOOP-15356. Make HTTP timeout configurable in ADLS connector. Contributed by Atul Sikaria and Sean Mackrory. 2018-05-09 15:15:51 -06:00
Sean Mackrory
85381c7b60 HADOOP-15434. Upgrade to ADLS SDK that exposes current timeout. 2018-05-02 21:30:31 -06:00
Yiqun Lin
1312f9ae4c HADOOP-15391. Add missing css file in hadoop-aws, hadoop-aliyun, hadoop-azure and hadoop-azure-datalake modules. 2018-04-18 16:04:00 +08:00
Sean Mackrory
9d7a9031a5 HADOOP-15342. Updating ADLS connector to use the current SDK version (2.2.7). Contributed by Atul Sikaria. 2018-03-29 10:13:40 -06:00
Chris Douglas
081c350188 HADOOP-15320. Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake. Contributed by Shanyu Zhao 2018-03-28 11:58:59 -07:00
Steve Loughran
1976e0066e HADOOP-15209. DistCp to eliminate needless deletion of files under already-deleted directories. 
Contributed by Steve Loughran.
 2018-03-15 18:05:14 +00:00
Steve Loughran
edc9f1451b HADOOP-15263. hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake. 
Contributed by Steve Loughran
 2018-02-28 14:42:25 +00:00
Steve Loughran
481d79fedc HADOOP-13972. ADLS to support per-store configuration. 
Contributed by Sharad Sonker.

(cherry picked from commit 050f5287b79324b7f6231b879c0bfc608203b980)
 2018-02-15 16:27:31 +00:00
Steve Loughran
c9a373fb14 HADOOP-15090. Add ADL troubleshooting doc. 
Contributed by Steve Loughran.

(cherry picked from commit 58a2120e8a31307f19551f87be4e81d4fb626de1)
 2018-02-15 14:26:00 +00:00
Steve Loughran
8cf88fcd1f HADOOP-15187. Remove ADL mock test dependency on REST call invoked from Java SDK. 
Contributed by Vishwajeet Dusane.

(cherry picked from commit bd5ab5912564d2d687651b01f552b8e4ca8c145a)
 2018-02-12 15:13:00 +00:00
Wangda Tan
60f9e60b3b Preparing for 3.2.0 development 
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
 2018-02-11 11:17:38 +08:00
Steve Loughran
7fd287b4af HADOOP-15186. Allow Azure Data Lake SDK dependency version to be set on the command line. 
Contributed by Vishwajeet Dusane.

(cherry picked from commit 95a96b13e2a54e01ea6c6933045d912998477da3)
 2018-01-29 09:48:14 -08:00
Steve Loughran
f63d13f10d HADOOP-15185. Update adls connector to use the current version of ADLS SDK. 
Contributed by Atul Sikaria.
 2018-01-23 09:09:11 -08:00
John Zhuge
8aca46e53f HADOOP-14651. Update okhttp version to 2.7.5. Contributed by Ray Chiang and John Zhuge. 2017-09-29 12:15:06 -07:00
John Zhuge
a4661850c1 HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria. 2017-09-08 11:51:03 -07:00
Andrew Wang
0d419c984f Preparing for 3.1.0 development 2017-09-01 11:53:48 -07:00
John Zhuge
7ecc6dbed6 HADOOP-14824. Update ADLS SDK to 2.2.2 for MSI fix. Contributed by Atul Sikaria. 2017-08-31 21:13:22 -07:00
Andrew Wang
dd7916d3cd HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas. 2017-08-17 09:35:36 -07:00
John Zhuge
7769e96149 HADOOP-14627. Support MSI and DeviceCode token provider in ADLS. Contributed by Atul Sikaria. 2017-08-13 00:22:34 -07:00
Chris Douglas
55a181f845 HADOOP-14730. Support protobuf FileStatus in AdlFileSystem. 2017-08-07 21:31:28 -07:00
John Zhuge
f735ad1b67 HADOOP-14678. AdlFilesystem#initialize swallows exception when getting user name. Contributed by John Zhuge. 2017-07-28 09:46:54 -07:00
Andrew Wang
af2773f609 Updating version for 3.0.0-beta1 development 2017-06-29 17:57:40 -07:00
Andrew Wang
16ad896d5c Update maven version for 3.0.0-alpha4 development 2017-05-26 14:09:44 -07:00
Akira Ajisaka
6a52b5e144
HADOOP-14180. FileSystem contract tests to replace JUnit 3 with 4. Contributed by Xiaobing Zhou and Mingliang Liu. 2017-05-25 15:36:44 +09:00
Akira Ajisaka
0d5c8ed8e0
HADOOP-14401. maven-project-info-reports-plugin can be removed. Contributed by Andras Bokor. 2017-05-11 16:37:32 -05:00
Mingliang Liu
e4c32bccde HADOOP-14349. Rename ADLS CONTRACT_ENABLE_KEY. Contributed by Mingliang Liu 2017-04-25 20:54:56 -07:00
John Zhuge
56e81f2a20 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge. 
Signed-off-by: John Zhuge <jzhuge@apache.org>
 2017-04-07 12:04:44 -07:00
Andrew Wang
4966a6e26e HADOOP-14223. Extend FileStatus#toString() to include details like Erasure Coding and Encryption. Contributed by Manoj Govindassamy. 2017-03-29 14:37:21 -07:00
John Zhuge
253e3e78ab HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 2017-03-27 23:05:57 -07:00
John Zhuge
d1b7439b48 HADOOP-14230. TestAdlFileSystemContractLive fails to clean up. Contributed by John Zhuge. 2017-03-24 13:37:04 -07:00
Andrew Wang
52b00600df HADOOP-13715. Add isErasureCoded() API to FileStatus class. Contributed by Manoj Govindassamy. 2017-03-24 11:44:46 -07:00
Chris Douglas
c55195588f HADOOP-14197. Fix ADLS doc for credential provider. Contributed by John Zhuge 2017-03-23 12:17:27 -07:00
Chris Douglas
03955612b7 HADOOP-14196. Azure Data Lake doc is missing required config entry. Contributed by Atul Sikaria 2017-03-23 12:13:23 -07:00
John Zhuge
5a40bafdae HADOOP-14173. Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE. Contributed by John Zhuge. 
Change-Id: I5dc6f885816b8834f718874542dfa373458b0333
 2017-03-13 08:11:25 -07:00
Mingliang Liu
881ec4d97b HADOOP-14153. ADL module has messed doc structure. Contributed by Mingliang Liu 2017-03-10 00:16:09 -08:00
John Zhuge
c5ee7fded4 HADOOP-14123. Remove misplaced ADL service provider config file for FileSystem. Contributed by John Zhuge. 
Change-Id: Ic956e2eb8189625916442eaffdc69163d32f730e
 2017-03-09 18:30:17 -08:00
Steve Loughran
e60c6543d5
HADOOP-14113. Review ADL Docs. Contributed by Steve Loughran 2017-02-24 13:24:59 +00:00
Mingliang Liu
924def7854 HADOOP-14017. User friendly name for ADLS user and group. Contributed by Vishwajeet Dusane 2017-02-21 13:44:42 -08:00
Mingliang Liu
f432999025 HADOOP-14049. Honour AclBit flag associated to file/folder permission for Azure datalake account. Contributed by Vishwajeet Dusane 2017-02-16 15:14:25 -08:00
Lei Xu
71c23c9fc9 HADOOP-13929. ADLS connector should not check in contract-test-options.xml. (John Zhuge via lei) 2017-02-13 13:33:13 -08:00
Lei Xu
ccf2d66244 HADOOP-13962. Update ADLS SDK to 2.1.4. (John Zhuge via lei) 2017-01-21 10:52:40 +08:00
Lei Xu
e015b56319 HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 2017-01-20 14:48:04 +08:00
Andrew Wang
5d8b80ea9b Preparing for 3.0.0-alpha3 development 2017-01-19 15:50:07 -08:00
Mingliang Liu
ef34bf2bb9 HADOOP-13900. Remove snapshot version of SDK dependency from Azure Data Lake Store File System. Contributed by Vishwajeet Dusane 2016-12-13 10:34:32 -08:00
Mingliang Liu
4113ec5fa5 HADOOP-13257. Improve Azure Data Lake contract tests. Contributed by Vishwajeet Dusane 2016-12-02 15:54:57 -08:00
Akira Ajisaka
209e805430 HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki. 2016-11-28 14:34:57 +09:00
Chris Douglas
5c61ad2488 HADOOP-13037. Refactor Azure Data Lake Store as an independent FileSystem. Contributed by Vishwajeet Dusane 2016-11-11 11:15:07 -08:00