Kai Xie
|
188bebbe7e
|
HADOOP-16018. DistCp won't reassemble chunks when blocks per chunk > 0.
Contributed by Kai Xie.
|
2019-01-08 11:57:57 +00:00 |
|
Akira Ajisaka
|
7f78397036
|
Revert "HADOOP-14556. S3A to support Delegation Tokens."
This reverts commit d7152332b3 .
|
2019-01-08 14:51:30 +09:00 |
|
Steve Loughran
|
d7152332b3
|
HADOOP-14556. S3A to support Delegation Tokens.
Contributed by Steve Loughran.
|
2019-01-07 13:18:03 +00:00 |
|
Arpit Agarwal
|
914b0cf15f
|
HADOOP-12558. distcp documentation is woefully out of date. Contributed by Dinesh Chitlangia.
|
2018-11-15 13:58:13 -08:00 |
|
Ted Yu
|
e2cecb681e
|
HADOOP-15850. CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0. Contributed by Ted Yu.
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
|
2018-10-19 13:21:06 -07:00 |
|
Steve Loughran
|
e36ae9639f
|
HADOOP-15831. Include modificationTime in the toString method of CopyListingFileStatus.
Contributed by Ted Yu.
|
2018-10-12 09:59:19 +01:00 |
|
Sunil G
|
58fa96b697
|
Changed version in trunk to 3.3.0-SNAPSHOT.
|
2018-10-02 22:41:41 +05:30 |
|
Surendra Singh Lilhore
|
96c4575d73
|
HDFS-13805. Journal Nodes should allow to format non-empty directories with -force option. Contributed by Surendra Singh Lilhore.
|
2018-08-24 08:14:57 +05:30 |
|
Akira Ajisaka
|
3e3963b035
|
HADOOP-15552. Move logging APIs over to slf4j in hadoop-tools - Part2. Contributed by Ian Pickering.
|
2018-08-16 00:31:59 +09:00 |
|
Steve Loughran
|
ca8b80bf59
|
HADOOP-15384. distcp numListstatusThreads option doesn't get to -delete scan.
Contributed by Steve Loughran.
|
2018-07-10 10:43:59 +01:00 |
|
Akira Ajisaka
|
2b2399d623
|
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.
|
2018-06-28 14:37:22 +09:00 |
|
Xiao Chen
|
7c9cdad6d0
|
HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo.
|
2018-04-10 21:31:48 -07:00 |
|
Steve Loughran
|
1976e0066e
|
HADOOP-15209. DistCp to eliminate needless deletion of files under already-deleted directories.
Contributed by Steve Loughran.
|
2018-03-15 18:05:14 +00:00 |
|
Chris Douglas
|
45cccadd2e
|
HDFS-12780. Fix spelling mistake in DistCpUtils.java. Contributed by Jianfei Jiang
|
2018-03-13 11:08:11 -07:00 |
|
Steve Loughran
|
7ef4d942dd
|
HADOOP-15273.distcp can't handle remote stores with different checksum algorithms.
Contributed by Steve Loughran.
|
2018-03-08 11:24:06 +00:00 |
|
Steve Loughran
|
3bd6b1fd85
|
HADOOP-15292. Distcp's use of pread is slowing it down.
Contributed by Virajith Jalaparti.
|
2018-03-08 11:15:46 +00:00 |
|
fang zhenyi
|
4d4dde5112
|
HADOOP-15223. Replace Collections.EMPTY* with empty* when available
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
|
2018-02-18 22:19:39 +09:00 |
|
Wangda Tan
|
60f9e60b3b
|
Preparing for 3.2.0 development
Change-Id: I6d0e01f3d665d26573ef2b957add1cf0cddf7938
|
2018-02-11 11:17:38 +08:00 |
|
Anu Engineer
|
4304fcd5bd
|
HDFS-12990. Change default NameNode RPC port back to 8020. Contributed by Xiao Chen.
|
2018-02-06 13:43:45 -08:00 |
|
Arpit Agarwal
|
d4e13a4647
|
HADOOP-15198. Correct the spelling in CopyFilter.java. Contributed by Mukul Kumar Singh.
|
2018-02-02 11:37:51 -08:00 |
|
Surendra Singh Lilhore
|
00129c5314
|
HDFS-12833. Distcp : Update the usage of delete option for dependency with update and overwrite option. Contributed by usharani.
|
2017-12-12 00:28:02 +05:30 |
|
Akira Ajisaka
|
cc3f3eca40
|
MAPREDUCE-6999. Fix typo onf in DynamicInputChunk.java. Contributed by fang zhenyi.
|
2017-11-02 18:32:24 +09:00 |
|
Steve Loughran
|
f36cbc8475
|
HADOOP-14942. DistCp#cleanup() should check whether jobFS is null.
Contributed by Andras Bokor.
|
2017-10-20 22:27:04 +01:00 |
|
ChenSammi
|
e0b3c644e1
|
HDFS-12414. Ensure to use CLI command to enable/disable erasure coding policy. Contributed by Sammi Chen
|
2017-09-14 09:15:29 +08:00 |
|
Xiaoyu Yao
|
63720ef574
|
HADOOP-14839. DistCp log output should contain copied and deleted files and directories. Contributed by Yiqun Lin.
|
2017-09-05 23:34:55 -07:00 |
|
Andrew Wang
|
0d419c984f
|
Preparing for 3.1.0 development
|
2017-09-01 11:53:48 -07:00 |
|
Andrew Wang
|
f29a0fc288
|
HDFS-12303. Change default EC cell size to 1MB for better performance. Contributed by Wei Zhou.
|
2017-08-25 14:14:23 -07:00 |
|
Andrew Wang
|
dd7916d3cd
|
HDFS-12250. Reduce usage of FsPermissionExtension in unit tests. Contributed by Chris Douglas.
|
2017-08-17 09:35:36 -07:00 |
|
Sean Mackrory
|
1a1bf6b7d0
|
HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer.
|
2017-08-02 12:25:05 -06:00 |
|
Wei-Chiu Chuang
|
44350fdf49
|
HADOOP-14557. Document HADOOP-8143 (Change distcp to have -pb on by default). Contributed by Bharat Viswanadham.
|
2017-07-20 18:23:13 -07:00 |
|
Andrew Wang
|
af2773f609
|
Updating version for 3.0.0-beta1 development
|
2017-06-29 17:57:40 -07:00 |
|
Jason Lowe
|
dd65eea74b
|
HADOOP-8143. Change distcp to have -pb on by default. Contributed by Mithun Radhakrishnan
|
2017-06-20 09:53:47 -05:00 |
|
Andrew Wang
|
16ad896d5c
|
Update maven version for 3.0.0-alpha4 development
|
2017-05-26 14:09:44 -07:00 |
|
Sunil G
|
b6f66b0da1
|
YARN-6584. Correct license headers in hadoop-common, hdfs, yarn and mapreduce. Contributed by Yeliang Cang.
|
2017-05-22 14:10:06 +05:30 |
|
Yongjun Zhang
|
b4adc8392c
|
HADOOP-14407. DistCp - Introduce a configurable copy buffer size. (Omkar Aradhya K S via Yongjun Zhang)
|
2017-05-18 15:35:22 -07:00 |
|
Mingliang Liu
|
26172a94d6
|
HADOOP-14267. Make DistCpOptions immutable. Contributed by Mingliang Liu
|
2017-03-31 20:04:26 -07:00 |
|
Yongjun Zhang
|
bf3fb585aa
|
HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen, Rosie Li.
|
2017-03-30 17:38:56 -07:00 |
|
Yongjun Zhang
|
144f1cf765
|
Revert "HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen."
This reverts commit 064c8b25ec .
|
2017-03-30 17:38:18 -07:00 |
|
Yongjun Zhang
|
064c8b25ec
|
HADOOP-11794. Enable distcp to copy blocks in parallel. Contributed by Yongjun Zhang, Wei-Chiu Chuang, Xiao Chen.
|
2017-03-30 17:01:15 -07:00 |
|
Wei-Chiu Chuang
|
8c591b8d19
|
HDFS-10974. Document replication factor for EC files. Contributed by Yiqun Lin.
|
2017-03-30 11:16:05 -07:00 |
|
Andrew Wang
|
0e6f8e4bc6
|
HDFS-10971. Distcp should not copy replication factor if source file is erasure coded. Contributed by Manoj Govindassamy.
|
2017-03-28 22:14:03 -07:00 |
|
Yongjun Zhang
|
d235dcdf0b
|
HADOOP-14127. Add log4j configuration to enable logging in hadoop-distcp's tests. (Xiao Chen via Yongjun Zhang)
|
2017-02-27 20:42:13 -08:00 |
|
Andrew Wang
|
5d8b80ea9b
|
Preparing for 3.0.0-alpha3 development
|
2017-01-19 15:50:07 -08:00 |
|
Steve Loughran
|
ed33ce11dd
|
HADOOP-13496. Include file lengths in Mismatch in length error for distcp. Contributed by Ted Yu
(cherry picked from commit 77401bd5fcca5127c9908156971eeec468371f47)
|
2017-01-19 11:25:40 +00:00 |
|
Chris Nauroth
|
4c8f9e1302
|
HDFS-9483. Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS. Contributed by Surendra Singh Lilhore.
|
2017-01-05 15:04:47 -08:00 |
|
Akira Ajisaka
|
209e805430
|
HADOOP-13506. Redundant groupid warning in child projects. Contributed by Kai Sasaki.
|
2016-11-28 14:34:57 +09:00 |
|
Mingliang Liu
|
beb70fed4f
|
HADOOP-13655. document object store use with fs shell and distcp. Contributed by Steve Loughran
This closes #131
|
2016-11-22 13:12:23 -08:00 |
|
Mingliang Liu
|
5af572b644
|
HADOOP-13427. Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}. Contributed by Steve Loughran and Mingliang Liu
|
2016-11-15 10:57:00 -08:00 |
|
Masatake Iwasaki
|
0bdd263d82
|
HADOOP-13017. Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0. Contributed by Steve Loughran.
|
2016-10-27 15:46:59 +09:00 |
|
Yongjun Zhang
|
0f0c15f7a5
|
HDFS-11040. Add documentation for HDFS-9820 distcp improvement. Contributed by Yongjun Zhang.
|
2016-10-25 12:25:40 -07:00 |
|