Akira Ajisaka
|
02c51c27d9
|
HDFS-10298. Document the usage of distcp -diff option. Contributed by Takashi Ohnishi.
|
2016-04-25 22:33:09 +09:00 |
|
Jing Zhao
|
63e5412f1a
|
HDFS-9427. HDFS should not default to ephemeral ports. Contributed by Xiaobing Zhou.
|
2016-04-22 15:14:40 -07:00 |
|
Steve Loughran
|
19f0f9608e
|
HADOOP-12891. S3AFileSystem should configure Multipart Copy threshold and chunk size. (Andrew Olson via stevel)
|
2016-04-22 11:25:03 +01:00 |
|
Yongjun Zhang
|
a749ba0cea
|
HDFS-9670. DistCp throws NPE when source is root. (John Zhuge via Yongjun Zhang)
|
2016-04-21 12:17:17 -07:00 |
|
Jing Zhao
|
404f57f328
|
HDFS-10216. Distcp -diff throws exception when handling relative path. Contributed by Takashi Ohnishi.
|
2016-04-14 10:35:22 -07:00 |
|
Steve Loughran
|
df18b6e984
|
HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint. (Stephen Montgomery via stevel)
|
2016-04-14 12:44:55 +01:00 |
|
Jason Lowe
|
2a5da97f81
|
Revert "YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla"
This reverts commit 1cbcd4a491.
|
2016-04-11 15:51:01 +00:00 |
|
Steve Loughran
|
b9e3eff62a
|
HADOOP-12444 Support lazy seek in S3AInputStream. Rajesh Balamohan via stevel
|
2016-04-09 11:25:31 +01:00 |
|
Chris Nauroth
|
843ee8d59d
|
HADOOP-12994. Specify PositionedReadable, add contract tests, fix problems. Contributed by Steve Loughran.
|
2016-04-08 13:36:58 -07:00 |
|
Steve Loughran
|
ce5b4812f0
|
HADOOP-12753 S3A JUnit tests failing if using HTTP proxy. (Zoran Rajic via stevel)
|
2016-04-08 17:10:00 +01:00 |
|
Akira Ajisaka
|
9c32f8785e
|
HDFS-10266. Remove unused properties dfs.client.file-block-storage-locations.num-threads and dfs.client.file-block-storage-locations.timeout.millis. Contributed by Ray Chiang.
|
2016-04-08 15:32:13 +09:00 |
|
Jason Lowe
|
1cbcd4a491
|
YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla
|
2016-04-05 13:40:19 +00:00 |
|
Steve Loughran
|
89c9347511
|
HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse. - omitted new S3A subclass
|
2016-04-04 17:02:04 +01:00 |
|
Steve Loughran
|
0ecdd4cffa
|
HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list. author: Pieter Reuse.
|
2016-04-03 16:40:19 +01:00 |
|
Harsh J
|
256c82fe29
|
HADOOP-11687. Ignore x-* and response headers when copying an Amazon S3 object. Contributed by Aaron Peterson and harsh.
|
2016-04-01 14:18:10 +05:30 |
|
Allen Wittenauer
|
0a74610d1c
|
HADOOP-11393. Revert HADOOP_PREFIX, go back to HADOOP_HOME (aw)
|
2016-03-31 07:51:05 -07:00 |
|
Akira Ajisaka
|
0050fa5f1c
|
MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
|
2016-03-29 18:17:52 +09:00 |
|
Akira Ajisaka
|
115be193df
|
Revert "MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote."
This reverts commit 2c268cc936.
|
2016-03-28 16:05:35 +09:00 |
|
Akira Ajisaka
|
18c7e58283
|
HDFS-9640. Remove hsftp from DistCp in trunk. Contributed by Wei-Chiu Chuang.
|
2016-03-28 15:32:38 +09:00 |
|
Akira Ajisaka
|
2c268cc936
|
MAPREDUCE-6543. Migrate MR client test cases part 2. Contributed by Dustin Cote.
|
2016-03-25 15:17:27 +09:00 |
|
Allen Wittenauer
|
738155063e
|
HADOOP-12857. rework hadoop-tools (aw)
|
2016-03-23 13:46:38 -07:00 |
|
Chris Nauroth
|
c50aad0f85
|
HADOOP-12717. NPE when trying to rename a directory in Windows Azure Storage FileSystem. Contributed by Robert Yokota and Gaurav Kanade.
|
2016-03-04 22:57:43 -08:00 |
|
Masatake Iwasaki
|
cbd31328a6
|
HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims)
|
2016-03-04 14:11:36 +09:00 |
|
Masatake Iwasaki
|
33a412e8a4
|
HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims)
|
2016-03-03 18:57:23 +09:00 |
|
Chris Nauroth
|
f98dff329b
|
HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty.
|
2016-03-01 13:18:42 -08:00 |
|
Chris Nauroth
|
d251e55415
|
HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay.
|
2016-02-29 21:59:52 -08:00 |
|
Masatake Iwasaki
|
809ebc0b14
|
HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims)
|
2016-02-29 18:20:14 +09:00 |
|
Chris Nauroth
|
7634d404b7
|
HADOOP-12846. Credential Provider Recursive Dependencies. Contributed by Larry McCay.
|
2016-02-28 11:22:55 -08:00 |
|
cnauroth
|
3369a4f691
|
HADOOP-12535. Run FileSystem contract tests with hadoop-azure. Contributed by Madhumita Chakraborty.
|
2016-02-23 21:37:50 -08:00 |
|
cnauroth
|
27b77751c1
|
HADOOP-12555. WASB to read credentials from a credential provider. Contributed by Larry McCay.
|
2016-02-22 17:30:13 -08:00 |
|
cnauroth
|
d4f5fc23b2
|
HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. Contributed by Masatake Iwasaki.
|
2016-02-22 13:39:38 -08:00 |
|
Yongjun Zhang
|
ba1c9d484a
|
HDFS-9764. DistCp doesn't print value for several arguments including -numListstatusThreads. (Wei-Chiu Chuang via Yongjun Zhang)
|
2016-02-19 10:17:37 -08:00 |
|
cnauroth
|
8ab7658025
|
HADOOP-11031. Design Document for Credential Provider API. Contributed by Larry McCay.
|
2016-02-18 14:06:38 -08:00 |
|
cnauroth
|
76fab26c5c
|
HADOOP-12548. Read s3a creds from a Credential Provider. Contributed by Larry McCay.
|
2016-02-17 12:19:59 -08:00 |
|
cnauroth
|
91a96eaa53
|
HADOOP-12780. During WASB atomic rename handle crash when one directory has been renamed but not file under it. Contributed by Madhumita Chakraborty.
|
2016-02-12 15:50:10 -08:00 |
|
Steve Loughran
|
29ae258013
|
HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel)
|
2016-02-06 15:05:16 +00:00 |
|
Akira Ajisaka
|
700a176fa7
|
HADOOP-12757. Findbug compilation fails for 'Kafka Library support'. (aajisaka)
|
2016-02-02 23:15:39 +09:00 |
|
Yongjun Zhang
|
eddd823cd6
|
HDFS-9638. Improve DistCp Help and documentation. (Wei-Chiu Chuang via Yongjun Zhang)
|
2016-01-29 12:11:55 -08:00 |
|
cnauroth
|
41da9a0773
|
MAPREDUCE-6563. Streaming documentation contains a stray % character. Contributed by Chris Nauroth.
|
2016-01-28 14:46:01 -08:00 |
|
Xuan
|
4efdf3a979
|
YARN-4612. Fix rumen and scheduler load simulator handle killed tasks
properly. Contributed by Ming Ma.
|
2016-01-26 18:17:12 -08:00 |
|
Akira Ajisaka
|
736eb17a79
|
HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
|
2016-01-25 13:47:29 +09:00 |
|
Akira Ajisaka
|
0bae506c22
|
HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
|
2016-01-22 21:08:31 +09:00 |
|
Xuan
|
1708a4cd23
|
YARN-4611. Fix scheduler load simulator to support multi-layer network
location. Contributed by Ming Ma.
|
2016-01-20 15:41:50 -08:00 |
|
Ravi Prakash
|
1acc509b45
|
HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
|
2016-01-19 13:57:08 -08:00 |
|
Wangda Tan
|
89d1fd5dac
|
HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
|
2016-01-19 21:27:38 +08:00 |
|
Wangda Tan
|
a44ce3f14f
|
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
|
2016-01-19 09:30:04 +08:00 |
|
Wangda Tan
|
150f5ae034
|
Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
This reverts commit 3fe5728563.
Conflicts:
hadoop-yarn-project/CHANGES.txt
|
2016-01-19 09:27:36 +08:00 |
|
cnauroth
|
8bc93db2e7
|
HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
|
2016-01-18 09:08:58 -08:00 |
|
Wangda Tan
|
3fe5728563
|
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
(cherry picked from commit 805a9ed85e)
|
2016-01-18 17:06:05 +08:00 |
|
Wangda Tan
|
adf260a728
|
Revert "YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)"
This reverts commit 805a9ed85e.
|
2016-01-18 16:50:45 +08:00 |
|
Wangda Tan
|
805a9ed85e
|
YARN-4502. Fix two AM containers get allocated when AM restart. (Vinod Kumar Vavilapalli via wangda)
|
2016-01-18 11:04:25 +08:00 |
|
Yongjun Zhang
|
a9c69ebeb7
|
HDFS-9612. DistCp worker threads are not terminated after jobs are done. (Wei-Chiu Chuang via Yongjun Zhang)
|
2016-01-15 10:03:09 -08:00 |
|
Colin Patrick Mccabe
|
b1ed28fa77
|
HADOOP-8887. Use a Maven plugin to build the native code using CMake (cmccabe)
|
2016-01-14 11:02:34 -08:00 |
|
Colin Patrick Mccabe
|
8315582c4f
|
HDFS-9517. Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes (Wei-Chiu Chuang via cmccabe)
|
2016-01-13 16:28:06 -08:00 |
|
Lei Xu
|
126705f67e
|
HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei)
|
2016-01-12 12:19:53 -08:00 |
|
Xiaoyu Yao
|
c2e2e13455
|
HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore.
|
2016-01-11 17:08:26 -08:00 |
|
Zhe Zhang
|
95f32015ad
|
HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng.
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
|
2016-01-11 09:46:56 -08:00 |
|
cnauroth
|
0e76f1fcea
|
HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
|
2016-01-09 22:18:11 -08:00 |
|
cnauroth
|
f0fa6d869b
|
HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
|
2016-01-08 20:18:59 -08:00 |
|
cnauroth
|
978bbdfeb2
|
HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
|
2016-01-06 11:15:59 -08:00 |
|
Ravi Prakash
|
2d16f40dab
|
HADOOP-12689. S3 filesystem operations stopped working correctly
|
2016-01-05 23:26:03 -08:00 |
|
Wangda Tan
|
a9594c61bb
|
YARN-4510. Fix SLS startup failure caused by NPE. (Bibin A Chundatt via wangda)
(cherry picked from commit 6eefae1b33928486e7a8572e14eaf00b83f2acfc)
|
2015-12-30 15:39:27 -08:00 |
|
Wangda Tan
|
8310b2e9ff
|
YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)
|
2015-12-30 15:30:12 -08:00 |
|
Wangda Tan
|
79c41b1d83
|
YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
|
2015-12-16 13:18:19 -08:00 |
|
Robert Kanter
|
6d84cc16b3
|
MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter)
|
2015-11-25 17:12:40 -08:00 |
|
Akira Ajisaka
|
bab03f3ee6
|
HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang.
|
2015-11-26 01:21:20 +09:00 |
|
Karthik Kambatla
|
52948bb20b
|
YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)
|
2015-11-24 13:47:17 +05:30 |
|
Haohui Mai
|
dc46c46b91
|
HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux.
|
2015-11-22 18:10:08 -08:00 |
|
Haohui Mai
|
0d27917042
|
HADOOP-12098. Remove redundant test dependencies in Hadoop Archives. Contributed by Varun Saxena.
|
2015-11-22 17:25:22 -08:00 |
|
Haohui Mai
|
176ff5ce90
|
HDFS-9402. Switch DataNode.LOG to use slf4j. Contributed by Walter Su.
|
2015-11-22 15:54:41 -08:00 |
|
Akira Ajisaka
|
f94d892704
|
HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad.
|
2015-11-13 21:52:57 +09:00 |
|
Akira Ajisaka
|
3ae82863f0
|
HADOOP-12553. [JDK8] Fix javadoc error caused by illegal tag. (aajisaka)
|
2015-11-08 19:17:57 +09:00 |
|
Lei Xu
|
bff7c90a56
|
HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)
|
2015-11-05 18:35:15 -08:00 |
|
Allen Wittenauer
|
19a0c2660c
|
MAPREDUCE-1125. SerialUtils.cc: deserializeFloat is out of sync with SerialUtils.hh (Simone Leo via aw)
|
2015-11-05 16:57:22 -08:00 |
|
Allen Wittenauer
|
fc7cd46faf
|
MAPREDUCE-3914. Mismatched free() / delete / delete [] in HadoopPipes (Joe Mudd via aw)
|
2015-11-05 16:53:32 -08:00 |
|
cnauroth
|
0fb1867fd6
|
HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade.
|
2015-11-04 10:28:44 -08:00 |
|
Varun Vasudev
|
73b9c7b82b
|
HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer.
|
2015-11-04 15:56:17 +05:30 |
|
cnauroth
|
9e7dcab185
|
HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade.
|
2015-11-02 10:21:39 -08:00 |
|
cnauroth
|
3ce0a6502e
|
HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth.
|
2015-11-02 10:17:41 -08:00 |
|
Kihwal Lee
|
b24fe06483
|
Addendum to MAPREDUCE-6451
|
2015-10-30 16:05:23 -05:00 |
|
Kihwal Lee
|
2868ca0328
|
MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla.
|
2015-10-30 14:56:41 -05:00 |
|
Gábor Lipták
|
18727c63da
|
HADOOP-12133 Add schemas to Maven Assembly XMLs
Signed-off-by: Allen Wittenauer <aw@apache.org>
|
2015-10-30 11:36:52 -07:00 |
|
cnauroth
|
2d10cb8e00
|
HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth.
|
2015-10-28 09:44:10 -07:00 |
|
cnauroth
|
1f7ecb0c84
|
HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu.
|
2015-10-27 22:56:22 -07:00 |
|
cnauroth
|
73822de7c3
|
HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth.
|
2015-10-27 22:48:56 -07:00 |
|
Varun Vasudev
|
c28e16b40c
|
YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt.
|
2015-10-27 20:56:00 +05:30 |
|
Akira Ajisaka
|
bcb2386e39
|
HADOOP-12515. Mockito dependency is missing in hadoop-kafka module. Contributed by Kai Zheng.
|
2015-10-27 20:17:16 +09:00 |
|
cnauroth
|
cb282d5b89
|
HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade.
|
2015-10-22 14:29:57 -07:00 |
|
cnauroth
|
47641fcbc9
|
HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade.
|
2015-10-22 12:21:32 -07:00 |
|
Robert Kanter
|
0c4af0f998
|
MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
|
2015-10-20 17:34:34 -07:00 |
|
Haohui Mai
|
da8441d0fe
|
HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu.
|
2015-10-13 15:24:24 -07:00 |
|
Haohui Mai
|
7e2c971fed
|
Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu."
This reverts commit fa5a54cac7.
|
2015-10-10 03:24:59 -07:00 |
|
Haohui Mai
|
fa5a54cac7
|
HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu.
|
2015-10-09 22:38:06 -07:00 |
|
Robert Kanter
|
1bca1bb517
|
MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter)
|
2015-10-06 16:49:50 -07:00 |
|
cnauroth
|
5f6edb30c2
|
HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth.
|
2015-10-05 20:11:41 -07:00 |
|
Allen Wittenauer
|
b59e434116
|
HADOOP-10949. metrics2 sink plugin for Apache Kafka (Babak Behzad via aw)
|
2015-10-05 14:02:07 -07:00 |
|
Akira Ajisaka
|
ecbfd68974
|
HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). Contributed by Rahul Palamuttam and Kanaka Kumar Avvaru.
|
2015-10-01 18:25:31 +02:00 |
|
Robert Kanter
|
5db371f52f
|
MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter)
|
2015-09-30 17:33:53 -07:00 |
|
Kihwal Lee
|
3abbdc929b
|
HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu.
|
2015-09-28 17:31:51 -05:00 |
|
Harsh J
|
66dad854c0
|
MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian.
|
2015-09-28 13:12:43 +05:30 |
|