hadoop/hadoop-common-project/hadoop-common/src/site/markdown
Steve Loughran f365957c63
HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile();
S3A to implement S3 Select through this API.

The new openFile() API is asynchronous, and implemented across FileSystem and FileContext.

The MapReduce V2 inputs are moved to this API, and you can actually set must/may
options to pass in.

This is more useful for setting things like s3a seek policy than for S3 select,
as the existing input format/record readers can't handle S3 select output where
the stream is shorter than the file length, and splitting plain text is suboptimal.
Future work is needed there.

In the meantime, any/all filesystem connectors are now free to add their own filesystem-specific
configuration parameters which can be set in jobs and used to set filesystem input stream
options (seek policy, retry, encryption secrets, etc).

Contributed by Steve Loughran
2019-02-05 11:51:02 +00:00
..
filesystem HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile(); 2019-02-05 11:51:02 +00:00
registry HADOOP-15821. Move YARN Registry to Hadoop Registry. 2018-10-19 19:46:48 -04:00
release Make 3.2.0 aware to other branches 2019-01-21 21:24:51 +05:30
AdminCompatibilityGuide.md HADOOP-14875. Create end user documentation from the compatibility guidelines. (Daniel Templeton via wangda) 2018-02-17 12:28:55 +08:00
Benchmarking.md HADOOP-13616. Broken code snippet area in Hadoop Benchmarking. Contributed by Kai Sasaki. 2016-09-15 23:42:34 +09:00
CLIMiniCluster.md.vm HADOOP-15166 CLI MiniCluster fails with ClassNotFoundException o.a.h.yarn.server.timelineservice.collector.TimelineCollectorManager. Contributed by Gera Shegalov 2018-01-19 16:15:55 -08:00
ClusterSetup.md YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang) 2017-03-06 14:02:49 -08:00
CommandsManual.md HADOOP-15885. Add base64 (urlString) support to DTUtil. Contributed by Inigo Goiri. 2018-11-02 10:54:12 -07:00
Compatibility.md HADOOP-15706. Typo in compatibility doc: SHOUD -> SHOULD 2018-08-30 09:12:36 -07:00
CredentialProviderAPI.md HADOOP-15855. Review hadoop credential doc, including object store details. 2018-10-30 15:58:04 +00:00
DeprecatedProperties.md HADOOP-14324. Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnostics. Contributed by Steve Loughran 2017-04-20 17:13:36 -07:00
DownstreamDev.md HADOOP-14876. Create downstream developer docs from the compatibility guidelines 2017-11-15 10:03:29 -08:00
FileSystemShell.md HADOOP-9214. Create a new touch command to allow modifying atime and mtime. Contributed by Hrishikesh Gadre. 2018-08-17 11:18:09 -07:00
GroupsMapping.md HADOOP-15950. Failover for LdapGroupsMapping. Contributed by Lukas Majercak. 2018-12-03 12:10:05 -08:00
HttpAuthentication.md HADOOP-15328. Fix the typo in HttpAuthentication.md. Contributed by fang zhenyi 2018-04-09 16:37:49 -07:00
InterfaceClassification.md HADOOP-15705. Typo in the definition of "stable" in the interface classification 2018-08-29 13:59:32 -07:00
Metrics.md HADOOP-15481. Emit FairCallQueue stats as metrics. Contributed by Christopher Gregorian. 2019-01-11 14:01:23 -08:00
NativeLibraries.md.vm HADOOP-13578. Add Codec for ZStandard Compression. Contributed by churro morales 2017-01-04 14:46:25 +00:00
RackAwareness.md HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation 2017-04-18 17:14:22 +09:00
SecureMode.md HADOOP-15996. Improved Kerberos username mapping strategy in Hadoop. 2019-01-04 17:54:15 -05:00
ServiceLevelAuth.md HADOOP-14702. Fix formatting issue and regression caused by conversion from APT to Markdown. Contributed by Doris Gu. 2017-08-02 06:06:25 +00:00
SingleCluster.md.vm MAPREDUCE-7165. mapred-site.xml is misformatted in single node setup document. Contributed by Zhaohui Xin. 2018-11-30 13:13:23 +09:00
Superusers.md HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 2016-03-04 14:11:36 +09:00
Tracing.md HADOOP-14053. Update the link to HTrace SpanReceivers. Contributed by Yiqun Lin. 2017-02-04 10:58:08 +09:00
UnixShellGuide.md HADOOP-13595. Rework hadoop_usage to be broken up by clients/daemons/etc. Contributed by Allen Wittenauer. 2017-08-02 12:25:05 -06:00