big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
25,245 Commits 2 Branches 2 Tags 264 MiB
60b37bbdf7
Commit Graph

150 Commits

Author SHA1 Message Date
Steve Loughran
35e04ff52a
HADOOP-18470. Remove HDFS RBF text in the 3.3.5 index.md file 
+ add a link to mukund's apachecon talk

Change-Id: I3d04b385ff1312aabf2a81d034f54f124d544a54
 2023-02-23 13:26:54 +00:00
Steve Loughran
cd2401d2cc
HADOOP-18470. More in the 3.3.5 index.html about security (#5383) 
Expands on the comments in cluster config to tell people
they shouldn't be running a cluster without a private VLAN
in cloud, that Knox is good here, and unsecured clusters
without a VLAN are just computation-as-a-service to crypto miners

Contributed by Steve Loughran
 2023-02-14 17:25:20 +00:00
Steve Loughran
cda1d45a61
HADOOP-18470. Update index md with section on ABFS prefetching 2022-12-19 13:03:57 +00:00
Steve Loughran
36889005f7
HADOOP-18470. index.md update for 3.3.5 release 2022-12-05 16:22:40 +00:00
Steve Loughran
c70b8709cc
HADOOP-18442. Remove openstack support (#4855) 
The swift:// connector for openstack support has been removed.
The hadoop-openstack jar remains, only now it is empty of code. 
This is to ensure that projects which declare the JAR a dependency
will still have successful builds.

Contributed by Steve Loughran
 2022-10-07 12:03:08 +01:00
Steve Loughran
8ccc586af6
HADOOP-17409. Remove s3guard from S3A module (#3534) 
Completely removes S3Guard support from the S3A codebase.

If the connector is configured to use any metastore other than
the null and local stores (i.e. DynamoDB is selected) the s3a client
will raise an exception and refuse to initialize.

This is to ensure that there is no mix of S3Guard enabled and disabled
deployments with the same configuration but different hadoop releases
-it must be turned off completely.

The "hadoop s3guard" command has been retained -but the supported
subcommands have been reduced to those which are not purely S3Guard
related: "bucket-info" and "uploads".

This is major change in terms of the number of files
changed; before cherry picking subsequent s3a patches into
older releases, this patch will probably need backporting
first.

Goodbye S3Guard, your work is done. Time to die.

Contributed by Steve Loughran.
 2022-01-18 18:04:48 +00:00
Masatake Iwasaki
cc42f5dafd HADOOP-17538. Add kms-default.xml and httpfs-default.xml to site index. (#2716) 
(cherry picked from commit e9a3c2950e)
 2021-02-23 22:55:10 +00:00
Uma Maheswara Rao G
418580446b HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide. Contributed by Uma Maheswara Rao G. 
(cherry picked from commit 76fa0222f0)
 2020-06-16 16:54:01 -07:00
Zhankun Tang
d40d7cc4f9 HADOOP-16670. Stripping Submarine code from Hadoop codebase. Contributed by Zhankun Tang. 
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2020-01-21 20:07:31 -08:00
Eric Badger
0e22e9ab83 YARN-9562. Add Java changes for the new RuncContainerRuntime. Contributed by Eric Badger 2019-11-18 21:56:31 +00:00
Masatake Iwasaki
a98c4dfc47 HADOOP-16702. Move documentation of hadoop-cos to under src directory. 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-11-12 17:47:17 +09:00
Masatake Iwasaki
b988487cae HADOOP-16701. Fix broken links in site index. 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-11-12 16:43:52 +09:00
Sammi Chen
8a9ede5cff HADOOP-15616. Incorporate Tencent Cloud COS File System Implementation. Contributed by Yang Yu. 2019-09-27 16:53:13 +08:00
Yiqun Lin
5043840b1d HDFS-14410. Make Dynamometer documentation properly compile onto the Hadoop site. Contributed by Erik Krogen. 2019-07-11 23:47:27 +08:00
Akira Ajisaka
48d7f00da8
HDFS-14590. [SBN Read] Add the document link to the top page. Contributed by Takanobu Asanuma. 2019-06-25 19:11:09 +09:00
Wanqiang Ji
eb6be4643f YARN-9630. [UI2] Add a link in docs's top page 
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
 2019-06-18 14:54:21 +09:00
Yiqun Lin
7b11b404a3 HADOOP-16097. Provide proper documentation for FairCallQueue. Contributed by Erik Krogen. 2019-02-13 11:16:04 +08:00
Akira Ajisaka
eee29ed706
HADOOP-16009. Replace the url of the repository in Apache Hadoop source code. 2018-12-31 06:28:24 +09:00
Sunil G
19ad5be651 YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan. 2018-09-29 00:01:04 +05:30
Weiwei Yang
1e7d6e55a5 YARN-7865. Node attributes documentation. Contributed by Naganarasimha G R. 2018-09-12 16:01:01 +05:30
Akira Ajisaka
418cc7f3ae
HDFS-13729. Fix broken links to RBF documentation. Contributed by Gabor Bota. 2018-07-11 14:46:43 -04:00
Xiaoyu Yao
7846636a5d HDFS-12551. Ozone: Documentation: Add Ozone overview documentation. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Weiwei Yang
c398ab49d3 HDFS-12047. Ozone: Add REST API documentation. Contributed by Weiwei Yang. 2018-04-26 05:36:04 -07:00
Yiqun Lin
52aa60ed2f HDFS-11963. Ozone: Documentation: Add getting started page (addendum). Contributed by Yiqun Lin. 2018-04-26 05:36:04 -07:00
Anu Engineer
8d289df627 HDFS-11963. Ozone: Documentation: Add getting started page. Contributed by Anu Engineer. 2018-04-26 05:36:04 -07:00
Anu Engineer
aa16380d71 HDFS-11566. Ozone: Document missing metrics for container operations. Contributed by Yiqun Lin. 2018-04-26 05:34:18 -07:00
Sunil G
427ad7ecc4 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 2018-04-17 15:08:31 +05:30
Takanobu Asanuma
7623cc5a98
HADOOP-15374. Add links of the new features of 3.1.0 to the top page 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2018-04-10 18:59:40 +09:00
weiy
6e2b5fa493 HDFS-13215. RBF: Move Router to its own module. Contributed by Wei Yan 2018-03-19 22:13:40 -07:00
Yiqun Lin
4cc9a6d9bb HADOOP-15296. Fix a wrong link for RBF in the top page. Contributed by Takanobu Asanuma. 2018-03-08 16:02:34 +08:00
Wangda Tan
31db977cb3 HADOOP-14875. Create end user documentation from the compatibility guidelines. (Daniel Templeton via wangda) 
Change-Id: I5d66d0f034874623af22aecae0a0b858b65396ed
 2018-02-17 12:28:55 +08:00
Daniel Templeton
69043ba8b5 HADOOP-14876. Create downstream developer docs from the compatibility guidelines 2017-11-15 10:03:29 -08:00
Andrew Wang
8b12574165 HADOOP-15037. Add site release notes for OrgQueue and resource types. 2017-11-13 18:49:22 -08:00
Daniel Templeton
040a38dc49 YARN-7369. Improve the resource types docs 2017-11-13 11:05:07 -08:00
Gour Saha
541b64c798 YARN-7165. Miscellaneous fixes in yarn-native-services. Contributed by Jian He 2017-11-06 13:30:15 -08:00
Jian He
7dd4490a44 YARN-7073. Yarn native services rest API documentation. Contributed by Gour Saha 2017-11-06 13:30:14 -08:00
Gour Saha
2ba38ce8ec YARN-5244. Documentation required for DNS Server implementation. Contributed by Jon Maron 2017-11-06 13:30:12 -08:00
Subru Krishnan
625039ef20 HADOOP-14840. Tool to estimate resource requirements of an application pipeline based on prior executions. (Rui Li via Subru). 2017-10-25 15:51:27 -07:00
Yiqun Lin
b90750cfb8 HDFS-12695. Add a link to HDFS router federation document in site.xml. Contributed by Yiqun Lin. 2017-10-24 10:46:09 +08:00
Chris Trezzo
e46d5bb962 MAPREDUCE-5951. Add support for the YARN Shared Cache. 2017-10-12 10:59:20 -07:00
Andrew Wang
132cdac0dd HADOOP-14939. Update project release notes with HDFS-10467 for 3.0.0. Contributed by Inigo Goiri. 2017-10-10 10:16:36 -07:00
Chris Trezzo
7e76f85bc6 YARN-2960. Add documentation for the YARN shared cache. 2017-10-05 10:38:41 -07:00
Andrew Wang
cae1c734fe HADOOP-14928. Update site release notes for 3.0.0 GA. 2017-10-04 14:59:40 -07:00
Andrew Wang
373d0a5195 HADOOP-14909. Fix the word of erasure encoding in the top page. Contributed by Takanobu Asanuma. 2017-09-29 13:34:36 -07:00
Ming Ma
ce943eb17a HDFS-11035. Better documentation for maintenace mode and upgrade domain. 2017-09-20 09:36:33 -07:00
Aaron Fabbri
49467165a5
HADOOP-14738 Remove S3N and obsolete bits of S3A; rework docs. Contributed by Steve Loughran. 2017-09-14 14:10:48 -07:00
Wangda Tan
6b88cd1901 YARN-7056. Document Resource Profiles feature. (Sunil G via wangda) 
Change-Id: I5f5d52cdf7aba4ac09684aab573e6916dbad183e
 2017-09-12 09:19:12 -07:00
Vrushali C
bea3e4df76 YARN-6047 Documentation updates for TimelineService v2 (Contributed by Rohith Sharma) 2017-08-30 11:29:54 +05:30
Subru Krishnan
d6c29b2f5b YARN-6484. Documenting the YARN Federation feature. (Carlo Curino via Subru). 
(cherry picked from commit 749ca890e6e62671b4df69d020396ec93edadf16)
 2017-08-01 17:28:25 -07:00
Masatake Iwasaki
fbc0c2bd76 YARN-4753. Use doxia macro to generate in-page TOC of YARN site documentation. (iwasakims) 2017-02-15 13:09:10 +09:00