big-data/hadoop
big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Projects Wiki Activity
22,998 Commits 2 Branches 2 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Steve Loughran 1921e94292
HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3 
Contributed by Steve Loughran.

Includes
-S3A glob scans don't bother trying to resolve symlinks
-stack traces don't get lost in getFileStatuses() when exceptions are wrapped
-debug level logging of what is up in Globber
-Contains HADOOP-13373. Add S3A implementation of FSMainOperationsBaseTest.
-ITestRestrictedReadAccess tests incomplete read access to files.

This adds a builder API for constructing globbers which other stores can use
so that they too can skip symlink resolution when not needed.

Change-Id: I23bcdb2783d6bd77cf168fdc165b1b4b334d91c7
2019-10-01 18:11:05 +01:00
.github
HADOOP-15184. Add GitHub pull request template. (#1419)
2019-09-11 11:10:11 +09:00
dev-support
HADOOP-16589. [pb-upgrade] Update docker image to make 3.7.1 protoc as default (#1482). Contributed by Vinayakumar B.
2019-09-21 10:07:26 +05:30
hadoop-assemblies
HADOOP-16534. Exclude submarine from hadoop source build. (#1356)
2019-09-03 17:40:38 +05:30
hadoop-build-tools
HADOOP-16331. Fix ASF License check in pom.xml
2019-05-29 17:25:13 +09:00
hadoop-client-modules
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 (#1432)
2019-09-20 16:08:30 +05:30
hadoop-cloud-storage-project
HADOOP-15616. Incorporate Tencent Cloud COS File System Implementation. Contributed by Yang Yu.
2019-09-27 16:53:13 +08:00
hadoop-common-project
HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3
2019-10-01 18:11:05 +01:00
hadoop-dist
HDFS-14639. [Dynamometer] Remove unnecessary duplicate directory from the distribution. Contributed by Erik Krogen.
2019-07-29 13:50:14 -07:00
hadoop-hdds
HDDS-2166. Some RPC metrics are missing from SCM prometheus endpoint
2019-10-01 18:01:51 +02:00
hadoop-hdfs-project
HDFS-14492. Snapshot memory leak. Contributed by Wei-Chiu Chuang. (#1370)
2019-10-01 21:16:46 +05:30
hadoop-mapreduce-project
HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3
2019-10-01 18:11:05 +01:00
hadoop-maven-plugins
HADOOP-16331. Fix ASF License check in pom.xml
2019-05-29 17:25:13 +09:00
hadoop-minicluster
HADOOP-16331. Fix ASF License check in pom.xml
2019-05-29 17:25:13 +09:00
hadoop-ozone
HDDS-2205. checkstyle.sh reports wrong failure count
2019-09-30 16:32:38 -07:00
hadoop-project
HADOOP-15616. Incorporate Tencent Cloud COS File System Implementation. Contributed by Yang Yu.
2019-09-27 16:53:13 +08:00
hadoop-project-dist
Make upstream aware of 3.2.1 release.
2019-09-23 06:20:54 +00:00
hadoop-submarine
SUBMARINE-45. Can't specify queue by using the parameter --queue. Contributed by Ayush Saxena, Zac Zhou.
2019-08-15 13:18:29 +08:00
hadoop-tools
HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3
2019-10-01 18:11:05 +01:00
hadoop-yarn-project
YARN-9801. SchedConfCli does not work wiwith https mode. Contributed by Prabhu Joseph
2019-10-01 20:06:21 +05:30
licenses
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
licenses-binary
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
.gitattributes
…
.gitignore
HDDS-1115. Provide ozone specific top-level pom.xml.
2019-02-24 14:40:52 -08:00
BUILDING.txt
HADOOP-16557. [pb-upgrade] Upgrade protobuf.version to 3.7.1 (#1432)
2019-09-20 16:08:30 +05:30
Jenkinsfile
HADOOP-16183. Use latest Yetus to support ozone specific build process
2019-05-02 16:48:30 +02:00
LICENSE-binary
HADOOP-16555. Update commons-compress to 1.19. (#1425) Contributed by YiSheng Lien.
2019-09-14 02:11:04 +08:00
LICENSE.txt
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
NOTICE-binary
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
NOTICE.txt
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
pom.ozone.xml
HDDS-2149. Replace findbugs with spotbugs
2019-09-26 22:56:05 -07:00
pom.xml
HADOOP-15184. Add GitHub pull request template. (#1419)
2019-09-11 11:10:11 +09:00
README.txt
HADOOP-15958. Revisiting LICENSE and NOTICE files.
2019-08-27 13:47:12 +09:00
start-build-env.sh
HADOOP-16240. start-build-env.sh can consume all disk space during image creation.
2019-04-10 08:48:11 -07:00

README.txt 

For the latest information about Hadoop, please visit our website at:

   http://hadoop.apache.org/

and our wiki, at:

   https://cwiki.apache.org/confluence/display/HADOOP/
Description
No description provided
big-datahadoopjava
Readme 264 MiB
Languages
Java 92.9%
C++ 2.8%
C 1.8%
JavaScript 1.1%
Shell 0.5%
Other 0.6%