Lokesh Jain
c1d7d68c78
HDDS-1461. Optimize listStatus api in OzoneFileSystem ( #782 )
2019-05-21 14:47:48 +05:30
Inigo Goiri
1cb2eb0df3
HDFS-14353. Erasure Coding: metrics xmitsInProgress become to negative. Contributed by maobaolong.
2019-05-20 17:22:58 -07:00
Vivek Ratnavel Subramanian
05db2a598e
HDDS-1487. Bootstrap React framework for Recon UI ( #831 )
...
HDDS-1487. Bootstrap React framework for Recon UI.
Contributed by Vivek Ratnavel Subramanian.
2019-05-20 22:09:58 +02:00
avijayanhwx
f63300228e
HDDS-1451 : SCMBlockManager findPipeline and createPipeline are not lock protected. ( #799 )
...
* HDDS-1451 : SCMBlockManager findPipeline and createPipeline are not lock protected.
* HDDS-1451 : Address review comments.
2019-05-20 22:02:56 +02:00
Sunil G
24c53e057a
YARN-9546. Add configuration option for YARN Native services AM classpath. Contributed by Gergely Pollak.
2019-05-20 10:53:01 -04:00
Bharat Viswanadham
0d1d7c86ec
HDDS-1499. OzoneManager Cache. ( #798 )
2019-05-19 19:23:02 -07:00
Ben Roling
a36274d699
HADOOP-16085. S3Guard: use object version or etags to protect against inconsistent read after replace/overwrite.
...
Contributed by Ben Roling.
S3Guard will now track the etag of uploaded files and, if an S3
bucket is versioned, the object version.
You can then control how to react to a mismatch between the data
in the DynamoDB table and that in the store: warn, fail, or, when
using versions, return the original value.
This adds two new columns to the table: etag and version.
This is transparent to older S3A clients -but when such clients
add/update data to the S3Guard table, they will not add these values.
As a result, the etag/version checks will not work with files uploaded by older clients.
For a consistent experience, upgrade all clients to use the latest hadoop version.
2019-05-19 22:29:54 +01:00
Zhankun Tang
729ccb2cab
SUBMARINE-58. Submarine client needs to generate fat jar. Contributed by Zac Zhou.
2019-05-19 21:18:33 +08:00
Arpit Agarwal
732133cb2a
HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit A… ( #725 )
...
* HDDS-1422. Exception during DataNode shutdown. Contributed by Arpit Agarwal.
Change-Id: I6db6bdd19839a45e5341ed7e745cd38f68af8378
* Suppress spurious findbugs warning.
* Remove log file that got committed in error
2019-05-18 11:47:19 +02:00
Giovanni Matteo Fumarola
12c81610e0
YARN-9505. Add container allocation latency for Opportunistic Scheduler. Contributed by Abhishek Modi.
2019-05-17 12:03:21 -07:00
Srinivasu Majeti
3e5e5b028a
HDFS-14323. Distcp fails in Hadoop 3.x when 2.x source webhdfs url has special characters in hdfs file path. Contributed by Srinivasu Majeti.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-05-17 19:20:28 +02:00
Alexis Daboville
4cb3da6ac7
HADOOP-16248. MutableQuantiles leak memory under heavy load.
...
Contributed by Alexis Daboville,
2019-05-17 15:15:22 +01:00
Siddharth
c183bd8e20
HDDS-1527. HDDS Datanode start fails due to datanode.id file read error. Contributed by Siddharth Wagle.
...
This closes #822 .
2019-05-16 15:13:10 -07:00
Eric Yang
fab5b80a36
YARN-9554. Fixed TimelineEntity DAO serialization handling.
...
Contributed by Prabhu Joseph
2019-05-16 16:39:50 -04:00
Márton Elek
03ea8ea92e
HDDS-1297. Fix IllegalArgumentException thrown with MiniOzoneCluster Initialization. Contributed by Yiqun Lin.
2019-05-16 17:04:46 +02:00
Márton Elek
9248b7d58b
HDDS-1284. Adjust default values of pipline recovery for more resilient service restart.
2019-05-16 17:04:46 +02:00
Sahil Takiar
b067f8acaa
HADOOP-16050: s3a SSL connections should use OpenSSL
...
(cherry picked from commit aebf229c175dfa19fff3b31e9e67596f6c6124fa)
2019-05-16 08:57:54 -06:00
Elek, Márton
b7de735159
HDDS-1522. Provide intellij runConfiguration for Ozone components. Contributed by Elek, Marton.
2019-05-16 16:38:50 +02:00
Andrew Olson
c15b3bca86
HADOOP-16294: Enable access to input options by DistCp subclasses.
...
Adding a protected-scope getter for the DistCpOptions, so that a subclass does
not need to save its own copy of the inputOptions supplied to its constructor,
if it wishes to override the createInputFileListing method with logic similar
to the original implementation, i.e. calling CopyListing#buildListing with a path and input options.
Author: Andrew Olson
2019-05-16 16:11:12 +02:00
David Mollitor
2713dcf6e9
HADOOP-16307. Intern User Name and Group Name in FileStatus.
...
Author: David Mollitor
2019-05-16 16:02:07 +02:00
Shashikant Banerjee
e66ecc564a
HDDS-1531. Disable the sync flag by default during chunk writes in Datanode ( #820 ). Contributed by Shashikant Banerjee.
2019-05-16 18:38:52 +05:30
Sunil G
de01422c2e
SUBMARINE-56. Update documentation to describe single-node PyTorch integration. Contributed by Szilard Nemeth.
2019-05-15 21:26:48 -07:00
Bharat Viswanadham
d4c8858586
HADOOP-16247. NPE in FsUrlConnection. Contributed by Karthik Palanisamy.
2019-05-15 17:41:36 -07:00
Virajith Jalaparti
77170e70d1
HDFS-14390. Provide kerberos support for AliasMap service used by Provided storage. Contributed by Ashvin Agrawal
2019-05-15 12:15:47 -07:00
Giovanni Matteo Fumarola
55bd35921c
YARN-9552. FairScheduler: NODE_UPDATE can cause NoSuchElementException. Contributed by Peter Bacsko.
2019-05-15 11:50:46 -07:00
supratimdeka
9569015802
HDDS-1511. Space tracking for Open Containers in HDDS Volumes. Contributed by Supratim Deka ( #812 )
2019-05-15 10:26:01 -07:00
bibinchundatt
570fa2da20
YARN-9508. YarnConfiguration areNodeLabel enabled is costly in allocation flow. Contributed by Bilwa S T.
2019-05-15 13:30:09 +05:30
bibinchundatt
2de1e30658
YARN-9547. ContainerStatusPBImpl default execution type is not returned. Contributed by Bilwa S T.
2019-05-15 13:21:39 +05:30
Weiwei Yang
2d8282bb82
HADOOP-16306. AliyunOSS: Remove temporary files when upload small files to OSS. Contributed by wujinhu.
2019-05-14 14:05:39 -07:00
Sahil Takiar
e2dfdaee7c
HDFS-14482: Crash when using libhdfs with bad classpath
2019-05-14 11:04:06 -07:00
Sunil G
7d831eca64
YARN-9519. TFile log aggregation file format is not working for yarn.log-aggregation.TFile.remote-app-log-dir config. Contributed by Adam Antal.
2019-05-14 10:48:08 -07:00
Lokesh Jain
6bcc1dce52
HDDS-1503. Reduce garbage generated by non-netty threads in datanode ratis server ( #813 )
2019-05-14 14:49:50 +05:30
Hanisha Koneru
02c9efcb81
HDDS-1491. Ozone KeyInputStream seek() should not read the chunk file. ( #795 )
2019-05-13 20:49:52 -07:00
Inigo Goiri
389e640f0c
HADOOP-16161. NetworkTopology#getWeightUsingNetworkLocation return unexpected result. Contributed by He Xiaoqiao.
2019-05-13 11:46:16 -07:00
Giovanni Matteo Fumarola
206e633946
YARN-9453. Clean up code long if-else chain in ApplicationCLI#run. Contributed by Wanqiang Ji.
2019-05-13 11:11:20 -07:00
Giovanni Matteo Fumarola
29ff7fb140
YARN-9493. Scheduler Page does not display the right page by query string. Contributed by Wanqiang Ji.
2019-05-13 10:57:12 -07:00
Erik Krogen
5847e00143
HDFS-14245. [SBN read] Enable ObserverReadProxyProvider to work with non-ClientProtocol proxy types. Contributed by Erik Krogen.
2019-05-13 08:39:59 -07:00
Weiwei Yang
1a47c2b7ae
YARN-9539.Improve cleanup process of app activities and make some conditions configurable. Contributed by Tao Yang.
2019-05-12 22:31:39 -07:00
DadanielZ
ff27e8eabd
HADOOP-16251. ABFS: add FSMainOperationsBaseTest. Re-commit to fix git metadata.
...
Author: Da Zhou
2019-05-10 13:57:30 -07:00
Aaron Fabbri
5f1a34649f
Revert "HADOOP-16251. ABFS: add FSMainOperationsBaseTest"
...
This reverts commit 7c2d7c05a9
.
Git Commit name and email were incorrect. Will re-commit.
2019-05-10 13:55:56 -07:00
DadanielZ
7c2d7c05a9
HADOOP-16251. ABFS: add FSMainOperationsBaseTest
...
Author: Da Zhou
2019-05-10 12:46:03 -07:00
Zhankun Tang
36267b6f7c
SUBMARINE-52. [SUBMARINE-14] Generate Service spec + launch script for single-node PyTorch learning job. Contributed by Szilard Nemeth.
2019-05-10 23:40:17 +08:00
Sunil G
64c7f36ab1
YARN-9504. [UI2] Fair scheduler queue view page does not show actual capacity. Contributed by Zoltan Siegl.
2019-05-10 14:27:23 +05:30
Vivek Ratnavel Subramanian
b832e174b0
HDDS-1474. "ozone.scm.datanode.id" config should take path for a dir and not a file ( #809 )
2019-05-09 17:11:09 -07:00
Giovanni Matteo Fumarola
1b48100a5e
YARN-9522. AppBlock ignores full qualified class name of PseudoAuthenticationHandler. Contributed by Prabhu Joseph.
2019-05-09 14:02:58 -07:00
Rajat Khandelwal
591ca69823
HADOOP-16278. With S3A Filesystem, Long Running services End up Doing lot of GC and eventually die.
...
Contributed by Rajat Khandelwal
2019-05-09 21:13:29 +01:00
Hanisha Koneru
2d31ccc1b3
Revert "HDDS-1474. ozone.scm.datanode.id config should take path for a dir ( #792 )" ( #808 )
...
This reverts commit 18cca583ac
.
2019-05-09 11:18:46 -07:00
Giovanni Matteo Fumarola
ec36126346
YARN-9483. DistributedShell does not release container when failed to localize at launch. Contributed by Prabhu Joseph.
2019-05-09 10:59:31 -07:00
Vivek Ratnavel Subramanian
18cca583ac
HDDS-1474. ozone.scm.datanode.id config should take path for a dir ( #792 )
2019-05-09 10:23:44 -07:00
Weiwei Yang
90add05caa
YARN-9489. Support filtering by request-priorities and allocation-request-ids for query results of app activities. Contributed by Tao Yang.
2019-05-09 21:54:09 +08:00