Szilard Nemeth
8b3c6791b1
YARN-9135. NM State store ResourceMappings serialization are tested with Strings instead of real Device objects. Contributed by Peter Bacsko
2019-07-12 17:20:42 +02:00
Szilard Nemeth
c416284bb7
YARN-9235. If linux container executor is not set for a GPU cluster GpuResourceHandlerImpl is not initialized and NPE is thrown. Contributed by Antal Balint Steinbach, Adam Antal
2019-07-12 16:51:58 +02:00
Nanda kumar
190e4349d7
HDDS-1790. Fix checkstyle issues in TestDataScrubber
...
Closes #1082
2019-07-12 14:42:29 +02:00
Nanda kumar
7b8177ba0f
HDDS-1791. Update network-tests/src/test/blockade/README.md file
...
Closes #1083
2019-07-12 14:38:22 +02:00
Steve Loughran
b15ef7dc3d
HADOOP-16384: S3A: Avoid inconsistencies between DDB and S3.
...
Contributed by Steve Loughran
Contains
- HADOOP-16397. Hadoop S3Guard Prune command to support a -tombstone option.
- HADOOP-16406. ITestDynamoDBMetadataStore.testProvisionTable times out intermittently
This patch doesn't fix the underlying problem but it
* changes some tests to clean up better
* does a lot more in logging operations in against DDB, if enabled
* adds an entry point to dump the state of the metastore and s3 tables (precursor to fsck)
* adds a purge entry point to help clean up after a test run has got a store into a mess
* s3guard prune command adds -tombstone option to only clear tombstones
The outcome is that tests should pass consistently and if problems occur we have better diagnostics.
Change-Id: I3eca3f5529d7f6fec398c0ff0472919f08f054eb
2019-07-12 13:02:25 +01:00
Shashikant Banerjee
f9fab9f22a
HDFS-14499. Misleading REM_QUOTA value with snapshot and trash feature enabled for a directory. Contributed by Shashikant Banerjee.
2019-07-12 15:42:06 +05:30
Márton Elek
9119ed07ff
HDDS-1384. TestBlockOutputStreamWithFailures is failing
...
Closes #1029
2019-07-12 11:00:03 +02:00
Hrishikesh Gadre
14c43f85de
HDDS-1752. ConcurrentModificationException while handling DeadNodeHandler event. ( #1080 )
2019-07-12 14:15:48 +05:30
supratimdeka
738fab3bff
HDDS-1754. getContainerWithPipeline fails with PipelineNotFoundException. Contributed by Supratim Deka ( #1081 )
2019-07-12 10:31:48 +05:30
Masatake Iwasaki
00dd843a1a
HDFS-14466. Add a regression test for HDFS-14323.
...
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2019-07-12 10:04:55 +09:00
Anu Engineer
cdcc205490
HDDS-1784. Missing HostName and IpAddress in the response of register command. ( #1078 )
2019-07-11 17:17:05 -07:00
Haibo Chen
9b54dd7186
YARN-9668. UGI conf doesn't read user overridden configurations on RM and NM startup. (Contributed by Jonathan Hung)
2019-07-11 13:57:08 -07:00
Chen Liang
8fb5ca3f40
HDFS-14611. Move handshake secret field from Token to BlockAccessToken. Contributed by Chen Liang.
2019-07-11 13:23:25 -07:00
Steve Loughran
6a3433bffd
HADOOP-16357. TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists.
...
Contributed by Steve Loughran.
This patch
* changes the default for the staging committer to append, as we get for the classic FileOutputFormat committer
* adds a check for the dest path being a file not a dir
* adds tests for this
* Changes AbstractCommitTerasortIT. to not use the simple parser, so fails if the file is present.
Change-Id: Id53742958ed1cf321ff96c9063505d64f3254f53
2019-07-11 18:15:34 +01:00
Inigo Goiri
5747f6cff5
HDFS-14624. When decommissioning a node, log remaining blocks to replicate periodically. Contributed by Stephen O'Donnell.
2019-07-11 08:55:44 -07:00
Yiqun Lin
5043840b1d
HDFS-14410. Make Dynamometer documentation properly compile onto the Hadoop site. Contributed by Erik Krogen.
2019-07-11 23:47:27 +08:00
Erik Krogen
32925d04d9
HDFS-14640. [Dynamometer] Fix TestDynamometerInfra failure. Contributed by Erik Krogen.
2019-07-11 08:34:39 -07:00
Erik Krogen
fc0656dd30
HADOOP-16418. [Dynamometer] Fix checkstyle and findbugs warnings. Contributed by Erik Krogen.
2019-07-11 08:29:57 -07:00
Szilard Nemeth
9cec023186
YARN-9625. UI2 - No link to a queue on the Queues page for Fair Scheduler. Contributed by Zoltan Siegl
2019-07-11 16:11:21 +02:00
Nanda kumar
0f399b0d57
HDDS-1784. Missing HostName and IpAddress in the response of register command.
2019-07-11 19:01:06 +05:30
Hrishikesh Gadre
acef5e0cec
HDDS-1201. Reporting corrupted containers info to SCM ( #1032 )
2019-07-11 14:49:58 +05:30
Akira Ajisaka
ccaa99c923
HADOOP-16381. The JSON License is included in binary tarball via azure-documentdb:1.16.2. Contributed by Sushil Ks.
2019-07-11 13:49:42 +09:00
Eric Yang
555dabf4f8
YARN-9660. Update support documentation for Docker on YARN.
...
Contributed by Peter Bacsko
2019-07-10 17:15:33 -04:00
Steve Loughran
c7b5f858a0
HADOOP-16393. S3Guard init command uses global settings, not those of target bucket.
...
Contributed by Steve Loughran.
Change-Id: I226a91ab8d7758340f8d221aa80a7abf9a0d3e8f
2019-07-10 20:57:02 +01:00
Anu Engineer
6872efcabf
HDDS-1611.[Addendum] Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. ( #973 )
...
Fixes a build break in ozone.
2019-07-10 11:28:18 -07:00
Inigo Goiri
eccc9a40de
HDFS-12703. Exceptions are fatal to decommissioning monitor. Contributed by He Xiaoqiao.
2019-07-10 11:11:52 -07:00
Ajay Yadav
cdb20adfcc
HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. ( #973 )
2019-07-10 11:03:58 -07:00
Erik Krogen
90b10a0d54
HDFS-14622. [Dynamometer] Update XML FsImage parsing logic to ignore non-INodeSection entries to fix an issue caused by the presence of Centralized Cache Management functionality. Contributed by Erik Krogen.
2019-07-10 09:59:11 -07:00
Nanda kumar
efb916457f
HDDS-1778. Fix existing blockade tests. ( #1068 )
2019-07-10 09:43:58 -07:00
Márton Elek
bbf5844968
HDDS-1525. Mapreduce failure when using Hadoop 2.7.5
...
Closes #1065
2019-07-10 15:31:28 +02:00
Márton Elek
93824886e9
HDDS-1764. Fix hidden errors in acceptance tests
...
Closes #1059
2019-07-10 13:22:51 +02:00
supratimdeka
e0fa1040af
HDDS-1748. Error message for 3 way commit failure is not verbose. Contributed by Supratim Deka ( #1051 )
2019-07-10 16:45:55 +05:30
Yiqun Lin
993dc8726b
HDFS-14632. Reduce useless #getNumLiveDataNodes call in SafeModeMonitor. Contributed by He Xiaoqiao.
2019-07-10 10:53:34 +08:00
supratimdeka
ac7a8accdf
HDDS-1603. Handle Ratis Append Failure in Container State Machine. Contributed by Supratim Deka ( #1019 )
2019-07-10 07:49:36 +05:30
Xiaoyu Yao
030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen.
2019-07-09 14:43:55 -07:00
Mukul Kumar Singh
96d0555913
HDDS-1718. Increase Ratis Leader election timeout default. Contributed by Aravindan Vijayan & Siddharth Wagle. ( #1062 )
2019-07-09 23:17:50 +05:30
pifta
1dc58c5b04
HDDS-1742. Merge ozone-perf and ozonetrace example clusters
...
Closes #1057
2019-07-09 17:21:16 +02:00
Hanisha Koneru
8861573e8c
HDDS-1717. MR Job fails as OMFailoverProxyProvider has dependency hadoop-3.2
...
Closes #1056
2019-07-09 13:22:00 +02:00
Vivek Ratnavel Subramanian
82d88a8d30
HDDS-1705. Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints. Contributed by Vivek Ratnavel Subramanian.
2019-07-08 21:06:50 -07:00
Mukul Kumar Singh
e5ffb88257
HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. ( #1050 )
...
* HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.
2019-07-08 20:24:12 -07:00
Lokesh Jain
b5d30e4914
HDDS-1750. Add block allocation metrics for pipelines in SCM. Contributed by Lokesh Jain. ( #1047 )
2019-07-09 08:42:55 +05:30
Masatake Iwasaki
738c09349e
HADOOP-16411. Fix javadoc warnings in hadoop-dynamometer.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-07-09 09:44:49 +09:00
Erik Krogen
4632708148
HDFS-14547. Improve memory efficiency of quotas when storage type quotas are not set. Contributed by Jinglun.
2019-07-08 14:46:25 -07:00
Sean Mackrory
de6b7bc67a
HADOOP-16409. Allow authoritative mode on non-qualified paths. Contributed by Sean Mackrory
2019-07-08 19:27:07 +02:00
Wei-Chiu Chuang
ec851e4db2
HDFS-12862. CacheDirective becomes invalid when NN restart or failover. Contributed by Wang XL.
2019-07-08 15:23:46 +08:00
Mukul Kumar Singh
ce91d35b29
HDDS-1728. Add metrics for leader's latency in ContainerStateMachine. Contributed by Mukul Kumar Singh. ( #1022 )
2019-07-08 12:19:16 +05:30
leosunli
9c90729486
HDFS-13694. Making md5 computing being in parallel with image loading.
2019-07-05 10:17:37 -07:00
Mukul Kumar Singh
c9c3429a16
HDDS-1758. Add replication and key deletion tests to MiniOzoneChaosCluster. Contributed by Mukul Kumar Singh. ( #1049 )
2019-07-05 17:04:40 +05:30
Zhankun Tang
928edb2c47
SUBMARINE-94. Support different docker images for
...
job types in Tony Runtime.
Contributed by Keqiu Hu.
2019-07-05 14:28:09 +08:00
Inigo Goiri
c3ca348b81
HDFS-14620. RBF: Fix 'not a super user' error when disabling a namespace in kerberos with superuser principal. Contributed by luhuachao.
2019-07-04 11:21:55 -07:00