sumangala-patki
35570e414a
HADOOP-17290. ABFS: Add Identifiers to Client Request Header ( #2520 )
...
Contributed by Sumangala Patki.
2021-07-02 19:13:20 +05:30
Mehakmeet Singh
ea259f236c
HADOOP-17774. S3A bytesRead FS statistic showing twice the correct value ( #3144 )
...
Contributed by: Mehakmeet Singh
2021-07-02 14:03:16 +01:00
litao
390f8603d3
HDFS-16106. Fix flaky unit test TestDFSShell ( #3168 )
2021-07-02 15:31:25 +08:00
zhangshuyan0
9be17339eb
HDFS-16099. Make bpServiceToActive to be volatile. ( #3159 )
...
Co-authored-by: zhangshuyan <zqingchai@gmail.com>
2021-07-01 23:52:21 +08:00
litao
52b9319e57
HDFS-16104. Remove unused parameter and fix java doc for DiskBalancerCLI ( #3160 ). Contributed by tomscut.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-07-01 18:44:10 +05:30
litao
56c7ada7a5
HDFS-16086. Add volume information to datanode log for tracing ( #3136 )
2021-06-30 22:06:56 -07:00
Gautham B A
7c999e2d9a
HADOOP-17778. CI for Centos 8 ( #3151 )
2021-06-30 22:04:54 -07:00
Viraj Jasani
d2e7003400
HDFS-16090. Fine grained lock for datanodeNetworkCounts ( #3148 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: stack Chuang <stack@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
2021-06-30 12:55:07 -07:00
Akira Ajisaka
20a4b1ae36
HADOOP-17331. [JDK 16] TestDNS fails ( #2884 )
2021-06-30 03:06:29 -07:00
Xiangyi Zhu
4cac6ec405
HDFS-16096. Delete useless method DirectoryWithQuotaFeature#setQuota ( #3156 )
...
Co-authored-by: zhuxiangyi <43412979@qq.com>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
2021-06-30 00:12:08 -07:00
Wanqiang Ji
c005195b78
HADOOP-17777. Update clover-maven-plugin version from 3.3.0 to 4.4.1 ( #3152 )
2021-06-29 18:32:16 -07:00
litao
95454d821c
HDFS-16089. Add metric EcReconstructionValidateTimeMillis for StripedBlockReconstructor ( #3146 )
2021-06-29 03:15:12 -07:00
Viraj Jasani
93a1685073
HDFS-16092. Avoid creating LayoutFlags redundant objects ( #3150 )
2021-06-29 02:31:02 -07:00
Jim Brennan
dc6f456e95
YARN-10834. Intra-queue preemption: apps that don't use defined custom resource won't be preempted. Contributed by Eric Payne.
2021-06-28 14:52:19 +00:00
Prabhu Joseph
6b4987f09c
YARN-10820. Make GetClusterNodesRequestPBImpl thread safe. Contributed by Swathi Chandrashekar.
2021-06-27 16:28:32 +05:30
Masatake Iwasaki
3788fe52da
HDFS-13916. Distcp SnapshotDiff to support WebHDFS. Contributed by Xun REN.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2021-06-26 21:04:56 +00:00
Jim Brennan
7c7d02edbd
YARN-10824. Title not set for JHS and NM webpages. Contributed by Bilwa S T.
2021-06-25 20:32:08 +00:00
Zamil Majdy
ed5d10ee48
HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt ( #3109 )
...
Contributed by Zamil Majdy.
2021-06-25 20:01:48 +01:00
He Xiaoqiao
748570b73c
Revert "HDFS-16044. Fix getListing call getLocatedBlocks even source is a directory. Contributed by ludun."
...
This reverts commit 0d07837712
.
2021-06-25 22:38:34 +08:00
Peter Bacsko
0934e783cf
YARN-10780. Optimise retrieval of configured node labels in CS queues. Contributed by Andras Gyori.
2021-06-24 20:15:10 +02:00
He Xiaoqiao
0d07837712
HDFS-16044. Fix getListing call getLocatedBlocks even source is a directory. Contributed by ludun.
2021-06-25 01:09:42 +08:00
Steve Loughran
5b7f68ac76
HADOOP-17771. S3AFS creation fails "Unable to find a region via the region provider chain." ( #3133 )
...
This addresses the regression in Hadoop 3.3.1 where if no S3 endpoint
is set in fs.s3a.endpoint, S3A filesystem creation may fail on
non-EC2 deployments, depending on the local host environment setup.
* If fs.s3a.endpoint is empty/null, and fs.s3a.endpoint.region
is null, the region is set to "us-east-1".
* If fs.s3a.endpoint.region is explicitly set to "" then the client
falls back to the SDK region resolution chain; this works on EC2
* Details in troubleshooting.md, including a workaround for Hadoop-3.3.1+
* Also contains some minor restructuring of troubleshooting.md
Contributed by Steve Loughran.
2021-06-24 16:37:27 +01:00
Ahmed Hussein
581f43dce1
HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery ( #3130 ). Contributed by Ahmed Hussein.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-24 17:57:52 +05:30
litao
f78b6d47f9
HDFS-16085. Move the getPermissionChecker out of the read lock ( #3134 ). Contributed by tomscut.
...
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-24 15:59:42 +05:30
litao
fdef2b4cca
HDFS-16076. Avoid using slow DataNodes for reading by sorting locations ( #3117 )
2021-06-24 11:27:40 +09:00
Gautham B A
ef5dbc7283
HADOOP-17766. CI for Debian 10 ( #3129 )
2021-06-23 10:02:33 -07:00
Masatake Iwasaki
11d144d228
YARN-10826. [UI2] Upgrade Node.js to v12.22.1. ( #3128 )
2021-06-23 19:33:03 +09:00
Viraj Jasani
d9fbb3c508
HDFS-16082. Atomic operations on exceptionsSinceLastBalance and failedTimesSinceLastSuccessfulBalance in Balancer ( #3127 )
2021-06-22 20:21:34 -07:00
He Xiaoqiao
10b79a26fe
HDFS-14575. LeaseRenewer#daemon threads leak in DFSClient. Contributed by Renukaprasad C.
...
Co-authored-by: Tao Yang <taoyang1@apache.org>
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-06-22 00:32:55 +08:00
Viraj Jasani
6e11461eaa
MAPREDUCE-7354. Use empty array constant present in TaskCompletionEvent to avoid creating redundant objects ( #3123 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
2021-06-21 16:46:06 +09:00
Viraj Jasani
c488abbc79
HDFS-16075. Use empty array constants present in StorageType and DatanodeInfo to avoid creating redundant objects ( #3115 )
...
Reviewed-by: Hui Fei <ferhui@apache.org>
2021-06-21 10:25:12 +09:00
litao
bdc9c8809e
HDFS-16079. Improve the block state change log ( #3120 ). Contributed by tomscut.
...
Signed-off-by: He Xiaoqiao <hexiaoqiao@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-20 17:23:11 +05:30
Viraj Jasani
d9eccb1eb3
HDFS-16080. RBF: Invoking method in all locations should break the loop after successful result ( #3121 ). Contributed by Viraj Jasani.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-20 17:19:05 +05:30
Ahmed Hussein
c255feb5d7
HDFS-16061. DFTestUtil.waitReplication can produce false positives ( #3095 ). Contributed by Ahmed Hussein.
...
Reviewed-by: Jim Brennan <jbrennan@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-20 10:22:47 +05:30
litao
c491f81a30
HDFS-16078. Remove unused parameters for DatanodeManager.handleLifeline() ( #3119 ). Contributed by tomscut.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-20 10:20:52 +05:30
LeonGao
643dfd60e4
HDFS-15842. HDFS mover to emit metrics. ( #2738 )
2021-06-19 15:39:46 -07:00
Gautham B A
51991c4907
HADOOP-17724. Add Dockerfile for Debian 10 ( #3038 )
2021-06-17 10:14:44 -07:00
Wei-Chiu Chuang
1ad674e548
HDFS-16074. Remove an expensive debug string concatenation ( #3107 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: litao <tomleescut@gmail.com>
2021-06-16 20:37:56 -07:00
hust_hhb
56d249759f
HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet ( #3065 )
2021-06-17 11:08:29 +08:00
Takanobu Asanuma
9e7c7ad129
HADOOP-17760. Delete hadoop.ssl.enabled and dfs.https.enable from docs and core-default.xml ( #3099 )
...
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
2021-06-17 09:58:47 +09:00
Szilard Nemeth
6562391737
YARN-10813. Set default capacity of root for node labels. Contributed by Andras Gyori
2021-06-16 18:55:09 +02:00
Szilard Nemeth
428478bbe2
YARN-10801. Fix Auto Queue template to properly set all configuration properties. Contributed by Andras Gyori
2021-06-16 18:26:58 +02:00
Ayush Saxena
2b304ad645
HDFS-16073. Remove redundant RPC requests for getFileLinkInfo in ClientNamenodeProtocolTranslatorPB. Contributed by lei w.
2021-06-16 15:53:12 +05:30
Jim Brennan
9a6a11c452
YARN-10767. Yarn Logs Command retrying on Standby RM for 30 times. Contributed by D M Murali Krishna Reddy.
2021-06-15 18:58:42 +00:00
Wei-Chiu Chuang
a77bf7cf07
Make upstream aware of 3.3.1 release
2021-06-15 15:43:36 +00:00
Takanobu Asanuma
839fcf7682
HDFS-16068. WebHdfsFileSystem has a possible connection leak in connection with HttpFS ( #3104 )
2021-06-15 13:20:09 +05:30
Viraj Jasani
c1bf3cb0da
HDFS-16016. BPServiceActor to provide new thread to handle IBR ( #2998 )
...
Contributed by Viraj Jasani
2021-06-14 14:23:50 -07:00
Szilard Nemeth
e31d06032b
YARN-10802. Change Capacity Scheduler minimum-user-limit-percent to accept decimal values. Contributed by Benjamin Teke
2021-06-14 22:33:04 +02:00
Siyao Meng
ebee2aed00
HDFS-16055. Quota is not preserved in snapshot INode ( #3078 )
2021-06-14 10:48:22 -07:00
Takanobu Asanuma
ae9630f580
HADOOP-17756. Increase precommit job timeout from 20 hours to 24 hours. ( #3090 )
...
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Viraj Jasani <vjasani@apache.org>
2021-06-14 10:17:39 +09:00