Wei-Chiu Chuang
9664b9c7a6
HADOOP-15686. Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr. Contributed by Wei-Chiu Chuang.
...
Reviewed-by: Xiaoyu Yao <xyao@apache.org>
2019-11-20 13:07:43 -08:00
Inigo Goiri
3037762b2c
HDFS-14949. Add getServerDefaults() support to HttpFS. Contributed by hemanthboyina.
2019-11-20 10:51:58 -08:00
Surendra Singh Lilhore
fd264b8265
HDFS-14995. Use log variable directly instead of passing as argument in InvalidateBlocks#printBlockDeletionTime(). Contributed by Lisheng Sun.
2019-11-21 00:00:42 +05:30
Erik Krogen
be77231452
HADOOP-16700. Track response time separately in Server.Call to avoid negative RpcQueueTime values. Contributed by xuzq.
2019-11-20 07:56:33 -08:00
Steve Loughran
1415ad3800
HADOOP-16707. NPE in UGI.getCurrentUser in ITestAbfsIdentityTransformer setup.
...
Contributed by Steve Loughran.
Change-Id: I38fdba2fa70e534d78b15e61de19368912588b0c
2019-11-20 14:32:12 +00:00
Wanqiang Ji
dfc61d8ea5
HADOOP-16719. Remove the disallowed element config within maven-checkstyle-plugin ( #1724 )
2019-11-20 16:18:56 +09:00
He Xiaoqiao
0b50aa29fd
HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Mukul Kumar Singh <msingh@apache.org>
2019-11-19 12:16:57 -08:00
Szilard Nemeth
dfdc6d6dd9
YARN-9886. Queue mapping based on userid passed through application tag. Contributed by Julia Kinga Marton
2019-11-19 21:14:15 +01:00
Eric Yang
ea8ffac121
YARN-9983. Fixed typo in YARN Service overview.
...
Contributed by Denes Gerencser
2019-11-19 14:16:51 -05:00
Surendra Singh Lilhore
c870514740
HDFS-14992. TestOfflineEditsViewer is failing in Trunk. Contributed by hemanthboyina.
2019-11-20 00:07:43 +05:30
Jeetesh Mangwani
b033c681e4
HADOOP-16612. Track Azure Blob File System client-perceived latency
...
Contributed by Jeetesh Mangwani.
This add the ability to track the end-to-end performance of ADLS Gen 2 REST APIs by measuring latency in the Hadoop ABFS driver.
The latency information is sent back to the ADLS Gen 2 REST API endpoints in the subsequent requests.
2019-11-19 09:00:24 -08:00
Steve Loughran
9fbfe6c8f9
HADOOP-16632 Speculating & Partitioned S3A magic committers can leave pending files under __magic ( #1599 )
...
Contributed by Steve Loughran.
This downgrade the checks for leftover __magic entries from fail to warn now the parallel
test runs make speculation more likely.
Change-Id: Ia4df2e90f82a06dbae69f3fdaadcbb0e0d713b38
2019-11-19 13:54:33 +00:00
Prabhu Joseph
30b2096933
YARN-9986. Allow app owner to signal container via RMWebServices. Contributed by kyungwan nam.
2019-11-19 11:35:00 +00:00
Duo Zhang
3cecb2a469
HADOOP-16110 Upgrade to yetus 0.11.1 and use emoji vote on github pre commit ( #1527 ). Contributed by Duo Zhang.
...
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
2019-11-19 14:21:49 +05:30
Sunil G
ea68756c0c
YARN-8373. RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH. Contributed by Wilfred Spiegelenburg.
2019-11-19 14:10:41 +05:30
Sunil G
215f2052fc
YARN-9984. FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node. Contributed by Wilfred Spiegelenburg.
2019-11-19 14:03:02 +05:30
Abhishek Modi
dc3f4fc2f4
YARN-9965. Fix NodeManager failing to start on subsequent times when Hdfs Auxillary Jar is set (addendum). Contributed by Prabhu Joseph.
2019-11-19 08:08:40 +05:30
Abhishek Modi
4050471b45
HADOOP-16657. Move remaining log4j APIs over to slf4j in hadoop-common. Contributed by Minni Mittal.
2019-11-19 08:01:17 +05:30
Eric Badger
0e22e9ab83
YARN-9562. Add Java changes for the new RuncContainerRuntime. Contributed by Eric Badger
2019-11-18 21:56:31 +00:00
Eric Badger
289bbca870
YARN-9561. Add C changes for the new RuncContainerRuntime. Contributed by Eric Badger
2019-11-18 21:54:16 +00:00
Szilard Nemeth
27642367ef
YARN-9011. Race condition during decommissioning. Contributed by Peter Bacsko
2019-11-18 16:29:39 +01:00
Ayush Saxena
7f811722b7
HADOOP-16712. Config ha.failover-controller.active-standby-elector.zk.op.retries is not in core-default.xml. Contributed by Xieming Li.
2019-11-18 19:00:25 +05:30
Ayush Saxena
34cb595d2e
HDFS-14967. TestWebHDFS fails in Windows. Contributed by Renukaprasad C.
2019-11-18 18:49:58 +05:30
Gabor Bota
cad540819f
HADOOP-16484. S3A to warn or fail if S3Guard is disabled - addendum: silent for S3GuardTool ( #1714 ). Contributed by Gabor Bota.
...
Change-Id: I63b928ef5da425ef982dd4100a426fc23f64bac1
2019-11-18 13:56:37 +01:00
Ayush Saxena
12617fad2e
HDFS-14955. RBF: getQuotaUsage() on mount point should return global quota. Contributed by Jinglun.
2019-11-18 16:04:52 +05:30
Ayush Saxena
3b5a0e86c1
HDFS-14974. RBF: Make tests use free ports. Contributed by Inigo Goiri.
2019-11-18 15:49:36 +05:30
prabhujoseph
bd454348b0
YARN-9982. Fix Container API example link in NodeManager REST API doc. Contributed by Charan Hebri.
2019-11-18 15:19:47 +05:30
Andras Bokor
96c4520f89
HADOOP-16710. Testing_azure.md documentation is misleading.
...
Contributed by Andras Bokor.
Change-Id: Icf07a53145936953629c7dace2e9648b7b21588d
2019-11-17 17:04:29 +00:00
Yiqun Lin
b3119b9ab6
HDFS-14648. Implement DeadNodeDetector basic model. Contributed by Lisheng Sun.
2019-11-16 11:32:41 +08:00
Hui Fei
67f2c491fe
HDFS-14802. The feature of protect directories should be used in RenameOp ( #1669 )
2019-11-15 12:35:37 -08:00
He Xiaoqiao
c892a879dd
HDFS-14882. Consider DataNode load when #getBlockLocation. Contributed by Xiaoqiao He.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Reviewed-by: Istvan Fajth <pifta@cloudera.com>
2019-11-15 12:16:31 -08:00
Sandeep Nemuri
9f0610fb83
HADOOP-16654:Delete hadoop-ozone and hadoop-hdds subprojects from apache trunk
...
Signed-off-by: Dinesh Chitlangia <dineshchitlangia@gmail.com>
2019-11-15 14:53:28 -05:00
Erik Krogen
b2cc8b6b4a
HDFS-14973. More strictly enforce Balancer/Mover/SPS throttling of getBlocks RPCs to NameNodes. Contributed by Erik Krogen.
2019-11-15 10:10:37 -08:00
Akira Ajisaka
92c28c100e
HADOOP-15097. AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path. Contributed by Xieming Li.
2019-11-15 13:49:57 +09:00
belugabehr
d0302d3849
HADOOP-16691. Unify Logging in UserGroupInformation.
...
Unify Logging in UserGroupInformation.
2019-11-14 10:28:26 -08:00
Lukas Majercak
c73334a924
HADOOP-16705. MBeanInfoBuilder puts unnecessary memory pressure on the system with a debug log.
...
MBeanInfoBuilder's get() method DEBUG logs all the MBeanAttributeInfo attributes that it gathered. This can have a high memory churn that can be easily avoided.
2019-11-14 09:54:02 -08:00
Steve Loughran
a139a87610
HADOOP-16708. HadoopExecutors cleanup to only log at debug.
...
Contributed by David Mollitor.
Change-Id: Ib501a3ed6ed299ccd3c773c4dc086441a5728e73
2019-11-14 17:51:39 +00:00
Surendra Singh Lilhore
73a386ab76
HADOOP-16585. [Tool:NNloadGeneratorMR] Multiple threads are using same id for creating file LoadGenerator#write. Contributed by Ranith Sardar.
2019-11-14 01:45:46 +05:30
Erik Krogen
586defe711
HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.
2019-11-13 11:46:35 -08:00
Xudong Cao
df6b3162c1
HADOOP-16677. Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. ( #1687 )
2019-11-12 14:19:39 -08:00
Chao Sun
97ec34e117
HDFS-14959: [SBNN read] access time should be turned off ( #1706 ) Contributed by Chao Sun.
2019-11-12 11:35:50 -08:00
Siyao Meng
3ab98eefa5
HADOOP-16656. Document FairCallQueue configs in core-default.xml. Contributed by Siyao Meng.
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2019-11-12 11:34:24 -08:00
Inigo Goiri
40150da1e1
HDFS-14922. Prevent snapshot modification time got change on startup. Contributed by hemanthboyina.
2019-11-12 10:53:54 -08:00
Steve Loughran
990063d2af
HADOOP-16665. Filesystems to be closed if they failed during initialize().
...
Contributed by Steve Loughran.
This FileSystem instantiation so if an IOException or RuntimeException is
raised in the invocation of FileSystem.initialize() then a best-effort
attempt is made to close the FS instance; exceptions raised that there
are swallowed.
The S3AFileSystem is also modified to do its own cleanup if an
IOException is raised during its initialize() process, it being the
FS we know has the "potential" to leak threads, especially in
extension points (e.g AWS Authenticators) which spawn threads.
Change-Id: Ib84073a606c9d53bf53cbfca4629876a03894f04
2019-11-12 18:17:21 +00:00
Yufei Gu
b83b9ab418
YARN-9537. Add configuration to disable AM preemption. Contributed by ZhouKang
2019-11-12 09:40:16 -08:00
Steve Loughran
f6697aa82b
HADOOP-16477. S3A delegation token tests fail if fs.s3a.encryption.key set.
...
Contributed by Steve Loughran.
Change-Id: I843989f32472bbdefbd4fa504b26c7a614ab1cee
2019-11-12 15:31:53 +00:00
Abhishek Modi
fb512f5087
YARN-9697. Efficient allocation of Opportunistic containers. Contributed by Abhishek Modi.
2019-11-12 16:34:04 +05:30
Masatake Iwasaki
a98c4dfc47
HADOOP-16702. Move documentation of hadoop-cos to under src directory.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-11-12 17:47:17 +09:00
Masatake Iwasaki
b988487cae
HADOOP-16701. Fix broken links in site index.
...
Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>
2019-11-12 16:43:52 +09:00
Szilard Nemeth
30b93f914b
YARN-9865. Capacity scheduler: add support for combined %user + %secondary_group mapping. Contributed by Manikandan R
2019-11-11 13:28:02 +01:00