big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
24,360 Commits 2 Branches 2 Tags 264 MiB
45434c93e8
Commit Graph

24360 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Eric E Payne
e0c9653166 YARN-1529: Add Localization overhead metrics to NM. Contributed by Jim_Brennan. 2020-07-30 15:30:22 +00:00
ywheel
cf4eb75608
MAPREDUCE-7051. Fix typo in MultipleOutputFormat (#338) 2020-07-30 13:01:22 +09:00
bibinchundatt
5d8600e80a YARN-10369. Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG. Contributed by Jim Brennan. 2020-07-29 23:26:08 +05:30
bshashikant
68287371cc
HDFS-15488. Add a command to list all snapshots for a snaphottable root with snapshot Ids. (#2166) 2020-07-29 21:33:25 +05:30
Jonathan Hung
3eaf62726f YARN-10343. Legacy RM UI should include labeled metrics for allocated, total, and reserved resources. Contributed by Eric Payne 2020-07-28 13:43:19 -07:00
bibinchundatt
5dadf963d3 YARN-10208. Add capacityScheduler metric for NODE_UPDATE interval. Contributed by Pranjal Protim Borah. 2020-07-28 11:55:47 +05:30
touchida
026dce5334
HDFS-15465. Support WebHDFS accesses to the data stored in secure Datanode through insecure Namenode. (#2135) 2020-07-27 09:55:11 -07:00
Prabhu Joseph
60a254621a YARN-10366. Fix Yarn rmadmin help message shows two labels for one node for --replaceLabelsOnNode. 
Contributed by Tanu Ajmera.
 2020-07-27 12:23:21 +05:30
Akira Ajisaka
d02be17a26
YARN-10362. Javadoc for TimelineReaderAuthenticationFilterInitializer is broken. Contributed by Xieming Li. 2020-07-27 01:55:04 +09:00
Akira Ajisaka
e277d338da
YARN-10367. Failed to get nodejs 10.21.0 when building docker image (#2171) 2020-07-27 00:51:44 +09:00
Masatake Iwasaki
4b1816c7d0
HADOOP-17153. Add boost installation steps to build instruction on CentOS 8. (#2169) 2020-07-26 06:38:54 +09:00
Eric Badger
ac5f21dbef YARN-4771. Some containers can be skipped during log aggregation after NM 
restart. Contributed by Jason Lowe and Jim Brennan.
 2020-07-24 22:35:16 +00:00
belugabehr
e60096c377
HADOOP-17141. Add Capability To Get Text Length (#2157) 
Contributed by David Mollitor
 2020-07-24 10:37:28 +01:00
Prabhu Joseph
247eb0979b YARN-10319. Record Last N Scheduler Activities from ActivitiesManager 
Reviewed by Tao Yang and Adam Antal.
 2020-07-24 11:43:31 +05:30
bibinchundatt
bfcd775381 YARN-10315. Avoid sending RMNodeResourceupdate event if resource is same. Contributed by Sushil Ks. 2020-07-23 16:41:35 +05:30
bshashikant
2d12496643
HDFS-15480. Ordered snapshot deletion: record snapshot deletion in XAttr (#2163) 2020-07-22 16:16:27 -07:00
Mehakmeet Singh
48a7c5b6ba
HADOOP-17113. Adding ReadAhead Counters in ABFS (#2154) 
Contributed by Mehakmeet Singh
 2020-07-22 18:22:30 +01:00
Akira Ajisaka
d5b4766158
HADOOP-17147. Dead link in hadoop-kms/index.md.vm. Contributed by Xieming Li. 2020-07-23 00:39:49 +09:00
Uma Maheswara Rao G
ac9a07b51a
HDFS-15478: When Empty mount points, we are assigning fallback link to self. But it should not use full URI for target fs. (#2160). Contributed by Uma Maheswara Rao G. 2020-07-21 23:29:10 -07:00
Masatake Iwasaki
1b29c9bfee
HADOOP-17138. Fix spotbugs warnings surfaced after upgrade to 4.0.6. (#2155) 2020-07-22 13:40:20 +09:00
Sneha Vijayarajan
d23cc9d85d
Hadoop 17132. ABFS: Fix Rename and Delete Idempotency check trigger 
- Contributed by Sneha Vijayarajan
 2020-07-21 09:22:38 -07:00
bilaharith
b4b23ef0d1
HADOOP-17092. ABFS: Making AzureADAuthenticator.getToken() throw HttpException 
- Contributed by Bilahari T H
 2020-07-21 09:18:54 -07:00
Inigo Goiri
8b7695bb26 HDFS-15246. ArrayIndexOfboundsException in BlockManager CreateLocatedBlock. Contributed by Hemanth Boyina. 2020-07-21 09:00:07 -07:00
Tsz-Wo Nicholas Sze
d57462f2da
HDFS-15479. Ordered snapshot deletion: make it a configurable feature (#2156) 2020-07-21 11:36:24 +05:30
Shashikant Banerjee
d9441f95c3 HDFS-15470. Added more unit tests to validate rename behaviour across snapshots. Contributed by Shashikant Banerjee. 2020-07-21 11:13:05 +05:30
Chen Liang
3833c616e0 HDFS-15404. ShellCommandFencer should expose info about source. Contributed by Chen Liang. 2020-07-20 12:49:58 -07:00
Eric Badger
736bed6d6d [YARN-10353] Log vcores used and cumulative cpu in containers monitor. 
Contributed by Jim Brennan
 2020-07-20 18:08:27 +00:00
Ayush Saxena
f2033de234 HADOOP-17119. Jetty upgrade to 9.4.x causes MR app fail with IOException. Contributed by Bilwa S T. 2020-07-20 22:13:48 +05:30
Ayush Saxena
6cbd8854ee HDFS-15381. Fix typos corrputBlocksFiles to corruptBlocksFiles. Contributed by bianqi. 2020-07-20 21:49:05 +05:30
Mukund Thakur
bb459d4dd6
HADOOP-17136. ITestS3ADirectoryPerformance.testListOperations failing (#2153) 
A regression caused by HADOOP-17022: the reduction in LIST calls broken an assertion.

Contributed by Mukund Thakur
 2020-07-20 16:58:50 +01:00
Steve Loughran
9f407bcc88
HADOOP-17107. hadoop-azure parallel tests not working on recent JDKs (#2118) 
Contributed by Steve Loughran.
 2020-07-20 10:51:26 +01:00
Tsz-Wo Nicholas Sze
2cec50cf16
HDFS-15463. Add a tool to validate FsImage. (#2140) 2020-07-20 11:44:30 +05:30
Suraj Naik
4101b0c0ed
HDFS-15476 Make AsyncStream executor private (#2151) 2020-07-19 23:26:54 +05:30
bilaharith
99655167f3
HADOOP-16682. ABFS: Removing unnecessary toString() invocations 
- Contributed by Bilahari T H
 2020-07-18 10:00:18 -07:00
Ayush Saxena
8a9a674ef1 HDFS-15198. RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode. Contributed by zhengchenyu. 2020-07-18 15:36:55 +05:30
Ayush Saxena
6bcb24d269 HADOOP-17100. Replace Guava Supplier with Java8+ Supplier in Hadoop. Contributed by Ahmed Hussein. 2020-07-18 14:33:43 +05:30
Masatake Iwasaki
2ba44a73bf
HADOOP-16866. Upgrade spotbugs to 4.0.6. (#2146) 2020-07-17 19:58:44 +09:00
Prabhu Joseph
cc71d50b21 YARN-10339. Fix TimelineClient in NodeManager failing when Simple Http Auth used in Secure Cluster 
Contributed by Tarun Parimi.
 2020-07-16 23:36:49 +05:30
Mukund Thakur
b21cb91c7f
HADOOP-17130. Configuration.getValByRegex() shouldn't be updating the results while fetching. (#2142) 
Contributed by Mukund Thakur
 2020-07-16 18:09:59 +01:00
Mehakmeet Singh
4083fd57b5
HADOOP-17129. Validating storage keys in ABFS correctly (#2141) 
Contributed by Mehakmeet Singh
 2020-07-16 17:29:37 +01:00
Ahmed Hussein
1f71c4ae71 HADOOP-17099. Replace Guava Predicate with Java8+ Predicate 
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
 2020-07-15 11:39:06 -05:00
Ahmed Hussein
98fcffe93f HADOOP-17101. Replace Guava Function with Java8+ Function 
Signed-off-by: Jonathan Eagles <jeagles@gmail.com>
 2020-07-15 09:53:18 -05:00
Masatake Iwasaki
80046d1c8a
MAPREDUCE-7285. Junit class missing from hadoop-mapreduce-client-jobclient-*-tests jar. (#2139) 2020-07-15 15:24:34 +09:00
Bilwa S T
8980c23fc2
YARN-10350. TestUserGroupMappingPlacementRule fails 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
 2020-07-15 14:31:34 +09:00
Shashikant Banerjee
85d4718ed7 HDFS-15319. Fix INode#isInLatestSnapshot() API. Contributed by Shashikant Banerjee. 2020-07-15 10:32:25 +05:30
Akira Ajisaka
3e7b65c3e5
MAPREDUCE-7284. TestCombineFileInputFormat#testMissingBlocks fails (#2136) 2020-07-15 13:46:20 +09:00
Gautham B A
cce5a6f609
HDFS-15385 Upgrade boost library to 1.72 (#2051) 
* Removed the asio-1.10.2 that was
  checked in under libhdfspp/third_party
  directory.
 2020-07-15 13:39:48 +09:00
Erik Krogen
317fe4584a HADOOP-17127. Use RpcMetrics.TIMEUNIT to initialize rpc queueTime and processingTime. Contributed by Jim Brennan. 2020-07-14 11:22:25 -07:00
Mukund Thakur
4647a60430
HADOOP-17022. Tune S3AFileSystem.listFiles() API. 
Contributed by Mukund Thakur.

Change-Id: I17f5cfdcd25670ce3ddb62c13378c7e2dc06ba52
 2020-07-14 15:27:35 +01:00
zhaoyim
bdce75d737
HDFS-15371. Nonstandard characters exist in NameNode.java (#2032) 
Contributed by zhaoyim
 2020-07-14 14:42:12 +01:00