big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • ddb805951e
         HDFS-17471. Correct the percentage of sample range. (#6742). Contributed by fuchaohong. fuchaohong 2024-04-30 12:18:47 +0800
  • 78987a71a6
         HADOOP-19151. Support configurable SASL mechanism. (#6740) Tsz-Wo Nicholas Sze 2024-04-29 10:02:23 -0700
  • a6f2c4617e
         HADOOP-19150: [ABFS] Fixing Test Code for ITestAbfsRestOperationException#testAuthFailException (#6756) Anuj Modi 2024-04-29 22:18:34 +0530
  • aa169e1093
         HADOOP-19159. S3A. Fix documentation of fs.s3a.committer.abort.pending.uploads (#6778) Xi Chen 2024-04-29 22:49:35 +0800
  • 08419c4233
         YARN-11675. Update MemoryResourceHandler implementation for cgroup v2 support (#6760) Peter Szucs 2024-04-29 16:26:18 +0200
  • daafc8a0b8
         HDFS-17367. Add PercentUsed for Different StorageTypes in JMX (#6735) Contributed by Hualong Zhang. zhtttylz 2024-04-27 20:36:11 +0800
  • 88ad7db80d
         HADOOP-19071. Update maven-surefire-plugin from 3.0.0 to 3.2.5. (#6664) Contributed by Shilun Fan. slfan1989 2024-04-27 20:30:21 +0800
  • 027b4c3259
         Remove empty queues from the queueByBlockId map (#6772) dannytbecker 2024-04-26 14:25:15 -0700
  • 399299104c
         YARN-11674. Add CPUResourceHandler for cgroup v2. (#6751) Benjamin Teke 2024-04-26 15:00:00 +0200
  • 579b3bcea9
         YARN-11690. Update container executor to use CGROUP2_SUPER_MAGIC in cgroup 2 scenarios (#6771) Benjamin Teke 2024-04-26 13:21:29 +0200
  • ecf665c6fa
         YARN-11191. Fix potentional deadlock in GlobalScheduler refreshQueues (#6732) Tamas Domok 2024-04-24 14:58:50 +0200
  • 5d0a40c143
         YARN-11672. Create a CgroupHandler implementation for cgroup v2 (#6734) Benjamin Teke 2024-04-24 11:33:50 +0200
  • 23286b0632
         HDFS-17469. Audit log for reportBadBlocks RPC (#6731) cxzl25 2024-04-24 09:39:57 +0800
  • 782c501441
         HDFS-17451. RBF: fix spotbugs for redundant nullcheck of dns. (#6697) Jian Zhang 2024-04-23 19:11:51 +0800
  • 6404692c09
         HADOOP-19102. [ABFS] FooterReadBufferSize should not be greater than readBufferSize (#6617) Pranav Saxena 2024-04-22 23:06:12 +0530
  • eec9cd2997
         HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 (#6629). Contributed by Ayush Saxena Ayush Saxena 2024-04-22 21:55:58 +0530
  • a386ac1f56
         YARN-11684. Fix general contract violation in PriorityQueueComparator. (#6725) Contributed by Tamas Domok. Tamas Domok 2024-04-19 02:37:05 +0200
  • e8b2c28dec
         HDFS-17478. FSPermissionChecker optimization by initializing AccessControlEnforcer in constructor (#6749) Madhan Neethiraj 2024-04-18 15:43:31 -0700
  • 0c35cf0982
         HDFS-17477. IncrementalBlockReport race condition additional edge cases (#6748) dannytbecker 2024-04-18 09:04:08 -0700
  • 922c44a339
         HADOOP-19130. FTPFileSystem rename with full qualified path broken (#6678). Contributed by shawn zj619 2024-04-18 01:42:38 +0800
  • 87cc2f1a1f
         HDFS-17465. RBF: Use ProportionRouterRpcFairnessPolicyController get “'ava.Lang. Error: Maximum permit count exceeded' (#6727) 章锡平 2024-04-16 00:28:05 +0800
  • f49a4df797
         HDFS-17383:Datanode current block token should come from active NameNode in HA mode (#6562). Contributed by lei w. Lei313 2024-04-15 18:35:53 +0800
  • 1c64c6aa3c
         增加hdfs删除目录代码注释 zeekling 2024-04-13 23:45:19 +0800
  • bd1a08b2cf
         HADOOP-19129: [ABFS] Test Fixes and Test Script Bug Fixes (#6676) Anuj Modi 2024-04-12 22:22:47 +0530
  • 6ccb223c9c
         HDFS-17461. Fix spotbugs in PeerCache#getInternal (#6721). Contributed by Haiyang Hu. huhaiyang 2024-04-12 19:53:25 +0800
  • d194ad0242
         HADOOP-19079. HttpExceptionUtils to verify that loaded class is really an exception before instantiation (#6557) PJ Fanning 2024-04-11 20:38:15 +0200
  • 81b05977f2
         HDFS-17455. Fix Client throw IndexOutOfBoundsException in DFSInputStream#fetchBlockAt (#6710). Contributed by Haiyang Hu. huhaiyang 2024-04-11 18:04:57 +0800
  • 05964ad07a
         HDFS-17453. IncrementalBlockReport can have race condition with Edit Log Tailer (#6708) dannytbecker 2024-04-10 09:30:24 -0700
  • dbe2d61258
         HADOOP-19096. [ABFS] [CST Optimization] Enhance Client-Side Throttling Metrics Logic (#6276) Anuj Modi 2024-04-10 19:16:23 +0530
  • 281e2d288d
         Revert "HADOOP-16822. Provide source artifacts for hadoop-client-api. Contributed by Karel Kolman." (#6458) Cheng Pan 2024-04-10 19:03:59 +0800
  • f7bb4f1595
         HADOOP-18135. Produce Windows binaries of Hadoop (#6673) Gautham B A 2024-04-09 22:15:05 +0530
  • 3f8af73913
         YARN-11670. Add CallerContext in NodeManager (#6688) Yang Jiandan 2024-04-09 10:50:41 +0800
  • 8c378d1ea1
         YARN-11444. Improve YARN md documentation format. (#6711) Contributed by Shilun Fan. slfan1989 2024-04-07 20:50:46 +0800
  • 73e6931ed0
         HDFS-17449. Fix ill-formed decommission host name and port pair triggers IndexOutOfBound error (#6691). Contributed by ConfX ConfX 2024-04-06 16:08:09 +0800
  • a1ae35e691
         HADOOP-19135. Remove Jcache 1.0-alpha. (#6695) Contributed by Shilun Fan. slfan1989 2024-04-05 22:09:15 +0800
  • 6ed73896f6
         HADOOP-18656. [ABFS] Add Support for Paginated Delete for Large Directories in HNS Account (#6409) Anuj Modi 2024-04-05 00:18:25 +0530
  • d7157b4aa9
         HADOOP-19141. Vector IO: Update default values consistently (#6702) Dongjoon Hyun 2024-04-04 02:56:40 -0700
  • 62182b1f74
         HADOOP-19098. Vector IO: test failure followup (#6701) Steve Loughran 2024-04-03 20:40:41 +0100
  • eede5b1315
         HADOOP-19114. Upgrade to commons-compress 1.26.1 due to CVEs. (#6636) PJ Fanning 2024-04-03 20:32:15 +0200
  • 87fb977777
         HADOOP-19098. Vector IO: Specify and validate ranges consistently. #6604 Steve Loughran 2024-04-02 20:16:38 +0100
  • b4f9d8e6fa
         Revert "HADOOP-19098. Vector IO: Specify and validate ranges consistently." Steve Loughran 2024-04-03 13:15:05 +0100
  • 1357bb162d
         HADOOP-19123. Update to commons-configuration2 2.10.1 due to CVE (#6661). Contributed by PJ Fanning PJ Fanning 2024-04-02 21:50:00 +0200
  • ba7faf90c8
         HADOOP-19098. Vector IO: Specify and validate ranges consistently. Steve Loughran 2024-04-02 20:16:38 +0100
  • 36c22400b2
         HDFS-17408:Reduce the number of quota calculations in FSDirRenameOp (#6653). Contributed by lei w. Lei313 2024-04-02 10:40:28 +0800
  • 5f3eb446f7
         YARN-11663. [Federation] Add Cache Entity Nums Limit. (#6662) Contributed by Shilun Fan. slfan1989 2024-04-02 07:47:59 +0800
  • f7d1ec2d9e
         HADOOP-19077. Remove use of javax.ws.rs.core.HttpHeaders (#6554). Contributed by PJ Fanning PJ Fanning 2024-04-01 09:13:39 +0200
  • 8bf19a216c
         增加hdfs代码注释 zeekling 2024-03-31 21:39:21 +0800
  • 59976f1be2
         HDFS-17450. Add explicit dependency on httpclient jar (#6130). Contributed by PJ Fanning PJ Fanning 2024-03-30 18:54:15 +0100
  • 4807815e1c
         HDFS-17448. Enhance the stability of the unit test TestDiskBalancerCommand (#6690). Contributed by Haiyang Hu huhaiyang 2024-03-31 01:21:05 +0800
  • 06db6289cb
         HADOOP-19024. Use bouncycastle jdk18 1.77 (#6410). Contributed PJ Fanning 2024-03-30 15:28:12 +0100
  • aabf31f6fa
         HDFS-17103. Fix file system cleanup in TestNameEditsConfigs (#6071). Contributed by ConfX. ConfX 2024-03-30 17:34:42 +0800
  • 97c5a6efba
         HADOOP-19041. Use StandardCharsets in more places (#6449) PJ Fanning 2024-03-29 04:17:18 +0100
  • 347521c95d
         HADOOP-19124. Update org.ehcache from 3.3.1 to 3.8.2. (#6665) slfan1989 2024-03-29 09:56:12 +0800
  • f1f2abe641
         YARN-11668. Fix RM crash for potential concurrent modification exception when updating node attributes (#6681) Contributed by Junfan Zhang. Junfan Zhang 2024-03-29 09:45:16 +0800
  • f3f6340746
         HDFS-17443. add null check for fileSys and cluster before shutting down (#6683) ConfX 2024-03-28 23:09:50 +0800
  • 8528d5783d
         HDFS-17216. Distcp: When handle the small files, the bandwidth parameter will be invalid, fix this bug. (#6138) xiaojunxiang 2024-03-28 22:31:06 +0800
  • 8d242458e9
         增加hdfs代码注释 zeekling 2024-03-27 23:42:27 +0800
  • 5bfca65692
         HADOOP-19115. Upgrade to nimbus-jose-jwt 9.37.2 due to CVE-2023-52428. (#6637) PJ Fanning 2024-03-27 11:30:55 +0100
  • 50370769cd
         HDFS-17429. Fixing wrong log file name in datatransfer Sender.java (#6670) Contributed by Zhongkun Wu. Alex 2024-03-27 06:59:15 +0800
  • 032796a0fb
         HADOOP-19047: S3A: Support in-memory tracking of Magic Commit data (#6468) Syed Shameerur Rahman 2024-03-26 20:59:35 +0530
  • 9fe371aa15
         HADOOP-18980. Invalid inputs for getTrimmedStringCollectionSplitByEquals (ADDENDUM) (#6546) Viraj Jasani 2024-03-26 03:18:03 -0800
  • 37f9ccdc86
         HDFS-17368. HA: Standby should exit safemode when resources are available. (#6518). Contributed by Zilong Zhu. Zilong Zhu 2024-03-26 17:35:55 +0800
  • 8bc4939ee2
         HDFS-17441. Fix junit dependency by adding missing library in hadoop-hdfs-rbf. (#6669) Takanobu Asanuma 2024-03-26 09:40:28 +0900
  • c4f7a3625b
         HDFS-17435. Fix TestRouterRpc failed (#6650) Takanobu Asanuma 2024-03-26 09:38:35 +0900
  • 76489e579b
         HADOOP-19127. Do not run unit tests on Windows pre-commit CI (#6672) Gautham B A 2024-03-25 21:46:03 +0530
  • 44a249e32a
         Exclude files from Apache RAT (#6671) Gautham B A 2024-03-25 21:43:57 +0530
  • 7653f968e5
         HADOOP-19116. Update to zookeeper client 3.8.4 due to CVE-2024-23944. (#6638) PJ Fanning 2024-03-25 16:10:56 +0100
  • c4fa1b65fb
         HADOOP-19089: [ABFS] Reverting Back Support of setXAttr() and getXAttr() on root path (#6592) Anuj Modi 2024-03-25 07:13:24 -0700
  • 5c7e40f910
         HADOOP-19111. Removing redundant debug message about client info (#6666). Contributed by Zhongkun Wu. Alex 2024-03-25 11:44:33 +0800
  • 8677cbd3e0
         增加hdfs代码注释 zeekling 2024-03-24 18:49:13 +0800
  • 55dca911cc
         HADOOP-19052.Hadoop use Shell command to get the count of the hard link which takes a lot of time (#6587) Contributed by liangyu. yu liang 2024-03-24 10:14:27 +0800
  • a60b5e2de3
         MAPREDUCE-7469. NNBench createControlFiles should use thread pool to improve performance. (#6463) Contributed by liuguanghua. LiuGuH 2024-03-23 06:15:56 +0800
  • 8cd4704e0a
         HDFS-17430. RecoveringBlock will skip no live replicas when get block recovery command. (#6635) huhaiyang 2024-03-22 21:43:12 +0800
  • 062836c020
         HDFS-17436. Supplement log information for AccessControlException (#6651) XiaobaoWu 2024-03-22 11:21:03 +0800
  • a375ef8cfa
         YARN-11626. Optimize ResourceManager's operations on Zookeeper metadata (#6616) XiaobaoWu 2024-03-21 15:12:14 +0800
  • adab3a22aa
         HDFS-17432. Fix junit dependency to enable JUnit4 tests to run in hadoop-hdfs-rbf (#6639) Takanobu Asanuma 2024-03-21 14:53:02 +0900
  • 2eb7246ea7
         HDFS-17433. metrics sumOfActorCommandQueueLength should only record valid commands. (#6644) hfutatzhanghb 2024-03-21 11:41:35 +0800
  • 77c600d769
         HDFS-17426. Remove Invalid FileSystemECReadStats logic in DFSInputStream (#6628) huhaiyang 2024-03-21 10:33:41 +0800
  • a957cd5049
         YARN-5305. Allow log aggregation to discard expired delegation tokens (#6625) Peter Szucs 2024-03-20 15:33:10 +0100
  • 12a26d8b19
         HDFS-17431. Fix log format for BlockRecoveryWorker#recoverBlocks (#6643) huhaiyang 2024-03-20 11:22:45 +0800
  • 8b2058a4e7
         HADOOP-19050. S3A: Support S3 Access Grants (#6544) Adnan Hemani 2024-03-19 10:49:51 -0700
  • 705fb8323b
         HADOOP-19119. Spotbugs: possible NPE in org.apache.hadoop.crypto.key.kms.ValueQueue.getSize() (#6642) Steve Loughran 2024-03-19 17:18:07 +0000
  • ff3f2255d2
         HADOOP-19112. Hadoop 3.4.0 release wrap-up. (#6640) Contributed by Shilun Fan. slfan1989 2024-03-19 20:08:03 +0800
  • 0f51d2a4ec
         HADOOP-14451. Deadlock in NativeIO (#6632) Vinayakumar B 2024-03-18 10:53:21 +0530
  • b25b28e5bb
         HDFS-17380. FsImageValidation: remove inaccessible nodes. (#6549). Contributed by Tsz-wo Sze. Tsz-Wo Nicholas Sze 2024-03-17 20:52:17 -0700
  • b0e5465244
         增加容量调度器的代码注释。 zeekling 2024-03-17 22:12:04 +0800
  • 4d88f9892a HADOOP-19085. Compatibility Benchmark over HCFS Implementations drankye 2024-03-17 16:48:29 +0800
  • 783cc3eda0
         YARN-11660. Fix performance regression for SingleConstraintAppPlacementAllocator (#6623) Contributed by Junfan Zhang. Junfan Zhang 2024-03-15 08:14:38 +0800
  • a325876fec
         HADOOP-19066. Run FIPS test for valid bucket locations (ADDENDUM) (#6624) Viraj Jasani 2024-03-13 05:21:50 -0800
  • e28c78f9a2
         HADOOP-19088. Use jersey-json 1.22.0 (#6585) PJ Fanning 2024-03-12 21:16:47 +0100
  • 44c14edac7
         HADOOP-19066. S3A: AWS SDK V2 - Enabling FIPS should be allowed with central endpoint (#6539) Viraj Jasani 2024-03-12 10:49:06 -0800
  • e211f6f83d
         HDFS-17391. Adjust the checkpoint io buffer size to the chunk size (#6594). Contributed by lei w. Lei313 2024-03-12 18:36:43 +0800
  • dbf08c872a
         HDFS-17422. Enhance the stability of the unit test TestDFSAdmin (#6621). Contributed by lei w and Hualong Zhang. Lei313 2024-03-12 12:25:33 +0800
  • bb32aec88e
         HADOOP-19043. S3A: Regression: ITestS3AOpenCost fails on prefetch test runs (#6465) Steve Loughran 2024-03-08 12:48:38 +0000
  • fc166d3aec
         HADOOP-19090. Use protobuf-java 3.23.4. (#6593). Contributed by PJ Fanning. PJ Fanning 2024-03-07 10:39:01 +0100
  • 58afe43769
         HDFS-17299. Adding rack failure tolerance when creating a new file (#6566) ritegarg 2024-03-06 13:08:05 -0800
  • 7012986fc3
         HDFS-17345. Add a metrics to record block report generating cost time. (#6475). Contributed by farmmamba. hfutatzhanghb 2024-03-06 16:59:00 +0800
  • 5584efd8d4
         HDFS-17396. BootstrapStandby should download rollback image during RollingUpgrade (#6583) dannytbecker 2024-03-05 11:31:31 -0800
  • a2d7241190
         HDFS-17404. Add NN Socket Address to log when processing command from active NN (#6598) Jtdellaringa 2024-03-05 10:33:22 -0800
  • dae871e3e0
         YARN-11657. Remove protobuf-2.5 from hadoop-yarn-api module (#6575) (#6580) Steve Loughran 2024-03-05 11:01:14 +0000