big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,284 Commits 2 Branches 2 Tags 264 MiB
f9fab9f22a
Commit Graph

22284 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Szilard Nemeth
a2a8be18cb YARN-9629. Support configurable MIN_LOG_ROLLING_INTERVAL. Contributed by Adam Antal. 2019-07-03 13:45:00 +02:00
Weiwei Yang
15d82fcb75 YARN-9658. Fix UT failures in TestLeafQueue. Contributed by Tao Yang. 2019-07-03 12:08:45 +08:00
Bharat Viswanadham
91cc197227 HDDS-1757. Use ExecutorService in OzoneManagerStateMachine. (#1048) 2019-07-02 16:02:27 -07:00
Mukul Kumar Singh
8b0d1adf31 HDDS-1616. ManagedChannel references are being leaked in while removing RaftGroup. Contributed by Mukul Kumar Singh. (#1039) 2019-07-02 14:34:49 -07:00
Márton Elek
75b1e458b1
HDDS-1716. Smoketest results are generated with an internal user 
Closes #1002
 2019-07-02 22:52:06 +02:00
Inigo Goiri
aa9f0850e8 HADOOP-16385. Namenode crashes with 'RedundancyMonitor thread received Runtime exception'. Contributed by Ayush Saxena. 2019-07-02 13:22:30 -07:00
Elek, Márton
564758ae8d HDDS-1698. Switch to use apache/ozone-runner in the compose/Dockerfile (#979) 
* HDDS-1698. Switch to use apache/ozone-runner in the compose/Dockerfile

* docker image is moved to the parent in HDDS-1667
 2019-07-02 09:54:43 -07:00
Sunil G
e966edd025 YARN-9644. First RMContext object is always leaked during switch over. Contributed by Bibin A Chundatt. 2019-07-02 12:18:16 +05:30
Sunil G
0c8813f135 YARN-9327. Improve synchronisation in ProtoUtils#convertToProtoFormat block. Contributed by Bibin A Chundatt. 2019-07-02 11:44:11 +05:30
Weiwei Yang
570eee30e5 YARN-9655. AllocateResponse in FederationInterceptor lost applicationPriority. Contributed by hunshenshi. 2019-07-02 09:55:25 +08:00
Márton Elek
2f4b37b53c
HDDS-1667. Docker compose file may referring to incorrect docker image name. Contributed by Eric Yang. 2019-07-02 02:19:57 +02:00
paulward24
d8bac50e12 HDFS-14610. HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected with synchronized. (#1015) 2019-07-01 13:54:49 -07:00
Vivek Ratnavel Subramanian
db674a0b14 HDDS-1685. Recon: Add support for "start" query param to containers and containers/{id} endpoints. 2019-07-01 12:44:14 -07:00
S O'Donnell
f8d62a9c4c
HDDS-1258. Fix error propagation for SCM protocol 
Closes #1001
 2019-07-01 20:04:32 +02:00
hunshenshi
b1dafc3506 YARN-9661:Fix typo in LocalityMulticastAMRMProxyPolicy.java and AbstractConfigurableFederationPolicy.java (#1042) 2019-07-01 10:46:33 -07:00
dineshchitlangia
1f75660350 HDDS-373. Genconf tool must generate ozone-site.xml with sample values (#1025) 2019-07-01 08:58:47 -07:00
Mukul Kumar Singh
9df6275954 HDDS-1555. Disable install snapshot for ContainerStateMachine. Contributed by Siddharth Wagle. (#846) 2019-07-01 20:52:32 +05:30
Bharat Viswanadham
1e727cf2a1
HDDS-1730. Implement File CreateDirectory Request to use Cache and Do… (#1026) 2019-06-30 22:38:53 -07:00
paulward24
d203045c30 HDFS-14618. Incorrect synchronization of ArrayList field (ArrayList is thread-unsafe). Contributed by Paul Ward. 2019-06-28 16:06:43 -07:00
dineshchitlangia
da568996af HDDS-1733. Fix Ozone documentation (#1031) 2019-06-28 15:59:33 -07:00
Eric Yang
29465bf169 YARN-9560. Restructure DockerLinuxContainerRuntime to extend OCIContainerRuntime. 
Contributed by Eric Badger, Jim Brennan, Craig Condit
 2019-06-28 17:18:53 -04:00
Bharat Viswanadham
49c5e8ac24
HDDS-1672. Improve locking in OzoneManager. (#1016) 2019-06-28 14:05:19 -07:00
Eric Yang
f02b0e1994 YARN-9581. Add support for get multiple RM webapp URLs. 
Contributed by Prabhu Joseph
 2019-06-28 14:54:57 -04:00
Márton Elek
9fd3c702fc
HDDS-1639. Restructure documentation pages for better understanding 
Closes #901
 2019-06-28 19:51:30 +02:00
Weiwei Yang
f09c31a97e Revert "YARN-9655. AllocateResponse in FederationInterceptor lost applicationPriority. (hunshenshi via wwei) closes apache/hadoop#1023" 
This reverts commit 5e7caf1287.
 2019-06-29 00:29:17 +08:00
Weiwei Yang
5e7caf1287 YARN-9655. AllocateResponse in FederationInterceptor lost applicationPriority. (hunshenshi via wwei) closes apache/hadoop#1023 2019-06-29 00:08:40 +08:00
Weiwei Yang
cbae241320 YARN-9623. Auto adjust max queue length of app activities to make sure activities on all nodes can be covered. Contributed by Tao Yang. 2019-06-28 23:24:53 +08:00
Inigo Goiri
4a212242d9 HDFS-14599. HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty. Contributed by He Xiaoqiao. 2019-06-27 10:00:05 -07:00
Inigo Goiri
041e0c0564 HDFS-14036. RBF: Add hdfs-rbf-default.xml to HdfsConfiguration by default. Contributed by Takanobu Asanuma. 2019-06-27 09:57:52 -07:00
bibinchundatt
be80334cdf YARN-9639. DecommissioningNodesWatcher cause memory leak. Contributed by Bilwa S T. 2019-06-27 09:59:44 +05:30
Bharat Viswanadham
4848280437
HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. (#956) 2019-06-26 18:04:12 -07:00
Giovanni Matteo Fumarola
1ac967a6b7 YARN-6055. ContainersMonitorImpl need be adjusted when NM resource changed. Contributed by Inigo Goiri. 2019-06-26 14:01:31 -07:00
avijayanhwx
0a37ccf379 HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist (#1013) 2019-06-26 11:44:49 -07:00
Zhankun Tang
062eb605ac YARN-9477. Implement VE discovery using libudev. Contributed by Peter Bacsko. 2019-06-26 23:53:14 +08:00
Bharat Viswanadham
a79bdf760e
HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. (#1014) 2019-06-25 17:12:45 -07:00
Anu Engineer
4b50981cfa HDDS-1709. TestScmSafeNode is flaky. 
Contributed by Elek, Marton.
 2019-06-25 13:57:01 -07:00
Bharat Viswanadham
049bb42760 HDDS-1723. Create new OzoneManagerLock class. (#1006) 
* HDDS-1723. Create new OzoneManagerLock class.

* add logs

* fix exception message

* add license

* fix findbug

* throw exception when acquiring 2nd lock failed.

* fix review comments

* fix missed review comment

* fix checkstyle

* fix review comments
 2019-06-25 08:48:03 -07:00
Erik Krogen
ab0b180ddb HDFS-12345 Add Dynamometer to hadoop-tools, a tool for scale testing the HDFS NameNode with real metadata and workloads. Contributed by Erik Krogen. 2019-06-25 08:07:39 -07:00
Akira Ajisaka
48d7f00da8
HDFS-14590. [SBN Read] Add the document link to the top page. Contributed by Takanobu Asanuma. 2019-06-25 19:11:09 +09:00
kkori
366f3deec5 HADOOP-16390. escape javadoc in S3AUtils public methods 
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
 2019-06-25 17:47:37 +09:00
Anu Engineer
041e7a7dee HDFS-14598. Findbugs warning caused by HDFS-12487. 
Contributed by He Xiaoqiao.
 2019-06-24 19:07:22 -07:00
Inigo Goiri
b76b843c8b HDFS-13371. NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.X. Contributed by Sherwood Zheng. 2019-06-24 17:52:33 -07:00
Inigo Goiri
38a560c6f1
Merge pull request #977 from leosunli/trunk 
HDFS-14541. When evictableMmapped or evictable size is zero, do not throw NoSuchElementException.
 2019-06-24 17:44:54 -07:00
Christopher Gregorian
129576f628 HDFS-14403. Cost-based extension to the RPC Fair Call Queue. Contributed by Christopher Gregorian. 2019-06-24 12:09:17 -07:00
Elek, Márton
d023f1f864 HDDS-1646. Support real persistence in the k8s example files (#945) 
* HDDS-1646. Support real persistence in the k8s example files

* ephemeral clusters can be scaled up
 2019-06-24 12:02:35 -07:00
Ajay Kumar
95c94dcca7
HADOOP-16350. Ability to tell HDFS client not to request KMS Information from NameNode. Ccontributed by Greg Senia, Ajay Kumar. 2019-06-24 11:59:07 -07:00
Elek, Márton
004207996c HDDS-1597. Remove hdds-server-scm dependency from ozone-common (#969) 
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.

* checkstyle fixes

* revert the import reorder of HddsUtil

* add javadoc

* switch back to the commons-lang2

* fix typo

* fix metrics core classpath problem (+rebase fix)
 2019-06-24 11:56:04 -07:00
Inigo Goiri
719d57bf46 HDFS-14545. RBF: Router should support GetUserMappingsProtocol. Contributed by Ayush Saxena. 2019-06-24 22:03:04 +05:30
Akira Ajisaka
8627f6532b HDFS-14550. RBF: Failed to get statistics from NameNodes before 2.9.0. Contributed by He Xiaoqiao. 2019-06-24 22:03:04 +05:30
Ayush Saxena
b52fd05d42 HDFS-13404. Addendum: RBF: TestRouterWebHDFSContractAppend.testRenameFileBeingAppended fail. Contributed by Takanobu Asanuma. 2019-06-24 22:03:04 +05:30