big-data/hadoop
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
22,374 Commits 2 Branches 2 Tags 264 MiB
fbe2fc6580
Commit Graph

790 Commits

Author SHA1 Message Date
Bharat Viswanadham
fbe2fc6580 HDDS-1846. Default value for checksum bytes is different in ozone-site.xml and code. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-23 10:42:16 -07:00
Doroszlai, Attila
278390f5bf HDDS-1710. Fix checkstyle errors 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-23 07:56:30 -07:00
Márton Elek
c533b79c32 HDDS-1710. Publish JVM metrics via Hadoop metrics 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 16:27:50 -07:00
Doroszlai, Attila
c958eddcf4 HDDS-1811. Prometheus metrics are broken. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-22 14:12:06 -07:00
Hanisha Koneru
cdc36fe286 HDDS-1649. On installSnapshot notification from OM leader, download checkpoint and reload OM state (#948) 2019-07-22 12:06:55 -07:00
Sammi Chen
69a46a95bb HDDS-1713. ReplicationManager fail to find proper node topology based… (#1112) 2019-07-19 15:45:26 -07:00
Xiaoyu Yao
4e66cb9333 HDDS-1653. Add option to "ozone scmcli printTopology" to order the output acccording to topology layer. Contributed by Xiaoyu Yao. (#1067) 
* HDDS-1653. Add option to "ozone scmcli printTopology" to order the output acccording to topology layer. Contributed by Xiaoyu Yao.

* use ip/hostname instead of network name for -o output and add smoke test
 2019-07-19 11:00:49 +08:00
Doroszlai, Attila
d5ef38b093 HDDS-1822. NPE in SCMCommonPolicy.chooseDatanodes (#1120) 2019-07-18 13:28:03 -07:00
Shashikant Banerjee
20cf50c6d0 HDDS-1654. Ensure container state on datanode gets synced to disk whennever state change happens. Cotributed by Shashikant Banerjee. (#923) 2019-07-18 17:09:05 +05:30
Shashikant Banerjee
ccceedb432 HDDS-1780. TestFailureHandlingByClient tests are flaky. Contributed by Shashikant Banerjee. (#1073) 2019-07-18 16:01:58 +05:30
Lokesh Jain
23e9bebe13
HDDS-1767: ContainerStateMachine should have its own executors for executing applyTransaction calls (#1087) 2019-07-18 14:48:13 +05:30
Bharat Viswanadham
3dc256ef81
HDDS-1689. Implement S3 Create Bucket request to use Cache and DoubleBuffer. (#1088) 2019-07-17 21:46:27 -07:00
Bharat Viswanadham
73e6ffce69
HDDS-1802. Add Eviction policy for table cache. (#1100) 2019-07-17 18:19:06 -07:00
avijayanhwx
303a7f8a39 HDDS-1721 : Client Metrics are not being pushed to the configured sink while running a hadoop command to write to Ozone. (#1034) 2019-07-17 12:05:43 -07:00
Xiaoyu Yao
eb0849b547 HDDS-1801. Make Topology Aware Replication/Read non-default for ozone 0.4.1. Contributed by Xiaoyu Yao. 
Signed-off-by: Anu Engineer <aengineer@apache.org>
 2019-07-17 10:32:59 -07:00
Sammi Chen
493b0b5760 HDDS-1787. NPE thrown while trying to find DN closest to client. Contributed by Sammi Chen. (#1094) 2019-07-16 12:52:29 -07:00
Shashikant Banerjee
d21eccf8ba HDDS-1492. Generated chunk size name too long. Contributed by Shashikannt Banerjee. (#1084) 2019-07-16 18:01:13 +05:30
Nanda kumar
1502e6a22f HDDS-1756. DeleteContainerCommandHandler fails with NPE. Contributed by Nanda kumar(#1095). 2019-07-16 15:06:41 +05:30
Anu Engineer
47345e598e
Merge pull request #1058 from elek/HDDS-1763 
HDDS-1763. Use vendor neutral s3 logo in ozone doc
 2019-07-15 13:17:21 -07:00
Mukul Kumar Singh
0976f6fc30
HDDS-1766. ContainerStateMachine is unable to increment lastAppliedTermIndex. Contributed by Mukul Kumar Singh. (#1072) 2019-07-14 10:53:51 +05:30
Márton Elek
9119ed07ff
HDDS-1384. TestBlockOutputStreamWithFailures is failing 
Closes #1029
 2019-07-12 11:00:03 +02:00
Hrishikesh Gadre
14c43f85de HDDS-1752. ConcurrentModificationException while handling DeadNodeHandler event. (#1080) 2019-07-12 14:15:48 +05:30
supratimdeka
738fab3bff HDDS-1754. getContainerWithPipeline fails with PipelineNotFoundException. Contributed by Supratim Deka (#1081) 2019-07-12 10:31:48 +05:30
Nanda kumar
0f399b0d57
HDDS-1784. Missing HostName and IpAddress in the response of register command. 2019-07-11 19:01:06 +05:30
Hrishikesh Gadre
acef5e0cec HDDS-1201. Reporting corrupted containers info to SCM (#1032) 2019-07-11 14:49:58 +05:30
Ajay Yadav
cdb20adfcc HDDS-1611. Evaluate ACL on volume bucket key and prefix to authorize access. Contributed by Ajay Kumar. (#973) 2019-07-10 11:03:58 -07:00
supratimdeka
e0fa1040af HDDS-1748. Error message for 3 way commit failure is not verbose. Contributed by Supratim Deka (#1051) 2019-07-10 16:45:55 +05:30
supratimdeka
ac7a8accdf HDDS-1603. Handle Ratis Append Failure in Container State Machine. Contributed by Supratim Deka (#1019) 2019-07-10 07:49:36 +05:30
Xiaoyu Yao
030307226a
HDDS-1586. Allow Ozone RPC client to read with topology awareness. Contributed by Sammi Chen. 2019-07-09 14:43:55 -07:00
Mukul Kumar Singh
96d0555913 HDDS-1718. Increase Ratis Leader election timeout default. Contributed by Aravindan Vijayan & Siddharth Wagle. (#1062) 2019-07-09 23:17:50 +05:30
Vivek Ratnavel Subramanian
82d88a8d30 HDDS-1705. Recon: Add estimatedTotalCount to the response of containers and containers/{id} endpoints. Contributed by Vivek Ratnavel Subramanian. 2019-07-08 21:06:50 -07:00
Mukul Kumar Singh
e5ffb88257 HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh. (#1050) 
* HDDS-1550. MiniOzoneCluster is not shutting down all the threads during shutdown. Contributed by Mukul Kumar Singh.
 2019-07-08 20:24:12 -07:00
Lokesh Jain
b5d30e4914 HDDS-1750. Add block allocation metrics for pipelines in SCM. Contributed by Lokesh Jain. (#1047) 2019-07-09 08:42:55 +05:30
Mukul Kumar Singh
ce91d35b29
HDDS-1728. Add metrics for leader's latency in ContainerStateMachine. Contributed by Mukul Kumar Singh. (#1022) 2019-07-08 12:19:16 +05:30
Márton Elek
68f53f95ad
HDDS-1763. Use vendor neutral s3 logo in ozone doc. Contributed by Elek, Marton. 2019-07-04 17:14:19 +02:00
Mukul Kumar Singh
8b0d1adf31 HDDS-1616. ManagedChannel references are being leaked in while removing RaftGroup. Contributed by Mukul Kumar Singh. (#1039) 2019-07-02 14:34:49 -07:00
S O'Donnell
f8d62a9c4c
HDDS-1258. Fix error propagation for SCM protocol 
Closes #1001
 2019-07-01 20:04:32 +02:00
dineshchitlangia
1f75660350 HDDS-373. Genconf tool must generate ozone-site.xml with sample values (#1025) 2019-07-01 08:58:47 -07:00
Mukul Kumar Singh
9df6275954 HDDS-1555. Disable install snapshot for ContainerStateMachine. Contributed by Siddharth Wagle. (#846) 2019-07-01 20:52:32 +05:30
dineshchitlangia
da568996af HDDS-1733. Fix Ozone documentation (#1031) 2019-06-28 15:59:33 -07:00
Márton Elek
9fd3c702fc
HDDS-1639. Restructure documentation pages for better understanding 
Closes #901
 2019-06-28 19:51:30 +02:00
Bharat Viswanadham
4848280437
HDDS-1638. Implement Key Write Requests to use Cache and DoubleBuffer. (#956) 2019-06-26 18:04:12 -07:00
avijayanhwx
0a37ccf379 HDDS-1691 : RDBTable#isExist should use Rocksdb#keyMayExist (#1013) 2019-06-26 11:44:49 -07:00
Bharat Viswanadham
a79bdf760e
HDDS-1727. Use generation of resourceName for locks in OzoneManagerLock. (#1014) 2019-06-25 17:12:45 -07:00
Bharat Viswanadham
049bb42760 HDDS-1723. Create new OzoneManagerLock class. (#1006) 
* HDDS-1723. Create new OzoneManagerLock class.

* add logs

* fix exception message

* add license

* fix findbug

* throw exception when acquiring 2nd lock failed.

* fix review comments

* fix missed review comment

* fix checkstyle

* fix review comments
 2019-06-25 08:48:03 -07:00
Elek, Márton
004207996c HDDS-1597. Remove hdds-server-scm dependency from ozone-common (#969) 
* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.

* checkstyle fixes

* revert the import reorder of HddsUtil

* add javadoc

* switch back to the commons-lang2

* fix typo

* fix metrics core classpath problem (+rebase fix)
 2019-06-24 11:56:04 -07:00
avijayanhwx
81d2f1b724 HDDS-1719 : Increase ratis log segment size to 1MB. (#1005) 
* HDDS-1719 : Increase ratis log segment size to 1MB.

* HDDS-1719 : Increase ratis log segment size to 1MB.
 2019-06-24 08:57:08 -07:00
Nanda kumar
b28ddb22a5 HDDS-1706. Replication Manager thread running too frequently. Contributed by Nilotpal Nandi. 2019-06-22 16:15:45 +05:30
Hrishikesh Gadre
8194a1196e HDDS-1690. ContainerController should provide a way to retrieve containers per volume (#986) 2019-06-21 10:23:11 -07:00
S O'Donnell
b95a58e231
HDDS-1674. Make ScmBlockLocationProtocol message type based. 
Closes #984
 2019-06-21 11:35:43 +02:00