maria-discuss team mailing list archive
-
maria-discuss team
-
Mailing list archive
-
Message #06152
Re: Clarification on Memory utilization of Mariadb
-
To:
<ragulrangarajan@xxxxxxxxx>, <maria-discuss@xxxxxxxxxxxxxxxxxxx>
-
From:
<Rhys.Campbell@xxxxxxxxxxxx>
-
Date:
Wed, 10 Nov 2021 09:31:14 +0000
-
Accept-language:
en-GB, en-US
-
Arc-authentication-results:
i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=swisscom.com; dmarc=pass action=none header.from=swisscom.com; dkim=pass header.d=swisscom.com; arc=none
-
Arc-message-signature:
i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=XMJGZhCVIFu0KCZCPZmgjZxJIzVzzxT9G1aVBZ+XXuI=; b=hwjq4kKvuO5ipYepE7C7f69Vf2qUDxr6++Coe4ATRIKKrxzcm/wet5rCG72eXmeFq/YNSU8NN7fiJWZ9OY7bg3dGrxr27BQhq1eoLTRSLJPdpbySkZVgFhwbv6p8b6nrGOye1d7/+5BkfsUxiN8Tp7iSjXRiPMOK8PFXxSqbhBIej/cJcq6b97KiKUcoNzI01BP3nm8nnBwGB+ru7aIp0oOiX0JKMXNC5D2WZaOe71hjMmiZdqAoH8X+LtuEiASvHQxoNAVeQgk8U7yfP9uXNL7sYWszp0+3a9RO/HwgQeUDYf+6eDIlrZTgsx5Zjax13YpCtNRMj4Jh54rmJMNiMg==
-
Arc-seal:
i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=WnUVcePZS9+cobeNVgQ9BXgNxftP5nPQmBnwolgZGslFKYv6j4hBdLhI5s5EercSwZYDyfSqqpy+5hlUY296rww9nNruaqcHtvzM4Sgan67G0eFreSWcRx0KHupd3tdKbOJOfrK6mRp1qx9EylLiap+YmxwLev6S6ihjCT4ULNKZJPppP3qIWNpQuRUkbqBkohJhLRLGagK+AzgycEJC4bRQQ3twc/aiI/aQY2aueEtUjQDg0YZ10TqhLppRHki96ehctyQkFfoeVHKPxjq7ewUmvapAuK5WWqsfEMqxJQELRne8pvpdae3160OUGEqVkeHZdY9ONEv4yUOk6e1BmA==
-
Authentication-results:
gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=swisscom.com;
-
In-reply-to:
<CAExRPvHGc5oHvYUuZ6xdNuZxojCTxxHbHX1Eov7CzWOxVz_UyA@mail.gmail.com>
-
Thread-index:
AQHX1XcFsjtcNPikwUm9FZ3eIMKMIKv8f+NQ
-
Thread-topic:
[Maria-discuss] Clarification on Memory utilization of Mariadb
The innodb_buffer_pool_size is just one memory setting of many. MariaDB will allocate additional memory for other things.
Here's a good place to start…
https://mariadb.com/kb/en/mariadb-memory-allocation/
From: Maria-discuss <maria-discuss-bounces+rhys.campbell=swisscom.com@xxxxxxxxxxxxxxxxxxx> On Behalf Of ragul rangarajan
Sent: 09 November 2021 15:34
To: maria-discuss@xxxxxxxxxxxxxxxxxxx
Subject: [Maria-discuss] Clarification on Memory utilization of Mariadb
Hi Team,
Need clarification on Memory utilization of Mariadb.
I have a java application with MariaDB that runs on the same Rhel 7 server with physical memory(RAM) allocated as 12GB where I would see the normal utilization at the start as below.
sys> free -h
total used free shared buff/cache available
Mem: 11G 7.8G 1.6G 9.0M 2.2G 3.5G
Swap: 0B 0B 0B
Over a period of time say >6month, I could see the RAM utilization is almost full, and available space is very less but still, the application continues to work fine without any issues.
sys> free -h
total used free shared buff/cache available
Mem: 11G 11G 134M 17M 411M 240M
Swap: 0B 0B 0B
I don't see any OOM issue or high usage of RSS at the java application level but I could see MariaDB occupies huge memory.... apart from that overall application runs fine.
To ensure this we observed memory utilization at the large-scale application servers where we deployed MariaDB and Java applications into different servers with 128GB each and could observe that the system with MariaDB uses full RAM size whereas the Java application consumption looks stable.
Server with Java application
sys> free
total used free shared buff/cache available
Mem: 128755 125171 606 118 2977 2694
Swap: 65535 9746 55789
Server with MariaDB
sys> free
total used free shared buff/cache available
Mem: 128755 125171 606 118 2977 2694
Swap: 65535 9746 55789
MariaDb conf:
innodb_buffer_pool_size=102G
innodb_buffer_pool_instances=8
innodb_io_capacity=3000
innodb_log_buffer_size=8M
innodb_log_file_size=2047MB
innodb_log_files_in_group=2
Is this expected that MariaDB consumes overall memory and manages within RAM size.... regardless of buffer size configured?
Do we need to optimize any configuration to control the MariaDB consumption apart from buffer pool size?
Thanks and Regards,
Ragul
References