MySQL: Difference between revisions

From Psygen Wiki
Jump to navigation Jump to search
 
(4 intermediate revisions by the same user not shown)
Line 29: Line 29:
Run the below to get the size of data in INNODB and MYISAM tables:<br />
Run the below to get the size of data in INNODB and MYISAM tables:<br />
<pre>mysql -e 'SELECT SQL_NO_CACHE Engine, count(*) "# of Tables", concat(round(sum(table_rows)/1000,2),"K") "Rows", concat(round(sum(data_length)/(1024*1024),2),"M") "Size of Data", concat(round(sum(index_length)/(1024*1024),2),"M") "Size of Indexes", concat(round(sum(data_length+index_length)/(1024*1024),2),"M") "Total Size", concat(round(sum(index_length)/sum(data_length)*(100),2), "%") "% Data in Indexes" FROM information_schema.TABLES GROUP BY engine ORDER BY sum(data_length+index_length) DESC LIMIT 10;'</pre>
<pre>mysql -e 'SELECT SQL_NO_CACHE Engine, count(*) "# of Tables", concat(round(sum(table_rows)/1000,2),"K") "Rows", concat(round(sum(data_length)/(1024*1024),2),"M") "Size of Data", concat(round(sum(index_length)/(1024*1024),2),"M") "Size of Indexes", concat(round(sum(data_length+index_length)/(1024*1024),2),"M") "Total Size", concat(round(sum(index_length)/sum(data_length)*(100),2), "%") "% Data in Indexes" FROM information_schema.TABLES GROUP BY engine ORDER BY sum(data_length+index_length) DESC LIMIT 10;'</pre>
<pre>
mysql -Bse 'show variables like "datadir";'|awk '{print $2}'|xargs -I{} find {} -type f -printf "%s %f\n"|awk -F'[ ,.]' '{print $1, $NF}'|awk '{array[$2]+=$1} END {for (i in array) {printf("%-15s %s\n", sprintf("%.3f MB", array[i]/1048576), i)}}' | egrep '(MYI|ibd)'
</pre>


(You can use the below to get the size of each database.)<br />
(You can use the below to get the size of each database.)<br />
Line 37: Line 41:
<code>innodb_buffer_pool_size</code> - set this to the value from the Total column, innodb row.<br />
<code>innodb_buffer_pool_size</code> - set this to the value from the Total column, innodb row.<br />
<br />
<br />
'''Note:''' if server has lots of RAM, and lots of data, set the innodb_buffer_pool_size = 1G, then set innodb_buffer_pool_instances = 4  (or smaller, or larger, depending on RAM) Also note that this will set the buffer pool size as 1G, and break that 1G into 4 chunks (It will NOT create 4, 1GB pools.)
'''Note:''' if server has lots of RAM, and lots of data, set the innodb_buffer_pool_size = 1G, then set innodb_buffer_pool_instances = 4  (or smaller, or larger, depending on RAM) Also note that this will set the buffer pool size as 1G, and break that 1G into 4 chunks (It will NOT create 4, 1GB pools.) Also note that ideally each pool chunk should be 1Gb in size.


<code>key_buffer_size</code> - set this to the value from the Index column, myisam row.
<code>key_buffer_size</code> - set this to the value from the Index column, myisam row.
Line 43: Line 47:
It's a good idea to backup the current settings, just in case:<br />
It's a good idea to backup the current settings, just in case:<br />
<code>cp -a /etc/my.cnf /root/my.cnf.</code>
<code>cp -a /etc/my.cnf /root/my.cnf.</code>
'''Are these settings effective?'''
mysql -e "show global status like '%innodb_buffer_pool_read%%';" | awk '/reads/ {print $1,"=",$2}';mysql -e "show global status like '%key_read%%';" | awk '/reads/ {print $1,"=",$2}'
The results should be close to the values for innodb_buffer_pool_size and key_buffer_size




Line 59: Line 70:


You can check to see if this value is good by running <code>mysqladmin stat</code>. That command will show the number of Opens, and the number of Open tables. Ideally, these numbers should be identical.
You can check to see if this value is good by running <code>mysqladmin stat</code>. That command will show the number of Opens, and the number of Open tables. Ideally, these numbers should be identical.
'''3. CPU Usage Issues '''
thread_cache_size - MySQL setting to adjust
SHOW GLOBAL STATUS LIKE 'Threads_created';
SHOW GLOBAL STATUS LIKE 'Connetions';


== View the MySQL Error log ==
== View the MySQL Error log ==
Line 80: Line 100:


<code>mysqladmin process stat</code> - This will show the queries that are running, how many threads, Open tables, slow queries, and a bunch of other helpful stuff. (Note that you can "tail -f" by running: <code>watch mysqladmin process stat</code> )
<code>mysqladmin process stat</code> - This will show the queries that are running, how many threads, Open tables, slow queries, and a bunch of other helpful stuff. (Note that you can "tail -f" by running: <code>watch mysqladmin process stat</code> )
== Dump and Import ==
<code>mysql database_name < file.sql</code> - Import a file to the named database from a .sql file
<code>mysqldump dbname > backupfile.sql</code> - dump one database to a .sql file

Latest revision as of 21:15, 23 November 2019

Note: never use kill to kill MySQL. Use service, or systemctl instead.

Backup (Dump)

To backup (dump) a single database:
mysqldump database_name > database_name.sql

Backup all databases:
mysqldump --all-databases > all_databases.sql


Restore

Restore a database:
mysql database_name < database_name.sql

Restore one database from a dump of all the databases: mysql --one-database database_name < all_databases.sql


Version

See: Software Versions to check the installed version.


Performance Tuning

1. First, Check innodb and myisam settings

Run the below to get the size of data in INNODB and MYISAM tables:

mysql -e 'SELECT SQL_NO_CACHE Engine, count(*) "# of Tables", concat(round(sum(table_rows)/1000,2),"K") "Rows", concat(round(sum(data_length)/(1024*1024),2),"M") "Size of Data", concat(round(sum(index_length)/(1024*1024),2),"M") "Size of Indexes", concat(round(sum(data_length+index_length)/(1024*1024),2),"M") "Total Size", concat(round(sum(index_length)/sum(data_length)*(100),2), "%") "% Data in Indexes" FROM information_schema.TABLES GROUP BY engine ORDER BY sum(data_length+index_length) DESC LIMIT 10;'
mysql -Bse 'show variables like "datadir";'|awk '{print $2}'|xargs -I{} find {} -type f -printf "%s %f\n"|awk -F'[ ,.]' '{print $1, $NF}'|awk '{array[$2]+=$1} END {for (i in array) {printf("%-15s %s\n", sprintf("%.3f MB", array[i]/1048576), i)}}' | egrep '(MYI|ibd)'

(You can use the below to get the size of each database.)
mysql -e 'select table_schema, sum((data_length+index_length)/1024/1024) AS MB from information_schema.tables group by 1;'

In /etc/my.cnf, change:

innodb_buffer_pool_size - set this to the value from the Total column, innodb row.

Note: if server has lots of RAM, and lots of data, set the innodb_buffer_pool_size = 1G, then set innodb_buffer_pool_instances = 4 (or smaller, or larger, depending on RAM) Also note that this will set the buffer pool size as 1G, and break that 1G into 4 chunks (It will NOT create 4, 1GB pools.) Also note that ideally each pool chunk should be 1Gb in size.

key_buffer_size - set this to the value from the Index column, myisam row.

It's a good idea to backup the current settings, just in case:
cp -a /etc/my.cnf /root/my.cnf.


Are these settings effective?

mysql -e "show global status like '%innodb_buffer_pool_read%%';" | awk '/reads/ {print $1,"=",$2}';mysql -e "show global status like '%key_read%%';" | awk '/reads/ {print $1,"=",$2}'

The results should be close to the values for innodb_buffer_pool_size and key_buffer_size


2. Opens

Warning: Don't mess with this unless the server is running out of memory. Even then, bigger is better than too small.

a.) Get the total number of tables on the server:
find /var/lib/mysql -name '*.frm' | wc -l - Example output: 4568

b.) Set table_open_cache variable in /etc/my.cnf to 50% of that number
Example, based on the above number: table_open_cache = 1371

c.) Set open_files_limit to three times the corrected value of table_open_cache
Example: open_files_limit = 3951

You can check to see if this value is good by running mysqladmin stat. That command will show the number of Opens, and the number of Open tables. Ideally, these numbers should be identical.


3. CPU Usage Issues

thread_cache_size - MySQL setting to adjust

SHOW GLOBAL STATUS LIKE 'Threads_created';
SHOW GLOBAL STATUS LIKE 'Connetions';

View the MySQL Error log

To check the MySQL error log, run:
mysql -e "show variables like '%log_error%';"

This will show the location of the MySQL error log, which you can then grep, tail, etc. (You're looking for stuff like innodb errors, disk space issues, connection messages, etc)


View MySQL Variables

You can view the variables that MySQL is using with:

mysql -e "show variables like 'max_connections%';" - This shows the max_connections variable. You can substitute any MySQL variable here.

This is helpful for database connection errors, or if a change to /etc/my.cnf isn't 'sticking' (In that case, look for other my.cnf files)


View Currently Running Queries

mysqladmin process stat - This will show the queries that are running, how many threads, Open tables, slow queries, and a bunch of other helpful stuff. (Note that you can "tail -f" by running: watch mysqladmin process stat )


Dump and Import

mysql database_name < file.sql - Import a file to the named database from a .sql file

mysqldump dbname > backupfile.sql - dump one database to a .sql file