MySQL: Speed of INSERT Statements

Speed of INSERT Statements

To optimize insert speed, combine many small operations into a single large operation. Ideally, you make a single connection, send the data for many new rows at once, and delay all index updates and consistency checking until the very end.

The time required for inserting a row is determined by the following factors, where the numbers indicate approximate proportions:

Connecting: (3)

Sending query to server: (2)

Parsing query: (2)

Inserting row: (1 × size of row)

Inserting indexes: (1 × number of indexes)

Closing: (1)

This does not take into consideration the initial overhead to open tables, which is done once for each concurrently running query.

The size of the table slows down the insertion of indexes by log

N

, assuming B-tree indexes.

You can use the following methods to speed up inserts:

If you are inserting many rows from the same client at the same time, use

INSERT

statements with multiple

VALUES

lists to insert several rows at a time. This is considerably faster (many times faster in some cases) than using separate single-row

INSERT

statements. If you are adding data to a nonempty table, you can tune the

bulk_insert_buffer_size

variable to make data insertion even faster. See Section 5.1.4, “Server System Variables”.

When loading a table from a text file, use

LOAD DATA INFILE

. This is usually 20 times faster than using

INSERT

statements. See Section 13.2.6, “LOAD DATA INFILE Syntax”.

Take advantage of the fact that columns have default values. Insert values explicitly only when the value to be inserted differs from the default. This reduces the parsing that MySQL must do and improves the insert speed.

See Section 8.5.2, “Bulk Data Loading for MyISAM Tables” for tips specific to

MyISAM

tables.

REF:

http://dev.mysql.com/doc/refman/5.0/en/insert-speed.html

http://dev.mysql.com/doc/refman/5.0/en/update-speed.html