|
Neohapsis is currently accepting applications for employment. For more information, please visit our website www.neohapsis.com or email hr@neohapsis.com |
Re: "Load Data Infile ... Repair with KeyCache" --WAY SLOW!
From: mos (mos99
fastmail.fm)
Date: Sun Mar 06 2005 - 11:51:10 CST
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
At 10:07 PM 3/2/2005, you wrote:
>Hello.
>
>You may use ALTER TABLE .. DISABLE KEYS to speed up the loading process
>on the MyISAM table.
I gave that a try but I had to cancel "Alter Table ... Enable Keys" after
49 hours. I find it amazing that it takes only 6.25 hours to load 450
million rows into the table using Load Data Infile with the keys disabled,
but over 49 hours (maybe a lot more) to rebuild 3 indexes. Even with 100g
of disk space dedicated to the sort file. It started using "Repair with
Filesort" for the first 7 hours, then it switched to "Repair with
KeyCache". I don't know anyone who can afford to take their database down
for a few days (weeks?) while building an index.
Mike
>mos <mos99
fastmail.fm> wrote:
> > I have a 50g CSV file that I am trying to import into an empty MyISAM
> > table. It appears to go fine except after 10 hours it hasn't completed. A
> > "Show Process List" shows Info="load data infile ..." and State="Repair
> > with keycache". The table has a few hundred million rows of data. I assume
> > it is using "Repair with keycache" to rebuild the indexes after the data
> > has been loaded.
> >
> > From what I've read "Repair with keycache" is going to take a huge amount
> > of time to complete. How do I disable "Repair with keycache" and use
> > "Repair with sort" instead (which should be faster, right?)? I'm using
> > MySQL 4.1.10 on Win XP and 1gb ram.
> >
> > TIA
> >
> > Mike
> >
> >
>
>
>--
>For technical support contracts, goto https://order.mysql.com/?ref=ensita
>This email is sponsored by Ensita.NET http://www.ensita.net/
> __ ___ ___ ____ __
> / |/ /_ __/ __/ __ \/ / Gleb Paharenko
> / /|_/ / // /\ \/ /_/ / /__ Gleb.Paharenko
ensita.net
>/_/ /_/\_, /___/\___\_\___/ MySQL AB / Ensita.NET
> <___/ www.mysql.com
>
>
>
>
>--
>MySQL General Mailing List
>For list archives: http://lists.mysql.com/mysql
>To unsubscribe: http://lists.mysql.com/mysql?unsub=mos99
fastmail.fm
--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]