I gather you must be using a CACHED table. 30 minutes is still a long time
to insert 700,000 rows. Please do some comparative tests with 1.7.2 ALPHA_M
and 1.7.1. The new version should be a lot faster. Also for reference, run
the TestCacheSize.java test with 700,000 rows and report the timing and the
settings you used.
Fred
----- Original Message -----
From: "neels" <neelesh_shastry@...>
To: "fredt" <fredt@...>;
<hsqldb-user@...>
Sent: 04 March 2003 05:59
Subject: Re: [Hsqldb-user] Bulk Inserts in HSQLDB
I have a single table with 11 columns, no index on any
column. (a NUMBER IDENTITY, b VARCHAR(100),c
VARCHAR(100),d VARCHAR(100),e VARCHAR(100), f
VARCHAR(100),g VARCHAR(100), h VARCHAR(100), i DATE, j
INTEGER,k INTEGER)
I was using prepared statement to insert records
[Guess a batch insert would have helped].
I am running HSQLDB on a PIII 833MHz WinNT4,with 512MB
RAM and 10GB Disk space.
--- fredt <fredt@...> wrote:
> Please give more details. What type of tables are
> you using. What spec
> machine is being used, etc. Thirty minutes seems a
> bit too long.
>
> Fred Toussi
>
> ----- Original Message -----
> From: "neels" <neelesh_shastry@...>
> To: <hsqldb-user@...>
> Sent: 03 March 2003 17:57
> Subject: [Hsqldb-user] (no subject)
>
>
> Hello,
> Im pretty new to hsqldb, but found it extremely
> good. I was using 1.7.1 and was trying to gzip the
> script files to make them compact and expand them
> when
> needed, because Im processing data of around
> 300-400MB.Great to see that 1.7.2 alpha has built-in
> support for compressed formats.
> I am facing a performance problem, when I try to
> insert huge amountr of data [around 100MB, 700,000
> records with 11 fields, mostly VARCHAR]. If i dont
> get
> and out of memory error (with java -Xmx128M
> option),it
> takes a LOT of time,around 30 minutes! Is there any
> way I can directly write to gzipped output stream?
> Im
> writing a very specific application, so i don't mind
> bypassing SQL/JDBC and write directly to the gzip
> output stream.
> Any help is greatly appreciated!
> Thanks,
> Neelesh
>
> __________________________________________________
> Do you Yahoo!?
> Yahoo! Tax Center - forms, calculators, tips, more
> http://taxes.yahoo.com/
>
>
>
-------------------------------------------------------
> This sf.net email is sponsored by:ThinkGeek
> Welcome to geek heaven.
> http://thinkgeek.com/sf
> _______________________________________________
> Hsqldb-user mailing list
> Hsqldb-user@...
>
https://lists.sourceforge.net/lists/listinfo/hsqldb-user
>
>
>
>
-------------------------------------------------------
> This SF.net email is sponsored by: Etnus, makers of
> TotalView, The debugger
> for complex code. Debugging C/C++ programs can leave
> you feeling lost and
> disoriented. TotalView can help you find your way.
> Available on major UNIX
> and Linux platforms. Try it free. http://www.etnus.com
> _______________________________________________
> Hsqldb-user mailing list
> Hsqldb-user@...
>
https://lists.sourceforge.net/lists/listinfo/hsqldb-user
__________________________________________________
Do you Yahoo!?
Yahoo! Tax Center - forms, calculators, tips, more
http://taxes.yahoo.com/
-------------------------------------------------------
This SF.net email is sponsored by: Etnus, makers of TotalView, The debugger
for complex code. Debugging C/C++ programs can leave you feeling lost and
disoriented. TotalView can help you find your way. Available on major UNIX
and Linux platforms. Try it free. http://www.etnus.com
_______________________________________________
Hsqldb-user mailing list
Hsqldb-user@...
https://lists.sourceforge.net/lists/listinfo/hsqldb-user
|
