Re: [Treebase-devel] [eX-purgate bulk]: db2->pg data transfer

[Jon A. <jon...@du...>]

The sobolsoft software looks worth a try to me. It follows the spirit  
of Mark's suggestion, that is, transfer the data across the wire  
without creating intermediate files. However, it is Windows only and  
my gut feeling is that it will blow up on the very large tables. Then  
again, maybe not.

I found another solution that could work called RazorSQL (http://www.razorsql.com/features/db2_export.html 
). Though it has a gui, it also has a command line interface which we  
could easily pipe the output into a psql statement to import directly  
into a PostgreSQL database (http://www.razorsql.com/docs/command_line.html 
). Something like:

java -Xms512M -Xmx2048M -jar razorsql.jar -export "[Treebase_DB2_db]"  
"select * from table1" sql | psql -Utreebase -hdarwin.nescent.org -d  
treebase-dev -f -

I can either give someone access to a database on our Postgresql  
server, or I can take a stab at from this end if it is possible to get  
read only access to the DB2 database.

-Jon

-------------------------------------------------------
  Jon Auman
  Systems Administrator
  National Evolutionary Synthesis Center
  Duke University
  http:www.nescent.org
  jon...@ne...
------------------------------------------------------

On May 27, 2009, at 1:31 PM, William Piel wrote:

>
> What do you think of this tool: http://www.sobolsoft.com/ 
> postgresqldb2/
>
> Too dodgy? But for only $30, perhaps it's worth giving it a shot.
>
> Bill
>
>
>
> On May 27, 2009, at 1:07 PM, Rutger Vos wrote:
>
>> Hi,
>>
>> Mark-Jason and I just met to discuss how to transfer data from DB2
>> (sdsc) to pg (nescent). We considered the following options:
>>
>> 1. DB2 uses an export file format called IXF, which pg doesn't
>> support. There are different versions of IXF, googling for tools that
>> might convert/import IXF only turns up things that look dodgy. An
>> unattractive possibility is that we write our own IXF parser.
>>
>> 2. Perhaps Hibernate has a facility to dump a database's contents  
>> to a
>> format that can be imported (say, select statements). You'd think  
>> that
>> Hibernate would have this, but we haven't found it.
>>
>> 3. Write our own exporter. Mark-Jason did some preliminary work on a
>> java-based "dump table to delimited file" exporter. Since we can run
>> DBD::DB2 on gigahertz.sdsc.edu we might do something along those  
>> lines
>> in perl. We note Hilmar's remarks about the dangers with this: need  
>> to
>> keep track of character encodings and escape sequences.
>>
>> I am now investigating option 2. We may have to open door 3, but we'd
>> like to hear your suggestions/remarks.
>>
>> Rutger
>>
>> --  
>> Dr. Rutger A. Vos
>> Department of zoology
>> University of British Columbia
>> http://www.nexml.org
>> http://rutgervos.blogspot.com
>>
>> ------------------------------------------------------------------------------
>> Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
>> is a gathering of tech-side developers & brand creativity
>> professionals. Meet
>> the minds behind Google Creative Lab, Visual Complexity,  
>> Processing, &
>> iPhoneDevCamp as they present alongside digital heavyweights like
>> Barbarian
>> Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com
>> _______________________________________________
>> Treebase-devel mailing list
>> Tre...@li...
>> https://lists.sourceforge.net/lists/listinfo/treebase-devel
>
>
>
>
>
> ------------------------------------------------------------------------------
> Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT
> is a gathering of tech-side developers & brand creativity  
> professionals. Meet
> the minds behind Google Creative Lab, Visual Complexity, Processing, &
> iPhoneDevCamp as they present alongside digital heavyweights like  
> Barbarian
> Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com
> _______________________________________________
> Treebase-devel mailing list
> Tre...@li...
> https://lists.sourceforge.net/lists/listinfo/treebase-devel