From: sudhendra s. <sud...@ya...> - 2002-09-29 01:23:53
|
Hi I was wondering if there is something that could be done to extraction of bulk rows from the database. Here is a quick recap. I have datasources like SAP, Oracle, Sybase Siebel, flat files etc., I shall use the JDBC impl from the vendors in case of DAtabase and JCA Impl. for all others. I am using JCA from JBoss. When I extract from database, I set a prefetch buffer to extract 1000 rows or (whatever is scalable and fast to extract). But here I still have to iterate through large number of ResultSet. I was wondering if we can set the rowsize and directly read data (Inputstream) which can be transfered in a temprovary buffer or something. Basically JCA or JDBC for High speed extraction and Loading. Sicne this is just reading data and mostly Batch transfers, Is there a way, I can disable Transactions (Local and XA). I really need speed and nothing else. I do not want to be really in transactions, since I dont have to rollback or commit in a source database. Any inputs or help ot suggestions would be appreciated. This is probably a chance, if we could come out with a special request to optimize JDBC/JCA for high speed Extraction and Loading. (Reading and Writing large resultsets as a stream (chunkof data) ). With respect to SAP, Siebel etc., I am not really concerned right now... thanks sudhi ===== God Bless America __________________________________________________ Do you Yahoo!? New DSL Internet Access from SBC & Yahoo! http://sbc.yahoo.com |