From: Rushan C. <rc...@lu...> - 2007-05-03 21:41:02
|
Hi Emily, The projection(select list items) and filters(where clause) are not pushed through the JDBC. That's why the SQL showing up on the postgresql server has no where clause and selects every column. Is it possible to create views on the postgresql to divide the original big table into smaller chunks and load them into LucidDb? In your script, the definition of habc_transformation_schema.location_view will have to be UNIONs of these source views. Hope this helps. Rushan Emily Gouge wrote: > > As a workaround, you could try loading the data in large chunks of rows > > via a WHERE clause on some partitioning key (if there is one in the > > source data). > > I tried this, however I am still getting Java heap space errors. This query should return only one row. > > select "x","y", "ecosec_v2_code", "lwdpbc_code", "bececolwd_v2_code", "dra_code" from > habc_extraction_schema."master_grid" where "x" = 0 and"y" = 0; > > causes: > Error: java.lang.OutOfMemoryError: Java heap space (state=,code=0) > > > I have noticed that adding the where clause to the query does not change the query being run on the > postgresql database. Both cases cause a "SELECT * FROM "habc"."master_grid"" query to be run on the > postgresql database with no where clause. > > Any ideas on how the query: > select "x","y", "ecosec_v2_code", "lwdpbc_code", "bececolwd_v2_code", "dra_code" from > habc_extraction_schema."master_grid" where "x" = 0 and"y" = 0; > > is being converted to a: > select * from "habc"."master_grid" > > Thanks again. > > > > > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by DB2 Express > Download DB2 Express C - the FREE version of DB2 express and take > control of your XML. No limits. Just data. Click to get it now. > http://sourceforge.net/powerbar/db2/ > _______________________________________________ > luciddb-users mailing list > luc...@li... > https://lists.sourceforge.net/lists/listinfo/luciddb-users > |