R, PostgresSQL and poor performance
On 12/02/2011 09:46 PM, Berry, David I. wrote:
Thanks for the reply and suggestions. I've tried the RpgSQL drivers and the results are pretty similar in terms of performance. The ~1.5M records I'm trying to read into R are being extracted from a table with ~300M rows (and ~60 columns) that has been indexed on the relevant columns and horizontally partitioned (with constraint checking on). I do need to try and optimize the database a bit more but I don?t think this is the cause of the performance issues.
With that much data you might want to consider PL/R: http://www.joeconway.com/plr/ HTH, Joe
Joe Conway credativ LLC: http://www.credativ.us Linux, PostgreSQL, and general Open Source Training, Service, Consulting, & 24x7 Support