Message-ID: <4ED962B1.1080703@joeconway.com>
Date: 2011-12-02T23:43:45Z
From: Joe Conway
Subject: R, PostgresSQL and poor performance
In-Reply-To: <CAFE83AD.3B73%dyb@noc.ac.uk>
On 12/02/2011 09:46 PM, Berry, David I. wrote:
> Thanks for the reply and suggestions. I've tried the RpgSQL drivers and
> the results are pretty similar in terms of performance.
>
> The ~1.5M records I'm trying to read into R are being extracted from a
> table with ~300M rows (and ~60 columns) that has been indexed on the
> relevant columns and horizontally partitioned (with constraint checking
> on). I do need to try and optimize the database a bit more but I don?t
> think this is the cause of the performance issues.
With that much data you might want to consider PL/R:
http://www.joeconway.com/plr/
HTH,
Joe
--
Joe Conway
credativ LLC: http://www.credativ.us
Linux, PostgreSQL, and general Open Source
Training, Service, Consulting, & 24x7 Support