Skip to content

vsize and nsize

3 messages · Z. Todd Taylor, Tim Keitt, Ross Ihaka

#
Tony Long <tdlong at uci.edu> wrote:

            
R's poor handling of large datasets is half the reason I have
not moved more of my work from S(plus) to R (the other half
being the absence of trellis).  I love its lexical closures, but
they're not worth the memory penalty if you have huge datasets.

Maybe someday R will get something akin to Perl's 'tie'
mechanism that would allow practical analysis of huge
datasets.  Maybe that's not possible.

--Todd
#
I've written just such an interface.  It ties proxy objects (subclassed from
data.frame) to postgres tables (it should be easy to write drivers for any
rdbms).  The library needs a bit of cleaning up and documenting before I release
the package.  I did run into some significant problems trying to subclass the
data.frame type, but I think they can be fixed (the current version knows nothing
about R internals).

Tim
"Z. Todd Taylor" wrote:

            
--
Timothy H. Keitt
National Center for Ecological Analysis and Synthesis
735 State Street, Suite 300, Santa Barbara, CA 93101
Phone: 805-892-2519, FAX: 805-892-2510
http://www.nceas.ucsb.edu/~keitt/



-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: r-help-request at stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._
#
On Mon, 17 May 1999, Z. Todd Taylor wrote:

            
Both of these things are being worked on for R 1.0, but I can't give
any timeframe, sorry.  I have a design for the memory changes and have
begun implementation experiments.  Paul Murrell and some others are
thinking about a ``lattice'' graphics package -- the name ``trellis''
begin trademarked :-)

	Ross

-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: r-help-request at stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._