[OT] A free (as in freedom) replacement for StatTransfer

On Sun, 2007-12-09 at 12:26 +1100, Tim Churches wrote:

Marc Schwartz wrote:

Perhaps the most notable format that is lacking is the SAS proprietary
format (not the Transport format), which is not openly published and to
my knowledge, has not been independently reverse engineered.

The SAS proprietary dataset and format catalogue structures were
successfully reverse engineered by a small software firm called
Conceptual and were made available in a product called DBMS/Copy.
DBMS/Copy is/was similar to StatTransfer, but by 2002 was going a lot
further by adding support for much of the SAS data step syntax and some
core SAS procedures as well - in other words, it was rapidly becoming a
very viable and quite good pop person's SAS (with a modest one-off
license fee). However, the SAS Institute bought out the privately-held
Conceptual company, and now sells DBMS/Copy thhrough its wholly-owned
daat integration offshoot company, DataFlux, but without the SAS
datastep support features (to avoid competition with the mainstream SAS
cash cows) - see http://www.conceptual.com/

Any of the commercial products that support that format, with the
possible exception of the SAS System Viewer (which is not open source,
but is free from SAS), will be closed source and will have to be
purchased.

DBMS/Copy is definitely closed-source and is probably not nearly as
cheapl as it once was when sold by Conceptual. But it is a great product
for convert to or from SAS proprietary data sets and format catalogues,
and works well and quickly with even huge datasets.

I am familiar with DBMS/Copy as my company uses it. Single user Windows
licenses are not too bad (~$500 U.S.), but going beyond that gets
expensive quickly.

I was aware of the past corporate history of Conceptual and it's
transition to DataFlux/SAS, but not that the original developer (who's
name escapes me at the moment) had reverse engineered the SAS format. He
is a SAS employee now, working on other projects and the rumors
percolate out of Tech Support in Cary every now and then that DBMS/Copy
will be EOL'd. There have not been any updates/patches for version 8
since January of this year.

The product is problematic however, in that it will both open and write
SAS datasets that in actuality may not be readable by SAS itself. A
significant problem that caused us to actually have to purchase SAS
earlier this year to be able to validate aspects of a client data
transfer process and we don't use SAS for anything else.

Indeed, there is an inconsistency in the behavior of SAS, DBMS/Copy and
the SAS System Viewer when reading SAS datasets. Given that all three
are now under the purview of SAS, it is in some respects surprising and
in others, not so much.

Unfortunately, SAS is now bundling BASE, STAT and GRAPH as the entry
level offering, so one cannot just get BASE as a stand-alone product any
longer, which is all we needed. This makes the investment even more
expensive for those of us who have to purchase at full commercial
pricing.

Regards,

Marc