request for examples
On Mon, 13 May 2002, Paul Murrell wrote:
Hi I hope you don't mind this "cold call", but this seems like a really good place to contact people with interest/experience/expertise in stats and databases ... I am busy producing a course on statistical computing for stage II students (to be delivered in the second half of this year). I will be teaching them about some databases issues: advantages of databases as a way to store information, how to design databases properly, how to retrieve information using SQL. What I am seriously lacking are some killer examples. Would anyone be able to help me with any of the following ... (i) killer examples where a database is clearly a superior method of storing information than, say, plain text files or spreadsheets or statistical-package-specific formats
That's true of almost all data mining applications. Think about a supermarket chain collecting information on all transactions at tills. Reasons include scale (as above), integrity of data coming from multiple sources (also as above) and security (most organizations' financial data is in databases). Related to scale is efficiency: lots of preprocessing (indices etc) makes online queries possible. Another good example is an online transaction system such as airlines' booking systems and those behind banks' ATM networks. Or, since, I have just been browsing one, large discussion forums, web search engines ....
From memory, Hand, Mannila, Smyth (2001) Principles of Data Mining
MIT Press, is a good source for statistics/databases interaction.
(ii) an actual real-life statistical database that could be copied to a local server for the students to practise accessing
On what DBMS?
(iii) killer examples where an important data source is stored in a database therefore requiring something like SQL knowledge to get access to the information.
(Many) pharamaceuticals have their gene chip data stored in databases. We had to set up Oracle lite and get help (thanks Fei) to get some results out last year. Insurance companies have all their claims data on databases, and MSc summer projects have been 25% taken up extracting the data. Yet another one was work on university admissions data: both locally and nationally that was on a database, and about 70,000 records were extracted to a spreadsheet. (And that was just one year's data.) Brian
Brian D. Ripley, ripley at stats.ox.ac.uk Professor of Applied Statistics, http://www.stats.ox.ac.uk/~ripley/ University of Oxford, Tel: +44 1865 272861 (self) 1 South Parks Road, +44 1865 272860 (secr) Oxford OX1 3TG, UK Fax: +44 1865 272595