Dear List members, maybe this is not the right place to ask, if that is the case, please forward me to the right place. I developed some functions to download and transform football/soccer related data from transfermarkt.com. There are plans to create my first package based on these functions and of course develop them and add more later. As far as I know there is no API to that page, so I am using the rvest package. My question is: is this an OK thing to do? Should I contact transfermarkt.com? My german is not perfect (just like my english), this is what I've found on thier webpage. Does that mean one can not create a package related to that page? Or can't crawl at all? Or just not allowed to sell the data? If it is allowed, can one post the package on CRAN at the end? Please if any of you have experience in that or just show me where to ask, do not hesitate! LEGAL NOTICE ? Transfermarkt GmbH & Co. KG 2000-2018 All rights reserved. Der Inhalt dieser Website ist urheberrechtlich gesch?tzt. Nachdruck, Aufnahme in Online-Dienste, Internet und Vervielf?ltigung auf Datentr?ger wie CD-ROM, DVD-ROM usw. d?rfen, auch auszugsweise, nur nach vorheriger schriftlicher Zustimmung durch Transfermarkt erfolgen. Eine kommerzielle Weitervermarktung des Inhalts ist untersagt. Transfermarkt haftet nicht f?r unverlangt eingesandte Inhalte, Manuskripte und Fotos. F?r Inhalte externer Links und fremde Inhalte ?bernimmt Transfermarkt keine Verantwortung. Thank you for all your insights and/or comments, best regards Daniel Dr. KEHL D?niel adjunktus P?CSI TUDOM?NYEGYETEM K?ZGAZDAS?GTUDOM?NYI KAR K?zgazdas?gtan ?s ?konometria Int?zet H-7622 P?cs, R?k?czi ?t 80. | www.ktk.pte.hu +36 72 501 599/ 23144 | kehld at ktk.pte.hu
[R-pkg-devel] new package? - Sports data from transfermarkt.com using rvest
3 messages · Kehl Dániel, Thierry Onkelinx, Peter Meissner
Dear Daniel, First of all you need to make sure that the licence of transfermarkt.com allows the usage that you have intended. If that is not clear from their website, then you should contact them rather than us. CRAN has several packages to assists in downloading data from online sources. But the source has to allow that kind of usage. Best regards, ir. Thierry Onkelinx Statisticus / Statistician Vlaamse Overheid / Government of Flanders INSTITUUT VOOR NATUUR- EN BOSONDERZOEK / RESEARCH INSTITUTE FOR NATURE AND FOREST Team Biometrie & Kwaliteitszorg / Team Biometrics & Quality Assurance thierry.onkelinx at inbo.be Havenlaan 88 bus 73, 1000 Brussel www.inbo.be /////////////////////////////////////////////////////////////////////////////////////////// To call in the statistician after the experiment is done may be no more than asking him to perform a post-mortem examination: he may be able to say what the experiment died of. ~ Sir Ronald Aylmer Fisher The plural of anecdote is not data. ~ Roger Brinner The combination of some data and an aching desire for an answer does not ensure that a reasonable answer can be extracted from a given body of data. ~ John Tukey /////////////////////////////////////////////////////////////////////////////////////////// 2018-01-23 16:27 GMT+01:00 Kehl D?niel <kehld at ktk.pte.hu>:
Dear List members, maybe this is not the right place to ask, if that is the case, please forward me to the right place. I developed some functions to download and transform football/soccer related data from transfermarkt.com. There are plans to create my first package based on these functions and of course develop them and add more later. As far as I know there is no API to that page, so I am using the rvest package. My question is: is this an OK thing to do? Should I contact transfermarkt.com? My german is not perfect (just like my english), this is what I've found on thier webpage. Does that mean one can not create a package related to that page? Or can't crawl at all? Or just not allowed to sell the data? If it is allowed, can one post the package on CRAN at the end? Please if any of you have experience in that or just show me where to ask, do not hesitate! LEGAL NOTICE ? Transfermarkt GmbH & Co. KG 2000-2018 All rights reserved. Der Inhalt dieser Website ist urheberrechtlich gesch?tzt. Nachdruck, Aufnahme in Online-Dienste, Internet und Vervielf?ltigung auf Datentr?ger wie CD-ROM, DVD-ROM usw. d?rfen, auch auszugsweise, nur nach vorheriger schriftlicher Zustimmung durch Transfermarkt erfolgen. Eine kommerzielle Weitervermarktung des Inhalts ist untersagt. Transfermarkt haftet nicht f?r unverlangt eingesandte Inhalte, Manuskripte und Fotos. F?r Inhalte externer Links und fremde Inhalte ?bernimmt Transfermarkt keine Verantwortung. Thank you for all your insights and/or comments, best regards Daniel Dr. KEHL D?niel adjunktus P?CSI TUDOM?NYEGYETEM K?ZGAZDAS?GTUDOM?NYI KAR K?zgazdas?gtan ?s ?konometria Int?zet H-7622 P?cs, R?k?czi ?t 80. | www.ktk.pte.hu +36 72 501 599/ 23144 | kehld at ktk.pte.hu
______________________________________________ R-package-devel at r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-package-devel
Hey, I am not a laywer but their terms are quite explicitly prohibiting redistribution of their data without written consent. Now you might build a package that does not collect, store and redistributes the data but only allows to access the data provided there 'live' via some convenience functions. But I don't really know if that argument actually is valid in any legal sense. To be on the safe side, you probably should contact them. Best, Peter Am 24.01.2018 12:13 nachm. schrieb "Thierry Onkelinx" < thierry.onkelinx at inbo.be>:
Dear Daniel, First of all you need to make sure that the licence of transfermarkt.com allows the usage that you have intended. If that is not clear from their website, then you should contact them rather than us. CRAN has several packages to assists in downloading data from online sources. But the source has to allow that kind of usage. Best regards, ir. Thierry Onkelinx Statisticus / Statistician Vlaamse Overheid / Government of Flanders INSTITUUT VOOR NATUUR- EN BOSONDERZOEK / RESEARCH INSTITUTE FOR NATURE AND FOREST Team Biometrie & Kwaliteitszorg / Team Biometrics & Quality Assurance thierry.onkelinx at inbo.be Havenlaan 88 bus 73, 1000 Brussel www.inbo.be //////////////////////////////////////////////////////////// /////////////////////////////// To call in the statistician after the experiment is done may be no more than asking him to perform a post-mortem examination: he may be able to say what the experiment died of. ~ Sir Ronald Aylmer Fisher The plural of anecdote is not data. ~ Roger Brinner The combination of some data and an aching desire for an answer does not ensure that a reasonable answer can be extracted from a given body of data. ~ John Tukey //////////////////////////////////////////////////////////// /////////////////////////////// 2018-01-23 16:27 GMT+01:00 Kehl D?niel <kehld at ktk.pte.hu>:
Dear List members, maybe this is not the right place to ask, if that is the case, please
forward me to the right place.
I developed some functions to download and transform football/soccer
related data from transfermarkt.com.
There are plans to create my first package based on these functions and
of course develop them and add more later. As far as I know there is no API to that page, so I am using the rvest package.
My question is: is this an OK thing to do? Should I contact
transfermarkt.com? My german is not perfect (just like my english), this is what I've found on thier webpage. Does that mean one can not create a package related to that page? Or can't crawl at all? Or just not allowed to sell the data? If it is allowed, can one post the package on CRAN at the end?
Please if any of you have experience in that or just show me where to
ask, do not hesitate!
LEGAL NOTICE ? Transfermarkt GmbH & Co. KG 2000-2018 All rights reserved. Der Inhalt dieser Website ist urheberrechtlich gesch?tzt. Nachdruck,
Aufnahme in Online-Dienste, Internet und Vervielf?ltigung auf Datentr?ger wie CD-ROM, DVD-ROM usw. d?rfen, auch auszugsweise, nur nach vorheriger schriftlicher Zustimmung durch Transfermarkt erfolgen. Eine kommerzielle Weitervermarktung des Inhalts ist untersagt.
Transfermarkt haftet nicht f?r unverlangt eingesandte Inhalte,
Manuskripte und Fotos. F?r Inhalte externer Links und fremde Inhalte ?bernimmt Transfermarkt keine Verantwortung.
Thank you for all your insights and/or comments, best regards Daniel Dr. KEHL D?niel adjunktus P?CSI TUDOM?NYEGYETEM K?ZGAZDAS?GTUDOM?NYI KAR K?zgazdas?gtan ?s ?konometria Int?zet H-7622 P?cs, R?k?czi ?t 80. | www.ktk.pte.hu +36 72 501 599/ 23144 | kehld at ktk.pte.hu
______________________________________________ R-package-devel at r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-package-devel
______________________________________________ R-package-devel at r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-package-devel