Skip to content

download.file() yields incomplete files with method="internal"

3 messages · Jan.Kleinn at partnerre.com, Johannes Ranke, Bill Dunlap

Original
Jan.Kleinn at partnerre.com
# 
Dear all,

as the bug # 7991 is flagged not-reproducible, let me give you some pieces
of code, as I have the same or similar problem. The problem always shows up
with the first example (a small text file) and only sometimes (but without
obvious pattern) with the second example, which is a binary file.
"C:/temp/bal012006.dat", method = 'internal', mode = 'w', cacheOK = FALSE)
trying URL 'ftp://ftp.nhc.noaa.gov/pub/atcf/btk/bal012006.dat'
ftp data connection made, file length 5110 bytes
opened URL
downloaded 0 bytes

Warning message:
downloaded length 0 != reported length 5110
download.file("ftp://ftp.nhc.noaa.gov/pub/atcf/aid_public/aal012006.dat.gz",
 "C:/temp/aal012006.dat.gz", method = 'internal', mode = 'wb', cacheOK =
FALSE)
trying URL 'ftp://ftp.nhc.noaa.gov/pub/atcf/aid_public/aal012006.dat.gz'
ftp data connection made, file length 173760 bytes
opened URL
downloaded 155Kb

Warning message:
downloaded length 159140 != reported length 173760


Finally, is the spec of the system I'm working on:
_
platform       i386-pc-mingw32
arch           i386
os             mingw32
system         i386, mingw32
status
major          2
minor          3.1
year           2006
month          06
day            01
svn rev        38247
language       R
version.string Version 2.3.1 (2006-06-01)
[1] "Windows XP Professional (build 2600) Service Pack 2.0"


Many thanks in advance and best regards,
Jan
Johannes Ranke
# 
Hi Jan!

* Jan.Kleinn at partnerre.com <Jan.Kleinn at partnerre.com> [060615 15:10]:
when I tried the first example (Windows NT, R 2.3.1), it worked
correctly two times, and then gave exactly the error message you cited
in the third run.

The second example worked once, and then gave the behaviour cited by
you, only the downloaded length differed. Specs:
_                         
platform       i386-pc-mingw32           
arch           i386                      
os             mingw32                   
system         i386, mingw32             
status                                   
major          2                         
minor          3.1                       
year           2006                      
month          06                        
day            01                        
svn rev        38247                     
language       R                         
version.string Version 2.3.1 (2006-06-01)
[1] "Windows NT 4.0 (build 1381) Service Pack 6"

No problems on Linux, R 2.3.1 (after replacing "C:/temp" by /tmp/).

Regards,

Johannes

  
    

      
      
    

  


  


      

    

    

      
      

        


  

        

      Bill Dunlap
    

    

      
      #
    

  


  

      
On Thu, 15 Jun 2006 Jan.Kleinn at partnerre.com wrote:

        

            

      
      
      
    

        
Two versions of curl (7.10.6 and 7.15.1) on my Linux
box fail on this ftp server also.  They timeout when
starting "Extended Passive Mode".  Does this sort of
failure indicate a firewall is getting in the way?

   % curl --version
   curl 7.10.6 (i386-redhat-linux-gnu) libcurl/7.10.6 OpenSSL/0.9.7a ipv6 zlib/1.1.4
   Protocols: ftp gopher telnet dict ldap http file https ftps
   Features: IPv6 SSL libz NTLM
   % /usr/bin/curl --verbose --output /tmp/junk ftp://ftp.nhc.noaa.gov/pub/atcf/btk/bal012006.dat
   * About to connect() to ftp.nhc.noaa.gov:21
   * Connected to dogfish.nhc.noaa.gov (140.90.48.37) port 21
   ... login warning messages and PWD's ...
    < 229 Entering Extended Passive Mode (|||36993|)
   * About to connect() to ftp.nhc.noaa.gov:36993
   ... long wait ...
    * socket error: 110
   * Connected the data stream with PASV!
   curl: (7) socket error: 110
   * Closing connection #0

This doesn't look like a good site for testing.  It login
message starts with

   < 220-**WARNING**WARNING**WARNING**
   < 220-
   < 220-This is a United States (DOC/NOAA/NCEP) computer system, which may be
   < 220-accessed and used only for official Government business by authorized
   < 220-personnel. Unauthorized access or use of this computer system may
   < 220-subject violators to criminal, civil, and/or administrative action.

            

      
      
      
    

        

      
      
    

        
----------------------------------------------------------------------------
Bill Dunlap
Insightful Corporation
bill at insightful dot com
360-428-8146

 "All statements in this message represent the opinions of the author and do
 not necessarily reflect Insightful Corporation policy or position."