Python download file requests and save file

Dennis Patterson Dennis Patterson 1 1 silver badge 11 11 bronze badges. Can you show an example with my code in the question? Code was tested with this url: imagecomics. Dennis Patterson you are mixing up bits and bytes on your calculation. Also a buffer size of 1KB is pretty small for the typical file size and bandwidth nowadays: You do not want to choke the download just to print progress several times per second! Also you are multiplying by instead of dividing by to get the total bytes downloaded: What's the logic behind that?

S: Also it'd be best to just accumulate len chunk for accuracy on total bytes downloaded or at least adjust for last chunk's length — NotGaeL. To add on, you probably want to do a os. Add a comment.

The Overflow Blog. Introducing Content Health, a new way to keep the knowledge base up-to-date. I will be using the god-send library requests for it.

I will write about methods to correctly download binaries from URLs and set their filenames. Requests is a versatile HTTP library in python with various applications.

One of its applications is to download a file from web using the file URL. Installation: First of all, you would need to download the requests library. Download images from Google Image search using Python - gist Writing response to file When writing responses to file you need to use the open function with the appropriate file write mode. For text responses you need to use "w" - plain write mode.

For binary responses you need to use "wb" - binary write mode. Response In [4]: type r. Sait Sait I don't think you answered OP's question. How to save that in a file.

All you did was describe r — pauljohn Sign up or log in Sign up using Google. Sign up using Facebook. Sign up using Email and Password. Post as a guest Name. Email Required, but never shown. The Overflow Blog. So if the file is large, this will do nothing but waste bandwidth. I looked into the requests documentation and found a better way to do it. That way involved just fetching the headers of a url before actually downloading it. This allows us to skip downloading files which weren't meant to be downloaded.

To restrict download by file size, we can get the filesize from the Content-Length header and then do suitable comparisons. We can parse the url to get the filename. This will be give the filename in some cases correctly. However, there are times when the filename information is not present in the url.

In that case, the Content-Disposition header will contain the filename information. Here is how to fetch it. The url-parsing code in conjuction with the above method to get filename from Content-Disposition header will work for most of the cases.