Commit Graph

14 Commits

Author SHA1 Message Date
Ivan Habunek
f57612ffcc
Refactor download_all to work when count is unknown 2024-08-30 07:37:50 +02:00
Ivan Habunek
07efac1ae7
Add --verbose flag for verbose logging
Don't log HTTP payloads unless --verbose flag is given. Always logging
HTTP payloads tends to make the log unreadable.
2024-08-28 12:58:36 +02:00
Ivan Habunek
a808b7d8ec
Don't check if file exists in download_file
This is done outside the function.
2024-08-28 12:39:56 +02:00
Ivan Habunek
936c6a9da1
Don't stop downloading if one download fails 2024-08-28 12:33:05 +02:00
Ivan Habunek
7184feacee
Move download_file to http 2024-08-28 11:07:25 +02:00
Ivan Habunek
1658aba124
Embrace pathlib 2024-08-28 10:59:23 +02:00
Ivan Habunek
28f1977d1c
Apply ruff formatting 2024-04-04 08:20:10 +02:00
Ivan Habunek
8592c41a50
Use an abstract base class for TokenBucket 2024-03-23 07:56:50 +01:00
Eliyahu Duvidzon
533c91d133 Removing positional-only arguments for compatibility with Python 3.7 2022-11-20 15:26:32 +01:00
Ivan Habunek
c9ab6237e8
Don't rename the file while it's still open
issue #111
2022-09-09 08:05:03 +02:00
Ivan Habunek
a4b2434735
Start adding types 2022-08-20 13:25:00 +02:00
Ivan Habunek
cd445674e5
Download chunks to a temp file first 2022-08-14 11:33:23 +02:00
Ivan Habunek
81846764a1
Don't download already downloaded files 2022-08-14 10:21:38 +02:00
Ivan Habunek
23f1a74aa6
Add new asyncio downloader code with rate limiting 2022-08-13 11:41:13 +02:00