|
|
02ea5c7ee3
|
fix rounding errors in elapsed time in logs
|
2024-04-29 17:25:21 -04:00 |
|
|
|
b6c82eb4f5
|
batch-e621: just use tags array in JSON
|
2024-04-25 18:08:20 -04:00 |
|
|
|
4f7f2ca7fe
|
add time since startup to logs
|
2024-04-04 20:00:32 -04:00 |
|
|
|
af0ed03467
|
batch-*: make tag aliasing code a little clearer
|
2024-03-29 09:18:13 -04:00 |
|
|
|
42c1e57eb7
|
improve path behavior on Windows
|
2024-03-27 18:29:29 -04:00 |
|
|
|
6c76a14448
|
limit to 32 concurrent file downloads
|
2024-03-27 17:47:50 -04:00 |
|
|
|
21f56991ac
|
batch-*: do not count downloads made by a concurrent instance
|
2024-03-25 08:05:48 -04:00 |
|
|
|
ad42d2a820
|
batch-e621: allow searching for unknown/invalid tags
|
2024-03-24 21:05:40 -04:00 |
|
|
|
ed3c8bcc00
|
move fetch options to own directory; only send special user-agent to e621 API
|
2024-03-24 17:05:30 -04:00 |
|
|
|
b8f5929b07
|
dl-rule34: use api.rule34.xxx
|
2024-03-24 16:30:58 -04:00 |
|
|
|
55ad4391a7
|
move binaries into bin directory
|
2024-03-24 16:14:30 -04:00 |
|
|
|
bff80e3fd3
|
retry downloads on error while streaming to file
|
2024-03-24 14:07:28 -04:00 |
|
|
|
c3eb4512cf
|
batch-allthefallen: improve multiple tag handling
|
2024-03-24 09:31:20 -04:00 |
|
|
|
e0f8446d1f
|
batch-allthefallen/dl-allthefallen: add initial version
|
2024-03-24 02:29:13 -04:00 |
|
|
|
42530b7b20
|
dl-*: ignore files with no URL
|
2024-03-24 02:27:45 -04:00 |
|
|
|
6a1464574d
|
batch-*: default to decoding URL-escaped characters in directory names
|
2024-03-24 02:27:23 -04:00 |
|
|
|
06791a1baf
|
rename project to fetch-booru
|
2024-03-23 19:17:41 -04:00 |
|
|
|
c6e1f31cec
|
batch-e621/dl-e621: factor out handling API responses
|
2024-03-23 19:04:46 -04:00 |
|
|
|
462d118367
|
batch-e621/aug-e621: adjust db dump processing
|
2024-03-23 17:21:42 -04:00 |
|
|
|
d554498a15
|
return true from done() if there were no errors
|
2024-03-23 15:21:46 -04:00 |
|
|
|
24d4f7cac7
|
dl-*: avoid trying to create directory for every file
|
2024-03-23 14:29:38 -04:00 |
|
|
|
c4faeb6a8a
|
retry fetch on network errors
|
2024-03-23 11:25:46 -04:00 |
|
|
|
eee96cb7ca
|
batch-e621/aug-e621: determine current dump by datetime rather than querying server
|
2024-03-23 05:43:35 -04:00 |
|
|
|
847daf7315
|
extract mkdir into dl.js
|
2024-03-21 22:20:29 -04:00 |
|
|
|
f460f62a3a
|
dl-inkbunny: add initial version
|
2024-03-21 22:10:13 -04:00 |
|
|
|
c3e223c596
|
aug-e621: rework
|
2024-03-21 22:08:34 -04:00 |
|
|
|
1f59badc73
|
remove reference to USE_WGET environment variable
|
2024-03-21 22:08:04 -04:00 |
|
|
|
20931c715a
|
batch-inkbunny: rework etc
|
2024-03-21 22:07:35 -04:00 |
|
|
|
4d987f95c8
|
dl-rule34/dl-tbib: rework
|
2024-03-21 22:06:32 -04:00 |
|
|
|
8140cd32bc
|
dl-e621: rework and extract additional shared e621 code
|
2024-03-21 22:05:23 -04:00 |
|
|
|
62a4d0500c
|
batch-inkbunny: add initial version
|
2024-03-17 10:51:49 -04:00 |
|
|
|
6125f52a3e
|
batch-e621: port over custom fetch options feature
|
2024-03-16 23:19:04 -04:00 |
|
|
|
e9b7741781
|
batch-e621: refactor
|
2024-03-16 21:58:32 -04:00 |
|
|
|
81c067025e
|
batch-e621: improve performance of handling CSV column names
|
2024-03-16 18:20:28 -04:00 |
|
|
|
99934c3a8c
|
batch-e621: only download db_export index page once
|
2024-03-16 11:29:37 -04:00 |
|
|
|
64a149930a
|
batch-e621: warn about tags the database doesn't know about
|
2024-03-16 10:54:44 -04:00 |
|
|
|
747813a85b
|
avoid converting web streams to Node streams
|
2024-03-15 18:50:09 -04:00 |
|
|
|
9f2ed5577d
|
batch-e621: avoid downloading same file multiple times in parallel
|
2024-03-15 12:30:47 -04:00 |
|
|
|
bd9cf8f283
|
batch-e621: avoid converting Node stream to web stream
|
2024-03-15 08:48:07 -04:00 |
|
|
|
dd22118430
|
batch-e621: prevent copy-to-self error when post is in both API response and CSV
|
2024-03-14 20:01:05 -04:00 |
|
|
|
833ac2adee
|
batch-e621: download/copy files in parallel
|
2024-03-14 07:07:34 -04:00 |
|
|
|
9f161235d8
|
batch-e621: add initial version
|
2024-03-13 18:06:07 -04:00 |
|
|
|
af92d46fdd
|
remove dl-furrybooru
|
2024-03-13 13:26:09 -04:00 |
|
|
|
b39947face
|
allow directory names to be URI encoded tag names
This provides better support for special queries containing ":" characters, for example.
|
2023-12-27 06:59:04 -05:00 |
|
|
|
393edeba2c
|
retry on 429 responses
|
2023-09-28 22:18:50 -04:00 |
|
|
|
8657712a20
|
add missing package-lock.json exception to .gitignore
|
2023-09-06 11:15:54 -04:00 |
|
|
|
81327664a2
|
do not readdir when there are no posts
|
2023-09-05 18:11:02 -04:00 |
|
|
|
f225084c94
|
update to package-lock.json version 3
|
2023-09-05 15:39:47 -04:00 |
|
|
|
4273af2ba6
|
readdir target directory rather than checking whether each file exists
|
2023-09-04 07:20:05 -04:00 |
|
|
|
7a3c394d46
|
add USE_WGET workaround
|
2023-09-04 06:52:26 -04:00 |
|
