Commit Graph

47 Commits

Author SHA1 Message Date
Conduitry b39947face allow directory names to be URI encoded tag names
This provides better support for special queries containing ":" characters, for example.
2023-12-27 06:59:04 -05:00
Conduitry 393edeba2c retry on 429 responses 2023-09-28 22:18:50 -04:00
Conduitry 8657712a20 add missing package-lock.json exception to .gitignore 2023-09-06 11:15:54 -04:00
Conduitry 81327664a2 do not readdir when there are no posts 2023-09-05 18:11:02 -04:00
Conduitry f225084c94 update to package-lock.json version 3 2023-09-05 15:39:47 -04:00
Conduitry 4273af2ba6 readdir target directory rather than checking whether each file exists 2023-09-04 07:20:05 -04:00
Conduitry 7a3c394d46 add USE_WGET workaround 2023-09-04 06:52:26 -04:00
Conduitry 3ae54e22fe adjust naming of temporary files 2023-02-17 08:48:41 -05:00
Conduitry ad373fa4e6 add dl-tbib 2023-02-09 08:57:31 -05:00
Conduitry 0f1ff32170 support md5 and id queries in boorus 2023-02-08 23:53:27 -05:00
Conduitry 1fca797207 retry requests returning 5xx after 5 seconds 2023-01-24 17:44:34 -05:00
Conduitry 92fb64675a avoid 3/10,000,000 event 2022-12-11 07:08:47 -05:00
Conduitry 6de122ed6b ignore malformed [hostname].json file 2022-12-10 23:53:48 -05:00
Conduitry 506e2f0e2f move fetch options to [hostname].json 2022-12-10 15:10:03 -05:00
Conduitry b3aafd4cc4 remove ExperimentalWarning suppression 2022-11-16 22:12:48 -05:00
Conduitry 5e5b2fca96 simplify output for non-TTY 2022-06-26 20:37:02 -04:00
Conduitry 988b49b9ae add dl-rule34 2022-06-19 22:39:34 -04:00
Conduitry a1cfa60e51 factor out shared booru code 2022-06-19 22:39:10 -04:00
Conduitry 95983cbffe rework directory/query handling in aug-*
aug-e621: support moving/renaming files for non-deleted posts
2022-06-16 20:14:02 -04:00
Conduitry dd05ab91b3 dl-e621: support downloading posts by ID or MD5 2022-06-16 20:11:38 -04:00
Conduitry d472b8e360 rework directory/query handling in dl-* 2022-06-16 20:11:15 -04:00
Conduitry 37b0663e5f stream responses to files rather than buffering them 2022-06-15 09:01:40 -04:00
Conduitry 49e14fd008 add initial version of aug-e621 2022-06-15 03:55:13 -04:00
Conduitry 92566da2d3 rename _dl.js to _shared.js 2022-06-15 03:51:22 -04:00
Conduitry eca076a091 export get function rather than passing it 2022-06-14 21:07:45 -04:00
Conduitry 51b4a3aa45 factor out naming directory after query 2022-06-14 20:58:32 -04:00
Conduitry b2977c2ecf refactor fetch options loading 2022-06-14 13:19:44 -04:00
Conduitry 16d48852f1 refactor: look up fetch options per request 2022-06-13 19:08:48 -04:00
Conduitry 6a278ec527 mention dl-*.fetch-options.json in readme 2022-06-13 08:12:07 -04:00
Conduitry 635ad1b3b6 tidy for loops 2022-06-11 08:23:08 -04:00
Conduitry de2febf6d9 use MD5 hash as filename in dl-furrybooru 2022-06-11 07:26:49 -04:00
Conduitry 67973ed59a tidy 2022-06-08 08:34:42 -04:00
Conduitry eafe5a35f7 rework loadiing of fetch options 2022-06-07 19:45:27 -04:00
Conduitry fa407c99aa tidy progress output 2022-06-05 23:49:17 -04:00
Conduitry 865255894c use regex capturing groups in dl-furrybooru 2022-06-05 23:11:48 -04:00
Conduitry 75bfadaf74 refactor 2022-06-05 20:27:46 -04:00
Conduitry 40bc42c170 support headers file in dl-e621 as well 2022-06-05 16:17:44 -04:00
Conduitry 79ada02977 add initial version of dl-furrybooru 2022-06-05 16:05:58 -04:00
Conduitry cbd47412f0 ignore dl-*.headers.js files 2022-06-05 15:36:54 -04:00
Conduitry a07573b421 support passing options into _shared.js to use for all fetches 2022-06-05 15:36:25 -04:00
Conduitry 20120154df improve console output in dl-e621 2022-06-05 06:04:38 -04:00
Conduitry 0c110b5498 DRY fetch calls in _shared.js 2022-06-04 10:08:28 -04:00
Conduitry c012e496ff suppress ExperimentalWarning about fetch 2022-06-04 09:58:53 -04:00
Conduitry e4253463a4 move more filesystem handling into _shared.js 2022-06-04 06:48:20 -04:00
Conduitry 88b945ad54 add initial version of dl-e621 2022-06-03 23:03:17 -04:00
Conduitry df77951791 add ESLint config 2022-06-03 22:34:54 -04:00
Conduitry 67a1a6b2a8 initial commit 2022-06-03 22:33:21 -04:00