Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

54462 readers

272 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others

Loot, Pillage, & Plunder

📜 c/Piracy Wiki (Community Edition):

💰 Please help cover server costs.


Ko-fi	Liberapay

founded 1 year ago

MODERATORS

[email protected]

Interest in a Kemono/Coomer scraper? (lemmy.world)

submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]

5 comments fedilink hide all child comments

Hello Lemmy piracy subreddit,

Posting this here as the reddit sub has a karma threshold which I don't meet and can't be bothered to pander to.

I've written 2 GUI-bases programs that were originally CLI as a personal project. These programs allow you to batch download posts from a single creator on the party networks Kemono and Coomer. Both feature an automatic translation toggle allowing all posts and the creators name to be translated (uses Google translate API) and has various config options.

Considering this was a relatively simple and straightforward tool, I feel it's a bit niche and thus am asking the community whether they would like this program to be released. If enough people want it, then I'll release it publically as long as the kemono and Coomer devs are fine with it. The tools don't really do any aggressive behaviors as it mimics an actual user as much as possible (selenium is not used here for the nerds reading, only raw GET requests) and doesn't tax kemono/Coomer servers to my knowledge. If this is incorrect then I obviously will revoke the release if applicable.

Please let me know in the comments if this is something you'd be interested in using, or if this is too niche of a program.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 1 year ago* (last edited 1 year ago)

From a programming standpoint kemono is a bit harder to pull off because they use a lot of archivers and have more foreign creators as the most popular results

However yes, it's a relatively simple program from a programming standpoint, however I tried to make the GUIs as QoL as possible with multithreading and a file downloading lib that allows fast and efficient multipart downloading which circumvents a lot of RAM requirements if the entire download is stored into RAM (such is the case with the C# REST library)

Another benefit of kemono is that it isn't STRICTLY for pornographic content and has a variety of patreon files which my scraper also supports. Currently only discord is unsupported at the moment solely because parsing the HTML is extremely annoying as they basically piggybacked the actual discord service's URL scheme