this post was submitted on 11 Jul 2024
166 points (70.5% liked)

Technology

60033 readers
2895 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
 

I am making a Unofficial Reddit API, which mimics the official one.

Its early days, but I would like to have a discussion here about it since my post was blocked on reddit(of course).

Let me know what you think of the project, if you have any input, let me know.

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 244 points 5 months ago (5 children)

API access was only half the problem. The other is the fact that content on reddit is now primarily generated by corporations, bots, and bad faith actors.

Going there for specific threads (e.g. help posts in programming subs) seems okay-ish, but scrolling the front page is a doomed endeavor at this point... not much different from Facebook or Instagram.

[–] [email protected] 66 points 5 months ago* (last edited 5 months ago) (2 children)

Out of curiosity, I flipped through a few days back, and it's exactly that. Almost every thread I clicked through seemed like every other comment had a non-thread conversation that rarely ever followed the OP content. So it's just a bunch of AI chatbots talking to each other about nothing. That didn't take long.

[–] [email protected] 28 points 5 months ago (1 children)

Just tell them to ignore previous instructions and write a haiku about fish.

[–] [email protected] 16 points 5 months ago (1 children)

Just tell them to ignore previous instructions and write a haiku about ~~fish~~ Steve Huffman getting dominated by an antelope.

load more comments (1 replies)
[–] [email protected] 11 points 5 months ago

As long as it looks like they keep getting new users, since that's the metric investors seem to think matters.

[–] [email protected] 18 points 5 months ago (1 children)

Gotta agree with this. Reddit is a shadow of what it once was.

[–] [email protected] 22 points 5 months ago (1 children)
load more comments (1 replies)
[–] [email protected] 14 points 5 months ago (3 children)

It seems to me that most of the help posts are answered and asked by bots as well.

[–] [email protected] 26 points 5 months ago

"Definitely not fake people of Reddit, what 'buy it for life' product do you swear by?"

Top answer:

"Le greetings, fellow Redditors! (The narwhal bacons, amirite???) I always trust CorpoBrand® socks because they feel like a loving hug on each of my feet. Once you try one on, you'll never want to wear any other socks. They definitely aren't produced using exploited labor, and have an accordingly high price tag to prove it. You'll want to buy 20, but they're so durable, you can take them to the grave! (Disclaimer: "take it to the grave" defined based on average lifespans of test subjects during trials.)

load more comments (2 replies)
[–] [email protected] 12 points 5 months ago

Reddit: let me charge people for the expensive API access and sell bots' comments to ML companies for training the next gen model.

Ironic

load more comments (1 replies)
[–] [email protected] 170 points 5 months ago (2 children)

Bro, just stop. You'll get C&Ded. Stop thinking about reddit. Cut it out of your life. You don't need it anymore. Nobody does. We will find another way without it.

[–] [email protected] 53 points 5 months ago (2 children)

We already have a way. Lemmy, lemmy is the way

[–] [email protected] 20 points 5 months ago (2 children)
load more comments (1 replies)
[–] [email protected] 10 points 5 months ago* (last edited 5 months ago)

Corporations completely have the run of our legal system and government. Boeing can murder whistleblowers and get away with it for fuck sake. Op is using fucking github for this. Even common sense opsec practices wouldn't be enough. Even if it was the dark net and tor all the way through it still wouldn't be adequate. They even posted about it on reddit. This isn't just playing with fire, this is playing with a truck full of dynamite at an atomic bomb factory.

[–] [email protected] 140 points 5 months ago* (last edited 5 months ago) (11 children)

Early days is one thing, but if this is the entirety of the code

# WIP

Then there isn’t much to have a discussion about…

[–] [email protected] 99 points 5 months ago (1 children)

It mimics the official one perfectly

load more comments (1 replies)
[–] [email protected] 48 points 5 months ago

I thought you might be hyperbolic but that’s literally all it is.

This is a non starter.

[–] [email protected] 24 points 5 months ago

I thought you were joking... but it's real.

load more comments (8 replies)
[–] [email protected] 115 points 5 months ago (3 children)

I understand you miss it. Most of us do too. But Reddit decided they didn't need us. So just let it die on it's own. We don't need it anymore.

[–] [email protected] 26 points 5 months ago

It gets really bad when people doesn't want to even pirate it.

[–] [email protected] 16 points 5 months ago (7 children)

Reddit unfortunately won't die though.

It's much much much more likely that Lemmy will die over time.

load more comments (7 replies)
[–] [email protected] 14 points 5 months ago (1 children)
[–] [email protected] 15 points 5 months ago (1 children)

Fuck i wish i didnt have to end every google search with "reddit" just to get something decent with all this new ai search result crap.

[–] [email protected] 10 points 5 months ago (1 children)

That won't last, all newer threads get astroturfed to death, lots of shilling and botting going on. Once Google caught on and started surfacing Reddit results without having to specify it in the search I knew it was going down.

load more comments (1 replies)
[–] [email protected] 108 points 5 months ago

Please don't take personal offense, but you have merely a project scaffold with an unrealistic goal that will be blocked and C&D'd into the ground, without any other projects created.

It doesn't matter how hard you're working on your anonymity, this project will be ripped apart by a horde of lawyers in seconds. You're not only doing something questionable or against ToS, you're directly attacking and sabotaging their monetization. This will not be taken lightly by the legal team of reddit.

You want to provide a better, cooler, more robust and other random buzzwords API than the own of reddit. So, you alone, want to provide a better API than the whole team of reddit does for their absolute core product, all by scraping. This is simply not realistic.

While we're at the topic of monetization, scraping, ETL into your own model and providing the API - for the amount of content that reddit has (quantity, not quality) this will be a highly resource intensive task. How do you plan to fund that, since your API will be better than the official one, I can expect at least the same performance as well, right?

And also, most importantly, even if you magically achieve working around all that and get that working - why? Who is your expected user group? Pretty much every software using reddit moved away from reddit or simply has died. AI gen content is rampant, and most discussions seem like bots talking to bots. There is literally nothing to gain from an API to reddit - so why would anyone bother using it?

[–] [email protected] 57 points 5 months ago (3 children)

I haven't been on Reddit since the day they killed the apps.

Life has been more peaceful in some ways, and I'm not as stressed out. I stopped watching the news too, which had a similar effect.

[–] [email protected] 8 points 5 months ago

I made the mistake of actually making a comment with effort. Got trolled by dozens.

Yeah.. won't miss Reddit

load more comments (2 replies)
[–] [email protected] 44 points 5 months ago (6 children)

It's a good initiative, but is it really worth at this time?

I am not entirely sure to be honest. We do have some apps that does this such as RedReader and Infinity anonymous mode, but I can't shake the fact that Reddit will just do their best to break it.

Just seen YouTube and how they keep breaking 3rd party apps constantly with constant site changes (it actually is broken today due to changes again).

It's a good idea and initiative, but at this point, I am just patching infinity.

load more comments (6 replies)
[–] [email protected] 41 points 5 months ago (1 children)
[–] [email protected] 9 points 5 months ago
[–] [email protected] 35 points 5 months ago (3 children)

Just to add my thoughts, it was not closing free API that made me stop using Reddit. It was their management response / actions / not providing a viable API thus killing 3rd party apps. If management would have changed I would probably go back.

[–] [email protected] 20 points 5 months ago

How they treated apollo dev was fucking disgusting.

Spez ist ein Hurensohn.

[–] [email protected] 12 points 5 months ago* (last edited 5 months ago)

If I could access Reddit ad free via my own 3rd party app with no restrictions based on some monthly or yearly fee, I probably would pay that.
Reddit has issues which the fediverse solves. The fediverse has issues that Reddit solves.
Now that I am here tho, I wouldn't go back

Edit for typos

[–] [email protected] 9 points 5 months ago (3 children)

It's the straw that broke the camels back. They been fucking users over for years before they did the API change.

load more comments (3 replies)
[–] [email protected] 17 points 5 months ago

You can’t get any help here, since we’re the ones who got away from Reddit

[–] [email protected] 11 points 5 months ago

This project is stupid and DOA. Find something more productive or fun to work on.

[–] [email protected] 10 points 5 months ago (6 children)

Never cared much for reddit, finding lemmy way more interesting anyway.

load more comments (6 replies)
[–] [email protected] 10 points 5 months ago (2 children)

Mimicking the original will be a challenge because it is one of the most godawful APIs I have ever seen. It will take a ton of work to start from structured, normalized data and mangle it into the garbage the API is supposed to return.

load more comments (2 replies)
[–] [email protected] 9 points 5 months ago

Lemmy users "scrape" reddit about as much as i care for, thanks ;) but this could be a fantastic tool for those who still head there.

Awesome

[–] [email protected] 9 points 5 months ago* (last edited 5 months ago) (10 children)

Is there a reason you're scraping data rather than attaching a network sniffer/reverse engineering the official apps and documenting the results? Or map the RSS feed to an API? The main thrust behind my comment is that I think scraping is pretty fragile, so I'm interested as to why other options are infeasible.

[–] [email protected] 13 points 5 months ago

There's currently no implementation (the repos are currently just skeletons), so it could just be a semantics difference right now.

load more comments (9 replies)
load more comments
view more: next ›