this post was submitted on 08 Sep 2023
339 points (94.3% liked)

Technology

68189 readers
4906 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
339
X updates its Terms to prohibit crawling/scraping of its data (stackdiary.com)
submitted 2 years ago by [email protected] to c/[email protected]
50 comments fedilink hide all child comments
 

But what if you do? Will you get caught?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 126 points 2 years ago (2 children)

If it's publicly accessible it's scrape-able. He already tried to make tweets not publicly accessible and look how long that lasted.

[–] [email protected] 20 points 2 years ago (2 children)

It’s not even clear that it’s illegal to scrape publicly available data, so I don’t know what the TOS would be enforcing.

[–] [email protected] 10 points 2 years ago (2 children)

It didn't have to be illegal for them to sue you for violating its policies. It would be a civil suit for damages.

[–] [email protected] 18 points 2 years ago (2 children)

Lol, then they would have to demonstrate that there were damages. The worst a TOS violation will get you is a ban.

[–] [email protected] 5 points 2 years ago (1 children)

Bandwidth costs.

[–] [email protected] 4 points 2 years ago (1 children)

Peanuts.

[–] [email protected] 2 points 2 years ago (1 children)

It's still a billionaire suing you for those peanuts.

[–] [email protected] 1 points 2 years ago

Suing for 50 dollar or so? Fine.

[–] [email protected] 3 points 2 years ago

Unfortunately, they have more money to blow on legal fees. The threat of a suit is enough to keep most perks from fucking around and finding out.

[–] [email protected] 2 points 2 years ago

Would it be violating policy if the scrapper only took the public data and never actually signed the ToS since they didn't make an account?

[–] [email protected] 2 points 2 years ago

It's not publicly available anymore. If you're not logged in you don't see anything anymore except tweets you have a direct link to. Even then you don't see any replies and the amount of tweets per day you can see is limited.

[–] [email protected] 17 points 2 years ago* (last edited 2 years ago)

Yep, would never remember on the odd occasions I would look at Twitter, then just leave the site after being prompted to login