this post was submitted on 26 Jul 2024
662 points (97.4% liked)

Technology

60052 readers
3608 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
(page 3) 50 comments
sorted by: hot top controversial new old
[–] [email protected] 4 points 4 months ago (3 children)

I'm kind of curious to understand how they're blocking other search engines. I was under the impression that search engines just viewed the same pages we do to search through, and the only way to 'hide' things from them was to not have them publicly available. Is this something that other search engines could choose to circumvent if they decided to?

load more comments (3 replies)
[–] [email protected] 3 points 4 months ago (2 children)

It's still possible to search with "site:reddit.com ..."

Has it been implemented yet or are they blocking non-flagged searches? Which seems odd.

load more comments (2 replies)
[–] [email protected] 3 points 4 months ago (5 children)

They're also blocking posts by users who aren't banned or even got a warning. It appears to the user as though it's been posted, but it hasn't.

load more comments (5 replies)
[–] [email protected] 3 points 4 months ago (2 children)

Hot take here.

I do believe in free information.

Instead of investing money in stop crawlers why do not make the data they are trying to crawl available to everyone for free so we can have a better world all together?

load more comments (2 replies)
load more comments
view more: ‹ prev next ›