affiliate

it would be a pretty funny post for the full 5 minutes it would last until it got stalin sorted out of lemmy.ml

such is life in the UK

what about haskell

Treat OR NO Trick

in my defense, your honor, i didn’t think anybody would actually fall for it

oh man that's an incredible option. i was already super happy with the "share as image" option they have, but it seems like they just keep outdoing themselves

windows 11 is a next generation experience. microsoft teams now has 16 times the detail

how the fuck could they have possibly done things in a way that makes explorer tabs depend on recall?

if they can’t even separate out recall from the rest of the operating system then i have absolutely no faith it will be secure.

why write better software when you can simply tell the customer to buy better hardware?

i would probably word it as something like:

Robots.txt is a document that specifies which parts of a website bots are and are not allowed to visit. While it’s not a legally binding document, it has long been common practice for bots to obey the rules listed in robots.txt.

in that description, i’m trying to keep the accessible tone that they were going for in the article (so i wrote “document” instead of file format/IETF standard), while still trying to focus on the following points:

• robots.txt is fundamentally a list of rules, not a single line of code
• robots.txt can allow bots to access certain parts of a website, it doesn’t have to ban bots entirely
• it’s not legally binding, but it is still customary for bots to follow it

i did also neglect to mention that robots.txt allows you to specify different rules for different bots, but that didn’t seem particularly relevant here.

but then the market would be ever so slightly less free. the horror!

from the article:

Robots.txt is a line of code that publishers can put into a website that, while not legally binding in any way, is supposed to signal to scraper bots that they cannot take that website’s data.

i do understand that robots.txt is a very minor part of the article, but i think that’s a pretty rough explanation of robots.txt