"I've created this amazing program that more or less precisely mimics the response of a human to any question!"
"What if I ask it a question where humans are well known to apply all kinds of biases? Will it give a completely unbiased answer, like some kind of paragon of virtue?"
"No"
Maybe widely name-calling this practice for what it is could help steer companies away from this disgusting pattern.
Should we start refering to pop-ups that give no option to say "no" as something like "rape-ups"?