It’s not merely natural. It’s human.
I'm not disputing this, but I also don't see why that's important. It's a representation of the world encoded in a human format. We're basically skipping a step of evolving a way to encode this data.
We know that LLMs, when fed human-like inputs, produce human-like outputs. That’s it. That tells us more about LLMs and humans than it tells us about nature itself.
Did you actually read through the paper?
I didn't say they're encoding raw data from nature. I said they're learning to interpret multimodal representations of the encodings of nature that we feed them in human compatible formats. What these networks are learning is to make associations between visual, auditory, tactile, and text representations of objects. When a model recognizes a particular modality such as a sound, it can then infer that it may be associated with a particular visual object, and so on.
Meanwhile, the human perspective itself isn't arbitrary either. It's a result of evolutionary selection process that shaped the way our brains are structured. This is similar to how brains of other animals encode reality as well. If you evolved a neural network on raw data from the environment, it would eventually start creating similar types of representations as well because it's an efficient way to model the world.
Ultimately the data both human brains and artificial neural networks are trained on comes from the material reality we inhabit. That's the underlying context. We're feeding LLMs data about our reality encoded in a way that's compatible with how our brains interpret it. I'd argue that models being based on data encoding that we ourselves use is a feature, because ultimately we want to be able to interact with them in a meaningful way.
The object concept representation is an emergent property within these networks. Basically, the network learns to create stable associations between different modalities and associate an abstract concept of an object that unites them together.
As he notes, even if they know the structure, there's not much they can do about it. If the bomb doesn't hit square on then it's not going to deliver the shaped charge in the right direction. Since they almost certainly would've used a composite material, it ensures that the bomb can't just penetrate in a straight line.
Context being that after all the posturing and theater of calling Trump the second coming of Hitler, the British poodle obediently picks up papers for him?
Yeah, if Kid Starver had even a shred of self respect then he would've just stood there and not picked the up.
Exactly, and this is such a great illustration how companies don't need Western consumer market to be successful.
Everyone should delete these spyware tools from their devices.
It's not even close, it's also the primary driver of the climate crisis that threatens us as the species.
this is a very good take on why Germany does this https://spore.social/@ayoub/114653676641160705