this post was submitted on 28 Aug 2023
153 points (98.1% liked)
Privacy
31939 readers
660 users here now
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
Chat rooms
-
[Matrix/Element]Dead
much thanks to @gary_host_laptop for the logo design :)
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Google's swipe typing is pretty damn good, but it isn't magic. It gets a lot better after using it for a while so I'm sure they use reinforcement learning in addition to the dictionary.
They've had it for quite a while and it's good, so I doubt they are putting much work into improving it. And since we have phones with TPUs and multimodal LLMs now, I think it's possible to beat google.
The LLM would only need 3-10 words of context and the swipe data as input to generate a single word, so it can be very small. I don't know much about the power of cellphone TPUs, but I think training an LLM with about 10M parameters on the fly should be possible. If that's the case, we could beat google while doing everything locally on the phone, so no privacy compromises.
Now that I think about it, it sounds doable. But then again I never did anything like this so I'm probably underestimating it by an order of magnitude or two.
Beating google while being local would be the dream, wouldn't it? What you say tracks but i'm like you, i've not done anything remotely like it so it's very possible we're underestimate indeed.