Darkmoon_UK

I think I found my jam! AnythingLLM self-hostable

Are there any AI apps that will index markdown documents with a vector DB, then allow you to run natural language queries using some kind of RAG approach with a local LLM?

Closest I've found is LlamaIndex, but this is still more of a 'foundation' than a turn-key solution and right now I'm too time-poor to do the assembly required...

I realise I'm describing close-to-frontier tech, but is there anything more turn-key (Dockerised) out there yet?

My use-case is pretty 'vanilla' in this space: Having a markdown software product knowledge base and wanting quick answers to questions like "How should screen X behave if I am not a registered user?".

Thanks for any suggestions!

I actually agree with most of what you're saying but you could try to sound less insane. 😅

Weird hill to die on perhaps; but I'll never forgive Microsoft for arbitrarily deciding to not support my Core i7 6700K 4Ghz CPU on Windows 11.

Simply because: I cannot find a single actual technical reason why it wouldn't be compatible (yes, my mobo also has TPM). It's even higher specced than many other 'supported' chips.

MS apparently just decided I hadn't spent enough money lately. Well now I won't - on your products - ever again, while this i7 will continue to run Win 10 for games and Linux for all else.

Also if it really mattered I'm sure the UK could work out how to do much if the required maintenance themselves. It's not exotic tech at this point.

Doesn't really follow...

To say nothing of the wider hypothetical conflict, wouldn't the US bases themselves be trivial to overrun by UK land forces?

They're air bases and not fortified from attack by the host country. If anything the easy opportunity to disable their aircraft while getting our hands on any undamaged kit could present a minor tactical advantage.

For this reason they'd surely vacate before turning nasty.

Am I missing something?

$14 USD/mo... Ironically

I've been an enthusiastic adopter of Generative AI in my coding work; and know that Claude 3.7 is the greatest coding model out there right now (at least for my niche).

That said, at some point you have to choose principles over convenience; so I've cancelled all my US Tech service accounts - now exclusively using 'Le Chat Pro' (+ sometimes local LLM's).

Honestly, it's not quite as good, but it's not half bad either, and it is very very fast thanks to some nifty hardware acceleration that the others lack.

I still get my work done, and sleep better at night.

The more subscriptions Mistral get, the more they're able to compete with the US offerings.

Anyone can do this.

It should not be that surprising. Many teenagers are really smart, curious and will find their way here. That said I realise your warning is well intentioned; I hope Lemmy remains a more civil place than Reddit became over the last ten years, for everyone; teenagers included.

Same here: Deleted my 13y Reddit account along with every other US tech account except Google, as I need that for my livelihood.

Censorship wasn't the motivation. Rather; I'm withdrawing my support for the US economy in any way possible, given the shocking geopolitical events of this year and the way they are treating Ukraine.

Besides, the Federverse feels like going back to the internet's roots and I'm here for it!