Technology

BRUSSELS, July 27 (Reuters) - Microsoft (MSFT.O) on Thursday found itself the target of an EU antitrust investigation over the tying of its chat and video app Teams with its Office product, putting it at risk of a hefty fine.

The U.S. tech giant has racked up 2.2 billion euros ($2.5 billion) in EU antitrust fines in the previous decade for practices in breach of EU competition rules, including tying or bundling two or more products together.

It has since then sought adopted a more conciliatory approach with the European Commission.

The European Commission's investigation followed a complaint by Salesforce-owned (CRM.N) workspace messaging app Slack in 2020 and after the U.S. tech giant's offer of remedies failed to address the EU competition enforcer's concerns.

The EU competition enforcer said it was concerned that Microsoft may be abusing and defending its market position in productivity software by restricting competition in the European communication and collaboration products market.

"Remote communication and collaboration tools like Teams have become indispensable for many businesses in Europe. We must therefore ensure that the markets for these products remain competitive, and companies are free to choose the products that best meet their needs," EU antitrust chief Margrethe Vestager said in a statement.

A spokesperson for Microsoft said Microsoft would continue to co-operate with the European Commission and that the company remained committed to finding solutions to address the Commission's concerns.

Reuters reported earlier this month that the EU antitrust watchdog was set to open a probe after Microsoft declined to offer bigger price cuts on its Office without Teams.

The European Commission hopes a price differential between Office with Teams and Office without the app will ensure a level playing field with rivals and give consumers more choice, people familiar with the matter have told Reuters.

German rival alfaview last week filed a complaint similar to Slack's with the EU executive.

With Reddit shutting down its API setting a precedent in the corporate tech world (and Reddit was a major outlier in that a ton of their users are technical minded and support third party clients, YouTube does not have that kind of userbase and will not get backlash for it), Twitter doing whatever the fuck they're doing, and Google already hellbent on destroying ad blockers, the days of Newpipe, Invidious, and Freetube are numbered. Wouldn't be surprised if they implement Netflix level DRM tomorrow that makes alt clients impossible. I say savour your alt clients while you can guys, you won't be able to soon.

cross-posted from: https://lemmy.world/post/2219010

Hello everyone!

We have officially hit 1,000 subscribers! How exciting!! Thank you for being a member of [email protected]. Whether you're a casual passerby, a hobby technologist, or an up-and-coming AI developer - I sincerely appreciate your interest and support in a future that is free and open for all.

It can be hard to keep up with the rapid developments in AI, so I have decided to pin this at the top of our community to be a frequently updated LLM-specific resource hub and model index for all of your adventures in FOSAI.

The ultimate goal of this guide is to become a gateway resource for anyone looking to get into free open-source AI (particularly text-based large language models). I will be doing a similar guide for image-based diffusion models soon!

In the meantime, I hope you find what you're looking for! Let me know in the comments if there is something I missed so that I can add it to the guide for everyone else to see.

Getting Started With Free Open-Source AI

Have no idea where to begin with AI / LLMs? Try starting with our Lemmy Crash Course for Free Open-Source AI.

When you're ready to explore more resources see our FOSAI Nexus - a hub for all of the major FOSS & FOSAI on the cutting/bleeding edges of technology.

If you're looking to jump right in, I recommend downloading oobabooga's text-generation-webui and installing one of the LLMs from TheBloke below.

Try both GGML and GPTQ variants to see which model type performs to your preference. See the hardware table to get a better idea on which parameter size you might be able to run (3B, 7B, 13B, 30B, 70B).

8-bit System Requirements

Model	VRAM Used	Minimum Total VRAM	Card Examples	RAM/Swap to Load*
LLaMA-7B	9.2GB	10GB	3060 12GB, 3080 10GB	24 GB
LLaMA-13B	16.3GB	20GB	3090, 3090 Ti, 4090	32 GB
LLaMA-30B	36GB	40GB	A6000 48GB, A100 40GB	64 GB
LLaMA-65B	74GB	80GB	A100 80GB	128 GB

4-bit System Requirements

Model	Minimum Total VRAM	Card Examples	RAM/Swap to Load*
LLaMA-7B	6GB	GTX 1660, 2060, AMD 5700 XT, RTX 3050, 3060	6 GB
LLaMA-13B	10GB	AMD 6900 XT, RTX 2060 12GB, 3060 12GB, 3080, A2000	12 GB
LLaMA-30B	20GB	RTX 3080 20GB, A4500, A5000, 3090, 4090, 6000, Tesla V100	32 GB
LLaMA-65B	40GB	A100 40GB, 2x3090, 2x4090, A40, RTX A6000, 8000	64 GB

*System RAM (not VRAM), is utilized to initially load a model. You can use swap space if you do not have enough RAM to support your LLM.

When in doubt, try starting with 3B or 7B models and work your way up to 13B+.

FOSAI Resources

Fediverse / FOSAI

• The Internet is Healing
• FOSAI Welcome Message
• FOSAI Crash Course
• FOSAI Nexus Resource Hub

LLM Leaderboards

• HF Open LLM Leaderboard
• LMSYS Chatbot Arena

LLM Search Tools

• LLM Explorer
• Open LLMs

Large Language Model Hub

Download Models

oobabooga

text-generation-webui - a big community favorite gradio web UI by oobabooga designed for running almost any free open-source and large language models downloaded off of HuggingFace which can be (but not limited to) models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and many others. Its goal is to become the AUTOMATIC1111/stable-diffusion-webui of text generation. It is highly compatible with many formats.

Exllama

A standalone Python/C++/CUDA implementation of Llama for use with 4-bit GPTQ weights, designed to be fast and memory-efficient on modern GPUs.

gpt4all

Open-source assistant-style large language models that run locally on your CPU. GPT4All is an ecosystem to train and deploy powerful and customized large language models that run locally on consumer-grade processors.

TavernAI

The original branch of software SillyTavern was forked from. This chat interface offers very similar functionalities but has less cross-client compatibilities with other chat and API interfaces (compared to SillyTavern).

SillyTavern

Developer-friendly, Multi-API (KoboldAI/CPP, Horde, NovelAI, Ooba, OpenAI+proxies, Poe, WindowAI(Claude!)), Horde SD, System TTS, WorldInfo (lorebooks), customizable UI, auto-translate, and more prompt options than you'd ever want or need. Optional Extras server for more SD/TTS options + ChromaDB/Summarize. Based on a fork of TavernAI 1.2.8

Koboldcpp

A self contained distributable from Concedo that exposes llama.cpp function bindings, allowing it to be used via a simulated Kobold API endpoint. What does it mean? You get llama.cpp with a fancy UI, persistent stories, editing tools, save formats, memory, world info, author's note, characters, scenarios and everything Kobold and Kobold Lite have to offer. In a tiny package around 20 MB in size, excluding model weights.

KoboldAI-Client

This is a browser-based front-end for AI-assisted writing with multiple local & remote AI models. It offers the standard array of tools, including Memory, Author's Note, World Info, Save & Load, adjustable AI settings, formatting options, and the ability to import existing AI Dungeon adventures. You can also turn on Adventure mode and play the game like AI Dungeon Unleashed.

h2oGPT

h2oGPT is a large language model (LLM) fine-tuning framework and chatbot UI with document(s) question-answer capabilities. Documents help to ground LLMs against hallucinations by providing them context relevant to the instruction. h2oGPT is fully permissive Apache V2 open-source project for 100% private and secure use of LLMs and document embeddings for document question-answer.

Models

The Bloke

The Bloke is a developer who frequently releases quantized (GPTQ) and optimized (GGML) open-source, user-friendly versions of AI Large Language Models (LLMs).

These conversions of popular models can be configured and installed on personal (or professional) hardware, bringing bleeding-edge AI to the comfort of your home.

Support TheBloke here.

• https://ko-fi.com/TheBlokeAI

70B

• Llama-2-70B-chat-GPTQ

• Llama-2-70B-Chat-GGML

• Llama-2-70B-GPTQ

• Llama-2-70B-GGML

• llama-2-70b-Guanaco-QLoRA-GPTQ

30B

• 30B-Epsilon-GPTQ

13B

• Llama-2-13B-chat-GPTQ

• Llama-2-13B-chat-GGML

• Llama-2-13B-GPTQ

• Llama-2-13B-GGML

• llama-2-13B-German-Assistant-v2-GPTQ

• llama-2-13B-German-Assistant-v2-GGML

• 13B-Ouroboros-GGML

• 13B-Ouroboros-GPTQ

• 13B-BlueMethod-GGML

• 13B-BlueMethod-GPTQ

• llama-2-13B-Guanaco-QLoRA-GGML

• llama-2-13B-Guanaco-QLoRA-GPTQ

• Dolphin-Llama-13B-GGML

• Dolphin-Llama-13B-GPTQ

• MythoLogic-13B-GGML

• MythoBoros-13B-GPTQ

• WizardLM-13B-V1.2-GPTQ

• WizardLM-13B-V1.2-GGML

• OpenAssistant-Llama2-13B-Orca-8K-3319-GGML

7B

• Llama-2-7B-GPTQ

• Llama-2-7B-GGML

• Llama-2-7b-Chat-GPTQ

• LLongMA-2-7B-GPTQ

• llama-2-7B-Guanaco-QLoRA-GPTQ

• llama-2-7B-Guanaco-QLoRA-GGML

• llama2_7b_chat_uncensored-GPTQ

• llama2_7b_chat_uncensored-GGML

More Models

• Any of KoboldAI's Models

• Luna-AI-Llama2-Uncensored-GPTQ

• Nous-Hermes-Llama2-GGML

• Nous-Hermes-Llama2-GPTQ

• FreeWilly2-GPTQ

GL, HF!

Are you an LLM Developer? Looking for a shoutout or project showcase? Send me a message and I'd be more than happy to share your work and support links with the community.

If you haven't already, consider subscribing to the free open-source AI community at [email protected] where I will do my best to make sure you have access to free open-source artificial intelligence on the bleeding edge.

Thank you for reading!

The awesome Taylor Lorenz reports this on Mastadon. Highly recommend to follow her if you like these updates about what's going on.

cross-posted from: https://lemmy.ml/post/2430941

https://archive.is/CMBBo

Title is a bit vague because I don't know the correct terms to phrase it properly.

I have a Raspberry Pi that I use to run jellyfin, transmission, blocky, soju. Recently I added libreddit to it seeing how the rate limits are affecting public instances.

The problem is that currently if I need to go my libreddit instance, I have to go to 192.168.0.x:xxxx which is extremely unfun to type.

Is there a way I can access it more elegantly? One solution I found was to configure blocky with a custom DNS that points to the RPi where I can configure an nginx reverse proxy so that lr.rpi.local for example serves libreddit.

Any other ideas for this?

Not a good look for Mastodon - what can be done to automate the removal of CSAM?

How much do you pay? How fast are your your real world speeds? Where are you located?

Since Twitter was bought by the world's biggest manbaby I've been using Nitter to avoid giving them any traffic/analytics/etc.

Full list of Nitter instances here: https://github.com/zedeus/nitter/wiki/Instances

Look. It happens a few times a week, where reps in 3 time-zones will be fucked by an interruption to azure services like o341 or sharepoint (we don't do VMs in azure; not secure enough).

I'm used to shadenfreuding Reddit over that, or at least finding it's not just our company firewall and VPN taking the Proverbial.

Is there a sub I can join to get the topical junk like that? I'm too indolent - like a fox! - to go to twitter (or ideally mastodon) for a more suitable location; but will I find it there if I do? Can it be here too?

Twitter’s new X logo wasn’t made by an in-house designer. It’s from an old podcast hosted by one of the cult that Elon took from his replies.

Hi, we're a tech startup run by libertarian Silicon Valley tech bros.

We're not a newspaper, we're a content portal.
We're not a taxi service, we're a ride sharing app.
We're not a pay TV service, we're a streaming platform.
We're not a department store, we're an e-commerce marketplace.
We're not a financial services firm, we're crypto.
We're not a space agency, we're a group of visionaries who are totally going to Mars next year.
We're not a copywriting and graphic design agency, we're a large language model generative AI platform.

Oh sure, we compete against those established businesses. We basically provide the same goods and services.

But we're totally not those things. At least from a legal and PR standpoint.

And that means all the laws and regulations that have built up over the decades around those industries don't apply to us.

Things like consumer protections, privacy protections, minimum wage laws, local content requirements, safety regulations, environmental protections... They totally don't apply to us.

Even copyright laws — as long as we're talking about everyone else's intellectual property.

We're going to move fast and break things — and then externalise the costs of the things we break.

We've also raised several billion in VC funding, and we'll sell our products below cost — even give them away for free for a time — until we run our competition out of the market.

Once we have a near monopoly, we'll enshitify the hell out of our service and jack up prices.

You won't believe what you agreed to in our terms of service agreement.

We may also be secretly hoarding your personal information. We know who you are, we know where you work, we know where you live. But you can trust us.

By the time the regulators and the general public catch on to what we're doing, we will have well and truly moved on to our next grift.

By the way, don't forget to check out our latest innovation. It's the Uber of toothpaste!

#startup #business #tech #technology @technology

HN link: https://news.ycombinator.com/item?id=36795173