Technology

59374 readers

7409 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

LLM Inference for Legal Document Summarization? (lemm.ee)

submitted 1 year ago by [email protected] to c/[email protected]

4 comments fedilink hide all child comments

Hey everyone, I've been parsing through the Huggingface website and am having a bit of trouble picking out an LLM inference to help me parse through legal documents. I am not a lawyer, but I would like to understand my rights and how to search for answers to legal questions with concrete answers using an inference.

I have heard a multitude of things around Llama being a privacy nightmare and something about Gerganov ML files? GGMU is also a nebulous term to me and I understand the basics about how a model is trained and validated, but not how to pick one for personal use that isn't GPT-4.

Any suggestions or things to add on to the discussion?

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 17 points 1 year ago (3 children)

I would be very hesitant to put my legal reasoning in the hands of an LLM. They're not AIs, they just come up with plausible text completions. There have actually been cases by now of lawyers who've gotten fucked by using AI to try to save themselves effort and then it not being good enough for what they were expecting from it.
If you're convinced you want to do this, there are basic tutorials on Youtube - I'm not 100% sure but I think that instead of "fine-tuning" in the same way you would do to fit an LLM to a problem space, you want to import the legal documents into something like Chroma, then use something like Llama as hooked up to the Chroma DB. But again, I wouldn't. For messing around with some things it's fine, but for legal documents you really want a sentient intelligence involved in the process.

[–] [email protected] 3 points 1 year ago

Man, Ryan Reynolds the lawyer is really entertaining. Thanks for posting the video, I thoroughly enjoyed it.

load more comments (2 replies)