this post was submitted on 02 Sep 2023
122 points (96.9% liked)

Selfhosted

46680 readers
372 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
122
Lemmy-safety can now run in docker (github.com)
submitted 2 years ago by [email protected] to c/[email protected]
13 comments fedilink hide all child comments
 

Through the efforts of @[email protected], the lemmy-safety tool can now run via docker, which should help you run it without having to mess with python on your end.

For those who don't remember, lemmy-safety is a script you can read to clean up your pict-rs images from potential CSAM.

top 13 comments
sorted by: hot top controversial new old
[–] [email protected] 16 points 2 years ago (2 children)

Thanks for the shout out!

Full disclosure, I use podman, not docker. If anyone has any issues with this using docker, let me know and I'll get it fixed ASAP. I'm not 100% sure the --device option works the same way with docker.

I added instructions on how to add the nvidia-container-toolkit repo on the two distros I have (one rpm based, one deb based). If adding the repo is different on your distro, please consider adding it to the instructions. The instructions on the nvidia-container-toolkit web page are... subpar in my opinion.

[–] [email protected] 7 points 2 years ago* (last edited 2 years ago) (1 children)

for docker the syntax is --gpus all

https://docs.docker.com/config/containers/resource_constraints/#expose-gpus-for-use

bonus: syntax to expose the gpu in a docker compose

    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu]

more at https://docs.docker.com/compose/gpu-support/#example-of-a-compose-file-for-running-a-service-with-access-to-1-gpu-device

[–] [email protected] 2 points 2 years ago

Would it be too much for you to ask to test that out and update the documentation? I don't have docker, and installing it would mess up my podman-docker setup, which would impact some things I have running. podman-docker simulates docker with podman so I can use docker-compose with podman.

[–] [email protected] 1 points 2 years ago

Thank you.

[–] [email protected] 4 points 2 years ago (1 children)

nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown.

I was getting this error with docker-desktop installed, but it worked after purging and installing docker-ce instead, and running with the --gpus all command.

[–] [email protected] 2 points 2 years ago

Interesting. This might be a different between podman and docker. I was using podman in my setup. Unfortunately we might need two different sets of instructions for podman and docker.

[–] MrRazamataz 1 points 2 years ago

Very useful tool, thank you Smiley face with 2 thumbs up

[–] [email protected] 1 points 2 years ago (2 children)

Does this run some ML wizardry on the images?

[–] [email protected] 2 points 2 years ago

Yes, it's uisng the clip image2text model

[–] [email protected] 1 points 2 years ago

By the looks of it, pretty much. Not in the sense of building an AI model, but more like traditional image recognition. Seems to process everything locally too, which is a plus; no sending data off to unknown servers.

[–] [email protected] 1 points 2 years ago

Thank you for this great service to the community.

[–] [email protected] -2 points 2 years ago (1 children)

Applying AI-voodoo to a non-existing problem with unknown side effects? Sign me up!

[–] [email protected] 2 points 2 years ago

This was created in response to mass posting of CSAM on lemmy recently. It might be one of the reasons its a "non-existing problem".