this post was submitted on 28 Mar 2024
46 points (92.6% liked)

Selfhosted

40677 readers
385 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
46
Looking for a way to monitor my services (feddit.it)
submitted 8 months ago by [email protected] to c/[email protected]
17 comments fedilink hide all child comments
 

Hi! i have a mixed set of containers (a few, not too many) and bare-metal services (quite a few) and i would like to monitor them.

I am using good old "monit" that monitors my network interfaces, filesystems status and traditional services (via pid files). It's not pretty, but get the work done. It seems i cannot find a way to have it also monitor my containers. Consider that i use podman and have a strict one service, one user policy (all containers are rootless).

I also run "netdata" but i find it overwhelming, too much data, too much graphics, just too much for my needs.

I need something that:

  • let me monitor service status
  • let me monitor containers status
  • let me restart services or containers (not mandatory, but preferred)
  • has a nice web GUI
  • the web gui is also mobile friendly (not mandatory, but appreciated)
  • Can print some history data (not manatory, but interesting)
  • Can monitor CPU usage (mandatory)
  • Can monitor filesystem usage (mandatory)

I don't care for authentication features, since it will be behind a reverse proxy with HTTPS and proxy authentication already.

I am not looking for a fancy and comples dashboard, but for something i can host on a secondary page that i open if/when i want to check stuff. Also, if the tool can be scripted or accessed via an API could be useful, so i would write some extractors to print something in a summary page in my own dashboard.

all 18 comments
sorted by: hot top controversial new old
[–] [email protected] 11 points 8 months ago* (last edited 8 months ago) (1 children)

I think Prometheus is a good industry standard. It can do everything you listed except for restarting stuff. It's got a decent built-in monitoring capability and you can extend it trivially to monitor anything. For example I wrote a 5-liner to monitor ZFS health and another for LVM. I even monitor my routers with it. OpenWrt has an installable node exporter for Prometheus.

Service restarting is a remote execution capability and generally falls outside of the monitoring domain. You'd be better off implementing that with another process/service manager. If you're running systemd, that's one of its primary purposes. You can use it to start/stop/restart containers just like normal processes.

[–] [email protected] 2 points 8 months ago (1 children)

Can you share a guide / tutorial on how to accomplish what OP wants (or just get started with Prometheus)? I was in the same boat as OP and settled for netdata, and eventually gave up on monitoring altogether because it was either overwhelming me with data, too cumbersome to set up or had features behind paid plans.

[–] [email protected] 2 points 8 months ago* (last edited 8 months ago)

Anytime you're asking this, go for the projects Quick Start / Getting Started doc. In this case here. If you're on a Debian based system Prometheus is already packaged in the repository so you don't have to download the latest. You likely won't win anything but the pain for having to set up the bare binary as a service with systemd. I followed that doc to setup mine but installed it from apt.

On a second thought, if you're getting it from the repo and it already has a systemd unit defined, it might be more difficult to follow the Getting Started doc. You know what, follow it as-is. Once you have something running and monitoring ad-hoc, it'll be easy to install from apt and put your config in it.

[–] [email protected] 6 points 8 months ago (1 children)

Give https://github.com/louislam/uptime-kuma a try. I'm planning to do the same for similar use case. Sensu (sensu.io) is a more sophisticated option but it requires more infrastructure and there is a bit of a learning curve with it.

[–] [email protected] 10 points 8 months ago (1 children)

While I really like uptime kuma, it seems a bit too restricted for OPs use case. For example, to monitor disk or CPU usage, you would need to write your own scripts. It would be doable, but not very nice.

At least how I understood the.question, OP would probably look for something like icinga.

[–] [email protected] 1 points 8 months ago (1 children)

Yeah better fit but a bit of trouble to setup.. What's your opinion on Icinga? Never used it myself.

[–] [email protected] 4 points 8 months ago

We had it at work, but I never did anything else than receiving and resolving alerts. But it looked good for me and I liked the system.

[–] [email protected] 6 points 8 months ago

Have you tried Cockpit? It has pretty nice Podman integration.

[–] [email protected] 4 points 8 months ago* (last edited 8 months ago)

grafana is pretty annoying to learn and setup but it does everything you seem to want.

[–] [email protected] 2 points 8 months ago

You can do most of not all of this with CheckMk but it's probably overkill.

[–] [email protected] 2 points 8 months ago

good ol' nagios (or one of its forks)

[–] [email protected] 1 points 8 months ago (2 children)

I use Homarr and Enjoy it a lot. Nice Interface, can Monitor not only Services but also the Server itself and is quite Customizable.

[–] [email protected] 4 points 8 months ago (1 children)

If you go with dashboard approach, I would suggest Homepage

[–] [email protected] 1 points 8 months ago

I like Homarr because it is Drag and Drop to edit the Page. I think with Homepage i would have to edit the config file.

[–] [email protected] 1 points 8 months ago* (last edited 8 months ago)

I tried to spin up a Homarr docker container the other day after seeing it on YouTube, but because it's located in ghcr it just wouldn't install.

I even added ghcr to my resources in docker using my password and an API key, but still no dice.

I'm missing something obvious, but I'm not sure what, any pointers?

Edit: I've just tried again and this time it hasn't failed with an error message, just hanging in Portainer stacks deployment instead

Edit 2: I left it hanging and checked while I was out and about (love Tailscale)and it's working now!

[–] [email protected] 0 points 8 months ago (1 children)

i have a mixed set of containers (a few, not too many) and bare-metal services

Containers run on bare metal. Or are you running them in a vm?

[–] [email protected] 1 points 8 months ago

I run containers on bare metal indeed.

I have services running in containers on bare metal and services running without containers, on bare metal.