Zum Inhalt der Seite gehen


Edit: thanks guy, I think I have enough tools to try out =)

Which application can you recommend to automatically comb through a Linux (Ubuntu) server's log files, search for warnings and errors, and generate a neat report?

#linux #admin #server #selfhosting #selfhosted
Dieser Beitrag wurde bearbeitet. (1 Tag her)
Perhaps this helps:
https://www.monitorix.org
thanks! Bit different from what I was searching for but very handy to have!
isn’t it an use case for a LLM?
Mein Ironiedetektor ist gerade mal wieder dejustiert ....
@holger
@zefix

Ne, einfach ein bissl priorisieren, aggregieren, ... würde mir schon reichen.
😂 ihr wieder. Aber haben jetzt im Unternehmen Gemini intern ausgerollt. Für Meetings kannst jetzt Notizen erstellen lassen. Protokoll usw. Ist wirklich gut.

Und warum sollte das nicht auch Logs durchforsten können .
stimmt schon -- aber wie gesagt: soll erstmal nur etwas ordnung ins chaos bringen... die feherlsuche ist dann schritt 2.

@mamue
grep, awk and sed. Available on pretty much every distribution. Not leaking info, either.

Honestly - steep learning curves but once you're even slightly proficient then you can find all the needles in all the haystacks you want, neatly.

Add in jq for conversion to JSON for a more transportable format.

#YesIAmOld #ClassicToolsFTW #linux #grep #awk #sed
Learn some Perl.

As the de facto Practical Eclectic Rubbish Lister.. it was built for you..

:)

For example.

https://phoenixtrap.com/2021/09/14/a-good-old-fashioned-perl-log-analyzer/

but TMTOWTDI

#perl
#perl
Loki for log collection, as a data source for Grafana for reporting. AlertManager to get your attention right away if anything really bad shows up.
thanks! I'm looking into these two ones!
it was a good reminder for me, too, that I need to get better with these tools. I plan to write up some notes for my blog about how to get them running inside of Docker. And how to get all of your Docker service logs automatically funneling into Loki. That part I feel pretty confident about writing some easy notes on.

Where I have to "get my learn on" is about crafting Grafana dashboards to make sense of the patterns showing up in the logs. I'd particularly like to write about how to use this stack to monitor health of some common #Fediverse platforms, particularly #GoToSocial and #PeerTube since I'm running them.

What other kinds of applications are you wanting to figure out how to monitor?
my current problem is that my home server “stalls” for reasons I do not know yet. I went through the logs with the usual grep commands and found a few odd things which I am debugging right now. So it is not a service that I am interested in, but the entire thing.

Grafana is a bit weird. Played with it a year ago or so and remember that the query language for the time series database (influx) many people use was quite weird…
@Holger :mastodon: Lnav -

hat eine schöne Filterfunktion -> filter-in und filter-out auch mit regex. Mehr braucht man nicht.
danke dir, das klingt gut!
check out logcheck as it is meant to do this automatically and email you log entries that you haven’t said are okay -> configured it to ignore.

There is a moderate startup curve as you configure okay log entries. But it quickly gets up to speed.

I’ve found a lot of otherwise unknown problems with properly configured logcheck.
I installed logwatch yesterday and it seems to do more or less the same. The report I got delivered to my inbox this morning is pretty neat. Going to test logcheck as well. Thanks.