Rsyslog to Elasticsearch

Last time I mentioned that I was working on a central syslog. Part of the task was also possibility to easily go through the logs, preferably with some filtering and what not. ELK-stack is usually the first thing mentioned as a potential solution. Essentially the goal is to land your logs in Elasticsearch. The problem with both of these solutions is on the processing part. With Logstash things can go very wrong very quickly and there’s only handful of other things than _grokparsefailure that can seriously put me into rage mode.

Grafana 6.0.0 →

Grafana is one of my favourite Open Source software of all time. I’ve been using it for years and am thrilled to see yet another great major release. I’m really looking forward to put my hands on all new workflow called Explore. Currently it integrates with Loki, but support for Elasticsearch is already on the roadmap!

Franz 5.0.0 →

Franz is one of the first apps I install on a fresh Mac. Single window to handle pretty much any kind of communication service one can think of is superb. Best part that it’s also cross-platform.1 5.0.0 is a major release after years of development and 24 beta pre-releases (sic!).

  1. Well, it’s Electron… 

NGINX logging to syslog

Recently I’ve been tasked with creating a central syslog server. These are very useful when one maintain couple of boxes (or couple hundred and more) as it can provide a single point of checking out on what’s up with the machines. If it’s combined properly with metrics it serves as a super-boosting way of maintaining the overview of the entire infrastructure.

When it comes to NGINX, it defaults to storing log files in plain text. It’s a sane default and I don’t see a good reason to ship it in any other fashion. However, sometimes the needs change. It was the case for me – I’m using rsyslog1 for all of the OS logs and it felt natural to me to have NGINX invited to join the party. As rsyslog client is pushing all of its logs further to the centralized server part already, I wanted to have NGINX logs included in the stream.

  1. Pretty much a standard these days for any given 🐧 Linux distro. 

mas 1.6.2 →

Majority of time I spend on my Mac, I do it in terminal.1 The more I can get away without switching to anything else, the better. MAS2 is one of these nifty little utilities that simply makes your life that much easier. While it’s quite mature software already and there’s not that much excitement in the latest release, I’m using it as opportunity to spread the word as not everyone is aware of this little bugger.3

MAS provides few really useful commands that allow you to avoid launching App Store altogether.4 The best part of it is that it integrates with 🍺 Homebrew’s Bundler, which in return allows you to easily replicate/keep-in-sync multiple systems or Macs. It really is super convenient to be able to combine two, otherwise independent, apps to serve single purpose. I, for one, am using these two together to sync all of the Mac apps I have installed on my private and work laptop.

  1. iTerm2 specifically. 

  2. Mac App Store. 

  3. You’re welcome. 

  4. mas install/uninstall/search etc.