Hey there and welcome!
At large, in the Software Industry, Observability and Monitoring are vastly important in building high-reliability software systems. Through these two practices, servers which are accesssed millions of times per day - and for some, per hour - can best report how they are doing to the engineers behind them.
As such, the exercise of generating, extracting and visualising logs is a key task for modern software engineers.
Let's see how we go trying to emulate this process - all driven by the dynamic programming magic of Python 🐍
To be dive into a specific exercise, follow the Setup at the root of each directory. Otherwise, please have the following installed before the workshop:
- Python 3+ - I personally use pyenv and pyenv-virtualenv, but feel free to use whatever you're comfortable with!
- Flask - a web framework written in Python;
- Jupyter - a notebooking tool great for quick prototyping and data analysis;
- Pandas - a premier data analysis library, often paired with numpy (not covered in this workshop);
In this small set of workshops, we will be working through three small exercises:
- Setting up a server which is a bit... buggy (aren't they all?);
- Extracting log lines from this server and placing them into a nicely formatted file;
- Visualising these log lines in meaningful ways.