Today I had some data coming into our event driven landscape, so I needed to know when my data was processed. As it constituted the processing of 400.000+ records (and I had more things to do), I needed a small script that kept an eye on my JSON API endpoint to see if the values are changed.
Read the article Poll JSON endpoint until value changes with bash & curl
Last week we had some problems with the Google Ads bot. It was not able to crawl a bunch of URLs while the browser had no problem getting through. The only difference was the User-Agent. This send us on a debugging journey through Cloudflare, gateways and micro-sites. To assist us, we’ve created a small bash script to visit an URL and show some debug info.
Read the article Investigate problems due to User-Agent using Bash
At Wehkamp we’ve been using machine learning for a while now. We’re training models in Databricks (Spark) and Keras. This produces a Keras file that we use to make the actual predictions. Training is one thing, but getting them to production is quite another!
The main problem we’ve faced was that it was too big to actually fit into a lambda. This blogs shows how we’ve dealt with that problem.
Read the article AWS Lambda Size: PIL+TF+Keras+Numpy?
These scripts will help to install Ubuntu to a Windows Server 2019 installation. It will download Ubuntu and activate the Linux Subsystem on Windows (WSL).
Read the article Installing Ubuntu to Windows Server 2019 (WSL)
The main problem of a CI/CD pipeline – in my opinion – is logging. When it logs too little you don’t know what’s going on, when it logs to much you can’t see the trees to the forest. Having too much logging can seriously impact the effectiveness of your CI/CD pipeline. This script will improve Xunit unit test output.
Read the article Taming Unit Test logging in Docker pipeline for .NET