Clik here to view.
GitHub Actions and SonarCloud
GitHub Actions allow you to do most CI/CD tasks for free, directly from your GitHub repository. One of the challenges however is that there is no build-in facility like for example SonarQube to manage...
View ArticleClik here to view.
OWASP Dependency-Check to SonarCloud
SonarCloud is a hosted SonarQube SaaS solution which does not allow 3rd party plugins to be installed. This puts some limitations on the kind of data you can put in SonarCloud. For Java this is limited...
View ArticleClik here to view.
Jenkins: Obtaining and displaying credentials
Jenkins is a solid CI/CD platform which has proven itself over the years. Many organizations use it to build, test and deploy their applications. In Jenkins it is possible to define credentials or to...
View ArticleClik here to view.
Blog milestone: 200 blog posts, 1M page views!
This is my 200th blog post. Also I reached 1M page-views recently. In those 200 blog posts, I used approximately 325K words. An average non-fiction book is somewhere between 70K to 80K words. So that...
View ArticleClik here to view.
OBS Studio: How to record online presentations (Zoom, Teams, Webex, Meet, ...)
Sometimes you want to record online presentations to maybe re-watch them later or share them with colleagues. It is not always possible to easily do this from within the tool which is used for the...
View ArticleClik here to view.
Measure the Quality of your Source Code!
Quality is something which is hard to define. Different areas of expertise use their own definitions of what quality is. Without an objective standard which carries weight, anyone can claim to provide...
View ArticleProduct selection done quickly
Your customer has a specific challenge and wants to have it solved by means of software. They ask you as a software/solution architect to advise them on this topic and they want to be able to choose a...
View ArticleClik here to view.
Vagrant + Docker Compose: A quick and easy Apache NiFi development environment
Vagrant can be used to quickly create development environments in for example VirtualBox, VMWare or Hyper-V. I decided to use Vagrant to create a quick Apache NiFi development environment. For Apache...
View ArticleClik here to view.
Apache NiFi: Reading COVID data from a REST API and producing it to a Kafka...
Apache NiFi can be used to accelerate big data projects by allowing easy integration between various data sources. Using Apache NiFi it is easy to track what happened to your data (data provenance) and...
View ArticleClik here to view.
Apache NiFi: Forwarding HTTP headers
Apache NiFi can be used to expose various flavors of webservices. Using NiFi in such a way provides benefits like quick development using a GUI and of course data provenance. You know who called you...
View ArticleClik here to view.
Generating random JSON data from an AVRO schema in Java
Recently I was designing an AVRO schema and wanted to test how data would look like which conformed to this schema. I developed some Java code to generate sample data. This of course also has uses in...
View ArticleClik here to view.
Java: Validating JSON against an AVRO schema
AVRO schema are often used to serialize JSON data into a compact binary format in order to for example transport it efficiently over Kafka. When you want to validate your JSON against an AVRO schema in...
View ArticleClik here to view.
Merge AVRO schema and generate random data or Java classes
Previously I wrote about generating random data which conforms to an AVRO schema (here). In a recent use-case, I encountered the situation where there were several separate schema files containing...
View ArticleClik here to view.
Vagrant and Hyper-V: Don't do it!
I've used Vagrant since 2015 in combination with Virtualbox for creating development machines. Recently however I'm experiencing more issues with Virtualbox. For example CPUs getting stuck when...
View ArticleClik here to view.
Apache NiFi: Avoid these common pitfalls
Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. It has a powerful UI which can be used for both development and operations. In addition, the NiFi Registry...
View ArticleClik here to view.
Apache NiFi: Automating tasks using NiPyAPI
Apache NiFi has a powerful web-based interface which provides a seamless experience between design, control, feedback, and monitoring. Sometimes however, you want to automate tasks instead of doing...
View ArticleClik here to view.
Apache NiFi: JSON to SOAP
Apache NiFi is a powerful open source integration product. A challenge you might encounter when integrating systems is that one system can produce JSON messages and the other has a SOAP API available....
View ArticleClik here to view.
Having fun with Jolt transformations
Jolt is a Java library which can be used to transform JSON to JSON (here). A Jolt transformation itself is also a JSON file. You can use it in products such as Apache NiFi and Apache Camel. In this...
View ArticleClik here to view.
Apache NiFi: Importing and exporting parameters
When you import a new process group or upgrade an existing one, missing parameters contexts and parameters will automatically be added. The new parameters will be filled with values from the...
View ArticleClik here to view.
Apache NiFi: Monitoring metrics and provenance events using Azure Log Analytics
There are several cases where you might want to use Azure Log Analytics to monitor your NiFi instances. An obvious one is when NiFi is running in Azure. Azure Log Analytics can also be used as single...
View ArticleReduce your gas and electricity bill!
This is not a usual topic for this blog but I wanted to share this anyway so people can refer to it and use it. Due to the current challenges on the energy market, prices for both gas and electricity...
View ArticleClik here to view.
Apache NiFi: Filter events and only let through the latest in a timeframe
In the IoT world, some devices generate large volumes of events that can be difficult for back-end systems to process in real time. Of course you can use NiFi to throttle messages. However, this will...
View ArticleClik here to view.
Python: Batch resize and pad files
When using AI models like Stable Diffusion, sometimes input images need to be of a specific size. In case of Stable Diffusion, multiples of 64 are required. Stable Diffusion (at least 1.5) works best...
View ArticleClik here to view.
Stable Diffusion: AI Image generation
To quote Wikipedia (here): "Stable Diffusion is a deep learning, text-to-image model released in 2022. It is primarily used to generate detailed images conditioned on text descriptions, though it can...
View ArticleClik here to view.
Running LLMs locally
Technology and availability of generative AI and especially large language models (LLMs) have taken a leap in recent years. Large parties like OpenAI, Microsoft and Google dominate this market. It is...
View Article