Skip to main content

Windmill for Geospacial Data Processing - Sourcepole Case Study

ยท 2 min read
Pirmin Kalberer (community)

This is a testimonial written by Pirmin Kalberer, Managing Director at Sourcepole.

Sourcepole Windmill use case

What before Windmill?โ€‹

Sourcepole is a software development company based in Switzerland. We develop customer-specific solutions in the field of geoinformatics based on open source software components.

Data science requires the manipulation of large amounts of data from multiple sources. Workflow engines are crucial as they provide the infrastructure to define, execute, and monitor a sequence of steps in a data manipulation process.

How did Windmill help?โ€‹

Windmill facilitates the creation of robust workflows by enabling seamless sequencing of steps and their outputs while automatically generating user-friendly interfaces.

We tried other solutions and found the configuration of parameters between steps was difficult, making it painful to create simple worflows.

In particular, we use Windmill for:

  • Scheduled ETL of files from public repositories to PostgreSQL.
  • Its UIs where users can simply upload their own data to publish it as a file ready for downloading.
  • We are starting to have workspaces dedicated to each customer where they can use our workflows straightforwardly.

A workflow made by Sourcepole being executed:

Workflow being executed

The associated results:

Workflow results

You can have more details on our use of worflow engines for geospatial data processing with this video (in German ๐Ÿ‡ฉ๐Ÿ‡ช) of my presentation at the 2023 Berlin FOSSGIS conference on free and open source software for geographic information systems.

How to use Windmill?โ€‹

You can self-host it using a docker compose up, our go with the cloud app.

Windmill Logo
Windmill is an open-source and self-hostable serverless runtime and platform combining the power of code with the velocity of low-code. We turn your scripts into internal apps and composable steps of flows that automate repetitive workflows.

You can self-host Windmill using a docker compose up, or go with the cloud app.