Windmill provides the same set of features as CRON, but with a user interface and control panels. It allows you to define Schedules for Scripts and Flows. Once a schedule is defined, the script will automatically run at the set frequency. Think of it as an easy-to-use scheduler similar to CRON that you can share with other users.
A Schedule consists of a Script or Flow, its arguments, a CRON expression that controls the execution frequency and an Error Handler to deal with failed scheduled executions.
Cron is a powerful and versatile tool that enables users to automate tasks by scheduling them to run at specific intervals or times. From automating routine system maintenance to sending periodic email reports, cron plays an indispensable role in streamlining processes and improving productivity for developers, system administrators, and even casual users.
However, as with any powerful tool, using cron comes with its own set of challenges and potential issues. Common problems associated with the use of cron include:
- Runs History: to maintain a record of script runs and log outputs through cron, you must manually incorporate that logic.
- Error Handling: in the event of a failed run, self-crafted logic is required for notifications (Slack, emails).
- Manual Runs: executing a cron job manually, outside of its schedule, proves difficult and can lead to inconsistencies due to potential environment differences.
- No UI: navigating cron jobs is challenging without a centralized hub, particularly for larger engineering teams. This comes with induced issues: 1. Handling permissions and Errors among users and editors and 2. Server downtime: when the server hosting the job experiences downtime, monitoring and alterting is problematic.
Windmill is an open-source developer platform and infra to build all internal tools through code, such as UIs and workflows based on simple scripts (TypeScript, Python, Go, Bash, SQL).
Managing scripts, flows and apps on Windmill works at the workspace-level. Admins invite authors and operators to the workspace where are hosted workflows. The first two can write and edit flows as well as managing permissions, executions etc.
From your workspace, navigate to the dedicated
Schedules menu and select
Configure the schedule frequency using cron syntax or the simplified builder.
Fill in the arguments that will be used for the automation. The arguments are the ones of the given script or flow. If you want your arguments to be dynamic, you might want to use a workflow.
Optional: Add an Error Handler
Optional: Add a Recovery Handler
Schedule button and you're good to go! The schedule will be automatically 'Enabled'. Toggle it off if needed.
The previous configuration can be replicated multiple times for the same workflow and therefore several schedules can work in parallel.
If the Schedules menu allows you to control future executions of scripts and workflows, you can check all past and future runs clicking on
Runs. This will lead you to the Runs menu, with a filtered view on your runnable.
... where you can get details on each run:
Configure Schedules from Flow Editor
The same method can also be done from the flow editor.
From your workspace, pick the workflow you want to schedule.
Go to the
Schedule menu ...
and either schedule in cron or in Basic mode that will automatically be translated in cron. Once it's done, you can see in next picture that the cron expression is now visible on the toolbar.
Fill in the inputs, toggle the Schedule Enabled option, save, and you're all set!
Control Permissions and Errors
Schedule Error Handler
From the schedule configuration, add a special script or flow to execute in case of an error.
You can pick the Slack pre-set schedule error handler.
Schedule Recovery Handler
From the schedule configuration, add a special script or flow to execute in case of of recovery from Error.
You can pick the Slack pre-set schedule recovery handler.
Be notified every time a scheduled workflow has been executed
For scheduled flows, add a simple step to be notified about the execution of the scheduled flow.
Configure the email.
And watch your mailbox.
Given how flows work on Windmill, it means that once the previous step has been successful, the Email step will trigger.
If you want to handle failure and receive another message in that case, add an Error Handler to your workflow that will let you know if a failure happened at any step.
Manage permissions from the workflow
From the settings menu, change the owner to a folder (group of people) to manage view and editing rights.
The process is very simple but it will allow you to schedule tasks with confidence and get an aggregated view on them.
Not only can you build scheduled jobs from Windmill but also you can import all your existing scripts - as Windmill supports TypeScript, Python, Go, Bash or SQL - as did one of our esteemed users for their own scheduled jobs.