Example

The example pipeline can be used for testing and as a template to build more complicated pipelines.

Given a list of 1...n numbers does a series of operations in each of them and computes the result sum using Dask delayed adding random sleep times in each operation. The datalen argument is the length of the list.

Install#

curl -O https://raw.githubusercontent.com/eddienko/owl-example-pipeline/main/owl_example/signature.yml
owl admin pdef add signature.yml

Pipeline Definition File#

version: 1

# Name of the pipeline
name: example

# Pipeline arguments
datalen: 100

# Resources requested
resources:
  cores: 10
  workers: 2
  memory: 10

GitHub

• github.com/eddienko/owl-example-pipeline