data_ingestion/user_data/ingest_geometry
Adds user geometries into the cluster storage, allowing for them to be used on workflows. The workflow downloads geometries provided in the references and generates GeometryCollection objects with local assets that can be used in other operations.
graph TD
inp1>user_input]
out1>geometry]
tsk1{{unpack}}
tsk2{{download}}
tsk1{{unpack}} -- ref_list/input_ref --> tsk2{{download}}
inp1>user_input] -- input_refs --> tsk1{{unpack}}
tsk2{{download}} -- downloaded --> out1>geometry]
Sources
user_input: List of external references.
Sinks
geometry: GeometryCollections with downloaded assets.
Tasks
unpack: Unpacks the urls from the list of external references.
download: Downloads geometries provided in the reference and generates a GeometryCollection.
Workflow Yaml
name: ingest_geometry
sources:
user_input:
- unpack.input_refs
sinks:
geometry: download.downloaded
tasks:
unpack:
op: unpack_refs
download:
op: download_geometry_from_ref
op_dir: download_from_ref
edges:
- origin: unpack.ref_list
destination:
- download.input_ref
description:
short_description: Adds user geometries into the cluster storage, allowing for them
to be used on workflows.
long_description: The workflow downloads geometries provided in the references and
generates GeometryCollection objects with local assets that can be used in other
operations.
sources:
user_input: List of external references.
sinks:
geometry: GeometryCollections with downloaded assets.