data_ingestion/weather/get_forecast

Downloads weather forecast data from NOAA Global Forecast System (GFS) for the input time range. The workflow downloads global forecast data from the Planetary Computer with 13km resolution between grid points. The workflow requires a SAS token to access the blob storage, which can be found at https://planetarycomputer.microsoft.com/dataset/storage/noaa-gfs.

graph TD inp1>user_input] out1>forecast] tsk1{{preprocessing}} tsk2{{gfs_download}} tsk3{{read_forecast}} tsk1{{preprocessing}} -- time --> tsk2{{gfs_download}} tsk1{{preprocessing}} -- location --> tsk3{{read_forecast}} tsk2{{gfs_download}} -- global_forecast --> tsk3{{read_forecast}} inp1>user_input] -- user_input --> tsk1{{preprocessing}} tsk3{{read_forecast}} -- local_forecast --> out1>forecast]

Sources

  • user_input: Time range and geometry of interest.

Sinks

  • forecast: Weather forecast data.

Parameters

  • noaa_gfs_token: SAS token to access blob storage.

Tasks

  • preprocessing: Gets the most relevant model date and forecast hour of product for the given input day, time and location.

  • gfs_download: Downloads the global forecast for the given input time.

  • read_forecast: Extracts the local data from a global forecast.

Workflow Yaml

name: get_forecast
sources:
  user_input:
  - preprocessing.user_input
sinks:
  forecast: read_forecast.local_forecast
parameters:
  noaa_gfs_token: null
tasks:
  preprocessing:
    op: gfs_preprocess
    op_dir: gfs_preprocess
    parameters:
      sas_token: '@from(noaa_gfs_token)'
  gfs_download:
    op: gfs_download
    op_dir: gfs_download
    parameters:
      sas_token: '@from(noaa_gfs_token)'
  read_forecast:
    op: read_grib_forecast
    op_dir: read_grib_forecast
edges:
- origin: preprocessing.time
  destination:
  - gfs_download.time
- origin: preprocessing.location
  destination:
  - read_forecast.location
- origin: gfs_download.global_forecast
  destination:
  - read_forecast.global_forecast
description:
  short_description: Downloads weather forecast data from NOAA Global Forecast System
    (GFS) for the input time range.
  long_description: The workflow downloads global forecast data from the Planetary
    Computer with 13km resolution between grid points. The workflow requires a SAS
    token to access the blob storage, which can be found at https://planetarycomputer.microsoft.com/dataset/storage/noaa-gfs.
  sources:
    user_input: Time range and geometry of interest.
  sinks:
    forecast: Weather forecast data.
  parameters:
    noaa_gfs_token: SAS token to access blob storage.