Introduction

VAST DataEngine is the VAST compute orchestration framework. The framework enables users to write, deploy and manage execution pipelines against scheduled or event driven triggers. VAST DataEngine runs on VAST Cluster and dynamically provisions infrastructure and runtime resources according to demand. VAST DataEngine frees users from the need to manage and handle infrastructure scaling and availability or worry about performance.

The VAST DataEngine REST API provides the following services:

• Provisioning Service. This services provides endpoints for deploying DataEngine on a VAST Cluster tenant, connecting and provisioning related cluster-internal and third party services such as event brokers, container registries and Kubernetes clusters, and for provisioning DataEngine resources such as triggers, functions and pipelines.

• Telemetries Collector Service. This service provides endpoints for managing the VAST DataEngine telemetry collector service. The telemetries collector service provides observability over user executed pipelines and functions. The telemetries service collects logs, and traces of pipelines.

• Telemetries Query Service. This service provides endpoints for managing the VAST DataEngine telemetry query service, which enables you to query the telemetry logs and traces.