VAST SyncEngine is a powerful distributed data migration and synchronization platform designed for enterprise-scale data operations. It provides a robust solution for seamless data transfer between various data sources and destinations, while maintaining comprehensive metadata indexing and cataloging capabilities.
VAST SyncEngine consists of a control plane that handles scheduling, coordination, and monitoring, and multiple workers that are deployed across multiple hosts and perform data transfer operations between migration source and destination.
VAST SyncEngine data migration process involves the following steps:
-
Configure connectors for the migration source and destination.
A connector represent a storage endpoint. When you configure a connector, you supply parameters required for VAST SyncEngine to access the store through a given endpoint.
-
Configure and run the migration.
During the migration, VAST SyncEngine workers perform data transfer and synchronization using the connectors specified in migration parameters.
In addition to running a migration on demand, SyncEngine also lets you configure recurring migrations or migrations triggered by events at the source store.
-
Monitor migration progress and completion.
VAST SyncEngine lets you view detailed real-time migration status on a Grafana dashboard, aggregate migration logs with Grafana Loki, and export migration metrics with Prometheus. In addition, the full range of VAST cluster metrics and analytics can be used to verify migration results on the VAST Data platform.
Supported Migrations
| Source | Destination | Steps |
|---|---|---|
| S3 | VAST S3 | Migrate from S3 to VAST S3 |
| Google Cloud Storage | VAST S3 | Migrate from GCS to VAST S3 |
| Confluence | VAST S3 | Migrate from Confluence to VAST S3 |
| Google Drive | VAST S3 | Migrate from Google Drive to VAST S3 |
| OneDrive | VAST S3 | Migrate from OneDrive to VAST S3 |
| NFS | VAST NFS | Migrate from NFS Export to VAST NFS |
| POSIX | POSIX | Migrate from POSIX to POSIX |