Pipeline management
Apply a pipeline
Deploy a pipeline from a YAML configuration file:- Validate your pipeline configuration
- Create or update the pipeline in your current project
- Start processing data according to your configuration
apply performs a server-side upsert that preserves checkpoints.
Options
List pipelines
View all pipelines in your current project:Options
Get a pipeline
Fetch details for a single pipeline by name or YAML file:Options
Delete a pipeline
Remove a pipeline by name:Options
Validate a pipeline
Check your pipeline configuration without deploying:- Catching syntax errors before deployment
- Verifying source and sink configurations
- Testing transform logic
Pause a pipeline
Temporarily stop a running pipeline:Options
Resume a pipeline
Resume a previously paused pipeline:- For deployments: restores the replica count from the original pipeline configuration (defaults to 1 if not specified)
- For jobs: sets
suspendtofalse
Options
You can only resume a paused pipeline. Attempting to resume an already running pipeline will return an error.
Restart a pipeline
Restart a running or paused pipeline by triggering a pod restart:Options
This command triggers a pod restart for the pipeline. If the pipeline is paused, it will automatically resume before restarting.
Restart vs Resume: Use
resume to restore a paused pipeline without restarting pods. Use restart when you need to trigger a fresh pod restart, such as after configuration changes or to recover from issues. The --clear-state flag allows you to discard all checkpoints and reprocess data from the beginning.Viewing logs
Monitor your pipeline’s execution with the logs command:Options
Inspecting live data
Open an interactive TUI to view live data flowing through your pipeline:Options
The positional argument accepts either a pipeline name or a path to a YAML file (the name is read from the file’s
name field).
Keyboard shortcuts
The TUI automatically reconnects if the pipeline is updated or temporarily unavailable, with a 30-minute timeout for persistent connection failures.
For detailed information about Live Inspect, including all keyboard shortcuts and features, see the Live Inspect guide.
Inspecting pipeline state
List checkpoint state entries for a pipeline:--clear-state.
Managing projects and secrets
The Turbo Pipelines CLI integrates with the Goldsky CLI for project management. Any command that is not a Turbo pipeline subcommand is forwarded to thegoldsky CLI on your PATH.
Projects
goldsky login command.
Secrets
Secrets are used to store sensitive configuration like database credentials:Secrets are referenced in your pipeline YAML using the
secret_name field. See the Pipeline Configuration guide for examples.