Pipeline management
Apply a pipeline
Deploy a pipeline from a YAML configuration file:
goldsky turbo apply my-pipeline.yaml
- Validate your pipeline configuration
- Create or update the pipeline in your current project
- Start processing data according to your configuration
If there were existing pipelines with the same name, the checkpoints from those pipelines will be reused.
Options
| Flag | Description |
|---|
-i, --inspect | Open the inspect TUI after successful deployment to monitor live data |
# Deploy and immediately start inspecting live data
goldsky turbo apply my-pipeline.yaml -i
To have a pipeline restart from scratch, you will have to rename the pipeline or rename the specific source node to avoid using the existing checkpoints.
List pipelines
View all pipelines in your current project:
Delete a pipeline
Remove a pipeline by name:
goldsky turbo delete my-pipeline
goldsky turbo delete -f my-pipeline.yaml
Validate a pipeline
Check your pipeline configuration without deploying:
goldsky turbo validate my-pipeline.yaml
- Catching syntax errors before deployment
- Verifying source and sink configurations
- Testing transform logic
Viewing logs
Monitor your pipeline’s execution with the logs command:
# View recent logs (default: last 10 lines)
goldsky turbo logs my-pipeline
# Show last 50 lines
goldsky turbo logs my-pipeline --tail 50
# Show logs from last hour
goldsky turbo logs my-pipeline --since 3600
# Include timestamps
goldsky turbo logs my-pipeline --timestamps
Use --follow to monitor your pipeline in real-time, especially useful when debugging or watching data flow through transforms.
Inspecting live data
Open an interactive TUI to view live data flowing through your pipeline:
# Inspect all nodes in a pipeline
goldsky turbo inspect my-pipeline
# Filter to specific topology nodes
goldsky turbo inspect my-pipeline -n source1,transform1
# Adjust buffer size for more history
goldsky turbo inspect my-pipeline -b 50000
Options
| Flag | Description |
|---|
-n, --topology-node-keys | Comma-separated list of nodes to filter |
-b, --buffer-size | Maximum records to keep in buffer (default: 10000) |
Keyboard shortcuts
| Key | Action |
|---|
Tab / ← → | Switch between topology node tabs |
j k / ↑ ↓ | Scroll up/down |
g / G | Jump to top/bottom |
/ | Search records |
n / N | Next/previous search match |
d | Toggle pipeline definition view |
w | Open in web dashboard |
q | Quit |
For detailed information about Live Inspect, including all keyboard shortcuts and features, see the Live Inspect guide. Managing projects and secrets
The Turbo Pipelines CLI integrates with the Goldsky CLI for project management
Projects
# List all projects you are a member of
goldsky project list
golsky login command
Secrets
Secrets are used to store sensitive configuration like database credentials:
# Create a secret
goldsky secret create MY_POSTGRES_SECRET
# List secrets
goldsky secret list
# Delete a secret
goldsky secret delete MY_POSTGRES_SECRET
Secrets are referenced in your pipeline YAML using the secret_name field. See the Pipeline Configuration guide for examples. 
