Skip to main content

Overview

Goldsky is a high-performance data indexing provider for Fogo that makes it easy to extract, transform, and load on-chain data to power both application and analytics use cases via Turbo Pipelines (real-time data replication pipelines). Fogo is a purpose-built Layer 1 blockchain designed for high-performance trading with sub-40ms blocks, sub-second confirmation, and SVM L1 compatibility. Built on a custom Firedancer client, Fogo delivers the speed and reliability demanded by modern finance.

Getting started

To use Goldsky, you’ll need to create an account, install the CLI, and log in.
  1. Install the Goldsky CLI: For macOS/Linux:
    curl https://goldsky.com | sh
    
    For Windows:
    npm install -g @goldskycom/cli
    
    Windows users need to have Node.js and npm installed first. Download from nodejs.org if not already installed.
  2. Go to your Project Settings page and create an API key.
  3. Back in your Goldsky CLI, log into your Project by running the command goldsky login and paste your API key.
  4. Now that you are logged in, run goldsky to get started:
    goldsky
    

Turbo Pipelines

Turbo pipelines allow users to replicate data into their own infrastructure (any of the supported sinks) in real time. For a complete overview of how to deploy Turbo pipelines, including a video walkthrough, check the Quickstart guide.

Working with Fogo datasets

Goldsky provides real-time streaming of Fogo datasets, including all historical data, for both mainnet and testnet. The following datasets are currently available:
DatasetDescription
Transactions with InstructionsEnriched transaction data including instructions, accounts, balance changes, and metadata for the block.
RewardsRecords of rewards distributed to validators for securing and validating the network.
BlocksMetadata for each block on the chain including hashes, transaction count, slot and leader rewards.
These datasets can be used as sources in your Turbo pipelines to stream Fogo data to any of the supported sinks.

Deploying Fogo pipelines

Turbo pipelines are defined using YAML configuration files and deployed via the Goldsky CLI. Here’s the workflow:
  1. Create a pipeline configuration file - Define your sources, transforms, and sinks in a YAML file
  2. Validate your configuration - Run goldsky turbo validate fogo-pipeline.yaml to check for errors
  3. Deploy the pipeline - Run goldsky turbo apply -f fogo-pipeline.yaml to deploy
  4. Monitor your pipeline - Use goldsky turbo logs fogo-pipeline.yaml to view logs and goldsky turbo inspect fogo-pipeline.yaml to see live data
For a complete walkthrough, see the Turbo Pipelines Quickstart.
Remember to first create a Secret in order for Turbo Pipelines to be able to write the data into the database of your choice.

Example pipeline configuration

Here’s an example configuration file for streaming Fogo transactions with instructions:
fogo-transactions.yaml
name: fogo-transactions
resource_size: s

sources:
  fogo_transactions:
    type: dataset
    dataset_name: fogo.transactions_with_instructions
    version: 1.0.0
    start_block: 1000000  # Start from a specific block, or omit to start from latest

sinks:
  postgres_fogo_transactions:
    type: postgres
    from: fogo_transactions
    schema: public
    table: fogo_transactions
    secret_name: <YOUR_SECRET_NAME>
    primary_key: id
Using the start_block filter: The start_block parameter allows you to specify exactly where your pipeline should begin processing data:
  • Omit start_block to start from the latest block (recommended for new pipelines)
  • Set a specific block number (e.g., start_block: 1000000) to process from that block forward
  • Use for historical processing when you need data from a specific point in time
Add your corresponding secret name and run goldsky turbo apply -f fogo-transactions.yaml to deploy the pipeline.

Getting support

Can’t find what you’re looking for? Reach out to us at support@goldsky.com for help.