KYVE

Availability:

Airbyte Cloud Airbyte OSS PyAirbyte

Support Level:

community

Connector Version:

0.2.2(Last updated 11 days ago)

CDK Version:

0.80.0

Usage Rate:

This page contains the setup guide and reference information for the KYVE source connector.

The KYVE Data Pipeline enables easy import of KYVE data into any data warehouse or destination supported by Airbyte. With the ELT format, data analysts and engineers can now confidently source KYVE data without worrying about its validity or reliability.

For information about how to setup an end to end pipeline with this connector, see the documentation.

Source configuration setup

1. In order to create an ELT pipeline with KYVE source you should specify the Pool-ID of KYVE storage pool from which you want to retrieve data.

2. You can specify a specific Bundle-Start-ID in case you want to narrow the records that will be retrieved from the pool. You can find the valid bundles of in the KYVE app (e.g. Cosmos Hub pool).

3. In order to extract the validated from KYVE, you can specify the endpoint which will be requested KYVE-API URL Base. By default, the official KYVE mainnet endpoint will be used, providing the data of these pools.

   Note: KYVE Network consists of three individual networks: Korellia is the devnet used for development purposes, Kaon is the testnet used for testing purposes, and mainnet is the official network. Although through Kaon and Korellia validated data can be used for development purposes, it is recommended to only trust the data validated on Mainnet.

Multiple pools

You can fetch with one source configuration more than one pool simultaneously. You just need to specify the Pool-IDs and the Bundle-Start-ID for the KYVE storage pool you want to archive separated with comma.

Reference

Config fields reference

Field

Type

Property name

string

pool_ids

string

start_ids

string

url_base

integer

max_pages

integer

page_size

Changelog

Expand to review

Version	Date	Pull Request	Subject
0.2.2	2024-06-04	39004	[autopull] Upgrade base image to v1.2.1
0.2.1	2024-05-21	38514	[autopull] base image + poetry + up_to_date
0.2.0	2023-11-10		Update KYVE source to support to Mainnet and Testnet
0.1.0	2023-05-25		Initial release of KYVE source connector