Databend [ARCHIVED]

Availability:

Airbyte Cloud Airbyte OSS PyAirbyte

Support Level:

Archived

This page guides you through the process of setting up the Databend destination connector.

Features

Feature	Supported?(Yes/No)	Notes
Full Refresh Sync	Yes
Incremental - Append Sync	Yes

Output Schema

Each stream will be output into its own table in Databend. Each table will contain 3 columns:

• _airbyte_ab_id: a uuid assigned by Airbyte to each event that is processed. The column type in Databend is VARCHAR.
• _airbyte_emitted_at: a timestamp representing when the event was pulled from the data source. The column type in Databend is TIMESTAMP.
• _airbyte_data: a json blob representing with the event data. The column type in Databend is VARVHAR.

Getting Started (Airbyte Cloud)

Coming soon...

Getting Started (Airbyte Open Source)

You can follow the Connecting to a Warehouse docs to get the user, password, host etc.

Or you can create such a user by running:

GRANT CREATE ON * TO airbyte_user;

Make sure the Databend user with the following permissions:

• can create tables and write rows.
• can create databases e.g:

You can also use a pre-existing user but we highly recommend creating a dedicated user for Airbyte.

Target Database

You will need to choose an existing database or create a new database that will be used to store synced data from Airbyte.

Setup the Databend Destination in Airbyte

You should now have all the requirements needed to configure Databend as a destination in the UI. You'll need the following information to configure the Databend destination:

• Host
• Port
• Username
• Password
• Database

Compatibility

If your databend version >= v0.9.0 or later, you need to use databend-sqlalchemy version >= v0.1.0. And the Databend Cloud will only support databend version > 0.9.0.

Changelog

Expand to review

| Version | Date | Pull Request | Subject | | :------------------------------------------------------- | :--------------------------------------- | :-------------------------------------------------------- | :------------------------------------------------------- | ----------- | | 0.1.16 | 2024-08-10 | 43611 | Update dependencies | | 0.1.15 | 2024-08-03 | 43234 | Update dependencies | | 0.1.14 | 2024-07-27 | 42588 | Update dependencies | | 0.1.13 | 2024-07-20 | 42164 | Update dependencies | | 0.1.12 | 2024-07-13 | 41800 | Update dependencies | | 0.1.11 | 2024-07-10 | 41429 | Update dependencies | | 0.1.10 | 2024-07-09 | 41243 | Update dependencies | | 0.1.9 | 2024-07-06 | 40916 | Update dependencies | | 0.1.8 | 2024-06-27 | 40215 | Replaced deprecated AirbyteLogger with logging.Logger | | 0.1.7 | 2024-06-25 | 40301 | Update dependencies | | 0.1.6 | 2024-06-21 | 39936 | Update dependencies | | 0.1.5 | 2024-06-04 | 39090 | [autopull] Upgrade base image to v1.2.1 | | 0.1.4 | 2024-05-21 | 38510 | [autopull] base image + poetry + up_to_date | | 0.1.3 | 2024-03-05 | #35838 | Un-archive connector | | 0.1.2 | 2023-02-11 | 22855 | Fix compatibility | | issue with databend-query 0.9 | | 0.1.1 | 2022-01-09 | | 21182 | Remove protocol option and enforce HTTPS | | | 0.1.0 | 2022-01-09 | 20909 | Destination | | Databend |