Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎉 New Destination: Propel #35427

Closed
Show file tree
Hide file tree
Changes from 8 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -5216,6 +5216,46 @@
},
"supportsDbt": true
},
{
"destinationDefinitionId": "938e4f36-ab42-4486-9a21-d43df92ed9e4",
"name": "Propel",
"dockerRepository": "propeldata/airbyte-propel-destination",
"dockerImageTag": "0.0.1",
"documentationUrl": "https://docs.airbyte.com/integrations/destinations/propel",
"icon": "propel.svg",
"spec": {
"documentationUrl": "https://propeldata.com/docs",
"connectionSpecification": {
"$schema": "http://json-schema.org/draft-07/schema#",
"title": "Propel Spec",
"type": "object",
"required": ["application_id", "application_secret"],
"additionalProperties": false,
"properties": {
"application_id": {
"type": "string",
"title": "Application ID",
"description": "Propel Application ID",
"examples": ["APP00000000000000000000000000"]
},
"application_secret": {
"type": "string",
"title": "Application Secret",
"description": "Propel Application secret",
"airbyte_secret": true
}
}
},
"supportsIncremental": true,
"supportsNormalization": false,
"supportsDBT": false,
"supported_destination_sync_modes": ["append", "overwrite"]
},
"tombstone": false,
"public": true,
"custom": false,
"releaseStage": "alpha"
},
{
"destinationDefinitionId": "2340cbba-358e-11ec-8d3d-0242ac130203",
"name": "Pulsar",
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
data:
registries:
cloud:
enabled: false
oss:
enabled: true
connectorSubtype: api
connectorType: destination
definitionId: 938e4f36-ab42-4486-9a21-d43df92ed9e4
dockerImageTag: 0.0.1
dockerRepository: propeldata/airbyte-propel-destination
githubIssueLabel: propeldata/airbyte-propel-destination
icon: propel.svg
license: MIT
name: Propel
releaseStage: alpha
documentationUrl: https://docs.airbyte.com/integrations/destinations/propel
tags:
- language:unknown
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmmm. IS this because the tag is required, but the value is irrelevant?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just used the other third party connectors as a base. Since those are in Javascript and the language was set as unknown, I set it as such too. Do let me know if setting it as go or golang would be appropriate.

ab_internal:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know if these make sense — and I'm not sure why we default them to 100.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same as above, the others had it as 100 😕 but let me know if those should change

sl: 100
ql: 100
supportLevel: community
metadataSpecVersion: "1.0"
68 changes: 68 additions & 0 deletions docs/integrations/destinations/propel.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,68 @@
# Propel

## Overview

[Propel](https://www.propeldata.com) is an Analytics Platform as a Service for developers to effortlessly ship embedded analytics, data-serving APIs, and usage metering into their applications.

It provides developers with:

- [Serverless ClickHouse](https://www.propeldata.com/docs/connect-your-data) to serve data blazingly fast without managing any infrastructure.
- [Data serving APIs](https://www.propeldata.com/docs/query-your-data) and [React UI components](https://storybook.propeldata.com/) to build customer-facing analytics experiences.
- [Access Control policies](https://www.propeldata.com/docs/control-access/multi-tenancy) to securely serve data to authenticated users in multi-tenant environments.

This Airbyte destination allows to sync data into a Propel Data Pool.

> ℹ️ This destination is maintained by Propel. Please send any support requests to [email protected]

## Features

| Feature | Supported | |
| :----------------------------- | :-------- | :-- |
| Full Refresh Sync | Yes | |
| Incremental - Append Sync | Yes | |
| Incremental - Append + Deduped | No | |
| Namespaces | Yes | |

## Getting started

### Prerequisites

To connect Propel to Airbyte, you need the following:

- A [Propel account](https://console.propeldata.com/get-started).
- An Airbyte account.
- A Propel Application with the ADMIN scope.

---

## Setup instructions

You must create a Propel Application. Propel Applications provide the API credentials, allowing the Airbyte destination to access the Propel API.

1. Log in to the [Propel Console](https://console.propeldata.com/).
2. Go to the **Applications** section and click **Create Application**.
3. Enter the **Unique Name**. For example, "Airbyte Destination".
4. Provide a **Description**. For example, "The Airbyte Destination app".
5. In the API scopes section, in the **Scopes** drop-down menu, select the **ADMIN** scope.
6. In the Propeller section, in the **Select Propeller** drop-down menu, select the processing power as per your requirements.
7. Click **Create**.
8. Make a note of the Application ID and secret. You will need them to configure Airbyte.

## Configuration

| Parameter | Type | Notes |
| :----------------- | :----: | :------------------------ |
| application_id | string | Propel Application ID |
| application_secret | string | Propel Application secret |

## Troubleshooting

If a sync fails to insert a record, you can review sync errors in the Propel console. Select the Data Pool to which data is being synced and select the **Error Logs** tab.

You may send support requests to: [email protected]

## CHANGELOG

| Version | Date | Pull Request | Subject |
| :------ | :--------- | :----------------------------------------------------------------- | :-------------------------- |
| 0.0.1 | 2024-02-19 | [GitHub](https://github.com/propeldata/airbyte-destination/pull/1) | Initial Propel destination. |
Loading