-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🎉 New Destination: Propel #35427
🎉 New Destination: Propel #35427
Changes from 8 commits
3bfe41f
ef79bfe
3373b1d
b4f6cef
c00eeb0
5bf9d6d
d413dce
f506835
f36230e
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
data: | ||
registries: | ||
cloud: | ||
enabled: false | ||
oss: | ||
enabled: true | ||
connectorSubtype: api | ||
connectorType: destination | ||
definitionId: 938e4f36-ab42-4486-9a21-d43df92ed9e4 | ||
dockerImageTag: 0.0.1 | ||
dockerRepository: propeldata/airbyte-propel-destination | ||
githubIssueLabel: propeldata/airbyte-propel-destination | ||
icon: propel.svg | ||
license: MIT | ||
name: Propel | ||
releaseStage: alpha | ||
documentationUrl: https://docs.airbyte.com/integrations/destinations/propel | ||
tags: | ||
- language:unknown | ||
ab_internal: | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I don't know if these make sense — and I'm not sure why we default them to 100. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Same as above, the others had it as 100 😕 but let me know if those should change |
||
sl: 100 | ||
ql: 100 | ||
supportLevel: community | ||
metadataSpecVersion: "1.0" |
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,68 @@ | ||
# Propel | ||
|
||
## Overview | ||
|
||
[Propel](https://www.propeldata.com) is an Analytics Platform as a Service for developers to effortlessly ship embedded analytics, data-serving APIs, and usage metering into their applications. | ||
|
||
It provides developers with: | ||
|
||
- [Serverless ClickHouse](https://www.propeldata.com/docs/connect-your-data) to serve data blazingly fast without managing any infrastructure. | ||
- [Data serving APIs](https://www.propeldata.com/docs/query-your-data) and [React UI components](https://storybook.propeldata.com/) to build customer-facing analytics experiences. | ||
- [Access Control policies](https://www.propeldata.com/docs/control-access/multi-tenancy) to securely serve data to authenticated users in multi-tenant environments. | ||
|
||
This Airbyte destination allows to sync data into a Propel Data Pool. | ||
|
||
> ℹ️ This destination is maintained by Propel. Please send any support requests to [email protected] | ||
|
||
## Features | ||
|
||
| Feature | Supported | | | ||
| :----------------------------- | :-------- | :-- | | ||
| Full Refresh Sync | Yes | | | ||
| Incremental - Append Sync | Yes | | | ||
| Incremental - Append + Deduped | No | | | ||
| Namespaces | Yes | | | ||
|
||
## Getting started | ||
|
||
### Prerequisites | ||
|
||
To connect Propel to Airbyte, you need the following: | ||
|
||
- A [Propel account](https://console.propeldata.com/get-started). | ||
- An Airbyte account. | ||
- A Propel Application with the ADMIN scope. | ||
|
||
--- | ||
|
||
## Setup instructions | ||
|
||
You must create a Propel Application. Propel Applications provide the API credentials, allowing the Airbyte destination to access the Propel API. | ||
|
||
1. Log in to the [Propel Console](https://console.propeldata.com/). | ||
2. Go to the **Applications** section and click **Create Application**. | ||
3. Enter the **Unique Name**. For example, "Airbyte Destination". | ||
4. Provide a **Description**. For example, "The Airbyte Destination app". | ||
5. In the API scopes section, in the **Scopes** drop-down menu, select the **ADMIN** scope. | ||
6. In the Propeller section, in the **Select Propeller** drop-down menu, select the processing power as per your requirements. | ||
7. Click **Create**. | ||
8. Make a note of the Application ID and secret. You will need them to configure Airbyte. | ||
|
||
## Configuration | ||
|
||
| Parameter | Type | Notes | | ||
| :----------------- | :----: | :------------------------ | | ||
| application_id | string | Propel Application ID | | ||
| application_secret | string | Propel Application secret | | ||
|
||
## Troubleshooting | ||
|
||
If a sync fails to insert a record, you can review sync errors in the Propel console. Select the Data Pool to which data is being synced and select the **Error Logs** tab. | ||
|
||
You may send support requests to: [email protected] | ||
|
||
## CHANGELOG | ||
|
||
| Version | Date | Pull Request | Subject | | ||
| :------ | :--------- | :----------------------------------------------------------------- | :-------------------------- | | ||
| 0.0.1 | 2024-02-19 | [GitHub](https://github.com/propeldata/airbyte-destination/pull/1) | Initial Propel destination. | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hmmm. IS this because the tag is required, but the value is irrelevant?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I just used the other third party connectors as a base. Since those are in Javascript and the language was set as
unknown
, I set it as such too. Do let me know if setting it asgo
orgolang
would be appropriate.