Slack Weekly Digest 2024-06

[marcosmarxm]

This is weekly digest of discussions happened in the Airbyte Slack.

Connector Discussions

• [Thread] [source-mongodb] Unable to Connect MongoDB as a Source in Airbyte - SSL/TLS Handshake Error
• [Thread] [source-postgresql] TimescaleDB Compression Issue with Airbyte Sync: org.postgresql.util.PSQLException on tableoid system column
• [Thread] [destination-snowflake] Error with MySQL Connector: Invalid DateTime Format in Stream "table here"
• [Thread] [source-slack] Slack Source Connector: Missing Reaction Data for Thread Replies
• [Thread] [source-facebook-marketing] Facebook Marketing Connector: Request for Persistent Token
• [Thread] [source-postgresql, cdc] CDC replication slot not syncing since December 15th, causing storage full crash.
• [Thread] [source-postgresql, cdc] Airbyte SQL Server to Postgres CDC Sync: DebeziumException with ClassCastException
• [Thread] [source-shopify] Shopify Connector not syncing historical data for newly added stream
• [Thread] [source-jira] Enhance Jira to Snowflake connector to generate structured data instead of JSON blobs
• [Thread] [source-facebook-marketing] [Facebook Marketing source] Duplicate Data Issue with Incremental-Append Sync
• [Thread] [source-mixpanel] Mixpanel Source Connector Attempting Cohort Endpoint Access Despite Selected Export Stream
• [Thread] [source-facebook-marketing] Difficulty Utilizing System User Token in Facebook Marketing Connector
• [Thread] [source-salesforce] Salesforce Connector Sync Mode Options Limited to Incremental Append or Full Refresh Append
• [Thread] [destination-postgresql] Postgres Destination Connection Error with Server Unavailability (HTTP 502) - Compatibility Query for Connector Version 9.6.1
• [Thread] [destination-databricks] Databricks Lakehouse Connector SSL Error with HTTPS Configuration
• [Thread] [source-mysql, cdc] MySQL CDC Connector: Socket Closed and Connection Reset Issues during S3 Sync
• [Thread] [source-mysql, cdc] Setting up CDC between two MySQL servers using binary logs in Airbyte
• [Thread] [destination-iceberg] Trouble Setting Up Iceberg Destination with MinIO Connector
• [Thread] [destination-azure-blob-storage] Dynamic datetime parameter in Azure Blob Connector destination container name
• [Thread] [destination-postgresql] Trouble with Normalization in V2 Postgres Destination
• [Thread] [source-google-drive] Google Drive Source Connector Syncing 0 Records with Internal Server Error: Cannot invoke "io.airbyte.api.model.generated.AirbyteCatalog.getStreams()"
• [Thread] [custom-connectors] : Custom Connector with Pagination and Incremental Sync Fails with 504 Timeout for Snowflake V2 Destination
• [Thread] [destination-postgresql] Permission Denied Error when Syncing Snowflake to PostgreSQL Connector
• [Thread] [source-teradata, cdc] Teradata Connector: Inquiry Regarding CDC Feature Compatibility
• [Thread] [source-mssql] Airbyte SQL Server Connector Sync Failure with Default Value Constraint
• [Thread] [source-confluence] Confluence to MongoDB Connector Producing Empty Article Pages
• [Thread] [custom-connectors, oauth] Unable to Initiate OAuth for SNAPCHAT_MARKETING Connector
• [Thread] [source-mssql, cdc] Sync to New Changes Only" Setting in MSSQL Connector UI

Platform Discussions

• [Thread] [sync, normalization] Sync Failure on Airbyte Connectors - First Attempt Fails with WorkerException and Unused Configuration Paths
• [Thread] [deployment, config] Memory Limit Configuration Issue for Dynamic Postgres Src to Postgres Dest Replication
• [Thread] [deployment, micronaut] Error starting Micronaut server: Issue with DeclarativeSourceDefinitionsApiController and DestinationServiceJooqImpl
• [Thread] [upgrade, migration, eks] Unknown Error in UI and Invalid UUID String Exception after Migrating to Airbyte (v40.15) on EKS with RDS PostgreSQL
• [Thread] [deployment, config, credentials] Container orchestrator pod does not have access to GCP credentials
• [Thread] [deployment, temporal] airbyte-temporal errors and 502 response when creating test e2e source with custom CloudSQL Postgres instance
• [Thread] [question] can airbyte map sql schema like primary key , foreign key to source sql to destination sql?
• [Thread] [deployment, database] Using Postgres Version Higher than 13 for Airbyte Job and Config Database
• [Thread] [deployment, helm, feature-flags] Helm chart question for deploying Airbyte with custom heartbeat.failSync configuration
• [Thread] [custom-connectors] Managing Custom Connector Development and Maintenance in Airbyte Community Repo Fork
• [Thread] [terraform] Terraform Provider Lagging Behind Source Connector Configuration Changes
• [Thread] [api] Unable to Retrieve bytesSync from API Endpoint for Specific jobId
• [Thread] [data-mismatch] Airbyte sync job reports 0 records transferred despite data differences between AWS Redshift and Kafka Topics
• [Thread] [deployment, sso] Implementing Single Sign-On with Azure Active Directory for Self-Hosted Airbyte on Kubernetes
• [Thread] [webapp] UI Loading Delay Due to High Number of Deprecated Connections
• [Thread] [deployment, database] Unable to access default workspace page when deploying Airbyte locally with external PostgreSQL database
• [Thread] [parallelization] Need to Parallelize Connector Connection in Docker Deployment
• [Thread] [deployment, config, secrets] Error Configuring AWS_SECRET_MANAGER Connector with Incorrect Endpoint
• [Thread] [api] Unable to Successfully Implement initiateOAuth API Endpoint for Slack Connector
• [Thread] [api] Missing Normalize Tabular Data Option in Clickhouse Destination API
• [Thread] [deployment] Trouble Moving Airbyte to Cloud Server with Docker Container: Network Error with redash_default
• [Thread] [logs] Error Logs for Failed Postgres Destination Connection Setup: Check Persistent Container
• [Thread] [terraform] Configuration Error with Google Sheets Authentication in Terraform for Airbyte Source
• [Thread] [deployment, helm, replication-orchestrator] Error Running Oracle to PostgreSQL Sync: Launcher Replication Orchestrator Failed