Skip to content

Latest commit

 

History

History
93 lines (74 loc) · 4.72 KB

amazon_appflow.md

File metadata and controls

93 lines (74 loc) · 4.72 KB

Amazon AppFlow

Amazon AppFlow is a fully managed integration service that enables you to securely transfer data between Software-as-a-Service (SaaS) applications and AWS services. It provides a seamless way to ingest, transform, and transfer data without the need for building and maintaining custom API connectors, saving time and reducing dependency on skilled developer resources.

Key Features and Capabilities

Data Integration

  • Sources:
    • Popular SaaS applications, including:
      • Salesforce
      • SAP
      • Zendesk
      • Slack
      • ServiceNow
  • Destinations:
    • AWS services such as:
      • Amazon S3
      • Amazon Redshift
    • Non-AWS destinations like Snowflake and Salesforce.

Triggers for Flows

Amazon AppFlow supports three types of triggers for running data flows:

  1. Run on Demand:
    • Manually trigger the flow as needed.
  2. Run on Event:
    • Automatically execute the flow in response to events from SaaS applications.
  3. Run on Schedule:
    • Execute flows at recurring intervals, such as daily or weekly.

Data Security and Encryption

  • Encryption Options:
    • AWS provides managed keys and the option to use customer-managed keys.
    • For customer-managed keys:
      • Provides full control over encryption.
      • Amazon AppFlow attaches a resource policy to the KMS key, granting access for operations.
  • Secure Transfers:
    • Transfers data encrypted over the public internet or privately via AWS PrivateLink, ensuring security.

Incremental Data Transfers

  • Supports incremental data transfer, which only transfers:
    • Records added or changed since the last successful flow run.
    • Based on a source timestamp field, such as CreatedDate.
    • Example:
      • Transfer only newly created records while excluding previously transferred or unchanged data.

Data Transformation

  • Built-in transformation capabilities allow you to:
    • Filter data based on specified criteria.
    • Validate data to ensure quality and consistency before transferring.

Benefits

  1. Time and Cost Savings:
    • Eliminates the need for writing and maintaining custom integrations, freeing up IT resources.
    • Leverages existing APIs for immediate deployment.
  2. Empowers Non-Developers:
    • Systems Administrators and business analysts can quickly implement integrations without requiring technical expertise.
  3. Scalable Integration:
    • Supports large-scale data flows between SaaS applications and AWS services, ensuring seamless scalability.
  4. Flexible Data Transfer:
    • Flows can be triggered on-demand, by event, or on a set schedule, adapting to varied use cases.
  5. Secure and Compliant:
    • Offers encryption with customer control and the option for private data transfer using AWS PrivateLink.

Example Use Cases

  1. Customer Data Integration:
    • Pull contact records from Salesforce into Amazon Redshift for analytics.
  2. Support Management:
    • Transfer support tickets from Zendesk to an Amazon S3 bucket for further analysis.
  3. Batch Data Transfers:
    • Schedule recurring data syncs from Slack or SAP to Snowflake for consistent updates.
  4. Event-Driven Workflows:
    • Trigger flows based on real-time events, such as new customer signups in Salesforce.

Features Summary Table

Feature Description
Source Applications Salesforce, SAP, Zendesk, Slack, ServiceNow, and other SaaS applications.
Destination Options Amazon S3, Amazon Redshift, Snowflake, and more.
Triggers Run on demand, on schedule, or on event.
Data Transformation Filtering and validation capabilities for refining data before transfer.
Incremental Transfers Transfers only new or changed records since the last successful flow run.
Encryption Options AWS managed or customer-managed KMS keys for encrypting data during transit and at rest.
Secure Connectivity Data transfer over the public internet (encrypted) or privately via AWS PrivateLink.
Ease of Use Enables administrators and analysts to build integrations without coding.