About Transporter

Transporter is designed to be a simple, yet powerful tool for moving data. The data is converted to an agnostic message format to make it easily interchangeable between different types of sources and destinations.

Specifically, Transporter has been built to move data between different databases but is flexible enough to import from plain text files or other information sources. The connections between the Transporter and theses different databases are called Adaptors. An adaptor can be configured as a Source where data is read from or as a Sink, where data can be written. A typical Transporter configuration would have a Source and a Sink configured and then connected to form a data pipeline for the messages to flow through.

To allow for data changes in-flight, Transporter has Transformers. Transformers are either native or JavaScript functions which can manipulate the data encapsulated in a message, along with other meta-data, so that it is suitable for Sinks to write out. This can be anything from renaming fields, picking out particular fields for preservation or just changing values as needed. Transformers are inserted into the pipeline between the Source and Sink.