The MarkLogic Data Hub Framework is a data integration framework and tool-set to quickly and efficiently integrate data from many sources into a single MarkLogic database, and expose that data.

The Data Hub Framework is free and open source under the Apache 2 License and is supported by the community of developers who build and contribute to it. Please note that this open source project and its code and functionality is not representative of MarkLogic Server and is not supported by MarkLogic.

OS	Status
Linux/Mac
Windows

This is the official branch of The MarkLogic Data Hub Framework. It is compatible with MarkLogic 8 or 9.

If you are looking for the Legacy 1.0 branch ( MarkLogic 8 compatible only ) go here.

MarkLogic Data Hub

Go from nothing to Operational Data Hub in a matter of minutes.

This project allows you to deploy a skeleton Data Hub into MarkLogic. With some basic configuration you will be running an Operational Data Hub in no time.

Getting Started

Prerequisites

You need these to get started

• Java 8 JDK
• MarkLogic 8.0-7 or greater, or 9.0-1.1 or greater
• Gradle 3.4 or greater (Optional)

TL;DR

Head over to our Getting Started Tutorial to get up and running with the Data Hub.

Or watch the MarkLogic University - Data Hub Framework On Demand Video Courses

The Easiest Way

To use the Data Hub Framework you should download the latest quickstart.war.

Then Run the war like so:

java -jar quick-start-2.0.2.war

Using the Hub in your existing Java project

Alternatively you can include the jar file as a build dependency in your Java project. Make sure you reference the latest version.

Gradle

compile('com.marklogic:marklogic-data-hub:2.0.2')

Maven

<dependency>
  <groupId>com.marklogic</groupId>
  <artifactId>marklogic-data-hub</artifactId>
  <version>2.0.2</version>
  <type>pom</type>
</dependency>

Ivy

<dependency org='com.marklogic' name='marklogic-data-hub' rev='2.0.2'>
  <artifact name='$AID' ext='pom'></artifact>
</dependency>

Command Line Ninjas

If you prefer to use gradle for all of your hub interactions then you can include the ml-data-hub gradle plugin in your build.gradle file:

plugins {
    id 'com.marklogic.ml-data-hub' version '2.0.2'
}

Now you have full access to the Data Hub tasks. To see all available tasks run:

./gradlew tasks

There is a sample barebones project here

Building From Source

Feeling intrepid? Want to contrubute to the Data Hub Framework? Perhaps you just want to poke the code?

Look at our CONTRIBUTING.md file for details on building from source.