Skip to content

sbonnick/yasetl

Repository files navigation

Build Status Maintainability Test Coverage

dependencies Status devDependencies Status

Docker Docker

Proposed syntax:

node index.js --source.username user --source.password password --source.baseurl https://api.atlassian.com/ex/jira/${cloudId}/rest

Proposed Configuration:

General

{
  "schemaVersion": "0.1",
  "source": {
    "engine":   "jira",
    "baseurl":  "https://api.atlassian.com/ex/jira/cloudId/rest",
    "query":    "project=PROD ORDER BY status ASC",
    "username": "user",
    "password": "password",
  },
  "destination": {
    "engine":      "postgres",
    "connection":  "postgresql://postgres:1234@localhost:5432/postgres",
    "table":       "jira"
  },
  "fields": {
    ...
  }
}

Fields

field processors are chained linearly. the output of one is streamed into the next.

"<field>": {
  "input":    "RECORD.fields.labels",
  "datatype": "text",
  "internal": false,  
  "processors": [{
    "processor": "array-filter",
    "criteria":  ["blah"]
  },{
    "processor": "string-format",
    "criteria":  "camelcase"
  }]
}

Filed Input Options

  • RECORD [default]: referencing the source item object or a sub record of it
  • FIELD: referencing a already processed field record

About

Yet Another Simple ETL

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published