Skip to content
/ fram Public

Extract metadata from Bigquery and load to Amundsen

Notifications You must be signed in to change notification settings

cpnat/fram

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data load scripts for Amundsen experiment

  1. Pip install requirements.txt

  2. Run /ingest/bigquery_ingest.py with the following args:-
    gcloud_project
    neo4j_endpoint
    neo4j_user
    neo4j_password
    temp_folder_path

Also see https://github.com/lyft/amundsendatabuilder#amundsen-databuilder

Note, databuilder.extractor.bigquery_usage_extractor has a bug; and requires an exception handler to wrap refTables iteration (will submit a PR - line 107)

About

Extract metadata from Bigquery and load to Amundsen

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages