Initial CLI integration with new SDG interfaces#46

Merged

russellb merged 10 commits intoinstructlab:mainfrom russellb:new-cli-integration

Jun 28, 2024

+1,066-905

Commits on Jun 28, 2024

Split up the utils module
markmc
committed
Import utils.read_taxonomy() from instructlab
markmc
committed
Add get_model_family() from instructlab.utils

russellb
authored and
markmc
committed
Add model_prompt for merlinite/granite

russellb
authored and
markmc
committed
Add API to enable disabling batching
markmc
committed
llmblock: fix batched=False

russellb
authored and
markmc
committed
Add simple knowledge pipeline for use with default merlinite
russellb
committed
Use new API in generate_data
russellb
committed
added number of iterations to generate

oindrillac
authored and
russellb
committed
Add skills variants for the full pipeline
russellb
committed