Spacy with Llama-2

[BadrinathMJ]

Can we integrate the spacy-llm with Llama2 for named entity recognition?

[rmitsch]

Hi @BadrinathMJ, yes, every task/model combination is possible.

[BadrinathMJ]

But for fine tuning purpose we need to do the annotations of named entities extraction. If we directly pass the prompt on huge corpus of text . There may be chances of hallucinations in response by Llama 2. So should we first do the annotations and train on those annotations and test it large corpus of text for named entity extraction?

[rmitsch]

So should we first do the annotations and train on those annotations and test it large corpus of text for named entity extraction?

I'm not sure I follow. What exactly is your use case?

[BadrinathMJ]

@rmitsch I want extract the named entities from legal documents. e.g. There huge corpus of text documents , I want to fine tune it using LLama2 . After finetuning it, want to test it on test document for extraction of named entities.

[rmitsch]

spacy-llm currently doesn't support custom LLMs, only those listed in the docs. It's on our roadmap though.