Can you share a template for FIM?

[Semihal]

I can't find template for FIM (Fill in the middle) task. Can you share it?

[mayank31398]

Hi, its similar to starcoder models.

input_text = "<fim_prefix>def print_hello_world():\n    <fim_suffix>\n    print('Hello world!')<fim_middle>"
inputs = tokenizer.encode(input_text, return_tensors="pt").to(device)
outputs = model.generate(inputs)
print(tokenizer.decode(outputs[0]))