chat template not supported #29
Description
Am using runpod serverless initially with Deepseek R1 from huggingface, then switched to Llama4-scout for testing but I got this error. No issues on the huggingface side, the model is exactly the same as it was.
Output:
{ "delayTime": 48454, "error": "{'object': 'error', 'message': 'Chat template does not exist for this model, you must provide a single string input instead of a list of messages', 'type': 'BadRequestError', 'param': None, 'code': 400}", "executionTime": 254, "id": "2bee8688-4f7e-4d8d-b198-3ad3054f34d8-u2", "status": "FAILED", "workerId": "9sxpstx8jawche" }
Switched back to deepseek-r1 and still getting the same message.
Nothing was changed but there are processes dependent on this.
Here is the input:
{"input": {
"messages": [
{"role": "system", "content": "You are a physics expert."},
{"role": "user", "content": "What is gravity?"}
]
}}
We changed models in the past and this issue never came up. I don't think its a hf model issue.
Also the models support the system/user type of breakdown