How to DIY the input/output format

[ruifengma]

If I would like to modify a bit the input/output structure for the api service, what should I do? Thanks

[krrishdholakia]

Moving to discussion, as this isn't exposed yet - but will try and enable it, this week

[ruifengma]

Thanks @krrishdholakia for the reply, I have a very similar api request input format to openai api and I would like to adapt. Now I can connect to my local hosted LLMs with the config file and I'm find the definition about the format. Or if it is possible to get some information about where did you define it this

[ruifengma]

Moving to discussion, as this isn't exposed yet - but will try and enable it, this week

any progress?

[krrishdholakia]

yup - working on it now @ruifengma

[krrishdholakia]

PR - #4887