File/Prompt/Instruction input for server

[ASH1998]

Is there a way to send instructions to the server to give output in one type of format ?
There is a syntax in ./main -p where you give instructions, I am looking for something similar on ./server

In the server UI, there is a prompt box, it works similarly, any input is appreciated, thanks.

[ianscrivener]

Sounds like might be looking for the grammer functionality - eg output the response as JSON. #2494, #2560, #1773

Also worth reviewing: system prompt - #2637

[ASH1998]

Closing the discussion, I figured out a way to do this for server using llama-cpp-python after some tinkering. They too do not support this at this point of time. If anyone is interested in working on this, please do, it will help a lot.

Thanks @ianscrivener for your time, I went on a tangent to discover grammar and it was amazing (I didn't know about this functionality)