Structured outputs #19
Description
Sometimes structured outputs are used along with the LLMs. This technique employs context grammar to allow to use only a subset of tokens from a dictionary. It can influence results so maybe we should keep information about using it?