Inference server alternatives

[kondratyevd]

We should consider alternatives to Triton as the inference server, and if other solutions are viable, implement necessary changes to make SuperSONIC support them.

Current candidates:

• KServe
• Cog

[kpedro88]

It is important to keep in mind that software development on the client side would be necessary for several aspects:

1. Fallback server launching and control
2. Server queries, if the new server technology does not support the same protocols as Triton (both KServe and the various extensions).