We'd still use saved models / tflite as serialization format and means to pass models to the compiler. Another possibility is moving to pytorch, if we can get from pytorch to saved models / tflite.