support stream infer, and add a web demo base gradio

[zhnglicho]

No description provided.

[rsxdalv]

Thank you, I tested the gradio UI!

I could not get multi turn to work, does it work for you?

[AlanSwift]

Thank you for contributing! I will test it these days.

[zhnglicho]

Thank you, I tested the gradio UI!

I could not get multi turn to work, does it work for you?

you can take a look this issue, that has a solution to fix multi turn
#44

[zh19990906]

没有提供任何描述。

大佬，我参考了一下你的代码，遇到一个问题，切分的部分是固定块切分的，中文的回复的过程中，发现有些字会被切开，然后再将结果拼接就会遇到很明显的拼接问题