-
Notifications
You must be signed in to change notification settings - Fork 46
AIT threading feature documentation #3076
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
aebe2c1 to
ea0ac8d
Compare
1fca0f7 to
6c00e62
Compare
6c00e62 to
3990c2b
Compare
|
Following discussions, I've updated this with an approach oriented around chain of thought, exposing both an inline and threading based approach according to the desired UX. cc @paddybyers |
| // Derive reasoning channel name from responseId and | ||
| // use rewind to retrieve historical reasoning | ||
| const reasoningChannel = realtime.channels.get(`{{RANDOM_CHANNEL_NAME}}:${responseId}`, { | ||
| params: { rewind: '2m' } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is 2m enough in general?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No, but I have included a call out below which points the user to specific documentation covering hydration strategies
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it worth having a brief explanation somewhere as to why it's 2m though? We're giving them a link covering hydration strategies but they on this page alone they won't know why it's 2m.
3990c2b to
06aafc8
Compare
paddybyers
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Lgtm, thanks
Documents patterns for exposing reasoning output from models along with final output.
06aafc8 to
a5b822b
Compare
abef1fe
into
AIT-129-AIT-Docs-release-branch
AIT-213