Null chat action support for Agent choosing not to reply in a conversation

[AbdurrehmanSubhani]

• This approach adds a "null" schema to the JsonFormatter in the DefaultFormatter component
• The "null" action is to opted by the agent if it thinks it should not be replying to the incoming messages
• Added in instructions for the agent to for scenarios when the agent should be going for the "null" action in the InstructionsPrompt.
• InstructionsPrompt is a better place for guiding the agent to take null action because the Instructions section influences the agent's decision-making process before it evaluates specific actions, hence not added when to use guidelines in the Action description
• Also added Communication Instructions here because the null action is directly dependant on the communication behaviour of the Agent's

Pros:

• no additional decision making loop as in hence no additional delays if the agent wants to respond choosing an action
• (currently this delay on the PerceptionModifier with gp4o-mini is averaging around 2 seconds for making the descision, then the agent is asked to generated an action again hence the overall latency to get a reply back is around 5 seconds)

Cons:

• Without the thought loop each message is being processed given the whole prompt, hence the inference cost with the complete prompt is always be deducted.
• very minor for now: the agent is showing "is typing" status during this generation process and eventually decides not to send anything. For each message, might have to adjust the typing status

This approach currently blends in together the ORIENT and DECIDE phases of the OODA cycle

Alternative approach with exactly the having cons as pros and pros as cons for the problem:
#647

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
chat	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 29, 2024 5:29am
docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 29, 2024 5:29am

[avaer]

One comment: can we replace the "null" action with the action just being null in the schema?

[AbdurrehmanSubhani]

One comment: can we replace the "null" action with the action just being null in the schema?

Yes, updated accordingly