Add token usage and counting to Agent Builder #4384
Conversation
charlotte-hoblik
added
the
documentation
Vale Linting ResultsSummary: 1 warning found
|
| File | Line | Rule | Message |
|---|---|---|---|
| solutions/search/agent-builder/monitor-usage.md | 21 | Elastic.DontUse | Don't use 'just'. |
|
Looking good. I think this deservers to be a standalone page, with a generic name which will allow us to add more content about usage, pricing, billing etc. in the future: maybe something like The H1 can just be about "token usage in AB" initially We should then make sure we link to this new page from the landing page and from the chat, agents, tools pages for visibility. |
|
@copilot can you remove the |
|
@leemthompo I've opened a new pull request, #4413, to work on those changes. Once the pull request is ready, I'll request review from you. |
Removed the `#token-usage-in-elastic-agent-builder` anchor from all links to `monitor-usage.md` to simplify navigation and improve maintainability. **Changes:** - Updated links in `chat.md`, `agent-builder-agents.md`, and `tools.md` to reference `monitor-usage.md` directly without anchor fragments - Links now point to the page itself rather than a specific section, allowing the page structure to evolve independently Before: ```markdown [Token usage in Elastic Agent Builder](monitor-usage.md#token-usage-in-elastic-agent-builder) ``` After: ```markdown [Token usage in Elastic Agent Builder](monitor-usage.md) ``` <!-- START COPILOT CODING AGENT TIPS --> --- 💬 We'd love your input! Share your thoughts on Copilot coding agent in our [2 minute survey](https://gh.io/copilot-coding-agent-survey). --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: leemthompo <32779855+leemthompo@users.noreply.github.com>
|
@copilot we need to add the new page to the |
|
@leemthompo I've opened a new pull request, #4414, to work on those changes. Once the pull request is ready, I'll request review from you. |
Thanks for the feedback on #4384. I've created this new PR, which merges into #4384, to address your comment. I will work on the changes and keep this PR's description up to date as I make progress. Original PR: #4384 Triggering comment (#4384 (comment)): > @copilot we need to add the new page to the `/solutions/toc.yml` file too <!-- START COPILOT CODING AGENT TIPS --> --- 💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more [Copilot coding agent tips](https://gh.io/copilot-coding-agent-tips) in the docs. --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: leemthompo <32779855+leemthompo@users.noreply.github.com>
|
This LGTM but I'll leave the approval to @joemcelroy and @akm-esco as this relates to tokens and billing 🙏🏽 |
|
This generally looks good just want to check on a couple things:
I think I know what this line is getting at but it feels like it would be difficult for a user to understand. Maybe something like, "each conversation round uses the previous rounds of the conversation for context, so subsequent rounds will generate larger quantities of tokens even if the inputs/outputs for that round are relatively small" |
Summary
This PR adds a new "Token usage and counting" section to the documenatition.
It clarifies how the agentic framework calculates token consumption.
Related issue: https://github.com/elastic/docs-content-internal/issues/600