Quantifying prompt quality using information theory: entropy and mutual information analysis of 1,800 LLM generations
-
Updated
Nov 20, 2025 - Jupyter Notebook
Quantifying prompt quality using information theory: entropy and mutual information analysis of 1,800 LLM generations
📊 Explore how Shannon entropy and mutual information can quantify prompt quality in generative AI systems across various temperature settings.
Add a description, image, and links to the prompt-quality topic page so that developers can more easily learn about it.
To associate your repository with the prompt-quality topic, visit your repo's landing page and select "manage topics."