Ethics Evaluation on GPT-4o-mini

Here I develop a framework using inspect-ai for evaluating LLMs on the ETHICS dataset. This project is a foundation for evaluating the behaviors of complex LLMs such as moral parliaments on ethical questions. In machine ethics, the moral parliament is a leading idea among ethical decision-making algorithms. Such algorithms are of particular interest in future LLMs.

Presentation Slides