We could consider a scheduler job to check if PRs are mergeable. We would add a comment ONCE if not (or maybe once per sha?). We could use a hidden HTML comment in the message to track which sha have been handled already.