Otherwise, if there's a single `nan`, all arms are filtered because nothing is less than `np.nan`. This only happens in classification. An alternative error is the $\epsilon$-suboptimality we allow