Sometimes focus cannot move out of the iframe for left/right navigation direction

[jihyerish]

Sometimes focus cannot move out of the iframe for left/right navigation direction.
This bug is shown in the demo center.
(https://wicg.github.io/spatial-navigation/demo/#iframe-element)