UART interface reading stick data as button data and vice versa

[Mynotaurus]

When running the python example, the sent bytes don't always line up with how the arduino is reading them.
For example, sending a bytearray of [128, 128, 128, 128, 1] should set both sticks to neutral and have no button presses.
[128, 128, 128, 128, 1]
LX LY RX RY C
However, most of the time this ends up out of sync, eg the 1 is read as a joystick input and a 128 as button presses.
[128, 128, 128, 128, 1]
C LX LY RX RY
Is there an easy fix I am missing somewhere?
I am using an Arduino Pro Micro
Thanks in advance

Same issue...

2022-09-18.14-18-12.mp4