This problem has always been there on the 2013-2015 CX-5s. It is generally 1-3s behind.
It applies to music too. Try playing a song and then press the ">>" next song button, your phone will immediately switch, but you will still hear another 2s or so of music as the stereo plays out the buffer...