Minor refactoring of core decoding loop #829

Job	Run time
generate-matrix / generate	4s
Build and Upload wheel / manywheel-py3_9-cuda11_8	6m 55s
Build and Upload wheel / manywheel-py3_9-cuda12_4	7m 18s
Build and Upload wheel / manywheel-py3_9-cuda12_6	7m 16s
Build and Upload wheel / upload / manywheel-py3_9-cuda11_8	21s
Build and Upload wheel / upload / manywheel-py3_9-cuda12_4	20s
Build and Upload wheel / upload / manywheel-py3_9-cuda12_6	26s
install-and-test (3.9, 11.8, 6)	12m 50s
install-and-test (3.9, 11.8, 7)	15m 19s
install-and-test (3.9, 12.4, 6)	13m 58s
install-and-test (3.9, 12.4, 7)	18m 58s
install-and-test (3.9, 12.6, 6)	14m 38s
install-and-test (3.9, 12.6, 7)	11m 55s
	1h 50m 18s

Provide feedback