Add GPU-side Gumbel-max sampling for CUDA graph compatibility #2612

Job	Run time
test-arm / test-backend-linux (arm_tosa_fp, models) / linux-job	37m 42s
test-arm / test-backend-linux (arm_vgf_fp, operators) / linux-job	16m 5s
test-arm / test-backend-linux (arm_tosa_fp, operators) / linux-job	17m 18s
test-arm / test-backend-linux (arm_vgf_fp, models) / linux-job	37m 14s
test-arm / test-backend-macos	-6s
test-arm / package-golden-artifacts	47s
	1h 49m 0s

Provide feedback