Remove extra Xtensa tools install #3303

Job	Run time
no-labels	1s
ci-ready-to-merge	3s
ci-run	1s
ci-run-full	3s
call-ci / Bazel msan (presubmit)	18m 14s
call-ci / Bazel (presubmit)	23m 20s
call-ci / Bazel TFLite Tools (presubmit)	2m 35s
call-ci / Bazel asan (presubmit)	21m 18s
call-ci / Cortex-M Bluepill Release (presubmit)	13m 8s
call-ci / Cortex-M Bluepill No Release (presubmit)	15m 31s
call-ci / Cortex-M Bluepill Renode (presubmit)	8m 16s
call-ci / Code Style (presubmit)	1m 54s
call-ci / Cortex-M QEMU Unit Tests (presubmit)	13m 24s
call-ci / Project Generation (presubmit)	12m 58s
call-ci / Makefile x86 Default (presubmit)	15m 14s
call-ci / Makefile x86 Release (presubmit)	22m 42s
call-ci / Makefile x86 No TFLite Static Memory (presubmit)	8m 42s
call-ci / Makefile x86 Out Of Tree (presubmit)	7m 8s
call-xtensa-presubmit / Hifi5 Unit Tests (presubmit)	24m 53s
call-hexagon / Hexagon Build Test (presubmit)	12m 21s
call-xtensa-presubmit / Vision P6 Build (presubmit)	19m 47s
call-xtensa-presubmit / Hifi3z Unit Tests (presubmit)	31m 36s
call-check-tflite-files / Check PR Modifies TfLite Files	52s
PR has Bug	1s
	4h 34m 2s

Provide feedback