dont install all the packages for CI

[richard-lane]

the testing CI action is very slow, presumably because it installs CUDA when we don't really need to (unless we want the tests to also check that cuda installs correctly given the environment file)

we could change this to only install the necessary packages - potentially using pixi or uv if we need multiple environments?