I'm studying physics- but apparently there aren't many jobs that involve looking through a telescope?

Astronomers don't actually look through telescopes for research anymore. We attach digital cameras and spectroscopes to the telescopes instead, which are much more accurate than anything we could see with our eyes. If that doesn't interest you, buy yourself a small telescope and pick up amateur astronomy as a hobby. You don't need a degree for that.