My solution was to replace the built in case fan with a quieter one from Amazon.
I went with a 5 pack because I can use the rest around in projects, I got these:
FYI, those particular fans (and others I’m sure) have a different plug polarity (black and red are switched compared to the stock fan). If you replace fans, double check the plug polarity!