If you've got samples, I can probably get us a targeted antifungal in a week or two. "Pop this pill if you think you're infected" and that should minimize the risk for most people.

Definitely probably shouldn't eat those deer, but I don't think most people are inclined to eat any part of the central nervous system anyway? It's got a high chance of complications for humans that can turn nasty, they just aren't designed for it and don't usually go for it. So latent infections should be okay if it's just brains and not the muscle meat.