Very odd and unexpected.
Part of this is too much hCG creating higher T-->E2 inside the testes where anastrozole is ineffective.
When you take 0.5mg anastrozole EOD you are really driving T-->E2 down in peripheral tissues. There has been conjecture that doing this would eliminate T-->E2 inside the brain where E2 is used locally. I have never seen evidence of this effect before. But I can't see how any of that would affect how T production in the testes from hCG would be affected.
"So everything I've read would lead me to believe the opposite should occur in relationship to E2 and TT. " does not apply as your HPTA is shutdown. You must always be considering the context for such things.
So I am thinking "out loud" but do not have an explanation. I could go wild and speculate that thyroid function was affected that affected testes.
For fertility, you would be better off with a SERM if that leads to decent LH/FSH levels. FSH has a critical role in sperm production.