It is impossible to accurately guess you HPTA's response to AAS. Given that you already have low serum test levels, I would assume that recovery could be harder for you, though that is purely an assumption.
With all things concerning complex physiology, one will never know until after the variable has been introduced. You could talk to an Endocrinologist about this, though he or she also will be unable to give you an entirely accurate answer.
So, knowing that you MAY be at a higher risk for recovery issues, and (hopefully) knowing the consequences of compromised recovery, you could make a slightly informed decision, weighing cost vs. benefit. It all really comes down to you.