The individual dose-response to herbals is all over the map and may not work for you. Arimidex/anastrozole has a very well understood dose-response. It simply works. Prescription arimidex is expensive. You would probably start on 1mg/week at $9.00 per mg.
Insurance may not pay for it as you would not be under treatment for hypogonadism or any other "pathology" and it would be considered unnecessary. You doctor may be trying something alternative because of such issues. But if your E2 is in a 0-53 range, she might be able to prescribe for a condition of abnormal E2 levels.
Elevated E2 levels can kill sex drive when T levels are high or even very high. A known problem. Some will have brain fog, low energy and all or any of the symptoms of hypogonadism when their T levels are not an issue. Good T levels alone are not sufficient for wellness.
If you were to start 1mg/wk of arimidex, I would expect that you would have a strong increase in libido in 10-14 days.
You do not need a ultra sensitive E2 test, serum 0-53 range is fine for driving therapeutic decisions and dosing.
Irritability is classic for low T, or for E2 poisoning. When you get the E2 levels down, that will clear up. Libido will tell you quickly that something is going right. Brain changes follow and it takes a while for habits of thought to evolve into the new brain-space.
While thought patterns are in a state of flux and malleable, a positive and hopeful attitude will probably have a significant effect on how you feel in the end. Major mental changes will probably be mostly in place in two months and that process should be complete in 3 months.
E2=17-20 is thought to be optimal from a libido point of view. 1mg/wk might not get you there, but that would be a good target for dose adjustments. That level has no health risks for CV or cholesterol. At those levels of E2, you might find that your emotions are a bit dry and that you are less passionate about some things... more male perhaps. One could determine that they feel best overall perhaps with E2 perhaps closer to 25.