Well, my level was <200. So my doc was concerned and really wanted me on the clomid. I was concerned about my impending gyno and it wasn't hard to get a script for arimidex.
If you doc only cares about the numbers, you are hosed. If they don't mind treating the symptoms, then you should be fine. You may have to see a few doctors before you find one that is comfortable treating symptoms.
Or you might find out that low T isn't your problem and that there's something else. I walked into the Drs office convinced my problems were because of pollen allergies. He suspected otherwise and was right.
You do seem to have serious anxiety. That could be caused by low T, OR it could be causing your lowish T.