Take less. I don't mean to be snarky, but if it makes you anxious, it's too much. If 5 mg of Adderall feels like too much, I think the issue is just that you feel different. Give it a few weeks. Psychotropic medication isn't an instant fix without side effects. You'll get used to it.