In general going for both AH and BW early without some source of commerce like a gold mine, fishing, or at least the wheel for trade routes will hurt your economy a lot on high difficulty levels.
With AH first and your starting position, you could have gone fishing next and build those boats in 5 turns with cow and horse pastures. Then BW can wait after the wheel or maybe even after pottery. On the other hand the worker doesn't have much to do until the wheel, which is why I preferred BW first.