Generally speaking, I would say it is probably easier in most cases, except for certain maps, map sizes, and, ofc, raging barbs on. Otherwise, barbs aren't much of a hindrance to the AI anyway and they get bonuses against them anyway. Raging barbs though can certainly cause some issues for them, and actually that setting can make a game easier should you set out to build the GW asap.
However, I play with barbs as I feel that is the way the game was intended to be played, hence it being a "setting" and not "default". In most cases barbs are rather easy to deal with if you know how to spawnbust,