The people who were initially involved in building and directing the factories were generally of a different background than the great landowners, that's true, but land-owners invested heavily in industrial enterprises, or in banks which in turn invested in industrial enterprises, and were active in pursuing the political and economic reforms that created and sustained the conditions for the industrial revolution. There wasn't a hard economic or political distinction between the two, only one of identity, and in practice, even that was more porous than is usually acknowledged, the majority of the landowning class being a provincial gentry of moderate wealth and no particular ancestry. This wasn't a class of such status or wealth that it could afford to let snobbery interfere with the practical business of remaining upper class, particularly if it preferred to keep itself at one step removed from the grubby business of actually buying and selling things.