It was in no small part due to Alexios IV Angelos.
The Venetians had gambled their economy on the success of the Fourth Crusade; for a year, they had built no new ships but those meant for the Crusade, they had provided a lot of the supplies, and they had expected to be paid for each crusader who arrived. They'd expected tens of thousands to show up, but after months of waiting, not nearly enough had arrived. The crusaders had had to wait for months in a dirty camp on a glorified sandbar and itching to go, while the Venetians' bet was going poorly and their wealth was at stake. Dandolo had managed to get the Crusade to sack Venice's rebellious vassal and rival Zara to help pay off their debt to Venice. This got the Crusaders excommunicated, but IIRC, they didn't hear of that until much later. The Crusade might have fallen apart then and there if they had.
Alexios Angelos promised that he'd supply the Crusaders with all the ships they needed and ten thousand soldiers, as well as pay off the debt and give a huge amount of money to the Crusaders themselves if only they'd detour and install him as Emperor, the Crusaders and Dandolo agreed. Angelos had even promised to end the Great Schism and lead the Empire to the Holy See. Obviously, he'd promised them the bloody Moon and had no way of even coming close to fulfilling his promises. So, after he got installed as Emperor, it became clear to everyone that this was the case, and things got... heated.
That the Fourth Crusade was a series of atrocities perpetrated is beyond question. However, it's also clear that a power-hungry Roman idiot made promises that were impossible to fulfill, and in the process, turned the wrath of the Crusade towards Constantinople.