During diplomacy, select the "lets make a deal" option. At the bottom should be 'new' and 'active'. Click active, and view all the ongoing agreements you have. If there is one that does not have the turns remaining listed in (), you can cancel it by clicking on it.