They'll only attack you if they are interested, no matter how you treat them.
In my last game on Deity diff (full aggression mode, still playing it) I denounced the Huns, ask them for tribute, asked to not settle near me, converted one of their cities in my religion (they have their own religion), placed city near them, sayed always thing like "You will pay for this" every time they ask for tribute to the CSs, and even if they are relatively close and have the biggest army they don't want to attack me. I guess the issue here is they are more focused with the other neighbor Spain, and I have friendship with most of civs, but i feel this is not much of an issue for this military civs.
If you have good relationships, you can always denounce him and hope for your buddies to do so. After that you can declare war with minor diplomatic penalty (to mantain trades and friendships for RAs more than anything)