No is a complete sentence. Especially if you had mentioned it before
He’s asked that I could maybe bend to her coming round here to look after them for an hour whilst I go to an appointment- although it’s not necessary, I just take them with me. But I really can’t give more than that, and if I found my trust was abused in that time I really couldn’t recover the relationship at all. But he completely agrees with sleepovers being a no
I think the best way is to be direct so there’s no misinterpretation, especially if you’ve already had issues with her not respecting your boundaries. Speak to her together or get your other half to speak to her. Basically something along the lines of thank you for the offer but we’re not planning on having sleepovers.
Honestly this feels like a boundary your partner needs to uphold with them, not you.