no hassle in my castle means: You should not create disharmony between your spouse and you in your domestic life. (in Community Dictionary, added by Armando Reed)