Basically an Andre Norton novel (witch queens, war dukes, intrigue) told by a duke. Silly, but good-tempered enough, and Stuff Happens. Also a version of a locked-room puzzle like Jumpers.
Find in a library: Ill Met in the Arena