A man lived in the depths of a man’s ban?

I thought there was no way a man could be put into Ooku… but the “son” of the Shogun’s nanny was the exception!