Look, it's been fifty years since I studied French in school. So I thought I'd ask Google for a literal translation of menage à trois. I know that trois is three, but was uncertain about ménage. I though it might be a weird conjugation of manger (to eat).
After I had a good laugh I found it means "household", so "household of three" and not "dinner for three".