"I became the toast of London. A lot of people I met came from these really decadent families where the married men were gay and no one thought anything about it."