This matter, when initially mentioned, wasn't of great significance. Families of officials abusing power isn't uncommon, and no one really took it to heart, the intervention depending solely on whether someone would expose it or not.
Clearly, the matter of the soap was brought to light by Sikong Mo, and because of Sikong Mo's extraordinary identity, that's why it received such high attention.
If it were a commoner, the matter would be easily settled, but in the Prince's case, it became difficult.
The Liu Family, his mother's family, was also tied to the Prince's Royal Residence, and during Sikong Mo's request for grain and provisions upon coming to the capital city, the Liu Family had not spared any expense. This was also the reason why the old Emperor, even after learning of the Liu Family's deeds, still didn't punish them.
If the Prince didn't know Ye Jiu, even if Ye Gaosheng was the victim, he would have been silenced long after the soap controversy came out.