When they first learned that Yang had been afflicted with the Silence Divine Spell, they had discussed it.
At the time, they were quite optimistic, after all, the first three layers of the Silence Spell are quite difficult to conceal.
People cursed with the Silence Spell can remember the secrets they're supposed to keep, they just can't speak them out loud.
Similarly, they know that they have been cursed with the Silence Spell and are aware of who cast it on them.
Under such circumstances, finding loopholes isn't much of a challenge; there are readily available methods as long as one is willing to implement them.
Only the highest level of the Silence Divine Spell will cause one to forget they have been cursed, as well as the secrets they are meant to keep.
The process in between these states leaves traces that can be followed.
Someone who has mastered the Silence Divine Spell can hardly keep it completely hidden.