Yu Xeidi and Shi Lang settled on the side of the human camp. However, none of the people bothered them. Some of them who have come from outside knew what was going on, and they were discussing these things using spiritual communication, because they didn't wish for Shi Lang or Yu Xeidi to get offended by their opinions. Although, hardly there was someone who opposed how strongly Shi Lang controlled the human race narrative.
The people in the world were always unsatisfied by what you do, so the only way to make sure they keep their thoughts to themselves was to grow stronger. This was why the people in the human race were scared of Shi Lang, because they knew he had the power to crush them all if he didn't like their opinions.
