If it were just about using the produce from Stone Garden to feed 50,000 people, that would be absolutely impossible. Take the current Stone Garden, for example. Due to its limited planting area, insufficient feed for breeding, and other constraints, even if all labor was efficiently divided and every usable resource was maximized, the food grown and livestock raised could support 20,000 people at most.
Furthermore, profit dividends and the mandatory 20% storage of products had to be factored in, reducing the number of people it could sustain even further.
Therefore, Jing Shu's statement that providing shelter wasn't an issue, but providing food was a significant problem, held true. Feeding 50,000 people would require more than the combined resources of two Stone Gardens; even then, it would fall short without additional contributions.