Personally, I think a constitutional structure that is robust over time must be able absorb and manage the forces of incumbent interest, of which oligarchs are a type, as well as the forces of popular will and innovation.
At times, folks have had to contend with the interests of monarchs, of the church, of the aristocracy, of the wealthy, of corporations, of unions etc.
To get a democracy, you have to have a constitution that incorporates and channels these interests in ways that offer a net benefit. There isn't a way to negate influence. But you have to corral it and direct it and make it submit to the common good.
The will of the people is only one kind of impulse, and not necessarily always the most beneficial. If it is the will of the people to do something dumb, then the will of the people also wants thwarting.