The fear is, and always has been, that raising wages above subsistence level would leave certain businesses unable to hire anyone. That's as it should be, some of those businesses probably shouldn't exist at all. And if they must, they should have to pay a premium for their labor force.
We can have a better world. But it's not going to happen if we let the wealthy determine who benefits from government policy.