Many mistake the so-called rapture as Jesus "coming back", when this is not the case.

That event is for after the millennial Kingdom. When the harvest has be quite large. Far more than now. The ones who remain are the serpent seed who refuse submission to Christ. They doesn't have much of a choice anyway. They were destined for destruction.