I mean, if they entered the country illegally them even being within the borders is a crime in itself. We shouldn't let criminals just run free as they wish.
Also, how are we supposed to identify illegal aliens who don't commit crimes. The 4th amendment protects people from the government asking for your "papers". Are we just gonna put immigration checkpoints outside grocery stores?