TSK · John 6:17

Cleansing the Temple After this he went down to Capernaum with his mother and brothers and his disciples, and they stayed there a few days.

So when the crowd realized that neither Jesus nor his disciples were there, they got into the boats and came to Capernaum looking for Jesus.