went down

This indicates that they went from a higher place to a lower place. Capernaum is northeast of Cana and is at a lower elevation.

his brothers

The word "brothers" includes both brothers and sisters. All Jesus' brothers and sisters were younger than he was.