Solder the two outermost pins for each Header (see top picture).
While doing this, press down the PCB to hold the Headers in the right position.
Turn the PCB and check if the Headers are in the right 90-Degrees/Parallel position (bottom picture).
Solder all of the pins.