You can really do it either way. Its assistance work, so you're really just getting the volume in. I've done alternating in the past due to having only one loadable handle and no other dumbbells.
Alternating sides will require more lateral stabilization of the trunk due to the asymmetrical loading.