Yes. the PSU can provide a lot more current than three button cells.
Since you have a meter, try measuring the voltage while the motor is running off the batteries. I suspect it will be lower than 3.6V.
Then connect it to the PSU and measure the current it draws(I assume you know how to go about this.) This will give you an idea about what to use as a speed controller if you want to go down that route.