(Cross post with Pommie)
That controller might not work below 6 V. However, you could supply the controller with 6 V and as long as you run the controller at less than half speed, you would not exceed 3 V on average to the motor.
I would not recommend running simple dc motors at less than about 20 % of their rated speed. Where low speed running is needed, some form of speed feedback is almost always used. A simple speed controller like that will just put out a lower average voltage to the motor, and that will result in less torque, so starting can be a problem.
You would be better to arrange the gearing to give a lower maximum speed.