as long as the POT impedance meet the maximum recommended.. it shouldn't be much of a problem.

What happen to your supply when you plug your loco directly?

Now, If you add 1 or more?

Now do the same but add your transistor to drive them.. what happen?

i got my few motor here, i'll do some test later.