What size cable are you using to run round to connectors.
The bigger the better with low voltage.
Test the voltage at variuos places around thee track both with and without a load and the fault should become clearer.
I think it`s 16 gauge speaker wire. 
16 Gauge should be fine.
Time to break out the voltmeter to test along the track.