Me and the other guys are telling you where it goes. If it doesn't fit it might be time to change battery cables or maybe you have the battery in backwards. The battery negative has to go to the block or the transmission case right next to the starter it doesn't bolt to the solenoid though a starter bolt goes through it.
It sounds like you don't have it wired up right.
You understand how a solenoid works right? Battery connects to the outer bolt (farthest from the starter) on the solenoid. The other bolt coming out the solenoid goes into the starter. You can just look at the starter and see this. When the solenoid is active the 12 volts from the battery wire COMES OUT the other solenoid wire into the starter. You make it sound like you have the battery on one side of the solenoid and the ground on the other so, every time you click the key, you short out the battery.
The ground cable bolts to the block even if it's not right next to the starter.