First of all thanks for responding!
I had checked those out, but wasn't sure if I needed them which was another reason I took then off today.
When I was trying to place the bolt through the hole on the swaybar it wouldn't line up straight, its almost like the sway bar is bent incorrectly on both ends.
It seems like if the spacers were needed the whole endlink would be tilted instead of just the top portion connected to the swaybar.
EDIT: Now that I look at these installed it appears the kartboy spacers may be the solution, Thanks again Jamal