Got it working, thanks for the help Evil.

BTW I finally figured out whats happening with the camera. So apparently its the lerp factor for the camera's angle thats doing it. When I set the factor to 1, the issue goes away. However when the lerp factor is set to anything below 1, the camera tries to "correct itself. It'll hit 179 then say "oh, I need to go to -180" and attempt to spin all the way around. Im already looking for a way to fix this problem.