So I removed some apps like taskbar notifier and a few others I wasn't using, let the battery completely drain and then charged it back up. It seems like its been better the last couple of days.
Thanks for the suggestions everyone.
You could have a tower issue in your area. If the closest tower to you goes down for whatever reason, the iPhone has to use a lot more power to keep connected with the next closest tower, which could be much further away. It's happened to me before.