So just to follow up on this just in case someone else is having the same issue.
SmartDeploy Support basically just told me that the Sysprep was crashing during the deployment. I had to install each program one by one and test the image in between to find out which program was causing it.
I found that it wasn't actually a program that was causing the crash. It had something to do with changing the ownership of the C:\ drive to the local admin. So I basically just left the ownership to TrustedInstaller and everything booted up fine.