The above solution indicating you to avoid "Copy Local" can be dangerous if you don't have libraries installed in the Global Assembly Cache (GAC). It is never intended to be a good idea. A bin copy can help.
These are the things I would recommend you to check.
a) First and foremost thing I would do is to remove the source control link, which most of the times externally causes visual studio compilation times to be high
b) Increase the parallel build count. You can do this by going to Tools - Options. Open "Projects and Solutions" section and choose "Build and Run". Increase it to a higher number. See below for a screenshot.
c) You can also try age-old trick of disabling your antivirus program. It for sure, adds to the slowness.
d) Add more project references instead of assembly reference.
e) Lower the number of files in the app_code folder. Try to see if you can migrate them outside. This also at times, cause slowness.
f) Disable third-party plugins or addins that you may have.
g) And most important of all - Rightclick your website, and choose Property pages. Go to build section, and choose the option that reads Build website as part of the solution, and set the Start action as "Build page"
Hope this helps.