PT 11 playing audio SUPER SLOW

[Skullj]

As i searched the internet I could not figure out a way to explain my problem in a google search. Basically PT is playing audio SUPER slow. As I look at the min/sec counter, (if I start at say 0:37.000) it takes a second or two for it to read 0:37.010. The levels jump up and down ever so slowly, the master has the same readings, but no sound at all. And when I stop I get the error (There was a problem stopping Pro Tools) and no error code is given. Most people with this problem fixed it via video codecs, etc, but I have only one audio test track, no video and video engine is not enabled. Pro Tools seems to not lag, scrolling through things or applying effects, but once played it plays at basically 0.1ms p/s. Any ideas on what would cause this? Sample rate matches my scarlett, HW buffer size has no effect, it takes about 5 seconds to start playing with counter off, and trashing prefs does not help.

Windows 8.1
16 gigs DDR3 RAM
NVIDIA GeForce GTX 670 FTW (latest version)
AMD FX Vishera (8 cores at 4.2ghz)

Pro Tools 11.3.1 (latest version)
Scarlett 18i20 (latest version)