Pro Tools 9 with X32 latency

[jeffm]

Running:
MAC PRO Desktop 8 core 10g ram, OS 10.9.5
Pro Tools 9
X32 Console (Current Firmware)

Inputs are running in through the console into PT via FW.
Stereo output for playback from PT is routed to Aux 1 & 2 in X32 console.
Bus outs 1-4 on X32 are going to a 4 channel headphone mixer for musicians headphones.
When doing an overdub musician gets aux1/2 from X32 which is PT stereo L/R to hear.
The track being recorded is not sent to PT output to avoid delay in their cans.
They get a mix of the mic and the PT playback mixed through the X32 into their bus send.
When playing back though the overdubbed track is way behind the tracks they dubbed to.
I have to try and manually realign the overdub to the recorded tracks.
What am I doing wrong?

[peterle]

delay compensation on or off?