Recorded signal delayed (LATENCY ISSUE)

[Husmas]

Here's my issue:

When I record something timing feels slightly off. Turns out it's not only because of my bad playing, also pro tools 2018.7.0, console and my apollo twin x is suspected of playing an integral, yet unexplainable, part in this.

I have tried checking and unchecking Ignore Errors During Playback (this worked for a while, until it didn't)
I have thrashed PT and UAD prefs, uninstalled/reinstalled uad software.
I have Input Delay Compensation off
Recorded through various inputs and cables (even tried the talkback mic in the apollo)
Delay compensation is enabled in PT
Low latency monitoring is enabled in PT
I've tried all conceivable combinations of HW buffer size

No matter what I do, the recorded file is late by a small amount and needs to be nudged back in time.

Included is a screenshot of a test I did, where I recorded the click track first through a bus, internally. (The green one)
And then through a microphone. (the blue one)
As you can see, the the blue one is delayed compared to the green one.
The session only contains these two audio tracks, a master track and zero plugins. Also, console isn't running any plugins.

I understand a small amount of latency when recording like this is impossible to avoid, but this amount feels like too much.

The super weird thing is, I've had this issue in the past and solved it with Ignore Errors During Playback unchecking, but that does absolutely nothing now...

Hoping for good advice on fixing this