Playback Latency? Unsure how to describe

[SquidEuchre]

MacBook Pro (15-inch, 2019)
Mojave 10.14.6
2.3 GHz Intel Core i9
32 GB 2400 MHz DDR4
Radeon Pro Vega 16 4 GB
Intel UHD Graphics 630 1536 MB
Pro Tools 2018.14
18i20 and some external monitors

When I record audio it doesn't play back in time. I first noticed it tracking guitars. I'd record to a click and feel good about the take and then listen back and I was super behind. So then for years I just thought I was bad (I had this issue on my old iMac as well.)

But then I played along to just a click, playing quarters with it and recorded it with my phone as well. I was in time per my phone recording, but it recorded into pro tools late. It doesn't happen all the time, but I was just in a session where it happened again.

I've tried adjusting buffer size, toggling delay compensation and low latency monitoring, uninstalling, using a different interface, toggling ignore errors during playback, and dynamic plug in processing...

The thing is I'm not getting any latency when I'm recording. It's only on playback. Wondering if anyone has any advice. Please let me know of any other information that'd be helpful. Thanks!