Hey guys, I see this post is old, but probably someone still have this problem and I can't see solution I use here.
what I do to quickly recover from accidentally pressing
Y is:
press
Z/cmd+Z for undo and then
arrow left to go to start of selection.
for me this is best solution till date.