Correction: I was on driver 576.40
I have now done a DDU and reinstall and I am still having the same issues. The problem seems to be when I hover over an ability or an item, the frame rate cuts in half and then my monitor will go black.
UPDATE: The issue was G-Sync. I have Adaptive Sync turned on in my monitor settings, but I turned off G-Sync in the nvidea control panel and the issues stopped. It still looks like the game drops frames when hovering on items and abilities, but it doesn't cause mini crashes like before.