You need to abandon the match - i.e. disconnect and not return after 5 minutes (cumulatively I think), or press "abandon match" in the menu. Quick connection drop will not give you a leaver status.
Dota2 treats disconnections pretty much exactly the same.
It should be severe, cause you leaving...