I feel what is happening is that you can hit orb moment it spawns but it doesnt register it as kiling it, only removes visual. In my expirience it is most common with melee hits on friendly orbs right after you killed enemy creep with gun - you dont confirm orb but it gets invisible and enemy can shoot it