Transparency in the ranked system

john.oaklander

New member
Hey,

Could we please be provided with some transparency on how the ranked system works? Its very hard to give feedback on it when its a complete mysterybox.

It seems from some anecdotes that you guys might be implementing some sort of a "true skill" system, where instead of ranking purely by wins/losses you are taking some statistics (like perhaps kills, deaths, assists, damage dealt, healing dealt, structure damage) into account.

This has been tried in many games before, and it has never worked, because it is entirely misguided. The goal of the game is to destroy the enemy patron, its the only objective that truly matters. The goal of the game is not to optimize statistics. However, if you are ranking not only based on win/loss but also statistics you are shifting the objective of the game from winning to a mixture of winning and stat optimization.

Good statistics only matter if they lead you to winning the game, which they generally will on average, and if they do lead to you winning your winrate will be high and your rank will adjust, meaning there is no need to further adjust based on good statistics, and if they do not lead to you winning they do not matter and should not be adjusted for.

It is entirely possible to have consistently good statistics and be a worse or equal player to those you are matched with as statistics do not tell you the whole picture.

One could be very good at playing the laning phase, and perhaps play characters that are good in the early game, and hence get many kills early when its fast to do as respawn times are short and deaths relatively inconsequential. But then they could be bad at playing late game, and get picked late a couple of times when it really matters and singlehandedly lose their team the game, all while having 15-2 stats because they went 15-0 in the early game before losing the game by mispositioning late.

Similarly a person could ignore all objectives and greedily farm while his team keeps him in the game, and lose the game for his team singlehandedly, but simutaneously have few deaths and highest farm in the game.

If a player consistently has good statistics, but is not winning games then he is not a better player than the people at his rank, his playstyle just optimizes stats. Since the only constant in a players teams is himself if he is truly better than the people at his rating his team will statistically have a higher probability of winning, and law of large numbers will ensure that they win more than they lose over a large sample of games. Any given game can go any which way due to randomness, but over a large set of games all randomness will even out, leaving only the impact of the difference between the player and the average player at his/her rank. This is statistics 101 and the basis of all ranking systems.

Please tell me Im wrong on this, and you are aware of the misguidedness of true skill systems and are not implementing such a system. But if this is the case there are some unexplainable anomalies in ranks (such as people that played their games against people that ranked into phantom, lost most of said games but somehow got ranked into eternus) which might indicate that there are unintented bugs in the system.

A chess player that captures alot of pieces because they offer many misadvantegous exchanges, and play into every advantageous sacrifice of the enemy but lose all their games due to the poor board state those captures leave him with is not better than a chess player that captures less pieces but wins sometimes. You can capture more pieces and still lose, because capturing is a means to the goal, not the goal of chess, and isnt always advantageous.

Furthermore, please add drafting to ranked, drafts really matter ALOT and in the current system you can just about automatically lose games based on random drafts.


heres just a couple of examples that point towards the game not functioning on a mmr system, but rather some "true skill" system under the hood, or being completely broken: (you can check the matches from the ID using the watch tab)
1.
https://tracklock.gg/players/158685386
Player plays ranked matches against low ranked people that mostly end up in phantom with a couple of low ascendants. out of the recorded games he loses 4 and wins 3. For his sub 50% winrate against mostly phantom players he was rewarded with eternus 3.

2.
player plays ranked matches against low ranked people that exclusively end up in emissary/archon, wins against them, and ends up in eternus 2. This is pretty nonsensical, the man was never tested against real opposition, he beat people in low rank and got placed in the highest rank for it.

3.
Wins against people who are mostly phantom or low ascendant -> ends up in eternus 6.

the 2nd and 3rd examples point towards some true skill system with heavy weight on individual performance, which enables people that are essentially smurfing to get jumped to the highest ranks without ever being tested against real opposition.

the 1st example is hard to explain, the person loses his games against phantoms but gets eternus, and then goes on to play casual matches against oracles and lose. makes 0 sense.
 
#2 is super interesting. I looked up the matches and he crushed every game, with top stats in almost everything, but its weird that he wasn't placed into higher MMR matches but got to farm stats off sub Phantom players. It looks like he's probably a smurf who is way too good for Emissary/Archon/Oracle, but it makes no sense that he was never place against Phantom/Ascendant/Eternus players. I doubt he'll be able to get free games if he plays again this week.
 
#2 is super interesting. I looked up the matches and he crushed every game, with top stats in almost everything, but its weird that he wasn't placed into higher MMR matches but got to farm stats off sub Phantom players. It looks like he's probably a smurf who is way too good for Emissary/Archon/Oracle, but it makes no sense that he was never place against Phantom/Ascendant/Eternus players. I doubt he'll be able to get free games if he plays again this week.
yes, its bizarre.

I wish the developers would make the system more transparent.
 
Nifty chess analogy. Issue wrt law of large numbers is that its elucidation occurs only with a sufficiently large sample size, i.e. some quantity which is generally in excess of however many matches even the most devoted players are likely to attain. Just for what that's worth. Great post, though!
 
It doesnt seem that the devs read here, and one cant reach them on the discord either. I suppose we will never get any elaboration on how the ranked system works.
 
y i guess look at me started at 2500 managed to have positive wr and now i ended up in 1900 lobbies so something doesnt work well
 

Attachments

  • Zrzut ekranu 2024-10-24 172736.png
    Zrzut ekranu 2024-10-24 172736.png
    181 KB · Views: 72
@john.oaklander
I cannot emphasize how much I relate to what you've just written.
So well said.

I currently am positioned in a ranking WELL above my ability, and I have no idea how I ended up here.
Now every game I play is outright miserable. I'm constantly letting my team down, and really not having any fun in the process.
To make matters worse, despite losing almost every game I've played lately, my rank has INCREASED. It's absolute lunacy.
 
So kill steals are more important than game wins basically?
As a support player i tend to not care about last hits as long as the team gains from it

But in this game i guess i will have to focus more on last hits and ego play. As a support in other moba i would stack/leave jungle camps for my carry but here i need to take them for myself just to not derank even if i win the match? Kinda wonky tbh.
 
I am new to moba/shooters, but i've played 120+ games and i definitely can see my progress.
I was given Initiate I last week, no problem, "get gut". I played more and tried harder.

This week i had 17 wins and 10 losses and still got Initiate I.
I don't understand this ranking system.
1. I was not the worst player, mostly was in the middle overall.
2. Yes, I didn't have top kills, but I was useful all the time - bringing urn and pushing lanes.
3. I guess I was also a good motivator :D Believe it or not, there were about 3-4 games where I was supportive in voice chat and somehow we managed to turn the game 180 degrees after my "speeches" xD
Overall, 17/10 in my opinion is a result that deserves more than Initiate I again.

And I cannot agree more with this "Since the only constant in a players teams is himself if he is truly better than the people at his rating his team will statistically have a higher probability of winning, and law of large numbers will ensure that they win more than they lose over a large sample of games."
I hope they change the current system, because it's frustrating, really. =(
 
Your experience compared with mine confuses me even more. I played 8 games. Lost 7, won 1. My rank remained as emissary 5.

They must be calculating based on abstract things like souls gathered or something. Like sure, I can kill creeps and farm jungle mobs, but I can't do shit against most other players at this skill level. I am totally out played almost every engagement. I just can't aim and move like these guys.
 
I believe you are all trying to understand a game for which no rules have been established. They just tell us if we go down, up or continue in a rank without any additional information.
Ranked matches will not test your performance against different players and choose a rank that suits us. There is no balance, whether in casual or ranked matches.
The quicker they accept this the quicker they will be able to enjoy what the game has to offer (which is a lot but certainly not the MMR system).
 
Your experience compared with mine confuses me even more. I played 8 games. Lost 7, won 1. My rank remained as emissary 5.

They must be calculating based on abstract things like souls gathered or something. Like sure, I can kill creeps and farm jungle mobs, but I can't do shit against most other players at this skill level. I am totally out played almost every engagement. I just can't aim and move like these guys.
Obviously some of your actions hit the sweet spot, as opposed to mine =)

What I think they should do is take the standard Win / Loss approach as a base plus tweak something within it.
It definitely must matter whether you win or lose, but if you lose and your performance was good, you do not lose much or gain something.
 
My friend and I play almost exclusively together—nearly 300 games, with only a handful apart. We have very similar playstyles and nearly identical win rates (we actually lost more than we won in our seven ranked matches), yet we ended up two divisions apart, despite our win rates being within 0.1% of each other at the time of ranking. The only main difference is that I tend to manage lanes, and he will push objects; we split the effort and rally teams to secure a win and maintain around a 50% win rate.

In the play queue, we occasionally see a "Wide Skill Range" indicator, with no guidance on how to close that gap. This setup often places us with players who are literally in their first game, while the opposing team is frequently a coordinated stack of three duos or even full six-player squads. I appreciate the playtest and the experimentation with new ranking formulas, but the lack of transparency is frustrating, and the resulting matchmaking can be infuriating. I cannot fathom how the new players that get matched with us feel going against a fully coordinated team of friends and being under-farmed. It's not a great introduction to the game, I would imagine.
 
See I'm confused about the system, because when i did my first ranking I won more then half the games with either top stats or higher then middle and was going against around archon rank players only to be put in Ritualist 6. My second placement I was usually top preforming in lobbies even the losses, but got down graded to Ritualist 5 despite performance being arguably better.
 
At this point I'm starting to think the devs are just picking random names out of a hat. I am by no means a great player but make it make sense. first week i played seven games, lost all seven did absolutely horrible in the games, some games we got obliterated in 16 minutes. Got ranked in initiate V fair enough right? second week comes along and i actively tried to do better, played 10 games and won 4. Did vastly better in all games, even games that we lost but i still got placed in initiate V, how? definitely got more kills, more assists, more wins, what am i missing here?
 
At this point I'm starting to think the devs are just picking random names out of a hat. I am by no means a great player but make it make sense. first week i played seven games, lost all seven did absolutely horrible in the games, some games we got obliterated in 16 minutes. Got ranked in initiate V fair enough right? second week comes along and i actively tried to do better, played 10 games and won 4. Did vastly better in all games, even games that we lost but i still got placed in initiate V, how? definitely got more kills, more assists, more wins, what am i missing here?
I believe that your individual and collective performance matters a total of 0% to define your ranking. And I haven't found any reasonable reason to think otherwise.
 
i played alot of games specifically a ton of games in the first 3 days of games like 20 right before shiv got nerfed and they fixed the balance matchmaking i lost ALOT i then only played 10 games now i am hardstuck in alchemist even though i maintain a decent kda but i mostly waste time defending walkers or rushing them solo( mcginnis and haze) but my obj damage is still very very high sometimes even more then the rest of my team put togheter what true skill matchmaking it just places you quickly in one tier and keeps you there
 
i played alot of games specifically a ton of games in the first 3 days of games like 20 right before shiv got nerfed and they fixed the balance matchmaking i lost ALOT i then only played 10 games now i am hardstuck in alchemist even though i maintain a decent kda but i mostly waste time defending walkers or rushing them solo( mcginnis and haze) but my obj damage is still very very high sometimes even more then the rest of my team put togheter what true skill matchmaking it just places you quickly in one tier and keeps you there
This is my problem as well.
I'm stuck in a ranking above my skill level, and most games are now utterly miserable. I can't get out. :(
May have to go an entire week without playing, and hope a rank reset fixes something. Although my supposed 'mmr' still puts me in terrible games in casual play even.
 
It's not "transparent" because they're still experimenting with it, so it's pointless to announce how they have it because it'll just be changed again anyways.
 
It's not "transparent" because they're still experimenting with it, so it's pointless to announce how they have it because it'll just be changed again anyways.
why would it be pointless? If we dont know how the system works its impossible for us to give feedback on it.

I dont see how transparency could ever be bad. Knowing how the system works could address alot of peoples perceived issues and complaints with the system. Or it could help with proper feedback that could lead to fixing them.
 
Back
Top