The first experiment described on the website, but most of all the first experiment performed with FM Tool. To check the effectiveness and how helpful one of the FM Tool functionalities can be (making a ranking among selected players based on their attributes), I made an experiment lasting 2 seasons. It looked like this:

• I picked 100 Serie A players, 5 from each team. (One goalkeeper, defender, midfielder, winger and striker one each).
• I picked 70 players from the Super League 1 (Greek League), 5 from each team, just like in Serie A.
• I exported all 10 player lists and loaded to FM Tool to pick the top 5 players from each list.
• I simulated 2 full seasons, saving the results (stats and re-exported attributes) at the end of both seasons.
• After each season I checked the top 5 players from each list.

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

The assumption of the experiment was to check whether if we were leading the team and bought each of the top5 players according to FM Tool, what % of top5 players according to the satistics at the end of the season would be our bought players. The choice of leagues is as follows, because I wanted to choose one very good league, from the top 5 leagues and one weaker, to see if there will be a big difference between the results.

TOP 5 players

Serie A

• 

• 

• 

• 

• 

• 

• 

Super League 1 (Greek League)

• 

• 

• 

• 

• 

• 

• 

After first season

Now that we have the top 5 players from each list presented, we can check how they did in the first season!

Serie A

• 

• 

• 

• 

• 

Starting from the beginning, with the goalkeeper and comparing with the ranking displayed in the FM Tool, we can see the compatibility of as many as 4 players from the top5. Only Ionut Radu, who is only the 13th goalkeeper according to his skills, jumped to the top5 according to statistics. This gives 80% success when purchasing any of the top5 shown in FM Tool. This basically gives you the opportunity to save money on scouts.
In the case of defenders, the compliance of the ranking with FM Tool with the statistics from this season is only 2/5 players. The effectiveness of 40%, which looks much worse than that of the goalkeepers.
The next formation to analyze is midfield. Here a lot depends on the role of the midfielder. Whether the Advanced Playmaker or the Ball Winning Midfielder or the Central Midfielder. In the case of the Ball Winning Midfielder, 2/5 players. The Advanced Playmaker is 2/5. The Central Midfielder one is 1/5. This analysis of midfielders is not as even as, for example, goalkeepers, due to the different roles. However, when looking at all 3 top 5 by role, as many as 4 players appear in the top 5 by stats. This is 80%.
The translation of the ranking from FM Tool into statistics in the case of wingers looks very good. According to the statistics, there are as many as 3 players from the top 5 of the FM Tool ranking. This is 60% effective. On the other hand, if you look at the top10 according to statistics and the top10 according to FM Tool, we have compliance in 8/10 cases. Up to 80% efficiency with a larger sample.
Ending with the strikers, we are dealing here with 3/5 hits. 60%. If we extend from comparing 10 again, we are again 8/10 cases. Again a high value of 80%.

The values ​​of 80% indicate a very good translation of the tool into the game. The average efficiency is 64% (for top5 only) or 72% (for top10 in some cases). Let’s check what it looks like in a weaker league.

Super League 1 (Greek League)

• 

• 

• 

• 

• 

Let’s start again by analyzing the goalkeepers. In the case of this league, we only agree in the case of 2/5 goalkeepers, but one of the top 5 presented in FM Tool did not play even 1 match, so it cannot be counted. In this case, only 4 of the top5 should be considered. Then the compliance is 50%.
As for the defenders, it looks great. Compatibility for 4/5 defenders, 80%!
The midfielders again, because of the different roles, are not entirely correct to verify. For Ball Winning Midfielder, compliance is 2/5. For Central Midfielder 3/5. For Advanced Playmaker 3/5. However, if you look at the top 5 stats without a role, each of these players appears in at least one of the top 5 midfielders in FM Tool. This gives you 100% efficiency and has 3 players who can be assigned 3 different roles. Ready middle of the field!
For wingers it’s 4/5 compatible. 80% effective.
The attackers. Also 4/5. 80%.

The goalkeepers were the worst in this league. However, taking the average of all success percentages, the average overall success rate is 78%!

After second season

Serie A

• 

• 

• 

• 

• 

The analysis of the second season begins completely different. In Serie A, 5/5 for goalkeepers. It’s 100%!
It looks bad again to call the defenders. This time only 1/5 of the players. Only 20% compliance. For top10 it is 60%, 6/10.
3/5 midfielders, 60%, one player worse than in the first season.
Wingers. 3/4, 75% compliance.
The attackers. 3/5, 60% agreement.
The average success rate is 63%, a bit better than in the first season.

Super League 1 (Greek League)

• 

• 

• 

• 

• 

Let’s check what the second season in Greece looked like. The goalkeeping formation is showing the greatest improvement again. 4/5 players, 80% compatibility.
Defenders a bit worse, 3/5 players, 60%.
Same for midfielders, 60%.
Great improvement for wingers. 100%, 5/5 football match.
Similarly, the analysis of the attackers is one player worse. 3/5, 60% effective.

The average success rate in the Greek league after this season is 72%, 6% worse than the first season.

Summary

Summing up the 4 presented efficiencies, 2 per league, 1 per season, one average value is approximately 73%. This means that if you did not use scouts and their reports, but only rely on the ready ranking presented in FM Tool, then in the case of 3 out of 4 players bought, they will be a hit purchase!