Predicting the performance of a single team when they are randomly paired

  • Context: Undergrad 
  • Thread starter Thread starter ferret_guy
  • Start date Start date
  • Tags Tags
    performance
Click For Summary

Discussion Overview

The discussion revolves around predicting the performance of teams in a robotics competition, specifically the FIRST Robotics Competition (FRC). Participants explore methods for ranking teams based on their contributions to alliance scores in matches, considering various statistical models and data requirements.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • One participant inquires about determining how much each team affects the score of their alliance based on a large dataset.
  • Another suggests that various properties of teams and different formulas could be used to predict match scores, emphasizing the need for clarity on the sport involved.
  • A participant describes a method for ranking teams based on match scores, indicating that the removal of a team could significantly impact the alliance's score.
  • There is a question about the mechanics of scoring in matches, specifically whether teams inhibit each other's scores.
  • One participant assumes that teams do not inhibit each other but expresses interest in models that could factor in interactions between teams.
  • A proposed model involves assigning ratings to players and calculating team scores based on these ratings, suggesting a lognormal distribution for match scores and discussing the fitting of parameters to data.
  • Another participant reiterates the ranking method and mentions the use of least squares for calculations, indicating a desire for a systematic approach to the problem.

Areas of Agreement / Disagreement

Participants express various methods and models for predicting team performance, but there is no consensus on a specific approach or model. The discussion remains unresolved regarding the best method to rank teams and the implications of team interactions on scoring.

Contextual Notes

Limitations include the need for a sufficiently large dataset to validate any proposed models and the ambiguity surrounding the definitions of team interactions and scoring mechanics.

ferret_guy
Messages
18
Reaction score
0
So if there were say 10 teams that were randomly matched into alliances of 3 v 3 with a score given for eatch match. How can I given a sufficiently large data set determine how much each team affect the score that there alliance achieves?
 
Physics news on Phys.org
There are many different ways that you could make up a set of "properties" for a team and many different formulas you could use the combined properties of 6 teams ( 3 per side) to make a prediction about the score of match. If you have picked a specific set of properties and a specific score prediction formula then there are still different ways of saying what "enough" data is.

If you want someone to work all this out for you then I suggest you reveal the details of what sport or game is involved. Some fan of it may know a good method.
 
This is for first robotics specifically, FRC after a set of Qualification rounds you pick alliances i was hoping to find a method that would allow me to rank the teams from best to worst kind of like the Harkness System but with more than one player per team.

I was thinking if you had sufficient data you could do something like this,
Teams: 1, 2, 3, 4

Teams:1, 2, 3 score: 9
Teams:1, 3, 4 score: 8
Teams:1, 2, 4 score: 8
Teams:2, 3, 4 score: 6

And so from this you can tell that team one is the best due to the fact that when they are removed the score tales a significant dip. I have no doubt this exists or there is some obvious implantation but I do not (yet ) know about it.
 
I don't understand your original mention of "3 v 3" compared to your examples of scores of teams. If a two teams of 3 people have a "match", does each team get a "score" and is the winner is the one with the highest score? When there is a match, is it like sports where one team scoring prevents or inhibits the other team from scoring?
 
I would like to assume that the teams do not inhibit each other this is not always the case mostly the 2 teams of 3 compete for the higher score but if there is a way to do it with the other teams factored in that would be cool too
 
How much data will you have? There isn't any point in making an elaborate model if there isn't data to enable finding its parameters.

Here's the simplest model I can think of:

Assume each player k has has rating r[k] that is a real number.
Assume the rating of the team as a whole is calculated by adding the ratings of the players.
If the rating of a team is R then the score of the team in a match is drawn at random from, say, a lognormal distribution whose underlying normal distribution is has (for simplicity) mean R and standard deviation (C)(R) where C is some constant that works for all teams. (If there is some reasonable bound for the maximum score, you could improve the assumed distribution of scores by picking a distribution limited to that range.)Fitting the model to data involves solving ( by some definition of what constitutes a solution) for the unknown parameters r[k] and C. One way to define a solution is to find values that maximize the likelihood of the data you have. As far as I can see, fitting the above model has no neat algebraic solution, but there are many ways to do solve such problems with computers by "trial and error".Rating systems for chss players have ambitious goals. Not only do the calculate the ratings of players from a set of static data; they also provide an updating procedure that (in theory) converges to an accurate rating of a player as more results occur.
 
ferret_guy said:
This is for first robotics specifically, FRC after a set of Qualification rounds you pick alliances i was hoping to find a method that would allow me to rank the teams from best to worst kind of like the Harkness System but with more than one player per team.

I was thinking if you had sufficient data you could do something like this,
Teams: 1, 2, 3, 4

Teams:1, 2, 3 score: 9
Teams:1, 3, 4 score: 8
Teams:1, 2, 4 score: 8
Teams:2, 3, 4 score: 6

And so from this you can tell that team one is the best due to the fact that when they are removed the score tales a significant dip. I have no doubt this exists or there is some obvious implantation but I do not (yet ) know about it.

Least squares on s1+s2+s3=9 etc, eg with matlab's "\" operator
 

Similar threads

  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 12 ·
Replies
12
Views
5K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 31 ·
2
Replies
31
Views
4K
  • · Replies 5 ·
Replies
5
Views
2K