Find the Best Optimization Method for Creating Test Groups - Mike

Click For Summary

Discussion Overview

The discussion revolves around an optimization problem related to grouping students based on their test scores. The goal is to create groups that maximize scores while minimizing the standard deviation of scores within each group. The context includes statistical methods and potential applications in programming with Matlab.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested
  • Mathematical reasoning

Main Points Raised

  • Mike describes a project involving 40 students and multiple tests, seeking a statistical method to optimize group formation based on scores and standard deviation.
  • He expresses a desire for groups to have one test in common while ensuring diversity in knowledge and maximizing overall scores.
  • Mike mentions the potential for scaling this problem to 200+ students and 17 different tests, indicating the complexity of the task.
  • A friend suggests that Mean Square Error might be relevant to the optimization problem, though this is not confirmed.
  • Another participant suggests consulting an expert in Operations Research, particularly in quadratic binary integer programming, to help formulate the problem.
  • There is a question about whether the standard deviation refers to individual student scores across tests or the overall scores within each group.
  • One participant questions the rationale behind allowing some students to have no test on day 2, suggesting it may limit data collection.

Areas of Agreement / Disagreement

Participants have not reached a consensus on the best approach to the optimization problem, and multiple perspectives on the objectives and constraints are presented.

Contextual Notes

The discussion highlights the complexity of the optimization problem, including the need for clear definitions of objectives and constraints, as well as the potential for various statistical methods to be applicable.

MJNun
Messages
2
Reaction score
0
I am looking for a term to describe a sort of "optimization" that I am trying to do.

Hi everybody, I am a college student who unfortunately is not smart enough to be a math major. But nonetheless I am obsessed with statistics and numbers. I have a question:

I need help figuring out a term, or a statistical method to describe and help me solve what I am looking to do.

I will give you the layout of my project (it is not real, just a good way of explaining what i am trying to accomplish):

I gave 40 students a test on Day 1, (test 1, 2, 3, or 4). At random, I gave them either test 1,2,3,4,5 or No test (0) on Day 2. But made sure not to repeat tests so a student cannot take test 2 on both days. I have averaged their scores and listed which students received which tests in my attachment so you can have a visual representation.

What I am trying to do, and what I would like some help on is:
Creating 4 groups of 4 students who only have one test in common
Group 1: (1,0), (2,1), (4,1), (1,5)
Group 2: (2,4), (2,1)*Different person than group 1, (3,2), (2,0)
ect.

But here is where I have trouble (even explaining), I want to make it so that each group is optimized in way that the groups have the highest possible score, while keeping the standard deviation of the groups at a minimum.

So basically is there a term, or analysis method that would help me figure out what I am trying to do. I figured there has to be a way to weight the standard deviation, so that I have the most equal groups possible, while still having the highest scores.

Think of it as if I were assembling a team for a competition, and I wanted to make each group as strong as possible for a single test (the one they have in common), while also making sure they had diversity in their knowledge. This is where I get optimization from, I am trying to optimize my team.

Does this make sense? If not please don't just ignore this, feel free to ask me a question if you are confused, and any help at all will be much appreciated.

- Mike
 

Attachments

  • sample for physics forum.png
    sample for physics forum.png
    19.8 KB · Views: 602
Physics news on Phys.org


Just to clarify, I plan on doing this with up to 17 different tests and 200+ students. So this is a simplified version of my goal.

Also, I plan on asking someone who is good with Matlab to write me a code. So if someone could explain to me a statistical analysis method that describes this crazy 'optimization' problem in words that would help me ask a more direct request to someone with Matlab expertise that would be great. Or any of you think you can tackle this with Matlab, that would be incredible.
*A friend of mine said that I might be looking for something that involves Mean Square Error (but he's not a math major either)*
 


Hello MJNun and welcome to the forums.

It's quite a challenge you've set for yourself, and the specific choices of the objectives and constraints are going to be crucial to whether this combinatorial optimisation problem is merely difficult to solve or near impossible.

If math isn't your strong point, then perhaps you can describe more about the actual purpose of the teams?

Otherwise I'd suggest speaking to an expert in Operations Research (particularly in quadratic binary integer programming) who can help to formulate and solve the problem (not necessarily using Matlab).
 


MJNun said:
I want to make it so that each group is optimized in way that the groups have the highest possible score, while keeping the standard deviation of the groups at a minimum.
When you say standard deviation, do you mean for each individual student across their own test results? (i.e. they will be preferred if they scored quite strongly across all tests, rather than just acing one or two?) ... or the students' totals within the group (i.e. all members in a given group should be of a similar overall standard?)

Also, what is the idea behind giving some students no test on day 2? I feel like this is a missed opportunity to gather useful data.
 

Similar threads

  • · Replies 30 ·
2
Replies
30
Views
4K
  • · Replies 3 ·
Replies
3
Views
1K
  • · Replies 5 ·
Replies
5
Views
3K
  • · Replies 24 ·
Replies
24
Views
4K
  • · Replies 26 ·
Replies
26
Views
1K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 11 ·
Replies
11
Views
2K
  • · Replies 2 ·
Replies
2
Views
2K