Need ideas on how to plot this large set of data

  • Context: Undergrad 
  • Thread starter Thread starter DyslexicHobo
  • Start date Start date
  • Tags Tags
    Data Ideas Plot Set
Click For Summary

Discussion Overview

The discussion revolves around finding effective methods to visualize a large dataset related to the performance of a memory controller, specifically focusing on 450 individual sub-module controllers monitored monthly. Participants explore various visualization techniques suitable for representing the data collected over time.

Discussion Character

  • Exploratory
  • Technical explanation
  • Conceptual clarification

Main Points Raised

  • One participant describes the challenge of visualizing data from 450 modules, each with 200 data points, and expresses a desire for a method that is visually appealing and informative.
  • Another participant suggests using a color chart where the x-axis represents months and the y-axis represents module numbers, with colors indicating value ranges (e.g., blue for values <100, green for values >100 to <1000, and red for values >1000).
  • This second participant emphasizes the importance of designing the chart based on specific insights the user wants to extract, such as focusing on modules with higher values or plotting value ranges against the number of modules within those ranges.
  • A later reply expresses agreement with the color chart idea and mentions the possibility of omitting modules with consistently low values for clarity.
  • The same participant also raises the idea of incorporating additional features, such as mapping temperature variations or comparing software versions against recorded data values.

Areas of Agreement / Disagreement

Participants generally agree on the utility of the color chart approach for visualizing the data, but the discussion remains open regarding additional features and specific design choices for the visualization.

Contextual Notes

Participants have not resolved the specific design elements or the best practices for implementing the proposed visualization methods, leaving room for further exploration and refinement of ideas.

Who May Find This Useful

This discussion may be useful for individuals involved in data visualization, particularly those working with large datasets in engineering or technical fields, as well as those seeking innovative ways to represent complex data over time.

DyslexicHobo
Messages
249
Reaction score
0
I'm working on monitoring and trending the performance of a memory controller. Without getting into the technical details, I'm trying to find a good way to visualize the data I've collected in a way that will be easy for me to update when I receive new data.

There are about 450 individual sub-module controllers that I'm monitoring about once a month. The value that's being reported each month is a value anywhere from 5 to 30,000 (most are <100, and the ones I'm most interested in visually representing are the ones <100). I have about 200 data points for each of these 450 individual sub-modules, and I just can't figure out how to plot this data in a way that's visually appealing while not leaving out important information.

I'm not really that well-versed in data visualization. I know the basics of Excel but that's about it. I know it's silly to plot all 450 components on one line graph, so I'm hoping there's some plotting method that might apply here.

Let me know if any other info/clarification would help!
 
Physics news on Phys.org
so you have 450 modules with 200 months worth of data (ie one datapoint per module per month)?

The only thing I can think of is a color chart with x=month and y=module number and each datapoint as a color (blue <100, green >100 to <1000 and say red > 1000 or whatever color scheme you want. Basically you'd have a map of time vs module number horizontal red lines would indicate a module that has consistently had higher values and vertical lines would indicate a group of modules that had higher values for the given month.

Basically if you know what you're wanting to see then design the chart to show it. As an example, maybe you only want to see those modules with high values in the month so just drop the low value ones. Or maybe you want to plot value ranges vs number of modules within the given range.
 
This is a great idea! I think I'll use this and just omit all modules with consistently low values.

Thanks for the idea.
 
DyslexicHobo said:
This is a great idea! I think I'll use this and just omit all modules with consistently low values.

Thanks for the idea.

Great!

I was also thinking if there are any other features of the modules that could be charted such as location vs recorded data values. As an example, temperature modules being mapped to a physical map showing temperature variations from place to place. Another would be if the modules use different versons of software perhaps grouping them that way to compare software versions vs data values...
 

Similar threads

Replies
28
Views
4K
  • · Replies 4 ·
Replies
4
Views
3K
  • · Replies 4 ·
Replies
4
Views
2K
  • · Replies 26 ·
Replies
26
Views
3K
  • · Replies 8 ·
Replies
8
Views
2K
  • · Replies 4 ·
Replies
4
Views
5K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 19 ·
Replies
19
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 7 ·
Replies
7
Views
2K