Looking for advice in clusterization

  • Context: Undergrad 
  • Thread starter Thread starter Frank Einstein
  • Start date Start date
  • Tags Tags
    Time series
Join the discussion
Ask a follow-up here, or get your own question answered by working scientists, mathematicians and engineers — people, not an autocomplete.
Real named experts · corrections over time · the nuance an AI answer skips
2 replies · 2K views
Frank Einstein
Messages
166
Reaction score
1
TL;DR
I need to know how to cluster data measured at different time instants.
Hello everyone. I have a machine with a series of sensors. All sensors send a signal each minute. I want to know if any of those sensors are redundant. The data is available as an Excel file, where the columns are the variables and the rows are the measurements. I have 1000 rows.

To do this, I have used DBSCAN in Python as

[CODE lang="python" title="Data clusterization"]scaler = StandardScaler()
data_normalized = scaler.fit_transform(data)
data_normalized = data_normalized.T
dbscan = DBSCAN(eps=15, min_samples=2)
clusters = dbscan.fit_predict(data_normalized)[/CODE]

However, I think that there has to be a better way to find relationships between variables (each sensor or columns of the data file).

Could someone please point me towards a methodology more suitable for my goals?
Any answer is appreciated.
Tanks for reading.
Best regards.
Frank.
 
on Phys.org
You can just look at the correlation matrix. If two inputs are highly correlated then you can probably drop one.
 
Reply
  • Like
Likes   Reactions: WWGD, FactChecker and Frank Einstein
Dale said:
You can just look at the correlation matrix. If two inputs are highly correlated then you can probably drop one.
Thanks. I can calculate them with ease as well.