Kernal density estimate in polar coordinates.

Click For Summary
SUMMARY

The discussion centers on the challenges of implementing kernel density estimation (KDE) in polar coordinates for a dataset containing power and direction values. The current Python KDE method lacks support for weighting data and polar coordinates, leading to discontinuities in the density curve near zero degrees. Participants suggest exploring implementations that accommodate finite support kernels and multivariate KDE, which may better represent the joint distribution of power and direction. Recommendations include searching for existing software solutions or considering alternative methods for estimating distributions.

PREREQUISITES
  • Understanding of kernel density estimation (KDE) principles
  • Familiarity with polar coordinates and their implications in data representation
  • Knowledge of Python programming for potential implementation
  • Concept of finite support kernels in statistical methods
NEXT STEPS
  • Research implementations of multivariate kernel density estimation in R or MATLAB
  • Explore libraries such as SciPy or statsmodels for KDE with finite support
  • Investigate alternative methods for probability density estimation in circular data
  • Examine academic papers on kernel density estimation with finite support for theoretical insights
USEFUL FOR

Data scientists, statisticians, and researchers working with directional data or seeking to implement advanced statistical methods in Python.

davcrai
Messages
13
Reaction score
0
Hi,
I have a data set containing values for power and direction. I would like to produce a probability density estimate. The data can have multiple sources so I want to use a nonparametric method. I work in python which has a method for kernal density estimation (KDE), which I think should be suitable. However, currently the method does not allow the data to be weighted, so I can only use the directions. Also, it does not allow polar coordinates so any bins near the ends of the distribution do not include all relevant values (i.e. bins centered close to zero degrees should include points close to 360 degrees). The result is a curve that is discontinuous across zero degrees. Does anyone know where I might find an implementation for KDE (any language) that allows polar coordinates, I might write one in python but would like to try it out somewhere to make sure it is suitable to what I need first. Alternatively, if there are any better suggestions on how to estimate the distribution I would be very interested??
 
Physics news on Phys.org
davcrai said:
Does anyone know where I might find an implementation for KDE (any language) that allows polar coordinates,

You might get better advice on particular software if you ask in the computer technology sections of physicsforums.

Alternatively, if there are any better suggestions on how to estimate the distribution I would be very interested??

You need to describe the problem. You've hinted that you want to represent "power" and "direction". Do you want a kernel density method that gives the joint distribution for "power" and "direction"?

I don't know how determined you are to implement something that is precisely kernel density estimation. If you are using "bins", it sounds like you are doing a numerical approximation of some kind. The intuitive way to think of kernel density estimation is that each sample of observed data is "smeared out" into a density function that represents other samples that "might well have also happened". What you need to implement this idea on a circle is a kernel that has "finite support" - i.e. it is only non-zero on an interval of finite length. For example suppose you use a kernel whose support is 180 deg centered at the observed direction. If the sample value is 10 degrees, the kernel extends to -80 deg = 280 deg on the left and 100 degrees on the right.

I notice there papers written about kernel density estimation with "finite support" and also about "multivariate kernel density estimation". I don't know if any of that theory has made it into commonly available software.
 

Similar threads

  • · Replies 7 ·
Replies
7
Views
3K
  • · Replies 12 ·
Replies
12
Views
2K
  • · Replies 10 ·
Replies
10
Views
6K
  • · Replies 17 ·
Replies
17
Views
2K
  • · Replies 61 ·
3
Replies
61
Views
5K
  • · Replies 7 ·
Replies
7
Views
13K
  • · Replies 19 ·
Replies
19
Views
1K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 9 ·
Replies
9
Views
3K
  • · Replies 47 ·
2
Replies
47
Views
7K