What is Statistics: Definition and 999 Discussions

Statistics is the discipline that concerns the collection, organization, analysis, interpretation, and presentation of data. In applying statistics to a scientific, industrial, or social problem, it is conventional to begin with a statistical population or a statistical model to be studied. Populations can be diverse groups of people or objects such as "all people living in a country" or "every atom composing a crystal". Statistics deals with every aspect of data, including the planning of data collection in terms of the design of surveys and experiments.When census data cannot be collected, statisticians collect data by developing specific experiment designs and survey samples. Representative sampling assures that inferences and conclusions can reasonably extend from the sample to the population as a whole. An experimental study involves taking measurements of the system under study, manipulating the system, and then taking additional measurements using the same procedure to determine if the manipulation has modified the values of the measurements. In contrast, an observational study does not involve experimental manipulation.
Two main statistical methods are used in data analysis: descriptive statistics, which summarize data from a sample using indexes such as the mean or standard deviation, and inferential statistics, which draw conclusions from data that are subject to random variation (e.g., observational errors, sampling variation). Descriptive statistics are most often concerned with two sets of properties of a distribution (sample or population): central tendency (or location) seeks to characterize the distribution's central or typical value, while dispersion (or variability) characterizes the extent to which members of the distribution depart from its center and each other. Inferences on mathematical statistics are made under the framework of probability theory, which deals with the analysis of random phenomena.
A standard statistical procedure involves the collection of data leading to test of the relationship between two statistical data sets, or a data set and synthetic data drawn from an idealized model. A hypothesis is proposed for the statistical relationship between the two data sets, and this is compared as an alternative to an idealized null hypothesis of no relationship between two data sets. Rejecting or disproving the null hypothesis is done using statistical tests that quantify the sense in which the null can be proven false, given the data that are used in the test. Working from a null hypothesis, two basic forms of error are recognized: Type I errors (null hypothesis is falsely rejected giving a "false positive") and Type II errors (null hypothesis fails to be rejected and an actual relationship between populations is missed giving a "false negative"). Multiple problems have come to be associated with this framework, ranging from obtaining a sufficient sample size to specifying an adequate null hypothesis. Measurement processes that generate statistical data are also subject to error. Many of these errors are classified as random (noise) or systematic (bias), but other types of errors (e.g., blunder, such as when an analyst reports incorrect units) can also occur. The presence of missing data or censoring may result in biased estimates and specific techniques have been developed to address these problems.

View More On Wikipedia.org
  1. E

    I The characteristic function of order statistics

    Suppose that ##Y=\sum_{k=1}^KX_{(k)}##, where ##X_{(1)}\leq X_{(2)}\leq\cdots X_{(N)}## and (##N\geq K##). I want to find the characteristic function of ##Y## as \phi(jvY)=E\left[e^{jvY}\right]=E\left[e^{jv\sum_{k=1}^KX_{(k)}}\right] In the case where ##\{X\}## are i.i.d random variables, the...
  2. resurgance2001

    Statistics Permutations and Combinations

    Homework Statement The back row of a cinema has 12 seats, all of which are empty. A group of 8 people including Mary and Francis, sit in this row. Find the number of ways they can sit in these 12 seats if a) There are no restrictions b) Mary and France's do not sit in seats which are next to...
  3. H

    [Poisson Stats] Error on half-life for radioactive decay

    Hi there, not sure whether this is in the right section but: I've made two runs of a radioactive decay experiment where I've got a log(N) vs. time plots. From this I've got the decay constants and hence the half-life. I've averaged these two half-lives ( = 160 secs) and now I'm trying to work...
  4. Sarina3003

    Probability theory, probability space, statistics

    Homework Statement Homework Equations All needed are in the picture above (i hope so) The Attempt at a Solution to me it is extremely difficult because it is so complicated with many notations. Also, I actually don't know how to read the question properly to answer it Is E(beta) is the...
  5. Jakub

    I Small Reduced Chi Squared interpretation

    Hello everyone, I would be happy if someone explained the small reduced chi squared value to me. I have fitted a set of measured data with an exponential function, which I need for some sw calculations. The fit seams great, the origin sw also provides the reduced chi squared, but it is very...
  6. D

    I In quantum statistics, inhibition/enhancement factors

    These ideas come from the book Quantum Physics by Eisberg and Resnick (specifically ch11), can anyone explain what the inhibition factor and enhancement factors are in a little more detail? I do not understand what the book is trying to explain, and I can't seem to find these anywhere online...
  7. Vital

    B Interval scale -- very basic question

    Hello! I marked the thread as a basic high school level, because I assume my question is just at that level. ) I am reading some materials on statistics now, and, not having enough background yet, I stumbled upon this sentence: "As an example, 50°C, although five times as large a number as...
  8. D

    Conditional probability reasoning problem

    Homework Statement Out of all the products a company makes 2% is damaged. During the routine control of the products, the products are put to a test which discovers the damaged ones in 99% of the cases. In 1% however it approves the damaged item as a working one and vice versa. Find the...
  9. Jianphys17

    I Relation between statistics and theoretical physics

    Hi at all, maybe it's a bit trivial. However, the question that i ask myself is ; that relation there is between statistics-probab theory & theoretical physics. What role does it play in theoretical research ? (apart from the probabilistic amplitudes encountered in qm) Thanks for the answers
  10. K

    Am I justified in using the binomial distribution?

    Homework Statement 12 non-distinguishable attacks from President Snow land in Panem’s 12 districts in a particular week. Assume the attacks are located randomly, with each configuration of attacks equally likely. What is the probability that some district had more than 1 attack? Homework...
  11. D

    Deriving Fermi-Dirac Distribution misunderstanding

    Homework Statement The actual question was deriving Bose-Einstein, but I got confused on the F-D example. I'm basically following the method given here. Homework Equations [All taken directly from the above link] Taylor series: The Attempt at a Solution So after that third equation...
  12. benorin

    B The Drunkard's Walk: A Discussion of the Text

    This thread is for us to discuss the text The Drunkard's Walk: How Randomness Rules Our Lives by Leonard Mlodinow, and by that I mean for me to ask questions of you, those of you who will suffer me, my experts in probability, the PhysicsForums readers, on things I'm interested in from the text...
  13. G

    Programs MS in scientific computing or statistics from online courses

    I find both subjects interesting, to the point where every night after putting the kids to bed, I spend a few hours self-studying, but I wonder if going back for a master's degree would be worth the effort. I know that if I want to do professional work in either of these two subjects I'll need...
  14. chwala

    Statistics: probability distribution problem

    Homework Statement two indepedent observations ##X_1## and ##X_2## are made up of the continuous random variable having the probability density function ## f(x)= 1/k##, and ## 0≤x≤k## find a. the cumulative distribution of ##X## b. Find the probability distribution of M, the...
  15. Philip Koeck

    A Can indistinguishable particles obey Boltzmann statistics

    Many textbooks claim that particles that obey Boltzmann statistics have to be indistinguishable in order to ensure an extensive expression for entropy. However, a first principle derivation using combinatorics gives the Boltzmann only for distinguishable and the Bose Einstein distribution for...
  16. ohwilleke

    I Why do particle physicists use Gaussian error estimates?

    There is solid empirical evidence that error in particle physics measurements is not actually distributed in a Guassian manner. Why don't particle physicists routinely use student t error distributions with fat tails that fit the reality of errors in experimental measurement more accurately...
  17. AirRecce

    General formula for a combination of four categories

    Homework Statement Say I have four categories which make up a "whole" that I'll call a unique "deal". Each deal can have "I" properties, "J" investors, "K" mortgages, and "L" credit lines, where "I" and "J" must be integers greater than zero and "K" and "L" are non-negative integers (i.e. 0 or...
  18. Photonino

    I Why do systematic uncertainties disappear using ratios?

    Hello, I often hear the phrase "Well, since you are taking a ratio bin-by-bin, you don't have to care about the luminosity syst. uncertainty and the trigger efficiency syst. uncertainty". I think I understand qualitatively why this is the case (It cancels out in the ratio, since both...
  19. Pouyan

    Probability theory and statistics

    Homework Statement The time (minute) that it takes for a terrain runner to get around a runway is a random variable X with the tightness function fX = (125-x)/450 , 95≤x≤125 How big is the probability of eight different runners, whose times are independent after 100 minutes: a) Everyone has...
  20. Pouyan

    A paradox in probability theory and statistics

    Homework Statement In a vessel is a 5 cent coin and two 1-cent coins. If someone takes up two randomly chosen of these coins, and we let X be the total value of the coins taken, what is the probability function for X? Homework Equations I know that X has a value {2,6} The Attempt at a...
  21. J

    MHB Statistics review questions

    Hi these are practice questions from our class. can someone please help me by cheaking if i have done the correct answear ? if i am wrong could someone please provide the correct answear ? Thanks 1. The z-value that is used to construct a 95% confidence interval is A 1.28 B 1.96 C 2.58 D 1.64...
  22. Dusty912

    Applying hypothesis test data collected (Statistics)

    Homework Statement So I am doing a project for statistics and wanted to apply a hypothesis test to see if there is a correlation between the number of years spent at my college and the number of services used. The services include library, recreational services, clubs, etc.. i sent out a survey...
  23. Semidevilz

    Programs Assistance choosing an M.S. Statistics school

    I'm trying to get into a Masters program in Statistics, and below are a few that seemed interesting. I was wondering if anyone who has any feedback, experience, or heard anything on the programs. I"m already full time employed as an analyst, so I'm not getting it to start a new career. Rather, I...
  24. B

    A Can KE be reformulated using |v| instead of v^2?

    While doing some calculations on v_rms using the Maxwell-Boltzmann distribution, I noticed that v_rms and v_avg are pretty similar (https://casper.berkeley.edu/astrobaki/index.php/File:MaxwellSpeedDist.png). In fact, really it's just the choice of using the 1-norm (|v|_avg) vs. 2-norm sqrt(v^2...
  25. L

    A General definition of interferences clarification

    I require your help to list all phenomena described as interferences in physics ( as teached nowadays ) with their citations in scholar documents if they are not well known by non-specialists. I am open to adjacent domains like information theory and mathematics. There are already light...
  26. B

    I Standard deviation of data after data treatment

    I was given the averages (AVG) and the corresponding standard deviation (SD) of sets of data. I have no copy of the raw data for each data point that were used to calculate the AVG and SD. I performed further data treatment on the data. I want to ask what is the relationship between the...
  27. MathematicalPhysicist

    Equilibrium Statistics -- Euler summation formula

    Homework Statement In the calculation in high temperatures of ##Z_{rot} = (\sum_{j=0}^\infty (2j+1)\exp{j(j+1)\theta_{rot}/T})^N##; they use Euler summation formula: $$\sum_{n=0}^\infty f(n) = \int_0^\infty f(x)dx+\frac{1}{2}f(0)-\frac{1}{12}f'(0)+\frac{1}{720}f^{(3)}(0)+\ldots$$ for ##f(x) =...
  28. G

    Minimize the sum of Type I and Type II errors

    Homework Statement Given X_1,\dots,X_n a simple random sample with normal variables (\mu, \sigma^2). We assume \mu is known but \sigma^2 is unknown. The hypothesis is \begin{cases} H_0: & \mu=\mu_0 \\ H_1: & \mu=\mu_1 > \mu_0 \end{cases} Determine the rejection region R...
  29. P

    I How are degrees of freedom understood in QM?

    I'm having a hard time understanding 'degrees of freedom'. Could someone please provide an example in terms of Quantum Mechanics about what a 'degree of freedom' could be represented as? Is it simply a number of observations of a physical system to determine the arrangement of particles within...
  30. E

    Intro statistics question: probability of intersection

    Homework Statement If event A equals event B, then the probability of their intersection is 1. True or False? Apparently the correct answer is False. The Attempt at a Solution If A=B then they should overlap entirely and their intersection should be 1? The only way I see this working is if...
  31. S

    Probability (Permutation Combination)

    Homework Statement There are 22 students in a class. The professor will divide the class into 4 groups. Group 1 and 2 have 5 members each whilst Group 3 and 4 have 6. Given that the teacher forms the group at random, find the probabilities of : A = event where Paula, Trina, Gia all belong in...
  32. S

    Proving the Continuity From Below Theorem

    Homework Statement Prove the continuity from below theorem. Homework EquationsThe Attempt at a Solution So I've defined my {Bn} already and proven that it is a sequence of mutually exclusive events in script A. I need to prove that U Bi (i=1 to infinity) is equal to U Ai (i=1 to infinity) to...
  33. C

    Other Math vs Statistics Degree/Major For Investment Banking

    Hello, I am just posting a quick question asking what is better if I want to get into investment banking. If I was too go for statistics, I would most likely get a PhD. If I went for mathematics I would want to double major in Econ and Math and get an undergraduate degree in both. Which is a...
  34. Z

    Solve Bayes' Rule Question: Probability of Rain Tomorrow

    Hi, I'm not sure whether my understanding of this question is correct: An app predicts rain tomorrow. Recently, it has rained only 73 days each year. When it actually rains, the app correctly forecasts rain 70% of the time. When it does not rain, it incorrectly forecasts rain 30% of the time...
  35. redtree

    B The expectation value of superimposed probability functions

    I apologize for the simplicity of the question (NOT homework). This is a statistical question (not necessarily a quantum mechanical one). If I have an initial probability function with an associated expected value and then a second probability function is superimposed on the initial...
  36. L

    Is average time between and after collision same for a gas?

    I am stuck on this concept in my physics book where the author claims that in a low density ionic gas the average of the time between collision and average of the time taken from last collision in ions is same. He further states that the average time to the next collision is same as the average...
  37. K

    A What is the best program for MSEM? Student Request

    My research requires using the multilevel structural equation model (MSEM). I've read countless articles related to MSEM and I have not been able to pinpoint the best program. They vary from SPSS, MPlus, SAS, LISREL, AMOS, R2, etc. Any recommendations? I've asked around my academic circle and...
  38. K

    Statistics average value question

    Homework Statement Prove that A(X(ωk)2)≥A(X(ωk))2 if and only if X(ωk) has the same value for every k such that pk>0 for every category which actually occurs in the population Homework Equations A(X)=1/N∑nkX(ωk)=∑pkX(ωk) The Attempt at a Solution A[(X-A(X)2)]=A(X2)-A(X)2 and i believe the...
  39. S

    Statistics - Batch AQL? (Acceptance Quality limit) HNC

    Hi All, Currently on a distance learning HNC and I am not quite sure whether the question just wants me to answer 'yes' or give mathematical evidence. Part A answered, Part B not sure... Any help would be great! 2. The process for the production of an electrical device is suitable for...
  40. Zeynel

    What does statistically significant mean?

    I'm looking at this quote: "The proportions of the phyla Firmicutes and Bacteroidetes were statistically significantly increased in the obese group compared to the normal weight group (p< 0.001, p = 0.003 respectively)." Since I don't know statistics can you please explain how to visualize...
  41. S

    MATLAB Weighting data points with fitted curve in Matlab

    Hi all, I'm currently in the middle of performing an experiment for the final project of my MSc, and I have a question about how I should go about weighting the data when fitting a curve to it using the MATLAB fitting tool. Firstly, a bit of background about the problem. I am seeing how low...
  42. G

    I Advanced problems with answer sheet in statistics

    I am looking for advanced problems in statistics with answer sheet on the subjects: probability distributions where you have to rewrite the sum of variables to a new probability distribution. Advanced problems in calculating variance and expected values for probability distributions. Advanced...
  43. Mark44

    Are Black and Hispanic Teens Being Targeted for Incarceration Based on Race?

    Here is some data from the FBI, from 2013, with arrest percentages by race for a variety of crimes (https://ucr.fbi.gov/crime-in-the-u.s/2013/crime-in-the-u.s.-2013/tables/table-43). The data I've listed here comes from Table 43A. ##\begin{array}{ccc} ~ & \text{White} & \text{Black/African...
  44. D

    Probability theory and statistics for Robotics and ME

    I study control theory and robotics. Recently I figured out that I have a much deeper understanding of probability and statistics compared to my colleagues. Is this 'talent' valuable in my field and if so, where? We used this theory to define white noise, but nothing more...as of now. Also I am...
  45. Question_

    Is cancer as prevalent as it was prehistorically?

    Almost everyone I've known has had someone close to them have cancer in some form or another. When I was doing some reading on the matter I encountered a statistic saying that one in two Americans will have any form of cancer. I really have a hard time understanding why so many people are...
  46. Kaura

    I Battle Projections: Predicting Probabilities in Games

    This is a rather odd topic but recently when playing games, mostly first person shooters, I have formed a curiosity about "Battle Projections" or the ability to predict probabilities based on in game variables. For example, if you were spectating a round of no respawn four versus four death...
  47. O

    Expected Monthly Profit for a Small Manufacturing Firm

    Homework Statement A small manufacturing firm sells 1 machine per month with 0.3 probability; it sells 2 machines per month with 0.1 probability; it never sells more than 2 machines per month. If X represents the number of machines sold per month and the monthly profit is 2X2 + 3X + 1 (in...
  48. L

    I Calculating Degrees of Freedom for Chi-Squared & P Value

    I am trying to understand how to decide the number of degrees of freedom when calculating a chi-squared and p value. I have the data: England: people with no pets = 665 people with 1 pet = 976 people with 2+ pets = 913 Scotland people with no pets = 313 people with 1 pet = 527 people...
  49. jdawg

    Statistics: Standard Deviation for a Normal Distribution

    Homework Statement A company allows a maximum failure rate of 1 out of 250,000 parts. To insure this quality goal, failed parts must be how many standard deviations from the mean? Use Excel to solve. Homework Equations z= (X-μ)/σ The Attempt at a Solution Hi! So I'm assuming that this is a...
  50. K

    I About binomial statistics

    Hi all, I am solving a practical math problem. There is a sale in one of the shopping mall in my town. The mall gives 10 coupons to a new customer. The customer could use one coupon at a time and when it is used, one could spin a fortune wheel to win more 10 more coupons. If one doesn't win...
Back
Top