CFD Online Logo CFD Online URL
www.cfd-online.com
[Sponsors]
Home > Wiki > Introduction to turbulence/Statistical analysis/Ensemble average

Introduction to turbulence/Statistical analysis/Ensemble average

From CFD-Wiki

< Introduction to turbulence | Statistical analysis(Difference between revisions)
Jump to: navigation, search
m (→Fluctuations about the mean)
 
(21 intermediate revisions not shown)
Line 1: Line 1:
-
== The ensemble and Ensemble Average ==
+
{{Introduction to turbulence menu}}
 +
== The mean or ensemble average ==
-
=== The mean or ensemble average ===
+
The concept of an ''ensemble average'' is based upon the existence of independent statistical event. For example, consider a number of inviduals who are simultaneously flipping unbiased coins. If a value of one is assigned to a head and the value of zero to a tail, then the ''arithmetic average'' of the numbers generated is defined as
-
 
+
-
The concept of an ''ensebmble average'' is based upon the existence of independent statistical event. For example, consider a number of inviduals who are simultaneously flipping unbiased coins. If a value of one is assigned to a head and the value of zero to a tail, then the average of the numbers generated is defined as
+
        
        
-
<table width="100%"><tr><td>
+
:<math>X_{N}=\frac{1}{N} \sum{x_{n}}</math>
-
:<math>  
+
-
X_{N}=\frac{1}{N} \sum{x_{n}}
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
where our <math> n </math> th flip is denoted as <math> x_{n} </math> and <math> N </math> is the total number of flips.
where our <math> n </math> th flip is denoted as <math> x_{n} </math> and <math> N </math> is the total number of flips.
 +
Now if all the coins are the same, it doesn't really matter whether we flip one coin <math> N </math>  times, or <math> N </math>  coins a single time. The key is that they must all be ''independent events'' - meaning the probability of achieving a head or tail in a given flip must be completely independent of what happens in all the other flips. Obviously we can't just flip one coin and count it <math> N </math> times; these cleary would not be independent events
 +
'''Exercise:''' Carry out an experiment where you flip a coin 100 times in groups of 10 flips each. Compare the values you get for <math>X_{10}</math> for each of the 10 groups, and note how they differ from the value of <math>X_{100}</math>.
-
 
+
Unless you had a very unusual experimental result, you probably noticed that the value of the <math> X_{10} </math>'s was also a random variable and differed from ensemble to ensemble. Also the greater the number of flips in the ensemle, the closer you got  to <math>X_{N}=1/2 </math>. Obviously the bigger <math> N </math> , the less fluctuation there is in <math> X_{N} </math>  
-
Now if all the coins are the same, it doesn't really matter whether we flip one coin <math> N </math>  times, or <math> N </math>  coins a single time. The key is that they must all be ''independent events'' - meaning the probability of achieving a head or tail in a given flip must be completely independent of what happens in all the other flips. Obviously we can't just flip one coin and count it <math> N </math> times; these cleary would not be independent events
+
-
 
+
-
Unless you had a very unusual experimental result, you probably noticed that the value of the <math> X_{10} </math>'s was also a random variable and differed from ensemble to ensemble. Also the greater the number of flips in the ensemle, thecloser you got  to <math>X_{N}=1/2 </math>. Obviously the bigger <math> N </math> , the less fluctuation there is in <math> X_{N} </math>  
+
Now imagine that we are trying to establish the nature of a random variable <math> x </math>. The <math>n</math>th ''realization'' of <math> x </math>  is denoted as <math> x_{n}</math>. The ''ensemble average'' of <math> x </math> is denoted as <math> X </math> (or <math> \left\langle x \right\rangle </math> ), and ''is defined as''
Now imagine that we are trying to establish the nature of a random variable <math> x </math>. The <math>n</math>th ''realization'' of <math> x </math>  is denoted as <math> x_{n}</math>. The ''ensemble average'' of <math> x </math> is denoted as <math> X </math> (or <math> \left\langle x \right\rangle </math> ), and ''is defined as''
-
<table width="100%"><tr><td>
+
:<math>X = \left\langle x \right\rangle \equiv \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} x_{n}</math>
-
:<math>  
+
-
 
+
-
X = \left\langle x \right\rangle \equiv \frac{1}{N} \lim_{N \rightarrow \infty} \sum^{N}_{n=1} x_{n}
+
-
 
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
-
Obviously it is impossible to obtain the ensemble average experimentally, since we can never an infinite number of independent realizations. The most we can ever obtain is the ariphmetic mean for the number of realizations we have. For this reason the arithmetic mean can also referred to as the ''estimator'' for the true mean ensemble average.
+
Obviously it is impossible to obtain the ensemble average experimentally, since we can never achieve an infinite number of independent realizations. The most we can ever obtain is the arithmetic mean for the number of realizations we have. For this reason the arithmetic mean can also referred to as the ''estimator'' for the true mean ensemble average.
Even though the true mean (or ensemble average) is unobtainable, nonetheless, the idea is still very useful. Most importantly,we can almost always be sure the ensemble average exists, even if we can only estimate what it really is. The fact of its existence, however, does not always mean that it is easy to obtain in practice. All the theoretical deductions in this course will use this ensemble average. Obviously this will mean we have to account for these "statistical differenced" between true means and estimates when comparing our theoretical results to actual measurements or computations.
Even though the true mean (or ensemble average) is unobtainable, nonetheless, the idea is still very useful. Most importantly,we can almost always be sure the ensemble average exists, even if we can only estimate what it really is. The fact of its existence, however, does not always mean that it is easy to obtain in practice. All the theoretical deductions in this course will use this ensemble average. Obviously this will mean we have to account for these "statistical differenced" between true means and estimates when comparing our theoretical results to actual measurements or computations.
-
In general, the <math> x_{n}</math> couldbe realizations of any random variable. The <math> X </math> defined by equation 2.2 representsthe ensemble average of it. The quantity <math> X </math> is sometimes referred to as the ''expacted value '' of the random variables <math> x </math> , or even simple its ''mean''.
+
<font color="orange" size=3>Figure 2.1 not uploaded yet</font>
-
For example, the velocity vector at a given point in space and time <math> x^{\rightarrow},t </math> , in a given turbulent flow can be considered to be a random variable, say <math> u_{i} \left( x^{\rightarrow},t \right) </math>. If there were a large number of identical experiments so that the  <math> u^{\left( n \right)}_{i} \left( x^{\rightarrow},t \right) </math> in each of them were identically distributed, then the ensemble average of <math> u^{\left( n \right)}_{i} \left( x^{\rightarrow},t \right) </math> would be given by
+
In general, the <math> x_{n}</math> could be realizations of any random variable. The <math> X </math> defined by the ensemle average definition defined above represents the ensemble average of it. The quantity <math> X </math> is sometimes referred to as the ''expected value '' of the random variables <math> x </math> , or even simple its ''mean''.
-
<table width="100%"><tr><td>
+
For example, the velocity vector at a given point in space and time <math>\vec{x},t </math> , in a given turbulent flow can be considered to be a random variable, say <math> u_{i} \left( \vec{x},t \right) </math>. If there were a large number of identical experiments so that the  <math> u^{\left( n \right)}_{i} \left( \vec{x},t \right) </math> in each of them were identically distributed, then the ensemble average of <math> u^{\left( n \right)}_{i} \left( \vec{x},t \right) </math> would be given by
-
:<math>  
+
-
\left\langle  u_{i} \left( x^{\rightarrow} , t \right) \right\rangle = U_{i} \left( x^{\rightarrow} , t \right) \equiv \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} u^{ \left( n \right) }_{i} \left( x^{\rightarrow} , t \right)
+
-
</math>
+
:<math>\left\langle  u_{i} \left( \vec{x} , t \right) \right\rangle = U_{i} \left( \vec{x} , t \right) \equiv \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} u^{ \left( n \right) }_{i} \left( \vec{x} , t \right)</math>
-
</td><td width="5%">(2)</td></tr></table>
+
-
Note that this ensemble average, <math> U_{i} \left( x^{\rightarrow},t \right) </math> , will , in general, vary with independent variables <math> x^{\rightarrow} </math> and <math> t </math>. It will be seen later, that under certain conditions the ensemble average is the same as the average wich would be generated by averaging in time. Even when a time average is not meaningful, however, the ensemble average can still be defined; e.g., as in non-stationary or periodic flow. Only ensemble averages will be used in the development of the turbulence equations here unless otherwise stated.
+
Note that this ensemble average, <math> U_{i} \left( \vec{x},t \right) </math> , will, in general, vary with independent variables <math>\vec{x}</math> and <math>t</math>. It will be seen later, that under certain conditions the ensemble average is the same as the average which would be generated by averaging in time. Even when a time average is not meaningful, however, the ensemble average can still be defined; e.g., as in non-stationary or periodic flow. Only ensemble averages will be used in the development of the turbulence equations here unless otherwise stated.
-
=== Fluctuations about the mean ===
+
== Fluctuations about the mean ==
-
It is often important to know how a random variable is distributed about the mean. For example, figure 2.1 illustrates portions of two random functions of time which have identical means, but are obviuosly members of different ensembles since the amplitudes of their fluctuations are not diswtributed the same. it is possible to distinguish between them by examining the statistical properties of the fluctuations about the mean (or simply the fluctuations) defined by:
+
It is often important to know how a random variable is distributed about the mean. For example, figure 2.1 illustrates portions of two random functions of time which have identical means, but are obviously members of different ensembles since the amplitudes of their fluctuations are not distributed the same. it is possible to distinguish between them by examining the statistical properties of the fluctuations about the mean (or simply the fluctuations) defined by:
-
<table width="100%"><tr><td>
+
:<math>x' = x - X</math>
-
:<math>  
+
-
X^{'}= x- X
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
It is easy to see that the average of the fluctuation is zero, i.e.,
It is easy to see that the average of the fluctuation is zero, i.e.,
-
<table width="100%"><tr><td>
+
:<math>\left\langle x' \right\rangle = 0</math>
-
:<math>  
+
-
        \left\langle x^{'} \right\rangle = 0
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
-
On the other hand, the ensemble average of the square of the fluctuation is ''not'' zero. In fact, it is such an important statistical measure we give it a special name, the '''variance''', and represent it symbolically by either <math> var \left[ x \right] </math> or <math> \left\langle \left( x^{'} \right) ^{2} \right\rangle  </math>  
+
On the other hand, the ensemble average of the square of the fluctuation is ''not'' zero. In fact, it is such an important statistical measure we give it a special name, the '''variance''', and represent it symbolically by either <math> var \left[ x \right] </math> or <math> \left\langle \left( x' \right) ^{2} \right\rangle  </math>  
The ''variance'' is defined as
The ''variance'' is defined as
-
<table width="100%"><tr><td>
+
:<math>var \left[ x \right] \equiv  \left\langle \left( x' \right) ^{2} \right\rangle  = \left\langle  \left[ x - X \right]^{2} \right\rangle</math>
-
:<math>  
+
-
var \left[ x \right] \equiv  \left\langle \left( x^{'} \right) ^{2} \right\rangle  = \left\langle  \left[ x - X \right]^{2} \right\rangle  
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
-
<table width="100%"><tr><td>
+
:<math>= \lim_{N\rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} \left[ x_{n} - X \right]^{2}</math>
-
:<math>  
+
-
= \lim_{N\rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} \left[ x_{n} - X \right]^{2}
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
Note that the variance, like the ensemble average itself, can never really be measured, since it would require an infinite number of members of the ensemble.
Note that the variance, like the ensemble average itself, can never really be measured, since it would require an infinite number of members of the ensemble.
 +
It is straightforward to show from the definition of ensemble average the variance can be written as
-
It is straightforward to show from eqaution 2.2 that the variance in equation 2.6 can be written as
+
:<math>var \left[ x \right] = \left\langle x^{2} \right\rangle - X^{2}</math>
-
 
+
-
<table width="100%"><tr><td>
+
-
:<math>  
+
-
var \left[ x \right] = \left\langle x^{2} \right\rangle - X^{2}
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
Thus the variance is the ''second-moment'' minus the square of the ''first-moment'' (or mean). In this naming convention, the ensemble mean is the ''first moment''.
Thus the variance is the ''second-moment'' minus the square of the ''first-moment'' (or mean). In this naming convention, the ensemble mean is the ''first moment''.
 +
The variance can also referred to as the ''second central moment of x''. The word central implies that the mean has been subtracted off before squaring and averaging. The reasons for this will be clear below. If two random variables are identically distributed, then they must have the same mean and variance.
-
The variance can also referred to as the ''second central moment of x''. The word central implies that the mean has been subtructed off before squaring and averaging. The reasons for this will be clear below. If two random variables are identically distributed, then they must have the same mean and variance.
+
The variance is closely related to another statistical quantity called the ''standard deviation'' or root mean square (''rms'') value of the random variable <math> x </math> , which is denoted by the symbol, <math> \sigma_{x} </math>. Thus,
-
The variance is closely related to another statistical quantity called the ''stardard deviation'' or root mean square (''rms'') value of the random variable <math> x </math> , which is denoted by the simbol, <math> \sigma_{x} </math>. Thus,
+
:<math>\sigma_{x} \equiv \left( var \left[ x \right] \right)^{1/2}</math>
-
 
+
-
<table width="100%"><tr><td>
+
-
:<math>  
+
-
\sigma_{x} \equiv \left( var \left[ x \right] \right)^{1/2}  
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
or  
or  
-
<table width="100%"><tr><td>
+
:<math>\sigma^{2}_{x} = var \left[ x \right]</math>
-
:<math>  
+
-
\sigma^{2}_{x} = var \left[ x \right]  
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
-
----------------------------------------
+
<font color="orange" size=3>Figure 2.2 not uploaded yet</font>
 +
== Higher moments ==
-
=== Higher moments ===
+
Figure 2.2 illustrates two random variables of time which have the same mean and also the same variances, but clearly they are still quite different. It is useful, therefore, to define higher moments of the distribution to assist in distinguishing these differences.
-
Figure 2.2 illustrates tow random variables of time which have the same mean and also the same variances, but clearly they are still quite different. It is useful, therefore, to define higher moments of the distribution to assist in distinguishing these differences.
+
The <math>m</math>-th moment of the random variable is defined as
-
The <math> m </math>-th moment of the random variable is defined as
+
:<math>\left\langle x^{m} \right\rangle = \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} x^{m}_{n}</math>
-
 
+
-
<table width="100%"><tr><td>
+
-
:<math>  
+
-
\left\langle x^{m} \right\rangle = \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} x^{m}_{n}  
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
It is usually more convenient to work with the ''central moments'' defined by:
It is usually more convenient to work with the ''central moments'' defined by:
-
<table width="100%"><tr><td>
+
:<math>\left\langle  \left( x' \right)^{m} \right\rangle  = \left\langle  \left( x-X \right)^{m} \right\rangle = \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} \left[x_{n} - X \right]^{m}</math>
-
:<math>  
+
-
\left\langle  \left( x^{'} \right)^{m} \right\rangle  = \left\langle  \left( x-X \right)^{m} \right\rangle = \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} \left[x_{n} - X \right]^{m}
+
-
</math>
+
-
</td><td width="5%">(2)</td></tr></table>
+
The central moments give direct information on the distribution of the values of the random variable about the mean. It is easy to see that the variance is the second central moment (i.e., <math> m=2 </math> ).
The central moments give direct information on the distribution of the values of the random variable about the mean. It is easy to see that the variance is the second central moment (i.e., <math> m=2 </math> ).
 +
 +
 +
{{Turbulence credit wkgeorge}}
 +
 +
{{Chapter navigation||Probability}}

Latest revision as of 12:29, 2 July 2011

Introduction to turbulence
Nature of turbulence
Statistical analysis
Reynolds averaged equation
Turbulence kinetic energy
Stationarity and homogeneity
Homogeneous turbulence
Free turbulent shear flows
Wall bounded turbulent flows
Study questions

... template not finished yet!

Contents

The mean or ensemble average

The concept of an ensemble average is based upon the existence of independent statistical event. For example, consider a number of inviduals who are simultaneously flipping unbiased coins. If a value of one is assigned to a head and the value of zero to a tail, then the arithmetic average of the numbers generated is defined as

X_{N}=\frac{1}{N} \sum{x_{n}}

where our n th flip is denoted as x_{n} and N is the total number of flips.

Now if all the coins are the same, it doesn't really matter whether we flip one coin N times, or N coins a single time. The key is that they must all be independent events - meaning the probability of achieving a head or tail in a given flip must be completely independent of what happens in all the other flips. Obviously we can't just flip one coin and count it N times; these cleary would not be independent events

Exercise: Carry out an experiment where you flip a coin 100 times in groups of 10 flips each. Compare the values you get for X_{10} for each of the 10 groups, and note how they differ from the value of X_{100}.

Unless you had a very unusual experimental result, you probably noticed that the value of the X_{10} 's was also a random variable and differed from ensemble to ensemble. Also the greater the number of flips in the ensemle, the closer you got to X_{N}=1/2 . Obviously the bigger N , the less fluctuation there is in X_{N}

Now imagine that we are trying to establish the nature of a random variable x . The nth realization of x is denoted as x_{n}. The ensemble average of x is denoted as X (or \left\langle x \right\rangle ), and is defined as

X = \left\langle x \right\rangle \equiv \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} x_{n}

Obviously it is impossible to obtain the ensemble average experimentally, since we can never achieve an infinite number of independent realizations. The most we can ever obtain is the arithmetic mean for the number of realizations we have. For this reason the arithmetic mean can also referred to as the estimator for the true mean ensemble average.

Even though the true mean (or ensemble average) is unobtainable, nonetheless, the idea is still very useful. Most importantly,we can almost always be sure the ensemble average exists, even if we can only estimate what it really is. The fact of its existence, however, does not always mean that it is easy to obtain in practice. All the theoretical deductions in this course will use this ensemble average. Obviously this will mean we have to account for these "statistical differenced" between true means and estimates when comparing our theoretical results to actual measurements or computations.

Figure 2.1 not uploaded yet

In general, the x_{n} could be realizations of any random variable. The X defined by the ensemle average definition defined above represents the ensemble average of it. The quantity X is sometimes referred to as the expected value of the random variables x , or even simple its mean.

For example, the velocity vector at a given point in space and time \vec{x},t , in a given turbulent flow can be considered to be a random variable, say u_{i} \left( \vec{x},t \right) . If there were a large number of identical experiments so that the u^{\left( n \right)}_{i} \left( \vec{x},t \right) in each of them were identically distributed, then the ensemble average of u^{\left( n \right)}_{i} \left( \vec{x},t \right) would be given by

\left\langle u_{i} \left( \vec{x} , t \right) \right\rangle = U_{i} \left( \vec{x} , t \right) \equiv \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} u^{ \left( n \right) }_{i} \left( \vec{x} , t \right)

Note that this ensemble average, U_{i} \left( \vec{x},t \right) , will, in general, vary with independent variables \vec{x} and t. It will be seen later, that under certain conditions the ensemble average is the same as the average which would be generated by averaging in time. Even when a time average is not meaningful, however, the ensemble average can still be defined; e.g., as in non-stationary or periodic flow. Only ensemble averages will be used in the development of the turbulence equations here unless otherwise stated.

Fluctuations about the mean

It is often important to know how a random variable is distributed about the mean. For example, figure 2.1 illustrates portions of two random functions of time which have identical means, but are obviously members of different ensembles since the amplitudes of their fluctuations are not distributed the same. it is possible to distinguish between them by examining the statistical properties of the fluctuations about the mean (or simply the fluctuations) defined by:

x' = x - X

It is easy to see that the average of the fluctuation is zero, i.e.,

\left\langle x' \right\rangle = 0

On the other hand, the ensemble average of the square of the fluctuation is not zero. In fact, it is such an important statistical measure we give it a special name, the variance, and represent it symbolically by either var \left[ x \right] or \left\langle \left( x' \right) ^{2} \right\rangle The variance is defined as

var \left[ x \right] \equiv \left\langle \left( x' \right) ^{2} \right\rangle = \left\langle \left[ x - X \right]^{2} \right\rangle
= \lim_{N\rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} \left[ x_{n} - X \right]^{2}

Note that the variance, like the ensemble average itself, can never really be measured, since it would require an infinite number of members of the ensemble.

It is straightforward to show from the definition of ensemble average the variance can be written as

var \left[ x \right] = \left\langle x^{2} \right\rangle - X^{2}

Thus the variance is the second-moment minus the square of the first-moment (or mean). In this naming convention, the ensemble mean is the first moment.

The variance can also referred to as the second central moment of x. The word central implies that the mean has been subtracted off before squaring and averaging. The reasons for this will be clear below. If two random variables are identically distributed, then they must have the same mean and variance.

The variance is closely related to another statistical quantity called the standard deviation or root mean square (rms) value of the random variable x , which is denoted by the symbol, \sigma_{x} . Thus,

\sigma_{x} \equiv \left( var \left[ x \right] \right)^{1/2}

or

\sigma^{2}_{x} = var \left[ x \right]

Figure 2.2 not uploaded yet

Higher moments

Figure 2.2 illustrates two random variables of time which have the same mean and also the same variances, but clearly they are still quite different. It is useful, therefore, to define higher moments of the distribution to assist in distinguishing these differences.

The m-th moment of the random variable is defined as

\left\langle x^{m} \right\rangle = \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} x^{m}_{n}

It is usually more convenient to work with the central moments defined by:

\left\langle \left( x' \right)^{m} \right\rangle = \left\langle \left( x-X \right)^{m} \right\rangle = \lim_{N \rightarrow \infty} \frac{1}{N} \sum^{N}_{n=1} \left[x_{n} - X \right]^{m}

The central moments give direct information on the distribution of the values of the random variable about the mean. It is easy to see that the variance is the second central moment (i.e., m=2 ).


Credits

This text was based on "Lectures in Turbulence for the 21st Century" by Professor William K. George, Professor of Turbulence, Chalmers University of Technology, Gothenburg, Sweden.

Probability →
Introduction to turbulence/Statistical analysis · Probability →
Retrieved from "https://mail.cfd-online.com/Wiki/Introduction_to_turbulence/Statistical_analysis/Ensemble_average"
My wiki