Mathematics for Applied Sciences (Osnabrück 2023-2024)/Part I/Lecture 12/latex

\setcounter{section}{12}






\subtitle {Power series}




\inputdefinition
{ }
{

Let \mathl{{ \left( c_n \right) }_{n \in \N }}{} be a sequence of real numbers and $x$ another real number. Then the series
\mathdisp {\sum _{ n= 0}^\infty c_n x^{ n }} { }

is called the \definitionword {power series}{} in $x$ for the coefficients \mathl{{ \left( c_n \right) }_{n \in \N }}{.}

}

For a power series, it is important that $x$ varies and that the power series represents in some \keyword {convergence interval} {} a function in $x$. Every polynomial is a power series, but one for which all coefficients starting with a certain member are $0$. In this case, the convergence is everywhere.

We have encountered an important power series earlier, the geometric series \mathl{\sum_{n=0}^\infty x^n}{} (here all coefficients equal $1$), which converges for
\mathrelationchain
{\relationchain
{ \betrag { x }}
{ < }{ 1}
{ }{}
{ }{}
{ }{}
} {}{}{} and represents the function \mathl{1/(1-x)}{,} see Theorem 9.13 . Another important power series is the \keyword {exponential series} {,} which for every real number converges and represents the \keyword {real exponential function} {.} Its inverse function is the \keyword {natural logarithm} {.}

The behavior of convergence of a power series is given by the following theorem.




\inputfaktbeweis
{Real power series/Convergence/Continuous function/Fact}
{Theorem}
{}
{

\factsituation {}
\factcondition {Let
\mathrelationchaindisplay
{\relationchain
{ f(x) }
{ \defeq} {\sum_{n = 0}^\infty c_n x^n }
{ } { }
{ } { }
{ } { }
} {}{}{} be a power series and suppose that there exists some
\mathrelationchain
{\relationchain
{ x_0 }
{ \neq }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} such that \mathl{\sum_{n=0}^\infty c_n x_0^n}{} converges.}
\factconclusion {Then there exists a positive $R$ (where
\mathrelationchain
{\relationchain
{ R }
{ = }{ \infty }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} is allowed) such that for all
\mathrelationchain
{\relationchain
{ x }
{ \in }{ \R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} fulfilling
\mathrelationchain
{\relationchain
{ \betrag { x } }
{ < }{ R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} the series converges absolutely. On such an \extrabracket {open} {} {} interval of convergence, the power series \mathl{f(x)}{} represents a continuous function.}
\factextra {}
}
{Real power series/Convergence/Continuous function/Fact/Proof

}


If two functions are given by power series, then their sum is simply given by the \extrabracket {componentwise defined} {} {} sum of the power series. It is not clear at all by which power series the product of two power series is described. The answer is given by the Cauchy-product of series.




\inputdefinition
{ }
{

For two series \mathcor {} {\sum_{ i = 0}^\infty a_{ i }} {and} {\sum_{ j = 0}^\infty b_{ j }} {} of real numbers, the series
\mathdisp {\sum_{ k = 0}^\infty c_{ k } \text{ with } c_k \defeq \sum_{i = 0}^k a_i b_{k-i}} { }

is called the \definitionword {Cauchy-product}{} of the series.

}

Also, for the following statement we do not provide a proof.




\inputfakt
{Real series/Cauchy-product/Absolute convergence/Fact}
{Lemma}
{}
{

\factsituation {Let
\mathdisp {\sum_{ k = 0}^\infty a_{ k } \text{ and } \sum_{ k = 0}^\infty b_{ k }} { }
be absolutely convergent series of real numbers.}
\factconclusion {Then also the Cauchy product \mathl{\sum_{ k = 0}^\infty c_{ k }}{} is absolutely convergent and for its sum the equation
\mathrelationchaindisplay
{\relationchain
{ \sum_{ k = 0}^\infty c_{ k } }
{ =} { { \left( \sum_{ k = 0}^\infty a_{ k } \right) } \cdot { \left( \sum_{ k = 0}^\infty b_{ k } \right) } }
{ } { }
{ } { }
{ } { }
} {}{}{} holds.}
\factextra {}

}


From this we can infer that the product of power series is given by the power series whose coefficients are those which arise by the multiplication of polynomials, see Exercise 12.3 .






\subtitle {Exponential series and exponential function}

We discuss another important power series, the exponential series and the exponential function defined by it.




\inputdefinition
{ }
{

For every
\mathrelationchain
{\relationchain
{x }
{ \in }{ \R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} the series
\mathdisp {\sum_{ n =0}^\infty \frac{ x^{ n } }{n!}} { }

is called the \definitionword {exponential series}{} in $x$.

}

So this is just the series
\mathdisp {1+x+ { \frac{ x^2 }{ 2 } } +{ \frac{ x^3 }{ 6 } } + { \frac{ x^4 }{ 24 } } +{ \frac{ x^5 }{ 120 } } + \ldots} { . }




\inputfactproof
{Exponential series/Real/Absolute convergence/Fact}
{Theorem}
{}
{

\factsituation {For every
\mathrelationchain
{\relationchain
{ x }
{ \in }{ \R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} the exponential series
\mathdisp {\sum_{ n =0}^\infty \frac{ x^{ n } }{n!}} { }
}
\factconclusion {is absolutely convergent.}
\factextra {}
}
{

For
\mathrelationchain
{\relationchain
{ x }
{ = }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} the statement is clear. Else, we consider the fraction
\mathrelationchaindisplay
{\relationchain
{ \betrag { \frac{ \frac{x^{n+1} }{(n+1)!} }{\frac{x^n}{n!} } } }
{ =} { \betrag { \frac{x}{n+1} } }
{ =} { \frac{ \betrag { x } }{n+1} }
{ } { }
{ } { }
} {}{}{.} This is, for
\mathrelationchain
{\relationchain
{ n }
{ \geq }{ 2 \betrag { x } }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} smaller than \mathl{1/2}{.} By the ratio test, we get convergence.

}


Due to this property, we can define the real exponential function.




\image{ \begin{center}
\includegraphics[width=5.5cm]{\imageinclude {Exp.svg} }
\end{center}
\imagetext {The graph of the real exponential function} }

\imagelicense { Exp.svg } {} {Oleg Alexandrov} {Commons} {CC-by-sa 3.0} {}





\inputdefinition
{ }
{

The function
\mathdisp {\R \longrightarrow \R , x \longmapsto \exp x \defeq \sum_{ n =0}^\infty \frac{ x^{ n } }{n!}} { , }
is called the (real)

\definitionword {exponential function}{.}

}

The following statement is called the \keyword {functional equation for the exponential function} {.}




\inputfactproof
{Exponential series/Real/Functional equation/Fact}
{Theorem}
{}
{

\factsituation {}
\factcondition {For real numbers
\mathrelationchain
{\relationchain
{ x,y }
{ \in }{\R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,}}
\factconclusion {the equation
\mathrelationchaindisplay
{\relationchain
{ \exp { \left( x+y \right) } }
{ =} { \exp x \cdot \exp y }
{ } { }
{ } { }
{ } { }
} {}{}{} holds.}
\factextra {}
}
{

The Cauchy product of the two exponential series is
\mathdisp {\sum_{ n = 0}^\infty c_{ n }} { , }
where
\mathrelationchaindisplay
{\relationchain
{ c_n }
{ =} { \sum_{i = 0}^n \frac{x^{i} }{i!} \cdot \frac{ y^{n-i } }{ (n-i)!} }
{ } { }
{ } { }
{ } { }
} {}{}{.} This series is due to Lemma 12.4 absolutely convergent and the limit is the product of the two limits. Furthermore, the $n$-th summand of the exponential series of \mathl{x+y}{} equals
\mathrelationchaindisplay
{\relationchain
{ \frac{(x+y)^n}{n!} }
{ =} { \frac{1}{n!} \sum_{i = 0}^n \binom { n } { i } x^{i} y^{n-i} }
{ =} { c_n }
{ } { }
{ } {}
} {}{}{,} so that both sides coincide.

}





\inputfactproof
{Exponential series/Real/Elementary properties/Fact}
{Corollary}
{}
{

\factsituation {}
\factcondition {The exponential function
\mathdisp {\R \longrightarrow \R , x \longmapsto \exp x} { , }
}
\factsegue {fulfills the following properties.}
\factconclusion {\enumerationsix {
\mathrelationchain
{\relationchain
{ \exp 0 }
{ = }{ 1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {For every
\mathrelationchain
{\relationchain
{ x }
{ \in }{\R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} we have
\mathrelationchain
{\relationchain
{ \exp { \left( -x \right) } }
{ = }{ ( \exp x )^{-1} }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} In particular
\mathrelationchain
{\relationchain
{ \exp x }
{ \neq }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {For integers
\mathrelationchain
{\relationchain
{ n }
{ \in }{ \Z }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} the relation
\mathrelationchain
{\relationchain
{ \exp n }
{ = }{ ( \exp 1)^n }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} holds. } {For every $x$, we have
\mathrelationchain
{\relationchain
{ \exp x }
{ \in }{ \R_+ }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {For
\mathrelationchain
{\relationchain
{ x }
{ > }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} we have
\mathrelationchain
{\relationchain
{ \exp x }
{ > }{ 1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} and for
\mathrelationchain
{\relationchain
{ x }
{ < }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} we have
\mathrelationchain
{\relationchain
{ \exp x }
{ < }{ 1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {The real exponential function is strictly increasing. }}
\factextra {}
}
{

(1) follows directly from the definition.
(2) follows from
\mathrelationchaindisplay
{\relationchain
{ \exp x \cdot \exp { \left( -x \right) } }
{ =} { \exp { \left( x-x \right) } }
{ =} { \exp 0 }
{ =} { 1 }
{ } { }
} {}{}{} using Theorem 12.8 .
(3) follows for
\mathrelationchain
{\relationchain
{ n }
{ \in }{ \N }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} from Theorem 12.8 by induction, and from that it follows with the help of (2) also for negative $n$.
(4). Nonnegativity follows from
\mathrelationchaindisplay
{\relationchain
{ \exp x }
{ =} { \exp { \left( { \frac{ x }{ 2 } } + { \frac{ x }{ 2 } } \right) } }
{ =} { \exp { \frac{ x }{ 2 } } \cdot \exp { \frac{ x }{ 2 } } }
{ =} { { \left(\exp { \frac{ x }{ 2 } }\right) }^2 }
{ \geq} { 0 }
} {}{}{.}
(5). For real $x$ we have
\mathrelationchain
{\relationchain
{ \exp x \cdot \exp { \left( -x \right) } }
{ = }{ 1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} so that because of (4), one factor must be $\geq 1$ and the other factor must be $\leq 1$. For
\mathrelationchain
{\relationchain
{ x }
{ > }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} we have
\mathrelationchaindisplay
{\relationchain
{ \exp x }
{ =} { \sum_{n = 0}^\infty \frac{1}{n!} x^n }
{ =} {1+x+ { \frac{ 1 }{ 2 } } x^2 + \ldots }
{ >} {1 }
{ } { }
} {}{}{} as only positive numbers are added.
(6). For real
\mathrelationchain
{\relationchain
{ y }
{ > }{ x }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} we have
\mathrelationchain
{\relationchain
{ y-x }
{ > }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} and therefore, because of (5)
\mathrelationchain
{\relationchain
{ \exp { \left( y-x \right) } }
{ > }{ 1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} hence
\mathrelationchaindisplay
{\relationchain
{ \exp y }
{ =} { \exp { \left( y-x + x \right) } }
{ =} { \exp { \left( y-x \right) } \cdot \exp x }
{ >} { \exp x }
{ } { }
} {}{}{.}

}

With the help of the exponential series, we also define \keyword {Euler's number} {.}


\inputdefinition
{ }
{

The real number
\mathrelationchaindisplay
{\relationchain
{e }
{ \defeq} { \sum_{k = 0}^\infty { \frac{ 1 }{ k! } } }
{ } { }
{ } { }
{ } { }
} {}{}{}

is called \definitionword {Euler's number}{.}

}

So we have
\mathrelationchain
{\relationchain
{ e }
{ = }{ \exp 1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} Its numerical value is
\mathrelationchaindisplay
{\relationchain
{e }
{ =} { 1+1+ { \frac{ 1 }{ 2 } } + { \frac{ 1 }{ 6 } } + { \frac{ 1 }{ 24 } } + \ldots }
{ \cong} { 2,71 ... }
{ } { }
{ } { }
} {}{}{.}




\inputremark {}
{

For Euler's number there is also the description
\mathrelationchaindisplay
{\relationchain
{e }
{ =} { \lim_{n \rightarrow \infty} { \left( 1+ { \frac{ 1 }{ n } } \right) }^n }
{ } { }
{ } { }
{ } { }
} {}{}{,} so that $e$ can also be introduced as the limit of this sequence. However, the convergence in the exponential series is much faster.

}

We will also write \mathl{e^x}{} instead of \mathl{\exp x}{.} This is, for
\mathrelationchain
{\relationchain
{x }
{ \in }{ \Z }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} compatible with the usual meaning of powers in the sense of the fourth lecture due to Corollary 12.9   (3). The compatibility with arbitrary roots \extrabracket {if the exponents are rational} {} {} follows from Remark 12.17 and Exercise 12.17 .




\inputfactproof
{Real exponential function/Continuity and image/Fact}
{Theorem}
{}
{

\factsituation {The real exponential function
\mathdisp {\R \longrightarrow \R , x \longmapsto \exp x} { , }
}
\factconclusion {is continuous and defines a bijection between $\R$ and $\R_+$.}
\factextra {}
}
{

The continuity follows from Theorem 12.2 , since the exponential function is defined with the help of a power series. Due to Corollary 12.9   (4), the image lies in $\R_+$, and the image is, because of the intermediate value theorem, an interval. The unboundedness of the image follows from Corollary 12.9   (3). This implies, because of Corollary 12.9   (2), that also arbitrary small positive real numbers are obtained. Thus the image is $\R_+$. Injectivity follows from Corollary 12.9   (6), in connection with Exercise 5.38 .

}







\subtitle {Logarithms}




\inputdefinition
{ }
{

The \definitionword {natural logarithm}{}
\mathdisp {\ln \colon \R_+ \longrightarrow \R , x \longmapsto \ln x} { , }
is defined as the inverse function of the

real exponential function.

}




\inputfactproof
{Natural logarithm/Functional equation/Bijection/Continuity/Monotonicity/Fact}
{Theorem}
{}
{

\factsituation {The natural logarithm
\mathdisp {\ln \colon \R_+ \longrightarrow \R , x \longmapsto \ln x} { , }
}
\factconclusion {is a continuous strictly increasing function, which defines a bijection between \mathcor {} {\R_+} {and} {\R} {.} Moreover, the functional equation
\mathrelationchaindisplay
{\relationchain
{ \ln (x \cdot y) }
{ =} { \ln x + \ln y }
{ } { }
{ } { }
{ } { }
} {}{}{} holds for all
\mathrelationchain
{\relationchain
{x,y }
{ \in }{ \R_+ }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.}}
\factextra {}
}
{

}






\image{ \begin{center}
\includegraphics[width=5.5cm]{\imageinclude {Exponentials.svg} }
\end{center}
\imagetext {The exponential functions for various bases} }

\imagelicense { Exponentials.svg } {} {Superborsuk} {Commons} {CC-by-sa 2.5} {}




\inputdefinition
{ }
{

For a positive real number
\mathrelationchain
{\relationchain
{ b }
{ > }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} the \definitionword {exponential function for the base}{} $b$ is defined as
\mathrelationchaindisplay
{\relationchain
{ b^x }
{ \defeq} { \exp (x \ln b ) }
{ } { }
{ } { }
{ } { }
}

{}{}{.}

}




\inputfactproof
{Real exponential function/Base/Properties/Fact}
{Theorem}
{}
{

\factsituation {Let $b$ denote a positive real number.}
\factsegue {Then the exponential function
\mathdisp {f \colon \R \longrightarrow \R , x \longmapsto b^x} { , }
fulfills the following properties.}
\factconclusion {\enumerationeight {We have
\mathrelationchain
{\relationchain
{ b^{x+x'} }
{ = }{ b^x \cdot b^{x'} }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} for all
\mathrelationchain
{\relationchain
{x,x' }
{ \in }{ \R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {We have
\mathrelationchain
{\relationchain
{ b^{-x} }
{ = }{ { \frac{ 1 }{ b^x } } }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {For
\mathrelationchain
{\relationchain
{b }
{ > }{1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} and
\mathrelationchain
{\relationchain
{x }
{ > }{0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} we have
\mathrelationchain
{\relationchain
{b^x }
{ > }{1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {For
\mathrelationchain
{\relationchain
{b }
{ < }{1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} and
\mathrelationchain
{\relationchain
{x }
{ > }{0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} we have
\mathrelationchain
{\relationchain
{b^x }
{ < }{1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {For
\mathrelationchain
{\relationchain
{b }
{ > }{1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} the function $f$ is strictly increasing. } {For
\mathrelationchain
{\relationchain
{b }
{ < }{1 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} the function $f$ is strictly decreasing. } {We have
\mathrelationchain
{\relationchain
{ (b^{x})^{x'} }
{ = }{ b^{ x \cdot x'} }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} for all
\mathrelationchain
{\relationchain
{x,x' }
{ \in }{\R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {For
\mathrelationchain
{\relationchain
{a }
{ \in }{ \R_+ }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} we have
\mathrelationchain
{\relationchain
{ (ab)^x }
{ = }{ a^x \cdot b^x }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} }}
\factextra {}

}
{See Exercise 12.9 .}





\inputremark {}
{

There is another way to introduce the exponential function \mathl{x \mapsto a^x}{} to base
\mathrelationchain
{\relationchain
{a }
{ > }{0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} For a natural number
\mathrelationchain
{\relationchain
{ n }
{ \neq }{ 0 }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} one takes the $n$th product of $a$ with itself as definition for $a^n$. For a negative integer $x$, one sets
\mathrelationchain
{\relationchain
{a^x }
{ \defeq }{ (a^{-x} )^{-1} }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} For a positive rational number
\mathrelationchain
{\relationchain
{x }
{ = }{r/s }
{ }{ }
{ }{ }
{ }{ }
} {}{}{,} one sets
\mathrelationchaindisplay
{\relationchain
{ a^x }
{ \defeq} { \sqrt[s] { a^r } }
{ } { }
{ } { }
{ } { }
} {}{}{,} where one has to show that this is independent of the chosen representation as a fraction. For a negative rational number, one takes again the inverse. For an arbitrary real number $x$, one takes a sequence $q_n$ of rational numbers converging to $x$, and defines
\mathrelationchaindisplay
{\relationchain
{ a^x }
{ \defeq} { \lim_{n \rightarrow \infty} a^{q_n} }
{ } { }
{ } { }
{ } { }
} {}{}{.} For this, one has to show that these limits exist and that they are independent of the chosen rational sequence. For the passage from $\Q$ to $\R$, the concept of uniform continuity is crucial.

}




\inputdefinition
{ }
{

For a positive real number
\mathcond {b>0} {}
{b \neq 1} {}
{} {} {} {,} the \definitionword {logarithm to base}{} $b$ of
\mathrelationchain
{\relationchain
{x }
{ \in }{ \R_+ }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} is defined by
\mathrelationchaindisplay
{\relationchain
{ \log_{ b } x }
{ \defeq} { { \frac{ \ln x }{ \ln b } } }
{ } { }
{ } { }
{ } { }
}

{}{}{.}

}






\image{ \begin{center}
\includegraphics[width=5.5cm]{\imageinclude {Fonctionslog3.svg} }
\end{center}
\imagetext {Logarithms for various bases} }

\imagelicense { Fonctionslog3.svg } {} {HB} {Commons} {CC-by-sa 3.0} {}




\inputfactproof
{Logarithm/Base/Rules/Fact}
{Theorem}
{}
{

\factsituation {The logarithms to base $b$}
\factsegue {fulfill the following rules.}
\factconclusion {\enumerationfour {We have \mathcor {} {\log_b(b^x) =x} {and} {b^{\log_b(y)} =y} {,} this means that the logarithm to Base $b$ is the inverse function for the exponential function to base $b$. } {We have
\mathrelationchain
{\relationchain
{ \log_{ b } (y \cdot z) }
{ = }{ \log_{ b } y + \log_{ b } z }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {We have
\mathrelationchain
{\relationchain
{\log_{ b } y^u }
{ = }{u \cdot \log_{ b } y }
{ }{ }
{ }{ }
{ }{ }
} {}{}{} for
\mathrelationchain
{\relationchain
{u }
{ \in }{ \R }
{ }{ }
{ }{ }
{ }{ }
} {}{}{.} } {We have
\mathrelationchaindisplay
{\relationchain
{ \log_{ a } y }
{ =} { \log_{ a } { \left( b^{ \log_{ b } y } \right) } }
{ =} { \log_{ b } y \cdot \log_{ a } b }
{ } { }
{ } { }
} {}{}{.} }}
\factextra {}

}
{See Exercise 12.25 .}