In this article, we introduce Cauchy problems for beginners in mathematics. To simplify our exposition, we will talk only about linear Cauchy problems. First, we study such problems in the set of real numbers. Second, generalize the result to finite-dimensional spaces. Finally, treat the case of general Banach spaces, partial differential equations. At the end of this article, we shall give some known Cauchy problems. The background of this post can be useful for engineers as well as for graduate students.
The origin of Cauchy’s problems
In one of his lectures at the École Polytechnique de Paris, The French mathematican Austin-Louis Cauchy asked his student the following question: is there a continuous function $ u: \mathbb{R}\to \mathbb{R} $ such that \begin{align*}\tag{Eq} u (t + s) = u (t ) u (s)\end{align*} for all $t, s\in\mathbb{R}$. In fact, this question dated two centuries ago. Of course, the null function is a solution to this problem. On the other hand, if $u(0)$ and if $u$ satisfies the above functional equation (Eq), then by replacing $s$ by zero we get $f(t)=0$, which is the null function. This case is not interesting, we then assume that $u(0)\neq 0$. In this case, as $u(0)=u(0+0)=u(0)u(0),$ we deduce that $u(0)=u(0)^2$, so $u(0)=1$.
The Differential equation
We recall that the real exponential function is given by the following series. \begin{align*}e^{at}=\sum_{n=0}^{+\infty} \frac{t^n}{n!}a^n\end{align*}where $n!=1\times 2\times \cdots\times n$ with the convention $0!=1$.
Linear systems on spaces of finite dimension
The exponential of a matrix
This definition makes sense only if the above series converges. In fact, by using the matrices norms we have $\|A^n\|\le \|A\|^n,$ so that \begin{align*} \left\|\frac{t^n}{n!} A^n\right\|\le \frac{\left(|t|\|A\|\right)^n}{n!}.\end{align*} Also, using series properties it follows that the quantity $e^{t A}$ is well-defined which we call exponential of a matrix.
An important remark on the exponential of matrices
The solution is defined by the exponential of a matrix
 Partial differential equations
 This equation represents the deplacement a line of lent $r$. Here, for each $t$, the solution $u(t,\cdot)$ is not a vector, but it is a function $u(t,\cdot):[0,r]\to \mathbb{R}$. The analogical $A$ of the previous section is \begin{align*} A =\frac{d}{dx}\end{align*} is not a matrix bu it is a differential operator. Moreover, the quantity $Au$ is well-defined if $u$ is diffrential, due to the definition of $A$. We then remark that $A$ is defined on the natural domain ${\rm Dom}(A)=C^1([0,r])$ the space of continuousely differential functions, and the state space is $X=L^2([0,r])$ the space of square integrable functions. An other example the eveolution of a population.
The general case
Let us define a general Cauchy problem. To this end, let $X$ be a complete normed space (Banach space), and a linear operator $A: {\rm Dom}(A) \subset X\to X$. Define \begin{align*} \begin{cases}\dot{u}(t)=Au(t),& t\ge 0,\cr u(0)=f.\end{cases}\end{align*} In the case of heat equation we have $A=\frac{d^2}{dx^2}$ with domaine the set of functions $f$ such that the second derivative of $f$ exists and $Af\in L^2$.
The Cauchy problem (CP) has a solution if and only if $A$ satisfies the condition of the Hille-Yosida theorem. That is the set (graph) $\{(f,Af):f\in {\rm Dom}(A) \}$ is closed in $X \times X$; $(\lambda I-A)^{-1}$ exists for any $\lambda\in \mathbb{C}$ with $Re\lambda >\omega$ (for some $\omega\in\mathbb{R}$), and \begin{align*} \|(\lambda I-A)^{-1}\|le \frac{M}{( Re\lambda -\omega)^n}\end{align*} for all $n\in\mathbb{N}$ and some real number $M\ge 1$. The problem (CP) can also, in some cases, solved by Laplace transform or Fourier transform.
If (CP) has a solution $X$, there exists a family of linear bounded operators $T(t):X\to X$ for $t\ge 0,$ satisfying $T(0)=I,$ $T(t+s)=T(t)T(s)$ and $T(t)f-f\to 0$ as $t\to 0,$ for any $f\in X$. Thus $T(\cdot)$ satisfies the exponential properties. The solution of (CP) is: \begin{align*}u(t)=T(t)f,\quad t\ge 0.\end{align*}. The familly $(T(t))_{t\ge 0}$ is called strongly continuous semigroups.
A Cauchy problem describing a transport equation
We consider a function defined by \begin{align*} u(t,x)=f(t+x),\quad t\in \mathbb{R}^+,\quad x\in [-r,0]\end{align*} for $f\in L^2([-r,0])$. If we assume that $f$ is differentiable, then by compostion of differential function on can be that \begin{align*} \frac{\partial u}{\partial t}(t,x)=Df(t+x)= \frac{\partial u}{\partial x}(t,x),\end{align*} where $Df(z)$ is the differntial function of $f$ at point $z$.