# Fourier Coefficients

• May 31st 2009, 11:08 AM
frater_cp
Fourier Coefficients
Let (e_k) be an orthonormal sequence in a Hilbert space H, and let
M=span{e_k}. Show that for any x \in H we have x \in \overline{M}
\iff x can be represented by \sum_{k=1}^{\infty} \alpha_k e_k, with
coefficients \alpha_k = <x,e_k>.
• May 31st 2009, 12:18 PM
Jose27
It should be clear that it suffices to prove the following:

Let $\displaystyle B=\{e_k: k \in \mathbb{N}\}$ an orthonormal set in a Hilbert space $\displaystyle H$, then $\displaystyle B$ is a Hilbert base ( $\displaystyle H=\overline{lin(B)}$) $\displaystyle \Longleftrightarrow$ $\displaystyle \forall u \in H$ we have $\displaystyle u = \sum_{i=1}^ \infty \ (u \circ e_i)e_i$
$\displaystyle \Longrightarrow)$

Since $\displaystyle B$ is a Hilbert base, we have $\displaystyle H=\overline{lin(B)}$ and so, we divide this in two cases:

1) $\displaystyle u \in lin(B)$: We have then $\displaystyle u = \sum_{i=1}^ m \ a_i(e_i)$ where $\displaystyle a_i \in \mathbb{F}$ (where $\displaystyle \mathbb{F}$ is the basefield $\displaystyle \mathbb{R}$ or $\displaystyle \mathbb{C}$) then $\displaystyle u \circ e_k = (\sum_{i=1}^m \ a_i(e_i)) \circ e_k = \sum_{i=1}^m \ a_i(e_i \circ e_k) = a_k$. Thus $\displaystyle u \circ e_k = a_k$, and as such for every $\displaystyle n>m$ we have $\displaystyle (u \circ e_n) = 0$ and so $\displaystyle u = \sum_{i=1}^ \infty \ (u \circ e_i)e_i.$
2) $\displaystyle u \in \overline{lin(B)}$: We choose a $\displaystyle v \in lin(B)$ such that $\displaystyle \| {u-v}\| <\epsilon$. Then $\displaystyle v = \sum_{i=1}^ l \ (v \circ e_k)e_k$. Now we take $\displaystyle m>l$ and using the triangle inequality two times and the Cauchy-Schwarz inequality afterwards we obtain:

$\displaystyle \|{\sum_{i=1}^ m \ (u \circ e_i)e_i} -u \| \leq \|{\sum_{i=1}^ m \ ( u \circ e_i)e_i}-{\sum_{i=1}^l \ ( v \circ e_i)e_i}\| + \| {v-u}\|$ $\displaystyle \leq \|{\sum_{i=1}^ m \ ( u-v \circ e_i)e_i}\| +\epsilon \leq {\sum_{i=1}^ m \ {\vert(u-v \circ e_i)\vert}} + \epsilon \leq \sum_{i=1}^ m \ {\|{u-v}\|} + \epsilon \leq m\epsilon + \epsilon \rightarrow 0.$
Thus we have shown that $\displaystyle u = \sum_{i=1}^ \infty \ ( u \circ e_i) e_i.$

Since $\displaystyle H=\overline{lin(B)}$, we are finished.

$\displaystyle \Longleftarrow)$
Since for all $\displaystyle m \in \mathbb{N}$ we have $\displaystyle u_m = \sum_{i=1}^ m \ ( u \circ e_i)e_i$ then $\displaystyle u_m \in lin(B)$, we have that $\displaystyle u_m \rightarrow u$ and so, $\displaystyle u \in \overline{lin(B)}$, and so $\displaystyle H=\overline{lin(B)}$.

Man, that was hard to type, anyway hope it helps.
• May 31st 2009, 12:25 PM
frater_cp
Just a quick question what is $\displaystyle \overline{lin(B)}$ ? is it same as span ? i.e. all possible linear combinations of e_n ?
• May 31st 2009, 01:04 PM
Jose27
Quote:

Originally Posted by frater_cp
Just a quick question what is \overline{lin(B)} ? is it same as span ? i.e. all possible linear combinations of e_n ?

No, it means the topological closure (obviously with the topology induced from the norm) of the linear span of B.

By the way check it out, I fixed the first post and now everything is legible...Yay.
• May 31st 2009, 01:19 PM
frater_cp
Youre the best Jose ! My brain is a bit tired has been a long day, but I'm gonna work through it slowly in the morning when I'm fresh. Thanks so much for the assistance :-)
• May 31st 2009, 01:29 PM
frater_cp
can you just help me with something small... I am not exactly sure what the
operator $\displaystyle \circ$ means.

Never seen it before is it an inner product or something else?
• May 31st 2009, 01:46 PM
Jose27
Yes, it's the inner product, I was going to use the normal brackets, but my instructions got all mixed up, and decided to change the brackets for this notation. Hope it doesn't confuse you much.
• Jun 1st 2009, 12:16 AM
frater_cp
Thank you for clarifying that for me Jose!
No I'll manage.
My sincerest gratitude for the solution you provided typed out is such elegance.
I've got plenty to learn about inner product spaces and hilbert spaces and your feedback is helping a great deal!
• Jun 5th 2009, 06:58 PM
Jose27
Quote:

Originally Posted by Jose27
It should be clear that it suffices to prove the following:

Let $\displaystyle B=\{e_k: k \in \mathbb{N}\}$ an orthonormal set in a Hilbert space $\displaystyle H$, then $\displaystyle B$ is a Hilbert base ( $\displaystyle H=\overline{lin(B)}$) $\displaystyle \Longleftrightarrow$ $\displaystyle \forall u \in H$ we have $\displaystyle u = \sum_{i=1}^ \infty \ (u \circ e_i)e_i$
$\displaystyle \Longrightarrow)$

Since $\displaystyle B$ is a Hilbert base, we have $\displaystyle H=\overline{lin(B)}$ and so, we divide this in two cases:

1) $\displaystyle u \in lin(B)$: We have then $\displaystyle u = \sum_{i=1}^ m \ a_i(e_i)$ where $\displaystyle a_i \in \mathbb{F}$ (where $\displaystyle \mathbb{F}$ is the basefield $\displaystyle \mathbb{R}$ or $\displaystyle \mathbb{C}$) then $\displaystyle u \circ e_k = (\sum_{i=1}^m \ a_i(e_i)) \circ e_k = \sum_{i=1}^m \ a_i(e_i \circ e_k) = a_k$. Thus $\displaystyle u \circ e_k = a_k$, and as such for every $\displaystyle n>m$ we have $\displaystyle (u \circ e_n) = 0$ and so $\displaystyle u = \sum_{i=1}^ \infty \ (u \circ e_i)e_i.$
2) $\displaystyle u \in \overline{lin(B)}$: We choose a $\displaystyle v \in lin(B)$ such that $\displaystyle \| {u-v}\| <\epsilon$. Then $\displaystyle v = \sum_{i=1}^ l \ (v \circ e_k)e_k$. Now we take $\displaystyle m>l$ and using the triangle inequality two times and the Cauchy-Schwarz inequality afterwards we obtain:

$\displaystyle \|{\sum_{i=1}^ m \ (u \circ e_i)e_i} -u \| \leq \|{\sum_{i=1}^ m \ ( u \circ e_i)e_i}-{\sum_{i=1}^l \ ( v \circ e_i)e_i}\| + \| {v-u}\|$ $\displaystyle \leq \|{\sum_{i=1}^ m \ ( u-v \circ e_i)e_i}\| +\epsilon \leq {\sum_{i=1}^ m \ {\vert(u-v \circ e_i)\vert}} + \epsilon \leq \sum_{i=1}^ m \ {\|{u-v}\|} + \epsilon \leq m\epsilon + \epsilon \rightarrow 0.$
Thus we have shown that $\displaystyle u = \sum_{i=1}^ \infty \ ( u \circ e_i) e_i.$

Since $\displaystyle H=\overline{lin(B)}$, we are finished.

$\displaystyle \Longleftarrow)$
Since for all $\displaystyle m \in \mathbb{N}$ we have $\displaystyle u_m = \sum_{i=1}^ m \ ( u \circ e_i)e_i$ then $\displaystyle u_m \in lin(B)$, we have that $\displaystyle u_m \rightarrow u$ and so, $\displaystyle u \in \overline{lin(B)}$, and so $\displaystyle H=\overline{lin(B)}$.

Man, that was hard to type, anyway hope it helps.

I was checking this the other day, and realized that there's a mistake in $\displaystyle \Longrightarrow )$ basically, I'm fixing $\displaystyle \epsilon$ and trying to show that for sufficiently large $\displaystyle m$ the series approaches what it has to, and if you notice I concluded with $\displaystyle m\epsilon + \epsilon \longrightarrow 0$ which is clearly false, since I'm letting $\displaystyle m$ go to infinity, leaving $\displaystyle \epsilon$ fixed, not the other way around.

Anyway, I'll try it again later, but in the meantime sorry for the wrong proof. Although the other implication IS right (it IS kind of trivial though (Punch)).
• Jun 6th 2009, 03:40 AM
frater_cp
Hi Jose. Thanks for alerting me to the fact that there is something wrong with the proof.
Do you think you can rectify it?
• Jun 12th 2009, 09:26 AM
frater_cp
unsolved
Quote:

Originally Posted by Jose27
I was checking this the other day, and realized that there's a mistake in $\displaystyle \Longrightarrow )$ basically, I'm fixing $\displaystyle \epsilon$ and trying to show that for sufficiently large $\displaystyle m$ the series approaches what it has to, and if you notice I concluded with $\displaystyle m\epsilon + \epsilon \longrightarrow 0$ which is clearly false, since I'm letting $\displaystyle m$ go to infinity, leaving $\displaystyle \epsilon$ fixed, not the other way around.

Anyway, I'll try it again later, but in the meantime sorry for the wrong proof. Although the other implication IS right (it IS kind of trivial though (Punch)).

I am also seeking a proof for this problem.
• Jun 23rd 2009, 06:50 PM
Jose27
Okay, I think I got it now.

$\displaystyle \Longrightarrow )$

Let $\displaystyle H$ be a Hilbert Space, $\displaystyle u \in H$ and $\displaystyle B= \{ e_k : k \in \mathbb{N} \} \subset H$ be an othonormal set. Let $\displaystyle a_n = u- \sum_{i=0}^n \ {<u, e_i> e_i}$, then $\displaystyle <a_n, e_k>= <u,e_k> - \sum_{i=0}^ n \ {<u, e_i><e_i,e_k>}$$\displaystyle =0$ if $\displaystyle k \leq n$. And so for $\displaystyle k=n$ we have that $\displaystyle C= \{ a_n, e_0,...,e_n \}$ is an orthogonal set and so:

$\displaystyle \Vert u \Vert ^2 = \Vert a_n + \sum_{i=0}^n \ {<u,e_i>e_i} \Vert ^2$ by definition

$\displaystyle = \Vert a_n \Vert ^2 + \vert \sum_{i=0}^n \ { \vert <u,e_i> \vert ^2} \vert$ because $\displaystyle C$ is an othonormal set.

$\displaystyle \geq \sum_{i=0}^n \ { \vert <u,e_i> \vert ^2}$ becuase the norm is always positive.

But this is for an arbitrary $\displaystyle n \in \mathbb{N}$ and so $\displaystyle \sum_{i=0}^{\infty} \ { \vert <u,e_i> \vert ^2} \leq \Vert u \Vert ^2$ (in particular it converges).

Suppose that $\displaystyle u \in \overline{linB}$ then there exist a sequence $\displaystyle (x_n) \subset linB$ such that $\displaystyle x_n \longrightarrow u$ and it's obvious that $\displaystyle x_n= \sum_{i=0}^{\infty} \ {<x_n,e_i>e_i}$ (actually, all but finitely many terms are zero for each $\displaystyle x_n$).

Remember that in a normed space $\displaystyle T$, we have that $\displaystyle T$ is complete iff every absolutely convergent series is convergent. Now since $\displaystyle H$ is complete we have that $\displaystyle u_1= \sum_{i=0}^{\infty} \ {<u,e_i>e_i}$ converges. Now it suffices to prove that this series converges to $\displaystyle u$.

$\displaystyle \Vert x_n - u_1 \Vert ^2 = \Vert \sum_{i=0}^{\infty} \ {<x_n,e_i>e_i} - \sum_{i=0}^{\infty} \ {<u,e_i>e_i} \Vert ^2$

$\displaystyle = \Vert \sum_{i=0}^{\infty} \ {<x_n -u,e_i>e_i} \Vert ^2$

$\displaystyle \leq \sum_{i=0}^{\infty} \ {\vert <x_n -u,e_i> \vert ^2}$

$\displaystyle \leq \Vert x_n - u \Vert ^2 \longrightarrow 0$
And so $\displaystyle x_n \longrightarrow u_1$ but since the limit is unique $\displaystyle u_1=u$. If $\displaystyle B$ is a Hilbert basis the every $\displaystyle u$ is in $\displaystyle \overline{linB}$ and we're finished.

Okay, I think I got it right this time, but be wary anyway, who knows...