Skip to main content

Section 8.6 Power Series

We have noted in our work with Taylor polynomials and Taylor series that polynomial functions are the simplest possible functions in mathematics, in part because they require only addition and multiplication to evaluate. From the point of view of calculus, polynomials are especially nice: we can easily differentiate or integrate any polynomial. In light of our work in Section 8.5, we now know that several important non-polynomials have polynomial-like expansions. For example, for any real number \(x\text{,}\)

\begin{equation*} e^x = 1 + x + \frac{x^2}{2!} + \frac{x^3}{3!} + \cdots + \frac{x^n}{n!} + \cdots\text{.} \end{equation*}

There are two settings where other series like the one for \(e^x\) arise: we may be given an expression such as

\begin{equation*} 1 + 2x + 3x^2 + 4x^3 + \cdots \end{equation*}

and we seek the values of \(x\) for which the expression makes sense. Or we may be trying to find an unknown function \(f\) that has expression

\begin{equation*} f(x) = a_0 + a_1 x + a_2 x^2 + \cdots + a_k x^k + \cdots\text{,} \end{equation*}

and we try to determine the values of the constants \(a_0\text{,}\) \(a_1\text{,}\) \(\ldots\text{.}\) The latter situation is explored in Preview Activity 8.6.1.

Preview Activity 8.6.1.

In Chapter 7, we learned some of the many important applications of differential equations, and learned some approaches to solve or analyze them. Here, we consider an important approach that will allow us to solve a wider variety of differential equations.

Let's consider the familiar differential equation from exponential population growth given by

\begin{equation} y' = ky\text{,}\label{pmR}\tag{8.6.1} \end{equation}

where \(k\) is the constant of proportionality. While we can solve this differential equation using methods we have already learned, we take a different approach now that can be applied to a much larger set of differential equations. For the rest of this activity, let's assume that \(k=1\text{.}\) We will use our knowledge of Taylor series to find a solution to the differential equation (8.6.1).

To do so, we assume that we have a solution \(y=f(x)\) and that \(f(x)\) has a Taylor series that can be written in the form

\begin{equation*} y = f(x) = \sum_{k=0}^{\infty} a_kx^k\text{,} \end{equation*}

where the coefficients \(a_k\) are undetermined. Our task is to find the coefficients.

  1. Assume that we can differentiate a power series term by term. By taking the derivative of \(f(x)\) with respect to \(x\) and substituting the result into the differential equation (8.6.1), show that the equation

    \begin{equation*} \sum_{k=1}^{\infty} ka_kx^{k-1} = \sum_{k=0}^{\infty} a_kx^{k} \end{equation*}

    must be satisfied in order for \(f(x) = \sum_{k=0}^{\infty} a_kx^k\) to be a solution of the DE.

  2. Two series are equal if and only if they have the same coefficients on like power terms. Use this fact to find a relationship between \(a_1\) and \(a_0\text{.}\)

  3. Now write \(a_2\) in terms of \(a_1\text{.}\) Then write \(a_2\) in terms of \(a_0\text{.}\)

  4. Write \(a_3\) in terms of \(a_2\text{.}\) Then write \(a_3\) in terms of \(a_0\text{.}\)

  5. Write \(a_4\) in terms of \(a_3\text{.}\) Then write \(a_4\) in terms of \(a_0\text{.}\)

  6. Observe that there is a pattern in (b)-(e). Find a general formula for \(a_k\) in terms of \(a_0\text{.}\)

  7. Write the series expansion for \(y\) using only the unknown coefficient \(a_0\text{.}\) From this, determine what familiar functions satisfy the differential equation (8.6.1). (Hint: Compare to a familiar Taylor series.)

Solution
  1. Differentiation term by term gives

    \begin{equation*} y' = \sum_{k=1}^{\infty} ka_kx_{k-1}\text{.} \end{equation*}

    We then substitute this series into the differential equation (8.6.1) to obtain the equation

  2. When we write the first few terms of the series on either side of our differential equation we obtain

    \begin{align*} \amp a_1 + (2)a_2x + (3)a_3x^2 + (4)a_4x^3 + \cdots + (k+1)a_{k+1}x^{k} + \cdots\\ \amp= a_0 + a_1x + a_2x^2 + \cdots + a_kx^k + \cdots\text{.} \end{align*}

    Equating the constant terms gives us \(a_1 = a_0\text{.}\)

  3. Equating the degree 1 terms gives us \(2a_2 = a_1\) or \(a_2 = \frac{a_1}{2}\text{.}\) Since \(a_1 = a_0\text{,}\) we have \(a_2 = \frac{a_0}{2}\text{.}\)

  4. Equating the degree 2 terms gives us \(3a_3 = a_2\) or \(a_3 = \frac{a_2}{3}\text{.}\) Since \(a_2 = \frac{a_0}{2}\text{,}\) we have \(a_3 = \frac{a_0}{3!}\text{.}\)

  5. Equating the degree 3 terms gives us \(4a_4 = a_3\) or \(a_4 = \frac{a_3}{4}\text{.}\) Since \(a_3 = \frac{a_0}{3!}\text{,}\) we have \(a_4 = \frac{a_0}{4!}\text{.}\)

  6. Equating the degree \(k-1\) terms gives us \(ka_k = a_{k-1}\) or \(a_k = \frac{a_{k-1}}{k}\text{.}\) It appears that \(a_{k-1} = \frac{a_0}{(k-1)!}\text{,}\) so we have

    \begin{equation*} a_k = \frac{a_0}{k!}\text{.} \end{equation*}
  7. Since \(a_k = \frac{a_0}{k!}\) we have

    \begin{equation*} y = a_0 \sum_{k=0}^{\infty} \frac{x^k}{k!}\text{.} \end{equation*}

    So the functions that satisfy the differential equation (8.6.1) are the exponential functions of the form \(y = a_0e^x\text{.}\)

Subsection 8.6.1 Power Series

As Preview Activity 8.6.1 shows, it can be useful to treat an unknown function as if it has a Taylor series, and then determine the coefficients from other information. In other words, we define a function as an infinite series of powers of \(x\) and then determine the coefficients based on something besides a formula for the function. This method allows us to approximate solutions to many different types of differential equations, even if we cannot solve them explicitly. This is different from our work with Taylor series since we are not using an original function \(f\) to generate the coefficients of the series.

Definition 8.6.1.

A power series centered at \(x = a\) is a function of the form

\begin{equation} \sum_{k=0}^{\infty} c_k(x-a)^k\label{ttu}\tag{8.6.2} \end{equation}

where \(\{c_k\}\) is a sequence of real numbers and \(x\) is an independent variable.

A power series defines a function \(f\) whose domain is the set of \(x\) values for which the power series converges. We therefore write

\begin{equation*} f(x) = \sum_{k=0}^{\infty} c_k(x-a)^k\text{.} \end{equation*}

It turns out that 1 , on its interval of convergence, every power series is in fact the Taylor series of the function it defines, so all of the techniques we developed in the previous section can be applied to power series as well.

See Exercise 8.6.4.4 in this section.

Consider the power series defined by

\begin{equation*} f(x) = \sum_{k=0}^{\infty} \frac{x^k}{2^k}\text{.} \end{equation*}

What are \(f(1)\) and \(f\left(\frac{3}{2}\right)\text{?}\) Find a general formula for \(f(x)\) and determine the values for which this power series converges.

Solution

If we evaluate \(f\) at \(x=1\) we obtain the series

\begin{equation*} \sum_{k=0}^{\infty} \frac{1}{2^k} \end{equation*}

which is a geometric series with ratio \(\frac{1}{2}\text{.}\) So we can sum this series and find that

\begin{equation*} f(1) = \frac{1}{1-\frac{1}{2}} = 2\text{.} \end{equation*}

Similarly,

\begin{equation*} f(3/2) = \sum_{k=0}^{\infty} \left(\frac{3}{4}\right)^k = \frac{1}{1-\frac{3}{4}} = 4\text{.} \end{equation*}

In general, \(f(x)\) is a geometric series with ratio \(\frac{x}{2}\text{,}\) so

\begin{equation*} f(x) = \sum_{k=0}^{\infty} \left(\frac{x}{2}\right)^k = \frac{1}{1-\frac{x}{2}} = \frac{2}{2-x} \end{equation*}

provided that \(-1 \lt \frac{x}{2} \lt 1\) (which ensures that the ratio is less than 1 in absolute value). Thus, the power series that defines \(f(x)=\frac{2}{2-x}\) converges for \(-2 \lt x \lt 2\text{.}\)

As we did for Taylor series, we define the interval of convergence of a power series (8.6.2) to be the set of values of \(x\) for which the series converges. And as we did with Taylor series, we typically use the Ratio Test to find the values of \(x\) for which the power series converges absolutely, and then check the endpoints separately if the radius of convergence is finite.

Let \(f(x) = \sum_{k=1}^{\infty} \frac{x^k}{k^2}\text{.}\) Determine the interval of convergence of this power series.

Solution

First we will plot some of the partial sums of this power series to get an idea of the interval of convergence. Let

\begin{equation*} S_n(x) = \sum_{k=1}^{n} \frac{x^k}{k^2} \end{equation*}

for each \(n \geq 1\text{.}\) Figure 8.6.4 shows plots of \(S_{10}(x)\) (in red), \(S_{25}(x)\) (in blue), and \(S_{50}(x)\) (in green).

Figure 8.6.4. Graphs of some partial sums of the power series \(\sum_{k=1}^{\infty} \frac{x^k}{k^2}\text{.}\)

The behavior of \(S_{50}\) in particular suggests that \(f(x)\) appears to be converging to a particular curve on the interval \((-1,1)\text{,}\) while growing without bound outside of that interval. Thus, the interval of convergence might be \(-1 \lt x \lt 1\text{.}\) To verify our conjecture, we apply the Ratio Test. Now,

\begin{equation*} a_k = \frac{x^k}{k^2}\text{,} \end{equation*}

so

\begin{align*} \lim_{k \to \infty} \frac{\left| a_{k+1} \right|}{ \left| a_k \right|} \amp = \lim_{k \to \infty} \frac{ \frac{|x|^{k+1}}{(k+1)^2} }{ \frac{| x|^{k}}{k^2} }\\ \amp = \lim_{k \to \infty} |x| \left(\frac{k}{k+1}\right)^2\\ \amp = |x| \lim_{k \to \infty} \left(\frac{k}{k+1}\right)^2\\ \amp = |x|\text{.} \end{align*}

Therefore, the Ratio Test tells us that \(f(x)\) converges absolutely when \(| x | \lt 1\) and diverges when \(| x | \gt 1\text{.}\) Because the Ratio Test is inconclusive when \(|x| = 1\text{,}\) we need to check \(x = 1\) and \(x = -1\) individually.

When \(x = 1\text{,}\) observe that

\begin{equation*} f(1) = \sum_{k=1}^{\infty} \frac{1}{k^2}\text{.} \end{equation*}

This is a \(p\)-series with \(p \gt 1\text{,}\) which we know converges. When \(x = -1\text{,}\) we have

\begin{equation*} f(-1) = \sum_{k=1}^{\infty} \frac{(-1)^k}{k^2}\text{.} \end{equation*}

This is an alternating series, and since the sequence \(\left\{ \frac{1}{n^2} \right\}\) decreases to 0, the power series converges by the Alternating Series Test. Thus, the interval of convergence of this power series is \(-1 \le x \le 1\text{.}\)

Activity 8.6.2.

Determine the interval of convergence of each power series.

  1. \(\sum_{k=1}^{\infty} \frac{(x-1)^k}{3k}\)

  2. \(\sum_{k=1}^{\infty} kx^k\)

  3. \(\sum_{k=1}^{\infty} \frac{k^2(x+1)^k}{4^k}\)

  4. \(\sum_{k=1}^{\infty} \frac{x^k}{(2k)!}\)

  5. \(\sum_{k=1}^{\infty} k!x^k\)

Hint
  1. Small hints for each of the prompts above.

Answer
  1. \([0,2)\text{.}\)

  2. \((-1,1)\text{.}\)

  3. \((-5,3)\text{.}\)

  4. \((-\infty, \infty)\text{.}\)

  5. \(\{0\}\text{.}\)

Solution
  1. We use the Ratio Test with \(a_k = \frac{|x-1|^k}{3k}\text{:}\)

    \begin{align*} \lim_{k \to \infty} \frac{ \frac{|x-1|^{k+1}}{3(k+1)} }{ \frac{|x-1|^k}{3k} } \amp = \lim_{k \to \infty} \frac{3k|x-1|^{k+1}}{3( k+1)|x-1|^{k}}\\ \amp = |x-1| \lim_{k \to \infty} \frac{k}{k+1}\\ \amp = |x-1|\text{.} \end{align*}

    So the power series \(\sum_{k=1}^{\infty} \frac{(x-1)^k}{3k}\) converges absolutely when \(|x-1| \lt 1\) or when \(0 \lt x \lt 2\) and diverges outside this interval. To completely determine the interval of convergence, we need to check what happens at the endpoints of this interval.

    • When \(x=0\) our power series is \(\sum_{k=1}^{\infty} \frac{(-1)^k}{3k}\) which is just a scalar multiple of the alternating harmonic series and so converges.

    • When \(x=2\) our power series is \(\sum_{k=1}^{\infty} \frac{1}{3k}\) which is just a scalar multiple of the harmonic series and so diverges.

    Therefore, the interval of convergence of the power series \(\sum_{k=1}^{\infty} \frac{(x-1)^k}{3k}\) is \([0,2)\text{.}\)

  2. We use the Ratio Test with \(a_k = k|x|^k\text{:}\)

    \begin{align*} \lim_{k \to \infty} \frac{ (k+1)|x|^{k+1} }{ k|x|^k } \amp = |x|\lim_{k \to \infty} \frac{k+1}{k}\\ \amp = |x|\text{.} \end{align*}

    So the power series \(\sum_{k=1}^{\infty} kx^k\) converges absolutely when \(|x| \lt 1\) or when \(-1 \lt x \lt 1\) and diverges outside this interval. To completely determine the interval of convergence, we need to check what happens at the endpoints of this interval.

    • When \(x=-1\) our power series is \(\sum_{k=1}^{\infty} (-1)^k k\text{.}\) Since \(k \to \infty\) as \(k \to infty\text{,}\) this series diverges by the Divergence Test.

    • When \(x=1\) our power series is \(\sum_{k=1}^{\infty} k\) which again diverges by the Divergence Test.

    Therefore, the interval of convergence of the power series \(\sum_{k=1}^{\infty} kx^k\) is \((-1,1)\text{.}\)

  3. We use the Ratio Test with \(a_k = \frac{k^2|x+1|^k}{4^k}\text{:}\)

    \begin{align*} \lim_{k \to \infty} \frac{ \frac{(k+1)^2|x+1|^{k+1}}{4^{k+1}} }{ \frac{k^2|x+1|^k}{4^k} } \amp = \lim_{k \to \infty} \frac{4^k(k+1)^2|x+1|^{k+1}}{4^{k+1}k^2|x+1|^k}\\ \amp = \frac{1}{4}|x+1| \lim_{k \to \infty} \left(\frac{k+1}{k}\right)^2\\ \amp = \frac{1}{4}|x+1|\text{.} \end{align*}

    So the power series \(\sum_{k=1}^{\infty} \frac{k^2(x+1)^k}{4^k}\) converges absolutely when \(\frac{1}{4}|x+1| \lt 1\) or when \(-5 \lt x \lt 3\) and diverges outside this interval. To completely determine the interval of convergence, we need to check what happens at the endpoints of this interval.

    • When \(x=-5\) our power series is \(\sum_{k=1}^{\infty} (-1)^k k^2\text{.}\) Since \(k^2 \to \infty\) as \(k \to \infty\text{,}\) this series diverges by the Divergence Test.

    • When \(x=3\) our power series is \(\sum_{k=1}^{\infty} k^2\text{,}\) which again diverges by the Divergence Test.

    Therefore, the interval of convergence of the power series \(\sum_{k=1}^{\infty} \frac{k^2(x+1)^k}{4^k}\) is \((-5,3)\text{.}\)

  4. We use the Ratio Test with \(a_k = \frac{|x|^k}{(2k)!}\text{:}\)

    \begin{align*} \lim_{k \to \infty} \frac{ \frac{|x|^{k+1}}{(2(k+1))!} }{ \frac{|x|^k}{(2k)!} } \amp = \lim_{k \to \infty} |x|\frac{(2k)!}{(2(k+1))!}\\ \amp = |x| \lim_{k \to \infty} \frac{1}{(2k+2)(2k+1)}\\ \amp = 0\text{.} \end{align*}

    So the power series \(\sum_{k=1}^{\infty} \frac{x^k}{(2k)!}\) converges absolutely on the interval \((-\infty, \infty)\text{.}\)

  5. We use the Ratio Test with \(a_k = k!|x|^k\text{:}\)

    \begin{align*} \lim_{k \to \infty} \frac{ (k+1)!|x|^{k+1} }{ k!|x|^k} \amp = \lim_{k \to \infty} |x|(k+1)\\ \amp = \infty \end{align*}

    unless \(x=0\text{.}\) So the interval of convergence of the power series \(\sum_{k=1}^{\infty} \frac{x^k}{k!}\) is \(\{0\}\text{.}\)

Subsection 8.6.2 Manipulating Power Series

We know power series expansions for important functions such as \(\sin(x)\) and \(e^x\text{.}\) Often, we can use a known power series expansion to find a power series for a different, but related, function. The next activity demonstrates one way to do this.

Activity 8.6.3.

Our goal in this activity is to find a power series expansion for \(f(x) = \frac{1}{1+x^2}\) centered at \(x=0\text{.}\)

While we could use the methods of Section 8.5 and differentiate \(f(x) = \frac{1}{1+x^2}\) several times to look for patterns and find the Taylor series for \(f(x)\text{,}\) we seek an alternate approach because of how complicated the derivatives of \(f(x)\) quickly become.

  1. What is the Taylor series expansion for \(g(x) = \frac{1}{1-x}\text{?}\) What is the interval of convergence of this series?

  2. How is \(g(-x^2)\) related to \(f(x)\text{?}\) Explain, and hence substitute \(-x^2\) for \(x\) in the power series expansion for \(g(x)\text{.}\) Given the relationship between \(g(-x^2)\) and \(f(x)\text{,}\) how is the resulting series related to \(f(x)\text{?}\)

  3. For which values of \(x\) will this power series expansion for \(f(x)\) be valid? Why?

Hint
  1. Small hints for each of the prompts above.

Answer
  1. \(\frac{1}{1-x} = \sum_{k=0}^{\infty} x^k\) for \(-1 \lt x \lt 1\text{.}\)

  2. \(f(x) = g(-x^2) = \sum_{k=0}^{\infty} (-1)^k x^{2k}\text{.}\)

  3. \(-1 \lt x \lt 1\text{.}\)

Solution
  1. Recall that

    \begin{equation*} g(x) = \frac{1}{1-x} = \sum_{k=0}^{\infty} x^k \end{equation*}

    for \(-1 \lt x \lt 1\text{.}\)

  2. Substituting \(-x^2\) for \(x\) in the power series expansion for \(g(x)\) gives

    \begin{align*} f(x) \amp = g(-x^2)\\ \amp = \frac{1}{1-(-x^2)}\\ \amp = \sum_{k=0}^{\infty} \left(-x^2\right)^k\\ \amp = \sum_{k=0}^{\infty} (-1)^k x^{2k}\text{.} \end{align*}
  3. This power series expansion for \(f(x)\) will be valid as long as \(-1 \lt (-x)^2 \lt 1\) or for \(-1 \lt x \lt 1\text{.}\)

In a previous section we found several important Maclaurin series and their intervals of convergence. Here, we list these key functions and their corresponding expansions.

\begin{align*} \sin(x) \amp =\sum_{k=0}^{\infty} \frac{(-1)^k x^{2k+1}}{(2k+1)!}\amp\text{for}\amp-\infty \lt x \lt \infty\\ \cos(x) \amp =\sum_{k=0}^{\infty} \frac{(-1)^k x^{2k}}{(2k)!}\amp\text{for}\amp-\infty \lt x \lt \infty\\ e^x \amp =\sum_{k=0}^{\infty} \frac{x^{k}}{k!}\amp\text{for}\amp-\infty \lt x \lt \infty\\ \frac{1}{1-x} \amp =\sum_{k=0}^{\infty} x^k\amp\text{for}\amp-1 \lt x \lt 1 \end{align*}

As we saw in Activity 8.6.3, we can use these known series to find other power series expansions for related functions such as \(\sin(x^2)\text{,}\) \(e^{5x^3}\text{,}\) and \(\cos(x^5)\text{.}\)

Activity 8.6.4.

Let \(f\) be the function given by the power series expansion

\begin{equation*} f(x) = \sum_{k=0}^{\infty} (-1)^k \frac{x^{2k}}{(2k)!}\text{.} \end{equation*}
  1. Assume that we can differentiate a power series term by term, just like we can differentiate a (finite) polynomial. Use the fact that

    \begin{equation*} f(x) = 1 - \frac{x^2}{2!} + \frac{x^4}{4!} - \frac{x^6}{6!} + \cdots + (-1)^k \frac{x^{2k}}{(2k)!} + \cdots \end{equation*}

    to find a power series expansion for \(f'(x)\text{.}\)

  2. Observe that \(f(x)\) and \(f'(x)\) have familiar Taylor series. What familiar functions are these? What known relationship does our work demonstrate?

  3. What is the series expansion for \(f''(x)\text{?}\) What familiar function is \(f''(x)\text{?}\)

Hint
  1. Small hints for each of the prompts above.

Answer
  1. \(f'(x) = - x + \frac{x^3}{3!} - \frac{x^5}{5!} + \cdots + (-1)^k \frac{x^{k-1}}{(k-1)!} + \cdots \text{.}\)

  2. \(\frac{d}{dx} \cos(x) = -\sin(x) \text{.}\)

  3. \(f''(x) = - 1 + \frac{x^2}{2!} - \frac{x^4}{4!} + \cdots \text{.}\)

Solution
  1. Note that

    \begin{equation*} f'(x) = - x + \frac{x^3}{3!} - \frac{x^5}{5!} + \cdots + (-1)^k \frac{x^{k-1}}{(k-1)!} + \cdots\text{.} \end{equation*}
  2. We recognize \(f(x)\) as \(\cos(x)\) and \(f'(x)\) as \(-\sin(x)\text{.}\) This gives the known differentiation formula

    \begin{equation*} \frac{d}{dx} \cos(x) = -\sin(x)\text{.} \end{equation*}
  3. We see that

    \begin{equation*} f''(x) = - 1 + \frac{x^2}{2!} - \frac{x^4}{4!} + \cdots\text{,} \end{equation*}

    which is the series expansion for \(-\cos(x)\) as expected

Our work in Activity 8.6.3 holds more generally. The corresponding theorem, which we will not prove, states that we can differentiate a power series for a function \(f\) term by term and obtain the series expansion for \(f'\text{,}\) and similarly we can integrate a series expansion for a function \(f\) term by term and obtain the series expansion for \(\int f(x) \ dx\text{.}\) For both, the radius of convergence of the resulting series is the same as the original, though it is possible that the convergence status of the various series may differ at the endpoints. The formal statement of the Power Series Differentiation and Integration Theorem follows.

Power Series Differentiation and Integration Theorem.

Suppose \(f(x)\) has a power series expansion

\begin{equation*} f(x) = \sum_{k=0}^{\infty} c_kx^k \end{equation*}

and that the series converges absolutely to \(f(x)\) on the interval \(-r \lt x \lt r\text{.}\) Then, the power series \(\sum_{k=1}^{\infty} kc_kx^{k-1}\) obtained by differentiating the power series for \(f(x)\) term by term converges absolutely to \(f'(x)\) on the interval \(-r \lt x \lt r\text{.}\) That is,

\begin{equation*} f'(x) = \sum_{k=1}^{\infty} kc_kx^{k-1}, \ \text{for} \ |x| \lt r\text{.} \end{equation*}

Similarly, the power series \(\sum_{k=0}^{\infty} c_k\frac{x^{k+1}}{k+1}\) obtained by integrating the power series for \(f(x)\) term by term converges absolutely on the interval \(-r \lt x \lt r\text{,}\) and

\begin{equation*} \int f(x) \ dx = \sum_{k=0}^{\infty} c_k\frac{x^{k+1}}{k+1} + C, \ \text{for} \ |x| \lt r\text{.} \end{equation*}

This theorem validates the steps we took in Activity 8.6.4. It tells us that we can differentiate and integrate term by term on the interior of the interval of convergence, but it does not tell us what happens at the endpoints of this interval. We always need to check what happens at the endpoints separately. More importantly, we can use use the approach of differentiating or integrating a series term by term to find new series.

Find a series expansion centered at \(x = 0\) for \(\arctan(x)\text{,}\) as well as its interval of convergence.

Solution

While we could differentiate \(\arctan(x)\) repeatedly and look for patterns in the derivative values at \(x = 0\) in an attempt to find the Maclaurin series for \(\arctan(x)\) from the definition, it turns out to be far easier to use a known series in an insightful way. In Activity 8.6.3, we found that

\begin{equation*} \frac{1}{1+x^2} = \sum_{k=0}^{\infty} (-1)^k x^{2k} \end{equation*}

for \(-1 \lt x \lt 1\text{.}\) Recall that

\begin{equation*} \frac{d}{dx} \left[ \arctan(x) \right] = \frac{1}{1+x^2}\text{,} \end{equation*}

and therefore

\begin{equation*} \int \frac{1}{1+x^2} \ dx = \arctan(x) + C\text{.} \end{equation*}

It follows that we can integrate the series for \(\frac{1}{1+x^2}\) term by term to obtain the power series expansion for \(\arctan(x)\text{.}\) Doing so, we find that

\begin{align*} \arctan(x) \amp = \int \left( \sum_{k=0}^{\infty} (-1)^kx^{2k} \right) \ dx\\ \amp = \sum_{k=0}^{\infty} \left( \int (-1)^k x^{2k} \ dx \right)\\ \amp = \left( \sum_{k=0}^{\infty} (-1)^k\frac{x^{2k+1}}{2k+1} \right) + C\text{.} \end{align*}

The Power Series Differentiation and Integration Theorem tells us that this equality is valid for at least \(-1 \lt x \lt 1\text{.}\)

To find the value of the constant \(C\text{,}\) we can use the fact that \(\arctan(0) = 0\text{.}\) So

\begin{equation*} 0 = \arctan(0) = \left( \sum_{k=0}^{\infty} (-1)^k\frac{0^{2k+1}}{2k+1} \right) + C = C\text{,} \end{equation*}

and we must have \(C = 0\text{.}\) Therefore,

\begin{equation} \arctan(x) = \sum_{k=0}^{\infty} (-1)^k\frac{x^{2k+1}}{2k+1}\label{Yvk}\tag{8.6.3} \end{equation}

for at least \(-1 \lt x \lt 1\text{.}\)

It is a straightforward exercise to check that the power series

\begin{equation*} \sum_{k=0}^{\infty} (-1)^k\frac{x^{2k+1}}{2k+1} \end{equation*}

converges both when \(x = -1\) and when \(x = 1\text{;}\) in each case, we have an alternating series with terms \(\frac{1}{2k+1}\) that decrease to \(0\text{,}\) and thus the interval of convergence for the series expansion for \(\arctan(x)\) in Equation (8.6.3) is \(-1 \le x \le 1\text{.}\)

Activity 8.6.5.

Find a power series expansion for \(\ln(1+x)\) centered at \(x=0\) and determine its interval of convergence.

Hint

Use the Taylor series expansion for \(\frac{1}{1+x}\) centered at \(x=0\text{.}\)

Answer

\(\ln(1+x) = \sum_{k=0}^{\infty} (-1)^k \frac{x^{k+1}}{k+1} \text{.}\) for \(-1 \lt x \lt 1\text{.}\)

Solution

Using the Taylor series

\begin{equation*} \frac{1}{1-x} = \sum_{k=0}^{\infty} x^k \end{equation*}

for \(-1 \lt x \lt 1\) we have that

\begin{equation*} \frac{1}{1+x} = \sum_{k=0}^{\infty} (-1)^k x^k\text{.} \end{equation*}

Integrating the left and right sides of this last equation gives us

\begin{equation*} \ln(1+x) = \sum_{k=0}^{\infty} (-1)^k \frac{x^{k+1}}{k+1} + C \end{equation*}

for \(-1 \lt x \lt 1\text{.}\) Since \(\ln(1) = 0\) we have that

\begin{equation*} 0 = \sum_{k=0}^{\infty} (-1)^k \frac{0^{k+1}}{k+1} + C \end{equation*}

and so \(C = 0\text{.}\) We conclude that

\begin{equation*} \ln(1+x) = \sum_{k=0}^{\infty} (-1)^k \frac{x^{k+1}}{k+1}\text{.} \end{equation*}

for \(-1 \lt x \lt 1\text{.}\)

Subsection 8.6.3 Summary

  • A power series is a series of the form

    \begin{equation*} \sum_{k=0}^{\infty} a_kx^k\text{.} \end{equation*}
  • We can often assume a solution to a given problem can be written as a power series, then use the information in the problem to determine the coefficients in the power series. This method allows us to approximate solutions to certain problems using partial sums of the power series; that is, we can find approximate solutions that are polynomials.

  • The connection between power series and Taylor series is that they are essentially the same thing: on its interval of convergence a power series is the Taylor series of its sum.

Exercises 8.6.4 Exercises

1. Finding coefficients in a power series expansion of a rational function.
2. Finding coefficients in a power series expansion of a function involving \(\arctan(x)\).
3.

We can use power series to approximate definite integrals to which known techniques of integration do not apply. We will illustrate this in this exercise with the definite integral \(\int_0^1 \sin(x^2) \,ds\text{.}\)

  1. Use the Taylor series for \(\sin(x)\) to find the Taylor series for \(\sin(x^2)\text{.}\) What is the interval of convergence for the Taylor series for \(\sin(x^2)\text{?}\) Explain.

  2. Integrate the Taylor series for \(\sin(x^2)\) term by term to obtain a power series expansion for \(\int \sin(x^2)\,dx\text{.}\)

  3. Use the result from part (b) to explain how to evaluate \(\int_0^1 \sin(x^2) \ dx\text{.}\) Determine the number of terms you will need to approximate \(\int_0^1 \sin(x^2) \,dx\) to 3 decimal places.

Answer
  1. \(\sin(x^2) = \sum_{k=0}^{\infty} (-1)^k\frac{x^{2(2k+1)}}{(2k+1)!} \text{,}\) with interval of convergence \((-\infty, \infty)\text{.}\)

  2. \(\int \sin(x^2) \, dx = \sum_{k=0}^{\infty} (-1)^k\frac{x^{4k+3}}{(2k+1)!(4k+3)} + C \text{.}\)

  3. \(\int_0^1 \sin(x^2) \, dx = \sum_{k=0}^{\infty} (-1)^k\frac{1}{(2k+1)!(4k+3)} \text{.}\) Use \(n = 1\) to generate the desired estimate.

Solution
  1. The Taylor series expansion for \(\sin(x)\) centered at \(x=0\) is

    \begin{equation*} \sin(x) = \sum_{k=0}^{\infty} (-1)^k\frac{x^{2k+1}}{(2k+1)!}\text{.} \end{equation*}

    Substituting \(x^2\) for \(x\) gives us

    \begin{equation*} \sin(x^2) = \sum_{k=0}^{\infty} (-1)^k\frac{x^{2(2k+1)}}{(2k+1)!}\text{,} \end{equation*}

    as the Taylor series for \(\sin(x^2)\) centered at \(x=0\text{.}\) Since the interval of convergence for the Taylor series for \(\sin(x)\) is \((-\infty, \infty)\text{,}\) it follows that the interval of convergence of the Taylor series for \(\sin(x^2)\) is also \((-\infty, \infty)\text{.}\)

  2. We can integrate a Taylor series term by term on its interval of convergence, so

    \begin{align*} \int \sin(x^2) \, dx &= \int \sum_{k=0}^{\infty} (-1)^k\frac{x^{2(2k+1)}}{(2k+1)!} \, dx\\ &= \sum_{k=0}^{\infty} \int (-1)^k\frac{x^{2(2k+1)}}{(2k+1)!} \, dx\\ &= \sum_{k=0}^{\infty} \int (-1)^k\frac{x^{4k+2}}{(2k+1)!} \, dx\\ &= \sum_{k=0}^{\infty} (-1)^k\frac{x^{4k+3}}{(2k+1)!(4k+3)} + C\text{.} \end{align*}
  3. To evaluate \(\int_0^1 \sin(x^2) \ dx\text{,}\) we evaluate the antiderivative \(\sum_{k=0}^{\infty} (-1)^k\frac{x^{4k+3}}{(2k+1)!(4k+2)}\) at \(1\) and \(0\) and subtract. So

    \begin{align*} \int_0^1 \sin(x^2) \, dx &= \left. \sum_{k=0}^{\infty} (-1)^k\frac{x^{4k+3}}{(2k+1)!(4k+3)}\right|_{0}^{1}\\ &= \sum_{k=0}^{\infty} (-1)^k\frac{1}{(2k+1)!(4k+3)}\text{.} \end{align*}

    The resulting series is an alternating series, so we can find a value of \(n\) that makes the \(n\)th partial sum of the series approximate the sum of the series to \(3\) decimal places by determining a value of \(n\) such that

    \begin{equation*} a_{n+1} = \frac{1}{(2(n+1)+1)!(4(n+1)+3)} \lt 0.001\text{.} \end{equation*}

    This is not an inequality that we can solve algebraically, so we use trial and error. Doing so shows that \(n = 1\) will work.

4.

There is an important connection between power series and Taylor series. Suppose \(f\) is defined by a power series centered at 0 so that

\begin{equation*} f(x) = \sum_{k=0}^{\infty} a_kx^k\text{.} \end{equation*}
  1. Determine the first 4 derivatives of \(f\) evaluated at 0 in terms of the coefficients \(a_k\text{.}\)

  2. Show that \(f^{(n)}(0) = n!a_n\) for each positive integer \(n\text{.}\)

  3. Explain how the result of (b) tells us the following:

    On its interval of convergence, a power series is the Taylor series of its sum.

Answer
  1. Then

    \begin{align*} f'(x) \amp = \sum_{k=1}^{\infty} ka_kx^{k-1}\\ f''(x) \amp = \sum_{k=2}^{\infty} k(k-1)a_kx^{k-2}\\ f^{(3)}(x) \amp = \sum_{k=3}^{\infty} k(k-1)(k-2)a_kx^{k-3}\\ \vdots \amp \ \qquad \vdots\\ f^{(n)}(x) \amp = \sum_{k=n}^{\infty} k(k-1)(k-2) \cdots (k-n+1) a_kx^{k-n}\\ \vdots \amp \ \qquad \vdots \end{align*}

    So

    \begin{align*} f(0) \amp = a_0\\ f'(0) \amp = a_1\\ f''(0) \amp = 2!a_2\\ f^{(3)}(0) \amp = 3!a_3\\ \vdots \amp \ \qquad \vdots\\ f^{(k)}(0) \amp = k!a_k\\ \vdots \amp \ \qquad \vdots \end{align*}

    and

    \begin{equation*} a_k = \frac{f^{(k)}(0)}{k!} \end{equation*}

    for each \(k \geq 0\text{.}\) But these are just the coefficients of the Taylor series expansion of \(f\text{,}\) which leads us to the following observation.

Solution
  1. Observe that

    \begin{align*} f'(x) \amp = \sum_{k=1}^{\infty} ka_kx^{k-1}\\ f''(x) \amp = \sum_{k=2}^{\infty} k(k-1)a_kx^{k-2}\\ f^{(3)}(x) \amp = \sum_{k=3}^{\infty} k(k-1)(k-2)a_kx^{k-3}\\ f^{(4)}(x) \amp = \sum_{k=4}^{\infty} k(k-1)(k-2)(k-3)a_kx^{k-4} \end{align*}

    and therefore

    \begin{align*} f(0) \amp = a_0\\ f'(0) \amp = a_1\\ f''(0) \amp = 2!a_2\\ f^{(3)}(0) \amp = 3!a_3\\ f^{(4)}(0) \amp = 4!a_4\text{.} \end{align*}
  2. Since

    \begin{equation*} f^{(n)}(x) = \sum_{k=n}^{\infty} k(k-1)(k-2) \cdots (k-n+1) a_kx^{k-n} \end{equation*}

    every term of this series vanishes at \(x = 0\) except the first. Thus it follows \(f^{(n)}(0) = n(n-1)(n-2) \cdots (1) a_n\text{,}\) so \(f^{(n)}(0) = n! a_n\text{.}\)

  3. Since \(a_k = \frac{f^{(k)}(0)}{k!}\) for each \(k \geq 0\text{,}\) we see that these are just the coefficients of the Taylor series expansion of \(f\text{,}\) and thus we get the unsurprising result that the coefficients of a power series are identical to the Taylor series of the power series.

5.

In this exercise we will begin with a strange power series and then find its sum. The Fibonacci sequence \(\{f_n\}\) is a famous sequence whose first few terms are

\begin{equation*} f_0 = 0, f_1 = 1, f_2 = 1, f_3 = 2, f_4 = 3, f_5 = 5, f_6 = 8, f_7 = 13, \cdots\text{,} \end{equation*}

where each term in the sequence after the first two is the sum of the preceding two terms. That is, \(f_0 = 0\text{,}\) \(f_1 = 1\) and for \(n \geq 2\) we have

\begin{equation*} f_n = f_{n-1} + f_{n-2}\text{.} \end{equation*}

Now consider the power series

\begin{equation*} F(x) = \sum_{k=0}^{\infty} f_kx^k\text{.} \end{equation*}

We will determine the sum of this power series in this exercise.

  1. Explain why each of the following is true.

    1. \(xF(x) = \sum_{k=1}^{\infty} f_{k-1}x^k\)

    2. \(x^2F(x) = \sum_{k=2}^{\infty} f_{k-2}x^k\)

  2. Show that

    \begin{equation*} F(x) - xF(x) - x^2F(x) = x\text{.} \end{equation*}
  3. Now use the equation

    \begin{equation*} F(x) - xF(x) - x^2F(x) = x \end{equation*}

    to find a simple form for \(F(x)\) that doesn't involve a sum.

  4. Use a computer algebra system or some other method to calculate the first 8 derivatives of \(\frac{x}{1-x-x^2}\) evaluated at 0. Why shouldn't the results surprise you?

6.

Airy's equation 2 

\begin{equation} y'' - xy = 0\text{,}\label{PgL}\tag{8.6.4} \end{equation}

can be used to model an undamped vibrating spring with spring constant \(x\) (note that \(y\) is an unknown function of \(x\)). So the solution to this differential equation will tell us the behavior of a spring-mass system as the spring ages (like an automobile shock absorber). Assume that a solution \(y=f(x)\) has a Taylor series that can be written in the form

\begin{equation*} y = \sum_{k=0}^{\infty} a_kx^k\text{,} \end{equation*}

where the coefficients are undetermined. Our job is to find the coefficients.

The general differential equations of the form \(y'' \pm k^2xy = 0\) is called Airy's equation. These equations arise in many problems, such as the study of diffraction of light, diffraction of radio waves around an object, aerodynamics, and the buckling of a uniform column under its own weight.
  1. Differentiate the series for \(y\) term by term to find the series for \(y'\text{.}\) Then repeat to find the series for \(y''\text{.}\)

  2. Substitute your results from part (a) into the Airy equation and show that we can write Equation (8.6.4) in the form

    \begin{equation} \sum_{k=2}^{\infty} (k-1)ka_kx^{k-2} - \sum_{k=0}^{\infty} a_kx^{k+1} = 0\text{.}\label{vnU}\tag{8.6.5} \end{equation}
  3. At this point, it would be convenient if we could combine the series on the left in (8.6.5), but one written with terms of the form \(x^{k-2}\) and the other with terms in the form \(x^{k+1}\text{.}\) Explain why

    \begin{equation} \sum_{k=2}^{\infty} (k-1)ka_kx^{k-2} = \sum_{k=0}^{\infty} (k+1)(k+2)a_{k+2}x^{k}\text{.}\label{bvd}\tag{8.6.6} \end{equation}
  4. Now show that

    \begin{equation} \sum_{k=0}^{\infty} a_kx^{k+1} = \sum_{k=1}^{\infty} a_{k-1}x^k\text{.}\label{HCm}\tag{8.6.7} \end{equation}
  5. We can now substitute (8.6.6) and (8.6.7) into (8.6.5) to obtain

    \begin{equation} \sum_{n=0}^{\infty} (n+1)(n+2)a_{n+2}x^{n} - \sum_{n=1}^{\infty} a_{n-1}x^{n} = 0\text{.}\label{nJv}\tag{8.6.8} \end{equation}

    Combine the like powers of \(x\) in the two series to show that our solution must satisfy

    \begin{equation} 2a_2 + \sum_{k=1}^{\infty} \left[(k+1)(k+2)a_{k+2}-a_{k-1} \right] x^{k} = 0\text{.}\label{TQE}\tag{8.6.9} \end{equation}
  6. Use equation (8.6.9) to show the following:

    1. \(a_{3k+2} = 0\) for every positive integer \(k\text{,}\)

    2. \(a_{3k} = \frac{1}{(2)(3)(5)(6) \cdots (3k-1)(3k)} a_0 \text{ for } k \geq 1\text{,}\)

    3. \(a_{3k+1} = \frac{1}{(3)(4)(6)(7) \cdots (3k)(3k+1)} a_1 \text{ for } k \geq 1\text{.}\)

  7. Use the previous part to conclude that the general solution to the Airy equation (8.6.4) is

    \begin{align*} y \amp= a_0\left( 1+\sum_{k=1}^{\infty} \frac{x^{3k}}{(2)(3)(5)(6) \cdots (3k-1)(3k)} \right)\\ \amp\phantom{={}}+ a_1 \left( x + \sum_{k=1}^{\infty} \frac{x^{3k+1}}{(3)(4)(6)(7) \cdots (3k)(3k+1)} \right)\text{.} \end{align*}

    Any values for \(a_0\) and \(a_1\) then determine a specific solution that we can approximate as closely as we like using this series solution.

Answer

The results from the various part of this exercise show that

\begin{align*} y\amp = a_0\left( 1+\sum_{k=1}^{\infty} \frac{x^{3k}}{(2)(3)(5)(6) \cdots (3k-1)(3k)} \right)\\ \amp\phantom{={}}+ a_1 \left( x + \sum_{k=1}^{\infty} \frac{x^{3k+1}}{(3)(4)(6)(7) \cdots (3k)(3k+1)} \right)\text{.} \end{align*}
Solution
  1. \begin{align*} y' \amp = \sum_{k=1}^{\infty} ka_kx^{k-1}\\ y'' \amp = \sum_{k=2}^{\infty} (k-1)na_kx^{k-2}\text{.} \end{align*}
  2. We substitute our series from (a) into the Airy equation to obtain the equation

    \begin{equation*} \sum_{k=2}^{\infty} (k-1)ka_kx^{k-2} + x\sum_{k=0}^{\infty} a_kx^{k} = 0\text{.} \end{equation*}

    Distributing the \(x\) in the second term on the left yields the desired equation.

  3. Note that

    \begin{align*} \amp\sum_{k=2}^{\infty} (k-1)ka_kx_{k-2}\\ \amp = (1)(2)a_2 + (2)(3)a_3x + (3)(4)a_4x^2 + (4)(5)a_5x^3 + \cdots + (k-1)(k)a_{k+2}x^{k-2} + \cdots\\ \amp = (0+1)(0+2)x^0 + (1+1)(1+2)x^1 + (2+1)(2+2)x^2 + \cdots + (k+1)(k+2)x^k + \cdots\text{.} \end{align*}

    In other words, we can re-index this series by increasing every \(k\) by 2, or replacing \(k-2\) with \(k\text{,}\) \(k-1\) with \(k+1\) and \(k\) with \(k+2\text{.}\) This gives us the next desired equation.

  4. As we did in the previous part,

    \begin{align*} \sum_{k=0}^{\infty} a_kx_{k+1} \amp = a_0x + a_1x^2 + a_2x^3 + \cdots + a_kx^{k+1} + \cdots\\ \amp = a_0x + a_1x^2 + a_2x^3 + \cdots + a_{k-1}x^{k} + \cdots\\ \amp = \sum_{k=1}^{\infty} a_{k-1}x^k\text{.} \end{align*}
  5. Notice that we have like powers of \(x\) in the two series, so we can combine them and obtain

    \begin{align*} 0 \amp = \sum_{k=0}^{\infty} (k+1)(k+2)a_{k+2}x^{k} + \sum_{k=1}^{\infty} a_{k-1}x^{k}\\ \amp = \left[(1)(2)a_2 + \sum_{k=1}^{\infty} (k+1)(k+2)a_{k+2}x^{k} \right] + \sum_{k=1}^{\infty} a_{k-1}x^{k}\\ \amp = 2a_2 + \sum_{k=1}^{\infty} \left[(k+1)(k+2)a_{k+2}+a_{k-1} \right] x^{k}\text{.} \end{align*}
  6. Equation (8.6.9) implies that \(a_2 = 0\) and \((k+1)(k+2)a_{k+2}+a_{k-2} = 0\) for all \(k \geq 1\text{.}\)

    Solving for \(a_{k+2}\) in the second equation shows that

    \begin{align*} a_2 \amp = 0\\ a_{k+2} \amp = -\frac{1}{(k+1)(k+2)}a_{k-1} \text{ for } k \geq 1\text{.} \end{align*}

    These last equations are called recurrence relations and allow us to write every coefficient of \(y\) in terms of \(a_0\) and \(a_1\text{.}\) For example, \(k=1\) shows that \(a_3 = \frac{1}{(2)(3)} a_0 = \frac{1}{6}a_0\text{.}\) We can continue in this way to obtain the first 10 coefficients in terms of \(a_0\) and \(a_1\text{:}\)

    \begin{align*} a_3 \amp = \frac{1}{(2)(3)}a_0\\ a_4 \amp = \frac{1}{(3)(4)}a_1\\ a_5 \amp = \frac{1}{(4)(5)} a_2 = 0\\ a_6 \amp = \frac{1}{(5)(6)} a_3 = \frac{1}{(5)(6)} \left(\frac{1}{(2)(3)} a_0 \right) = \frac{1}{(2)(3)(5)(6)} a_0\\ a_7 \amp = \frac{1}{(6)(7)} a_4 = \frac{1}{(6)(7)} \left(\frac{1}{(3)(4)} a_1 \right) = \frac{1}{(3)(4)(6)(7)} a_1\\ a_8 \amp = \frac{1}{(7)(8)} a_5 = 0\\ a_9 \amp = \frac{1}{(8)(9)} a_6 = \frac{1}{(8)(9)} \left(\frac{1}{(2)(3)(5)(6)} a_0 \right) = \frac{1}{(2)(3)(5)(6)(8)(9)} a_0\\ a_{10} \amp = \frac{1}{(9)(10)} a_7 = \frac{1}{(9)(10)} \left(\frac{1}{(3)(4)(6)(7)} a_1 \right) = \frac{1}{(3)(4)(6)(7)(9)(10)} a_1\text{.} \end{align*}

    It may not be obvious, but there is a pattern.

    • All of the terms involving \(a_2\) are 0. These terms are \(a_2\text{,}\) \(a_5\text{,}\) \(a_8\text{,}\) etc. The subscripts of these terms are all of the form \(3k+2\text{.}\) So \(a_{3k+2} = 0\) for every positive integer \(k\text{.}\)

    • The terms that involve \(a_0\) have the form \(a_3\text{,}\) \(a_6\text{,}\) \(a_{9}\text{,}\) etc. and are all of the form \(a_{3k}\) for positive integers \(k\text{.}\) The pattern in the denominators of the coefficient for \(a_{3k}\) is \((2)(3)(5)(6) \cdots (3k-1)(3k)\text{.}\) So

      \begin{equation*} a_{3k} = \frac{1}{(2)(3)(5)(6) \cdots (3k-1)(3k)} a_0 \text{ for } k \geq 1\text{.} \end{equation*}
    • The terms that involve \(a_1\) have the form \(a_4\text{,}\) \(a_7\text{,}\) \(a_{10}\text{,}\) etc. and are all of the form \(a_{3k+1}\) for positive integers \(k\text{.}\) The pattern in the denominators of the coefficient for \(a_{3k+1}\) is \((3)(4)(6)(7) \cdots (3k)(3k+1)\text{.}\) So

      \begin{equation*} a_{3k+1} = \frac{1}{(3)(4)(6)(7) \cdots (3k)(3k+1)} a_1 \text{ for } k \geq 1\text{.} \end{equation*}
  7. We can write the solution \(y\) in three pieces as

    \begin{equation*} y = \sum_{k = 0}^{\infty} a_kx^k = \sum_{k=0}^{\infty} a_{3k}x^{3k} + \sum_{k=0}^{\infty} a_{3k+1}x^{3k+1} + \sum_{k=0}^{\infty} a_{3k+2}x^{3k+2} \end{equation*}

    and so our results from the previous part of this exercise show that

    \begin{align*} y\amp = a_0\left( 1+\sum_{k=1}^{\infty} \frac{x^{3k}}{(2)(3)(5)(6) \cdots (3k-1)(3k)} \right)\\ \amp\phantom{={}}+ a_1 \left( x + \sum_{k=1}^{\infty} \frac{x^{3k+1}}{(3)(4)(6)(7) \cdots (3k)(3k+1)} \right)\text{.} \end{align*}