Tuesday, May 15, 2007

L'Hospital's Rule

l'Hôpital's rule (sometimes spelled as l'Hospital's rule) uses derivatives to help compute limits with indeterminate forms. Application (or repeated application) of the rule often converts an indeterminate form to a determinate form, allowing easy computation of the limit. The rule is named after the 17th-century French mathematician Guillaume de l'Hôpital, who published the rule in his book Analyse des infiniment petits pour l'intelligence des lignes courbes (literal translation: Analysis of the infinitely small to understand curves) (1696), the first book to be written on differential calculus.

The rule is believed to be the work of Johann Bernoulli since l'Hôpital, a nobleman, paid Bernoulli a retainer of 300 per year to keep him updated on developments in calculus and to solve problems he had. Among these problems was that of limits of indeterminate forms. When l'Hôpital published his book, he gave due credit to Bernoulli and, not wishing to take credit for any of the mathematics in the book, he published the work anonymously. Bernoulli, who was known for being extremely jealous, claimed to be the author of the entire work, and until recently, it was believed to be so. Nevertheless, the rule was named for l'Hôpital, who never claimed to have invented it in the first place[1].

The Stolz-Cesàro theorem is a similar result involving limits of sequences, and using finite difference operators rather than derivatives.

Introduction

In simple cases, l'Hôpital's rule states that for functions f(x) and g(x), if:

\lim_{x \to c}f(x)=\lim_{x \to c}g(x)=0,

or

\lim_{x \to c}f(x)=\lim_{x \to c}g(x)=\infty,

then:

\lim_{x\to c}\frac{f(x)}{g(x)} = \lim_{x\to c}\frac{f'(x)}{g'(x)}

where the prime (') denotes the derivative.

Among other requirements, for this rule to hold, the limit \lim_{x\to c}\frac{f'(x)}{g'(x)} must exist. Other requirements are detailed below, in the formal definition.

Formal statement

When determining the limit of a quotient f(x)/g(x) \ when both f and g approach 0, or f and g approach infinity, l'Hôpital's rule states that if f'(x)/g'(x) \ converges, then f(x)/g(x) \ converges, and to the same limit. This differentiation often simplifies the quotient and/or converts it to a determinate form, allowing the limit to be determined more easily.

Symbolically let \mathbb{R}^*=\mathbb{R}\cup\{\pm\infty\}. Suppose that c \in \mathbb{R}^*, that

\lim_{x\to c}{f'(x) \over g'(x)} = A, A \in \mathbb{R}^*

and that g'(x) \neq 0 for all x\ne c in an open interval (a,b) containing c (or with b=\infty if c=\infty or with a=-\infty if c=-\infty). If

\begin{cases}   \lim_{x\to c}{f(x)} = \lim_{x\to c}g(x) = 0  \\   \mbox{or} \\    \lim_{x\to c}{|f(x)|} = \lim_{x\to c}{|g(x)|} = +\infty  \end{cases}

then

\lim_{x\to c}{f(x)\over g(x)}=A.

L'Hôpital's rule also holds for one-sided limits.

Basic indeterminate forms (all others reduce to these):

{0\over 0}\qquad {\infty\over\infty}

Other indeterminate forms:

{\infty^0\qquad 1^\infty\qquad 0\cdot\infty\qquad 0^0\qquad\infty - \infty\qquad}

Note the requirement that the limit \lim_{x\to c}\frac{f'(x)}{g'(x)} exists. Differentiation of limits of this form can sometimes lead to limits that do not exist. In that case, L'Hôpital's rule cannot be applied. For instance if f(x) = x + sin(x) and g(x) = x, then

\lim_{x\to\infty}\frac{f'(x)}{g'(x)}=\lim_{x\to\infty}(1+\cos(x))

does not exist, whereas

\lim_{x\to\infty}\frac{f(x)}{g(x)}=1.

In practice one often uses the rule and, if the resulting limit exists, concludes that it was legitimate to use l'Hôpital's rule.

Note also the requirement that the derivative of g not vanish throughout an entire interval containing the point c. Without such a hypothesis, the conclusion is false. Thus one must not use l'Hôpital's rule if the denominator oscillates wildly near the point where one is trying to find the limit. For example if f(x) = x + cos(x)sin(x) and g(x) = esin(x)(x + cos(x)sin(x)), then

\lim_{x\to\infty}\frac{f'(x)}{g'(x)} =\lim_{x\to\infty}\frac{2\cos^{2}{x}}{e^{\sin(x)}\cos(x)(x+\sin(x)\cos(x)+2\cos(x))}

= \lim_{x\to\infty}\frac{2\cos(x)}{e^{\sin(x)}(x+\sin(x)\cos(x)+2\cos(x))}=0

whereas

\lim_{x\to\infty}\frac{f(x)}{g(x)}=\lim_{x\to\infty}\frac{1}{e^{\sin(x)}}

does not exist since \frac{1}{e^{\sin(x)}} fluctuates between e-1 and e.

Examples

  • Here is an example involving the sinc function, which has the form 0/0 :
\lim_{x \to 0} \mathrm{sinc}(x)\, = \lim_{x \to 0} \frac{\sin \pi x}{\pi x}\, = \lim_{x \to 0} \frac{\sin x}{x}\,


= \lim_{x \to 0} \frac{\cos x}{1} = \frac{1}{1} = 1\,
However, it is simpler to observe that this limit is just the definition of the derivative of sin(x) at x = 0.
In fact this particular limit is needed in the most usual proof that the derivative of sin(x) is cos(x), but we cannot use l'Hôpital's rule to do this, as it would produce a circular argument.
  • Here is a more elaborate example involving the indeterminate form 0/0. Applying the rule a single time still results in an indeterminate form. In this case, the limit may be evaluated by applying l'Hôpital's rule three times:
\lim_{x\to 0} {2\sin x-\sin 2x \over x-\sin x} =\lim_{x\to 0}{2\cos x-2\cos 2x \over 1-\cos x}

=\lim_{x\to 0}{-2\sin x +4\sin 2x \over \sin x}

=\lim_{x\to 0}{-2\cos x +8\cos 2x \over \cos x}

={-2\cos 0 +8\cos 0 \over \cos 0}

=6\,
  • Here is another case involving 0/0:
\lim_{x\to 0}{e^x-1-x \over x^2} =\lim_{x\to 0}{e^x-1 \over 2x} =\lim_{x\to 0}{e^x \over 2}={1 \over 2}
  • Here is a case of ∞/∞:
\lim_{x \to \infty} \frac{\sqrt{x}}{\ln(x)}   = \lim_{x \to \infty} \frac{\ 1/(2 \sqrt{x})\ }{1/x}   = \lim_{x \to \infty} \frac{\sqrt{x}}{2}   = \infty
  • This one involves ∞/∞. Assume n is a positive integer.
\lim_{x\to\infty} x^n e^{-x} =\lim_{x\to\infty}{x^n \over e^x} =\lim_{x\to\infty}{nx^{n-1} \over e^x} =n\lim_{x\to\infty}{x^{n-1} \over e^x}
Iterate the above until the exponent is 0. Then one sees that the limit is 0.
  • This one also involves ∞/∞:
\lim_{x\to 0+} (x  \ln x) =\lim_{x\to 0+}{\ln x \over 1/x} =\lim_{x\to 0+}{1/x \over -1/x^2} =\lim_{x\to 0+} -x = 0
  • The previous result can be used the following case of the indeterminate form 00: To compute \lim_{x\to 0} x^x, we rewrite xx as exlnx and get
\lim_{x\to 0} x^x  = e^{\lim_{x\to 0} (x  \ln x )} = e^0 = 1.
\lim_{t\to 0}\, \mathrm{sinc}(f_0 t)\cdot \frac{\cos\left(\pi \alpha f_0 t\right)}{\left[1 - \left(2 \alpha f_0 t\right)^2\right]} = \left\{\lim_{t\to 0}\, \mathrm{sinc}(f_0 t)\right\}\cdot \left. \frac{\cos\left(\pi \alpha f_0 t\right)}{\left[1 - \left(2 \alpha f_0 t\right)^2\right]} \, \right|_{t = 0}

= 1 \cdot 1 = 1
  • And:
\lim_{t\to \frac{1}{2\alpha f_0}} \mathrm{sinc}(f_0 t)\cdot \frac{\cos\left(\pi \alpha f_0 t\right)}{\left[1 - \left(2 \alpha f_0 t\right)^2\right]} = \mathrm{sinc}\left(\frac{1}{2\alpha}\right)\cdot \lim_{t\to \frac{1}{2\alpha f_0}} \frac{\cos\left(\pi \alpha f_0 t\right)}{\left[1 - \left(2 \alpha f_0 t\right)^2\right]}

= \mathrm{sinc}\left(\frac{1}{2\alpha}\right)\cdot \left(\frac{-\pi /2}{-2}\right)

= \sin\left(\frac{\pi}{2\alpha}\right)\cdot \frac{\alpha}{2}

With the indeterminate form 0 over 0

The case when f(x) \to 0, g(x) \to 0

First, we expand continuously (or redefine) f(x) and g(x) by 0 for x = c. This doesn't change the limit since the limit doesn't depend on the value in the point (by definition).

According to Cauchy's mean value theorem there is a constant ξ in c < ξ < c + h such that:

\frac{f'(\xi)}{g'(\xi)}  = \frac{f(c + h) - f(c)}{g(c + h) - g(c)}

Since f(c) = g(c) = 0,

\frac{f'(\xi)}{g'(\xi)} = \frac{f(c + h)}{g(c + h)}

If h \to 0 then \xi \to c and

\lim_{x\to c}\frac{f'(x)}{g'(x)} = \lim_{\xi\to c}\frac{f'(\xi)}{g'(\xi)} = \lim_{h\to 0}\frac{f(c+h)}{g(c+h)}  = \lim_{x\to c}\frac{f(x)}{g(x)}

With the indeterminate form infinity over infinity

The case when |g(x)| \to +\infty

Let x < y < x + h. Then using Cauchy's mean value theorem:

\frac{f'(\xi)}{g'(\xi)} = \frac{f(x) - f(y)}{g(x) - g(y)}

We rewrite that in the form

\frac{f(x)}{g(x)} = \frac{f(y)}{g(x)} + \left [ 1 - \frac{g(y)}{g(x)} \right ] \frac{f'(\xi)}{g'(\xi)}

and then by the discussion of the two cases

\begin{cases} \lim_{x \to c}\frac{f'(x)}{g'(x)} = B \in \mathbb{R} \\ \lim_{x \to c}\frac{f'(x)}{g'(x)} = \pm \infty \end{cases}

we show that the limit of f(x)/g(x) tends to the same when x \to c and h \to 0

Other applications

Many other indeterminate forms, such as 1^\infty, \infty^0, and \infty-\infty can be calculated using l'Hôpital's rule.

For example, to handle a case of \infty-\infty, the difference of two functions is converted to a quotient:

\lim_{x \to \infty} x - \sqrt{x^2 - x} = \lim_{x \to \infty} \frac{ \left(x + \sqrt{x^2 - x}\right)                              \left(x - \sqrt{x^2 - x}\right) }                            { x + \sqrt{x^2 - x} }  \quad
= \lim_{x \to \infty} \frac{x^2 - (x^2 - x)}{x + \sqrt{x^2 - x}} \quad
= \lim_{x \to \infty} \frac{x}{x + \sqrt{x^2 - x}} \quad
= \lim_{x \to \infty} \frac{1}{1 + \frac{2x - 1}{2 \sqrt{x^2 - x}}} = \frac{1}{1 + 1} = \frac{1}{2} \quad

The rule can be used on indeterminate forms involving exponents by using logarithms to "move the exponent down."

Other methods of computing limits

Although l'Hôpital's rule is a powerful way of computing otherwise hard-to-compute limits, it is not always the easiest. Some limits are actually easier to compute using the Taylor series expansion.

For example,

\lim_{|x| \to \infty} x \sin {1 \over x} = \lim_{|x| \to \infty} x     \left( {1 \over x} - {1 \over x^3 \cdot 3!}          + {1 \over x^5 \cdot 5!} - \cdots \right)  \;
= \lim_{|x| \to \infty} 1 - {1 \over x^2 \cdot 3!}                         + {1 \over x^4 \cdot 5!} - \cdots\; =\; 1 \quad

Some elementary algebraic manipulation, however, yields:

\lim_{|x| \to \infty}\ {\sin {1 \over x} \over {1 \over x}}

And applying l'Hôpital's rule, we have:

L = \lim_{|x| \to \infty}\ {{\cos {1 \over x} \cdot  {-1 \over x^2}}\over {-1 \over x^2}}
= \lim_{|x| \to \infty} {\cos{1 \over x}} \cdot {-1 \over x^2} \cdot {x^2 \over -1}
= \cos{1 \over \infty} = \cos{\ 0} = 1

On the other hand, a simple substitution also allows the use of l'Hôpital's rule.

Let\ u = {1 \over x} Therefore, as x \rightarrow \infty, u \rightarrow\ 0

Therefore,

\lim_{|x| \to \infty} x \sin {1 \over x}\ =\ \lim_{|u| \to\ 0} {1 \over u} \sin {u}\ =\ 1

Logical circularity

In some cases it may constitute circular reasoning to use l'Hôpital's rule to evaluate such limits as

\lim_{h\to 0}{(x+h)^n-x^n \over h}.

If one uses the evaluation of the limit above for the purpose of proving that

{d \over dx} x^n=nx^{n-1},

and one uses l'Hôpital's rule and the fact that

{d \over dx} x^n=nx^{n-1},

in the evaluation of the limit, the argument uses the expected proof to prove itself and is therefore fallacious (even though the conclusion of the proof happens to be true).

Another popular mistake of this nature is the well-known limit

\lim_{x\to 0} {\sin x \over x} = 1.

Just as in the previous example, if one proves the differentiation rule for sin(x) with the limit, as is often the case in most calculus books, then it is circular to apply l'Hôpital's rule to evaluate the same limit.

No comments: