Data Structures and Algorithms with Object-Oriented Design Patterns in Python
next up previous index

Example-Computing Binomial Coefficients

 

Consider the problem of computing the binomial coefficient

  equation33142

given non-negative integers n and m (see Theorem gif).

The problem with implementing directly Equation gif is that the factorials grow quickly with increasing n and m. For example, tex2html_wrap_inline68225. Therefore, it is not possible to represent n! for tex2html_wrap_inline68229 using 32-bit integers. Nevertheless it is possible to represent the binomial coefficients tex2html_wrap_inline68231 up to n=33 without overflowing. For example, tex2html_wrap_inline68235.

Consider the following recursive definition of the binomial coefficients:

  equation33158

This formulation does not require the computation of factorials. In fact, the only computation needed is addition.

If we implement Equation gif directly as a recursive method, we get a method whose running time is given by

displaymath68215

which is very similar to Equation gif. In fact, we can show that tex2html_wrap_inline68237 which (by Equation gif) is not a very good running time at all! Again the problem with the direct recursive implementation is that it does far more work than is needed because it solves the same subproblem many times.

An alternative to the top-down recursive implementation is to do the calculation from the bottom up. In order to do this we compute the series of sequences

eqnarray33178

Notice that we can compute tex2html_wrap_inline68197 from the information contained in tex2html_wrap_inline67035 simply by using Equation gif. Table gif shows the sequence in tabular form--the tex2html_wrap_inline57847 row of the table corresponds the sequence tex2html_wrap_inline67035. This tabular representation of the binomial coefficients is known as Pascal's triangle .gif

 

 

n tex2html_wrap_inline68249 tex2html_wrap_inline68251 tex2html_wrap_inline68253 tex2html_wrap_inline68255 tex2html_wrap_inline68257 tex2html_wrap_inline68259 tex2html_wrap_inline68261 tex2html_wrap_inline68263
0 1
1 1 1
2 1 2 1
3 1 3 3 1
4 1 4 6 4 1
5 1 5 10 10 5 1
6 1 6 15 20 15 6 1
7 1 7 21 35 35 21 7 1
Table: Pascal's triangle.

Program gif defines the method binom which takes two integer arguments n and m and computes the binomial coefficient tex2html_wrap_inline68231 by computing Pascal's triangle. According to Equation gif, each subsequent row depends only on the preceding row--it is only necessary to keep track of one row of data. The implementation shown uses an array of length n to represent a row of Pascal's triangle. Consequently, instead of a table of size tex2html_wrap_inline58629, the algorithm gets by with O(n) space. The implementation has been coded carefully so that the computation can be done in place. That is, the elements of tex2html_wrap_inline68197 are computed in reverse so that they can be written over the elements of tex2html_wrap_inline67035 that are no longer needed.

   program33239
Program: Dynamic programming example--computing Binomial coefficients.

The worst-case running time of the binom method given in Program gif is clearly tex2html_wrap_inline58629.


next up previous index

Bruno Copyright © 2003, 2004 by Bruno R. Preiss, P.Eng. All rights reserved.