On the lighter side of things, here is an interesting paper called "How smart are computers?" By: J. R. Pierce
|
| Linear Algebra - Systems of Equations and Least-Squares | |
|---|---|
|
Frankel (1950) Hestenes & Stiefel (1952) Young (1954) Householder (1958) Wilkinson (1961) Golub (1965) Strassen (1969) George (1973) Gill, Golub, Murray & Saunders (1974) Concus, Golub & O'Leary (1976) Meijerink & van der Vorst (1977) Skeel (1980) Saad & Schultz (1986) |
optimal omega for SOR iteration the conjugate gradient iteration theory of classical iterative methods QR decomposition error analysis for systems of eqs. least-squares problems Gaussian elimination is not optimal nested dissection updating matrix factorizations preconditioned conjugate gradients incomplete LU preconditioning iterative refinement and stability GMRES for nonsymmetric systems |
| Linear Algebra - Eigenvalues and SVD | |
|---|---|
|
Jacobi (1846) Henrici (1958) Rutishauser (1958) Kublanovskaya (1961) Francis (1961) Golub & Kahan (1965) Moler & Stewart (1973) Cuppen (1981) |
Jacobi's method for matrix eigenvalues convergence of the Jacobi method the LR algorithm the QR algorithm the QR algorithm computation of the SVD QZ algorithm for gen'd eigenvalues divide and conquer for eigenvalues |
| Optimization | |
|---|---|
|
Dantzig (1951) Davidon (1959) Fletcher & Powell (1963) Broyden/Fletcher/Goldfarb/Shanno (`70) Karmarkar (1984) |
simplex method for linear programming variable metric methods DFP quasi-Newton update formula BFGS quasi-Newton update formula interior pt methods for linear prog. |
| Integration | |
|---|---|
|
Golub & Welsch (1969) de Boor (1971) |
Gauss quadrature rules adaptive quadrature algorithms |
| Approximation | |
|---|---|
|
Remes (1934) Schoenberg (1946) Powell (1967) Reinsch (1967) Cox (1972) de Boor (1972) |
Remes algorithm for Chebyshev approx. splines near-optimality of Chebyshev interp. smoothing with splines calculation with B-splines calculation with B-splines |
| ODEs | |
|---|---|
|
Curtiss & Hirschfelder (1952) Dahlquist (1956) Dahlquist (1963) Butcher (1965) Gear (1969) Wanner, Hairer & Norsett (1978) |
stiffness and BD formulas stability and convergence A-stability Runge-Kutta methods stiff ODEs order stars and stability theorems |
| Elliptic PDEs | |
|---|---|
|
Peaceman & Rachford (1955) Douglas (1955) Strang (1971 or 1973) Buzbee, Golub & Nielsen (1970) Hockney (1965) Fedorenko (1961) Brandt (1977) |
ADI ADI finite elements and approx. theory fast Poisson via cyclic reduction fast Poisson via FFT multigrid methods multigrid methods |
| Parabolic and Hyperbolic PDEs | |
|---|---|
|
Courant, Friedrichs & Lewy (1928) Crank & Nicolson (1947) O'Brien, Hyman & Kaplan (1951) Lax & Richtmyer (1956) Lax & Wendroff (1960,1962,1964) Kreiss (1962) Orszag (1971) Kreiss and Oliger (1972) Gustafsson, Kreiss & Sundstrom (1972) Chorin (1973) Engquist & Majda (1977) |
the CFL condition finite differences for parabolic PDE Von Neumann stability analysis general stability theory methods for solving conservation laws more general stability theory spectral methods spectral methods stability of boundary conditions vortex methods for CFD absorbing boundary conditions |
| Other Notables | |
|---|---|
|
Aitken (1932) Cooley & Tukey (1965) Greengard & Rokhlin (1987) |
Aitken extrapolation the fast Fourier transform fast multipole methods |