Following is a collection of books (and some papers) which present a
general survey of parallel processing issues.  This list is of course
not intended to be exhaustive.

<P>

The Design and Analysis of Parallel Algorithms, by Selim G. Akl.
Prentice Hall, 1989.

<P>

Parallel Computation:  Models and Methods, by Selim G. Akl.  
Prentice Hall, 1997.

<P>

Highly Parallel Computing (second edition), by George S. Almasi and
Allan Gottlieb.  Benjamin/Cummings, 1994.  Good overview of hardware
and applications, including some not found in most other books, such
as in AI.

<P>

Introduction to Parallel Programming, by Steven Brawer.  Academic Press,
1989.  

<P>

How to Write Parallel Programs:  a First Course, by Nicholas Carriero
and David Gelernter.  MIT Press, 1990.  Gelernter is the inventor of
the Linda parallel language.  There are a lot of Linda examples here,
but the techniques presented are general.

<P>

Distributed and Parallel Computing, Hesham El-Rewini and Ted G. Lewis.  
Manning, 1998.

<P>

Scalable Parallel Computing:  Technology, Architecture, Programming, by 
Kai Hwang and Zhiwei Xu.  McGraw-Hill, 1998.  This is a comprehensive
"catalog," long on breadth though short on depth.  Has a very extensive
appendix of 
<A HREF="http://www.cs.hku.hk/~kaihwang/book98.html">
parallel processing Web sites, </A> which Hwang says will
be continually updated over time.

<P>

Parallel Systems in the Data Warehouse, by Stephen Morse and David Isaac.  
Prentice Hall, 1998.  Up-to-date information on specific commercial
products in shared-memory parallel hardware.

<P>

The Art of Parallel Programming, by Bruce P. Lester.  Prentice Hall, 1993.
Nice overview of techniques and applications.

<P>

<A HREF="http://NSCP01.PHYSICS.UPENN.EDU/parallel/books/jones%2bbartlett">
The book by Chris Nevison et al,</A> covering a
<A HREF="http://cs.colgate.edu/faculty/nevison.pub/parallel.html#curric"> 
parallel processing curriculum</A> developed by several universities.
This covers both techniques and applications.  Source code for the
programs (in PVM) is available at their
<A HREF="ftp://cs.oswego.edu/pub/UParCC/modules">ftp site. </A>

<P>

My favorite MPI book is the <A HREF="http://www.usfca.edu/mpi/">text by
Pacheco.  </A>  You can read <A HREF="MPI/PP_MPI_C.tar.gz"> an earlier
and much shorter version</A> online.  It covers techniques and a few
applications, mainly numerical analysis.

<P>

Parallel Computing:  Theory and Practice (second edition), by Michael J.
Quinn.  McGraw-Hill, 1994.

<P>

High-Performance Computer Architecture (second edition), by Harold S. Stone.  
Addison-Wesley, 1990.

<P>

Practical Parallel Programming, by Gregory V. Wilson.  MIT Press, 1995.
Excellent overview of methods and applications.  

<P>

Principles of Database Query Processing for Advanced Applications, by
Clement T. Yu and Weiyi Meng.  Morgan Kaufmann, 1998.  Chapter 5 gives
an excellent overview of parallel methods in relational database
operations.