This book is for a first course in stochastic processes taken by undergraduates or master’s students who have had a course in probability theory. It covers Markov chains in discrete and continuous time, Poisson processes, renewal processes, martingales, and mathematical finance. One can only learn a subject by seeing it in action, so there are a large number of examples and more than 300 carefully chosen exercises to deepen the reader’s understanding
The book has undergone a thorough revision since the first edition. There are many new examples and problems with solutions that use the TI-83 to eliminate the tedious details of solving linear equations by hand. Some material that was too advanced for the level has been eliminated while the treatment of other topics useful for applications has been expanded. In addition, the ordering of topics has been improved. For example, the difficult subject of martingales is delayed until its usefulness can be seen in the treatment of mathematical finance.