Jeffrey S Rosenthal

The Markov chain ergodic theorem is well-understood if either the time-line or the state space is discrete. However, there does not exist a very clear result for general state space continuous-time Markov processes. Using methods from mathematical logic and nonstandard analysis, we introduce a class of hyperfinite Markov processes-namely, general Markov processes which behave like finite state space discrete-time Markov processes. We show that, under moderate conditions, the transition probability of hyperfinite Markov processes align with the transition probability of standard Markov processes. The Markov chain ergodic theorem for hyperfinite Markov processes will then imply the Markov chain ergodic theorem for general state space continuous-time Markov processes.

This textbook introduces the theory of stochastic processes, that is, randomness which proceeds in time. Using concrete examples like repeated gambling and jumping frogs, it presents fundamental mathematical results through simple, clear, logical theorems and examples. It covers in detail such essential material as Markov chain recurrence criteria, the Markov chain convergence theorem, and optional stopping theorems for martingales. The final chapter provides a brief introduction to Brownian motion, Markov processes in continuous time and space, Poisson processes, and renewal theory.Interspersed throughout are applications to such topics as gambler's ruin probabilities, random walks on graphs, sequence waiting times, branching processes, stock option pricing, and Markov Chain Monte Carlo (MCMC) algorithms.The focus is always on making the theory as well-motivated and accessible as possible, to allow students and readers to learn this fascinating subject as easily and painlessly as possible.

This textbook introduces the theory of stochastic processes, that is, randomness which proceeds in time. Using concrete examples like repeated gambling and jumping frogs, it presents fundamental mathematical results through simple, clear, logical theorems and examples. It covers in detail such essential material as Markov chain recurrence criteria, the Markov chain convergence theorem, and optional stopping theorems for martingales. The final chapter provides a brief introduction to Brownian motion, Markov processes in continuous time and space, Poisson processes, and renewal theory.Interspersed throughout are applications to such topics as gambler's ruin probabilities, random walks on graphs, sequence waiting times, branching processes, stock option pricing, and Markov Chain Monte Carlo (MCMC) algorithms.The focus is always on making the theory as well-motivated and accessible as possible, to allow students and readers to learn this fascinating subject as easily and painlessly as possible.

Jeffrey S. Rosenthal, author of the bestseller Struck by Lightning: The Curious World of Probabilities, was born on Friday the thirteenth, a fact that he discovered long after he had become one of the world's pre-eminent statisticians. Had he been living ignorantly and innocently under an unlucky cloud for all those years? Or is thirteen just another number? As a scientist and a man of reason, Rosenthal has long considered the value of luck, good and bad, seeking to measure chance and hope in formulas scratched out on chalkboards.In Knock on Wood, with great humour and irreverence, Rosenthal divines the world of luck, fate and chance, putting his considerable scientific acumen to the test in deducing whether luck is real or the mere stuff of superstition.

This textbook is an introduction to probability theory using measure theory. It is designed for graduate students in a variety of fields (mathematics, statistics, economics, management, finance, computer science, and engineering) who require a working knowledge of probability theory that is mathematically precise, but without excessive technicalities. The text provides complete proofs of all the essential introductory results. Nevertheless, the treatment is focused and accessible, with the measure theory and mathematical details presented in terms of intuitive probabilistic concepts, rather than as separate, imposing subjects. In this new edition, many exercises and small additional topics have been added and existing ones expanded. The text strikes an appropriate balance, rigorously developing probability theory while avoiding unnecessary detail.

This textbook is an introduction to probability theory using measure theory. It is designed for graduate students in a variety of fields (mathematics, statistics, economics, management, finance, computer science, and engineering) who require a working knowledge of probability theory that is mathematically precise, but without excessive technicalities. The text provides complete proofs of all the essential introductory results. Nevertheless, the treatment is focused and accessible, with the measure theory and mathematical details presented in terms of intuitive probabilistic concepts, rather than as separate, imposing subjects. In this new edition, many exercises and small additional topics have been added and existing ones expanded. The text strikes an appropriate balance, rigorously developing probability theory while avoiding unnecessary detail.