Basics of Applied Stochastic Processes

This book gives an in-depth description of the structure and basic properties of the following stochastic processes commonly used in applications: Markov chains and continues time, renewal and regenerative processes, Poisson processes and Brownian motion.