Markov processes

62 books

Markov Decision Processes

Martin L. Puterman

2005

Bioinformatics

Pierre Baldi

1998

Markov chains

J. R. Norris

1998

Hidden Markov models for time series

W. Zucchini, Iain L. MacDonald, Walter Zucchini

2009

Machiavelli and Renaissance Italy

J. R. Hale

1960

Markov chains

D. Revuz

1984

Markov models and optimization

M. H. A. Davis

1993

Deterministic and Stochastic Optimal Control

Raymond W. Rishel, Wendell H. Fleming

1975

Finite Markov chains

John G. Kemeny

1969

Introduction to matrix analytic methods in stochastic modeling

G. Latouche

1999

Design and analysis of simulation experiments

S. M. Ermakov

1995

Numerical methods for stochastic control problems in continuous time

Harold J. Kushner

2001

Probabilistic models of cumulative damage

J. L. Bogdanoff

1985

Dynamic probabilistic systems

Ronald A. Howard

1971

Latent Markov models for longitudinal data

Francesco Bartolucci

2013

Markov chains

Michael K. Ng

2005

Queues And Inventories

N. U. Prabhu

1965

Zak Zoo y el extraño animal

Justine Swain-Smith

2013

Models of Random Processes

Shurenkov, V. M., Igorʹ Nikolaevich Kovalenko, Kuznetsov, Yu N.

1996

Symbolic dynamics

Bruce Kitchens

1998

Applied probability and queues

Søren Asmussen

1987

DNA, words, and models

Stéphane Robin

2005

Diskretnye t︠s︡epi Markova

Vsevolod Ivanovich Romanovskiĭ

1970

Lecture notes on limit theorems for Markov chain transition probabilities

Steven Orey

1971

The theory of branching processes

Theodore E. Harris

1989

Markov random field textures and applications in image processing

Christopher A. Korn

1997

Discrete-time Markov jump linear systems

Oswaldo Luiz do Valle Costa

2004

Topics in symbolic dynamics and applications

A. Nogueira

2000

Statistical inference for Markov processes

Patrick Billingsley

1961

Markov chains

David Freedman

1971