The intent of this book is to present recent results in the control theory for the long run average continuous control problem of piecewise deterministic Markov processes (PDMPs). The book focuses mainly on the long run average cost criteria and extends to the PDMPs some well-known techniques related to discrete-time and continuous-time Markov decision processes, including the so-called ``aver…
"Stochastic Tools in Mathematics and Science" covers basic stochastic tools used in physics, chemistry, engineering and the life sciences. The topics covered include conditional expectations, stochastic processes, Brownian motion and its relation to partial differential equations, Langevin equations, the Liouville and Fokker-Planck equations, as well as Markov chain Monte Carlo algorithms, reno…
Stochastic Orders in Reliability and Risk Management is composed of 19 contributions on the theory of stochastic orders, stochastic comparison of order statistics, stochastic orders in reliability and risk analysis, and applications. These review/exploratory chapters present recent and current research on stochastic orders reported at the International Workshop on Stochastic Orders in Reliabili…
This book aims to further develop the theory of stochastic functional inclusions and their applications for describing the solutions of the initial and boundary value problems for partial differential inclusions. The self-contained volume is designed to introduce the reader in a systematic fashion, to new methods of the stochastic optimal control theory from the very beginning. The exposition …
Sergei Kuznetsov is one of the top experts on measure valued branching processes (also known as “superprocessesâ€) and their connection to nonlinear partial differential operators. His research interests range from stochastic processes and partial differential equations to mathematical statistics, time series analysis and statistical software; he has over 90 papers publishe…
The stochastic calculus of variations of Paul Malliavin (1925 - 2010), known today as the Malliavin Calculus, has found many applications, within and beyond the core mathematical discipline. Stochastic analysis provides a fruitful interpretation of this calculus, particularly as described by David Nualart and the scores of mathematicians he influences and with whom he collaborates. Many of thes…
The book is the extended and revised version of the 1st edition and is composed of two main parts: mathematical background and queueing systems with applications. The mathematical background is a self-containing introduction to the stochastic processes of the later studied queueing systems. It starts with a quick introduction to probability theory and stochastic processes and continues with cha…
This book presents some recent systems engineering and mathematical tools for health care along with their real-world applications by health care practitioners and engineers. Advanced approaches, tools, and algorithms used in operating room scheduling and patient flow are covered. State-of-the-art results from applications of data mining, business process modeling, and simulation in healthcare,…
Linear-Quadratic Controls in Risk-Averse Decision Making cuts across control engineering (control feedback and decision optimization) and statistics (post-design performance analysis) with a common theme: reliability increase seen from the responsive angle of incorporating and engineering multi-level performance robustness beyond the long-run average performance into control feedback design a…