Applied Stochastic Models in Business and Industry

Optimal decision procedure for an operation‐dependent deteriorating system

Journal Article

Highly flexible and integrated systems can perform one of several operations at a time, which allows the decision‐maker to select which operation to perform in the safest and most effective way. There are strong dynamic interactions between a system's deterioration and the operations it performs. In this research, optimal decision‐making was investigated for operation‐dependent deteriorating systems under variable operations while formulating the problem as a Markov decision process with the operation as a parameter. The decision‐maker selects the operation that will minimize the total expected cost over an infinite horizon on the basis of the current state. The properties of the resulting optimal expected cost function were examined, and the optimal decision procedure was found to be given by a monotone procedure under certain conditions. This research provides a generalization of the ‘keep, inspection, and replacement’ problem that was initially introduced by Derman (Mathematical Optimization Techniques: 201–210, 1963) and has been studied extensively since then. Copyright © 2014 John Wiley & Sons, Ltd.

Related Topics

Related Publications

Related Content

Site Footer


This website is provided by John Wiley & Sons Limited, The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ (Company No: 00641132, VAT No: 376766987)

Published features on are checked for statistical accuracy by a panel from the European Network for Business and Industrial Statistics (ENBIS)   to whom Wiley and express their gratitude. This panel are: Ron Kenett, David Steinberg, Shirley Coleman, Irena Ograjenšek, Fabrizio Ruggeri, Rainer Göb, Philippe Castagliola, Xavier Tort-Martorell, Bart De Ketelaere, Antonio Pievatolo, Martina Vandebroek, Lance Mitchell, Gilbert Saporta, Helmut Waldl and Stelios Psarakis.