In order to plan ahead for multiple moves, an algorithm known as a markov decision process is commonly used when there are only a reasonably small group of possible world states.
为了计划后面多个步骤，当可能的世界状态数目不算太多时，通常用到一种被称作马尔科夫决策过程的算法。
Any system that can be described in this manner is a Markov process.
任何可以被描述成为这样一种形式的系统就是马尔科夫过程。
Reinforcement learning based on Markov decision process is a way of on-line learning, which can be applied to single agent environment.
基于马尔科夫过程的强化学习作为一种在线学习方式，能够很好地应用于单智能体环境中。
This paper presents an adaptive prediction coding scheme for the image signals regarded as a high order nonstationary Markov process.
本文把图象信号作为一个高阶非稳马尔柯夫过程，提出一种自适应预测编码方案。
In this paper, we discuss three types of video source models: a autoregressive model, a Markov-modulated fluid flow model, and a Markov-modulated Poisson process model (MMPP).
在本论文中，我们讨论了三种视频源模型：自回归模型、马尔科夫调制流体流模型、马尔科夫调制泊松过程模型(MMPP)。
The semi-Markov process was used to describe network traffic characteristics and divide network traffic into four states: busy, idle, rising and falling.
通过半马尔柯夫过程描述网络流量特性，将网络流量划分为四种状态：忙、空闲、上升和下降。
When the distribution of life, delayed repair and imperfect repair time are all exponential, Markov renewal process for educing the availability is presented.
并在寿命、修理延迟和维修时间均服从指数分布的情况下，用马尔可夫更新过程理论导出了系统的可用度。
The phenomenon of random fluid flow on multistage column trays is simulated by applying theory and method of Markov process.
利用马尔可夫过程的理论和方法，模拟多级塔板上的液体随机流动现象。
By the strong Markov property of the surplus process, we derive the expected discounted penalty function.
利用盈余过程的强马尔可夫性，得到了期望折现罚金函数。
According to the queueing theory and Markov process theory, this paper made all the availability models and performance models of the supply chain system.
本文以排队理论和马尔可夫过程理论为基础，建立了该系统的可用性模型和性能模型。
The transition of the jumping parameters in systems is governed by a finite-state Markov process.
系统中的跳变参数可以通过有限状态马尔可夫过程来描述。
In a sense, it can be seen as the time when semi-dynamic system is killed, or as the time the first random jump of piecewise deterministic Markov process.
它直观上可视作半动力系统随机中断(或出现问题)的时刻，亦可视作逐段决定马尔可夫过程的首次随机跳跃时刻。
The optimal model of inspection and maintenance for the deteriorating system is presented with the semi-Markov decision process.
提出了一类基于半马氏决策过程的劣化失效系统检测与维修优化模型。
The problems of the probability of buildings under the earthquake damages and the buildings born the earthquake events before the certain damage state are solved by the application of Markov process.
应用马尔可夫过程回答给定地震次数下房屋处于各种破坏状态下的概率、达到某一给定破坏状态之前房屋所能承受的地震次数等实际问题。
By using probability analysis and the method of vector Markov process, reliability indexes are obtained, the optimal diagnostic policies are studied.
利用概率分析和向量马尔科夫过程方法，求得了系统的可靠性指标并研究了最优诊断策略。
Then, three safety modeling methods of human-machine system are introduced: probability logic method, Markov process method and random parameter function method.
然后介绍了用于人机一体化系统安全性建模的三种数据方法：概率逻辑法、马尔柯夫过程法和随即参数函数法。
A general method of reliability cost assessment in distribution system which is based on Semi-Markov process and aims at the uncertainty of failure duration distribution is presented.
针对配电系统故障时间分布不确定的特点，提出了基于半马尔柯夫过程的可靠性成本评估通用方法。
The time-varying reliability of existing bridge on bearing capacity was discussed based on fuzzy evaluation and Markov process.
基于模糊评价和马尔科夫过程，研究了在役桥梁承载力可靠度的时变规律。
Taking the study of gating mechanism of potassium channel as the basis, this article approaches modeling method of Markov process of gating mechanism, and selects the relatively simple model.
以钾离子单通道门控机理的分析为前提，探索钾离子通道门控动力学马尔科夫过程的模型，并选出相对简单的模型。
A three-state Markovian model of the F-PRMA system is developed based on Markov process theory.
利用马尔可夫过程理论为F - PR MA协议系统建立了三状态简化模型。
Particularly, the markov theory of random process has been used in reduced model.
特别地，约化模型应用了随机过程中的马尔科夫理论。
A mathematical model of a hybrid-switched system has been built up by a two dimensional ergodic Markov process with the state-transition-rates diagram.
本文利用具有状态转移率的马尔柯夫过程建立了一种综合传输交换的数学模型。
Two approaches to anomaly detection of program behaviors are presented which both use a Markov process to represent the normal behavior profile of a program.
研究了马尔可夫过程在程序行为异常检测中的应用，提出两种新的检测方法。
This method overcome the disadvantage of Markov process, which fussy in calculation and difficult to program in computer.
该方法克服了用常用马尔科夫过程研究可修系统时计算繁琐，且不易于用计算机编程实现等缺点。
A theory of the state-space method based on Markov process was introduced to solve reliability analysis for the low - voltage switchgear assembly system.
考虑到系统部件的更换和维修，把低压成套开关设备作为可修复系统，运用基于马尔可夫过程的状态空间方法，对其可靠性进行分析。
For the reservoir generation operation based on the Markov process, the extensively applied optimization criterion is the optimal expectations revenue.
基于马尔可夫过程的水库发电优化调度，受到广泛研究的优化准则是收益期望值最优。
For the reservoir generation operation based on the Markov process, the extensively applied optimization criterion is the optimal expectations revenue.
基于马尔可夫过程的水库发电优化调度，受到广泛研究的优化准则是收益期望值最优。
应用推荐