orbital.algorithm.template
Interface MarkovDecisionProblem.Transition

All Superinterfaces:

java.lang.Comparable, TransitionModel.Transition

All Known Implementing Classes:

GeneralSearchProblem.Transition, MarkovDecisionProblem.DefaultTransition

Enclosing interface:

MarkovDecisionProblem

public static interface MarkovDecisionProblem.Transition
extends TransitionModel.Transition

Represents a transition option during a Markov decision process.

A transition option is at least a pair ⟨p,c⟩∈[0,1]×R of a probability of reaching a state (in the corresponding context), and the cost of the action taken to reach it.

Author:

André Platzer

Stereotype:

Structure

Method Summary

Real	getCost() Get the cost of taking the action leading to this transition.

Methods inherited from interface orbital.algorithm.template.TransitionModel.Transition

compareTo, equals, getProbability, hashCode

Method Detail

getCost

Real getCost()

Get the cost of taking the action leading to this transition.

Note: Since c:S×A→R is a function, the cost should only depend on the action a taken, and the state s in which it was taken, not the actual outcome (which is unknown a priori). Otherwise, subset construction would not be applicable, etc.

Returns:

c(s,a) the cost of taking the action a∈A(s) that took us here from state s∈S.

Postconditions:

RES>0 ∨ RES∈[0,∞)