net.pakl.rl
Interface ValueFunction

All Superinterfaces:

java.io.Serializable

All Known Implementing Classes:

ParallelToSerialVFAdapter, ValueFunctionHashMap, ValueFunctionHashMapZipped, ValueFunctionPerceptron, ValueFunctionResidualAlgorithmBairdPerceptron, ValueFunctionResidualAlgorithmLinear, ValueFunctionResidualAlgorithmPatrykNetwork, ValueFunctionResidualAlgorithmPerceptron

public interface ValueFunction
extends java.io.Serializable

A ValueFunction maps states from a World, to values, and may be implemented with a neural network or a HashMap. For an example hashmap implementation see ValueFunctionHashMap. When the value function is optimal then the optimal policy can be extracted from it in realtime, see PolicyExtractor.

Method Summary

java.lang.String	getName() It is important for value functions to have names for the patchwork approach, so that states can identify to which value function patch they belong by the PolicyExtractor.
double	getValue(State state) Retrieve the value associated with a state (which may be different for non-stored states depending on the actual class implementing this value function).
void	setName(java.lang.String name)
void	setValue(State state, double newValue)
void	setValueOfTerminalStates(double newValueOfTerminalStates) Many problems define a value of 0 for their terminal states, where the agent can remain.
void	setWorld(World w)

Method Detail

getValue

double getValue(State state)

Retrieve the value associated with a state (which may be different for non-stored states depending on the actual class implementing this value function).

setValue

void setValue(State state,
              double newValue)

setValueOfTerminalStates

void setValueOfTerminalStates(double newValueOfTerminalStates)

Many problems define a value of 0 for their terminal states, where the agent can remain.

getName

java.lang.String getName()

It is important for value functions to have names for the patchwork approach, so that states can identify to which value function patch they belong by the PolicyExtractor.

setName

void setName(java.lang.String name)

setWorld

void setWorld(World w)