net.pakl.rl
Class ValueFunctionResidualAlgorithmLinear

java.lang.Object
  net.pakl.rl.ValueFunctionResidualAlgorithmLinear

All Implemented Interfaces:

java.io.Serializable, ValueFunction

public class ValueFunctionResidualAlgorithmLinear
extends java.lang.Object
implements ValueFunction

See Also:

Serialized Form

Field Summary

boolean	BINARY_COMPLEMENT
boolean	CROSS_PRODUCT
boolean	HAND_CRAFTED_VECTORS
boolean	INCREMENTAL_UPDATE
double	learningRate
double	multiplyAndAdd
boolean	RESIDUAL_ALGORITHM
boolean	SCALE_OUTPUT_VALUE

Constructor Summary

ValueFunctionResidualAlgorithmLinear()

ValueFunctionResidualAlgorithmLinear(World w)

Method Summary

java.lang.String	getName() It is important for value functions to have names for the patchwork approach, so that states can identify to which value function patch they belong by the PolicyExtractor.
double	getTotalIncrementalWeightChangeAndReset()
double	getValue(State state) Retrieve the value associated with a state (which may be different for non-stored states depending on the actual class implementing this value function).
void	setAllowExpansionOfStateBounds(boolean trueOrFalse)
void	setHiddenUnits(int newValue)
void	setLearningRate(double newValue)
void	setMaxMinValue(double newValue)
void	setName(java.lang.String name)
void	setResidualWeighting(double newValue)
void	setValue(State state, double newValue)
void	setValue(State thisState, State nextState, double newValue, double discountFactor)
void	setValueOfOutOfBoundsStates(double newValueOfOutOfBoundsStates)
void	setValueOfTerminalStates(double newValue) Many problems define a value of 0 for their terminal states, where the agent can remain.
void	setWorld(World w)
void	storeWeightChangesIfNonIncremental()
java.lang.String	toText()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CROSS_PRODUCT

public boolean CROSS_PRODUCT

BINARY_COMPLEMENT

public boolean BINARY_COMPLEMENT

HAND_CRAFTED_VECTORS

public boolean HAND_CRAFTED_VECTORS

learningRate

public double learningRate

multiplyAndAdd

public double multiplyAndAdd

RESIDUAL_ALGORITHM

public boolean RESIDUAL_ALGORITHM

INCREMENTAL_UPDATE

public boolean INCREMENTAL_UPDATE

SCALE_OUTPUT_VALUE

public boolean SCALE_OUTPUT_VALUE

Constructor Detail

ValueFunctionResidualAlgorithmLinear

public ValueFunctionResidualAlgorithmLinear(World w)

ValueFunctionResidualAlgorithmLinear

public ValueFunctionResidualAlgorithmLinear()

Method Detail

setWorld

public void setWorld(World w)

Specified by:

setWorld in interface ValueFunction

setName

public void setName(java.lang.String name)

Specified by:

setName in interface ValueFunction

getName

public java.lang.String getName()

Description copied from interface: ValueFunction

It is important for value functions to have names for the patchwork approach, so that states can identify to which value function patch they belong by the PolicyExtractor.

Specified by:

getName in interface ValueFunction

setValueOfOutOfBoundsStates

public void setValueOfOutOfBoundsStates(double newValueOfOutOfBoundsStates)

setAllowExpansionOfStateBounds

public void setAllowExpansionOfStateBounds(boolean trueOrFalse)

getTotalIncrementalWeightChangeAndReset

public double getTotalIncrementalWeightChangeAndReset()

getValue

public double getValue(State state)

Description copied from interface: ValueFunction

Retrieve the value associated with a state (which may be different for non-stored states depending on the actual class implementing this value function).

Specified by:

getValue in interface ValueFunction

setValue

public void setValue(State state,
                     double newValue)

Specified by:

setValue in interface ValueFunction

setResidualWeighting

public void setResidualWeighting(double newValue)

setHiddenUnits

public void setHiddenUnits(int newValue)

setLearningRate

public void setLearningRate(double newValue)

setMaxMinValue

public void setMaxMinValue(double newValue)

toText

public java.lang.String toText()

setValueOfTerminalStates

public void setValueOfTerminalStates(double newValue)

Description copied from interface: ValueFunction

Many problems define a value of 0 for their terminal states, where the agent can remain.

Specified by:

setValueOfTerminalStates in interface ValueFunction

setValue

public void setValue(State thisState,
                     State nextState,
                     double newValue,
                     double discountFactor)

storeWeightChangesIfNonIncremental

public void storeWeightChangesIfNonIncremental()