TRF Language Model
SA Training

Classes

class  trf::AISConfig
 
class  trf::ThreadData
 
class  trf::SAfunc
 
class  trf::LearningRate
 
class  trf::SAtrain
 

Detailed Description

Define the classes that carry out the SA-training progress.
During each iteration, sample miniBatchSample times and calculate the expectation in respect to the distribution.
Update the parameters using the gradient: p_emp[f]-p_distri[f]