LanguageModel_Segmenter Class Reference

Public Member Functions | |
LanguageModel_Segmenter (int uniNr) | |
~LanguageModel_Segmenter () | |
void | transferTo (int word) |
void | finishModel () |
void | addPenalty (int word, double penalty) |
virtual float | getP (int newWordID, int *wordHistoryIn, int *wordHistoryOut) |
Protected Attributes | |
int * | transfer_uni |
int * | transfer_bi |
float * | probs_bi |
int | currentWord |
int | totalTransfer |
Constructor & Destructor Documentation
LanguageModel_Segmenter::LanguageModel_Segmenter | ( | int | uniNr | ) |
- Todo:
- Docs
References currentWord, probs_bi, totalTransfer, transfer_bi, transfer_uni, and LanguageModel::uni_tableLength.
LanguageModel_Segmenter::~LanguageModel_Segmenter | ( | ) |
Member Function Documentation
void LanguageModel_Segmenter::addPenalty | ( | int | word, | |
double | penalty | |||
) |
- Todo:
- Docs
References LMEntryType_1::p, probs_bi, LanguageModel::uni_lmData, and LanguageModel::uni_tableLength.
Referenced by Train_Segmenter::trainIteration().
void LanguageModel_Segmenter::finishModel | ( | ) |
- Todo:
- Docs
References currentWord, FastMath::log(), LMEntryType_1::p, probs_bi, totalTransfer, transfer_bi, transfer_uni, transferTo(), LanguageModel::uni_lmData, and LanguageModel::uni_tableLength.
Referenced by Train_Segmenter::trainIteration().

float LanguageModel_Segmenter::getP | ( | int | newWordID, | |
int * | wordHistory, | |||
int * | wordHistoryOut | |||
) | [virtual] |
- Todo:
- Docs
Reimplemented from LanguageModel.
References LMEntryType_1::p, probs_bi, LanguageModel::uni_lmData, and LanguageModel::uni_tableLength.
void LanguageModel_Segmenter::transferTo | ( | int | word | ) |
- Todo:
- Docs
References currentWord, totalTransfer, transfer_bi, transfer_uni, and LanguageModel::uni_tableLength.
Referenced by finishModel(), and Train_Segmenter::trainIteration().
Member Data Documentation
int LanguageModel_Segmenter::currentWord [protected] |
Referenced by finishModel(), LanguageModel_Segmenter(), and transferTo().
float* LanguageModel_Segmenter::probs_bi [protected] |
Referenced by addPenalty(), finishModel(), getP(), LanguageModel_Segmenter(), and ~LanguageModel_Segmenter().
int LanguageModel_Segmenter::totalTransfer [protected] |
Referenced by finishModel(), LanguageModel_Segmenter(), and transferTo().
int* LanguageModel_Segmenter::transfer_bi [protected] |
Referenced by finishModel(), LanguageModel_Segmenter(), transferTo(), and ~LanguageModel_Segmenter().
int* LanguageModel_Segmenter::transfer_uni [protected] |
Referenced by finishModel(), LanguageModel_Segmenter(), transferTo(), and ~LanguageModel_Segmenter().