Package edu.berkeley.nlp.lm.phrasetable
Class PhraseTableValueContainer
- java.lang.Object
-
- edu.berkeley.nlp.lm.phrasetable.PhraseTableValueContainer
-
- All Implemented Interfaces:
ValueContainer<PhraseTableValueContainer.PhraseTableValues>
,java.io.Serializable
public final class PhraseTableValueContainer extends java.lang.Object implements ValueContainer<PhraseTableValueContainer.PhraseTableValues>
Stored type and token counts necessary for estimating a Kneser-Ney language model- Author:
- adampauls
- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static class
PhraseTableValueContainer.FeaturePhraseTableValues
static interface
PhraseTableValueContainer.PhraseTableValues
static class
PhraseTableValueContainer.TargetTranslationsValues
-
Constructor Summary
Constructors Constructor Description PhraseTableValueContainer(int separatorWord, int numFeatures)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description boolean
add(int[] ngram, int startPos, int endPos, int ngramOrder, long offset, long contextOffset, int word, PhraseTableValueContainer.PhraseTableValues val, long suffixOffset, boolean ngramIsNew)
Adds a new value at the specified offset.void
clearStorageForOrder(int ngramOrder)
PhraseTableValueContainer
createFreshValues(long[] numNgramsForEachOrder_)
Creates a fresh value container for copying purposes.void
getFromOffset(long offset, int ngramOrder, PhraseTableValueContainer.PhraseTableValues outputVal)
Gets the value living at a particular offset.PhraseTableValueContainer.PhraseTableValues
getScratchValue()
Creates a fresh value of object (useful for passing as an output parameter)int
getSeparatorWord()
int
numValueBits(int ngramOrder)
void
setFromOtherValues(ValueContainer<PhraseTableValueContainer.PhraseTableValues> other)
Destructively sets internal storage from another object.void
setMap(NgramMap<PhraseTableValueContainer.PhraseTableValues> map)
Initializes a value container with the map that contains itvoid
setSizeAtLeast(long size, int ngramOrder)
Sets internal storage for size for a particular n-gram orderboolean
storeSuffixoffsets()
void
trim()
Final clean up of storage.void
trimAfterNgram(int ngramOrder, long size)
Clear storage after an n-gram order is complete
-
-
-
Method Detail
-
createFreshValues
public PhraseTableValueContainer createFreshValues(long[] numNgramsForEachOrder_)
Description copied from interface:ValueContainer
Creates a fresh value container for copying purposes.- Specified by:
createFreshValues
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
- Returns:
-
getFromOffset
public void getFromOffset(long offset, int ngramOrder, PhraseTableValueContainer.PhraseTableValues outputVal)
Description copied from interface:ValueContainer
Gets the value living at a particular offset.- Specified by:
getFromOffset
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
trimAfterNgram
public void trimAfterNgram(int ngramOrder, long size)
Description copied from interface:ValueContainer
Clear storage after an n-gram order is complete- Specified by:
trimAfterNgram
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
getScratchValue
public PhraseTableValueContainer.PhraseTableValues getScratchValue()
Description copied from interface:ValueContainer
Creates a fresh value of object (useful for passing as an output parameter)- Specified by:
getScratchValue
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
- Returns:
-
add
public boolean add(int[] ngram, int startPos, int endPos, int ngramOrder, long offset, long contextOffset, int word, PhraseTableValueContainer.PhraseTableValues val, long suffixOffset, boolean ngramIsNew)
Description copied from interface:ValueContainer
Adds a new value at the specified offset.- Specified by:
add
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
ngramOrder
- As always, ngramOrder is 0-based (0=unigram)- Returns:
- Whether or not the add was successful
-
setSizeAtLeast
public void setSizeAtLeast(long size, int ngramOrder)
Description copied from interface:ValueContainer
Sets internal storage for size for a particular n-gram order- Specified by:
setSizeAtLeast
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
setFromOtherValues
public void setFromOtherValues(ValueContainer<PhraseTableValueContainer.PhraseTableValues> other)
Description copied from interface:ValueContainer
Destructively sets internal storage from another object.- Specified by:
setFromOtherValues
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
trim
public void trim()
Description copied from interface:ValueContainer
Final clean up of storage.- Specified by:
trim
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
setMap
public void setMap(NgramMap<PhraseTableValueContainer.PhraseTableValues> map)
Description copied from interface:ValueContainer
Initializes a value container with the map that contains it- Specified by:
setMap
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
getSeparatorWord
public int getSeparatorWord()
-
clearStorageForOrder
public void clearStorageForOrder(int ngramOrder)
- Specified by:
clearStorageForOrder
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
storeSuffixoffsets
public boolean storeSuffixoffsets()
- Specified by:
storeSuffixoffsets
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
numValueBits
public int numValueBits(int ngramOrder)
- Specified by:
numValueBits
in interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
-