Class CommonTokenResult

java.lang.Object
org.apache.tika.eval.core.tokens.CommonTokenResult

public class CommonTokenResult extends Object
  • Constructor Details

    • CommonTokenResult

      public CommonTokenResult(String langCode, int uniqueCommonTokens, int commonTokens, int uniqueAlphabeticTokens, int alphabeticTokens)
  • Method Details

    • getLangCode

      public String getLangCode()
      Returns:
      the language used to select the common_tokens list
    • getCommonTokens

      public int getCommonTokens()
      Returns:
      total number of "common tokens"
    • getUniqueCommonTokens

      public int getUniqueCommonTokens()
      Returns:
      number of unique "common tokens" (types)
    • getUniqueAlphabeticTokens

      public int getUniqueAlphabeticTokens()
      Returns:
      number of unique alphabetic tokens (types)
    • getAlphabeticTokens

      public int getAlphabeticTokens()
      Returns:
      number of tokens that had at least one alphabetic/ideographic character whether or not a common token
    • getOOV

      public double getOOV()