Text miner synonym dictionary

Text miner synonym dictionary

book

Article ID: KB0074205

calendar_today

Updated On:

Products Versions
Spotfire Statistica 13.0 and higher

Description

This article explains how to define synonym in the text miner module.

Issue/Introduction

Text miner synonym dictionary

Environment

Windows

Resolution

Using Synonym under Words tab in the Text Mining analysis dialog is to specify words that are to be treated as synonyms during indexing and when computing results.

Synonyms can be defined in the Synonym dialog or selected from an existing text file.

To define synonyms:

1. Select the front checkbox under Words tab|Synonyms(replace, combine words) and click "Edit" button.

2. Enter "Root" and "Words" and click "Add new synonym" in the Synonym Dialog. Keep entering all root and words for all synonyms.

3. Click "OK" in the Synonym dialog, a Synonyms.txt file will be auto-generated under Statistica Examples folder, which saves the synonyms you entered in step 2.

To select an existing synonym list in a text file, click "select".

The general format for synonym in a text file should be as below. Note: A phrase needs be put under quotes in order to be treated as a single word and synonyms are separated by comma.

WordA : SynonymA1, SynonymA2, SynonymA3, ...
WordB : SynonymB1, SynonymB2, "Synonym in a phrase"...

The search mechanism for synonym is from top line to bottom, left to right until a match is found. When identical words exist in the synonym list of different keywords, the synonym will resolve to the first keyword it encounters.

Example 1:

Good: Positive, "not bad"

Superior: Positive, "better than",excellent

In Example 1, the word "Positive' will resolve to the root:"Good".

Example 2:

able: capable, ability

capable: able

In Example 2, the word "capable" will resolve to the root: "able".