- 19 Nov 2024
- 6 Minutes to read
- Print
- DarkLight
- PDF
Reveal AI Document Sync Matrix
- Updated on 19 Nov 2024
- 6 Minutes to read
- Print
- DarkLight
- PDF
Below is a list of fields that are added by the AI document sync process in Reveal. The fields fall into three groups – fields from the Brainspace (BRS) overlay, entity fields, and emotional intelligence scores.
Field Category | Review (Web) Display Name | REVIEW SQL FIELD NAME | Description |
BD Overlay | BD ClusterPath | CLUSTERPATH | The full list of cluster ids to reach the current document. It will start with the root (0) and go out to the RELATEDSETID, then if applicable on to near dup cluster and exact dup cluster. Format: /0/126/133/239/1124/267/7222 |
BD Overlay | BD DupType | DUPTYPE | Type of duplicate: Exact, Near |
BD Overlay | BD EMT AttachmentCount | EMT_ATTACHMENTCOUNT | Number of attachments to an email document. |
BD Overlay | BD EMT DuplicateID | EMT_DUPLICATEID | Identifier assigned to documents for the purpose of relating exact duplicates. |
BD Overlay | BD EMT EmailAction | EMT_EMAILACTION | Type of message: Send, Reply, ReplyAll, Forward, or Draft. |
BD Overlay | BD EMT FamilyID | EMT_FAMILYID | Identifier assigned to documents for the purpose of relating emails and their attachments. |
BD Overlay | BD EMT Intelligent Sort | EMT_INTELLIGENT SORT |
|
BD Overlay | BD EMT IsDuplicate | EMT_ISDUPLICATE | Specifies if this document is a duplicate: True/False. |
BD Overlay | BD EMT IsMessage | EMT_ISMESSAGE | Specifies if this document is an email: True/False. |
BD Overlay | BD EMT IsUnique | EMT_ISUNIQUE | Message is unique, due to the message itself and/or an attachment. (brs_emt_unique_reason details why it is unique.) |
BD Overlay | BD EMT MessageCt | EMT_MESSAGECT |
|
BD Overlay | BD EMT ThreadHasMissingMessage | EMT_THREADHASMISSINGMESSAGE | Email thread has been identified to have a message that i0s not present in the dataset. |
BD Overlay | BD EMT ThreadID | EMT_THREADID | Identifier assigned to documents for the purpose of relating the content in email threads. All Emails and attachments within the thread will have the same EMT_THREADID. |
BD Overlay | BD EMT ThreadIndent | EMT_THREADINDENT | Specifies the display of emails within a tiered system. The original message is assigned a value of 0. All corresponding messages, such as forwards and replies, are staggered beneath the original, stepped in as specified for each "re:" or "fw:" in the email chain. |
BD Overlay | BD EMT ThreadPath Full | EMT_THREADPATH FULL | The list of document ids to lead to the current document in the email chain, using the document keys (Control Number or BegBates). For example, FirstEmailID;SecondEmailID;thirdEmailID might specify a forward of a reply to an original message. |
BD Overlay | BD EMT ThreadSort | EMT_THREADSORT | Allows you to sort documents within an email thread in chronological order. |
BD Overlay | BD EMT UniqueReason | EMT_UNIQUEREASON | Specifies why the email was flagged as unique: Message, Attach, or Message_and_Attach. |
BD Overlay | BD EMT WasUnique | EMT_WASUNIQUE | Specifies if a document was unique in a previous build, but after incremental build is no longer unique: True/False. |
BD Overlay | BD EMT WasUniqueReason | EMT_WASUNIQUEREASON | Specifies why a document was flagged as unique in a previous build, but after incremental build is no longer unique: Message, Attach, or Message_and_Attach. |
BD Overlay | BD ExactDupSetID | EXACTDUPSETID | Identifier assigned to documents for the purpose of relating exact duplicates. |
BD Overlay | BD ExactDupStatus | EXACTDUPSTATUS | Specifies the document’s status as part of an exact duplicate set: ExactOrig, ExactDupe. |
BD Overlay | BD IsExactPivot | ISEXACTPIVOT | Specifies if a document is the ExactOrig pivot in an Exact Duplicate Set: True/False. |
BD Overlay | BD IsNearDupPivot | ISNEARDUPPIVOT | Specifies if a document is the ExactOrig pivot in a near duplicate set: True/False. |
BD Overlay | BD IsStrictDupPivot | ISSTRICTDUPPIVOT | Specifies if a document is the ExactOrig pivot in a strict duplicate set: True/False. |
BD Overlay | BD Languages | LANGUAGES | A list of languages found in a document (according to the language detector). |
BD Overlay | BD NearDupSetID | NEARDUPSETID | Identifier assigned to documents for the purpose of relating near duplicates. |
BD Overlay | BD NearDupSimilarityScore | NEARDUPSIMILARITYSCORE | A document’s degree of similarity to the pivot document of its near duplicate set. |
BD Overlay | BD NearDupStatus | NEARDUPSTATUS | Specifies the document’s status as part of a near duplicate set: NearOrig, NearDupe |
BD Overlay | BD Primary Language | PRIMARY LANGUAGE | The single most likely and prominent language in a document (according to the language detector). |
BD Overlay | BD RelatedSetID | RELATEDSETID | Specifies the cluster ID in which a related document is contained. The Related Cluster is the one closest to the outside edge that is neither an Exact Dup cluster nor a Near Dup cluster. (The document may also have NearDupSetID and ExactDupSetIDs.) |
BD Overlay | BD StrictDupSetID | STRICTDUPSETID | Identifier assigned to documents for the purpose of relating strict duplicates. |
BD Overlay | BD StrictDupStatus | STRICTDUPSTATUS | Specifies the document’s status as part of a strict duplicate set: StrictOrig, StrictDupe. |
BD Overlay | BD Summary | SUMMARY | Provides a brief summary of the text of each document |
BD Overlay | BDID | BDID | Brainspace Unique Identifier for a document. |
Emotional Intelligence Fields | INTENT SCORE | _EMS_INTENT_SCORE | Analytic score for intentionality of document language. |
Emotional Intelligence Fields | Negative Snippets | _EMS_NEGATIVE_SNIPPETS | Excerpt of document containing negative language. |
Emotional Intelligence Fields | Negativity | _EMS_NEGATIVITY_SCORE | Analytic score for negativity of document language. |
Emotional Intelligence Fields | OPPORTUNITY SCORE | _EMS_OPPORTUNITY_SCORE | Analytic score for opportunity of document language. |
Emotional Intelligence Fields | Positive Snippets | _EMS_POSITIVE_SNIPPETS | Excerpt of document containing positive language. |
Emotional Intelligence Fields | Positivity | _EMS_POSITIVITY_SCORE | Analytic score for positivity of document language. |
Emotional Intelligence Fields | PRESSURE SCORE | _EMS_PRESSURE_SCORE | Analytic score for pressure of document language. |
Emotional Intelligence Fields | RATIONALIZATION SCORE | _EMS_RATIONALIZATION_SCORE | Analytic score for rationalization in document language. |
Emotional Intelligence Fields | ROUNDABOUT STYLE SCORE | _EMS_ROUNDABOUT_STYLE_SCORE | Analytic score for roundabout style of document language, which may indicate evasiveness. |
Entity Fields | Brs Has Entity | BRS_HAS_ENTITY | Specifies if a document contains reference to one or more entities: True/False. |
Entity Fields | Brs Has Entity Type | BRS_HAS_ENTITY_TYPE | Specifies the entity that caused the document to be flagged under BRS_HAS_ENTITY: Credit Card Number, Email, Location, Money, Nationality, Organization, Person, Personal ID Number, Phone Number, Product, Religion, Title, URL. |
Entity Fields | Entity Count | ENTITY_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Count Unique | ENTITY_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Credit Card Num | ENTITY_CREDIT_CARD_NUM | A sequence of numbers that are detected as patterns used by the major credit card providers. |
Entity Fields | Entity Credit Card Num Count | ENTITY_CREDIT_CARD_NUM_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Credit Card Num Count Unique | ENTITY_CREDIT_CARD_NUM_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Email | ENTITY_EMAIL | A sequence of characters that appear to be legitimate email addresses. |
Entity Fields | Entity Email Count | ENTITY_EMAIL_COUNT | Number of emails found in the entity cluster. |
Entity Fields | Entity Email Count Unique | ENTITY_EMAIL_COUNT_UNIQUE | Number of emails containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Location | ENTITY_LOCATION | - A city, state, country, region, or other location that contains both a population and a government. - A geographic place such as a body of water, mountain, park, or address. - A structure such as a building or monument. |
Entity Fields | Entity Location Count | ENTITY_LOCATION_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Location Count Unique | ENTITY_LOCATION_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Money | ENTITY_MONEY | A sequence of symbols, numbers and/or words that are detected as referencing money. |
Entity Fields | Entity Money Count | ENTITY_MONEY_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Money Count Unique | ENTITY_MONEY_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Nationality | ENTITY_NATIONALITY | Reference to a country or region of origin, such as American or Swiss. |
Entity Fields | Entity Nationality Count | ENTITY_NATIONALITY_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Nationality Count Unique | ENTITY_NATIONALITY_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Organization | ENTITY_ORGANIZATION | A corporation, institution, government agency, or other group of people defined by an established organizational structure. |
Entity Fields | Entity Organization Count | ENTITY_ORGANIZATION_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Organization Count Unique | ENTITY_ORGANIZATION_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Person | ENTITY_PERSON | A human identified by name, nickname, or alias. |
Entity Fields | Entity Person Count | ENTITY_PERSON_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Person Count Unique | ENTITY_PERSON_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Personal Id Num | ENTITY_PERSONAL_ID_NUM | A series of digits in a pattern detected as a national or well-known personal identifier. |
Entity Fields | Entity Personal Id Num Count | ENTITY_PERSONAL_ID_NUM_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Personal Id Num Count Unique | ENTITY_PERSONAL_ID_NUM_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Phone Number | ENTITY_PHONE_NUMBER | A series of digits in a pattern detected as a phone number. |
Entity Fields | Entity Phone Number Count | ENTITY_PHONE_NUMBER_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Phone Number Count Unique | ENTITY_PHONE_NUMBER_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Product | ENTITY_PRODUCT | Reference to a commercially available product. |
Entity Fields | Entity Product Count | ENTITY_PRODUCT_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Product Count Unique | ENTITY_PRODUCT_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Religion | ENTITY_RELIGION | Reference to an organized religion or theology as well as its followers. |
Entity Fields | Entity Religion Count | ENTITY_RELIGION_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Religion Count Unique | ENTITY_RELIGION_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Title | ENTITY_TITLE | Appellation associated with a person by virtue of occupation, office, birth, or as an honorific. |
Entity Fields | Entity Title Count | ENTITY_TITLE_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Title Count Unique | ENTITY_TITLE_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |
Entity Fields | Entity Url | ENTITY_URL | Web address. |
Entity Fields | Entity Url Count | ENTITY_URL_COUNT | Number of documents found in the entity cluster. |
Entity Fields | Entity Url Count Unique | ENTITY_URL_COUNT_UNIQUE | Number of documents containing content that is not contained in any other message in the entity cluster. |