Processing Short Message Format (RSMF)

RSMF was made for the handling, delivery, and transporting of short message information and records.

Why RSMF?

RSMF files are used in the handling, delivering, and transporting of short message information and records. What follows is a description of how Reveal handles short message format data from ingestion and processing to review.

What is an RSMF File?

Information from chat applications like Slack, Teams, SMS and WhatsApp are encapsulated into one RSMF file. This RSMF contains the text and metadata packaged from the source data.

What are the technical specifications of an RSMF?

In short, an RSMF file is an EML file with a ZIP attachment.

The EML file is an RFC 5322 standard and compliant internet message formatted file that has an .rsmf extension. The EML is partitioned into a “header” section and a “body” section which contain previews of the participants and messages.

The EML also contains an attachment rsmf.zip. The rsmf.zip file attachment will contain an “rsmf_manifest.json” as well as any attachments or avatar files.

This results in a short messaging package to be processed and pushed into Review.

What is the RSMF_MANIFEST.JSON File?

The rsmf_manifest.json is a specifically-formatted JSON file containing the activity in the short messages, such as:

• Participants

• Conversations

• Events

• Event Collection IDs (this was introduced in RSMF 2.0)

Reveal Processing and RSMF Handling

Reveal Processing has been engineered to improve positive identification of RSMF as a distinct file type and process these data in a format that is required for the Reveal review environment.

The primary requirement for the processing of RSMF files is the RFC RSMF wrapper (the EML) which contains the header and body. The header has a required field (X-RSMF-Version) for processing to truly identify the content for full processing support. This is true for both RSMF versions 1.0 and 2.0. Inside the RSMF.ZIP wrapped in the EML are an RSMF file and the rsmf_manifest.json file. 

• The RSMF file contains virtual paths and instructions to process the content that resides in the rsmf_manifest.json. 

• The manifest will contain the participants, conversations, events, and event collection ids.

• Attachments and avatars will also fall inline inside the RSMF.zip file.

• Further support of the RSMF 2.0 specification will be evaluated based on requested functionality requirements.

During Archive Processing, Filetype 10007 (RSMF_ZIP Files) requires special processing from standard zip files. Data are stored on the event level and aggregated, with conversations split into a 24-hour time period as a single ‘document’ for export with the associated metadata provided as a record. If a conversation spans multiple 24-hour periods (or 'slices'), the relationship will be identified. There will be metadata containing some of the key information, such as communicators (participants), time period, communication type, multi-document number tracking.

To review the RSMF handling workflow in Reveal, please see Short Message Format Workflow.