Processing - 10.3 Release Notes

Story

PROC-1730

Uploader JobName to DataImports LoadFileDescription

In the Discover Manager, any SaaS uploaded imports will now display the Job Name set by the uploader as opposed to path to the associated JSON file used in the upload process. This will match the coordinating Export name used to send to review.

Story

PROC-1712

Update default field mapping to Review to include TVFILEID, TVFAMILYID, Application Type, & Exif information

New Import Mapping created for new projects that add fields to include the TVFILEID (which is the unique identifier of any file in Processing).

Story

PROC-1524

Create PDFs directly from native files

Added ability to generate PDFs directly from native files without conversion to tiff as an intermediary step.

Story

PROC-934

Reveal Processing Billing Report | Feature Request

Enhancements to the billing report.

Story

PROC-927

Add Fielded Search Capabilities for eFile Metadata

Additional metadata fields can be added and searched in index.

Story

PROC-925

Ingest Data Directly from S3

Added the ability to process directly from S3 buckets in AWS.

Story

PROC-922

OCR Index Status in Preview

Corrected issue where a document indexed from OCR was showing as not indexed.

Story

PROC-921

Features Missing from Project Settings Report

Enhancements to the Project Settings report.

Story

PROC-918

Make processing reports interactive

Added interactive actions to specific reports. This will auto create new selective sets.

Story

PROC-908

Remove Custodian Prefix Requirement

No longer is a prefix required when creating a Custodian.

Story

PROC-906

Extend import custodian assignment to 3 folders deep

Go down and allow for assignment 3 levels in the import module.

Story

PROC-904

Project template reselection from dropdown

If choosing a Project level template and then deciding incorrect one was chosen, the user can now re-select project level templates.

Story

PROC-903

Manage Template button behavior confusing

Redesigned the management of project level templates.

Story

PROC-894

ICS\VCF Hashing/Dedupe

Added in new functionality in the handling of ICS and and recurring appointment emails in relation to hashing. The user can now determine if they want recurring appointments as separate email entries.

Story

PROC-846

Allow for Project Level Templates to be Re-Named

Renaming project level templates now allowed.

Story

PROC-842

Added Column for Archive Extraction Errors Report

Added Actual Parent items column in the Archive Extraction Errors report.

Story

PROC-828

Add New Features into Project Settings Report

All new project level filters added are now reflected accurately in the Project settings report.

Story

PROC-826

Add Counter to Update Projects Tool Popup

Counter added to the Project Updater tool.

Story

PROC-821

Ability to Direct Agents to Specific Jobs

This allows our on prem clients to set the number of agents and the priority level for a specific task as there is not AWS automation present in their environment.

Story

PROC-815

Processing Project Renaming to Follow Review Renaming

If a user changes a Review case name, this will subsequently change the associated Processing Project's name to match.

Story

PROC-808

Add "SOURCEPATH" Field to Load File and Mappings

Added new field SOURCEPATH to load file options and update Field mappings. This field will contain the top level folder selected at import.

Story

PROC-791

Password Used to Decrypt Files as Load File Option

Added a Password Field in load file options that would display the name of the password used to decrypt a file.

Story

PROC-785

Track Doc Level OCR Time

Added in database level tracking the time files took to OCR as column OCRDuration added into Files table.

Story

PROC-784

Add Parent Archive Size to Export Summary

Added in space estimated that will be used at any temp location for a specified export in Export summary. This allows the end user to make sure ample space is available for the export.

Story

PROC-783

Add Import ID as Load File option

ImportID added as load file option.

Story

PROC-778

Project\Export Template Migration Tool

Added ability to export\migrate export templates in On Prem environments.

Story

PROC-880

EXIF & New Fields in Processing/Review

Added in expanded metadata dives for Image file types and coordinating EXIF load file options.

Fix

PROC-1729

Native Format Export Missing Natives

Corrected issue with Natives Only Exports and failure to complete due to access to final archive retrieved.

Fix

PROC-1728

Removed Review ProjectID Character Limitation

Removed the limitation of giving Review Case id more than 10 characters.

Fix

PROC-1685

Fatal Error when Launching Agent from Discovery Manager

Corrected databased connection issue when launching discovery agents.

Fix

PROC-1663

Review Append Exports Failing due to characters in Export LoadFile Path/FileName

Resolved Issues in Review Append Exports in which special characters caused failures.

Fix

PROC-1649

Zip Processing Errors Out - NIST issue

In Embedded Object projects, stalls due to invalid files (filtered files) being referenced in the JobDocs table no longer will cause stalls in Import or Import QC.

Fix

PROC-1627

Project settings: Email Options - GenerateProjectMD5file checkbox value remains unchecked

Resolved selection persistence issue in Email Options tab

Fix

PROC-1618

Tab Character in File Extension

Enhanced handling of filenames containing control characters

Fix

PROC-1603

DD/E01 Erroring with Missing Dependency

Enhanced Forensic Image Processing

Fix

PROC-1602

Re-implement the 'Field out all email metadata' option

Reimplementation of the 'all fielded metadata' feature, but with more control and increased performance.

Fix

PROC-1595

Processing Discovery: Selective Set - App crashes when adding ImagingPDF File Status clause

Corrected issues with Fatal crashes in selective sets when including Imaging jobs.

Fix

PROC-1572

Processing Discovery: Reveal Processing Service - Could not find part of the TEMP path

Worked on issues with On Prem Processing Agents not checking in after an upgraded version is used.

Fix

PROC-1571

Processing Discovery Manager: Manage Templates - Change Prompt icon

Redesigned the Management of Project level templates.

Fix

PROC-1569

Uploader Failure - UNASSIGNED Custodian Issue

Issue where uploader jobs fail due to the selection of the UNASSIGNED Custodian will no longer occur.

Fix

PROC-1567

Cannot Create New Instance in Discovery Manager

Issues creating new instances via the Discovery Manager have been resolved.

Fix

PROC-1553

Import QC not Working for PST Attachment Issues

Improved Import QC in relation to remediation of PST attachment issues.

Fix

PROC-1541

CLI Processing Installation: Initialize instance - Issue trying to reach the server

Improved issues with On Prem CLI installer.

Fix

PROC-1540

Multi-Page Tiffs and Searchable PDF's Creation During Export of Images Failing

Corrected an issue with the exporting of images and the options of either multi-part tiffs or searchable pdf files not being available.

Fix

PROC-1537

Folder replacement in import QC is not working with S3

Corrected issues with Import QC folder replacement options in SaaS environments.

Fix

PROC-1521

Replace File in Import QC /w replacement larger than 5GB causing error

Improved Import QC and file replacement options in relation to files that exceed 5 GB in size.

Fix

PROC-1294

Uploader Deduplication Checkbox not Working as Expected.

Corrected issue with the uploader in relation to deduplication option not working as expected.

Fix

PROC-1291

Selective Set Note Ellipses not Working

Corrected an issue in selective set File Id List options in relation to the inability to drive to the text list option.

Fix

PROC-1289

Import Error

Corrected issues in relation to Import\Import QC stalls in relation to some .7z files.

Fix

PROC-1288

Duplicative TVFILEIDs in Review cause Overlay Errors

Improved SaaS review overlay exports. Eliminated errors in relation to use of File IDs exported in multiple exports.

Fix

PROC-1192

Template Saving Issue - Import QC\Preview

Corrected issues saving templates from Search and selective set previews.

Fix

PROC-1193

Automate SCANPST not Working as Expected

Corrected issues with instances of Automate SCANPST not launching automatically as expected in specific sub versions of Outlook that support the feature.

Fix

PROC-1188

Uploader Export Created for Exports with 0 Files

Uploader jobs that have 0 files to export will not create "empty" export jobs causing stalls in updating Upload job screen in review.

Fix

PROC-1183

Missing Natives Causing Import QC to Error

If a native does not exist when attempting to QC in the Discovery Manager, this will not cause fatal errors closing the application, but instead an error warning.

Fix

PROC-1185

TaskType 3 and 9 Leaving Imports Stalled

Corrected issues with invalid filetypes being routed for indexing causing both Imports and Import QC jobs to reach a Finalizing state and never moving forward.,

Fix

PROC-1208

Preview from Search Module

Corrected issues where launching to Preview from the search module was not executing as expected.

Fix

PROC-1228

Uploader Forensic Images Failing

Corrected issues with uploaded forensic images failing to mount and extract contents as expected in SaaS deployments.

Fix

PROC-1230

Uploader 5GB Limit

Removed any file size limitation on uploader jobs. While suggestion to keep loads at less than 5GB is in place, this is not going to cause job failures.

Fix

PROC-1225

Cannot Associate Processing\Review Clients in UK Region

Corrected issues in SaaS environments with inability to associate Processing and Review Clients.

Fix

PROC-1252

Import QC Bringing in Incomplete Imports

Eliminated the ability to start an Import QC job on any import that is in progress.

Fix

PROC-1247

Export Issue - [MergeBegDocs] SQL (8152):String or binary data would be truncated.

Corrected issues when correcting BegDoc values in SaaS append exports when a collision is determined.

Fix

PROC-1249

.7z File Stalls Import

Addressed 7zip archive format handling.

Fix

PROC-1245

Save Native not working

Corrected issues in relation to Save Native option causing failures in import\export in SaaS environments.

Fix

PROC-1239

Password Bank via Import QC not Working

Corrected issues with Password Bank not passing passwords as expected to encrypted files.

Fix

PROC-1237

Near Dupe Job Creates but all Files Fail Hashing

Corrected issues with Processing Near Duplicate jobs failing to complete.

Fix

PROC-1263

Search Syntax Link Broken in Discovery Manager

dtSearch link in search & Indexing module properly routes to the Help page as expected.

Fix

PROC-1259

Adding Date Restricted Search Groups in Selective Sets Performance

Improved performance in selective sets in relation to Search Groups and inclusion of Date Restrictions.

Fix

PROC-1260

Review Append Export Failure Special Character

Corrected issues with special characters in Review append exports causing failures to complete.

Fix

PROC-1258

Import Deletion

Users should be able to properly delete imports as expected in the SaaS Discovery Managers.

Fix

PROC-1277

Cannot Run Import QC Archive Replacement

Corrected issues with File Level replacement in Import QC.

Fix

PROC-1275

Issue With NSF .ICS Files - Metadata

Improved handling of NSF .ics files.

Fix

PROC-1125

PST Processing Speed 10.1.2.022

This was corrected in v10.2 and does cascade in 10.3 deployments.

Fix

PROC-1123

Issue with Ingestion of Loose emls

Improved .eml processing speeds causing long delays in Imports and Import QC.

Fix

PROC-1134

Issue with Snapshot Report

Corrected issues with incorrect counts returned in the Snapshot report that differed from the actual snapshot in the application in relation to inclusion of Filtered files.

Fix

PROC-1147

Add Sliders to Environment Module

Improved ability to change views in the environment module by adding adjustable sliders.

Fix

PROC-1141

Split Families in Embedded Object Projects From Archives

Corrected any issues in family relation in embedded archive children.

Fix

PROC-1157

Domain Field Showing x\400 Address in Addition to Parsed SMTP Address

Improved upon errors seen in relation x\400 and SMTP email address normalization.

Fix

PROC-1154

Fatal Error Export FileID (Doc Level) Adding to Selective Set

Corrected issues in relation to adding exported file ids in the File ID option in selective sets.

Fix

PROC-1153

Auto-Filter Issue in Sender/Recipients Domain Tab

Corrected issues in Auto filtering in Sender\Recipient tabs in selective sets.

Fix

PROC-1151

Cannot Create Review Case When Creating Processing Project.

Corrected issues in creating Review cases directly in Processing when creating Processing projects.

Fix

PROC-1179

File Signature Tab Blank

Corrected issues in blank values in File Signature tab\option in selective sets.

Fix

PROC-1209

Export Templates Cause Fatal Error

Accessing previously created export templates will no longer causes errors.

Fix

PROC-1402

After Linking with, or Creating, a Review Project to the Processing (Discovery Manager) Export Module Does Not See Import Mapping Template

After associating a project in Processing to a Review case via the Discovery Manager, the user no longer needs to exit the application to see the Import mapping in the Review Append export options.

Fix

PROC-1465

FILESIZE = EXPORTFILESIZE in Review Append Exports

EXPORTFILESIZE fields in load file options now properly capturing the sizes of the actual files exported and not the value store in the database (FILESIZE).

Fix

PROC-773

ExportSettings Table not Deleted with Deleted Exports Causing BegDoc Collision

Corrected issues where fields that were in a deleted export are no longer saved in the database causing issues with the Files In Review option which causes overlay issues.

Fix

PROC-737

Fatal Error ESI Summary Report

The ESI Summary report will no longer cause a fatal error when generating on a scope with 0 files assigned to a Custodian.

Fix

PROC-1800

Fix issue in processing from S3 where part of the path is being truncated.

Importing from S3 pointing to the top level folder, which looks like this in the UI: S3://revealdata-s3staging-108000/Persistent/proc-source/PilotData/01.

This imported and processed the data as expected, but the Importpaths for the data were missing the top level folder and the lower level subfolders. The import path stored now contains the entire folder structure from the starting folder location down to the actual data.

Fix

PROC-1805

Users are unable to associate custodians at the folder level when processing from S3.

Following the item noted under PROC-1800: users have the ability to assign data to Custodians at Import time (manually ingesting in the Discovery Manager). In 10.3 we did not see the option to assign the data, and even manual assignment in the Custodian module wasn't possible at the folder level.

Users can now see the folder path present in the Folder column and should be able to assign Custodians when processing data from S3.

Fix

PROC-1806

Issue with field mapping in 10.3.

In Review Overlay and append export types in upgraded projects a popup appeared warning Value was either too large or too small for an int32... The errors seen in the database referenced fields in the new Processing mapping for Review 10.4.

Fix

PROC-1808

TaskType 3 and 9 Leaving Imports Stalled.

While the race condition allowing for these task types was addressed in both Import and ImportQC, there was an additional bug in Import QC that would cause TaskType of 9 where OCR did not complete successfully to be orphaned from the first batch of jobdocs retrieved for tasktype 9. This was being caused by an incorrect parameter being passed to the UpdateJobDocStatus method (task type value of 8 instead of 9) and has been corrected.