Post-Import Snapshot and Controls

Once data has been imported into a project, many controls become available for managing, reviewing, and taking actions related to the import. The image below provides an overview of these controls, including options such as viewing the import status, addressing errors, editing properties, and exploring processed archives. Each numbered element in the image is subsequently explained in greater detail.

11. Import Status – The import Status chart displays counts for all import items which are not successfully completed. The chart updates every 10 seconds and reports on the tasks for the import job, broken down by the following categories:

    • Copy – The copying of a source file into the project.

    • Archive – Decompressing of unique archives within the import.

    • Hidden Content – The evaluation of hidden content on original documents within the import.

    • Password Bank – The attempt to decrypt unique password protected documents within the import with the provided passwords.

    • OCR – OCR processing of unique documents within the import when OCR during import is enabled.

    • Indexing/Language ID – The indexing and/or language identification for generated OCR text and Extracted text from unique documents within the import.

12. Import Snapshot – After the import has completed processing the Import Snapshot will be populated with a bar graph containing the following measurements:

    • Source Files – This is the number of files imported into Discovery Manager before processing. This number should mirror the total number of files on the import media. It allows QC to make sure that the number of files imported into Discovery Manager before processing is the same number of files that was on the source media.

    • Expanded Files – Total number of files (source files and archive children) after processing prior to any data filtering.

    • Archives – Total number of completed and errored archives contained within the import.

    • Errored Archives – Total number of errored archives in the import.

    • Filtered Files – Total number of files filtered out of the project due to project level filters (Date, File Type, deNIST).

      Note

      This count also includes inline image attachments removed with the "Suppress Inline Image Email Attachments" option within the Embedded Object settings.

    • Project Files – Total number of files contained within the project after processing and filtering.

    • Duplicates – Total number of duplicates contained within the import.

    • Indexed – Total number of successfully indexed files within the Project Files. These are the files that are available for searching within the index. A file can have both electronic and OCR text. If the file has one or more of these text types, the file will be considered Indexed and one or both text files will be indexed for searching.

    • OCR Success – Total number of files that successfully completed the OCR process within the import.

    • OCR Errors – Total number of files that errored during the OCR process within the import.

    • OCR Pending – Total number of files that are potentially scanned within the project. This will consist of all TIFF images as well as image based PDF files.

    • Non-Indexable Files – Total number of files where text extraction will not be attempted as Reveal believes no usable text will be generated from these file types. For a complete listing of these files please see Appendix B. These files will not be available for searching.

    • Encrypted – Total number of files identified as encrypted or password protected and that do not have text extracted. These files can be decrypted by using the Password Bank. Please see the Create an Import Job for directions on how to do this. If these files are not decrypted, they will not be available for searching.

    • Index Errors – Total number of files where both text extraction and OCR has failed. These files will not be available for searching.

    • File Recognition Errors – Total number of unrecognizable file types contained within the import. These files will not be available for searching.

13. Imports Module Navigation – Each import has an icon, import path/ID, and a tree view. The following explains the different import icons and their meaning:

    • Import Icons
      Successful Import

      • • After the import has completed processing successfully, the Successful Import icon will be displayed in the Imports Module Navigation. Double click on the Successful Import icon and Import Snapshot as well as Import Data under the Module’s Form are repopulated with the information from the import.
          Paused Import

        • To suspend an import while it is processing click the Pause Import button in the Import Ribbon. This will suspend the import at that moment in time. After an import has been suspended the Paused Import icon will be displayed for the import in the Imports Module Navigation. To resume a suspended import, click on the Paused Import icon and then click on the Resume Import button in the Import Ribbon.
          In Progress Import

        • If an import is in progress, the In Progress Import icon will be displayed in the Imports Module Navigation. Another scenario where this icon would be displayed in the Imports Module Navigation is if the import errors out during processing owing to the shutting down of Discovery Manager via the Task Manager or an unexpected interruption. To resume a suspended import, click on the In Progress Import icon and then click on the Resume Import button in the Import Ribbon.
          Import Missing Files

        • If the native file could not be copied from the source data to the processing folder, the Import Missing Files icon will be displayed in the Imports Module Navigation. Typically, this issue is seen when the antivirus is not properly configured on the Discovery Manager workstation or there were unforeseen network hiccups.

          • When this happens please contact [email protected]. Depending on the number of affected files this issue can be recoverable with the help of the Reveal Technical Support Team. If the issue is deemed non-recoverable the underlying issue will be resolved by the Reveal Technical Support Team and the import will need to be deleted and reimported again.
            Import Error

        • If a major error occurs during the import, the Import Error icon will be displayed in the Imports Module Navigation. An example is where Discovery Manager cannot extract a proper date for the file(s).

          • When this happens please contact [email protected]. Depending on the number of affected files this issue can be recoverable with the help of the Reveal Technical Support Team. If the issue is deemed non-recoverable, the underlying issue will be resolved by the Reveal Technical Support Team and the import will need to be deleted and reimported.

    • Import Path/ID – Next to each import is the assigned Import ID (this is automatically created by Discovery Manager) as well as the Import Path of the source data.

    • Import Tree View – Expand the tree view and the following data is displayed:

      • Machine – This is the machine that processed the data.

      • Original Size – This is the original size of the imported data in megabytes preprocessing.

      • Total Size – This is the total size (original size + the size of the extracted archive children) of the data imported in megabytes post processing.

      • Date Imported – This is the date the data was imported.

      • Import Duration – This is the total time in minutes it took to import the data. This value is rounded down, so if an import took less than a minute to process, it will display 0 minutes.

14. Edit Import Properties – To edit the Media Information or Sender Information after an import completes click the Edit Import Properties button in the Imports Ribbon.

    Note

    The Serial Number, Model Number, Manufacturer, and Description fields are exportable fields in the Export Module. Whatever values are provided in these fields can be exported (MEDIASERIAL, MEDIAMODEL, MEDIAMANUFACTURER, MEDIADESCRIPTION) into the resulting DAT file on the file level to any file within the import. If there is custom information that needs to be exported on the file level for an import such as an internal media tracking number this is where it could be added.

15. QC – To resolve all import exceptions click the QC button. More detailed information is below in the Import QC section.

16. Archive Explorer – Displays all processed archives in the import.

17. Delete Import – To delete an import first click on the import in the Imports Module Navigation and then click the Delete Import button in the Imports Ribbon.

    Note

    This will not delete all files from the project’s processing folder for the import. Under no circumstances should a user ever manipulate or delete any folders within the processing folder of an active project, so do not delete the import’s corresponding folder in the project’s processing folder. Please contact Reveal Technical Support with any questions about deleting import material.