GUI of Pmfort Silverstack in dark mode listing clips of a project

Data Transfer and File Handling

How to keep your original camera negative safe

How to transfer camera originals

To ensure the secure transfer of your original camera data, avoid using simple file copy methods (e.g. macOS Finder, Windows Explorer, or basic command line copy). Instead, follow these steps to ensure you don't lose a day's worth of footage because missing or corrupt files weren't noticed before the original recording media was erased. Your minimum standard should be checksum-verified data backups.

 

1. Implement checksummed backups

- Checksums: A checksum is a small block of data representing a file, used to detect errors that may have been introduced during file transmission. Different types of checksums exist, calculated using various algorithms, but they all serve the same purpose.

- Checksum Verification: A data management tool offering "checksum verify" will calculate and compare the checksum of a file with the checksum of its copy. The verification result (verified or failed), along with additional information, can then be stored in a checksum directory listing called a Media Hash List (MHL).

 

2. A checksum collection: MHL

A Media Hash List (MHL) is an XML file which contains:

  • the creator info (name, user name, host name, tool, checksum calculation start date and finishing date) followed by...
  • the hash for each file that was processed (path to file, size in bytes, last modification date, hash value, hash creation date)

The next time the files will be copied, the hash values from the MHL file will be used as the reference for the verification. If any file was modified in any way (i.e. corrupted or edited), the checksums will no longer match and the verification will fail. Checksums therefore should be created as early as possible, i.e. when the original camera data is copied from the recording media and should be kept along with the original files all the way into archival.

Though most agree that checksums are vital, different tools, companies or individuals may utilize any of the verification methods/checksum types. This makes it difficult to track where a corruption or unintended modification occurred within the production’s lifespan.

 

ASC MHL v2

To overcome this issue, a sub-committee of the American Society of Cinematographers (ASC), together with members from studios, software companies, DITs, and post facilities, developed an extension to the original MHL concept: the ASC MHL (version 2).

In a nutshell, the ASC MHL refines the XML structure of the MHL file and adds a so-called "chain file", which serves as an MHL history. The chain file keeps track of the path and file hash of each ASC MHL file so their integrity, in turn, can be verified. This enables productions to determine exactly where in the chain the problem occurred.

More information on the ASC MHL can be found on the website of the American Society of Cinematographers.

 

3. Choosing your data management software

The following is a list of data management tools for ensuring secure handling and integrity verification of your original camera data. These offer the recommended level of security though verification. Please note that this list cannot be exhaustive!

  • Pomfort offers a range of products for media asset management and digital imaging. Its entry-level software for data management is Offload Manager, while at the top end its feature-packed Silverstack Lab tool offers clip management, QC, and dailies. Pomfort software is macOS only.
  • Imagine Products focuses on data backup to disk and LTO. Its data management software is called ShotPut Pro and is available for macOS and Windows.
  • Hedge offers tools for data management, reporting, transcoding, review, and archiving. Its copy tool is called OffShoot (formerly Hedge). Hedge software is available for macOS, iPadOS, and Windows.
  • YoYotta software facilitates full offload, transcode, conform, archive, and restore functions.
  • OWC, manufacturer of professional storage hardware solutions, also offers software for backup, disk management, and archival. Its data management software is called Copy That (macOS only).
  • Quine offers the free Quine Copy software, providing basic copy and media management features, as well as transcoding options.
  • OTTOMATIC o/PARASHOOT is not a copy tool but ensures a secure offload and erasing process on set by checking if files on a card were already copied. It also offers a reversible process for erasing the camera media, so long as the drive was not erased in-camera.