The Metadata Black Hole

A major problem in media archival is the "Metadata Black Hole." When you offload a camera card, the footage is just a sequence of alphanumerics: A001C032_220914_R0NQ.mxf. If an editor searches your SAN three years later for "Interview with the CEO where he mentions the Q3 launch", the filesystem cannot help them.

Normally, post-facilities buy expensive, third-party Media Asset Management (MAM) software to solve this. Someone has to manually transcode the files, upload them to the MAM, type in keywords, and link those database entries back to the LTO tape ID. It's a fragile, disconnected workflow. We built Husk to collapse that pipeline directly into the storage controller itself.

AI Audio Transcription (Whisper Hook)

When a file is written to a Husk watched folder, the Enterprise Sidecar intercepts it using the PRE_ARCHIVE hook. In our default pipeline, the sidecar first uses ffprobe to extract technical metadata (Codec, Resolution, Framerate). But it doesn't stop there.

It then uses FFmpeg to strip a lightweight 16kHz audio track from the video file and pipes it directly into an AI transcription model (like OpenAI's open-source Whisper).

// 1. Strip the audio to a temp wav file Command::new("ffmpeg") .args(["-y", "-i", file_path, "-ar", "16000", "-ac", "1", "-c:a", "pcm_s16le", &audio_path]) .spawn().await; // 2. Pipe to local AI tool (e.g. Whisper) let ai_output = Command::new("whisper").args([&audio_path, "--model", "base"]).output().await; // 3. Pass the JSON back to Husk Core's SQLite Database serde_json::json!({ "ai_transcript": "We are launching the new product in Q3...", "ai_language": "en", "ai_confidence": 0.98 })

The sidecar returns this JSON payload to the Husk Core over the Unix socket. The Core blindly ingests it, storing it in the SQLite catalog alongside the physical tape block addresses. Now, the storage itself is searchable by dialogue.

A Note on Performance

Because the Husk Sidecar is heavily asynchronous, this AI processing happens in the background. It does not block the actual writing of data to the tape. The tape drive streams at a full 400MB/s while the CPU crunches the metadata in parallel.

Can I plug in Video/Vision AI? (Yes.)

A common question we get from pipeline TDs is: "Can I add a hook for a video tagging AI service as well?"

Absolutely. The `PRE_ARCHIVE` hook is entirely extensible. If you want to pipe image frames into a local YOLOv8 container for object detection, or trigger an AWS Rekognition API call to identify actors' faces, you simply add that logic to the sidecar's Rust code and append the results to the custom_meta JSON object.

Husk doesn't care what the keys are (e.g., {"actors": ["Tom Hanks"], "objects": ["Car", "Explosion"]}). It just indexes whatever the sidecar hands it, allowing you to build a highly bespoke, automated MAM tailored perfectly to your studio's needs.

MHL Compliance & Blake3 Hashes

M&E workflows aren't just about finding data; they are about proving the data hasn't been corrupted. When a DIT (Digital Imaging Technician) hands off a hard drive of raw camera footage to a post-house, they include an MHL (Media Hash List) manifest. This is Hollywood's standard for chain-of-custody.

When the Husk Sidecar processes a CATALOG_UPDATE event, it grabs the file's ultra-fast Blake3 Cryptographic Hash (which the Husk Core calculates on the fly as data streams to tape) and automatically generates an XML compliance manifest.

<!-- Example of an auto-generated Husk MHL Manifest --> <?xml version="1.0" encoding="UTF-8"?> <hashlist version="1.1"> <creatorinfo> <hostname>Husk-Enterprise-Sidecar</hostname> <tool>Husk Archiver</tool> </creatorinfo> <hash> <file> <size>15400000000</size> <lastmodificationdate>2026-09-14T10:30:00Z</lastmodificationdate> </file> <blake3>a3f9c2b4e8...</blake3> </hash> </hashlist>

Hollywood Chain of Custody

Why does this matter? If you are archiving content for Netflix, Disney, or HBO, you are contractually obligated to prove that the file on your LTO tape is a bit-for-bit perfect match to the file that came out of the ARRI Alexa camera.

01 — Zero-Touch Audits
Built-In Verification
Because the sidecar generates the MHL automatically, archivists don't need to run separate hashing software (like Pomfort Silverstack) before committing to tape.
02 — Blake3 Speed
Saturating the Bus
Older hashing algorithms like MD5 or SHA-256 bottleneck at around 500MB/s. Blake3 is heavily parallelized, easily capable of hashing at 3GB/s+, ensuring the cryptography never slows down the tape drives.

By blending AI intelligence with cryptographic proof, HuskHoard stops being just a place to put your files. It becomes an active participant in the post-production pipeline—protecting your data, understanding what's inside it, and proving its integrity to anyone who asks.