During high-frequency iterative software development cycles, developers often need to capture project snapshots before executing high-risk code refactorings or large merges. However, traditional general-purpose archiving tools (such as zip, tar.gz, and tar.zst) are often too slow and bloated when dealing with modern projects containing tens of thousands of tiny files (like the massive dependency trees in node_modules). This makes frequent snapshotting highly impractical.

To completely solve this pain point, Hydite has designed and open-sourced the HIGV2 protocol and archiving format.

HIG is engineered to provide a fast, compact, and securely encrypted project-level file archiving format, making frequent snapshots painless. It is fast enough to run on every minor change, compact enough to store locally long-term or transfer across machines instantly, and implements a strict validation model to guarantee zero corruption during extraction.

Core Advantages: Outperforming Traditional Tools in Benchmarks

In open benchmarks conducted by Hydite on a real-world project directory containing 15,330 files and totaling 198.97 MB (189.76 MiB), HIGV2 demonstrated outstanding performance:

Evaluation Metric	HIGV2 Performance	Improvement Over Traditional Archiving Tools
Archive Duration (CLI Wall Time)	164.008 ms	96.0% faster than `zip` (24.9x speedup) 98.4% faster than `tar.gz` (61.6x speedup) 97.6% faster than `tar.zst` (41.0x speedup)
Archive Size	57.11 MB (57,108,395 bytes)	15.7% smaller than `zip` 6.9% smaller than `tar.gz` 12.0% smaller than `tar.zst`
Incremental Updates	Single-file edit: 253.53 ms Five-file edits: 96.24 ms	HIGV2 supports extremely fast incremental snapshots and change tracking
Burst Events Handling	1000 file change events catch-up: 111.63 ms	Sub-second sync completed with zero file-watcher overflows

[!NOTE] The above benchmarks were conducted in an open testing environment. Due to file system I/O differences across operating systems, these numbers represent transparent performance snapshots rather than absolute guarantees. However, HIG consistently exhibits a massive advantage when handling typical software project directories.

HIGV2 Format Specification & Architecture

HIG's remarkable speed and compression efficiency stem from its unique compact file layout and optimized cryptographic schemes.

1. File Layout and Central-Directory-Free Design

Standard ZIP archives place their central directory at the end of the file, meaning readers cannot inspect the file structure before the download or transfer is complete. HIGV2 utilizes a layout optimized for streaming and rapid validation:

+------------------------------+
| Fixed Header (64 bytes)      |
+------------------------------+
| Protected Manifest Payload   |
+------------------------------+
| Protected Block Payload 0    |
+------------------------------+
| Protected Block Payload 1    |
+------------------------------+
| ...                          |
+------------------------------+

A reader only needs to parse the fixed 64-byte header to immediately verify and extract the subsequent Manifest. It can then parallelize block reads and restore files in order, eliminating the need for a tail-end index.

2. Small File Consolidation (Batch & Solid Blocks)

When there are thousands of tiny files (often just a few dozen bytes each) on a disk, storing them individually leads to severe storage waste due to sector alignment (slack space). During archiving, HIGV2 consolidates these tiny files in memory into a single large Batch or Solid data block for unified compression. The Manifest only tracks the relative offset and length of each file within the block, eliminating metadata overhead for small files and maximizing the context window efficiency of the Zstd compressor.

Rigorous Security Model

HIGV2 does not sacrifice security for performance. In encrypted mode (Password Mode), it enforces high-grade confidentiality and integrity protections:

Argon2id Key Derivation Function (KDF): HIGV2 employs the industry-standard, ASIC-resistant Argon2id algorithm (version 0x13) to hash passwords, deriving a 32-byte master key using a 16-byte random salt. Memory cost, time cost, and parallelism factors are recorded in the header to ensure robust brute-force protection.
ChaCha20-Poly1305 Authenticated Encryption (AEAD): In addition to file content, HIGV2 encrypts the entire Manifest, including all file paths and metadata. Each protected payload block uses a unique 12-byte Nonce, and must pass Poly1305 MAC verification prior to decompression, defending against tampering and chosen-ciphertext attacks.
BLAKE3 Content Hashing: HIGV2 uses BLAKE3, the fastest collision-resistant hashing algorithm available, for content addressing, unique block identification, and manifest root validation.
Secure Path Resolution: Conforming readers enforce strict path validation during extraction. Any attempt to write to absolute paths (e.g., /etc/passwd) or perform directory traversal (e.g., ../../) will immediately abort the process, preventing malicious path-traversal write attacks.

Desktop and CLI Tools Available

The HIG protocol is supported by low-level command-line tools as well as a native macOS desktop client.

Version: v1.9.4
Release Artifact: hig-v1.9.4-desktop-macos-universal.dmg (approx. 21 MB)
Trust & Security: The DMG installer is signed, notarized with hardened runtime enabled, and verified with SHA-256 integrity checks for an out-of-the-box native experience on macOS.

With the release of the HIGV2 protocol, we aim to provide the developer community with a backup and archiving alternative that is more code-aware than ZIP, and faster and more secure than TAR. Whether you are performing high-risk refactorings or syncing private project directories across multiple devices, HIG is your secure, high-performance digital vault.

Check out the GitHub Repository to learn more about the technical implementation and download the tools!