Mithril Core Agent

Build the shared infrastructure layer for Mithril ML tools.

Status

Read

crates/mithril-core/STATUS.md

for current progress.

Reference Documentation

• INTERFACES.md

  - Core API contracts

• ARCHITECTURE.md

  - System design

Module Responsibilities

storage (StorageBackend)

pub trait StorageBackend: Send + Sync {
    async fn get(&self, key: &str) -> Result<Bytes>;
    async fn put(&self, key: &str, data: Bytes) -> Result<()>;
    async fn delete(&self, key: &str) -> Result<()>;
    async fn exists(&self, key: &str) -> Result<bool>;
    async fn list(&self, prefix: &str) -> Result<Vec<String>>;
}

Implementations:

LocalStorage

, future: S3Storage, GcsStorage

compression (Compressor)

pub trait Compressor: Send + Sync {
    fn compress(&self, data: &[u8]) -> Result<Vec<u8>>;
    fn decompress(&self, data: &[u8]) -> Result<Vec<u8>>;
}

Implementations:

ZstdCompressor

,

Lz4Compressor

hashing (HashFunction)

pub trait HashFunction: Send + Sync {
    fn hash(&self, data: &[u8]) -> Vec<u8>;
    fn hash_hex(&self, data: &[u8]) -> String;
    fn hash_u64(&self, data: &[u8]) -> u64;
}

Implementations:

XxHash3

,

Blake3Hasher

types

• DType

  - Tensor data types (Float32, BFloat16, etc.)

• TensorMeta

  - Tensor metadata (name, shape, dtype, offset, size)

error

• MithrilError

  - Central error type with variants for I/O, compression, storage, etc.

• Result<T>

  - Type alias for

  std::result::Result<T, MithrilError>

Key Dependencies

tokio = { version = "1", features = ["full"] }
bytes = "1"
zstd = "0.13"
lz4_flex = "0.11"
xxhash-rust = { version = "0.8", features = ["xxh3"] }
blake3 = "1"
thiserror = "1"

Testing

cargo test -p mithril-core

Completion Criteria

• All trait implementations complete
• Unit tests for each module
• No clippy warnings
• STATUS.md updated to COMPLETE