Run LLMs, Fast.

Run open models on your own GPUs. Parallel decoding and reusable prompts for Apple Silicon and supported NVIDIA hardware.

Install the CLIMetal · CUDA
curl -fsSL https://tensorfold.dev/install.sh | sh

Apache-2.0 Metal + CUDA OpenAI-compatible and Anthropic APIs

Inference,
measured.

Real runs on named hardware.
Open the release. Inspect the conditions.

Recorded performanceRelease 1.0.6
874tokens per second

Nemotron 3.5 Lightning

RTX PRO 6000 Blackwell

Greedy code decode with drafting enabled, an MLX affine 4-bit checkpoint and the CUDA engine.

Separate workloads and machines, not a like-for-like comparison.

Community benchmarks

One stream.
More work per pass.

Drafted tokens, retained prompts and connected machines, working through the same engine.

Read the implementation

Check the work together.

On supported models, a drafter proposes several tokens and the target checks them together, committing only the matching prefix.

Built for the hardware you ownCompany brief

Open models.
Your infrastructure.

Run qualified checkpoints on Apple Silicon or NVIDIA hardware, through APIs compatible with the tools your teams already use.

Discuss a deployment
NVIDIA
Inception member

Part of NVIDIA's startup program.

Recipes developed with Mia's AI Lab

With thanks to Mia and her team for their patches, setup and testing.

Explore the collaboration ↗
Concept illustration of a satellite above Earth
Deployment in preparation

Preparing
for orbit.

TensorFold is being prepared for a satellite deployment, where every hardware resource counts.

Concept illustration. Hardware results will follow qualification.