Code

Distributed inference example#890

Code

Draft

angeloskath wants to merge 5 commits intomainml-explore/mlx-examples:mainfrom distributed-layersml-explore/mlx-examples:distributed-layersCopy head branch name to clipboard

+99-13

Commits

Commits on Feb 6, 2025

• Start distributed inference for llama models

  

  angeloskath

  authored and

  awni

  committed
  d778402

  Copy full SHA for d778402

• Temporarily remove async_eval

  

  angeloskath

  authored and

  awni

  committed
  a0ce059

  Copy full SHA for a0ce059

• Remove async eval and add sequential load

  

  angeloskath

  authored and

  awni

  committed
  026362e

  Copy full SHA for 026362e

• Make the chat distributed

  

  angeloskath

  authored and

  awni

  committed
  617f928

  Copy full SHA for 617f928

• fix lazy load

  awni

  committed
  65b792d

  Copy full SHA for 65b792d