Open-weight models that run on Apple M5 Ultra (64-core GPU) · 256 GB

  • Unified memory 256 GB
  • Bandwidth 1200 GB/s
  • Usable 192.0 GB

Specs: Memory · Mac Studio - Technical Specifications - Apple · Bandwidth · Mac Studio - Technical Specifications - Apple

FitModelParameters / activePrecisionMemoryEst. speedLongest contextRuns as
Runs wellGLM-4.5 Zhipu AI358.3BIQ4_XS189.0 / 192.0 GB25–38 tok/s16KUnified memory
Runs wellGLM-4.7 Zhipu AI358.3BIQ4_XS189.0 / 192.0 GB25–38 tok/s16KUnified memory
Runs wellGLM-4.6 Zhipu AI356.8BIQ4_XS188.2 / 192.0 GB26–39 tok/s18KUnified memory
Runs wellGLM-5.3-Flash Zhipu AI321.3B / 18BIQ4_XS167.3 / 192.0 GB60–91 tok/s570KUnified memory
Runs wellMiMo-V2.5 Xiaomi310.8B / 15BQ4_0172.1 / 192.0 GB62–93 tok/s150KUnified memory
Runs wellDeepSeek-V4-Flash (2026-07-31) DeepSeek304.2BFP8 (native)maker’s file163.9 / 192.0 GB31–47 tok/s343KUnified memory
Runs wellHy3 Tencent298.8B / 21BQ4_0166.9 / 192.0 GB41–62 tok/s88KUnified memory
Runs wellDeepSeek-V4-Flash (2026-04-24) DeepSeek290.9B / 13BFP8 (native)maker’s file156.8 / 192.0 GB76–115 tok/s428KUnified memory
Runs wellDeepSeek-V4-Flash DeepSeek290.9B / 13BFP8 (native)maker’s file156.8 / 192.0 GB76–115 tok/s427KUnified memory
Runs wellERNIE-5.5-Flash-Base Baidu286.2BQ4_K_M170.4 / 192.0 GBspeed not estimated465KUnified memory
Runs wellQwen3-VL-235B-A22B-Instruct Alibaba Qwen235.7BQ5_K_M165.4 / 192.0 GB34–51 tok/s128KUnified memory
Runs wellQwen3-VL-235B-A22B-Thinking Alibaba Qwen235.7BQ5_K_M165.4 / 192.0 GB34–51 tok/s128KUnified memory
Runs wellQwen3-235B-A22B-Instruct-2507 Alibaba Qwen235.1B / 22BQ5_K_M165.0 / 192.0 GB35–52 tok/s256KUnified memory
Runs wellQwen3-235B-A22B-Thinking-2507 Alibaba Qwen235.1B / 22BQ5_K_M165.0 / 192.0 GB35–52 tok/s256KUnified memory
Runs wellQwen3-235B-A22B Alibaba Qwen235.1B / 22BQ5_K_Mmaker’s file164.6 / 192.0 GB35–52 tok/s128KUnified memory
Runs wellMiniMax-M2.1 MiniMax228.7BQ5_K_M161.0 / 192.0 GB60–91 tok/s136KUnified memory
Runs wellMiniMax-M2.5 MiniMax228.7BQ5_K_M161.0 / 192.0 GB60–91 tok/s136KUnified memory
Runs wellMiniMax-M2.7 MiniMax228.7BQ5_K_M161.0 / 192.0 GB60–91 tok/s136KUnified memory
Runs wellMiniMax-M2 MiniMax228.7B / 10BQ5_K_M161.0 / 192.0 GB65–98 tok/s136KUnified memory
Runs wellMiniMax-M3.1-Flash MiniMax220.5B / 23BQ5_K_M154.3 / 192.0 GB35–52 tok/s330KUnified memory
Runs wellStep 3.7 Flash StepFun201.4BQ6_K163.1 / 192.0 GB145–218 tok/s172KUnified memory
Runs wellStep 3.5 Flash StepFun199.4B / 11BQ6_K161.5 / 192.0 GB57–85 tok/s181KUnified memory
Runs wellMing-3.0-audio-flash Ant Group128.2B / 6.5BQ8_0133.6 / 192.0 GB82–123 tok/s128KUnified memory
Runs wellLing-3.0-flash Ant Group127.5B / 5.1BQ8_0maker’s file133.0 / 192.0 GB103–155 tok/s250KUnified memory
Runs wellQwen3.5-122B-A10B Alibaba Qwen125.1B / 10BQ8_0130.2 / 192.0 GB55–83 tok/s256KUnified memory
Runs wellLing-3.0-flash-VL Ant Group124.8B / 5.5BQ8_0130.1 / 192.0 GB96–144 tok/s128KUnified memory
Runs wellgpt-oss-120b OpenAI116.8B / 5.1BMXFP4 (native)maker’s file64.1 / 192.0 GB190–285 tok/s128KUnified memory
Runs wellGLM-4.5-Air Zhipu AI110.5BQ8_0116.2 / 192.0 GB31–46 tok/s125KUnified memory
Runs wellGLM-4.5V Zhipu AI107.7B / 12BQ8_0113.3 / 192.0 GB42–63 tok/s63KUnified memory
Runs wellGLM-4.6V Zhipu AI107.7BQ8_0113.3 / 192.0 GB36–54 tok/s125KUnified memory
Runs wellLing-2.6-flash Ant Group107.5B / 7.4BQ8_0112.0 / 192.0 GB73–110 tok/s128KUnified memory
Runs wellQwen3-Next-80B-A3B-Instruct Alibaba Qwen81.3B / 3BBF16 (native)maker’s file159.3 / 192.0 GB97–145 tok/s256KUnified memory
Runs wellQwen3-Next-80B-A3B-Thinking Alibaba Qwen81.3B / 3BBF16 (native)maker’s file159.3 / 192.0 GB97–145 tok/s256KUnified memory
Runs wellQwen3-Coder-Next Alibaba Qwen79.7B / 3BBF16 (native)maker’s file156.0 / 192.0 GB97–145 tok/s256KUnified memory
Runs wellQwen2.5-VL-72B-Instruct Alibaba Qwen73.4BQ4_K_M46.1 / 192.0 GB13–19 tok/s125KUnified memory
Runs wellQwen2-VL-72B-Instruct Alibaba Qwen73.4BQ4_K_M46.1 / 192.0 GB13–19 tok/s32KUnified memory
Runs wellQwen2.5-72B-Instruct Alibaba Qwen72.7BQ4_K_Mmaker’s file45.5 / 192.0 GB13–19 tok/s32KUnified memory
Runs wellQianfan-VL-70B Baidu71.8BQ4_K_M45.2 / 192.0 GB13–19 tok/s32KUnified memory
Runs wellDeepSeek-R1-Distill-Llama-70B DeepSeek70.6BQ4_K_M44.4 / 192.0 GB13–20 tok/s125KUnified memory
Runs wellQwen3.5-35B-A3B Alibaba Qwen36B / 3BBF16 (native)maker’s file70.5 / 192.0 GB97–146 tok/s256KUnified memory
Runs wellQwen3.6-35B-A3B Alibaba Qwen36B / 3BBF16 (native)maker’s file70.5 / 192.0 GB97–146 tok/s256KUnified memory
Runs wellQwen2.5-VL-32B-Instruct Alibaba Qwen33.5BQ8_036.8 / 192.0 GB16–24 tok/s125KUnified memory
Runs wellQwen3-VL-32B-Instruct Alibaba Qwen33.4BQ8_0maker’s file36.0 / 192.0 GB16–24 tok/s128KUnified memory
Runs wellQwen3-VL-32B-Thinking Alibaba Qwen33.4BQ8_0maker’s file36.0 / 192.0 GB16–24 tok/s128KUnified memory
Runs wellQwen2.5-32B-Instruct Alibaba Qwen32.8BQ8_0maker’s file36.1 / 192.0 GB16–24 tok/s32KUnified memory
Runs wellQwen2.5-Coder-32B-Instruct Alibaba Qwen32.8BINT8 (GPTQ)maker’s file36.3 / 192.0 GB16–24 tok/s32KUnified memory
Runs wellQwQ-32B Alibaba Qwen32.8BQ8_0maker’s file36.1 / 192.0 GB16–24 tok/s40KUnified memory
Runs wellDeepSeek-R1-Distill-Qwen-32B DeepSeek32.8BQ8_036.0 / 192.0 GB16–24 tok/s32KUnified memory
Runs wellQwen3-32B Alibaba Qwen32.8BMLX 8bitmaker’s file35.0 / 192.0 GB17–25 tok/s128KUnified memory
Runs wellQwen3-Omni-30B-A3B-Captioner Alibaba Qwen31.7BBF16 (native)maker’s file62.8 / 192.0 GB61–91 tok/s64KUnified memory
Runs wellGemma 4 31B IT Google31.3BQ8_034.5 / 192.0 GB17–25 tok/s250KUnified memory
Runs wellGLM-4.7-Flash Zhipu AI31.2BBF16 (native)maker’s file61.5 / 192.0 GB56–83 tok/s195KUnified memory
Runs wellQwen3-VL-30B-A3B-Instruct Alibaba Qwen31.1BBF16 (native)maker’s file61.5 / 192.0 GB70–105 tok/s128KUnified memory
Runs wellQwen3-VL-30B-A3B-Thinking Alibaba Qwen31.1BBF16 (native)maker’s file61.5 / 192.0 GB70–105 tok/s128KUnified memory
Runs wellQwen3-30B-A3B-Instruct-2507 Alibaba Qwen30.5B / 3.3BBF16 (native)maker’s file60.5 / 192.0 GB81–122 tok/s256KUnified memory
Runs wellQwen3-30B-A3B-Thinking-2507 Alibaba Qwen30.5B / 3.3BBF16 (native)maker’s file60.5 / 192.0 GB81–122 tok/s256KUnified memory
Runs wellQwen3-30B-A3B Alibaba Qwen30.5B / 3.3BBF16 (native)maker’s file60.5 / 192.0 GB81–122 tok/s128KUnified memory
Runs wellQwen3-Coder-30B-A3B-Instruct Alibaba Qwen30.5B / 3.3BBF16 (native)maker’s file60.5 / 192.0 GB81–122 tok/s256KUnified memory
Runs wellHy-Memory-30B-A3B Tencent30.1B / 3BBF16 (native)maker’s file59.6 / 192.0 GB88–132 tok/s63KUnified memory
Runs wellGranite Switch 4.1 30B IBM30BQ8_0maker’s file35.4 / 192.0 GB17–25 tok/s128KUnified memory
Runs wellQwen3.5-27B Alibaba Qwen27.8BQ8_029.4 / 192.0 GB20–30 tok/s256KUnified memory
Runs wellQwen3.6-27B Alibaba Qwen27.8BQ8_029.4 / 192.0 GB20–30 tok/s256KUnified memory
Runs wellQwen3.8-27B Alibaba Qwen27.8BQ8_029.4 / 192.0 GB20–30 tok/s256KUnified memory
Runs wellGemma 4 26B A4B IT Google25.8B / 3.8BBF16 (native)maker’s file51.0 / 192.0 GB74–110 tok/s250KUnified memory
Runs wellMagistral Small 1.2 Mistral AI24BQ8_0maker’s file25.8 / 192.0 GB23–34 tok/s125KUnified memory
Runs wellDevstral Small 1.0 Mistral AI23.6BQ8_025.7 / 192.0 GB23–34 tok/s125KUnified memory
Runs wellDevstral Small 1.1 Mistral AI23.6BQ8_025.7 / 192.0 GB23–34 tok/s125KUnified memory
Runs wellMagistral Small 1.0 Mistral AI23.6BQ8_025.7 / 192.0 GB23–34 tok/s39KUnified memory
Runs wellMagistral Small 1.1 Mistral AI23.6BQ8_0maker’s file25.8 / 192.0 GB23–34 tok/s39KUnified memory
Runs wellERNIE-4.5-21B-A3B-Thinking Baidu21.8B / 3BBF16 (native)maker’s file43.1 / 192.0 GB93–139 tok/s128KUnified memory
Runs wellGPT OSS 20B OpenAI20.9B / 3.6BMXFP4 (native)maker’s file13.6 / 192.0 GB233–350 tok/s128KUnified memory
Runs wellQwen2.5-14B-Instruct-1M Alibaba Qwen14.8BBF16 (native)maker’s file30.4 / 192.0 GB19–29 tok/s870KUnified memory
Runs wellQwen2.5-14B-Instruct Alibaba Qwen14.8BBF16 (native)maker’s file30.4 / 192.0 GB19–29 tok/s32KUnified memory
Runs wellDeepSeek-R1-Distill-Qwen-14B DeepSeek14.8BBF16 (native)maker’s file30.4 / 192.0 GB19–29 tok/s32KUnified memory
Runs wellQwen3-14B Alibaba Qwen14.8BBF16 (native)maker’s file30.1 / 192.0 GB19–29 tok/s128KUnified memory
Runs wellGemma 3 12B IT Google12.2BBF16 (native)maker’s file26.6 / 192.0 GB22–33 tok/s128KUnified memory
Runs wellQwen2.5-Omni-7B Alibaba Qwen10.7BBF16 (native)maker’s file22.3 / 192.0 GB26–39 tok/s32KUnified memory
Runs wellGLM-4.6V-Flash Zhipu AI10.3BBF16 (native)maker’s file20.4 / 192.0 GB29–43 tok/s125KUnified memory
Runs wellQwen3.5-9B Alibaba Qwen9.7BBF16 (native)maker’s file19.1 / 192.0 GB31–46 tok/s256KUnified memory
Runs wellQianfan-VL-8B Baidu8.8BBF16 (native)maker’s file18.2 / 192.0 GB32–48 tok/s32KUnified memory
Runs wellGranite Switch 4.1 8B IBM8.8BBF16 (native)maker’s file18.5 / 192.0 GB32–47 tok/s128KUnified memory
Runs wellQwen3-VL-8B-Instruct Alibaba Qwen8.8BBF16 (native)maker’s file18.3 / 192.0 GB32–48 tok/s128KUnified memory
Runs wellQwen3-VL-8B-Thinking Alibaba Qwen8.8BBF16 (native)maker’s file18.3 / 192.0 GB32–48 tok/s128KUnified memory
Runs wellpplx-embed-v2-context-9b Perplexity8.4BFP32 (native)maker’s file33.1 / 192.0 GB18–27 tok/s256KUnified memory
Runs wellQwen2.5-VL-7B-Instruct Alibaba Qwen8.3BBF16 (native)maker’s file16.7 / 192.0 GB35–53 tok/s125KUnified memory
Runs wellQwen3-8B Alibaba Qwen8.2BBF16 (native)maker’s file17.1 / 192.0 GB34–51 tok/s128KUnified memory
Runs wellDeepSeek-R1-Distill-Llama-8B DeepSeek8BBF16 (native)maker’s file16.7 / 192.0 GB35–53 tok/s125KUnified memory
Runs wellGemma 4 E4B Google8BBF16 (native)maker’s file15.8 / 192.0 GB37–56 tok/s125KUnified memory
Runs wellLing-3.0-tiny Ant Group7.9B / 1.3BBF16 (native)maker’s file15.6 / 192.0 GB212–318 tok/s128KUnified memory
Runs wellQwen2.5-7B-Instruct-1M Alibaba Qwen7.6BBF16 (native)maker’s file15.3 / 192.0 GB38–57 tok/s977KUnified memory
Runs wellQwen2.5-7B-Instruct Alibaba Qwen7.6BBF16 (native)maker’s file15.3 / 192.0 GB38–57 tok/s32KUnified memory
Runs wellDeepSeek-R1-Distill-Qwen-7B DeepSeek7.6BBF16 (native)maker’s file15.3 / 192.0 GB38–57 tok/s32KUnified memory
Runs wellMistral-7B-Instruct-v0.1 Mistral AI7.2BBF16 (native)maker’s file15.2 / 192.0 GB39–58 tok/s32KUnified memory
Runs wellGemma 4 E2B Google5.1BBF16 (native)maker’s file10.1 / 192.0 GB58–87 tok/s125KUnified memory
Runs wellWeVisOne-VL-4B Tencent4.8BBF16 (native)maker’s file10.6 / 192.0 GB55–83 tok/s256KUnified memory
Runs wellQianfan-OCR Baidu4.7BBF16 (native)maker’s file10.5 / 192.0 GB56–84 tok/s31KUnified memory
Runs wellQwen3.5-4B Alibaba Qwen4.7BBF16 (native)maker’s file9.4 / 192.0 GB63–94 tok/s256KUnified memory
Runs wellQwen3-VL-4B-Instruct Alibaba Qwen4.4BBF16 (native)maker’s file9.9 / 192.0 GB60–89 tok/s250KUnified memory
Runs wellQwen3-4B-Instruct-2507 Alibaba Qwen4BBF16 (native)maker’s file9.1 / 192.0 GB65–97 tok/s256KUnified memory
Runs wellQwen3-4B Alibaba Qwen4BBF16 (native)maker’s file9.1 / 192.0 GB65–97 tok/s128KUnified memory
Runs wellDeepSeek-OCR DeepSeek3.3BBF16 (native)maker’s file7.2 / 192.0 GB215–323 tok/s8KUnified memory
Runs wellGranite-4.0-H-Micro IBM3.2BBF16 (native)maker’s file6.5 / 192.0 GB93–140 tok/s128KUnified memory
Runs wellQwen3-1.7B Alibaba Qwen2BBF16 (native)maker’s file5.2 / 192.0 GB120–180 tok/s40KUnified memory
Runs wellDeepSeek-R1-Distill-Qwen-1.5B DeepSeek1.8BBF16 (native)maker’s file4.0 / 192.0 GB158–238 tok/s125KUnified memory
Runs wellGLM-OCR Zhipu AI1.3BBF16 (native)maker’s file3.5 / 192.0 GB188–282 tok/s128KUnified memory
Runs wellQwen3-0.6B Alibaba Qwen0.8BBF16 (native)maker’s file2.8 / 192.0 GB246–368 tok/s40KUnified memory
Runs wellEmbeddingGemma 2 Google0.7BBF16 (native)maker’s file2.0 / 192.0 GB380–571 tok/s256KUnified memory
Runs wellQwen3-Embedding-0.6B Alibaba Qwen0.6BBF16 (native)maker’s file2.5 / 192.0 GB282–422 tok/s32KUnified memory
Runs wellbge-reranker-v2-m3 BAAI0.6BFP32 (native)maker’s file3.4 / 192.0 GB195–293 tok/s8KUnified memory
Runs wellbge-m3-unsupervised BAAI0.6BFP32 (native)maker’s file3.4 / 192.0 GB195–293 tok/s8KUnified memory
Runs wellbge-large-en-v1.5 BAAI0.3BFP32 (native)maker’s file1.8 / 192.0 GB431–647 tok/s512Unified memory
Runs wellbge-reranker-base BAAI0.3BFP32 (native)maker’s file1.6 / 192.0 GB530–796 tok/s514Unified memory
Runs wellbge-base-en-v1.5 BAAI0.1BFP32 (native)maker’s file0.9 / 192.0 GB1313–1970 tok/s512Unified memory
Runs wellbge-small-en-v1.5 BAAI0BFP32 (native)maker’s file0.6 / 192.0 GB4199–6298 tok/s512Unified memory

Estimates from the makers’ Hugging Face repositories (as of 2026-11-06); filtered views aren’t indexed. How it’s estimated