Skip to content

Conversation

@ArjunDivecha
Copy link

  • Backend selection UI (Metal-4 Tensor / Legacy Metal / CPU)
  • Comprehensive metrics collection (TTFT, tokens/sec, memory, thermal)
  • Automated A/B comparison across all backends
  • Fixed download progress tracking and error handling
  • Markdown export for sharing results

Tested on iPhone 17 Pro Max (iOS 26.0.1) with Mistral-7B-v0.1 Q4_0 Results: Metal-4 Tensor shows 23% improvement over Legacy Metal (13.66 vs 11.08 t/s)

🤖 Generated with Claude Code

Make sure to read the contributing guidelines before submitting a PR

- Backend selection UI (Metal-4 Tensor / Legacy Metal / CPU)
- Comprehensive metrics collection (TTFT, tokens/sec, memory, thermal)
- Automated A/B comparison across all backends
- Fixed download progress tracking and error handling
- Markdown export for sharing results

Tested on iPhone 17 Pro Max (iOS 26.0.1) with Mistral-7B-v0.1 Q4_0
Results: Metal-4 Tensor shows 23% improvement over Legacy Metal (13.66 vs 11.08 t/s)

🤖 Generated with Claude Code
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant