picomlx/mlxkit
MLXKit is a Swift library that provides an [OpenAI compatible API](https://platform.openai.com/docs/api-reference) layer to [MLX](https://github.com/ml-explore/mlx-swift). MLXKit can be used to create MLX servers or incorporated in chat clients.
Highlights
Supported OpenAI API
| | OpenAI API | |----|------------------| | ✅ | Chat completion | | ✅ | Chat completion streaming | | ❌ | Vision | | ❌ | Text to speech | | ❌ | Speech to text | | ❌ | Moderation | | ❌ | Images | | ❌ | Assistants (beta) | | ❌ | Embeddings | | ❌ | Fine-tuning |
Supported MLX models
Installation
The MLXKit package can be built from Xcode or SwiftPM.
In Xcode you can add https://github.com/ronaldmannak/MLXkit as a package dependency.
Requirements
- MLX is only available on devices running macOS >= 13.5 It is highly recommended to use macOS 14 (Sonoma)
Package Metadata
Repository: picomlx/mlxkit
Default branch: main
README: README.md