SwiftAI | Not Hacker News!

Discussion (24 comments)

Showing 24 comments

4 months ago

1 reply

Awesome, this is a good idea! Having a nice wrapper to make LLM calls easier is very helpful too :)

Nice to see someone digging in on the system models. That's on my list to play with, but I haven't seen much new info on them or how they perform yet.

mi12-root

4 months ago

We’ve begun internally evaluating the model and will share our findings more in details later. So far, we’ve found that it performs well on tasks such as summarization, writing, and data extraction, and shows particular strength in areas like history and marketing. However, it struggles with STEM topics (e.g., math and physics), often fails to follow long or complex instructions, and sometimes avoids answering certain queries. If you want us to evaluate a certain use case or vertical, please share it with us!

keyle

4 months ago

1 reply

Needs more example on custom.

mi12-root

4 months ago

1 reply

Thanks for the feedback! When you say “custom,” do you mean additional integrations with LLM providers, or more documentation on how to build your own custom integration? If you mean the former, we’re currently focused on stabilizing the API and reaching feature parity with FoundationModels (e.g., adding streaming). After that, we plan to add more integrations, such as Claude, Gemini, and on-device LLMs from Hugging Face.

jdmg94

4 months ago

1 reply

There is no examples or documentation on `CustomLLM` the README file has examples on `SystemLLM` and `OpenaiLLM` but there's no way for us to know if we need to bring in guff files, ollama, hugginface, etc.

achrafmam2

4 months ago

1 reply

I’ve added documentation on creating new LLM integrations in SwiftAI [https://github.com/mi12labs/SwiftAI/blob/main/Docs/Guides/cu...]. We also have a proof-of-concept using MLX-optimized models from Hugging Face [https://huggingface.co/mlx-community], which we’ll release once it’s ready.

achrafmam2

4 months ago

We added an experimental support for MLX see README [https://github.com/mi12labs/SwiftAI/?tab=readme-ov-file#loca...]. We also added an chat demo where you can interact with 20+ models [https://github.com/mi12labs/SwiftAI/tree/main/Examples/ChatA...]

jc4p

4 months ago

1 reply

I do a lot of AI work and right now the story for doing LLMs on iOS is very painful (but doing Whisper or etc is pretty nice) so this is existing and the API looks Swift native and great, I can't wait to use it!

Question/feature request: Is it possible to bring my own CoreML models over and use them? I honestly end up bundling llama.cpp and doing gguf right now because I can't figure out the setup for using CoreML models, would love for all of that to be abstracted away for me :)

mi12-root

4 months ago

1 reply

That’s a good suggestion, and it indeed sounds like something we’d want to support. Could you help us better understand your use case? For example, where do you usually get the models (e.g., Hugging Face)? Do you fine-tune them? Do you mostly care about LLMs (since you only mentioned llama.cpp)?

jc4p

4 months ago

1 reply

Thank you! I’ve been fine tuning tiny Llama and Gemma models using transformers then exporting from the safetensors that spits out — My main use case is LLMs but I’ve also tried getting YOLO finetuned and other PyTorch models running and ran into similar problems, just seemed very confusing to figure out how to properly use the phone for this.

mi12-root

4 months ago

Thanks for sharing the details—that makes a lot of sense. Fine-tuning and exporting models on-device can be tedious nowadays. We’re planning to look into supporting popular on-device LLM models more directly, so deployment feels much easier. We'll let you know here or reach out to you once we have something

rafram

4 months ago

3 replies

You may get a letter from Apple’s lawyers because of the name - Swift and SwiftUI are trademarks, and this seems like something they’d want to keep for themselves.

andsoitis

4 months ago

2 replies

> Swift and SwiftUI are trademarks

This is called SwiftAI, though.

reactordev

4 months ago

1 reply

If they can prove enough similarities or overlap with their brand, they’ll find the way. And since it targets macOS/iOS specifically, there you go.

steve1977

4 months ago

Als considering that Apple probably has Apple Intelligence trademarked

rafram

4 months ago

1 reply

Right, and if it were called IBM AI, they’d get a letter from IBM instead. You can’t just tack something onto the end of a trademarked brand name.

farseer

4 months ago

IBM and Apple are company names, which means the intent to mislead can play a role during legal proceedings. Compared to banning the use of "Swift" in any phrase or sentence by any future company for the foreseeable future.

farseer

4 months ago

1 reply

What if I make a SwiftDelivery app? Would that also get me sued?

fragmede

4 months ago

Probably not. I am not a lawyer though. The Apple Corps vs Apple Computer lawsuit may make for some interesting introductory reading about various aspects of intellectual property law for you, if you are so inclined.

https://en.wikipedia.org/wiki/Apple_Corps_v_Apple_Computer

leobg

4 months ago

Or from Taylor’s.

lawgimenez

4 months ago

1 reply

Another vibe coded.

mi12-root

4 months ago

While we did use AI coding tools, we put significant thought into the design of SwiftAI and would greatly value feedback on it (see system design doc above). All AI-generated code was carefully reviewed and often, rewritten (no yolo)

hbcondo714

4 months ago

1 reply

Mind me asking what your thoughts are on the overall quality of Apple's on-device LLMs? I've found that LanguageModelSession always returns very lengthy responses:

https://developer.apple.com/forums/thread/789182?answerId=85...

mi12-root

4 months ago

I tested the system LLM with a long article using two prompts: one asking for a summary in at most 20 words, and another asking for a one-sentence summary. In both cases, the model followed the instructions correctly. Regarding your second point in the link above: maximumResponseTokens: 500 corresponds to roughly 1,500–2,000 characters in English. For the AFM tokenizer, a token typically represents 3–4 characters. Could it be why you are getting large outputs? If you share your prompt(s), we’d be happy to take a closer look. You can reach us on Slack, Discord, or privately at root@mi12.dev

Resources