[Feature] Implement On-Device LLMs using new Apple API for message rewriting, improvement, and translation

[mikeldev0]

Is there an existing request for feature?

• I have searched the existing issues

What feature would you like?

Implement on-device LLMs using Apple's new API. Integrate LLM capabilities for rewriting, improving, and translating messages directly within the app, leveraging the privacy and performance advantages of Apple's on-device architecture. Ensure seamless user experience and compatibility with Session's core features. Consider UI/UX, device support, and performance constraints.

Anything else?

The new Apple API for LLMs unlocks advanced AI functionality on iOS devices. Use this to deliver message enhancement, rewriting, and translation features—while maintaining user privacy and security. Explore opportunities to support additional languages and improve accessibility.

[pottsandpans]

Thanks for raising, we are tracking this request internally via SES4583.