Now You Can Run OpenAI’s Whisper on Apple Watches
Argmax released WhisperKit, a software package which enables OpenAI’s Whisper speech recognition model to operate on Apple Watches. This integration leverages Apple’s CoreML framework, making it possible to use Whisper on other Apple devices using the framework. https://twitter.com/reach_vb/status/1757846797890867212?s=20 The software facilitates the implementation of speech recognition in WatchOS applications by harnessing the Apple Neural Engine for real-time voice data processing. Released under the MIT license, WhisperKit is designed for systems running macOS 14.0 or later and Xcode 15.0 or later. Developers can incorporate WhisperKit into their Xcode projects, offering flexibility with audio formats and model selection. Another user went ahead and integrated the Whisperkit with his Vision Pro headset to transcribe his voice. The fusion of WhisperKit with Apple Vision Pro's capabilities is no small feat. Finally got it running on my headset! pic.twitter.com/Q0d393SquE— Ray Fernando (@RayFernando1337) February 14, 2024 Founded in 2020, Argmax Inc. specializes in fields like Natural Language Processing, Recommendation Systems, and Computer Vision. WhisperKit stands as an open-source project, encouraging contributions from developers to enhance its functionality and adaptability. By making WhisperKit available, Argmax aims to broaden the accessibility of speech recognition technology across Apple’s ecosystem, facilitating its integration into applications. Recent work has advanced the use of large language models on devices such as Apple Watches, aiming for local processing of complex tasks. This approach aims to decrease latency, improve privacy, and enhance user interaction. Devices like the Rabbit R1 and Humane Ai Pin are notable for integrating AI in distinct ways. The Rabbit R1 uses a model for interfacing directly with user interfaces, while the Humane Ai Pin employs an AI-based operating system for quick service access without needing activation words, focusing on privacy and user initiation. These devices move the use of AI in smaller devices for more tailored and efficient use of the technology.
Argmax introduces WhisperKit, bringing OpenAI’s Whisper to Apple Devices for instant speech recognition.
Argmax introduces WhisperKit, bringing OpenAI to Apple Devices instant speech recognition.
["Apple", "OpenAI"]
["Go", "OpenAI", "AI", "Apple", "ML", "recommendation systems", "computer vision", "RAG", "Ray", "Aim", "R"]
["AI", "ML", "computer vision", "OpenAI", "Aim", "Ray", "RAG", "recommendation systems", "R", "Go"]
K L Krithika is a tech journalist at AIM. Apart from writing tech news, she enjoys reading sci-fi and pondering the impossible technologies, trying not to confuse it with reality.