Ferret LLM
Apple has quietly loued ferret the feret an open- Source large language model developed in collaboration with Cornell University as reported by data economy unlike traditional language models faret combines language understanding with image analysis allowing it to analyze
specific regions of images and respond to prompts involving both text and visuals the release signifies Apple’s move towards openness presenting challenges in scaling against larger models like gp4 due to infrastructure
limitations however the potential impact on Apple devices is immense promising improved image-based interactions augmented user assistance enriched media understanding and a platform for developer Innovation but what does this mean
What does this mean
now this Apple’s fet llm has emerged as a silent but powerful player in the AI landscape breaking away from Apple’s typical secrecy faret is an open source model developed in collaboration with Cornell University uniquely integrating language understanding with image
analysis this Fusion allows faret to go beyond textual comprehension and extend into the world of visuals analyzing specific elements within images and incorporating them into responses the technological proficiency of par life in its visual integration enabling it to respond to queries involving both text and images
For example it can identify objects within image and leverage surrounding elements to provide deeper insights creating a more contextual and comprehensive understanding what sets faret apart is not just its capabilities
but also Apple’s strategic move towards openness by releasing feret as an open source model on GitHub apple is inviting developers and researchers to explore enhance and refine its capabilities fostering a collaborative ecosystem but the license excludes commercial use
However, challenges lie ahead for Apple in scaling faret to compete with industry giants like GPD 4 infrastructure limitations raise questions about the model’s ability to deploy large scale language models efficiently strategic decisions
such as potential Partnerships or further embracing open- Source principles may be necessary to overcome these hurdles the potential impact of faret on Apple devices is considerably promising enhanced user experiences and
functionalities improved image-based interactions with Siri Advanced visual search functionalities augmented user assistance for accessibility needs and enriched media and content understanding are amongst the potential benefits
Developers too stand to benefit from feret’s capabilities with opportunities to create Innovative applications across various domains however the implementation of faret into Apple products depends on factors like technological feasibility user privacy considerations.
Way to go Apple
The extent of integration into existing Apple software and Hardware Bart D from open met future wrote on X ferret’s
introduction is a Testament to Apple’s commitment to impactful AI research solidifying its place as a leader in the multimodal AI space.
Way to go Apple P.S I’m looking forward to the day when local large language models run on my iPhone as an integrated service of a redesigned iOS and running llms on device might be closer than we think a week ago techradar.com reported that Apple is working on a way to make their
phones run their own large language models this could mean exciting AI features on devices Apple researchers shared their findings in a pair of papers The challenge is that iPhones have limited memory and modern AI models
like GPT 4 are massive and hard for phones to handle Apple’s solution involves two techniques windowing where the AI reuses processed data to reduce the load on the hardware and row column bundling which organizes data into big chunks for better language understanding.
Article Reading
Apple releases faret 7B multimodal large language model this is an article out of geeky gadgets.com Apple has recently introduced the faret 7B a sophisticated large language model that represents a significant step forward in the realm of artificial intelligence
the new technology is a testament to Apple’s commitment to advancing AI and positions the company as a formable player in the tech industry.
The faret 7B is engineered to integrate smoothly with both iOS and macOs taking full advantage of Apple’s powerful silicone to ensure users enjoy a fluid experience the standout feature of the fet 7B is a multi is its multimodal capabilities which allows it to interpret and create content that combines images and text
so let’s read that again send out features that it allows it to interpret and create content that combines images and text so this breakout goes Beyond but beyond what traditional text-based AI models can do the fair 7B capabilities
are showcased in systems like Google 5.2 coding model and mix L X8 7B which are built on Apple’s MX platform and utilize its unique tools uh this is just some of the tools that they were talking about here
I’m not going to go over that um there’s Buzz around the upcoming iOS 18 which is expected to incorporate AI more comprehensively potentially transforming how users interact with Apple devices the collaboration between AI advancements and Apple’s silicone architecture is likely to result in a more cohesive powerful ecosystem for
both iOS and Mac OS users so yeah so this article is saying that they expect 18 to actually come out with it so that will probably line up with maybe the release of the iPhone 16
so the iPhone 16 would more than likely be probably the first advice to have uh their AI sper 7B built into it so that will remains to be seen once that happens in the fall I doubt they released iOS 18 before that it will make more sense to well actually we’ll probably see iOS 18
at their worldwide developer conference and then more like that will probably come out on the iPhone 16 here are some of the other no not that for those interested in technical performance of Fet 7B Apple has developed the freret bench
a benchmarking tool specifically for this model this tool will help developers and researchers evaluate the model’s efficiency and flexibility in various situations Apple’s approach to AI Center.