Will Qualcomm’s New AI Hub Revolutionize AI Development And Devices?

There’s no question that every tech company is jumping on the artificial intelligence (AI) bandwagon. While some are tying up with AI leaders to infuse the technology into their products, others are building completely new products to facilitate its use.

In this regard, American semiconductor, software and wireless technology services multinational company, Qualcomm, came out with its latest announcement, which is touted to revolutionize the AI industry for developers and technology devices.

At the Mobile World Congress (MWC) in Barcelona, Qualcomm Technologies, Inc. unveiled its latest AI endeavors, including the company’s new Qualcomm AI Hub, latest breakthroughs and some commercial AI-enabled devices.

This was even conveyed through a press note released on the company’s website.

So, what do these AI breakthroughs comprise of? Let’s explore!

What Is Qualcomm’s AI Hub?

Qualcomm’s AI Hub comes with a library of pre-optimized AI models that can be deployed on devices running Snapdragon and Qualcomm platforms.
The library consists of over 75 popular AI and GenAI models, including Whisper, ControlNet, Stable Diffusion and Baichuan 7B.
These models will be optimized for superior on-device AI performance, lower memory utilization, better power efficiency and leverage “hardware acceleration across all cores within the Qualcomm AI Engine (NPU, CPU, and GPU) resulting in 4X faster inferencing times.”
The library can automatically handle model translation from source framework to popular runtimes, allowing developers to seamlessly integrate the models into their apps. Essentially, this brings benefits like immediacy, reliability, privacy, personalization and cost savings.
These models are now available on Qualcomm’s AI Hub, GitHub and Hugging Face, while new models will continually be added, as will support for additional platforms and operating systems.
Additionally, developers can sign up and run the models themselves on cloud-hosted devices using Qualcomm’s platforms, while also getting access to new features on Qualcomm AI Hub.

TechDogs-"A Screenshot Of The Home Page Of Qualcomm AI Hub Website"

Source

What Does Qualcomm’s Cutting Edge AI Research Entail?

Qualcomm’s AI Research division ran Large Language and Vision Assistant (LLaVA) for the first time on an Android smartphone.
This consists of a 7+ billion parameter large multimodal model (LMM) “that can accept multiple types of data inputs, including text and images, and generate multi-turn conversations.”
Outputs from the LLM include enhanced privacy, reliability and personalization.
The division also brought up its first demonstration of Low Rank Adaptation (LoRA) on an Android smartphone, which allows users to create high-quality custom images, while reducing the number of trainable parameters, bringing greater efficiency, scalability and customization.

How Is Qualcomm Revolutionizing Devices?

Smartphones: Qualcomm is bringing a range of flagship commercial AI smartphones powered by the Snapdragon 8 Gen 3 Mobile Platform that offer new GenAI features.
PCs: Using the new Snapdragon X Elite and its 45 TOPS NPU, Qualcomm displayed how it will transform PC-user interactions.
Automotive: The company also demonstrated how GenAI will help deliver more powerful, efficient, private, safer and personalized experiences for drivers and passengers.
IoT: Ahead of this, the company revealed advancements that will help it enhance consumer IoT and connectivity, including integrating a second-generation 5G AI processor.
5G Infrastructure: Qualcomm showcased three groundbreaking AI-based enhancements for network management, including a generative AI assistant for radio access network (RAN) engineers, an AI-based open RAN application (rApp) and an AI-based 5G network slice lifecycle management suite.

TechDogs-"An Image Showing What Qualcomm's AI Hub Offers"

Source

What Did Stakeholders Say?

Durga Malladi, the SVP and GM of Technology Planning and Edge Solutions at Qualcomm Technologies, said, “With Snapdragon 8 Gen 3 for smartphones and Snapdragon X Elite for PCs, we sparked commercialization of on-device AI at scale. Now with the Qualcomm AI Hub, we will empower developers to fully harness the potential of these cutting-edge technologies and create captivating AI-enabled apps.”
[Contd.] “The Qualcomm AI Hub provides developers with a comprehensive AI model library to quickly and easily integrate pre-optimized AI models into their applications, leading to faster, more reliable and private user experiences.”

Do you think the announcements made by Qualcomm will help it gain a strong position in the AI race?

Let us know in the comments below!

First published on Tue, Feb 27, 2024

Enjoyed what you've read so far? Great news - there's more to explore!

Stay up to date with the latest news, a vast collection of tech articles including introductory guides, product reviews, trends and more, thought-provoking interviews, hottest AI blogs and entertaining tech memes.

Plus, get access to branded insights such as informative white papers, intriguing case studies, in-depth reports, enlightening videos and exciting events and webinars from industry-leading global brands.

Dive into TechDogs' treasure trove today and Know Your World of technology!

Disclaimer - Reference to any specific product, software or entity does not constitute an endorsement or recommendation by TechDogs nor should any data or content published be relied upon. The views expressed by TechDogs' members and guests are their own and their appearance on our site does not imply an endorsement of them or any entity they represent. Views and opinions expressed by TechDogs' Authors are those of the Authors and do not necessarily reflect the view of TechDogs or any of its officials. While we aim to provide valuable and helpful information, some content on TechDogs' site may not have been thoroughly reviewed for every detail or aspect. We encourage users to verify any information independently where necessary.

Tags:

Artificial Intelligence (AI)Emerging Technology Generative Artificial Intelligence GenAI Qualcomm AI Hub GitHub Hugging Face LLM Large Language Model Optimized AI

Join The Discussion

Emerging Technology