MediaTek Leverages Meta’s Llama 2 to Enhance On-Device Generative AI in Edge Devices

Written by MediaTek

Image
MediaTek

HSINCHU, Taiwan – August 23, 2023 – MediaTek, a leading global fabless semiconductor powering more than two billion connected edge devices every year, today announced it is working closely with Meta’s Llama 2, the company’s next-generation open-source Large Language Model (LLM). Utilizing Meta’s LLM as well as MediaTek’s latest APUs and NeuroPilot AI Platform, MediaTek aims to build a complete edge computing ecosystem designed to accelerate AI application development on smartphones, IoT, vehicles, smart home, and other edge devices.

Presently, most Generative AI processing is performed through cloud computing; however, MediaTek’s use of Llama 2 models will enable generative AI applications to run directly on-device as well. Doing so provides several advantages to developers and users, including seamless performance, greater privacy, better security and reliability, lower latency, the ability to work in areas with little to no connectivity, and lower operation cost.

To truly take advantage of on-device Generative AI technology, edge device makers will need to adopt high computing, low-power AI processors and faster, more reliable connectivity to enhance computing capabilities. Every MediaTek-powered 5G smartphone SoC shipped today is equipped with APUs designed to perform a wide variety of Generative AI features, such as AI Noise Reduction, AI Super Resolution, AI MEMC and more.

Read more on MediaTek

Share article