Nvidia and Apple team up to enhance ChatGPT-like LLM capabilities with ReDrafter technology – NVIDIA (NASDAQ: NVDA)

apple inc. AAPL and NVIDIA Corporation NVDA Announced collaboration to improve performance of large language models.

What happened: The collaboration focuses on integrating Apple’s Recurrent Drafter (ReDrafter) technology with Nvidia’s TensorRT-LLM to increase the speed of text generation.

ReDrafter, which Apple open sourced earlier this year, combines beam search and dynamic tree attention to improve LLM performance.

Collaboration with Nvidia resulted in the integration of ReDrafter into TensorRT-LLM, a tool designed to accelerate LLM on Nvidia GPUs.

See also: Elon Musk agrees with Satya Nadella, Microsoft CEO reflects on ‘incredible speed’ of AI spread in 2024

This integration involves adding new operators to improve TensorRT-LLM’s ability to handle complex models and decoding methods.

Benchmark results show that greedy decoded token generation is 2.7x faster on Nvidia GPUs, significantly reducing latency and power consumption.

Apple’s machine learning researchers noted that this advancement could lower computing costs and improve user experience by reducing latency in production applications.

subscription Benzinga Technology Trends Newsletter Get all the latest technology developments delivered to your inbox.

Why it’s important: In early October this year, Apple announced fourth-quarter revenue of US$94.9 billion, exceeding analysts’ expectations of US$94.56 billion.

Last month, according to Benzinga Pro, Nvidia reported third-quarter revenue of $35.1 billion, a 94% increase from last year and exceeding Wall Street’s consensus estimate of $33.12 billion.

The combined value of these two technology giants is approximately US$7 trillion, with Apple being the most valuable company in the world and Nvidia ranking third.

Price Action: Apple shares fell 2.14% to $248.05 on Wednesday and fell further to $247.19 in after-hours trading. Meanwhile, Nvidia shares rose 2.01% to $131.50 in after-hours trading, recovering from a 1.14% decline to $128.91 during the regular session.

Photo credit: Koshiro K on Shutterstock.com

See more from Benzinga’s Consumer Technology Report follow this link.

Read next:

Disclaimer: This content was produced in part with the help of benzingine nerve and is reviewed and published by Benzinga editors.