MLPerf Inference v3.1 introduces new LLM and recommendation benchmarks

The latest release of MLPerf Inference introduces new LLM and recommendation benchmarks, marking a leap forward in the realm of AI testing.

The v3.1 iteration of the benchmark suite has seen record participation, boasting over 13,500 performance results and delivering up to a 40 percent improvement in performance. 

What sets this achievement apart is the diverse pool of 26 different submitters and over 2,000 power results, demonstrating the broad spectrum of...

12 September 2023 | Artificial Intelligence

How AI can transform the way enterprises test digital experiences

The digital world is evolving rapidly, and businesses need to keep up if they want to offer their customers high-quality digital experiences that meet their needs and expectations. Testing is a crucial component of the digital experience since it makes sure that digital goods and services meet the standards for usability, functionality, and quality.

With the ability to automate and streamline the testing process, enhance accuracy, and reduce costs and time spent on it, artificial...

6 April 2023 | Applications

Xbox’s Matt Booty wants to see QA testers replaced by AI

Xbox Game Studios head Matt Booty told a live audience at PAX that he’d like to see QA (Quality Assurance) testers replaced by AI.

Gaming QA testers regularly come under fire as bug-riddled games reach the hands of disappointed gamers with seemingly increasing prevalence.

The backlash QA testers receive from frustrated gamers is often misplaced. Managers are often aware that games are full of bugs but decide to release unfinished games anyway in the hope of starting to...

7 September 2022 | Applications

Eggplant launches AI-powered software testing in the cloud

Automation specialists Eggplant have launched a new AI-powered software testing platform.

The cloud-based solution aims to help accelerate the delivery of software in a rapidly-changing world while maintaining a high bar of quality.

Gareth Smith, CTO of Eggplant, said:

“The launch of our cloud platform is a significant milestone in our mission to rid the world of bad software. In our new normal, delivering speed and agility at scale has never been more...

6 October 2020 | Enterprise

Applause’s new AI solution helps tackle bias and sources data at scale

applause ai artificial intelligence testing solution data sets scale news

Testing specialists Applause have debuted an AI solution promising to help tackle algorithmic bias while providing the scale of data needed for robust training.

Applause has built a vast global community of testers for its app testing solution which is trusted by brands including Google, Uber, PayPal, and more. The company is leveraging this relatively unique asset to help overcome some of the biggest hurdles facing AI development.

AI News spoke with Kristin Simonini, VP...

6 November 2019 | Deep & Reinforcement Learning