Apple ignored engineers’ warnings about faulty AI tech

Source Cryptopolitan

Apple reportedly ignored engineers’ warnings about its faulty Apple Intelligence and went on to release the technology, earning underwhelming market reviews.

The iPhone maker’s Apple Intelligence made headlines for the wrong reasons and garnered widespread criticism, particularly for making up false information and botching news headlines.

Engineers discovered faults in many models including Apple Intelligence

While it is common for large language models to hallucinate, a challenge that the AI industry is yet to solve if ever at all, Apple’s case was a bit different. Engineers noted some deep flaws with the model before it was released. Yet, the company ignored the warnings.

According to analysts, proceeding to release the model was reckless on the part of the tech giant after warnings were sounded about its AI’s gaping deficiencies. The warnings came through a study released in October last year.

Although it is yet to be peer-reviewed, the study also concluded that the models do not reason, after testing the mathematical “reasoning” of some of the top LLMs in the AI industry.

To test the models, the engineers made them solve thousands of math problems from the widely used GSM8K dataset, which is the industry’s benchmark.

According to Futurism, a typical question from the dataset reads: “James buys 5 packs of beef that are 4 pounds each. The price of beef is $5.50 per pound. How much did he pay?”

The engineers exposed the gaps in the AI models by simply changing some numbers in the questions to avoid data contamination. This caused some small but notable inaccuracies in the 20 LLMs examined.

However, when the researchers took it a step further by changing names and adding some “irrelevant details,” the results were “catastrophic,” reaching as high as 65%.

The researchers wrote: “This reveals a critical flaw in the models’ ability to discern relevant information for problem-solving, likely because their reasoning is not formal in the common sense term and is mostly based on pattern matching.”

According to the researchers, the results differed with each model. OpenAI’s 01-preview dropped by 17.5%, and its predecessor GPT-4o dropped by 32%. The researchers noted that even the “cleverest” models faced problems and exhibited some serious flaws.

AI models struggle on their own 

The tests also proved that AI models may seem smart at solving problems, but once they are not copying someone’s homework word-for-word, they struggle. As for Apple, the tech giant reportedly knew about the test results but released its model to the market.

It took serious backlash from the market, including BBC raising concerns about the model dishing out misleading information, for Apple to eventually pause the program until it could fix it.

Apple’s AI feature was expected to summarize news notifications, but it sometimes fabricated news on its own, much to the displeasure of readers and news publishers.

One of the inaccurate news alerts alleged that Rafael Nadal was gay and that a man accused of killing a US insurance boss had shot himself. Apple’s AI also inaccurately summarized BBC app notifications to claim that Luke Littler had won the PDC World Darts Championship hours before it began.

Another incorrect summary of a New York Times story appears to have been published on January 6, relating to the fourth anniversary of the Capitol Hill riots.

“Apple Intelligence features are in beta and we are continuously making improvements with the help of user feedback,” Apple said in a statement to the BBC. “A software update in the coming weeks will further clarify when the text being displayed is summarization provided by Apple Intelligence. We encourage users to report a concern if they view an unexpected notification summary,” the statement added.

Apple’s faulty feature was one of the AI tools released to users of some newer iPhones in December, including the iPhone 16, 15 Pro, and 15 Pro Max handsets, as well as on some iPads and Macs.

A Step-By-Step System To Launching Your Web3 Career and Landing High-Paying Crypto Jobs in 90 Days.

Disclaimer: For information purposes only. Past performance is not indicative of future results.
placeholder
Dogecoin Crash Signal Flashes: Analyst Warns Of A Potential 40% DropDogecoin (DOGE) holders have been put on alert by crypto analyst Ali Martinez (@ali_charts), who shared a chart on Monday highlighting a noteworthy technical setup. According to Martinez, the Market
Author  NewsBTC
22 hours ago
Dogecoin (DOGE) holders have been put on alert by crypto analyst Ali Martinez (@ali_charts), who shared a chart on Monday highlighting a noteworthy technical setup. According to Martinez, the Market
placeholder
Bitcoin Faces Persistent Resistance at $100K, Analyst Eyes Next StepWeeks after hitting an all-time high above $109,000, Bitcoin’s price remains under pressure. It is currently trading below the $100,000 mark, an 11.4% decrease from its peak. The crypto asset’s
Author  NewsBTC
6 hours ago
Weeks after hitting an all-time high above $109,000, Bitcoin’s price remains under pressure. It is currently trading below the $100,000 mark, an 11.4% decrease from its peak. The crypto asset’s
placeholder
XRP slides below $2.72 as Elon Musk's DOGE shift focus to SECRipple's XRP saw a 4% decline in the early Asian session on Tuesday following an announcement that the Department of Government Efficiency (DOGE) is targeting the Securities and Exchange Commission (SEC) as the next agency to face its examination process.
Author  FXStreet
4 hours ago
Ripple's XRP saw a 4% decline in the early Asian session on Tuesday following an announcement that the Department of Government Efficiency (DOGE) is targeting the Securities and Exchange Commission (SEC) as the next agency to face its examination process.
placeholder
XRP Price Pump To $3.35 On The Horizon With Bullish Cup And Handle Pattern FormationThe XRP price is getting ready for a significant pump, as a new Cup and Handle pattern has just formed on its chart. A crypto analyst who identified the pattern has released an analysis, predicting that XRP could rise to $3.35, marking a new local high for the cryptocurrency. Cup And Handle Pattern To Trigger […]
Author  Bitcoinist
4 hours ago
The XRP price is getting ready for a significant pump, as a new Cup and Handle pattern has just formed on its chart. A crypto analyst who identified the pattern has released an analysis, predicting that XRP could rise to $3.35, marking a new local high for the cryptocurrency. Cup And Handle Pattern To Trigger […]
placeholder
3 Reasons Why XRP Is Showing Top Signals As Investors Begin To Rapidly Accumulate This New XRP RivalXRP top signals have surfaced in recent aggregator data, hinting at a potential slowdown following the token’s partial legal victories. Observers note that daily XRP trading volume spiked roughly 15% last week before tapering off, suggesting some whales might be eyeing exit points.  XRP’s spike last week Meanwhile, a new XRP rival has captured growing […]
Author  Cryptopolitan
2 hours ago
XRP top signals have surfaced in recent aggregator data, hinting at a potential slowdown following the token’s partial legal victories. Observers note that daily XRP trading volume spiked roughly 15% last week before tapering off, suggesting some whales might be eyeing exit points.  XRP’s spike last week Meanwhile, a new XRP rival has captured growing […]
goTop
quote