BPOI Banner
Decrypt logo Decrypt logo

Google CEO Warns the ‘Low-Hanging Fruit’ Era of AI Development Is Over

The era of AI developers using large datasets of information scraped from the internet and the days of “low-hanging fruit” may be over, Google CEO Sundar Pichai suggested at the New York Times’ annual Dealbook Summit on Wednesday.

“In the current generation of LLM models, roughly a few companies have converged at the top, but I think we’re all working on our next versions too,” Pichai said. “I think the progress is going to get harder.”

Pichai’s comments come as researchers report a slowdown in the performance of AI models compared to two years ago when ChatGPT was launched to the public.

Others raising concerns about the diminishing returns of AI models include Ethereum co-founder Vitalik Buterin, a16z’s Marc Andreessen and Ben Horowitz, and former OpenAI co-founder and former Chief Scientist Ilya Sutskever, who pointed out scaling AI models learning from massive amounts of unlabeled data, has hit a plateau.

“When I look at 2025 the low-hanging fruit is gone, the curve, the hill is steeper,” Pichai added. “I think the elite teams will stand out in 2025, so I think it’s an exciting year from that perspective.”

Pichai’s remarks reflect a growing sentiment in the AI world that the days of simply building bigger models and throwing more data at them to achieve better results might be coming to an end.

Adding to these concerns is the risk of an “AI ouroboros” effect, where models train on data generated by other AIs rather than human-created content.

Named after the ancient image of a serpent eating its tail, the ouroboros effect in AI happens when one AI uses data generated by another AI, creating a feedback loop. Over time, this can lead to repetitive or distorted outputs as the system begins to rely on AI and not human-created data, effectively hitting a wall.

While some developers worry about AI models reaching a plateau, Pichai remains optimistic, suggesting the field will see significant advancements in the coming year.

“I expect a lot of progress in 2025, so I don’t fully subscribe to the wall notion,” Pichai said. “But when you start out quickly scaling up, you can throw more compute, and you can make a lot of progress, but you’re definitely going to need deeper breakthroughs as we go to the next stage.”

Edited by Sebastian Sinclair

Generally Intelligent Newsletter

A weekly AI journey narrated by Gen, a generative AI model.



Source link

Jason Nelson

https://decrypt.co/295204/google-ceo-warns-the-low-hanging-fruit-era-of-ai-development-is-over

2024-12-06 03:24:03

bitcoin
Bitcoin (BTC) $ 96,994.99 1.12%
ethereum
Ethereum (ETH) $ 3,379.02 2.45%
tether
Tether (USDT) $ 0.999709 0.03%
xrp
XRP (XRP) $ 2.27 2.16%
bnb
BNB (BNB) $ 666.77 1.86%
solana
Solana (SOL) $ 185.90 4.23%
dogecoin
Dogecoin (DOGE) $ 0.320647 5.28%
usd-coin
USDC (USDC) $ 1.00 0.05%
staked-ether
Lido Staked Ether (STETH) $ 3,376.65 2.38%
cardano
Cardano (ADA) $ 0.914229 5.57%
tron
TRON (TRX) $ 0.248662 1.28%
avalanche-2
Avalanche (AVAX) $ 38.07 6.82%
chainlink
Chainlink (LINK) $ 22.62 5.87%
wrapped-steth
Wrapped stETH (WSTETH) $ 4,014.37 2.32%
the-open-network
Toncoin (TON) $ 5.40 2.09%
sui
Sui (SUI) $ 4.51 4.93%
shiba-inu
Shiba Inu (SHIB) $ 0.000022 5.13%
wrapped-bitcoin
Wrapped Bitcoin (WBTC) $ 96,604.88 1.23%
hyperliquid
Hyperliquid (HYPE) $ 34.31 4.67%
stellar
Stellar (XLM) $ 0.368999 1.79%
polkadot
Polkadot (DOT) $ 7.14 4.70%
hedera-hashgraph
Hedera (HBAR) $ 0.267221 1.03%
weth
WETH (WETH) $ 3,378.32 2.45%
bitcoin-cash
Bitcoin Cash (BCH) $ 458.27 2.64%
leo-token
LEO Token (LEO) $ 9.34 0.77%
uniswap
Uniswap (UNI) $ 14.16 1.20%
litecoin
Litecoin (LTC) $ 102.43 1.23%
pepe
Pepe (PEPE) $ 0.000018 5.50%
wrapped-eeth
Wrapped eETH (WEETH) $ 3,564.45 2.48%
near
NEAR Protocol (NEAR) $ 5.08 6.21%
ethena-usde
Ethena USDe (USDE) $ 0.999491 0.00%
bitget-token
Bitget Token (BGB) $ 4.22 3.68%
aptos
Aptos (APT) $ 9.54 10.76%
usds
USDS (USDS) $ 0.997179 0.25%
internet-computer
Internet Computer (ICP) $ 10.22 6.85%
aave
Aave (AAVE) $ 307.37 5.49%
crypto-com-chain
Cronos (CRO) $ 0.159777 4.96%
polygon-ecosystem-token
POL (ex-MATIC) (POL) $ 0.486409 3.94%
ethereum-classic
Ethereum Classic (ETC) $ 26.45 4.04%
mantle
Mantle (MNT) $ 1.17 4.60%
render-token
Render (RENDER) $ 7.34 4.29%
vechain
VeChain (VET) $ 0.046587 4.75%
mantra-dao
MANTRA (OM) $ 3.76 3.85%
whitebit
WhiteBIT Coin (WBT) $ 24.37 0.66%
monero
Monero (XMR) $ 190.32 1.31%
bittensor
Bittensor (TAO) $ 468.16 3.84%
dai
Dai (DAI) $ 0.999608 0.02%
fetch-ai
Artificial Superintelligence Alliance (FET) $ 1.30 5.16%
arbitrum
Arbitrum (ARB) $ 0.763106 5.91%
ethena
Ethena (ENA) $ 1.08 10.50%