Meta has debuted a new AI model that CEO Mark Zuckerberg said rivals similar offerings from OpenAI and Google.
, took several months to train and hundreds of millions of dollars of computing power. The company said it represents a major update from Llama 3, which came out in April.
Meta’s investments in AI have been steep. Zuckerberg said that Meta’s Llama 3 models cost “hundreds of millions of dollars” in computing power to train, but that he expects future models will cost even more. “Going forward it’s going to be billions and many billions of dollars of compute” power, he said. Meta in 2023 tried to reign in some of its spending on futuristic technologies and management layers, cutting thousands of jobs in what Zuckerberg dubbed the “year of efficiency”.
Despite the pledge to make Llama open, Zuckerberg and other top company executives are keeping the data sets used for training Llama 3.1 a secret. “Even though it’s open we are designing this also for ourselves,” he explained. Meta is using publicly available user posts from Facebook and Instagram, as well as other “proprietary” data sets that the company has licensed from others, Zuckerberg said, without sharing specifics.
Meta told investors in April that it was planning to spend billions of dollars more than initially expected this year, with investments in AI being a core reason why. The company is expected to have some 350 000 Nvidia H100 GPUs by the end of the year, according to a company blog post. The H100 chips have become the foundational technology used to train large language models like Llama and OpenAI’s ChatGPT, and can cost upwards of tens of thousands of dollars apiece.
South Africa Latest News, South Africa Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
ChatGPT voice assistant delayed for safety reasonsOpenAI has decided the ChatGPT voice assistant needs another month to “reach our bar to launch.”
Read more »
OpenAI delays new voice assistant to address safety issuesOpenAI is delaying the release of a much-anticipated voice assistant feature for ChatGPT.
Read more »
Car tech roundup: Next-next-gen batteries, ChatGPT integration, Fiat's Grande Panda EVAway from the show lights, a small company in Sweden is quietly starting a battery revolution.
Read more »
Unisa rocked by AI, ChatGPT cheating scandal after students' scripts flagged as 'disciplinary cases'Unisa rocked by AI, ChatGPT cheating scandal after students' scripts flagged as 'disciplinary cases'
Read more »
Apple rejected Meta Platforms AI partnershipApple has spent years criticising Meta’s technology, and integrating Llama into the iPhone would have been a stark about-face.
Read more »
Meta warns it may block news from Facebook in AustraliaMeta is considering blocking news content from Facebook in Australia if the government makes it pay licensing fees.
Read more »