您现在的位置是:Alpaca AI: Stanford researchers clone ChatGPT AI for just $600 >>正文
Alpaca AI: Stanford researchers clone ChatGPT AI for just $600
上海品茶网 - 夜上海最新论坛社区 - 上海千花论坛79244人已围观
简介By subscribing, you agree to our Terms of Use and Policies You may unsubscribe at any time.Researche...
By subscribing, you agree to our Terms of Use and Policies You may unsubscribe at any time.
Researchers at Stanford's Center for Research on Foundation Models (CRFM) have unveiled an artificial intelligence (AI) model that works much like the famous ChatGPT but cost them only $600 to train. The researchers said that they hadn't optimized their process and future models could be trained for lesser.
Until OpenAI's ChatGPT was launched to the public in November last year, Large Language Models (LLMs) were largely a topic of discussion among AI researchers. The company has spent millions of dollars training them and making sure that they provided responses to human queries in the way another human would respond.
See AlsoMicrosoft's investments into OpenAI to the tune of billions suggest that training AI models is hard. But researchers at Stanford seem to have done it at a modest budget that could allow AI companies to be spun out of garages.
How Stanford trained AI for minimal costs
A critical component of this achievement was LLaMA 7B, an open-source language model, which the researchers got access to. Interestingly, this model comes from Meta, Mark Zuckerberg's company, and is one of the smallest and most low-cost language models available today.
Trained on trillion tokens, the language model has some capabilities that are equipped with but nowhere close to the levels that we have seen with ChatGPT. The researchers then turned to GPT, the AI behind the chatbot, and used an Application Programming Interface (API) to use 175 human-written instruction/output pairs to generate more in the same style and format.
Generating 20 such statements at a time, the researchers amassed 52,000 sample conversations in very little time, which cost them $500. This dataset was then used to post-train the LLaMa model. Turning to eight 80-GB A100 cloud processing computers, the researchers completed this task in just three hours having spent less than $100.
The trained model, dubbed, Alpaca was then tested against ChatGPT itself in various domains and beat GPT in its own game. The researchers go on to state that their process wasn't really optimized and they could have gotten better results, had they used GPT-4, the latest version of the AI.
The researchers have now released the 52,000 questions that were used in the research alongside the code that was used to generate them, allowing many others to repeat the process and replicate the results. The AI and its responses are not subject to any guardrails that OpenAI has ensured in its chatbot, so one can expect some really nasty replies.
But what if someone does not really care what the chatbot says and about whom and wants it to work without filters? There are Open AI's user terms that prevent users from building competing AI and LLaMA access available only for researchers. But beyond that, there is hardly anything that could prevent one from developing their pet AI.
Guess, this is where regulation comes in. AI is racing very fast and lawmakers are really to catch up soon, else AI will write it itself.
Tags:
转载:欢迎各位朋友分享到网络,但转载请说明文章出处“上海品茶网 - 夜上海最新论坛社区 - 上海千花论坛”。http://www.jz08.com.cn/news/1486.html
相关文章
Cardano targets a fresh high of $3.50
Alpaca AI: Stanford researchers clone ChatGPT AI for just $600Cardano has flipped Binance Coin to become the third-largest cryptocurrency by market cap and is now...
阅读更多
AI and water systems: Do it right not just fast, says study
Alpaca AI: Stanford researchers clone ChatGPT AI for just $600By subscribing, you agree to our Terms of Use and Policies You may unsubscribe at any time.It is 202...
阅读更多
ChatGPT rival Claude AI can comprehend an entire book in seconds
Alpaca AI: Stanford researchers clone ChatGPT AI for just $600By subscribing, you agree to our Terms of Use and Policies You may unsubscribe at any time.Claude AI...
阅读更多
热门文章
- Code archaeologist online unearths the origins of MS
- Soon, we may be able to produce e
- US scientists turn everyday materials into conductors for quantum computers
- America reassures firemen with fire and bullet proof helmet
- Watch: Google Lumiere AI can turn text into stunning videos
- Polkadot price prediction amid spike in volume