Hello Dolly: A Cheap, Customizable ChatGPT ‘Clone’

Databricks has unveiled Dolly, an open-source version of ChatGPT that it said exhibits similar high-quality responses – developed for just $30.
Named after the world’s first cloned mammal, a sheep, Dolly has key differences to ChatGPT. Not only is its code openly available for free, Dolly was trained on a much smaller language model of only six billion parameters versus 175 billion for GPT-3 (ChatGPT is fine-tuned on GPT-3.5). Dolly also was trained using only eight Nvidia A100 40GB GPUs vs. 10,000 for ChatGPT.
Databricks’ team said Dolly’s output quality was similar to that of ChatGPT, as evaluated on the instruction-following capabilities in the InstructGPT paper that ChatGPT is based on.
As for Dolly’s shortcomings, the team said the chatbot "struggles with syntactically complex prompts, mathematical operations, factual errors, dates and times, open-ended question answering, hallucination, enumerating lists of specific length and stylistic mimicry."
“We believe the technology underlying Dolly represents an exciting new opportunity for companies that want to cheaply build their own instruction-following models,” the team said. Moreover, companies will likely feel more comfortable inputting proprietary data into their own chatbots rather than give it to a public chatbot like ChatGPT.