Dolly is a low-cost LLM that takes EleutherAI’s existing 6 billion-parameter open-source model and slightly modifies it to inspire instruction-following capabilities. Start training Add the dollyrepo to Databricks (under Repos, click Add Repo, enter https://github.com/databrickslabs/dolly.git, and click Create Repo). Start a 12.2 LTS ML (includes Apache Spark 3.3.2, GPU, Scala 2.12) single node cluster with 8 A100 GPU node types (e.g. Standard_ND96asr_v4 or p4…

#Lowcost #generative #Dolly

Leave a Comment

Your email address will not be published. Required fields are marked *