EleutherAI announces 20 billion-parameter language model, GPT-NeoX-20B
EleutherAI has announced GPT-NeoX-20B, a 20 billion parameter model trained using the GPT-NeoX framework on GPUs from CoreWeave. The company claimed it is the largest publicly accessible pretrained general-purpose autoregressive language model. Image: EleutherAI The model will help in accelerating research towards the safe use of AI systems. Image:  EleutherAI The full model weights will be downloadable for free from February 9, under a permissive Apache 2.0 license from The Eye. Till then, you can try the model using CoreWeave and Anlatan’s inference service, GooseAI. “GPT-NeoX and GPT-NeoX-20B are very much research artifacts and we do not recommend deploying either in a production setting without careful consideration,” EleutherAI said.
The company claimed it is the largest publicly accessible pretrained general-purpose autoregressive language model.
The company claimed it is the largest publicly accessible pretrained general-purpose autoregressive language model.
[]
["Go", "programming_languages:R", "AI", "programming_languages:Go", "GPT", "Aim", "R", "llm_models:GPT"]
["AI", "Aim", "R", "Go", "GPT", "llm_models:GPT", "programming_languages:R", "programming_languages:Go"]
I am a technology journalist at AIM. What gets me excited is deep-diving into new-age technologies and analysing how they impact us for the greater good.

Reach me at sreejani.bhattacharyya@analyticsindiamag.com