Stability AI, the company that developed the neural network for generating Stable Diffusion images, has released the alpha of the StableLM language model. It can be used to generate both text and code.
To train StableLM, an open data set, The Pile, was used. It contains information from Wikipedia, PubMed, Stack Exchange and many other platforms.
Stability AI has published the StableLM source code on Github. Now there are two versions of the model available: with 3 billion and 7 billion parameters. Later, the company intends to release larger versions with 15 billion, 30 billion and 65 billion parameters.