Stability AI has revolutionized the world of software development with the introduction of Stable Code 3D, its flagship product for automated code generation and completion. This product was launched as an AI model with three billion parameters and is particularly notable for innovations such as a larger context size and improved completion quality.
Stable Code 3B
Stable Code 3B does not require specialized GPUs and can run efficiently on common hardware such as laptops. The company claims that despite the small size of its product, it successfully competes with models more than twice its size. The model is built on Stability AI’s Stable LM natural language model, with additional training on software engineering data, covering 18 different programming languages.
During the training process, Stability AI expanded the context dimension with Rotary Position Embeddings (RoPE) techniques, and the model has the advanced ability to not only suggest new lines of code, but also to fill in missing sections in existing code. This capability, called Fill in the Middle (FIM), allows it to automatically write entire functions or components.
It is emphasized that Stable Code 3B has attracted the attention of giants such as Microsoft, OpenAI and Meta in the field of AI-generated code and outperforms similar models. This product has a feature that aims to enable developers to be more productive and creative, allowing them to focus on complex challenges.
Stability AI and Stable Code 3D
According to the company, Stable Code 3B is much more successful than the existing StarCoder in PHP, Rust, Python, C++, JavaScript and Java. In December, Stability AI announced a subscription service that includes Stable Code 3B as well as other AI tools. The service offers access to a variety of tools, including SDXL stable diffusion rendering tools, StableLM Zephyr 3D for text content rendering, Stable Audio for audio rendering, and Stable Video for video rendering. This step demonstrates Stability AI’s effort to maintain its leadership in the industry by offering customers a wide range of AI tools.
