Inkling 2 Small is an open-weight, multimodal AI model that accepts text and images and produces text for chat, coding, agents, and visual tasks. Its large scale and 1-million-token context window make it relevant for developers building advanced AI applications.
The model has 594 billion total parameters but activates 17 billion per token through a sparse mixture-of-experts design. It supports English and other languages, image inputs, tool use, retrieval-augmented generation, and multiple coding languages.
The recommended NVFP4 version needs at least 500GB of combined GPU memory, such as two NVIDIA B300s or four H200s. An MXFP8 version needs at least 800GB, but the documentation says its evaluation gains are only marginal. Developers can run it with SGLang, vLLM, TokenSpeed, Unsloth, or Hugging Face, and access it through Tinker or listed third-party providers.
Training used text, images, video, public sources, third-party data, internally generated data, and synthetic or augmented data. The page reports broad benchmark results across coding, search, business, finance, legal work, visual reasoning, long-context tasks, and factuality.
The model is released under the Apache 2.0 license for research, fine-tuning, and integration into third-party products.
Takeaways
The model combines a 594-billion-parameter sparse MoE architecture with a 1-million-token context window, but practical deployment requires at least 500GB of aggregated GPU memory.
The documentation recommends the NVFP4 checkpoint because the higher-memory MXFP8 version reportedly delivers only marginal evaluation gains.
Article timeline
Build this article’s timeline
Extract dated events, key actors, and open questions using the same timeline analysis available in Signal.
Comments
Login to view and post comments.