Snowflake Arctic Instruct (128x3B MoE), largest open source model

Model architecture, performance, and positioning

• Snowflake Arctic Instruct is a large MoE (128 experts, ~480B params, ~17B active per token), claimed to be compute‑efficient for its size.
• Some are impressed by benchmarks (competitive with Llama‑3 8B on many tasks, strong hallucination scores), others note it’s only mid‑pack versus recent releases and huge in raw size.
• Intended focus is enterprise tasks like SQL generation and “text2SQL,” not general chat; however, even there Llama‑3 70B slightly outperforms it on Snowflake’s own SQL benchmark.
• MoE sparsity reduces compute per token but still requires all experts in memory; running unquantized needs ~1 TB, ~240 GB at 4‑bit, which limits local use to high‑end hardware or cloud.

Use cases and quality in practice

• Users report the public demo is fast and decent at prose and code, but still hallucinates badly on factual questions and citations.
• It handles some niche benchmarks poorly (e.g., reasoning puzzles, physics thought experiments, creative FORTH storytelling, real‑world stacking tasks).
• Hallucinations remain a core complaint despite good leaderboard scores on specific metrics.

Openness and licensing debate

• Snowflake markets the model as “truly open” (Apache‑2 weights and code, plus planned “cookbooks,” data recipes, and fine‑tuning pipeline).
• A major subthread argues this is only “open weights,” not truly open source for LLMs, because full training data and training code are not yet available; OLMo is cited as a stricter reference point.
• Counter‑arguments say OSI compliance only requires code and license, not training corpora, and that expectations here are ideological, not legal.
• Snowflake staff respond that more details (data composition, processing, systems info) and fine‑tuning pipeline will be released, but much is still “coming soon.”

Motivations, ecosystem, and comparisons

• Many see this as part of a broader “every company needs an LLM” wave: marketing, investor signaling, skills‑building, and platform lock‑in for data/ML workloads.
• Others worry about waste: many similar base models and countless small finetunes, echoing cryptocurrency’s resource burn.
• Debate over AI’s CO₂ impact: some call current usage negligible vs other sectors; others fear an exponential curve like crypto and argue for carbon taxes and efficiency focus.

Guardrails and alignment

• Arctic has minimal safety fine‑tuning; it will answer legally or morally sensitive questions more freely than mainstream models, though it still avoids explicit profanity by default.
• Some users appreciate the lack of heavy alignment; others highlight legal/ethical concerns.