The Orange Pi 5 Plus

Original Article ↗ Hacker News Discussion ↗

Enthusiasts are examining the Orange Pi 5 Plus as a high-end ARM single-board computer that can handle tasks from lightweight local LLM inference and home automation to databases, k8s nodes, and video capture, often outperforming Raspberry Pi 4/5 in raw capability and I/O. Many weigh it against cheap x86 mini‑PCs (e.g., Intel N100/Ryzen boxes), arguing over total cost, power efficiency, software support, and whether ARM SBCs still make sense once you approach ~$100–150. Others highlight ecosystem gaps—non‑mainline kernels, reliance on Armbian/DietPi, limited SATA, and quirks like USB 2.0 ports—as factors that can limit its appeal for roles like low‑power NAS or general “real computer” replacements.

LLMs and AI on Orange Pi / CPUs

  • Several comments discuss running small, quantized LLMs and Whisper on RK3588 boards.
  • Models that fit in 4 GB RAM are described as weak at instruction-following and inconsistent, but may be “good enough” for simple smart-home intents.
  • Others report better results with ~2–3B parameter models on 8+ GB systems, though speeds vary.
  • General consensus: GPU not strictly required; CPU-only inference via tools like llama.cpp / Ollama is viable if latency demands are modest.

Benchmarks, Comparisons, and Fairness

  • Some criticize the article’s benchmarks for mixing different storage types and CPUs, arguing this undermines conclusions.
  • Others counter that low-end Intel boxes often lack full-speed NVMe and that the tests are still CPU-bound in key cases.
  • RK3588 is praised for having a strong PCIe layout and full-speed NVMe, which many cheap x86 mini-PCs lack.

Use Cases and Real-World Deployments

  • Reported uses include: home metrics and logs read-replicas, IoT metrics DBs, k3s/k8s nodes, video capture relays, and home automation backends.
  • Users highlight good performance for SQLite/Postgres, stability under Linux, and suitability as low-power “always-on” infrastructure.

Pricing, Value, and Competition with N100/Mini‑PCs

  • Many argue that once SBCs exceed ~$100–150, N100/Ryzen mini‑PCs with more RAM, storage, and x86 compatibility become more attractive.
  • Others stress advantages of SBCs: fanless, very small, ARM-native for embedded/edge work, GPIO and HAT ecosystem, and lower idle draw.
  • Energetic debate about whether saving ~10 W justifies higher upfront costs; multiple commenters share detailed kWh cost math with very different local electricity prices.

Software, Kernels, and Distributions

  • Strong recommendation to avoid vendor images on non‑Pi SBCs; Armbian and DietPi are preferred for longevity and transparency.
  • Complaints that some Armbian builds (e.g., HDMI on certain boards) can be broken for months, so “just works” experiences still trail Raspberry Pi OS.
  • Some refuse to buy hardware without solid mainline kernel support; Rockchip images are called “mystery meat” by critics.

Raspberry Pi vs Clones and Market Direction

  • Debate over Pi 5’s value: some see it as overpriced and hot versus N100 boxes; others argue the Pi ecosystem and new RP1 southbridge signal a strategic shift towards in‑house silicon and more flexible future designs.
  • Several note that Pi’s original goal was education and GPIO‑centric tinkering, not high‑end server roles.

Other Hardware Notes

  • Interest in HDMI‑input on Orange Pi 5+ and other boards; Linux support status is still unclear and under-tested.
  • Desire for SBCs with native SATA and 10GbE for power‑efficient NAS; current boards often require PCIe adapters or compromises.
  • Brief side discussions cover Radxa Zero 3E, RISC‑V SBC maturity, and concerns that Orange Pi 5+ has only USB 2.0 ports.