Pipes: A spiritual successor to Yahoo Pipes

Original Article ↗ Hacker News Discussion ↗

Project overview & pricing

  • Pipes is presented as a spiritual successor to Yahoo Pipes and is open source on GitHub.
  • Hosted service: free tier limited to three “pipes,” with mixed reactions; some find that reasonable and argue more use cases justify paying.
  • Default output is RSS; some see this as retro, others as exactly what the target audience wants.

Visual programming debate

  • Long digression on visual programming styles.
  • Many note that most tools are “boxes and lines” (nodes and edges) for functions and data flow because it maps well to how people draw systems (whiteboards, flowcharts, org charts, etc.).
  • Others argue there are many distinct visual paradigms: block-based languages (Scratch, Blockly, Snap!, Nassi–Shneiderman diagrams), spreadsheets, cellular automata, UML/ERD, spatial programming, and domain-specific node systems (audio DSP, geometry nodes, Petri nets, etc.).
  • Some claim text itself is a visual language and that text and box-and-line are isomorphic representations with no clear hierarchy.
  • A more theoretical subthread invokes category theory, commutative diagrams, and “shapes of reasoning,” proposing novel representations (e.g., simplicial complexes, “plibs,” data lineage–oriented diagrams).
  • There is disagreement on whether the space “needs innovation” vs has already seen lots of experimentation.

RSS relevance

  • One commenter questions whether RSS outputs are still worth supporting.
  • Multiple replies strongly affirm active RSS use: for blogs, HN, podcasts, newsletters (to declutter email), and YouTube channels.
  • Argument that “local popularity” among a product’s users is what matters, not global trends.
  • Implementation effort is seen as modest: essentially templating existing data into XML and storing some history.

Alternatives, ecosystem, and low-code skepticism

  • Comparable tools mentioned: Zapier-like services, n8n (self-hostable), NodeRED (especially for home automation), Apache NiFi, Azure Logic Apps, Palantir Foundry’s PipelineBuilder, rss-funnel, and various visual back-end/API builders.
  • Opinions differ: some praise visual/low-code tools for empowering domain experts and covering most transformation needs; others report they often become opaque production tech debt when built by non-programmers.

Pipes maintainer notes

  • Maintainer describes recent refactor from passing RSS as text between blocks to passing an RSS object, plus server and worker tuning to address instability.
  • Twitter integration was removed after API changes; some stale references remained.
  • Considering a block to POST each feed item to user-defined URLs for custom transformations (e.g., AI summaries, image insertion); chaining multiple pipes is suggested as a current workaround.
  • Some users report email confirmation issues with non-Gmail addresses.