recsys-pipeline-architect

SKILL.md

Recsys Pipeline Architect

A spec-and-scaffold skill for building composable recommendation, ranking, and feed pipelines. Encodes the six-stage pattern popularized by xAI's open-sourced For You algorithm (Apache 2.0) and applies it to any "top K for (user, context)" problem.

Overview

Most "recommendation systems" in production aren't exotic ML — they're pipelines: fetch candidates from one or more sources, enrich them with metadata, drop the ineligible, score the rest, sort and pick the top K, then fire async side effects. The pattern is universal. The scoring function and the items change; the pipeline shape doesn't.

This skill is an independent reimplementation of the pattern (MIT) — no code copied from the original.

When to Use This Skill

Building any system that returns "the top K items for a user/context"

Designing or refactoring a personalized feed (content, search results, notifications)

Wrapping an LLM/ML scorer in proper pipeline plumbing (sources, hydration, filters, side effects)

Adding multi-action prediction with tunable weights (instead of a single relevance score)

Building a RAG retrieval reranker (cheap retrieval → expensive rerank)

Designing a task prioritizer or alert triage system