AI Skills Hub — Automated Discovery & Enrichment Pipeline for AI Agent Skills (aiagentivo.com)

A searchable directory of AI agent skills, built by a pipeline that finds, parses and enriches them automatically.

Live site: https://www.twine.net/signin

What it solves

Agent skills and tool definitions are scattered across public repositories in inconsistent formats. Finding a good one means reading a lot of README files. This project indexes them and makes them searchable with real metadata.

The pipeline

discover -> extract -> normalise -> PostgreSQL -> Gemini enrich -> API -> UI

• Discover: crawl public sources and queue candidate repositories, with de-duplication and change detection so the same source is not reprocessed for nothing.
• Extract: parse skill definition files across several formats and layouts, tolerating malformed input rather than crashing the batch.
• Normalise and store: map heterogeneous inputs into one PostgreSQL schema. This is the unglamorous data-mapping work that makes everything downstream possible.
• Enrich: Gemini generates summaries, categories and tags on top of the extracted content, with the raw source retained so enrichment can be re-run when the prompts improve.
• Serve: FastAPI JSON API behind a Next.js frontend with full-text and faceted search.

Engineering notes

Idempotent ingestion, incremental re-crawls, Dockerised workers, and structured LLM output validated against a schema before it ever reaches the database.

Stack

Next.js, FastAPI, PostgreSQL, Gemini, Docker, scheduled data pipeline.

Architecture notes: https://www.twine.net/signin