You are viewing documentation for an older version of Lucille.

This is a static snapshot.
For up-to-date information, see the latest version.

Cookbooks

Practical cookbooks for common Lucille pipeline patterns.

Lucille cookbooks are practical, step-by-step guides for common ingestion patterns.

Available Cookbooks

  • File Ingestion — Ingest files from the local filesystem, Amazon S3, Azure Blob Storage, and Google Cloud Storage. Covers CSV, JSON, XML, incremental mode, tombstone deletions, and Tika text extraction.

  • Vector Search — Build end-to-end vector search pipelines: chunk text, generate embeddings (OpenAI or local via JLama), and index into Pinecone or Weaviate.

  • RSS Ingestion — Ingest RSS feeds into CSV or OpenSearch, including incremental mode.

File Ingestion Cookbook

Recipes for ingesting files from the local filesystem, Amazon S3, Azure Blob Storage, and Google Cloud Storage.

Vector Search Cookbook

A guide to building vector search pipelines with Lucille — chunking text, generating embeddings, and indexing into Pinecone or Weaviate.

RSS Cookbook

A guide to using the RSS Connector in Lucille.