Sous

source code

Next.js

React

TypeScript

Tailwind CSS

Framer

NextAuth.js

OAuth

MongoDB

FastAPI

Python

PydanticAI

Google Gemini AI

Spoonacular API

Zod

Sous is a multi-agent AI system using PydanticAI to orchestrate vision and natural language processing agents, enabling context-aware input routing and structured output validation. Basically an intelligent cooking assistant that transforms everyday ingredients into personalized culinary experiences.

The system handles diverse user inputs, from fridge photos to natural language queries, by routing them to specialized agents that work in concert to deliver tailored recipe recommendations and cooking guidance.

Dashboard:

Fridge analysis:

Leverages Gemini Vision to analyze fridge photos and extract ingredients with high accuracy
Implements a multi-step workflow: image analysis → ingredient extraction → smart ingredient selection → recipe matching
Provides real-time streaming updates showing progress through each analysis step

Natural language recipe search:

Built an intent classification system that understands complex recipe queries like "healthy vegetarian dinner without nuts in under 30 minutes"
Extracts multiple search parameters (cuisine, dietary restrictions, cooking time, ingredients) from natural language
Integrates with Spoonacular API for comprehensive recipe database access

Cooking related questions:

Implements a context-aware agent that answers cooking questions and provides culinary guidance

currently i'm working on implementing aws s3 and amazon tesseract so that users can save recipes by uploading a recipe image/doc