Give each model a job.
Claude Haiku extracts structured recipe details from source material. Claude Sonnet handles conversation and chooses tools. Mobile planning uses separate model calls with parsed, validated results.
Product engineering
Engineering an AI assistant for recipes and meal planning.

The product
Links, photos, and conversation become saved recipes, meal plans, and shopping lists. A Telegram assistant and mobile web app connect to the same underlying system.
The Telegram assistant handles recipe intake and conversational changes. The mobile app makes it easy to browse the collection, adjust a meal plan, and work through a grocery list.
Recipes, plans, and lists also have shareable web pages, so the result can travel beyond the chat.
Tool results feed the next model call. The loop continues until the agent can respond, with a limit on iterations.
System architecture
Chat, links, photos
and video URLs
Browse recipes, plan meals
and use shopping lists
TypeScript / Node.js
Hosted on Railway
Recipes, plans, lists
and conversation state
Video transcripts
Recipe webpage content
Telegram and the Mini App connect to one application. It coordinates model and service calls, executes tools, and saves recipes, plans, and lists.
Chat accepts links, photos, and video URLs. The mobile app supports recipe browsing, meal plans, and shopping lists.
The application routes inputs, validates results, runs the chat agent loop, and executes tools.
Claude Haiku extracts structured recipe details. Claude Sonnet handles conversation and tool selection. Mobile planning uses separate model calls.
Supadata retrieves video transcripts. Tavily retrieves recipe webpage content.
Recipes, plans, lists, and conversation state persist in the shared application database.
Engineering decisions
Claude Haiku extracts structured recipe details from source material. Claude Sonnet handles conversation and chooses tools. Mobile planning uses separate model calls with parsed, validated results.
The chat agent can find recipes, save a plan, or change a shopping list. The application executes each tool and returns the result to the model. Changes live in SQLite, ready for the next conversation or app visit.
Extraction distinguishes usable, partial, and failed results. Photo drafts retain corrections between messages, and estimated ingredient quantities from videos are identified in recipe notes.
What would you like to build or improve?
hello@outermost.us