About Colin
- Define the right use case, value, MVP, metrics (adoption, quality, cost/latency).
- Vibe coding prototypes: prototype quickly → test with users → iterate (ideal for securing a decision before heavy investment).
- Execute Go-to-market strategy: product/market fit, messaging, Product/Tech/GTM alignment, launch plan.
- RAG & orchestration (agents, scoring, embeddings / vector search)
- Evals/QA (rubrics, test sets, hallucination detection)
- Monitoring/guardrails (observability/tracing, brand voice, security, fallbacks)
- Business results: 360k visitors/year • x5 meetings
- Evals scoring: -98% noise (shortlist 2500 → 50)
- Evals hallucination rate: < 2% after context/prompt engineering optimization + guardrails
French
Native or bilingual
English
Native or bilingual
German
Native or bilingual
Experience
- LUNA NOVASenior Consultant GenAI (LLMOps, RAG, Evals) | AI Agents & AutomationDIGITAL AND ITApril 2025 - Today (1 year and 2 months)Paris, FranceRole: GenAI Product & Go-to-Market Consultant (LLMOps, RAG, AI, ML)Positioning: Transform GenAI POCs into reliable products in production (measured quality, controlled risks, adoption)ContextAs a Senior Product Manager and LLM/RAG expert, I help SMEs, digital agencies, and B2B SaaS startups transform GenAI ideas into adopted products (reliable in production, measurable, results-oriented).Missions / Responsibilities
- Product & Value Scoping: target audience, use cases, value proposition, packaging, and pricing for a first GenAI product
- Lean Discovery: field interviews / tests to validate user workflow and avoid building "in the dark"
- Roadmap & MVP: focused scope, success criteria, minimal instrumentation (activation, adoption, quality, cost).
- LLMOps & Reliability: implement Evals / QA / monitoring practices to make the system measurable and improvable
- Delivery & GTM Alignment: synchronizing founders/tech/sales-marketing on priorities, milestones, and feedback loops.
- Definition of quality rubrics (relevance, factuality, style/brand voice, security)
- Setting up test sets (golden set), edge case scenarios, acceptance criteria
- Anti-hallucination strategies (RAG, citations/sources, controlled refusals)
- Production Monitoring: tracking quality, latency, cost, error rates, drifts
- Guardrails: content policies, tone/brand voice constraints, filters, fallbacks, and human escalation
Approach- Scope: 1 target + 1 job-to-be-done + 1 success metric
- Design: workflow + architecture (RAG / agentic) + risks
- Evals: rubrics + dataset + automated tests (pre-production)
- Prod: monitoring + alerting + feedback loop (post-production)
- Iteration: optimizing quality ↔ cost ↔ latency + adoption
KeywordsGenAI • LLMOps • RAG • Evals • LLM evaluation • Monitoring • Observability • Guardrails • QA anti-hallucinations • AI Agents • Product strategy • Go-to-market • Discovery • MVP - Site BunchProduct Owner AI / GenAITELECOMMUNICATIONSFebruary 2023 - March 2025 (2 years and 1 month)Bordeaux, FranceRole: Product Owner (Product + Ops)Product: No-code "website factory" platform for creating and managing website networks at scaleTargets: Local marketing agencies & networks, franchises, groups, SEO / content agenciesContextProprietary SaaS CMS, intuitive no-code administration. Powerful network features (mutualization, sharing, multi-client management) to industrialize website and content production.AI Product VisionAutomatic content optimization for better SEO (on-page + linking)Responsibilities
- Product Strategy & Roadmap: defining vision, trade-offs, prioritization, MVP/iteration scoping.
- Delivery & Operations Management: implementing tracking processes, rituals, tools, and quality management.
- Estimation & Planning: Extreme Estimation, progress tracking, dependency management.
- Management: team of ~25 people (5 direct: PO, CTO, UX... + 20 indirect: dev, designers, integrators, consultants).
- Recruitment: building a team of 15 development consultants.
- Performance & KPIs: tracking burndown, QA, user feedback, reliability, and satisfaction.
Environment / Stack- Process: Scrum, TDD, Gherkin
- Architecture: API + microservices, single codebase, multi-client, Angular / .NET
- DB: PostgreSQL, Redis
- Infra: GitLab, Docker, Kubernetes, Traefik
- Cloud: Google Cloud, OVH Cloud, Cloudinary
- Tools: GitLab, Miro, Figma, Discord
- Tests: LambdaTest, Ghost Inspector
KeywordsCPO • Product Ownership • SaaS • No-code • Platform • Multi-tenant / Multi-client • Agile/Scrum • KPIs • Delivery • Microservices • Kubernetes • Angular/.NET • LLM
Recommendations
Be the first to recommend Colin
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4