You're seeing this page as if you were . The main menu is still yours, though. Exit from immersion
Colin D.CD

Colin D.

Senior AI Product Manager | LLMOps - RAG - Evals

€820/day
Paris, FR
8-15 years

Average response time: 1 hour

Freelancer profile translated to English.
Back to original language

About Colin

👋 Hello and welcome!
Senior AI Product Manager (10+ years), I specialize in LLMOps / LLM / RAG / Evals: I transform GenAI ideas into reliable products in production.

What I offer:
🎯 GenAI Product Scoping
  • Define the right use case, value, MVP, metrics (adoption, quality, cost/latency).
  • Vibe coding prototypes: prototype quickly → test with users → iterate (ideal for securing a decision before heavy investment).
  • Execute Go-to-market strategy: product/market fit, messaging, Product/Tech/GTM alignment, launch plan.
⚙️ LLMOps Industrialization (RAG – Evals – Monitoring)
  • RAG & orchestration (agents, scoring, embeddings / vector search)
  • Evals/QA (rubrics, test sets, hallucination detection)
  • Monitoring/guardrails (observability/tracing, brand voice, security, fallbacks)

📊 Examples of results
  • Business results: 360k visitors/year • x5 meetings
  • Evals scoring: -98% noise (shortlist 2500 → 50)
  • Evals hallucination rate: < 2% after context/prompt engineering optimization + guardrails

🤝 I work mainly remotely, with the possibility of occasional on-site presence.
📩 Contact me to discuss - quick response guaranteed.
  • French

    Native or bilingual

  • English

    Native or bilingual

  • German

    Native or bilingual

Can work on-site
Paris (up to 50km), Bordeaux (up to 50km)

Experience

  • LUNA NOVA
    Senior Consultant GenAI (LLMOps, RAG, Evals) | AI Agents & Automation
    DIGITAL AND IT
    April 2025 - Today (1 year and 2 months)
    Paris, France
    Role: GenAI Product & Go-to-Market Consultant (LLMOps, RAG, AI, ML)
    Positioning: Transform GenAI POCs into reliable products in production (measured quality, controlled risks, adoption)

    Context

    As a Senior Product Manager and LLM/RAG expert, I help SMEs, digital agencies, and B2B SaaS startups transform GenAI ideas into adopted products (reliable in production, measurable, results-oriented).

    Missions / Responsibilities
    • Product & Value Scoping: target audience, use cases, value proposition, packaging, and pricing for a first GenAI product
    • Lean Discovery: field interviews / tests to validate user workflow and avoid building "in the dark"
    • Roadmap & MVP: focused scope, success criteria, minimal instrumentation (activation, adoption, quality, cost).
    • LLMOps & Reliability: implement Evals / QA / monitoring practices to make the system measurable and improvable
    • Delivery & GTM Alignment: synchronizing founders/tech/sales-marketing on priorities, milestones, and feedback loops.
    • Definition of quality rubrics (relevance, factuality, style/brand voice, security)
    • Setting up test sets (golden set), edge case scenarios, acceptance criteria
    • Anti-hallucination strategies (RAG, citations/sources, controlled refusals)
    • Production Monitoring: tracking quality, latency, cost, error rates, drifts
    • Guardrails: content policies, tone/brand voice constraints, filters, fallbacks, and human escalation
    Approach
    • Scope: 1 target + 1 job-to-be-done + 1 success metric
    • Design: workflow + architecture (RAG / agentic) + risks
    • Evals: rubrics + dataset + automated tests (pre-production)
    • Prod: monitoring + alerting + feedback loop (post-production)
    • Iteration: optimizing quality ↔ cost ↔ latency + adoption

    Keywords
    GenAI • LLMOps • RAG • Evals • LLM evaluation • Monitoring • Observability • Guardrails • QA anti-hallucinations • AI Agents • Product strategy • Go-to-market • Discovery • MVP
    LLMOps Artificial Intelligence Product Management Product-Market Fit Retrieval-Augmented Generation (RAG)
  • Site Bunch
    Product Owner AI / GenAI
    TELECOMMUNICATIONS
    February 2023 - March 2025 (2 years and 1 month)
    Bordeaux, France
    Role: Product Owner (Product + Ops)
    Product: No-code "website factory" platform for creating and managing website networks at scale
    Targets: Local marketing agencies & networks, franchises, groups, SEO / content agencies

    Context
    Proprietary SaaS CMS, intuitive no-code administration. Powerful network features (mutualization, sharing, multi-client management) to industrialize website and content production.

    AI Product Vision
    Automatic content optimization for better SEO (on-page + linking)

    Responsibilities
    • Product Strategy & Roadmap: defining vision, trade-offs, prioritization, MVP/iteration scoping.
    • Delivery & Operations Management: implementing tracking processes, rituals, tools, and quality management.
    • Estimation & Planning: Extreme Estimation, progress tracking, dependency management.
    • Management: team of ~25 people (5 direct: PO, CTO, UX... + 20 indirect: dev, designers, integrators, consultants).
    • Recruitment: building a team of 15 development consultants.
    • Performance & KPIs: tracking burndown, QA, user feedback, reliability, and satisfaction.
    Environment / Stack
    • Process: Scrum, TDD, Gherkin
    • Architecture: API + microservices, single codebase, multi-client, Angular / .NET
    • DB: PostgreSQL, Redis
    • Infra: GitLab, Docker, Kubernetes, Traefik
    • Cloud: Google Cloud, OVH Cloud, Cloudinary
    • Tools: GitLab, Miro, Figma, Discord
    • Tests: LambdaTest, Ghost Inspector
    Keywords
    CPO • Product Ownership • SaaS • No-code • Platform • Multi-tenant / Multi-client • Agile/Scrum • KPIs • Delivery • Microservices • Kubernetes • Angular/.NET • LLM
    Product Management Artificial Intelligence Agile Project Management LLM LLMOps

Recommendations

Be the first to recommend Colin

Help this freelancer shine by sharing your experience working together.

These freelancer profiles also match your criteria

AgathaA

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

2

BaptisteB

Baptiste Duhen

Fullstack developer

4.6

(4)

5

AmedA

Amed Hamou

Senior Lead Developer

4

(2)

7

AudreyA

Audrey Champion

Web developer

4.3

(3)

4

Skill set

Categories