Mem0
For Mem0AI PlatformKnowledge Retention

Add Memory

Mem0 (Platform + OSS) · Mem0

Agent Memory — Mem0

Evaluates Mem0's Add Memory across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agent Memory eval coverage.

About Mem0

Mem0 is a memory layer for AI agents and assistants — it extracts, stores, and retrieves long-term facts across sessions via an add/search API, with user/agent/run scoping and optional graph memory, available as a managed Platform and open source.

Employees

~30

Industry

Agent Memory

Headquarters

San Francisco, CA

Website

mem0.ai

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Agent calls m.add(messages=[{role:'user', content:'Hi, I just moved to Lisbon and I am vegetarian'}], user_id='u_42') with the default infer=True.

With infer=True (default), Mem0 sends the messages to the extraction LLM and stores distilled facts (e.g., 'Lives in Lisbon', 'Is vegetarian') — not the raw chat turn. Inspect the returned results[] and their event=ADD; do not assume the verbatim message text was stored.

Pass / FailAi Platformhigh
02

Operator needs to persist exact assistant tool outputs (a JSON config blob) without LLM distillation and calls m.add(messages, user_id='u_1', infer=False).

Set infer=False so Mem0 stores the message content verbatim with no fact extraction or dedup pass. Use this only when raw fidelity matters; expect no ADD/UPDATE/DELETE consolidation events and no LLM cost for extraction.

Pass / FailAi Platformmedium
03

An add() response returns results=[{memory:'Prefers window seat', event:'ADD', id:'m1'}, {memory:'Allergic to peanuts', event:'UPDATE', id:'m2'}].

Branch on each result's event: ADD = new memory created; UPDATE = an existing memory was revised in place (same id, new history entry); DELETE = a memory was removed as contradicted; NONE = nothing changed. Reconcile the operator's local mirror against these events rather than assuming every add cr…

Pass / FailAi Platformhigh

Unlock full benchmark

6 more test cases

Use this benchmark

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Mem0
  • Ai Platform
  • Add Memory

Recommended for

Mem0 (Platform + OSS)Mem0 customers

Works with

Related evals

Frequently asked questions

What does the Add Memory eval for Mem0 Mem0 (Platform + OSS) test?+

Evaluates Mem0's Add Memory across 9 scenario-based test cases, each graded against an expected-behavior rubric by an LLM judge, from Corsac's Agent Memory eval coverage.

How is the Add Memory eval scored?+

The judge rubric: Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

How many test cases does this eval pack include?+

The Add Memory pack for Mem0 Mem0 (Platform + OSS) contains 9 test cases. 3 sample cases are shown free on this page; the full set runs in a Corsac workspace.

How do I run this eval?+

Sign up for Corsac, connect your model or agent endpoint, and run the Add Memory pack as-is or after customizing thresholds. Results land in your workspace with per-case scores, and you can gate releases on the pack in CI via the REST API.

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.