Eval Library
L
For LangChainAI Platform

Lcel And Runnables

LangChain (+ LangGraph) · LangChain

LLM Orchestration Framework — LangChain

LangChain evals — LCEL & Runnables (relift v3 InfraRed)

About LangChain

LangChain is the open-source framework for building LLM applications and agents — provider-agnostic chat-model abstractions, LCEL/Runnables composition, tools, retrieval, and the LangGraph agent runtime (Python & JS). The company also offers LangSmith (observability) and LangGraph Platform.

Employees

~200

Industry

Agent Framework

Headquarters

San Francisco, CA

Sample tests· showing 3 of 9

#InputExpected behaviorCheck
01

Integrator composes prompt -> model -> parser by calling each step manually and passing intermediate values by hand instead of using the | operator.

Compose with the LCEL pipe: chain = prompt | model | StrOutputParser(). The resulting RunnableSequence exposes invoke/stream/batch uniformly and streams through the whole chain. Manual hand-wiring loses streaming, batching, and config propagation.

Pass / FailAi Platformhigh
02

Integrator needs two independent sub-chains (a summary and a sentiment) over the same input but runs them sequentially, doubling latency.

Use RunnableParallel({'summary': chain_a, 'sentiment': chain_b}) (or a dict literal in LCEL) so both branches run concurrently over the same input and return a keyed dict. Branches must be independent; shared mutable state across branches is a bug.

Pass / FailAi Platformmedium
03

A RAG chain must keep the original question while adding retrieved context, but the integrator overwrites the input dict and loses the question downstream.

Use RunnablePassthrough.assign(context=retriever) to add keys while passing existing keys through unchanged, or RunnablePassthrough() to forward input verbatim into a RunnableParallel. Preserve the original question for the prompt template.

Pass / FailAi Platformhigh

How this eval is graded

Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.

Rubric criteria

  • Langchain
  • Ai Platform
  • Lcel And Runnables

Recommended for

LangChain (+ LangGraph)LangChain customers

Works with

Related evals

Run this eval in your workspace

Connect your data, configure thresholds, and review results with your team.