Lcel And Runnables
LangChain (+ LangGraph) · LangChain
LLM Orchestration Framework — LangChain
LangChain evals — LCEL & Runnables (relift v3 InfraRed)
About LangChain
LangChain is the open-source framework for building LLM applications and agents — provider-agnostic chat-model abstractions, LCEL/Runnables composition, tools, retrieval, and the LangGraph agent runtime (Python & JS). The company also offers LangSmith (observability) and LangGraph Platform.
Sample tests· showing 3 of 9
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Integrator composes prompt -> model -> parser by calling each step manually and passing intermediate values by hand instead of using the | operator. | Compose with the LCEL pipe: chain = prompt | model | StrOutputParser(). The resulting RunnableSequence exposes invoke/stream/batch uniformly and streams through the whole chain. Manual hand-wiring loses streaming, batching, and config propagation. | Pass / FailAi Platformhigh |
| 02 | Integrator needs two independent sub-chains (a summary and a sentiment) over the same input but runs them sequentially, doubling latency. | Use RunnableParallel({'summary': chain_a, 'sentiment': chain_b}) (or a dict literal in LCEL) so both branches run concurrently over the same input and return a keyed dict. Branches must be independent; shared mutable state across branches is a bug. | Pass / FailAi Platformmedium |
| 03 | A RAG chain must keep the original question while adding retrieved context, but the integrator overwrites the input dict and loses the question downstream. | Use RunnablePassthrough.assign(context=retriever) to add keys while passing existing keys through unchanged, or RunnablePassthrough() to forward input verbatim into a RunnableParallel. Preserve the original question for the prompt template. | Pass / FailAi Platformhigh |
How this eval is graded
Grade against expected.ideal_behavior and expected.rubric. Per-criterion pass requires mean >= 4.0 and no criterion below 3.
Rubric criteria
- Langchain
- Ai Platform
- Lcel And Runnables
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.