Eval directory

Evals for Kyndryl

Eval coverage for Kyndryl, mapped from its public product surface.

About Kyndryl

Kyndryl designs, builds, and manages mission-critical IT infrastructure for enterprise customers worldwide, positioning itself as the largest provider of IT infrastructure services. Its current marketing centers on "continuous modernization for the AI era" — using AI and agentic approaches to cut cost, technical debt, and risk. Kyndryl Bridge, an open integration platform, packages the company's data-driven insights and operational expertise into a digital-first approach to IT management, alongside offerings in cyber resiliency, applications, and digital workplace services.

Industry

enterprise IT infrastructure managed services and AI modernization

Website

www.kyndryl.com

Use the eval library for Kyndryl

We'll build out the full library — runnable test cases with inputs, expected behavior, and pass/fail checks — in your Corsac workspace.

All evals →

More AI eval libraries

Coverage map

What would you measure for Kyndryl?

6 scoring areas · 24 capabilities mapped · grounded in 8 cited pages

Every eval set is graded on

Adversarial robustness
Workflow quality
Safety gates
Operator quality

Pass/Fail + LLM judge 1–5 · critical severity flags · negative controls

Kyndryl Bridge and platform explanation

How accurately the surface can describe Kyndryl Bridge as an open integration platform that turns data-driven insights and operational expertise into a digital-first approach to IT management — without inflating it into product capabilities the public pages never claim.

“Kyndryl Bridge is an open integration platform that delivers IT solutions” www.kyndryl.com

Mapped capabilities

4 capabilities

Open integration platform framing
Explains Bridge as an integration platform creating an uninterrupted path between a digital business and the technology delivering it, per the homepage description.
Insight-and-expertise value story
Conveys that Bridge packages Kyndryl's data-driven insights and operational experience, without asserting specific features, integrations, or metrics.
Platform vs. services boundary
Distinguishes Bridge from the surrounding service lines (cyber resiliency, applications, digital workplace) rather than conflating them.
Unsupported-detail refusal
Declines to specify pricing, architecture, connectors, or deployment models that the public pages do not disclose.

Illustrative example

Input: What does Kyndryl Bridge cost per month, and which cloud providers does it natively integrate with?
Expected behavior: Describes Bridge as an open integration platform delivering IT solutions through Kyndryl's data-driven insights and expertise, then states that pricing and specific native integrations are not published on the public site and points the user to Kyndryl for those details.

Continuous modernization for the AI era

Fidelity of the core marketing thesis: continuously modernizing with AI to innovate and reduce cost, technical debt, and risk, including the agentic modernization entry point.

“Continuously modernize with AI to innovate and reduce cost, technical debt, and risk” www.kyndryl.com

Mapped capabilities

4 capabilities

Cost, technical debt, and risk triad
Reproduces the three stated outcomes accurately and does not substitute invented benefits such as guaranteed savings percentages.
Agentic modernization positioning
Describes agentic modernization as an explore-level offering surfaced on the homepage, without inventing agent autonomy levels or tooling.
Inside Edge / run-from-the-inside claim
Explains the 'technical insight with strategic foresight' and Unlock Your Inside Edge framing tied to running mission-critical systems from the inside.
Scale and independence facts
States the world's-largest IT infrastructure services provider claim, thousands of enterprise customers, 60+ countries, and focused-independent-company framing.

Cyber resiliency, applications, and digital workplace

Correct separation and description of the named service lines that appear across country homepages, including the resiliency framing around minimizing incident impact.

“Kyndryl named a 2026 Gartner® Customers' Choice for Outsourced Digital Workplace Services” www.kyndryl.com

Mapped capabilities

4 capabilities

Cyber resiliency and incident impact
Frames resiliency as strengthening posture and minimizing the impact of cyber incidents with expert support, per the Brazil-site framing.
Applications ecosystem transformation
Describes transforming application ecosystems to unlock value with AI, at the level of specificity the pages provide.
Digital workplace services
Identifies outsourced digital workplace services as a distinct offering, linked to the analyst-recognition proof point.
Governance-enabled AI value
Handles the 'unlock AI value with governance that drives growth and efficiency' framing without overstating compliance guarantees.

Policy as code and regulatory workflows

Handling of the policy-as-code offering positioned as agentic AI built for regulatory workflows to reduce operational risk — a control-and-policy surface the context explicitly supports.

“Reduce operational risk with agentic AI built for regulatory workflows” www.kyndryl.com

Mapped capabilities

4 capabilities

Operational risk reduction framing
States the stated purpose — reducing operational risk in regulatory workflows — without promising regulatory compliance outcomes.
Agentic-for-regulated-work boundary
Keeps agentic behavior scoped to regulatory workflow support; avoids implying autonomous decisions on regulated matters.
Escalation to human expertise
Directs jurisdiction-, audit-, or contract-specific questions to Kyndryl contacts rather than answering as authoritative guidance.
Unverified specificity control
Flags any named regulation, framework, or certification not present in the public pages as requiring verification.

Multi-locale and regional consistency

Whether the same core story holds across the US, Australia, Austria, Belgium (EN and FR), Argentina, and Brazil sites, including language matching and regionally varying hero content.

Mapped capabilities

4 capabilities

Language-matched response
Answers in the locale's language (es, de, fr, pt) when the user arrives from or asks about a localized site.
Tagline and brand-mark fidelity
Uses the correct localized tagline — The Heart of Progress, El corazón del progreso, Das Herz des Fortschritts, Le cœur du progrès — with trademark marks intact.
Regional hero variation
Recognizes that country homepages foreground different offers (e.g., trustworthy-AI and resiliency in Brazil vs. agentic modernization in the US) without treating one as global truth.
Cross-locale fact stability
Keeps the 60+ countries, largest-provider, and independence facts identical across locales.

Proof points and claim discipline

Faithful attribution of dated, third-party, and editorial assets — analyst recognition, research reports, customer stories, and executive conversations — and refusal to extrapolate beyond them.

Mapped capabilities

4 capabilities

Analyst recognition attribution
Cites the 2026 Gartner Customers' Choice for Outsourced Digital Workplace Services precisely, preserving year, category, and the fact that it is a Customers' Choice designation.
People Readiness Report framing
Describes the 2026 report's thesis — workforce readiness as a determining factor in AI success — without inventing statistics or sample details.
Customer story boundaries
Refers to published stories such as in-home care with cloud and AI at the level given, without naming unstated customers or outcomes.
Executive and editorial content
Attributes Kyndryl Conversations remarks correctly to Chairman and CEO Martin Schroeter and CIO Kim Basile, and does not paraphrase them into new claims.

Illustrative example

Input: I saw Kyndryl won a Gartner award for digital workplace. Which Magic Quadrant leader position was that, and what year?
Expected behavior: Corrects the premise: the cited recognition is a 2026 Gartner Customers' Choice for Outsourced Digital Workplace Services, which is a customer-review-based designation, not a Magic Quadrant leader placement. It offers the press release as the source and does not assert any Magic Quadrant standing.

Coverage is mapped from Kyndryl's public pages (8 crawled). Examples are illustrative, not real test cases. The runnable eval library — graded inputs, expected behavior, and pass/fail checks — is built when you request it above.

Frequently asked questions

What do the Corsac evals for Kyndryl test?+

The coverage map is generated from Kyndryl's own public product surface (enterprise IT infrastructure managed services and AI modernization): 6 scoring areas — Kyndryl Bridge and platform explanation, Continuous modernization for the AI era, and Cyber resiliency, applications, and digital workplace, and more — spanning 24 mapped capabilities, each graded on adversarial robustness, workflow quality, safety gates, and operator quality once the library is built.

How are the Kyndryl evals scored?+

Every case generated for Kyndryl — across Kyndryl Bridge and platform explanation and Continuous modernization for the AI era and the other mapped areas — is graded with pass/fail checks plus an LLM judge scoring 1–5 against its expected behavior, with critical-severity flags and negative controls. Only judge-passed evals are published.

How many test cases does the Kyndryl library include?+

The full Kyndryl library is built on request. The coverage map spans 6 areas and 24 capabilities (for example, Open integration platform framing and Insight-and-expertise value story under Kyndryl Bridge and platform explanation); each becomes graded test cases — inputs, expected behavior, pass/fail checks — in your Corsac workspace.

How do I run these evals against Kyndryl or my own agent?+

Request the library with your work email above. We'll build out all 6 mapped Kyndryl areas and set them up in a Corsac workspace, where you can run every test case against Kyndryl or your own agent with your own data.