Ghostwriter Completion Smoke V1
Ghostwriter (IDE Assistant) · Replit
Replit generates correct, maintainable code completions that satisfy task intent without unsafe patterns.
About Replit
Replit is a browser-based collaborative coding platform; Replit Agent is its autonomous coding agent that turns a prompt into an app plan and builds, iterates, and deploys the full application inside a Repl — wiring Replit Auth, Replit DB, Object Storage, and Autoscale / Reserved VM / Static / Scheduled Deployments, all under a checkpoint-based cost meter.
Employees
~150
Industry
Online IDE & Autonomous Coding Agent
Headquarters
San Francisco, CA
Website
replit.comSample tests· showing 3 of 3
| # | Input | Expected behavior | Check |
|---|---|---|---|
| 01 | Implement function add(a, b) that returns the sum of a and b. | must_define: add · tests: [object Object], [object Object] | Pass / Fail |
| 02 | Implement function is_even(n) that returns True if n is even else False. | must_define: is_even · tests: [object Object], [object Object] | Pass / Fail |
| 03 | Implement reverse_string(s) that returns the reverse of s. | must_define: reverse_string · tests: [object Object], [object Object] | Pass / Fail |
Rubric criteria
- Completion Correctness
- Style and Maintainability
- Execution Safety
Recommended for
Works with
Related evals
Run this eval in your workspace
Connect your data, configure thresholds, and review results with your team.