Evals and Functional Testing using Replit

Evals and Functional Testing using Replit

Evals and Functional Testing using Replit

Upwork

Upwork

Remoto

17 hours ago

No application

About

Seeking a solid engineer who has direct experience with code-assist tools like Replit Agent 3 (which now integrated Claude Sonnet 4.5). This is an incredibly capable platform. The role involves running evals, functional tests, performing light integrations on and with our agentic-AI platform and paying attention to UX/UI. Prompting abilities and knowledge of what technical debt looks like are the #1 and #2 skill. Proficient with Github, experience integrating services like Supabase, MongoDB, Redis, Pinecone. **Frontend:** - React 18 + TypeScript - Vite (build system) - D3.js (for Sankey diagrams) - WebSocket (real-time updates) **Backend:** - FastAPI (Python web framework) - SQLAlchemy 2.0 (async ORM) - Alembic (database migrations) - Python RQ + Redis (task queue) - DuckDB (embedded analytics for DCL) - Pydantic (validation)