Skip to content
Yetmgeta Redahegn

AI & Automation Engineer · Addis Ababa, Ethiopia (UTC+3)

I build AI that works in production, and I measure it.

RAG chatbots, AI agents and business automations, built end to end and tested the way AI labs test their models.

  • Python
  • LangChain
  • LangGraph
  • LlamaIndex
  • n8n
  • FastAPI
  • Django
  • Next.js
rag_pipeline.run()judge: grounded
  1. Step 1Ingest your documents
  2. Step 2Index & retrieve
  3. Step 3Generate the answer
  4. Step 4Serve it to users
  5. Step 5Score every answer (LLM-as-judge)
Step 5 is the one most builders skip. I build it in from the start.
  • AfterQuery

    Software engineer at a Y Combinator-backed AI research lab

  • 4 client organizations

    sequa · AfriDev · Blih · AfterQuery

  • Featured on EBS TV

    Business process outsourcing segment

  • Multilingual AI

    Agents that work in English, Amharic, German and more

Services

What I build

  • RAG chatbots & knowledge assistants

    Accurate, grounded answers from your docs, PDFs, websites or database.

    • LlamaIndex
    • LangChain
    • Vector DB
  • AI agents

    Multi-step agents that take in voice, photos and documents, fill in structured forms, review and score submissions, and act across your tools, in several languages.

    • LangChain
    • LangGraph
    • OpenAI
    • Gemini
  • Business automation

    n8n workflows with scraping, databases, email and calendars, with retries, de-duplication and run logging built in.

    • n8n
    • Playwright
    • PostgreSQL
    • Gmail
    • Google Calendar
  • Full-stack AI products

    Backends that serve your models and agents, with a clean frontend and background jobs.

    • FastAPI
    • Django REST
    • Next.js
    • Celery
    • Redis
  • AI evaluation & QA

    Test suites and scoring pipelines that show whether your LLM feature is actually getting better.

    • LLM-as-judge
    • Benchmarks
    • Python
  • Production-ready delivery

    Dockerized services, versioned database migrations and runbooks, so your team can run what I build.

    • Docker
    • PostgreSQL
    • Docs

Work

Selected work

Built for sequa

Agentic Funding-Application Assistant

Turns a small-business owner's spoken story, phone photos and paper licence into a complete, honest funding application, and helps reviewers produce a ranked shortlist they can defend.

  1. Voice note + photos
  2. Intake agent (LangChain)
  3. Structured application + project draft
  4. Eligibility gate & weighted grid (AI evaluation / decision step)
  5. Gap list & declarations
  6. Reviewer agent (AI evaluation / decision step)
  7. Ranked shortlist
  • LangChain
  • FastAPI
  • Next.js
  • LLMs
  • Multilingual

Client project via AfriDev (Upwork agency) · private repository

Aquinas: Scholastic AI Tutor

An end-to-end RAG tutoring platform grounded in Catholic scholastic philosophy, with answer quality measured before release.

Request path

  1. Learner (Next.js)
  2. Django REST API
  3. Redis cache
  4. Celery worker
  5. LlamaIndex retrieval
  6. LLM answer

Evaluation loop (AI evaluation / decision step)

  1. Test questions
  2. RAG pipeline
  3. LLM judge
  4. Quality scores
  • Next.js
  • Django REST Framework
  • LlamaIndex
  • Celery
  • Redis
  • Docker
  • LLM-as-judge

Client project · Blih Marketing and Communication PLC

AI Tender Intelligence Automation

Replaced a team's manual tender research with a pipeline that fetches, enriches, qualifies and schedules tenders automatically.

  1. Tender portal
  2. Playwright fetcher
  3. n8n
  4. PostgreSQL
  5. Prefilter
  6. De-duplicate
  7. LLM qualification (AI evaluation / decision step)
  8. Verdict propagation
  9. Google Calendar + Gmail
  • n8n
  • PostgreSQL
  • Node.js
  • TypeScript
  • Playwright
  • Docker Compose
  • LLM qualification
  • Google Calendar API
  • Gmail API

Experience

Experience & education

  1. AfterQuery

    Software Engineer, AI Evaluation & Benchmark Engineering

    Status: OngoingContract

    A Y Combinator-backed AI research lab. Work on Projects Silver, Pluto and Fenrir across two tracks: AI Model Evaluation & Benchmark Engineering, and Full-Stack Software Engineering (Testing & Evaluation).

    • Author SWE-bench-style coding benchmark tasks: real bugs grounded in a repository's base commit, with machine-verifiable test harnesses (null/oracle-gated) and reference solutions.
    • Work on C++/Rust systems and memory-safety benchmarks (Project Fenrir).
    • Review instructions and rubrics against strict evaluation criteria (leakage, ambiguity, verifier strength, reproducibility) to keep AI training data reliable.
    • Document findings, failure modes and reproduction steps as structured, specific feedback.
    • Delivered accepted benchmark tasks across multiple repositories, earning per-task and per-repository bonuses.
  2. sequa

    AI Engineer

    Status: DeliveredClient Project

    Built an agentic funding-application assistant for small Ethiopian businesses.

    • Applicant agent turns a spoken story, phone photos and a paper licence into a complete, structured funding application, in English, Amharic, German and more.
    • Unverified fields go on a gap list (what's missing, what it needs, from whom) instead of being guessed; declarations are explained in the applicant's language and never ticked for her.
    • Reviewer agent scores each application against the funder's weighted 100-point grid with per-criterion reasoning, runs the eligibility gate and exclusion factors, flags contradictions, and returns a ranked shortlist a reviewer can defend.
    • Stack: LangChain, FastAPI, Next.js.
    Case study: Agentic Funding-Application Assistant
  3. AfriDev (Upwork agency)

    Backend & AI Engineer

    Status: DeliveredFreelance Contract

    Freelance contract work through AfriDev, delivering Aquinas: Scholastic AI Tutor for an offshore client (private repository).

    • Designed and built an end-to-end RAG tutoring platform with LlamaIndex, grounded in Catholic scholastic philosophy.
    • Next.js frontend on a modular Django REST Framework backend.
    • Celery with a Redis broker for background processing, plus Redis caching for queries and responses.
    • Evaluated answer quality with an LLM-as-judge pipeline before release.
    • Dockerized all services for production and delivered under a strict client deadline.
    Case study: Aquinas: Scholastic AI Tutor
  4. Blih Marketing and Communication PLC

    AI Automation Engineer

    Status: DeliveredClient Project

    Built an AI tender intelligence system that replaced the team's manual tender research.

    • n8n, PostgreSQL and a Node.js/TypeScript Playwright fetcher, all in Docker Compose.
    • The fetcher logs in to the tender portal, reuses and renews its session, de-duplicates listings and enriches each tender with its full scope of work.
    • An LLM qualifies each tender against Blih's two service lines behind a fail-open prefilter that never silently drops a plausible tender.
    • Found about 16% of tenders were near-duplicates getting inconsistent verdicts; added de-duplication before the AI step so each group gets one call and one consistent decision.
    • Qualified tenders become Google Calendar deadline events and a Gmail summary; every run is logged.
    Case study: AI Tender Intelligence Automation
  5. Education

    Software Engineering, Adama Science and Technology University

    ALX ProDev Backend graduate

Media

In the media

Yetmgeta Redahegn interviewed on EBS TV in a segment on business process outsourcing

Featured on EBS TV

Interviewed on EBS TV (Ethiopia) in a segment on business process outsourcing, as an Ethiopian engineer who works remotely for offshore businesses.

Process

How we'll work

  1. Step 1Share your idea

    A rough description is enough.

  2. Step 2Get a plan

    I reply with a clear plan, timeline and quote.

  3. Step 3See it early

    A working first milestone arrives early, so you can check direction.

  4. Step 4Clean handover

    Documented code, a setup guide, and support after delivery.

Contact

Have something to build?

Tell me what you want automated or which AI feature you need, and I'll reply with a concrete plan.

Addis Ababa, Ethiopia (UTC+3). Full overlap with Europe, morning overlap with the US.