How It Works

From a single decision to evidence you can act on.

Inverse AI follows one loop, whether the model grades an eye scan, answers a question, or reads a document with images in it.

The loop

Six steps. Nothing is taken on trust.

  1. Decide

    The model returns an output: a grade, an answer, a refusal. It is recorded with its input and the exact model version.

  2. Explain

    Several explanation methods attribute the decision to parts of the input (pixels, tokens) or to internal features of the model.

  3. Check

    Each explanation is scored. For images, does the credit fall inside the region that can carry evidence? Across methods, do they agree? A map that fails is reported as failing.

    Published method: Sight

  4. Intervene

    If behaviour needs to change, a steering edit is applied at runtime. The weights stay fixed, and the edit is written up as a STEER card.

    In research: Steer

  5. Verify

    The change is measured against the untouched model and against a strong alternative, and its cost is counted. A gain that doesn’t survive the comparison is reported that way.

  6. Monitor

    In production, decisions, explanations, and interventions are tracked for drift, fairness, and audit, and the loop starts again.

    Builds on the founder’s MLOps research

The STEER card

Every intervention, described the same way.

Steering results are hard to compare because they are reported differently. A STEER card fixes the format, so two interventions on two different models can be read side by side.

S
SignalHow the steering direction is built.
T
Target siteWhere in the model the change is written.
E
EditWhat is added, removed, or gated.
E
ExecutionWhen it runs, and under what rule.
R
ResultWhat moved, against which comparison, at what cost.
Worked example

One fundus photograph, end to end.

In Sight, a retinal image is pre-processed, graded, explained twice, and then scored only inside the retinal disc, so credit that spills onto the black border doesn’t count.

  1. Fundus image
  2. Pre-process
  3. Grade
  4. Grad-CAM + SHAP
  5. Retinal mask
  6. Report
See the full study
A moderate diabetic retinopathy photograph shown through resize, contrast enhancement, background subtraction, and circular crop.
The photograph as the model sees it. The circular crop is the region the explanation is later scored on.
Architecture

The platform, layer by layer.

The system is designed as six services. The repositories are set up, and the build is starting from the published methods.

Data layer

Datasets, masks, and annotations, versioned alongside every model and result.

Model serving

Hosts the models under study, with hooks into their internal activations.

Explanation tools

Attribution methods and the scoring that checks them.

Intervention engine

Applies steering edits at runtime and records each one as a STEER card.

Monitoring

Drift, fairness, and audit dashboards with alerting.

API and dashboard

One interface for engineers, reviewers, and auditors.

See the research behind each step.

Every step in the loop maps to published or ongoing work.