AI interpretability & alignment

Understand your AI. Correct it. Trust it.

Inverse AI shows why an AI model made a decision, lets you fix its behaviour without retraining, and keeps checking that it stays fixed. It builds on published research in medical imaging and machine-learning operations, and ongoing doctoral research on language models.

300+
citations to the founder’s published work
IEEE 2026
explainable-AI study in diabetic retinopathy
Since 2019
publishing on AI, from language to medical imaging
UAEU
doctoral research, College of Computing and AI
The problem

Models answer. They rarely show their work, and they are hard to correct.

AI now grades medical images, drafts decisions, and talks to customers. The people accountable for those systems still can’t easily see why a model decided, change what it does, or prove that it keeps behaving.

Explanations nobody checks

A heatmap looks like an answer. Whether it points at the evidence, or at the dark corner of an image, is rarely measured.

Fixes that mean retraining

Changing behaviour usually means new data and another training run. Runtime steering is faster, but its gains are seldom tested against strong alternatives, or costed.

Rules that now expect both

The EU AI Act and national frameworks expect transparency and human oversight for high-risk AI. Teams need evidence, not just dashboards.

Featured study

Did the model look at the retina?

A model can grade a fundus photograph for diabetic retinopathy in a moment. Our study asks the clinician’s question: did the explanation stay on the retina, and did it support the grade?

82.2%
accuracy, 550-image APTOS 2019 test
0.896
quadratic weighted kappa
0.29→0.21
Grad-CAM border ratio, once scored inside the retina

A research study, not a screening device.

Four fundus photographs beside their Grad-CAM heatmaps. Three predicted grades match the true grade; one moderate case is predicted severe.
Grad-CAM on four test cases. Green frames are correct grades; the red frame is a moderate case graded severe.
How it works

One loop, from a single decision to evidence.

The same discipline applies to an eye scan, a chatbot answer, or a document read by a vision-language model.

  1. Decide
  2. Explain
  3. Check
  4. Intervene
  5. Verify
  6. Monitor

Walk through the loop

Saeed Thabit, founder of Inverse AI
Founder

Saeed Thabit

Founder, Inverse AI · AI safety researcher

Saeed’s research asks when an AI explanation, or an intervention, can be trusted, from retinal photographs to large language and vision-language models.

He brings 15 years of leading engineering teams and architecting cloud-native and enterprise systems for government and private-sector organisations in the UAE. His published work also spans automating machine-learning delivery with DevOps practice, sentiment analysis of social media, and emotion analysis across text and other modalities.

Building the trust layer for AI, from the UAE.

We welcome conversations with investors, clinical and industry partners, and research collaborators.