Human Hallucination Prediction

Predict what visual hallucinations humans may experience using neural networks.

How to predict hallucinations:

  1. Select an example image below and click "Load Parameters" to set the prediction settings
  2. Click "Predict Hallucinations" to predict what hallucination humans may perceive
  3. View the prediction: Watch as the model reveals the perceptual structures it expects—matching what humans typically hallucinate
  4. You can upload your own images
  5. You can download the results as a .gif file together with the configs.json
Model
Inference Method
0 40
1 600
0 1
0 0.05
0.01 2
Model Layer

🎯 Adaptive Gaussian mask (spatially varying constraint)

Define where on the image the mask is centered and how large its radius is. Coordinates: -1 = left/top, 1 = right/bottom, 0 = center.

-1 1
-1 1
0.01 1
0.05 1
0.1 350
0.1 10
0.1 150
0.1 10

🎯 Biased inference

Bias the prediction toward a specific ImageNet category (1000 classes).

Biased toward category

Examples

Select an example and click Load Parameters to apply its settings

farm1


ArtGallery1


UrbanOffice1


Neon Color Spreading


Kanizsa Square


Cornsweet Illusion

Instructions: Both blocks are gray in color (the same), use your finger to cover the middle line. Hit 'Load Parameters' and then hit 'Run Generative Inference' to see how the model sees the blocks.


Rubin's Face-Vase (Object Prior)


Confetti Illusion


Ehrenstein Illusion


Grouping by Continuity


Figure-Ground Illusion

🧠 About Hallucination Prediction

This tool predicts human visual hallucinations using generative inference with adversarially robust neural networks. Robust models develop human-like perceptual biases, allowing them to forecast what perceptual structures humans will experience.

Prediction Methods:

Prior-Guided Drift Diffusion (Primary Method)
Starting from a noisy representation, the model converges toward what it expects to perceive—revealing predicted hallucinations

IncreaseConfidence
Moving away from unlikely interpretations to reveal the most probable perceptual experience

Parameters:

  • Drift Noise: Initial uncertainty in the prediction process
  • Diffusion Noise: Stochastic exploration during prediction
  • Update Rate: Speed of convergence to the predicted hallucination
  • Number of Iterations: How many prediction steps to perform
  • Model Layer: Which perceptual level to predict from (early edges vs. high-level objects)
  • Epsilon (Stimulus Fidelity): How closely the prediction must match the input stimulus

Why Does This Work?

Adversarially robust neural networks develop perceptual representations similar to human vision. When we use generative inference to reveal what these networks "expect" to see, it matches what humans hallucinate in ambiguous images—allowing us to predict human perception.

Developed by Tahereh Toosi