VIEW THIS AS

Auto mode follows the Route Engine until you choose a viewpoint.

YOU ARE HERE

ROUTE CHECK

CONNECTED TO

WHAT NEXT

Use the canonical route for this room, or HELP if you are unsure.

How Artificial Intelligence AI Works | How AI Recognises Objects in Photos

Did you know? A computer can look at a photograph and suggest “cat,” “bicycle” or “traffic light” without anyone writing a rule for every possible picture. That is what makes AI image recognition so fascinating: the system learns visual patterns from examples, then tries those patterns on a new image.

Here is the quick answer: a picture becomes numbers → a trained model extracts visual features → the model scores possible labels or locations → the application displays a result. It is pattern recognition, not a guarantee that the machine understands the whole scene the way a person does.

Imagine showing a child a hundred pictures of bicycles from different angles. The child learns what usually makes a bicycle a bicycle. AI does not learn exactly as a child does, but the comparison helps us notice why varied examples matter.

A fast guide: recognition, detection and segmentation

  • Image classification: choose a label for an image, such as “cat” or “dog”.
  • Object detection: locate one or more objects, often with bounding boxes around each.
  • Image segmentation: assign regions or pixels to object categories, creating a more detailed map.
  • Optical character recognition: turn visible writing into text; this is a related but different computer-vision task.

Those jobs are easy to mix up. A model that identifies “three apples” is doing a different job from one that draws a box around each apple. When comparing tools, ask which output you actually need.

Step 1: The camera turns light into pixel values

A digital photograph is a grid of numbers representing colour and brightness. Before a computer-vision model can analyse it, an application may resize the picture, adjust numerical ranges or divide it into patches. Those choices can change what visual detail remains.

To a person, the photograph contains a cheerful brown dog running across grass. To the processing pipeline, it begins as structured numerical data. The training process has to help the model connect patterns in those numbers with labels or other useful outputs.

Step 2: Training helps the model detect useful patterns

For a labelled-image task, developers may train a model with many image–label examples and measure how often its predictions disagree with the training targets. An optimisation process adjusts the model’s parameters to reduce that error. Neural networks can learn increasingly complex visual features, but not every computer-vision system uses the same architecture.

A shallow visual clue might relate to edges or colour transitions. More developed representations can help distinguish wheels, frames and handles in unfamiliar views. The exact intermediate features are learned and are not always easily translated into human words.

A crucial detail: many examples do not guarantee good examples. If all the training bicycles are photographed on roads, the model might partly rely on road backgrounds. Show it a bicycle hanging on a white wall and the shortcut may fail.

Step 3: The model produces scores, not eyewitness testimony

Suppose an entirely fictional classifier gives an image these scores: dog 0.78, fox 0.14, other 0.08. The highest-scoring category is “dog,” but that does not prove the photo really contains a dog. The numbers may not even correspond to accurate real-world probabilities unless the model has been carefully calibrated.

The practical test: Would it still recognise the same object when the lighting, background, camera angle or image quality changes?

Strong evaluation uses examples the model did not simply memorise during training. It should also test the conditions people care about: blurry photos, unfamiliar locations, unusual object sizes and images containing more than one plausible subject.

Step 4: The application decides what to do with the prediction

One app might put a label beneath the picture. Another might highlight where an object appears. A third might pass the detected object to a navigation or accessibility system. These are not identical uses, and each has a different acceptable error rate.

Mistaking a puppy for a fox on a pet-photo album is inconvenient. Missing a hazard in a safety-critical setting is a very different problem. The required evaluation and human oversight should match the consequences of a mistake.

Try a mini experiment with three photos

Choose an everyday object such as a cup. Take a photograph with a clean background, another from above and a third partly obscured by a notebook. If you use a suitable image-recognition application, compare its descriptions. Never upload private photographs merely to perform this exercise; a freely licensed or self-created non-sensitive object photo is enough.

Ask three questions. Did the output change? Which visual clues became harder to see? Did the application claim something that the pixels did not establish, such as who owns the cup or where it was bought? The third question is especially useful: recognising an object is not the same as knowing its story.

Common mistakes beginners can avoid

  • Confusing object classification with identity: “a person appears here” does not establish who that person is.
  • Assuming the model sees every detail: compression, cropping and resolution can hide relevant information.
  • Ignoring the training distribution: unusual backgrounds, lighting and viewpoints may cause errors.
  • Trusting a single confidence score: a score is a model output that must be evaluated, not a certificate of truth.
  • Assuming all image models do the same task: classifying, detecting, segmenting and captioning are different jobs.

Frequently asked questions

How does AI recognise faces and objects differently?

Both use computer-vision techniques, but detecting a face, verifying whether two face images match and identifying a person by name are distinct tasks with different privacy implications. Treat biometric identification as sensitive.

Can image recognition work without the internet?

Yes, some models can run on-device. Others send images to remote servers. Whether this happens depends on the application, its model size and deployment design—not on the word “AI” alone.

Why does an AI description sometimes invent a detail?

An image-captioning model may generate a plausible sentence that goes beyond what the visible image supports. Ask it to separate what it can observe from what it is inferring.

What should students learn from this?

Look for observable evidence, compare alternative interpretations and test a claim in changed conditions. The same habits that help in Mathematics and Science help you evaluate AI. The broader How AI Works overview explains how training, evaluation and human judgement connect.

What to remember in one minute

  • Pixels are numerical inputs; they do not arrive with meanings attached.
  • Training can teach a model useful visual patterns, but shortcuts and bias can survive.
  • The best label is not proof of truth; test new settings and keep a human check when errors matter.

Explore the wider series and sources

Discover more from eduKate Singapore

Subscribe now to keep reading and get access to the full archive.

Continue reading