EN
Log inGet started
Article

Detecting damage in photos with AI: what it sees, and what it doesn't

In short: vision AI spots the visible elements in a photo, damage included: a dent, a broken light, a crack, a crushed box. It outlines each one, names it and describes the scene in one sentence. It only sees the surface, and the quality of the photo matters as much as the tool. It prepares the file; the adjuster, manager or quality lead keeps the decision.

7 min read
Video · 30 s

Four situations where photos pile up

Damage photos come in from the phone of a driver, a tenant, a warehouse clerk or a policyholder. Someone then has to look at them one by one, describe what they see and record it in a file.

SituationWhat gets photographedWhat you want to recordWhat slows things down
Claims and vehicle fleetsRental returns, parking-lot scrapes, photos sent by the policyholderPart affected, type of damage, side of the vehicleDescribing each photo by hand before triage
Move-in and move-out inspectionsApartment, commercial space, rented equipment, at the start and the endWalls, floors, windows, appliances; new damageComparing two sets of photos and writing the report
Receiving and returnsParcels, wrapped pallets, unpacked productsCrushed box, torn packaging, breakage, missing label or sealDocumenting the carrier claim on time
Building inspectionsRoof, façade, foundation, equipmentCrack, corrosion, water infiltration, lifted shinglesSorting dozens of photos by defect

When the inspection is filmed rather than photographed, the same work is done frame by frame: see Inspecting a video and isolating each defect as an image.

What vision AI sees in a photo

In a photo, modern vision AI does four things at once.

  1. It spots the visible elements: the main object (a vehicle, a wall, a parcel), the surroundings, and the damage.
  2. It outlines each element: a rectangle, defined by its coordinates in the image, pins it down. You see at a glance what it is talking about.
  3. It names what it sees in plain words: "Broken left tail light", not a code.
  4. It sums up the scene: the camera angle, the object, the setting.

It can also pick out what identifies the photo or document: a logo, a licence plate, a label, a signature or a stamp on an accident report.

The four limits to know

  1. It only sees the surface. A pushed-in bumper can hide a broken bracket; a ceiling stain can hide an old leak. Internal damage needs an inspection.
  2. It doesn't measure. Without an object of known size in the frame, the size of a scratch or a crack stays a visual impression.
  3. It depends on the photo. Blur, backlight, reflections on a wet car body, a photo taken from too far: what the eye struggles with, the AI struggles with too.
  4. It doesn't decide. It doesn't price the repair, settle liability or accept a claim. It prepares the file for the person who will.

Tools built for auto insurance go further, up to estimating repair costs. A general-purpose AI like Scanee's stops at the structured report, but adapts to any object: vehicle, apartment, parcel or equipment.

Six rules for usable photos

These rules help the AI, and they also help your evidence if the file is disputed.

  1. An overview, then close-ups. The overview places the damage; the close-up shows it.
  2. Shoot straight on. An angle perpendicular to the surface limits reflections and distortion.
  3. Light, without direct flash on a shiny surface. Flash creates a glare that hides the damage.
  4. A reference object. A ruler, a coin or a pen next to a crack gives the scale.
  5. Something that identifies the subject in at least one photo: plate, unit number, parcel label, unit address.
  6. The original image. No filter, no tight crop, no screenshot of a photo: you lose detail and the date the photo was taken.

Complete example in Scanee: a photo of a damaged car

The project

In Create a project, choose the Object & Visual Element Detection template. It creates five fields:

FieldWhat it holds
Detected Objects & ElementsEach element spotted, with its box on the image
Scene DescriptionOne sentence summing up the photo
Logos & BrandsBrands, logos, pictograms, with their box
Signatures & StampsSignatures, stamps, seals, with their box
Media TypePhotograph, Scanned Document, Diagram / Schema, Screenshot, Inspection Report or Other

The result

We dropped in a test photo: the back of a grey compact car, in a parking lot. Scanee outlined seven elements (the test was run in French; the labels are translated here).

Element outlinedKind
Damaged grey compact carMain object
Impact damage and scratches on the rear left bumperDamage
Broken left tail lightDamage
Rear wiperVehicle part
Licence plate masked in whiteIdentification
Orange and white traffic coneSurroundings
Metal shopping cartSurroundings

The Scene Description starts with "Rear left three-quarter view of a damaged grey compact car", and the Media Type is Photograph.

A photo of a damaged car in Scanee (French interface): seven elements outlined on the image and listed in the right-hand panel

The cart and the cone have nothing to do with the damage, but they matter: they place the scene (a parking lot) and may explain the scrape.

Fit the fields to your work

The template records everything that is visible. For a claim file or a move-out inspection, you often want the damage only, and a decision. With Add field, add for example:

FieldTypeDescription that guides the AI
Visible damageKeywords / Object detectionOutline only visible physical damage: dent, scratch, crack, broken glass, corrosion
SeveritySelection ListMinor, Moderate, Major
Next stepSelection ListRepair, Replace, Acceptable

The field description is sent to the AI along with the photo. It is what tells the AI what to outline and what to ignore. See Create fields.

Correct before exporting

Each element appears next to the photo, and you stay in control:

  • remove an extra element with one click on its cross;
  • add a missed detail with Draw a zone: you draw a rectangle on the image, and it joins the field;
  • the AI Assistant answers a question about the photo, or proposes filling in a field, which you approve.

Export the file

The template prepares an Object Detection (JSON) export: the file name and link, the media type, the scene description and each element with its coordinates. You can also set up a CSV or Excel export, or connect the project to Google Sheets. See Set up an export.

If you download the photo while the boxes are displayed, Scanee downloads it with the boxes drawn on it, ready to attach to a report. An export can also include the link to that annotated image.

Scanee reads documents with 99.4% accuracy on extracted fields, in about 2 seconds per document: these measurements were made on documents. For photos, check the result on your own images during the trial. The trial lasts 14 days, with no credit card: try Scanee.

Frequently asked questions

Which photo formats are accepted?

JPG, PNG, WEBP, TIFF and HEIC, the iPhone photo format, as well as PDFs. A phone photo can be dropped in as is, without converting it.

How do I detect only the damage and ignore the surroundings?

Add a Keywords / Object detection field whose description asks to outline only the damage, for example "dent, scratch, crack, broken glass, corrosion". The AI follows that description.

Can I correct a box or add one by hand?

Yes. Remove an element with one click on its cross, or add one with Draw a zone by drawing a rectangle on the photo.

Can field teams send their photos by email?

Yes. Each project has its own email address, and photos attached by an approved sender are added to the project and analyzed. See Receive by email.

Can the AI estimate the cost of a repair?

Not reliably, and Scanee doesn't promise it. It spots and describes visible damage; pricing stays with an adjuster, a body shop or your own price list.

Photos or video: which should I use?

Photos for a few specific damages, with close-ups. A video for a full walkthrough of a building or a piece of equipment: Scanee splits it into images, one per defect. See Inspecting a video.

Try it with your own photos

14-day free trial, no credit card.

Try it free →