Using A.I. to retouch scans for dust and scratches.

Photoemulator

Suspended / Banned
Messages
5
Name
Chrystopher Wayne Robinson
Edit My Images
Yes
Hey there! New guy here on the forum. I searched but there didn't seem to be a question or anyone talking about the idea of using their own local A.I. to retouch scans from their archives. Anyone?
 
Welcome to TP. Do you mean film scans? I would, but the thought of scanning and uploading all my old photos puts paid to that idea straight away.
 
Hey there! New guy here on the forum. I searched but there didn't seem to be a question or anyone talking about the idea of using their own local A.I. to retouch scans from their archives. Anyone?

Why when you could just use one of the many A.I editing tools that are already available?
 
My standard reply is that I don't want any of my work to be training material for someone else's profit. I am speaking of training my own local A.I. machine which is why I didn't mention any of the already available editing tools available.
 
My standard reply is that I don't want any of my work to be training material for someone else's profit. I am speaking of training my own local A.I. machine which is why I didn't mention any of the already available editing tools available.

Is there such a thing as a local AI? I'm not aware of an AI acting in isolation. But, just to put things in perspective you could post a photo here and I could immediately use it as a basis for a copy cat version. The point is humans learn too. Just not at such a prodigious rate as AI.
 
You could do that in principle, I use a lot of local AI models, but having worked with imaging AI development, the difficulty arises in training the AI to remove scratches and dust rather than details, or grain, and ensuring it does not add new details into the images.
You will need to provide sufficient training data (images before and after manual retouching) for it to understand what is and is not good enough. This training will be computationally intensive, and it will require multiple iterations.
 
You could do that in principle, I use a lot of local AI models, but having worked with imaging AI development, the difficulty arises in training the AI to remove scratches and dust rather than details, or grain, and ensuring it does not add new details into the images.
You will need to provide sufficient training data (images before and after manual retouching) for it to understand what is and is not good enough. This training will be computationally intensive, and it will require multiple iterations.
I expected such labor. Thanks for your advice.
 
That's not to say it's not possible, the problem is more infrastructure than the difficulty of doing it.

You'd need:
- Computational power (modern GPUs aren't cheap, but these can be rented through the cloud now)
- Intermediate Python coding knowledge (AI coding assistants are probably good enough to get you going)
- Enough annotated training data, basically before and after data that you know really well, you'd need to show it where every bit of dust and scratch is...(this is the worst part)
- Enough experience with the data to know what features are real or artefacts (was that spot that was removed really dust, or was it someones eye in a group photo?)
- Time to review and retrain the model when it is showing incorrect results

For this part, we have a dedicated full time engineer developing, training and maintaining our AI services, this is overkill for a home user but they do the same things you would have to, but on a slightly larger scale

Only after this will you have a trained AI model that can do scratch or dust removal. The next fun part is building the infrastructure to use that model:
- How do you send your images to and from the model
- How to know the model is working properly
- How to check the performance of the hardware it is running on

To get to this, we had to build a whole Python package to interface between our hardware and our AI models, capable of full diagnostics, resource allocation, and data handling. You would need to do something similar to this, then build a GUI for user friendliness, or just run it from a command line, like a caveman.

I expected such labor. Thanks for your advice.
 
Blimey! That's a lot of work for a few scratches.
 
And that is probably only scratching the surface.

Seriously, thanks for the description Rob.
 
Blimey! That's a lot of work for a few scratches.
It's a lot of work, but it could mean that you never retouch stratches again
 
Back
Top