I to had an odd layer of white'ish dust building up especially during seasonal periods when the HVAC ran a a lot. I carefully swept up the fine dust into a small pile and had it analyzed. Turns out it was very fine fiberglass powder dust. It turns out it is the insulation form the attic! (My attic has blown in insulation). Turns out if you (I) had small gaps around my HVAC registers in the ceiling whee the airs blows into the room. What occurred in my case was that the exiting air at that seam creates a vacuum effect at the grate vent cover and draws and then blows fine insulation dust from the attic into the house. Removing each register grate and sealing each tin outlet gap with calking between the dry wall ceiling and tin fixed the issue. A couple were so bad with bowed gaps I had to screw down the bowed tin to the attaching stud better. Checking the very same glass top desk that catches and shows any dust accumulation now shows only very small amounts of normal house dust build up over several weeks. A big, big improvement. You might have a look by simply removing a couple vent covers yourself.
All these pro duct cleaners answer with "it's common sense, everything operates better when cleaner" etc. But your explanation is correct. Especially so with flex tube ducting where dust gets "stuck" between the lowest valleys (between wire coil supports) where air flow is drastically reduced -- which is more than 50 pct of the entire interior surface area of the flex ducting. That sounds like a bad thing but also has a good effect of trapping dust from escaping.
I hope that those customers you have with breathing problems don't follow your advice too closely. You are doing them a disservice. Dirt in your ducts does not always stay there, depending on what the contaminants are. I bet you tell your customers not to worry about mold either- just to kill it with bleach. Educate yourself before opening your mouth- You may kill someone someday with your opinion.
You should be aware that although a substance may look like mold, a positive determination of whether it is mold or not can be made only by an expert and may require laboratory analysis for final confirmation. For about $50, some microbiology laboratories can tell you whether a sample sent to them on a clear strip of sticky household tape is mold or simply a substance that resembles it.