As a homeowner and an owner of rental property I can tell you that the air ducts sometimes need to be cleaned. If you have had pets or anyone smoking in your home (even a visitor) for any length of time, having the ducts cleaned is really good idea. I had a tenant who did not smoke, but got married to a smoker more than year after moving in. When I realized someone was smoking I had them move out, but the smell was awful. I had the ducts cleaned and sanitized (it was a bit extra). The ducts were shiny like new afterwards. I left the windows open for a few days and we cleaned the place super clean and then replaced the carpets. The duct cleaning was worth every penny because the house looked, smelled, and felt new afterward. I plan to have my own house ducts cleaned again this year as we have two cats. We had them cleaned about 12 years ago and they found building materials in the ducts! If you move into a house that has never had them cleaned, it is good to do it. If you have allergies, clean the ducts to see if it helps. You never know what is in your ducts if you have never had them cleaned.
You should be aware that although a substance may look like mold, a positive determination of whether it is mold or not can be made only by an expert and may require laboratory analysis for final confirmation. For about $50, some microbiology laboratories can tell you whether a sample sent to them on a clear strip of sticky household tape is mold or simply a substance that resembles it.