Weird. I think mine is backwards, sort of. I was normal, I guess, really I don't remember(not NT, but much less pronounced autistic traits) and now they are starting to be more pronounced as I get older, or maybe I just think that because I can't remember when I was a child. My traits are very Asperger's like. I don't know, I'm confused.
I think the only problem with 'residual' is that some people who are not very knowledgeable about these things will say "Oh, residual autism / asperger's - so you're perfectly normal really then."
I guess something like PDD-NOS would be used now for 'residual' traits if HFA or AS didn't fit. I also know someone who was initially diagnosed as residual AS who was recently re-diagnosed with Non-verbal learning disorder.
This sounds like my husband. He has taught himself many compensatory strategies over the years so he might not be called "Aspergers" on a diagnostic test. But NVLD still fits him very well.