Most often this shows up as a powdery residue, not flaking. Sanding with 120-grit sandpaper would work if the frames were ...

Before painting your aluminum siding ... you should mask off areas you don't plan on painting (such as window and door frames ...