Dems lining up to challenge Duffy