Can I upsell a product with multiple variants?

Yes.

When a product has multiple variants, a drop-down will appear for the customer that can select their choice of variant, be size or colour. Easy Upsell will automatically check if the variants are available for sale and in stock.