Do Upgrades Affect Items Already in Production?

Yes and no.

Items currently being produced keep their original speed. However, items waiting in the queue will benefit from the new speed once production begins.