With the recent update, tracking your Speed Seeds or Golden Gloves amount has been made easier. You will now see your total amount of Speed Seeds or Golden Gloves when fast finishing the harvest / crafting time of crops / workshops.  You will continue to only use 1 Speed / 1 pair of Golden Gloves per click and not all of them.