Status of challah cut at meat meal

I know there is a halacha in SA that challah cut for a meat meal should not later be used for dairy (eg, making french toast on Sunday morning)

But is it okay to use this challah if you take extra care to keep it parve? For example, after you say hamotzi and cut slices for everyone remove the rest of the loaf from the table.

If you are very careful then it would be ok to eat at the other meal.

Is it okay to serve parve food in parve serving dishes at a meat meal?