Ministers set for further Brexit talks