Tuning NeMo Safe Synthesizer for Agent Conversations (Part 2)
In Part 1, we turned 8,034 customer-service conversations into synthetic training data with NeMo Safe Synthesizer, and models trained on it kept 90.4% of the utility of models trained on the real data. That result used the default settings, which raises some natural follow-up questions. Is fine-tuning really necessary, or would a few example conversations in a prompt be enough? Which settings shift the balance between utility and replay of the training data? And can synthetic data help with labels that barely show up?
Part 2 answers those questions with three experiments on the same dataset.