Skip to content

Emotion Flip Reasoning via Stacked Instruction Finetuning of LLMs

Vy Nguyen, Xiuzhen Zhang

Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024) · 2024 · 326–336

doi:10.18653/v1/2024.semeval-1.50

The problem

To find what caused an emotion flip, the model has to answer a few smaller questions first: did the emotion change, whose emotion changed, and which earlier utterance caused it?

If everything is predicted at once, those steps are hidden inside one answer. When the model gets the final utterance wrong, it is hard to tell where the reasoning failed.

What I do

I separate the reasoning into steps.

With stacked instruction finetuning, the model learns to identify the flip, track whose emotion changed, and then find the utterance that caused it.

Cite

Vy Nguyen, Xiuzhen Zhang. 2024. Emotion Flip Reasoning via Stacked Instruction Finetuning of LLMs. Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024) 326–336.

PDF ↗