Constitutes the refereed proceedings of the 5th International Workshop on Machine Learning for Multimodal Interaction, MLMI 2008, held in Utrecht, The Netherlands, in September 2008. This title features papers that cover a wide range of topics related to human-human communication modeling & processing, as well as to human-computer interaction.