How can i make a program which can recognise feelings ?

melisaztrk

Hello, I want to make a project which can recognise emotions from words that i said. Where should i start ?

Chrisir

Hello!

Sounds Interesting!

You mean you enter a text by typing and the program estimates the emotions?

First idea: Microsoft has within its azure program a branch of cognitive services (via api).

There is one as a preview that could suit you. Learning curve is probably pretty steep:

https://azure.microsoft.com/en-us/services/cognitive-services/text-analytics/

An api is a service that you can use from within your sketch

Chrisir ;-)

Chrisir

You should get some texts that are test cases for the emotions you want to detect. Eg unhappy / angry customers or suicidal people.

Without texts you cannot test.

Beside the api I mentioned a naive approach would be to search the text for keywords like frustrated sad angry anger tears dark sunny afraid fear etc. and count them. With a certain threshold or probability the emotion with the most words (that belong to this emotion) in the text wins against the other emotion.

When 2 or more emotions have the same word count both apply.

The approach is naive because a sentence like I am not angry just sad would mislead the program...

melisaztrk

Ok, thank you. But i want to recognise emotions from speech. I think i should record the voice first and i though i can use minim library for this. Then should i make the program write those speech to a file ? I don't know how to do it.

Chrisir

In the azure site there are also speech emotions api and speech recognition api. Both is not trivial.

Do you mean you convert the speech to text first and then recognize the emotion in the text or do you mean you recognize the emotion in the speech (its sound)?

Maybe look at the libraries of processing (extra menu point on the website) or search speech to text here in the forum

Chrisir

But yes, for the basics like recording I guess minim is a good starting points.

It has great examples

melisaztrk

Thank you for your helps. :)

Chrisir

;-)

jeremydouglass

Emotions from speech is a very hard problem. If you are looking for articles and software tools the phrase you are looking for is "speech sentiment analysis."

http://www.utd.edu/~john.hansen/Publications/CP-ICASSP13-KaushikSangwanHansen-Sentiment-0008485.pdf

jeremydouglass

Also note that:

"I hate you so much!" (said in a joking / happy / loving tone of voice)

If you run speech sentiment analysis, it will focus on the tone (love).

If you use speech recognition to text and then use sentiment analysis on text, it will focus on the words content (hate).

melisaztrk

Yes, you are right. Speech sentiment analysis is important here. I will consider it. Thank you.