Stumbling upon this pointless but intriguing video made my day yesterday. Usually when we talk about machine learning and programming – it’s rarely this light-hearted.
A student from HIT – Tatenda Mushaya made use of Machine Learning techniques to attempt to figure out how many times Noku from Wadiwa Wepa Moyo says “Hesi”.
If you’ve watched the show, you’ll know why the “Hesi” has become equally iconic and infamous resulting in some of funniest social media reactions;
Social media reactions aside, Tatenda followed the steps below;
- Collect images from the internet which can be done using code.
- Resize the images
- Detect faces use script
- Crop the detected face
- Pick only Noku’s face
- Make Noku encodings
- Detect Noku’s face.
- find the `Hie` subtitle
You can see the script he created to do this on Github
In the video above, Tatenda explained that the process was complicated because the script was trying to read text on varying backgrounds and as a result he could only pick up 4 Hesi’s.
Fellow programmers, comment below on how Tatenda can make his script better at identifying Noku’s “Hesi’s”.
Share
Home
9 comments
Thanks for open sourcing your code bro, by the way this isn’t a “stupid mission”
I would frame this as an audio extraction and detection problem. “Hesi” could possibly be said whilst the subject isn’t within frame or not facing the camera. I’ve only watched one episode, so I can’t speak to the distribution of such events.
Audio can be trickier to work with though, as most AI tutorials, examples e.t.c focus on computer vision. One option would be to use text recognition to identify locations of the subtitle “Hie” (regardless of the speaker), then extract the audio within the neighbouring areas and process that accordingly, to identify the speaker.
Dude, this is impressive. This is not stupid at all!
I can see something like this taking off and being useful some day. I home I will remember to hit you up when I find an alternative and more effective way of doing it.
He should just use audio to use the algorithm to pick ‘hesi’ from audo.
Audio algorithm is a very complex but achievable
Even if it’s “stupid”, it’s stupidly funny. I quite enjoyed. Things line these lead to interesting use cases. Remember mould gave us penicillin. It was a botched experiment. Kinda stupid I’d say 😁
Very true
im inspired by this young man. Great work ineed
Dude you are a genious🔥