Automatic burp detection

I made something that automatically detects burps in videos. It’s not perfect but it usually finds most of them.

Example file
Original: https://www.youtube.com/watch?v=VlUL5l5_n64
Output: http://files.bfforums.com/HOT_DOG_MUKBANG_Brittany’s_highly_requested_storytime_VlUL5l5_n64.mp4

Let’s test it in this thread. Post links and I’ll upload what it finds. Or if you don’t want to post the link publicly, send me a PM.

28 Likes

Machine learning application?

1 Like

Mostly, with youtube-dl and ffmpeg handling some video stuff.

2 Likes

That sounds cool! Let’s try: Mukbang - Pika Pika Bruh ~ Maria Alive - YouTube

1 Like

Does it work off chats/loud sounds? What’s it do exactly to detect it?

http://files.bfforums.com/Mukbang_-Pika_Pika_Bruh~_Maria_Alive_DlyHQVyRvMM.mp4

1 Like

It analyses the audio, a bit like how youtube’s auto captions work.

1 Like

Now we just need to train it to have the fetish itself :rofl:

12 Likes

Wow! That’s super impressive. I think it found every burp from that video. Any way it could provide timestamps as well?

1 Like

Huh how does that work lmao :skull:

5 Likes

Yep, look in the bottom left corner and it’ll tell you at which point that is in the video.

Oh sweet! Didn’t even see that with my play controls in the way. Very cool.

1 Like

Does this happen to be a custom model for deepspeech? I experimented with this a long time ago but never found it to be feasible. Nonetheless, very impressive work

2 Likes

Thanks. Not that one exactly, but looking through that page, it seems to use some similar parts (I saw something about tensorflow there)

3 Likes

Is this some thing we’d be able to use on our own?

Only in this thread, the idea being if someone has a long twitch stream or something that they didn’t wanna watch all the way through, they could post it here. I could potentially make a website or app though if people find it useful enough.

9 Likes

I think it would be a good idea, because i don’t know about other people but knowing you can just take a video and it finds all the burps for you, seems like heaven

4 Likes

I’d agree but sounds like Q needs to give it a bit more training to optimise it’s detection rate.

Does it only work with YouTube videos or could you throw in any mp4 file?

Not only youtube. It works with any video or audio.