Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: A singing synthesizer for the browser with automatic 3-part harmony

pbat.ch

Post reply on HN
Print view View original

31–36 of 36 posts

Re: Show HN: A singing synthesizer for the browser with automatic 3-part harmony

#31

Post by atech4826 »

zebproj wrote: post #29

Thanks everyone for the suggestions and kind words. Some details: The source code for this project can be found on github [0]. I am using an AudioWorklet node with custom DSP using Rust/WebAssembly. Graphics are just done with the Canvas API. The voice leading is done algorithmically using a state machine with some heuristics. The underlying DSP algorithm is a physical model of the human voice, similar to the model y…

Dear zebproj,

Apologies for the late comment, but I had a query I wanted to share.

Would it be possible for you to create a tool that allows users to mimic human emotional sounds directly in the browser? I’m thinking of sounds like realistic coughs, sighs, gasps, and other vocal expressions like shouting or crying etc . It would be amazing if the tool could optionally incorporate TTS, but even without it, the functionality would be very valuable for content creators or people who need custom sound effects.

The idea is to let users customize these sounds by adjusting parameters such as intensity, pitch, and duration. It could also include variations for emotional contexts, like a sad sigh, a relieved sigh, a startled gasp, or a soft cough. An intuitive interface with sliders and buttons to tweak and preview sounds in real-time would make it super user-friendly, with options to save or export the generated audio much like the project pinktrombone

I’m quite new to this field and only have basic experience with HTML, CSS, and JavaScript. However, I am very much interested in this area and I was wondering if this is something that could be achieved using tools like CursorAI or similar AI-based solutions? Or better yet, is it possible for you to create something like this for people like me who aren’t very tech-savvy?

Thank you so much

Re: Show HN: A singing synthesizer for the browser with automatic 3-part harmony

#33

Post by zebproj »

atech4826 wrote: post #31
zebproj wrote: post #29

Thanks everyone for the suggestions and kind words. Some details: The source code for this project can be found on github [0]. I am using an AudioWorklet node with custom DSP using Rust/WebAssembly. Graphics are just done with the Canvas API. The voice leading is done algorithmically using a state machine with some heuristics. The underlying DSP algorithm is a physical model of the human voice, similar to the model y…

Dear zebproj, Apologies for the late comment, but I had a query I wanted to share. Would it be possible for you to create a tool that allows users to mimic human emotional sounds directly in the browser? I’m thinking of sounds like realistic coughs, sighs, gasps, and other vocal expressions like shouting or crying etc . It would be amazing if the tool could optionally incorporate TTS, but even without it, the functio…

Greetings,

What a beautiful idea. Sadly, I do not think I currently have the skills required to build such a tool.

The underlying algorithms and vocal models I'm using here are just good enough to get some singing vowels working. You'd need a far more complex model to simulate the turbulent airflow required for a cough.

If you suspend disbelief and allow for more abstract sounds, I believe you can craft sounds that have similar emotional impact. A few years ago, I made some non-verbal goblin sounds [0] from very simple synthesizer components and some well-placed control curves. Even though they don't sound realistic, character definitely comes through.

0: https://pbat.ch/gestlings/goblins

Re: Show HN: A singing synthesizer for the browser with automatic 3-part harmony

#34

Post by hunter2_ »

zebproj wrote: post #27
hunter2_ wrote: post #24

95% of the time, I can only get 1 voice at a time. 5% of the time, I can get 2 or 3 voices at a time (1 variable pitch, the others fixed pitch) but I have no idea what input causes this rare behavior. Can you add some help text explaining what various input sequences will achieve? Android Chrome with touch input (Pixel 8 Pro).

A tutorial would be helpful. Holding down a note and waiting will cause a second, then a third not to appear. When you move your held, note to another pitch, the other pitches will follow, but with a bit of delay. This produces what is known as staggered voice leading, and produces interesting "in-between" chords.

Aha! In hindsight, I'm amazed that I managed to not figure this out on my own.

Re: Show HN: A singing synthesizer for the browser with automatic 3-part harmony

#36

Post by atech4826 »

zebproj wrote: post #33
atech4826 wrote: post #31

Earlier quoted context omitted.

Dear zebproj, Apologies for the late comment, but I had a query I wanted to share. Would it be possible for you to create a tool that allows users to mimic human emotional sounds directly in the browser? I’m thinking of sounds like realistic coughs, sighs, gasps, and other vocal expressions like shouting or crying etc . It would be amazing if the tool could optionally incorporate TTS, but even without it, the functio…

Greetings, What a beautiful idea. Sadly, I do not think I currently have the skills required to build such a tool. The underlying algorithms and vocal models I'm using here are just good enough to get some singing vowels working. You'd need a far more complex model to simulate the turbulent airflow required for a cough. If you suspend disbelief and allow for more abstract sounds, I believe you can craft sounds that h…

Dear Zebproj Thankyou for the response. I see, do you believe that tools like cursor Ai or ChatGPT can help like you I too do not have the skills to make such a tool and while I am trying to get there it will be quite sometime if I can learn those skills and implement. I really wish if someone can make my wish come true I will still however have a look at what you shared cheers Alex
Post reply on HN