Live data from Hacker News

JavaScript singing synthesis library

github.com

1–10 of 29 posts

Re: JavaScript singing synthesis library

#4

This is great, nice job! I'm working on a midi player in JavaScript; it would be interesting to use this as the sound font. Maybe assigning certain words to certain pitches. https://github.com/grimmdude/MidiPlayerJS

What back end code have you integrated this with? Have you tried "flocking"? http://flockingjs.org/

(I have not, I'm just wondering about somebody else's experience with this sort of thing in JS)

I'm still pretty new to this (modern computer synthesis). I had a couple electronic music (synthesis) classes back in the day, but that day was back in the late 80s. We didn't even have any digital equipment the first time I took the class - it was analog gear with literal patch cords between LFOs, envelope generators, oscillators, filters and such. The second time we actually had some digital stuff to do FM and sampling layers.

Re: JavaScript singing synthesis library

#5
post #4

This is great, nice job! I'm working on a midi player in JavaScript; it would be interesting to use this as the sound font. Maybe assigning certain words to certain pitches. https://github.com/grimmdude/MidiPlayerJS

What back end code have you integrated this with? Have you tried "flocking"? http://flockingjs.org/ (I have not, I'm just wondering about somebody else's experience with this sort of thing in JS) I'm still pretty new to this (modern computer synthesis). I had a couple electronic music (synthesis) classes back in the day, but that day was back in the late 80s. We didn't even have any digital equipment the first time I…

There's no back end code used with this (assuming you mean server side). I've never tried flocking but it looks interesting. The library I wrote, MidiPlayerJS, just emits JSON events and in my demo I'm feeding those into a sound font library (https://github.com/danigb/soundfont-player). But my thought was to switch that out for this singing synth library and see what kind of sounds it can produce.

Re: JavaScript singing synthesis library

#6
post #4

Earlier quoted context omitted.

What back end code have you integrated this with? Have you tried "flocking"? http://flockingjs.org/ (I have not, I'm just wondering about somebody else's experience with this sort of thing in JS) I'm still pretty new to this (modern computer synthesis). I had a couple electronic music (synthesis) classes back in the day, but that day was back in the late 80s. We didn't even have any digital equipment the first time I…

There's no back end code used with this (assuming you mean server side). I've never tried flocking but it looks interesting. The library I wrote, MidiPlayerJS, just emits JSON events and in my demo I'm feeding those into a sound font library ( https://github.com/danigb/soundfont-player ). But my thought was to switch that out for this singing synth library and see what kind of sounds it can produce.

I don't know how to inform this author with the issue with 404 when try to load soundfont player.

https://cdn.rawgit.com/gleitz/midi-js-soundfonts/master/Flui...

Re: JavaScript singing synthesis library

#7
post #6

Earlier quoted context omitted.

There's no back end code used with this (assuming you mean server side). I've never tried flocking but it looks interesting. The library I wrote, MidiPlayerJS, just emits JSON events and in my demo I'm feeding those into a sound font library ( https://github.com/danigb/soundfont-player ). But my thought was to switch that out for this singing synth library and see what kind of sounds it can produce.

I don't know how to inform this author with the issue with 404 when try to load soundfont player. https://cdn.rawgit.com/gleitz/midi-js-soundfonts/master/Flui...

You could submit an issue on the repo https://github.com/gleitz/midi-js-soundfonts/

Re: JavaScript singing synthesis library

#8

This is great, nice job! I'm working on a midi player in JavaScript; it would be interesting to use this as the sound font. Maybe assigning certain words to certain pitches. https://github.com/grimmdude/MidiPlayerJS

Looks cool! Combine this with Web MIDI and you could make a reasonable DAW!

Re: JavaScript singing synthesis library

#9
Cute as a Javascript hack, but not going to compete with Vocaloid or Festival Singer.

Somebody really needs to crack singing synthesis. Vocaloid from Yamaha is good, but it works by having a live singer sing a prescribed set of phrases, which are then reassembled. Automatic singer generation is needed.

Figure out some way to use machine learning to extract a singer model from recorded music and generate cover songs automatically. Drive the RIAA nuts. Get rich.

Re: JavaScript singing synthesis library

#10
post #3

The demo doesn't allow you to put in your own lyrics, keeps loading exactly the same set of words. Really awesome project though

Original author here; good catch, I've fixed it now so it'll sing whatever lyrics + notes are in the grid when you press "Set Voices". Thanks for pointing that out!
Post reply on HN