For some reason, I found the sample audio unnerving. I don't know. I guess there's also an uncanny valley for synthesized speech?
JavaScript singing synthesis library
21–29 of 29 posts
Re: JavaScript singing synthesis library
#22Earlier quoted context omitted.
I don't know how to inform this author with the issue with 404 when try to load soundfont player. https://cdn.rawgit.com/gleitz/midi-js-soundfonts/master/Flui...
You could submit an issue on the repo https://github.com/gleitz/midi-js-soundfonts/
[deleted]
Re: JavaScript singing synthesis library
#23Earlier quoted context omitted.
I don't know how to inform this author with the issue with 404 when try to load soundfont player. https://cdn.rawgit.com/gleitz/midi-js-soundfonts/master/Flui...
You could submit an issue on the repo https://github.com/gleitz/midi-js-soundfonts/
[deleted]
Re: JavaScript singing synthesis library
#24On Safari, instead of using the normal "AudioContext" constructor you must create a "webkitAudioContext"- a feature detection check for this would be a nice addition.
EDIT: This issue has now been fixed. However, it's led me to notice some (unrelated) timing problems in both Safari and Firefox, which will take some deeper digging to figure out. Seems like browser compatibility rabbit hole never ends! --- Thanks for this; I've fixed that issue and started on getting it compatible with Safari, but turns out there are some other errors regarding Float32Array mapping and support for A…
Excellent. Thanks for going the extra mile to chase down these compatibility issues. I know from experience how frustrating this stuff can be.
Re: JavaScript singing synthesis library
#25Cute as a Javascript hack, but not going to compete with Vocaloid or Festival Singer. Somebody really needs to crack singing synthesis. Vocaloid from Yamaha is good, but it works by having a live singer sing a prescribed set of phrases, which are then reassembled. Automatic singer generation is needed. Figure out some way to use machine learning to extract a singer model from recorded music and generate cover songs a…
Related software for iOS musicians: https://klevgrand.se/products/jussi/
Re: JavaScript singing synthesis library
#26Cute as a Javascript hack, but not going to compete with Vocaloid or Festival Singer. Somebody really needs to crack singing synthesis. Vocaloid from Yamaha is good, but it works by having a live singer sing a prescribed set of phrases, which are then reassembled. Automatic singer generation is needed. Figure out some way to use machine learning to extract a singer model from recorded music and generate cover songs a…
well, something better than Vocaloid does exist: http://mtg.upf.edu/research/labs/mir-lab/vap
It's from the same University that helped develop Vocaloid, and if you look at (well, listen to) their INTERSPEECH 2016 submission you'll find it's another league entirely ( https://chanter.limsi.fr/doku.php?id=winner_of_the_singing_s... )
Re: JavaScript singing synthesis library
#27The demo doesn't allow you to put in your own lyrics, keeps loading exactly the same set of words. Really awesome project though
Original author here; good catch, I've fixed it now so it'll sing whatever lyrics + notes are in the grid when you press "Set Voices". Thanks for pointing that out!
Glad to hear you got it fixed, I'll play around with it on my lunch break
Re: JavaScript singing synthesis library
#28Earlier quoted context omitted.
What back end code have you integrated this with? Have you tried "flocking"? http://flockingjs.org/ (I have not, I'm just wondering about somebody else's experience with this sort of thing in JS) I'm still pretty new to this (modern computer synthesis). I had a couple electronic music (synthesis) classes back in the day, but that day was back in the late 80s. We didn't even have any digital equipment the first time I…
There's no back end code used with this (assuming you mean server side). I've never tried flocking but it looks interesting. The library I wrote, MidiPlayerJS, just emits JSON events and in my demo I'm feeding those into a sound font library ( https://github.com/danigb/soundfont-player ). But my thought was to switch that out for this singing synth library and see what kind of sounds it can produce.
Sorry about the confusion. By "back end" I meant the tone generator(s) that your "sequencer" (?) is calling.
Re: JavaScript singing synthesis library
#29Earlier quoted context omitted.
There's no back end code used with this (assuming you mean server side). I've never tried flocking but it looks interesting. The library I wrote, MidiPlayerJS, just emits JSON events and in my demo I'm feeding those into a sound font library ( https://github.com/danigb/soundfont-player ). But my thought was to switch that out for this singing synth library and see what kind of sounds it can produce.
Sorry about the confusion. By "back end" I meant the tone generator(s) that your "sequencer" (?) is calling.
Oh, by default the library doesn't implement any tone generator. But, in my demo (http://grimmdude.com/MidiPlayerJS/) I'm using https://github.com/danigb/soundfont-player to generate the sounds.