Viewing profile — dzhulgakov

You can try Mixtral live at https://app.fireworks.ai/ (soon to be faster too) Warning: the implementation might be off as there's no official one. We at Fireworks tried to reverse-…

In this experimental release with prebuilt binaries it’s about 5Mb per architecture. This includes all operators for inference (that is forward only). We’re working on selective co…

The recurrent network work is under way - we are revisiting the designs to consciously balance between performance and API niceness. We'll share more tech details in the upcoming d…

Right now we're training models in server-side environment and run highly optimized inference on pre-trained model in products (with focus on inference optimization). The framework…