Viewing profile — tmabraham

Sophont Inc. | Founding Research Engineer / Scientist | Remote | Full-time Sophont is a public-benefit corporation building open multimodal foundation models for medicine. Joining …

I'm the co-founder of Sophont, happy to answer any questions!

https://x.com/iScienceLuvr/status/1905144432791609480

it was already planned for open-sourcing, the leak did not affect the plans in any way

Nicolas Bourbaki is the name of a character in twenty one pilots' concept album "He'll always try to stop me, that Nicolas Bourbaki He's got no friends close, but those who know hi…

The paper has preliminary results for video as well

Because you can take advantage of pretrained CNNs and perform transfer learning, which is significantly more data-efficient than training from scratch, which is what you'd likely h…

Yeah using data from a 7T MRI giving higher spatial resolution definitely helps! The fMRI dataset includes signal from the whole brain but we only use the data from the visual cort…

Our model generates CLIP image embeddings from fMRI signals and those image embeddings can be used for retrieval (using cosine similarity for example) or passed into a pretrained d…

Yes we've been looking into ControlNet as well, and I think there is one recent fMRI-to-image paper that also has tried ControlNet. Maybe we'll use ControlNet in MindEye v2 :)

We think it could be useful for clinical research and maybe even diagnostics. For example, you could imagine a person with depression(or other neurological disorders) may have a di…