Viewing profile — vkkhare

updated the link

We have built fused operator kernels for structured contextual sparsity to avoid loading and computing activations with feed forward layer weights that eventually zero out by the a…

Isn't the inference cost of running these models at scale challenging? Currently it feels like small LLMs (1B-4B) are able to perform well for simpler agentic workfows. There are d…

We will be open sourcing the entire platform soon. This blog shows our platform to build the AI app https://www.nimbleedge.com/blog/how-to-run-kokoro-tts-model-...

We have just started open sourcing the on-device AI platform. We have started with the github repo for custom Kokoro TTS model. It is basically a batch implementation for Kokoro wh…

maybe try local p2p networking and compute offloading? Check out https://nimbleedge.ai for a cool demo This is our repository https://github.com/NimbleEdge/RecoEdge

I would love to talk more about it and understand your take. Is there a way I can reach out to you? I have been reading the content in web 3 and form my own opinion on the merits/d…

What do people think of automatic differentiation support facebook was trying for Kotlin. They called it differentiable programming https://ai.facebook.com/blog/paving-the-way-for-…

Let's take an example of recommendation engines. I think a truly decentralised content curation will be based on edge computing. Twitter, FB (Meta), Youtube everyone harvests user …

I was thinking along ML. How analytics and ML happens on user data which is stored on data silos. For example, twitter has data about all our posts and interactions and uses that d…

I believe edge computing is one of the game changing technologies for the decade. I am not sure if it can fall under the purview of Web 3 or not. For example one of the library I i…

you can find many such people in our discord server https://nimbleedge.ai/discord We all care about how our data is used and processed.

That's why not giving them ability to copy data, allow them to use that data only on your device and send aggregated information back. So they cannot copy the data

That's what I am worried about, from its description the intent looks good but being aligned to only one industry or vertical defeats the purpose of ubiquity. People wouldn't trust…

I do care if that data gets leaked or if that data is used by third party companies for things I have bought and I do not want them to know. Why should a bank do my credit scoring …

Marc is reading this ;p

This is a very cool description! Hits to the point

Exactly if that is the case, it should also include technologies where data ownership lies with the users. After all data itself is a huge resource. One of the biggest reasons corp…

Web 2 as a term itself was coined much later when people needed to distinguish web 3 from status quo

Whenever I search and learn for web 3.0 people limit it to blockchain based solutions and apps. However, the core ethos of web 3.0 is about decentralisation, shouldn't it also enco…