Live data from Hacker News

LoRA Without Regret

thinkingmachines.ai

11–20 of 62 posts

Re: LoRA Without Regret

#12

Thinking Machines have put out a string of incredibly high-quality posts lately. Hard to oversell how much cred it's buying them with the AI research community! Keep up the great work folks

What else has there been. I've only seen this one (which is great!)

Re: LoRA Without Regret

#13

The name gets me every single time. Always think it’s going to be about radio LoRa

Dang it! Got me too! I've been wanting to hop into Meshtastic lately.

Set up a node! Bare boards that work with the app are like $50 and take a few clicks to flash and setup. The basic antenna with no amp makes contacts up to 50mi away if the conditions are right. I have one in a window and one in a backpack at all times.

Re: LoRA Without Regret

#17

Earlier quoted context omitted.

Dang it! Got me too! I've been wanting to hop into Meshtastic lately.

Set up a node! Bare boards that work with the app are like $50 and take a few clicks to flash and setup. The basic antenna with no amp makes contacts up to 50mi away if the conditions are right. I have one in a window and one in a backpack at all times.

It's insane how far you can go between hops, really most impressive. Where I live the mesh density is fairly high but I've also tried it in places where it was vanishingly low and yet I never completely lost contact. LoRa is very much an underappreciated technology.

Re: LoRA Without Regret

#19
Can someone explain the bit counting argument in the reinforcement learning part?

I don’t get why a trajectory would provide only one bit of information.

Each step of the trajectory is at least giving information about what state transitions are possible.

An infinitely long trajectory can explore the whole state space if there are no absorbing states. Such a trajectory would provide a massive amount of information about the system, even if we ignored the final reward.

Post reply on HN