Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Build your own BitTorrent

app.codecrafters.io

Post reply on HN
Print view View original

111–120 of 136 posts

Re: Build your own BitTorrent

#111

Post by r3trohack3r »

mcgingras wrote: post #110
r3trohack3r wrote: post #108

For anyone who is interested in peer-to-peer systems like this, and completes Sarp's course, I have an open interview challenge you can submit it to if you find that you want to continue building in this space as a profession: https://gitlab.com/webai-open/network/interview-challenge Take the guidelines to heart though. We evaluate you on demonstrating understanding of what you did, not that you completed the course.…

Do y'all really only work M-Th? If so, that's awesome.

Yes.

Our salary bands are competitive outside of FAANG (my previous life was at NFLX), we are fully remote, nomad friendly, and work 4 day weeks.

You can come on full time or as a contractor (your choice).

We give space to learn and do things right. Are comfortable investing in knowledge today to see compounding returns tomorrow. For example, I spent the first 3 weeks of my employment here sitting on my couch reading research papers. That paid dividens, we collapsed a 1.5 year timeline into a 1 month timeline. 3 weeks of reading research papers and 1 week of building got us to a milestone we didn't plan on reaching until a year+ into the project: we trained a model running on a developers laptop in Grand Rapids Michigan against a dataset sitting on another laptop in Yorkshire, with a fully auditable CI/CD log of what data was fed into the model.

Another example, the team decided we should do rust to cross-compile to WASM etc. from day one, so we all took 2 weeks to study the Rust Book and learn together. Now we have a subset of our p2p stuff compiling to WASM and running in headless firefox during our integration tests from day one.

Pretty flexible in every respect, just need good people who can help build this.

Re: Build your own BitTorrent

#112

Post by mcgingras »

r3trohack3r wrote: post #111
mcgingras wrote: post #110

Earlier quoted context omitted.

Do y'all really only work M-Th? If so, that's awesome.

Yes. Our salary bands are competitive outside of FAANG (my previous life was at NFLX), we are fully remote, nomad friendly, and work 4 day weeks. You can come on full time or as a contractor (your choice). We give space to learn and do things right. Are comfortable investing in knowledge today to see compounding returns tomorrow. For example, I spent the first 3 weeks of my employment here sitting on my couch reading…

Honestly, sounds awesome.

Re: Build your own BitTorrent

#113

Post by Already__Taken »

Jonhoo wrote: post #104
mr-karan wrote: post #8

Jon Gjengset[1] is currently doing a livestream on the same challenge in Rust, on his YT channel[2]. [1]: https://thesquareplanet.com/ [2]: https://www.youtube.com/watch?v=jSTkEPPiULs

Oh hey, that's me! A better link is https://www.youtube.com/watch?v=jf_ddGnum_4 which has chapter marks and has the power outage in the middle spliced away :p

thanks Jon really enjoyed the process. I always wondered why oci registries don't bit torrent the images. now I understand why they might not have been fond of the approach.

Re: Build your own BitTorrent

#114

Post by andnand »

sarp wrote: post #78

Hi! Sarp here, author of the Build your own BitTorrent challenge on Codecrafters. Some back story: After being laid off from my FAANG job, I found myself very unmotivated to go back. I started looking for interesting programming projects to revive my interest in coding. While nomading, I discovered Codecrafters on Nomadlist and really liked the push code to git and pass different stages interaction. The gamification…

How did you learn to build a BitTorrent client? I love the idea of codecrafters and books that walk you through building something but I always struggle if I don't have something to get me started.

Re: Build your own BitTorrent

#115

Post by sarp »

rrishi wrote: post #93
sarp wrote: post #78

Hi! Sarp here, author of the Build your own BitTorrent challenge on Codecrafters. Some back story: After being laid off from my FAANG job, I found myself very unmotivated to go back. I started looking for interesting programming projects to revive my interest in coding. While nomading, I discovered Codecrafters on Nomadlist and really liked the push code to git and pass different stages interaction. The gamification…

> After completing all the challenges on the site, I ran out of things to do. This is when I decided to build a BitTorrent client which was one of the highly voted ideas on the site. Are you employed by them now?

I'm not an employee of Codecrafters. I worked with them for the BitTorrent challenge as an independent contractor.

Re: Build your own BitTorrent

#116

Post by sarp »

andnand wrote: post #114
sarp wrote: post #78

Hi! Sarp here, author of the Build your own BitTorrent challenge on Codecrafters. Some back story: After being laid off from my FAANG job, I found myself very unmotivated to go back. I started looking for interesting programming projects to revive my interest in coding. While nomading, I discovered Codecrafters on Nomadlist and really liked the push code to git and pass different stages interaction. The gamification…

How did you learn to build a BitTorrent client? I love the idea of codecrafters and books that walk you through building something but I always struggle if I don't have something to get me started.

My starting point was searching for tutorials and asking ChatGPT to implement a torrent parser :) There are great blog posts [0] for building a BitTorrent client. Along the way, I referenced open-source implementations and the BitTorrent Protocol Specification as well [1].

[0] https://blog.jse.li/posts/torrent/

[1] https://www.bittorrent.org/beps/bep_0003.html

Re: Build your own BitTorrent

#117

Post by sarp »

sarupbanskota wrote: post #82
sarp wrote: post #78

Hi! Sarp here, author of the Build your own BitTorrent challenge on Codecrafters. Some back story: After being laid off from my FAANG job, I found myself very unmotivated to go back. I started looking for interesting programming projects to revive my interest in coding. While nomading, I discovered Codecrafters on Nomadlist and really liked the push code to git and pass different stages interaction. The gamification…

Are we gonna get extensions to the challenge?

To limit the scope of the challenge, I had to leave out a lot of cool features you see in modern clients: magnet links, UDP trackers, DHT

I'm planning to add them over time starting with magnet links which is the highest voted extension idea right now

Re: Build your own BitTorrent

#118

Post by mu5tach3 »

paledot wrote: post #105
thedaly wrote: post #102

Earlier quoted context omitted.

User agents, fingerprinting, etc. There are certainly ways to mask your client, but these would be considered cheating by most private trackers and would be grounds for a ban.

There's a whole ton of bluster in the torrent community. Bittorrent is a simple protocol, to the point of being naive (and therefore a fun toy network app project). Clients identify themselves to the tracker by user agent; there's really nothing else to fingerprint against. Claims to the contrary are almost certainly bullshit to scare people out of editing their user agent. Clients also self-report the amount of data…

> "there's no excuse for having a ratio less than 1"

Maybe the context of the quote was in regard to a private tracker?

The "ratio" in terms of private trackers isn't always the real ratio of GBs uploaded or downloaded.

There are for example some private trackers that grant additional credit for longer seed-time or they declare specific torrents "freeleech" so they don't "cost" ratio.

In the end they are just some of the measures private trackers take to strengthen their network, but they lead to a confusing definition of "ratio".

Re: Build your own BitTorrent

#119

Post by sarp »

Jonhoo wrote: post #104
mr-karan wrote: post #8

Jon Gjengset[1] is currently doing a livestream on the same challenge in Rust, on his YT channel[2]. [1]: https://thesquareplanet.com/ [2]: https://www.youtube.com/watch?v=jSTkEPPiULs

Oh hey, that's me! A better link is https://www.youtube.com/watch?v=jf_ddGnum_4 which has chapter marks and has the power outage in the middle spliced away :p

Hi Jon, challenge author here! First time watching your content, it was fun to see a Rust expert go through the challenge live. Saw the first hour, I noticed that during Bencode parsing, trying to find the most elegant way to implement it slowed you down a bit. (I also have this tendency and I'm sure having so many viewers doesn't help :)) Great progress by the way in 4 hours, hope you get to finish the challenge soon!

Re: Build your own BitTorrent

#120

Post by ollien »

sarp wrote: post #78

Hi! Sarp here, author of the Build your own BitTorrent challenge on Codecrafters. Some back story: After being laid off from my FAANG job, I found myself very unmotivated to go back. I started looking for interesting programming projects to revive my interest in coding. While nomading, I discovered Codecrafters on Nomadlist and really liked the push code to git and pass different stages interaction. The gamification…

I don't know if this is feedback on the challenge per-se, but I was a little saddened that I couldn't add dependencies to my `Cargo.toml`; I wanted to solve part of the bencode challenge using nom (perhaps overkill, but it was for fun), but I can't.

If this is a concern of load/execution times on a remote builder, it would be cool if I had some way to run the testcases locally to avoid this concern

Post reply on HN