Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

"BGP at home": getting a DIA circuit installed at home

aaka.sh

Post reply on HN
Print view View original

41–50 of 102 posts

Re: "BGP at home": getting a DIA circuit installed at home

#41

Post by markonen »

I rent a single ~600 meter fiber that connects my home to the network infrastructure of the company I run. The rent is $75/mo or so. I have passive CWDM muxes on the line to run two 10G connections to two separate edge routers.

My home router is a MikroTik CRS309—it’s about $250, fanless, has 8 SFP+ ports and advertises my home network blocks over BGP to the two routers (for HA).

The setup works great. The best part is how it’s small and fanless and fits inside the very small wall box the fiber terminates in.

Re: "BGP at home": getting a DIA circuit installed at home

#42

Post by Aachen »

Huh, so per the last paragraph, they're paying a ton to have an SLA, all the ISP has to provide is basic connectivity because BGP and stuff is being done by the customer themselves, and yet they have more outages in a few months than I have on a consumer connection in years?

The whole thing has a lot of hack value, it's cool and also worth something to be in control of your own networking, even if it's more expensive. Like buying apple: overpriced for the specs you're getting, but you're assured it'll be good quality (that's the idea anyway) and it looks cool (to most). Except... apparently it's still got issues, regularly? Now I'm really wondering what the point was, at least with hindsight

Re: "BGP at home": getting a DIA circuit installed at home

#43

Post by pdpi »

sbierwagen wrote: post #12
c3534l wrote: post #2

But why?

Besides the stated reason, there's also this: >(as of this writing, VZ was pricing 50Mbps commited @ $455/mo; 100Mbps @ $661/mo; 1Gbps @ $999/mo; 5Gbps @ $2,099/mo; and 10Gbps @ $3,099/mo). Ten gigabit is not yet a common residential internet service in North America. If that's what you want, this would be the only way to get it. I've occasionally daydreamed about buying a condominium near one of the Seattle Internet…

> The only upside is that the pair traveled directly to a CO in the same office park, so we would routinely see 1-2ms pings to anycast IPs like 4.2.2.2, 8.8.8.8, etc

Those are the pings I see on my residential connection, though?

Re: "BGP at home": getting a DIA circuit installed at home

#45

Post by techsupporter »

markonen wrote: post #41

I rent a single ~600 meter fiber that connects my home to the network infrastructure of the company I run. The rent is $75/mo or so. I have passive CWDM muxes on the line to run two 10G connections to two separate edge routers. My home router is a MikroTik CRS309—it’s about $250, fanless, has 8 SFP+ ports and advertises my home network blocks over BGP to the two routers (for HA). The setup works great. The best part…

> My home router is a MikroTik CRS309 ... advertises my home network blocks over BGP

How do you fit two full BGP tables into 512MB of RAM? I've looked into MikroTik boxes before and maybe they're doing something I'm not understanding. On the routers I have manage, two IPv4 feeds take up about 1.1GB and three IPv6 adds another 450MB.

Re: "BGP at home": getting a DIA circuit installed at home

#46

Post by no_carrier »

techsupporter wrote: post #45
markonen wrote: post #41

I rent a single ~600 meter fiber that connects my home to the network infrastructure of the company I run. The rent is $75/mo or so. I have passive CWDM muxes on the line to run two 10G connections to two separate edge routers. My home router is a MikroTik CRS309—it’s about $250, fanless, has 8 SFP+ ports and advertises my home network blocks over BGP to the two routers (for HA). The setup works great. The best part…

> My home router is a MikroTik CRS309 ... advertises my home network blocks over BGP How do you fit two full BGP tables into 512MB of RAM? I've looked into MikroTik boxes before and maybe they're doing something I'm not understanding. On the routers I have manage, two IPv4 feeds take up about 1.1GB and three IPv6 adds another 450MB.

If by 'full BGP tables' you mean the entire internet routing table, you don't need that to advertise a network on the internet. You can receive just a default route if you wish and still be able to advertise to any carriers you have a connection with. You won't lose out on any functionality in dual homing or anything like that.

Re: "BGP at home": getting a DIA circuit installed at home

#47

Post by rfoo »

Aachen wrote: post #42

Huh, so per the last paragraph, they're paying a ton to have an SLA, all the ISP has to provide is basic connectivity because BGP and stuff is being done by the customer themselves, and yet they have more outages in a few months than I have on a consumer connection in years? The whole thing has a lot of hack value, it's cool and also worth something to be in control of your own networking, even if it's more expensive…

The post said that consumer connection does not let you do BGP peering with the ISP.

There are real value in doing so in addition to the hack value, by doing so you can steer the Internet traffic to whatever IP blocks you owned to your house, dynamically. For example OP mentioned "add some resilience" as motivation, i.e. anytime their services running in the DC failed he can reroute the traffic to ... their house.

Re: "BGP at home": getting a DIA circuit installed at home

#48

Post by oarsinsync »

no_carrier wrote: post #46
techsupporter wrote: post #45

Earlier quoted context omitted.

> My home router is a MikroTik CRS309 ... advertises my home network blocks over BGP How do you fit two full BGP tables into 512MB of RAM? I've looked into MikroTik boxes before and maybe they're doing something I'm not understanding. On the routers I have manage, two IPv4 feeds take up about 1.1GB and three IPv6 adds another 450MB.

If by 'full BGP tables' you mean the entire internet routing table, you don't need that to advertise a network on the internet. You can receive just a default route if you wish and still be able to advertise to any carriers you have a connection with. You won't lose out on any functionality in dual homing or anything like that.

> You can receive just a default route … You won't lose out on any functionality in dual homing or anything like that.

Except you do lose out on best path routing / any other outbound TE, and you’re now restricted to rudimentary load balancing methodologies / manual prefix-specific hackery.

Re: "BGP at home": getting a DIA circuit installed at home

#49

Post by markonen »

techsupporter wrote: post #45
markonen wrote: post #41

I rent a single ~600 meter fiber that connects my home to the network infrastructure of the company I run. The rent is $75/mo or so. I have passive CWDM muxes on the line to run two 10G connections to two separate edge routers. My home router is a MikroTik CRS309—it’s about $250, fanless, has 8 SFP+ ports and advertises my home network blocks over BGP to the two routers (for HA). The setup works great. The best part…

> My home router is a MikroTik CRS309 ... advertises my home network blocks over BGP How do you fit two full BGP tables into 512MB of RAM? I've looked into MikroTik boxes before and maybe they're doing something I'm not understanding. On the routers I have manage, two IPv4 feeds take up about 1.1GB and three IPv6 adds another 450MB.

I’m just getting the default route from both upstream routers. They’re not diverse in terms of the internet routes they have, this is just for HA.
Post reply on HN