Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Free full BGP feed. IPv4 and IPv6 (2020)

lukasz.bromirski.net

Post reply on HN
Print view View original

31–40 of 41 posts

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#31

Post by Bender »

toast0 wrote: post #29
Bender wrote: post #28

Earlier quoted context omitted.

Every time I stand up new name servers I have to add the glue records into the root servers or the name servers do not exist. In fairness to me I keep forgetting the trend is to shove everything into big centralized DNS servers as it is something I would never do at least not as a primary.

Afaik, those glue records are held at your TLD's registry and served by the tld nameservers, not the root servers. It might be nice to get a zone transfer for every tld, but that's not possible for the public. (I understand there's some way to get many of them, but $$$$)

I run my own name servers. I never use the name servers of a registry. I can see the glue records of my name servers in the root servers. In fact the reason I left NetworkSolutions (web.com) was that their interface to update the root servers broke and there was nobody left that knew how to fix it. I'm sure they must have fixed it by now but I was being impatient only waiting 3 weeks.

I should add that I have been adding name servers to the root servers since 1998. I've just never managed one of the root servers and I guess nobody on HN has either.

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#32

Post by Bender »

johnhtodd wrote: post #30
Bender wrote: post #4

Just to have a compressed static file that contains all the routes one could download from time to time I think would be interesting to analyze. Same goes for the anycast root DNS servers. To have a full dump from them could be interesting. Not to be confused with the root.zone [1] I mean the whole kit and caboodle. [1] - https://www.internic.net/domain/root.zone

This is conflating BGP routes and DNS. DNS data: Root server data is available via AXFR ("dig . AXFR @f.root-servers.net") but this isn't what you're referencing. Second level TLD server data is available is available at CZDS. ( https://czds.icann.org/home ) but some TLDs don't participate, but this also isn't what you're referencing. What I think you want: There is no canonical list of all zones that exist - there i…

This is conflating BGP routes and DNS.

No I was fantasizing that I could get these two things. They are two separate things. If I had a nickle for every time I said something off topic I could by everyone a cup of coffee.

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#33

Post by toast0 »

Bender wrote: post #31
toast0 wrote: post #29

Earlier quoted context omitted.

Afaik, those glue records are held at your TLD's registry and served by the tld nameservers, not the root servers. It might be nice to get a zone transfer for every tld, but that's not possible for the public. (I understand there's some way to get many of them, but $$$$)

I run my own name servers. I never use the name servers of a registry. I can see the glue records of my name servers in the root servers. In fact the reason I left NetworkSolutions (web.com) was that their interface to update the root servers broke and there was nobody left that knew how to fix it. I'm sure they must have fixed it by now but I was being impatient only waiting 3 weeks. I should add that I have been ad…

I'm pretty sure you're confused.

If you query your domain at the root servers, they will refer you to the tld servers, run by your registry.

Then when you query your domain at the tld servers, they return your selected nameservers along with their addresses, if in their bailiwick.

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#34

Post by Bender »

toast0 wrote: post #33
Bender wrote: post #31

Earlier quoted context omitted.

I run my own name servers. I never use the name servers of a registry. I can see the glue records of my name servers in the root servers. In fact the reason I left NetworkSolutions (web.com) was that their interface to update the root servers broke and there was nobody left that knew how to fix it. I'm sure they must have fixed it by now but I was being impatient only waiting 3 weeks. I should add that I have been ad…

I'm pretty sure you're confused. If you query your domain at the root servers, they will refer you to the tld servers, run by your registry. Then when you query your domain at the tld servers, they return your selected nameservers along with their addresses, if in their bailiwick.

Im not confused at all. For your recursive servers to know how to get the name servers they have to have a hints file, that tells them what to use for the tld, then from the group of root servers associated with that TLD you get the glue (name servers) assocociated with the domain, then you query the authoritative name servers for that domains resources you were requesting. Every name server has a glue record in the root servers. I can manually walk you through it with dig if you would like.

I need to clean up the formatting a bit but this is a walk through. [1] I think I know where your confusion is but I will wait for your reply.

[1] - https://blawg.nochan.net/b/Internet-Crap/20260530-DNS-Recurs...

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#35

Post by toast0 »

Bender wrote: post #34
toast0 wrote: post #33

Earlier quoted context omitted.

I'm pretty sure you're confused. If you query your domain at the root servers, they will refer you to the tld servers, run by your registry. Then when you query your domain at the tld servers, they return your selected nameservers along with their addresses, if in their bailiwick.

Im not confused at all. For your recursive servers to know how to get the name servers they have to have a hints file, that tells them what to use for the tld, then from the group of root servers associated with that TLD you get the glue (name servers) assocociated with the domain, then you query the authoritative name servers for that domains resources you were requesting. Every name server has a glue record in the…

> from the group of root servers associated with that TLD you get the glue (name servers) assocociated with the domain

Those are not root servers. They are tld servers, run by the registry for the tld your domain is under.

The root servers serve the root. Root hints just tell you where those are. The zone file you listed has the whole root zone.

a.root-servers.net is a root server.

a.gtld-servers.net is a tld server (controlled by verisign, iirc?). several tlds use gtld-servers, but that doesn't make them root servers.

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#36

Post by Bender »

toast0 wrote: post #35
Bender wrote: post #34

Earlier quoted context omitted.

Im not confused at all. For your recursive servers to know how to get the name servers they have to have a hints file, that tells them what to use for the tld, then from the group of root servers associated with that TLD you get the glue (name servers) assocociated with the domain, then you query the authoritative name servers for that domains resources you were requesting. Every name server has a glue record in the…

> from the group of root servers associated with that TLD you get the glue (name servers) assocociated with the domain Those are not root servers. They are tld servers, run by the registry for the tld your domain is under. The root servers serve the root. Root hints just tell you where those are. The zone file you listed has the whole root zone. a.root-servers.net is a root server. a.gtld-servers.net is a tld server…

TLD servers are just another level of root servers. Each TLD does have a primary registrar that manages them however they provide access to thousands of registrars to manage the glue records at that layer. They are still collectively part of the root servers even if they are not under the domain root-servers.net. My registrar does not manage them. Nobody here is on a regisrar that manages the TLD root servers. The only permission my registrar and most registrars have is to update glue records for the domains their domain clients own and to add their domains. I and every DNS admin I've ever know collectively refers to all levels of the root and TLD servers as root servers. Even if that is technically incorrect that is how we have always referred to them. I think that distinction would primarily mater for people that worked at one of the high level registrars that manages the anycast clusters of tld root servers. At least I think that is where the confusion started. This was fun we should do this again. I updated the blawg to add (TLD) in reference to root servers.

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#37

Post by toast0 »

Bender wrote: post #36
toast0 wrote: post #35

Earlier quoted context omitted.

> from the group of root servers associated with that TLD you get the glue (name servers) assocociated with the domain Those are not root servers. They are tld servers, run by the registry for the tld your domain is under. The root servers serve the root. Root hints just tell you where those are. The zone file you listed has the whole root zone. a.root-servers.net is a root server. a.gtld-servers.net is a tld server…

TLD servers are just another level of root servers. Each TLD does have a primary registrar that manages them however they provide access to thousands of registrars to manage the glue records at that layer. They are still collectively part of the root servers even if they are not under the domain root-servers.net. My registrar does not manage them. Nobody here is on a regisrar that manages the TLD root servers. The on…

If every level is a root, then the word root means nothing. I guess you could say that the root servers point to the tld root servers that point to your domain's root servers. But then root server just means dns server.

I never mentioned registrars, only registries.

> Nobody here is on a regisrar that manages the TLD root servers.

I have a .is domain. For .is and some of the other country code tlds, you contract directly with the entity managing the TLD and its servers.

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#38

Post by Bender »

toast0 wrote: post #37
Bender wrote: post #36

Earlier quoted context omitted.

TLD servers are just another level of root servers. Each TLD does have a primary registrar that manages them however they provide access to thousands of registrars to manage the glue records at that layer. They are still collectively part of the root servers even if they are not under the domain root-servers.net. My registrar does not manage them. Nobody here is on a regisrar that manages the TLD root servers. The on…

If every level is a root, then the word root means nothing. I guess you could say that the root servers point to the tld root servers that point to your domain's root servers. But then root server just means dns server. I never mentioned registrars, only registries. > Nobody here is on a regisrar that manages the TLD root servers. I have a .is domain. For .is and some of the other country code tlds, you contract dire…

Are you secretly the admin of archive.is? He's made accounts on here before but they were all temporary. I want to believe he has an account that has been here a long time.

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#39

Post by toast0 »

Bender wrote: post #38
toast0 wrote: post #37

Earlier quoted context omitted.

If every level is a root, then the word root means nothing. I guess you could say that the root servers point to the tld root servers that point to your domain's root servers. But then root server just means dns server. I never mentioned registrars, only registries. > Nobody here is on a regisrar that manages the TLD root servers. I have a .is domain. For .is and some of the other country code tlds, you contract dire…

Are you secretly the admin of archive.is? He's made accounts on here before but they were all temporary. I want to believe he has an account that has been here a long time.

No, I live on an island, and is is a usps acceptable abbreviation for island ... I was trying to convince my spouse to leave yahoo mail for mail hosted on one of our domains by getting a domain that's less out there than enslaves.us, so I have islandname.is (well not literally that).

Tldr, a cool domain name isn't enough to make a switch happen.

Re: Free full BGP feed. IPv4 and IPv6 (2020)

#40

Post by ccgreg »

zamadatix wrote: post #27
faangguyindia wrote: post #24

Earlier quoted context omitted.

Sonar does seem to have data here: https://opendata.rapid7.com/ But it seems you've to go through their sales team and all for the data. I can't find CommonCrawl making their DNS resolution available.

Common Crawl doesn't publish raw DNS separately, you have to pull the information out of the aggregate database. The WARC-IP-Address header should record the IP Common Crawl connected to for the site.

Good timing, I'm about to release that dataset.
Post reply on HN