If something is taking way too long, often times it shouldn't be made faster, it should be done differently. For example, it takes me 4 hours to get to work, just making the car faster isn't going to help. Maybe the solution is to take a plane, get a different job,work from home, or move closer to where you want to be.
Yep. What the post described as the final solution was bringing down the running time from 24hrs to 10min using straightforward optimisations. I would guess moving from 10min to 30sec would take doing it differently.
Just Make It Faster
21–29 of 29 posts
Re: Just Make It Faster
#22Re: Just Make It Faster
#23Earlier quoted context omitted.
A "full stack programmer" will be able to look at the whole and see what should be done differently, but a database performance person (not a generic DBA) will be bring a much deeper knowledge of that one area (just as a GPU programmer will know more about GPU optimization then the application developer). Sometimes you need that specialist to get you over the hump. An "inch deep and mile wide" sort of knowledge will…
It's been my experience that most of the time, you don't need "the fastest performance." You really only need things to be "fast enough." Though the dividing line between "too slow" and "fast enough" is pretty murky, it's obvious when you're firmly on one side or the other. In the article example, 24 hours is clearly too slow, while 10 minutes is clearly fast enough. Consider, too, that expert-level knowledge of the…
Re: Just Make It Faster
#24If something is taking way too long, often times it shouldn't be made faster, it should be done differently. For example, it takes me 4 hours to get to work, just making the car faster isn't going to help. Maybe the solution is to take a plane, get a different job,work from home, or move closer to where you want to be.
Re: Just Make It Faster
#25Re: Just Make It Faster
#26There seems to be a battle here between full-stackers and specialists, but if you think of a full-stacker as "an extremely experienced generalist", then I think there are plenty of "extremely experienced specialists" who fit that description too. That is to say, an extremely experienced "database optimizer" is going to know how the presentation layer hits the database and how the database hits the disc, and I expect they would know many different database technologies.
Re: Just Make It Faster
#27Earlier quoted context omitted.
It's been my experience that most of the time, you don't need "the fastest performance." You really only need things to be "fast enough." Though the dividing line between "too slow" and "fast enough" is pretty murky, it's obvious when you're firmly on one side or the other. In the article example, 24 hours is clearly too slow, while 10 minutes is clearly fast enough. Consider, too, that expert-level knowledge of the…
Wait a minute, who says that the specialist also can't do "fast enough"? And more to the point, how do you know that the "fast enough" solution is within the reach of the generalist or that the specialist can't figure it out sooner than the generalist can? I can't count the number of times I've spun my wheels on something for days and then brought the problem to an experienced database developer who figured it out in…
Re: Just Make It Faster
#28Re: Just Make It Faster
#29Earlier quoted context omitted.
Wait a minute, who says that the specialist also can't do "fast enough"? And more to the point, how do you know that the "fast enough" solution is within the reach of the generalist or that the specialist can't figure it out sooner than the generalist can? I can't count the number of times I've spun my wheels on something for days and then brought the problem to an experienced database developer who figured it out in…
I think his point is that there's usually a bottleneck somewhere, and unless the bottleneck lies within the specialist's realm of specialization, the generalist is in a better position to spot it.