Earlier quoted context omitted.
Filters out a lot of kook theories but I'm sure some revolutionary stuff from some Goodwill Hunting genius has been filtered out as well.
Fun fact: peer review isn't gatekept. There are peer reviewed young earth creationist articles out there: https://www.cnet.com/culture/creationists-launch-peer-review... So "peer review" isn't holding back kook theories at all on its own. At best, journal prestige is bolstered by it, which the journal can then translate into holding them back. The track record is a bit unclear, though.
Papers and patents are becoming less disruptive over time
151–160 of 172 posts
Re: Papers and patents are becoming less disruptive over time
#152There was a time in the 19th century when people thought physics discoveries were complete. A few decades later all hell broke lose.
The problem we have right now is that we are stymied on the complexity front (materials, chemistry, biology, medicine etc)
Our mental / mathematical models that we use to understand the world and even enable us to ask original scientific questions are losing their edge when things get complex. These tools are 19th century stuff (including all the AI junk) and we have milked them for all they are worth
I would hypothesise that a new period of discovery will correlate with some breakthrough in the mathematics of complexity. We had a few false dawns but not the real thing
Re: Papers and patents are becoming less disruptive over time
#153The science knowledge base grows monotonically but not necessarily at a steady rate. Actually far from it. There was a time in the 19th century when people thought physics discoveries were complete. A few decades later all hell broke lose. The problem we have right now is that we are stymied on the complexity front (materials, chemistry, biology, medicine etc) Our mental / mathematical models that we use to understan…
I'm not really sure what you're looking for here. I mean, you could claim that modern cryptography is based on ideas from the ancient Greeks (factoring numbers), and is therefore old and busted. Is every idea just derivative unless it uses a completely new kind of math?
Software developers (maybe not you, but a large percentage of the users of this site) tend to automatically think older ideas are worse. But that's not true in math. Mathematical ideas don't expire. The idea of the number 7 is aeons old; the number 0 over a thousand years; the complex number i 450 years. But the numbers 7 and 0 and i are still extremely useful, in infinite combinations. If you think we have milked those numbers for all they're worth, you have an extremely limited imagination.
Sure, most of the "AI junk" is a combination of old ideas like linear algebra and gradient descent, but used at a scale orders of magnitude larger than their creators ever imagined. (And quantity has a quality all its own.) It's that combination of ideas that is so powerful. Besides, backpropagation is a pretty damned novel idea. If you're looking for the one truly new idea from AI, it's backpropagation.
You are vastly underestimating the volume of the idea space available to explore simply by combining the ideas and materials we already have. Crossover is a better source of variety than mutation is. You may be right that truly new concepts are the "raw materials" of invention, but we never run out of the raw ideas we have, and they prove to be useful in their combination up to the limits of our imaginations. It's actually surprising how likely you are to come up with a reasonably good idea by simply considering a few randomly-selected ideas together.
> we are stymied on the complexity front (materials, chemistry, biology, medicine etc)
Again you seem like your standard is: if it's not an entirely new thing where nothing like it has ever existed before, then it's boring!. If you think the volume of the idea-space from combining the materials, chemistry, biology, and medicine we already have/understand is X, it's almost certainly at least 2^X, or even X! (factorial).
Besides, we are coming up with brand new materials all the time! Materials science is one of the most exciting frontiers of human technology.
Re: Papers and patents are becoming less disruptive over time
#154I'm left a bit conflicted by what conclusions to draw from this effort. How much of this is due to how much easier it is to publish something these days? Every statistics package spits out publication-ready charts and tables, Latex/Word has automated much of the typesetter's art, drafts can be communicated instantly via email, there are instantly searchable and linked databases of papers, etc, etc. Think about what i…
This was done well into the 1980s, if not longer.
Re: Papers and patents are becoming less disruptive over time
#155The science knowledge base grows monotonically but not necessarily at a steady rate. Actually far from it. There was a time in the 19th century when people thought physics discoveries were complete. A few decades later all hell broke lose. The problem we have right now is that we are stymied on the complexity front (materials, chemistry, biology, medicine etc) Our mental / mathematical models that we use to understan…
> These tools are 19th century stuff (including all the AI junk) I'm not really sure what you're looking for here. I mean, you could claim that modern cryptography is based on ideas from the ancient Greeks (factoring numbers), and is therefore old and busted. Is every idea just derivative unless it uses a completely new kind of math? Software developers (maybe not you, but a large percentage of the users of this site…
Old math can still have an impact at the margin (eg speeding up protein folding calculations etc) but its not the cognitive leap that would allow us to steer discoveries in more effective manner. Materials, medicine etc all very exciting and very active but also hampered by their intrinsic complexity.
Re: Papers and patents are becoming less disruptive over time
#156When I was in grad school I had done measurements of the magnetic anisotropy of amorphous compounds. I had found an interesting link between the structure and the magnetic properties which is surprising since the material is amorphous, the material properties should be isotropic yet these had a preferred magnetization axis. During the discussions of these results with my advisor I was told in very clear terms that he…
Re: Papers and patents are becoming less disruptive over time
#157To understand the fundamental problem with this paper and the "CD" measure of "disruptiveness", one need only look at Figure 1a, where three Nobel Prize winning papers and three patents are ranked on the "CD5" scale. Apparently, there are more disruptive discoveries than Watson and Crick's discovery of the double-stranded structure of DNA (CD5 0.62 on a scale of -1.0 to 1.0), and Baltimore's discovery of reverse tran…
The trend over time could equally be capturing changes in referencing practice (either that really important, influential papers/inventions in the past didn't reference other really important, influential papers/inventions nearly as often as equally novel papers/inventions today, or that modern referencing is much more exhaustive about referencing minor and tangentially relevant papers/inventions. There is, of course, also more significant prior art in journals and patent indices to actually cite in later years...). They carry out some robustness checks, but I'm not sure any of them really dent that hypothesis. It's also a conclusion based on proportions (ie. the effect mostly comes from by there being a lot more "non-disruptive" papers published rather than fewer "disruptive" papers) and there's actually a trend rise in the raw number of "most disruptive" academic papers from the 1950s through to the 1990s, at which point the numbers drop so sharply it looks like a discontinuity in the data (but would probably coincide with lots of journal content becoming easily accessible online...)
Re: Papers and patents are becoming less disruptive over time
#158I wonder if this is to do with major vs minor breakthrough. Take physics. As I read it, modern fundamental physics is mostly some combination of general relativity and quantum mechanics, which are both early 20th century inventions. They weren't necessarily genius in particular in-depth analysis, rather they were genius new concepts that created a whole new blank canvas to fill in. What did the field look like just b…
It might be that human brains can only do so much physics, which is a tiny subset of all the physics there is. It’s amazing upright apes can figure out the speed of light or postulate and find the Higgs Boson in the first place. How much physics do we expect the smartest dog in the world to do? What if we 10x’d its lifespan? At some point either: 1. There is no more physics 2. We build beings that can do physics that…
Re: Papers and patents are becoming less disruptive over time
#159When I was in grad school I had done measurements of the magnetic anisotropy of amorphous compounds. I had found an interesting link between the structure and the magnetic properties which is surprising since the material is amorphous, the material properties should be isotropic yet these had a preferred magnetization axis. During the discussions of these results with my advisor I was told in very clear terms that he…
Re: Papers and patents are becoming less disruptive over time
#160Earlier quoted context omitted.
3D printing seems a good example: Extruded plastic took off before resin printers because the patents expired a few years earlier. As far as I can tell, we could have had the 3D printing revolution in the 90s or early 2000s, but instead we locked the technology away to only be used in a few esoteric commercial applications until the patents expired.
Similar story with e-ink; the license costs for the technology are the main blocker to wider adoption.
Perhaps if there were no patent, there'd be more third-party research to improve all these things faster. But as far as adoption of the existing stuff goes, I don't see how license costs are a direct blocker.