Generative Agents: Interactive Simulacra of Human Behavior[1]. Make sure to check out the recorded demo!
Ask HN: Which recent research paper blew your mind?
11–20 of 174 posts
Re: Ask HN: Which recent research paper blew your mind?
#12Not recent but legendary:
"Latency Lags Bandwidth"
David Patterson
http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.115...
Recent:
"How to Hack the Simulation?" Roman Yampolskiy https://www.researchgate.net/publication/364811408_How_to_Ha...
"On the Computational Practicality of Private Information Retrieval" Radu Sion, Bogdan Carbunar https://zxr.io/research/sion2007pir.pdf
(via "Explained from scratch: private information retrieval using homomorphic encryption," https://blintzbase.com/posts/pir-and-fhe-from-scratch/ )
Re: Ask HN: Which recent research paper blew your mind?
#13LoRA: Low-Rank Adaptation of Large Language Models [1] [1]: https://arxiv.org/abs/2106.09685
Off topic: LoRa is forever low-power long-range communication for me (as in LoRaWAN).
Re: Ask HN: Which recent research paper blew your mind?
#14Someone managed to GPU-accelerate program synthesis, a form of symbolic ML. First time for ML that is not deep learning: https://dl.acm.org/doi/10.1145/3591274 Deep learning took off precisely when the ImageNet paper dropped around 2010. Before nobody believed that backprop can be GPU-accelerated.
How is program synthesis the same as regular expression search? Honest question
Re: Ask HN: Which recent research paper blew your mind?
#15"Blue Is the New Black (Market): Privacy Leaks and Re-Victimization from Police-Auctioned Cellphones" https://krebsonsecurity.com/2023/05/re-victimization-from-po... Researchers bought up a bunch of seized phones from police auction sites and found about 25% of them were trivially unlockable and still held sensitive data about suspects and victims .
Is this really "mind blowing"? Knowing the competency of the average police department, I'd consider it more par for the course.
Re: Ask HN: Which recent research paper blew your mind?
#16More is Different by P. W. Anderson (1972)'arguing that “at each level of complexity entirely new properties appear” — that is, although, for example, chemistry is subject to the laws of physics, we cannot infer the field of chemistry from our knowledge of physics.'
The paper https://cse-robotics.engr.tamu.edu/dshell/cs689/papers/ander...
Also its impact https://www.nature.com/articles/s42254-022-00483-x
Re: Ask HN: Which recent research paper blew your mind?
#17"Overview of SHARD: A System for Highly Available Replicated Data" it's the first paper to introduce the concept of database sharding. It was published in 1988 by the Computer Corporation of America.
It is referenced hundreds of times in many classic papers.
But, here's the thing. It doesn't exist.
Everyone cites Sarin, DeWitt & Rosenb[e|u]rg's paper but none have ever seen it. I've emailed dozens of academics, libraries, and archives - none of them have a copy.
So it blows my mind that something so influential is, effectively, a myth.
Re: Ask HN: Which recent research paper blew your mind?
#18"Overview of SHARD: A System for Highly Available Replicated Data" it's the first paper to introduce the concept of database sharding. It was published in 1988 by the Computer Corporation of America. It is referenced hundreds of times in many classic papers. But, here's the thing. It doesn't exist . Everyone cites Sarin, DeWitt & Rosenb[e|u]rg's paper but none have ever seen it. I've emailed dozens of academics, libr…
Is this an example of reference rot or did it never exist?
Re: Ask HN: Which recent research paper blew your mind?
#19Someone managed to GPU-accelerate program synthesis, a form of symbolic ML. First time for ML that is not deep learning: https://dl.acm.org/doi/10.1145/3591274 Deep learning took off precisely when the ImageNet paper dropped around 2010. Before nobody believed that backprop can be GPU-accelerated.
> First time for ML that is not deep learning
What do you mean by this? Virtually all "classic" or "shallow" ML can be GPU-accelerated, from linear regression to SVM to GBM.
Re: Ask HN: Which recent research paper blew your mind?
#20Someone managed to GPU-accelerate program synthesis, a form of symbolic ML. First time for ML that is not deep learning: https://dl.acm.org/doi/10.1145/3591274 Deep learning took off precisely when the ImageNet paper dropped around 2010. Before nobody believed that backprop can be GPU-accelerated.
How is program synthesis the same as regular expression search? Honest question
Good question. All supervised learning is a form of search with three components:
- Specification: what are you are looking for?
- Search space: were are you looking?
- Search mechanism: how are you going through the search space?
Program synthesis is simply learning where the search space is syntax. In deep learning, taking the ImageNet paper as an example, the specification a bunch of photos with annotations, the search space is multi-variate real functions (encoded as matrix of floats) and the search mechanisms is gradient descent (implemented as backprop) with a loss function.
I think this paper uses regular expressions an example of how to search fast over syntax. It claims not to be tied to regular expressions.