Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: CrossHair – SMT Assisted Testing for Python

github.com

Post reply on HN
Print view View original

11–15 of 15 posts

Re: Show HN: CrossHair – SMT Assisted Testing for Python

#11

Post by zzz95 »

pschanely wrote: post #7
timothycrosley wrote: post #5

Earlier quoted context omitted.

Can confirm that I would be happy to collaborate on this project, it looks really cool!

That would be amazing. It's easy to turn CrossHair into an absurdly slow fuzz tester (imagine hashing or printing your inputs early in the process). I think the ideal product would be good at both symbolic and concrete tactics, and the minimization logic of hypothesis would be really nice to have too. I will be in touch!

Portfolio of a slow but precise fuzzer + fast imprecise fuzzer is the easiest integration. Start both together and return the one which fails first. SMT solvers are often complementary with samplers.

However, it would be very interesting to see if a closer integration of symbolic and sampling methodologies is possible.

Re: Show HN: CrossHair – SMT Assisted Testing for Python

#12

Post by singhrac »

zitterbewegung wrote: post #10
pschanely wrote: post #2

Hi all! My primary objective with this post is to find potential collaborators and people willing to try it. (and file bugs!) If you do try it, I'd encourage you to think of it as an exercise in formally documenting your code's behavior, with the side benefit that CrossHair can sometimes help you ensure the correctness of that documentation. And, of course, feedback of any kind at all is honestly appreciated. Thanks…

This is a really minor nitpick that I am expressing to help you market this better. Instead of saying (defunct) PEP 316 just say inspired which communicates that you don’t do everything of pep 316 also .

Yes, please. I was confused when I first read this - I thought "why would I want to use a tool based on outdated syntax?". Maybe "PEP 316-inspired syntax"?

Re: Show HN: CrossHair – SMT Assisted Testing for Python

#13

Post by exdsq »

pschanely wrote: post #2

Hi all! My primary objective with this post is to find potential collaborators and people willing to try it. (and file bugs!) If you do try it, I'd encourage you to think of it as an exercise in formally documenting your code's behavior, with the side benefit that CrossHair can sometimes help you ensure the correctness of that documentation. And, of course, feedback of any kind at all is honestly appreciated. Thanks…

Hey! I'd love to collaborate :)

This is an area I'm trying to focus my Masters on, so any opportunity to apply what I'm reading is more than welcome! I'll add my email to my profile if you'd like to chat.

Re: Show HN: CrossHair – SMT Assisted Testing for Python

#14

Post by philzook »

Very cool! Ever looked at the Viper project? It's the only other system in python that I know of targeting pre and post conditions

https://www.pm.inf.ethz.ch/research/viper.html

https://www.pm.inf.ethz.ch/research/nagini.html

Another thing that might be of interest is HOLpy. I have no idea what the state of that is. https://arxiv.org/abs/1905.05970

I was fiddling around recently with way jankier methods than what you've done here http://www.philipzucker.com/programming-and-interactive-prov...

Re: Show HN: CrossHair – SMT Assisted Testing for Python

#15

Post by pschanely »

singhrac wrote: post #12
zitterbewegung wrote: post #10

Earlier quoted context omitted.

This is a really minor nitpick that I am expressing to help you market this better. Instead of saying (defunct) PEP 316 just say inspired which communicates that you don’t do everything of pep 316 also .

Yes, please. I was confused when I first read this - I thought "why would I want to use a tool based on outdated syntax?". Maybe "PEP 316-inspired syntax"?

Totally agree that this is confusing. I've stolen and committed your suggestion. Thank you both!
Post reply on HN