Live data from Hacker News

Bombadil: Property-based testing for web UIs

github.com

91–100 of 112 posts

Re: Bombadil: Property-based testing for web UIs

#91

My kingdom for a way to stop this godforsaken industry from stripping Tolkien's fiction for parts.

To be fair, the name was a joking response to https://x.com/patrickc/status/2015562569105465347…and then the temporary skunkworks name stuck, as it always does.

Whoops, bad link formatting: https://x.com/patrickc/status/2015562569105465347

Re: Bombadil: Property-based testing for web UIs

#92
post #79

Timely! I spent a good chunk of yesterday investigating Bombadil. I'm a huge fan of PBT and a huge fan of temporal logic (though not linear temporal logic) and we're currently trying to level up our QA, so it seemed like a good match. Unfortunately, I concluded that Bombadil is a toy . Not as in "Does some very nice things, but missing the features for enterprise adoption." I mean that in a very strong sense, as in:…

Hey, yeah, so actions are indeed independent and you can't express fixed sequences of them (e.g. fill out thus form by doing X, then Y, then Z). If you want to enforce certain sequentiality you'd need to precondition your generators. This is admittedly limited right now. I do want to add QoL things like `filter` on the generators to make that more ergonomic. Also, as you note, you can't implement custom actions. And…

Thanks for the reply Oskar!

Re: Bombadil: Property-based testing for web UIs

#94
post #13

Struggling to understand what this is or how it works.

Did you have a look at the intro in the manual? https://antithesishq.github.io/bombadil/1-introduction.html If that's not clear, please let me know how we can improve it!

"Bombadil is property-based testing for web UIs, autonomously exploring and validating correctness properties, finding harder bugs earlier."

I can't make heads or tails of this. What does it do? "Bombadil checks each property as it explores your system in its chaotic ways, reporting back any violations." what properties? checks how? does it read application state? "recording violations" what violations? "select an action and performs it" what actions?

This needs some code example, or a video, or something to explain what this tool is

The page "Language features > Properties" starts to explain what this is.

Re: Bombadil: Property-based testing for web UIs

#96
post #48
post #14

I'm doing propety-based test since years for frontend stuff. The hardest part is, that there is so much between the test inputs and the application under test, that I find 50% of the time problems with the frontend test frameworks/libs and not in our code.

And sometimes you find errors in code that absolutely should never have errors: I found an (as of yet not-root-caused) error in sqlite (no crash or coredump, just returns the wrong data, and only when using sqlite in ram-only-mode). Had to move to postgres for that reason alone. This is part of the reason why I have a strong anti-library bias (and I sound like a lunatic to most colleagues because they "have never had…

Hell, I’d hire you on the spot.

Re: Bombadil: Property-based testing for web UIs

#97
post #48
post #14

I'm doing propety-based test since years for frontend stuff. The hardest part is, that there is so much between the test inputs and the application under test, that I find 50% of the time problems with the frontend test frameworks/libs and not in our code.

And sometimes you find errors in code that absolutely should never have errors: I found an (as of yet not-root-caused) error in sqlite (no crash or coredump, just returns the wrong data, and only when using sqlite in ram-only-mode). Had to move to postgres for that reason alone. This is part of the reason why I have a strong anti-library bias (and I sound like a lunatic to most colleagues because they "have never had…

Did you report that SQLite bug? What's the company's name?

Re: Bombadil: Property-based testing for web UIs

#98
I probably missed it in the documentation, but how do I automate the browser with Bombadil? How do I get it to login to my app so I can test authenticated pages?

Edit: as others have said, I am having trouble figuring out how to make this work and understanding how to use it, more practical examples of that would be helpful. Looking forward to using this. Thank you!

Re: Bombadil: Property-based testing for web UIs

#100
post #99

I’m curious regarding your choice of name. What in your company or product brought you to adopt that name, or whether you just liked it (So do I!).

I'll quote my lobste.rs reply to this question:

> I think his jolly chaotic good energy, along with how he's uncorruptible and sort of outside the normal world, fits a fuzzer in a spiritual sense. But it might all just be a good excuse to use one of my favorite names from my favorite book.

It's also my favorite part of the book, and definitely not something I'd skip. I know some people would object, but I think of it as an homage rather than stealing.

Post reply on HN