Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: We built a tool that automatically generates API tests

stepci.com

Post reply on HN
Print view View original

11–20 of 53 posts

Re: Show HN: We built a tool that automatically generates API tests

#11

Post by Wissmueller »

LeonidBugaev wrote: post #7

If you are looking for a more general tool, which can do not only API tests, but also interact with Databases and etc, but still use declrative syntax, try Venom https://github.com/ovh/venom

Hi, this is Sebastian from Step CI

Thanks for sharing Venom!

Certainly, there are lots of tools in the space, both SaaS and open-source. Mish and I can name you a few!

However, there’s one thing these tools seem to be missing - a greater goal.

Our vision is to give you a tool that will free you from writing and maintaining API tests ever again - in any shape or form. What you currently see from us is the first step!

Re: Show HN: We built a tool that automatically generates API tests

#12

Post by jicea »

Really cool, with already a lot of features!

Given the raise of CI/CD, I really think these kind of tools (CLI tests on HTTP requests), based on a simple format, will be really important. We've build Hurl (https://github.com/Orange-OpenSource/hurl), that shares a lot of similarities with Step CI (plain text instead of yaml, captures, jsonpath, xpath etc...). I will shamelessly take inspiration for some new features (like GraphQL for instance)!

Re: Show HN: We built a tool that automatically generates API tests

#17

Post by Sebastian_Wis »

jicea wrote: post #12

Really cool, with already a lot of features! Given the raise of CI/CD, I really think these kind of tools (CLI tests on HTTP requests), based on a simple format, will be really important. We've build Hurl ( https://github.com/Orange-OpenSource/hurl ), that shares a lot of similarities with Step CI (plain text instead of yaml, captures, jsonpath, xpath etc...). I will shamelessly take inspiration for some new features…

Oh, nice to meet you!

Our Matcher functionality was actually inspired by Hurl (you call them predicates!)! We would take your inspiration from us as a huge compliment :)

The main difference between Hurl and Step CI is from our persepective an ideological one. What do you think?

Hurl is a CLI tool, while Step CI is a library. This means that you can include our Test Runner (https://github.com/stepci/runner) and use it with other tools. For example, you can combine it with testing frameworks like Mocha, Jest, and Ava (https://github.com/stepci/stepci/blob/main/docs/using-test-t...) or build your own platform on top of it.

That's what's so nice about open source.

Re: Show HN: We built a tool that automatically generates API tests

#18

Post by barefeg »

I was looking in the site to understand the automatic generation of tests from OpenAPI but I couldn’t find it. Maybe it’s very obvious but I missed it. Does it mean that it produces test cases from the examples provided? Or how does it figure out the request response pairs?

Re: Show HN: We built a tool that automatically generates API tests

#19

Post by Sebastian_Wis »

yuvalsteuer wrote: post #15

Love it! > "never have to write and maintain your tests again!" this feels a bit misleading though. What are you doing step ci? :D

We have been watching you and we know testing APIs is your hobby and you spend a lot of time on it. We'll have to take it away from you! ;)

Just give us a little more time and hopefully your support. :)

Re: Show HN: We built a tool that automatically generates API tests

#20

Post by Wissmueller »

airocker wrote: post #10

Hi , I tried to build cli from swagger, it was a disaster: very verbose and did not really work. I am wondering what’s the verbosity of your tool. How do you deal with imperfect specs?

We’re sorry to hear that! Would you mind sharing some context with us?

Our OpenAPI (Swagger) integration is currently in Beta and only available through our website. We acknowledge, that it is not ready for prime-time just yet

Everything we do is open-source. You can see the list of issues in the repository and contribute if possible: https://github.com/stepci/plugin-openapi/issues

Disclaimer: We have tested our OpenAPI integration with the Petstore example and some other API definitions we had available. In both cases the generated tests would run after only some little adjustments

Post reply on HN