Show HN: We built a tool that automatically generates API tests

Post by jicea » Mon, Oct 10, 2022, 5:24 PM UTC

Sebastian_Wis wrote: post #17

jicea wrote: post #12

Really cool, with already a lot of features! Given the raise of CI/CD, I really think these kind of tools (CLI tests on HTTP requests), based on a simple format, will be really important. We've build Hurl ( https://github.com/Orange-OpenSource/hurl ), that shares a lot of similarities with Step CI (plain text instead of yaml, captures, jsonpath, xpath etc...). I will shamelessly take inspiration for some new features…

Oh, nice to meet you! Our Matcher functionality was actually inspired by Hurl (you call them predicates!)! We would take your inspiration from us as a huge compliment :) The main difference between Hurl and Step CI is from our persepective an ideological one. What do you think? Hurl is a CLI tool, while Step CI is a library. This means that you can include our Test Runner ( https://github.com/stepci/runner ) and use…

Post by Wissmueller » Mon, Oct 10, 2022, 5:57 PM UTC

barefeg wrote: post #18

I was looking in the site to understand the automatic generation of tests from OpenAPI but I couldn’t find it. Maybe it’s very obvious but I missed it. Does it mean that it produces test cases from the examples provided? Or how does it figure out the request response pairs?

Post by itake » Mon, Oct 10, 2022, 6:58 PM UTC

Wissmueller wrote: post #11

LeonidBugaev wrote: post #7

If you are looking for a more general tool, which can do not only API tests, but also interact with Databases and etc, but still use declrative syntax, try Venom https://github.com/ovh/venom

Hi, this is Sebastian from Step CI Thanks for sharing Venom! Certainly, there are lots of tools in the space, both SaaS and open-source. Mish and I can name you a few! However, there’s one thing these tools seem to be missing - a greater goal. Our vision is to give you a tool that will free you from writing and maintaining API tests ever again - in any shape or form. What you currently see from us is the first step!

Post by fernandopj » Mon, Oct 10, 2022, 7:51 PM UTC

ushakov wrote: post #5

inglor wrote: post #3

How do you deal with state between API calls? (For example, a user filling a shopping cart, getting discounts based on their geo/products and then checking out)

Hello, this is Mish from Step CI Thanks for your question! We allow you to capture content like headers, response and cookies between steps using captures, check out the "Captures" example in our Demo Here's a documentation with examples for all capture types: https://github.com/stepci/stepci/blob/main/docs/workflow-syn... also: we manage cookies for you automatically

Post by jzig » Mon, Oct 10, 2022, 8:17 PM UTC

jzig wrote: post #28

Yo, I tried uploading my openapi.json file and all I got was a big error on the right hand side.

    #     $ref: '#/components/schemas/String'
  schemas:
  ^^^^^^^