Earlier quoted context omitted.
Have you tried https://k6.io/ ? (Full disclosure: I'm one of the maintainers.) It allows you to write load/performance tests in JS, commit them to your repo, easily automate them in CI, send metrics to several backends, use protocols besides HTTP, with a modern CLI, and many more features. There's also a Postman-to-k6 converter[1]. The conversion might not be perfect, but it will give you a head start. Note that the…
If you maintain k6, can I log a complaint? I feel like I used to be able to run the CLI with just an URL and it would issue GET requests to it -- without needing a .js script to run Am I crazy, did this never exist? Please bring back/add this feature
Hurl 4.0.0
91–100 of 104 posts
Re: Hurl 4.0.0
#92Re: Hurl 4.0.0
#93Earlier quoted context omitted.
Have you tried https://k6.io/ ? (Full disclosure: I'm one of the maintainers.) It allows you to write load/performance tests in JS, commit them to your repo, easily automate them in CI, send metrics to several backends, use protocols besides HTTP, with a modern CLI, and many more features. There's also a Postman-to-k6 converter[1]. The conversion might not be perfect, but it will give you a head start. Note that the…
> but it's limited in features compared to existing peformance testing tools, and I'd personally rather write tests in a programming language, than in a bespoke text format. I’d hardly call hurl’s config bespoke, it basically amounts to HTTP codes and some header stuff, which basically everyone is familiar with. From personal experience a couple of weeks ago I needed some http tests. I got a CI-ready Hurl config work…
That said...
> I got a CI-ready Hurl config working on some endpoints for work sorted within like, 5 minutes of downloading it.
I'm obviously biased, but I'd argue that k6 is equally easy to get started with. Take a look at the docs[1].
> I’d hardly call hurl’s config bespoke
But it is. It has a unique syntax, and no other tool uses it, AFAIK. I'm not saying it's not simple or easy to understand, but it's not as expressive as a programming language. Which is fine if your tests don't require any logic, but from experience, in order to simulate accurate real-world traffic, which you probably want when writing a load/performance test, you do need some logic, different scheduling options, a way to process and analyze the metrics, etc.
I don't want to turn this into a versus battle, as there is a place for tools such as Hurl, ab, and wrk to coexist with tools like k6 and Locust. I just wanted to mention it as an option for anyone who hasn't heard about it, as any personal biases aside, I do think it's a great tool.
[1]: https://k6.io/docs/
Re: Hurl 4.0.0
#94Earlier quoted context omitted.
Anual revenue is in the ballpark of about $1bn-$5bn.
If this happens to be a reference to Microsoft, their famous laying off of qa people has been regarded as a disaster by everyone outside Ms, with windows update quality dropping off a cliff.
And I believe it's hard to do this kind of thing as an afterthought. If your whole engineering culture is built around having a QA dept then just firing that dept is obviously going to have disastrous consequences.
Re: Hurl 4.0.0
#95Can anyone who's used hurl explain whether there are any use cases where something like Postman can do something hurl can't or can do it much better? I haven't used Postman very often previously but at work my role may change to require much more testing work (that many in the industry would have traditionally used Postman for).
Another Hurl use case is, instead of testing APIs, you want to download datas. Like curl, Hurl can output an HTTP response body. Unlike curl, this response can be the last one of a complex workflow (data behind login for instance, you need to capture data from one request and inject in another request like CSRF tokens).
Disclaimer: I'm one of the Hurl maintainers.
Re: Hurl 4.0.0
#96Feedback: The homepage ( https://hurl.dev/ ) doesn't really make it clear - is this an interactive tool or not? If I understand it correctly, you're supposed to save that example as a file and run 'hurl example.hurl'. It would make it easier to understand if that sample code box had a headline saying e.g. [example.hurl].
Re: Hurl 4.0.0
#97Earlier quoted context omitted.
There’s also Step CI: https://stepci.com (I’m one of the authors) Hurl is brilliant though
I was just looking at this. We might use it at my company, but i was wondering, is this funded? Or is this just an open source side project for you guys.
Re: Hurl 4.0.0
#98This looks like a great tool to put in charge of regularly testing your site performance in a dashboard or incorporating into CI somehow. Has anyone done anything like this as, say, a Github Action, in a workflow? I see that there is this https://github.com/marketplace/actions/install-hurl-cross-pl... but I'm not sure how it would look in such a use case- a "performance test" stage perhaps? with logging over time to…
- GitHub CI/CD integration example in the Hurl documentation [1]
- a blog post from GitLab about how to integrate Hurl in GitLab CI/CD [2]
[1]: https://hurl.dev/docs/tutorial/ci-cd-integration.html
[2]: https://about.gitlab.com/blog/2022/12/14/how-to-continously-...
Re: Hurl 4.0.0
#99I learned today that Visual Studio 2022 has support for something similar with .http files: https://learn.microsoft.com/en-us/aspnet/core/test/http-file... . Hurl seem to have way more features.
Re: Hurl 4.0.0
#100Earlier quoted context omitted.
> but it's limited in features compared to existing peformance testing tools, and I'd personally rather write tests in a programming language, than in a bespoke text format. I’d hardly call hurl’s config bespoke, it basically amounts to HTTP codes and some header stuff, which basically everyone is familiar with. From personal experience a couple of weeks ago I needed some http tests. I got a CI-ready Hurl config work…
That's fair, and k6 is not for everyone. JS was chosen as it's a popular language with a large web ecosystem, but the tool itself is written in Go. That said... > I got a CI-ready Hurl config working on some endpoints for work sorted within like, 5 minutes of downloading it. I'm obviously biased, but I'd argue that k6 is equally easy to get started with. Take a look at the docs[1]. > I’d hardly call hurl’s config bes…
Yeah, I did they start off with JS shenanigans, including importing packages, which immediately makes me concerned I’m going to have to deal with JS packaging dumpster-fire. There’s then one line of CLI args, followed by even more JS boilerplate.
> in order to simulate accurate real-world traffic, which you probably want when writing a load/performance test
I think the mismatch here is that Hurl is closer to being a http testing tool, not a load-testing tool, so most of these features are unnecessary.
> It has a unique syntax, and no other tool uses it, AFAIK.
Taking the example from the front page:
HTTP 200 [Captures] csrf_token: xpath "string(//meta[@name='_csrf_token']/@content)"
Character for character, most of this is bog-standard http verbs, a url, and an html path string. The Jetbrain HTTP tool also sports very similar interface, and I believe there’s a VSCode plugin somewhere that does a similar thing.