Thanks for posting this! Could you add a download link somewhere?
Sure just added this to the intro. You can download via https://github.com/mtford90/silk/releases or install through pip install django-silk
Show HN: Silk, a profiling tool for Django
11–20 of 25 posts
Re: Show HN: Silk, a profiling tool for Django
#12I wrote https://github.com/rory/django-sql-inspector a django app to profile SQL queries done in multiple pages, including showing stack trace of where it's being called. You can find out which function(s) are responsible for long SQL requests.
Re: Show HN: Silk, a profiling tool for Django
#13Looks really nice. Have you thought that instead of sending the results to elasticsearch? Instead of using something like newrelic this could take it's place..
That's not a bad idea, it would probably be more natural than the rigid filters that are currently in place for the requests and profiles. As far as having this running in prod I've only really thought of siphoning off the results to celery or something similar to avoid impacting response time, but a spray and pray at Elasticsearch would work just as well.
What's nice about the current setup is that it takes very little effort to get up and running but I suppose could make that configurable...
Re: Show HN: Silk, a profiling tool for Django
#14What is the overhead (roughly) for this guy? I do absolutely love the idea of using elasticsearch for this instead of a traditional database.
Using celery or django-rq to delay the processing also seems reasonable.
Re: Show HN: Silk, a profiling tool for Django
#15What is the overhead (roughly) for this guy? I do absolutely love the idea of using elasticsearch for this instead of a traditional database. Using celery or django-rq to delay the processing also seems reasonable.
Tbh, probably fairly bad atm. I haven't done anything empirical but atm Silk will create a record for every SQL query executed during the request/response cycle effectively doubling the number of queries. Not only that but it also saves down any non-binary HTTP body to a TextField, and this isn't yet configurable.
I think the Elasticsearch/Celery option is a good shout if this were to ever be used in production. Celery would help with the issue of response time but it wouldn't solve the load impact on the database (although I guess could also configure a different SQL database in Django).
I will certainly do some investigation into this at some point :)
Re: Show HN: Silk, a profiling tool for Django
#16What is the overhead (roughly) for this guy? I do absolutely love the idea of using elasticsearch for this instead of a traditional database. Using celery or django-rq to delay the processing also seems reasonable.
Tbh, probably fairly bad atm. I haven't done anything empirical but atm Silk will create a record for every SQL query executed during the request/response cycle effectively doubling the number of queries. Not only that but it also saves down any non-binary HTTP body to a TextField, and this isn't yet configurable. I think the Elasticsearch/Celery option is a good shout if this were to ever be used in production. Cele…
StatsD might be better since you are just recording datapoints + text field I'm assuming.
Re: Show HN: Silk, a profiling tool for Django
#17Earlier quoted context omitted.
Tbh, probably fairly bad atm. I haven't done anything empirical but atm Silk will create a record for every SQL query executed during the request/response cycle effectively doubling the number of queries. Not only that but it also saves down any non-binary HTTP body to a TextField, and this isn't yet configurable. I think the Elasticsearch/Celery option is a good shout if this were to ever be used in production. Cele…
StatsD might be better since you are just recording datapoints + text field I'm assuming. https://pypi.python.org/pypi/python-statsd
Sounds interesting... i'll take a look. The fact that its UDP would be helpful in avoiding the need for a dependency on celery/message queues.
What's it like in terms of getting the data back out?
Re: Show HN: Silk, a profiling tool for Django
#18For people interested in production monitoring I've created https://appenlight.com - and our python middleware will integrate and start timing django applications without any code changes required (except 3 lines to load middleware itself).
@mtford great job!
Re: Show HN: Silk, a profiling tool for Django
#19Looks really nice. Have you thought that instead of sending the results to elasticsearch? Instead of using something like newrelic this could take it's place..
If you are looking for something like newrelic you might want to give https://appenlight.com a try.
I've put a lot of love into it and it can give you tons of information about your application.
Re: Show HN: Silk, a profiling tool for Django
#20Earlier quoted context omitted.
StatsD might be better since you are just recording datapoints + text field I'm assuming. https://pypi.python.org/pypi/python-statsd
Sounds interesting... i'll take a look. The fact that its UDP would be helpful in avoiding the need for a dependency on celery/message queues. What's it like in terms of getting the data back out?
You can write your plugin for the back end to dump it. It defaults to graphite which would be familiar enough I think.