Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Voila – From notebooks to standalone web applications and dashboards

voila.readthedocs.io

Post reply on HN
Print view View original

41–50 of 92 posts

Re: Voila – From notebooks to standalone web applications and dashboards

#41

Post by byteface »

vladev wrote: post #17

Note that there's also streamlit [1]. It uses regular python files, rather than notebooks, so they can be easily version controlled. And it has more UI tools. [1]: https://streamlit.io/

I wasn't aware of this so thanks for sharing. I've been setting up a repo that utilises github actions to build exe/app files as noted in this guys blog...

https://data-dive.com/multi-os-deployment-in-cloud-using-pyi...

It uses pyinstaller to build and even pushes the build as a zip into your release page on github and appears to be working quite well.

Re: Voila – From notebooks to standalone web applications and dashboards

#42

Post by abdullahkhalids »

I have a question about hosting costs - not a SW.

Suppose I write some educational Jupyter notebooks, which are not particularly resource intensive, say 100 seconds of compute time per notebook. I host them on some cloud server, using something like OP, and get a 1000 people to learn from it. Maybe they end up using say,

1000 people x 5 notebooks x 100 seconds/run x 20 runs of each notebook = 10 million seconds of compute time.

How much would such a server cost to host, where "many" of these people are working on the notebooks together? Just need a rough estimate.

Re: Voila – From notebooks to standalone web applications and dashboards

#43

Post by csmpltn »

BiteCode_dev wrote: post #37
bluescarni wrote: post #28

Earlier quoted context omitted.

As a scientist myself, I strongly disagree. If you spend a non-negligible amount of your time telling a computer what to do, you are, indeed, a programmer. And as such you should be expected to become a decently proficient programmer. Physicists are not mathematicians, and yet they are required to acquire a relatively high degree of proficiency in maths because maths is a fundamental tool in their job, and nobody wou…

> If you spend a non-negligible amount of your time telling a computer what to do, you are, indeed, a programmer. And as such you should be expected to become a decently proficient programmer. Just like if you are standing on your two legs most of the day and sprint once in a while, you can be considered a runner. Sure, you can play with semantics, but most people cannot run a marathon. > The attitude of considering…

Shouldn't we just reduce the "data science profession" to what it clearly is then: shuffling around numbers and statistics in excel and python, in the hope of generating a useful insight or two and the occasional whitepaper as you go along?

If you don't understand the tools you're using, or the environment you're in - you're not any more of a "data scientist" than pretty much everybody else. My carpenter is a data scientist going by this logic.

Re: Voila – From notebooks to standalone web applications and dashboards

#44

Post by qayxc »

fxtentacle wrote: post #16

Tried their example link: "Problem: package xeus-cling-0.12.0-h5a79028_0 requires xtl >=0.7.0, sigh I don't know when it started, but it seems to be a recent trend to add dependencies for anything and to package everything on demand. It's probably for security or something. But I do miss the days when people would link a static binary that "just works" even without internet and that'll keep working a week later, beca…

Amen to that.

That's why tools like Anaconda and Docker were created and now even a simple utility can use gigabytes of disk space...

Re: Voila – From notebooks to standalone web applications and dashboards

#45

Post by BiteCode_dev »

jstx1 wrote: post #30
BiteCode_dev wrote: post #26

Earlier quoted context omitted.

Data scientists are not programmers. They are data scientists. Just like I'm not a data scientists, I'm a programmer. Now, I can use pandas in a pinch and makes pretty graphs, but my statistical analysis will never be on part with yours. Just like a pianist hobbyist will have a hard time to rival somebody who does that 40 hours a week, although he may be able to play a few fantastic pieces. Hell, even a web dev progr…

As a data scientist I spend more time writing software and building things than I spend doing statistical analysis (and I like it that way). That's why I consider it part of software development. Don't be tripped up by the word "scientist" in the job title (I wrote another comment about this in this thread). Also, it's a very broad field and it varies a lot from company to company - if you've had some interactions wi…

If you want to play with names and semantics, I'll leave you to it.

That's not my point.

Re: Voila – From notebooks to standalone web applications and dashboards

#46

Post by pavlovskyi »

csmpltn wrote: post #43
BiteCode_dev wrote: post #37

Earlier quoted context omitted.

> If you spend a non-negligible amount of your time telling a computer what to do, you are, indeed, a programmer. And as such you should be expected to become a decently proficient programmer. Just like if you are standing on your two legs most of the day and sprint once in a while, you can be considered a runner. Sure, you can play with semantics, but most people cannot run a marathon. > The attitude of considering…

Shouldn't we just reduce the "data science profession" to what it clearly is then: shuffling around numbers and statistics in excel and python, in the hope of generating a useful insight or two and the occasional whitepaper as you go along? If you don't understand the tools you're using, or the environment you're in - you're not any more of a "data scientist" than pretty much everybody else. My carpenter is a data sc…

But it is just an assumption. I work as a data scientist for 5+ years and from practical point of view, it is not just data wrangling. It is worth to mention that going through that logic we assume that programmer fully understand how to develop model in production and how to handle it in some border cases, which is not true.

Re: Voila – From notebooks to standalone web applications and dashboards

#47

Post by misja111 »

BiteCode_dev wrote: post #9
pavlovskyi wrote: post #4

I really like Jupyter notebooks to build a simple concept and then move to .py files. But what I observe, especially at the entry level or junior level jobs in data science is that people spend huge amount of its work on jupyter, which did not focus on how to plan flow properly. What I meant is that there is very short path from usefullness to overkill.

That's because they are not programmers. One should not expect them to be experts in 2 fields. They do their work with the tool provided, and if we want a better output, we need to provide better tooling or accept what comes out. I want my physicists to spend their mental effort on physics, not on software architecture.

Maybe they are not programmers but they surely work in a team or company where everybody is supposed to work as efficiently as possible together. Simply throwing your unstructured and unreadable code over the wall, with the excuse that it's not your key responsibility so somebody else should fix it, is just bad.

It doesn't mean of course that everybody is supposed to be an expert programmer, but a minimum effort to help your colleague is surely not too much to be asked.

Re: Voila – From notebooks to standalone web applications and dashboards

#48

Post by qayxc »

abdullahkhalids wrote: post #42

I have a question about hosting costs - not a SW. Suppose I write some educational Jupyter notebooks, which are not particularly resource intensive, say 100 seconds of compute time per notebook. I host them on some cloud server, using something like OP, and get a 1000 people to learn from it. Maybe they end up using say, 1000 people x 5 notebooks x 100 seconds/run x 20 runs of each notebook = 10 million seconds of co…

This could cost anywhere from nothing (e.g. free) to 3-figures (in USD) depending on the specifics.

How many users are accessing the notebooks concurrently (e.g. all 1000 or only a dozen at a given time)? Is there any downtime, i.e. do the users come from the same time zone, so that app can have inactive hours (say it's OK to be unreachable during the night)?

Depending on the specifics, free hosting may be available (e.g. via Heroku, Google Colab, AWS Free Tier etc.).

As far as paid offers go, this is way too unspecific to be answered in a meaningful way. The answer depends on the actual resource requirements (RAM, storage, data transfer, CPU cores), estimated usage patterns (concurrent users), and your location.

TBH, if no commercial interest is involved, just hosting the notebooks on Github or making them accessible via Google Colab would be the easiest option.

Re: Voila – From notebooks to standalone web applications and dashboards

#49

Post by ianbooker »

abdullahkhalids wrote: post #42

I have a question about hosting costs - not a SW. Suppose I write some educational Jupyter notebooks, which are not particularly resource intensive, say 100 seconds of compute time per notebook. I host them on some cloud server, using something like OP, and get a 1000 people to learn from it. Maybe they end up using say, 1000 people x 5 notebooks x 100 seconds/run x 20 runs of each notebook = 10 million seconds of co…

We host at this scale on a dedicated server and it is roughly 0.5 Euro per user per month.

We provide this no matter the season and usage is very seasonal for us ;) We also provide way more computational bandwidth that would be necessary, so I guess you can provision this for half the cost, just be sure to put out the right restrictions for resource usage.

Re: Voila – From notebooks to standalone web applications and dashboards

#50

Post by d4rkp4ttern »

vladev wrote: post #17

Note that there's also streamlit [1]. It uses regular python files, rather than notebooks, so they can be easily version controlled. And it has more UI tools. [1]: https://streamlit.io/

Streamlit is great for demos but not for building a product.
Post reply on HN