exponentially?
Estimating Number of Jupyter Notebooks on Github
71–80 of 135 posts
Re: Estimating Number of Jupyter Notebooks on Github
#72We built a runnable jupyter notebook website. Would someone be able to take a look and give us some feedback? https://datacabinet.systems We are VM based for now but are moving to be kubernetes based to make sharing better. Our initial market is classrooms.
Something to be aware of (and a general comment about k8s in general) is that k8s is not suitable for use in hostile multi-tenant scenarios like the one that you're describing. Once an attacker escapes from the container (see HN archives for lots of examples of this), they can p0wn the entire cluster. Jessie Frazelle has a great post on this: https://blog.jessfraz.com/post/hard-multi-tenancy-in-kuberne... There are e…
We were starting to work on disabling kubernetes cluster access. We will try the steps in the post.
Re: Estimating Number of Jupyter Notebooks on Github
#73Earlier quoted context omitted.
> We've been recently working in a FREE hosted version [...] Oh no, you make it sound like this is a good thing. It only means I can't take you serious. Don't make it free . That is not a feature for a computation environment, it will only cause headaches on your side and people get wrong (bad) impression about the performance (assuming free accounts get some limited shared instances). I rather pay a monthly fee for…
That's a very good point. We wanted to make it super accessible for students using Jupyter. Also, we only support very small containers which of course don't have GPU. It's not mainly intended to be used for business, but for learning purposes.
What would be the difference between using this and something like Google Colab?
Re: Estimating Number of Jupyter Notebooks on Github
#74Earlier quoted context omitted.
We got support of the local university at my city and we got a bunch of free credits at AWS. Costs are very low and we want to keep it that way so we can support the most students we can with a free access.
What happens when your funding and AWS credits run out?
We might add bigger paid tiers later if we decide to support business usage of it. For now it's only educational and we can deal with the costs, even without the credits. Containers used are small and get shut down on inactivity. So, we only need to care about concurrent users. Hope it makes sense.
Re: Estimating Number of Jupyter Notebooks on Github
#75We built a runnable jupyter notebook website. Would someone be able to take a look and give us some feedback? https://datacabinet.systems We are VM based for now but are moving to be kubernetes based to make sharing better. Our initial market is classrooms.
There are a few basic UI problems I ran into immediately. You should focus on that instead of rearchitecting things. It needs to look sleeker, too. Pay some designer to create a new design for you. Like I can't add a project. It says "To create project Please wait till hard drive button turn green." I don't know what that means. You've lost my attention.
Thanks. We are doing some enhancements. Here is some initial screen: https://mondaytest.datacabinet.systems/ system but the page inside is still the same. We have an elaborate design done.
Re: Estimating Number of Jupyter Notebooks on Github
#76I hate jupyter notebooks. Joel Grus puts it perfectly: https://docs.google.com/presentation/d/1n2RlMdmv1p25Xy5thJUh... past hn discussion: https://news.ycombinator.com/item?id=17856700
What specifically do you hate about Jupyter? Is it out of order execution exacerbating the "hidden state" problem? If so, and if you already use VS Code, I encourage you to try out our Python VS Code extension. We have an "Interactive Python Window" mode https://code.visualstudio.com/docs/python/jupyter-support that we showed a lot of folks at pycon last week and even among the "I don't like Jupyter" crowd, it was qu…
This is really cool.
I tend to do a lot of exploratory work in Jupyter stuff, but find the whole process really annoying and cumbersome to set up - just been playing around with this VS code extension and it seems really neat!
I've been using nteract a lot recently but I'm gonna switch to VS Code now, at least that reduces one Electron app eating up my memory
Re: Estimating Number of Jupyter Notebooks on Github
#77In the same spirit as “Effective Java” and “Effective C++” we need to have a book entitled “Effective Jupyter Notebooks”. Here are some of my items below. Maybe this sub-thread can come up with an outline for this book. Item #1 Writing a notebook is foremost an exercise in expository writing. Make sure the writing is high quality is the first objective when writing a notebook. This is the Knuth’s literate programming…
This is a really good idea, and I've been planning to write said guide for a while.
I think there is a lot to do with organising and formatting the notebooks, and the %run command works a treat for me when breaking a project into multiple notebooks
Re: Estimating Number of Jupyter Notebooks on Github
#78Earlier quoted context omitted.
What happens when your funding and AWS credits run out?
We might add bigger paid tiers later if we decide to support business usage of it. For now it's only educational and we can deal with the costs, even without the credits. Containers used are small and get shut down on inactivity. So, we only need to care about concurrent users. Hope it makes sense.
> Containers used are small and get shut down on inactivity.
How do you define inactivity? If I do
$ nohup ./computational_intense_and_runs_for_100_hours.py &
Do you just kill the process (or stop the container)? In essence Jupyter is a graphical rich shell, so you providing free *nix machines - don't underestimate how this feature can be exploited (e.g. CoCalc limits at least internet access for free instances).
Re: Estimating Number of Jupyter Notebooks on Github
#79Earlier quoted context omitted.
That's a very good point. We wanted to make it super accessible for students using Jupyter. Also, we only support very small containers which of course don't have GPU. It's not mainly intended to be used for business, but for learning purposes.
What would be the difference between using this and something like Google Colab?
We were using Colab and Azure Notebooks before, but we found a few not covered requirements. For example:
* We added a way for students to present their projects / analysis in an static blog-looking version of their notebooks. Here's an example: https://notebooks.ai/martinzugnoni/how-to-trade-bitcoin-with...
They can share that version with classmates, and classmates can "fork" the project and do their own changes to it.
* Also, we added a custom JupyterLab extension called "solutions" that allow the teacher to mark certains parts of the notebooks as assignment solution and it will be hidden for the student until they decide to reveal it. Here's how it works:
(teacher) https://user-images.githubusercontent.com/7065401/50402147-1...
(student) https://user-images.githubusercontent.com/7065401/50402146-1...
We now have the ability to keep adding educational relates stuff to it, without depending on Google or Microsoft, that are not focussed on this space.
Re: Estimating Number of Jupyter Notebooks on Github
#80In the same spirit as “Effective Java” and “Effective C++” we need to have a book entitled “Effective Jupyter Notebooks”. Here are some of my items below. Maybe this sub-thread can come up with an outline for this book. Item #1 Writing a notebook is foremost an exercise in expository writing. Make sure the writing is high quality is the first objective when writing a notebook. This is the Knuth’s literate programming…
I disagree massively with this, to me Jupyter is a repl+ development environment + rapid prototyping in ETL/visualisation. There's no rule that they have to be used for exposition, or any writing at all. I don't know why you think this is a rule, or what you'd use as an alternative data-repl.