Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Announcing tools for the AI-driven digital transformation

azure.microsoft.com

Post reply on HN
Print view View original

31–34 of 34 posts

Re: Announcing tools for the AI-driven digital transformation

#31

Post by headcanon »

gradstudent wrote: post #11

I have a PhD in AI and I'm having trouble figuring out exactly what's being announced here. Like, check this out: > Building on advanced research in program synthesis (PROSE) and data cleaning, we have created a data wrangling experience (Figure 1) that drastically reduces the time that data scientists have to spend in transforming data for machine learning. Huh? > Figure 1: AI-powered data wrangling in the workbench…

I've seen this demo at a meetup and its actually quite cool. You use a graphical interface to connect boxes of data transformations, play with the settings, and it will generate a python script that will perform the exact operations you specify to the data in question.

What you're describing are tools for data engineering - sanitizing real-world datasets to be fed into models. Researchers do not have to deal with this task as much because they work with well-defined datasets to provide fair comparisons of the algorithms they develop. Industry is the opposite - the algorithms are usually formulaic and well-defined, but the data itself is not.

Re: Announcing tools for the AI-driven digital transformation

#32

Post by dynamicwebpaige »

gradstudent wrote: post #11

I have a PhD in AI and I'm having trouble figuring out exactly what's being announced here. Like, check this out: > Building on advanced research in program synthesis (PROSE) and data cleaning, we have created a data wrangling experience (Figure 1) that drastically reduces the time that data scientists have to spend in transforming data for machine learning. Huh? > Figure 1: AI-powered data wrangling in the workbench…

Getting data into a reasonable format is (unfortunately!) a huge part of the machine learning process; that was the motivation for tools like pandas (in Python) and dplyr (for R). Joseph is describing a machine-learning-enabled way to automate some of that data cleaning, which is pretty cool.

Check out the PROSE SDK (including an interactive playground) here. I particularly like its ability to extract JSON to something resembling a dataframe: https://microsoft.github.io/prose/documentation/extraction-j...

Re: Announcing tools for the AI-driven digital transformation

#33

Post by vorotato »

Top19 wrote: post #14

Currently reading the work of Hubert Dreyfus. Dreyfus was widely ridiculed in the 60’s and the 80’s for coming out against AI simply on the grounds that it wouldn’t work, but for those decades at least he was certainly right as it turned out. Reading his book “The Power of Human Intuition and Expertise in the Era of the Computer” from 1983 is haunting and eerily sounds a lot like today. >“AI entrepreneurs and researc…

Sure but you couldn't actually do anything with AI in the 1960's and 1980's.

Re: Announcing tools for the AI-driven digital transformation

#34

Post by dotancohen »

unmole wrote: post #12
contextfree wrote: post #10

Earlier quoted context omitted.

vscode runs on Windows, Mac and Linux

VS and vscode are two entirely different projects.

The previous post seems to have been a bit context free. The application in question actually is based on vscode: https://www.visualstudio.com/downloads/ai-tools/
Post reply on HN