Human in A.I. Loop • Hacker News Board

Re: Human in A.I. Loop

#21

Post by nxzero » Sat, Sep 10, 2016, 4:10 PM UTC

mmastrac wrote: post #18

nxzero wrote: post #6

"In the loop" is a reference to the OODA loop, which is the decision cycle of observe, orient, decide, and act, developed by military strategist and United States Air Force Colonel John Boyd. "In the loop" has a specific tactical meaning, which is that you're able to do a full OODA loop cycle faster than a comparable AI/man system which gives a strategic advantage and maybe used against oppositional forces in a varie…

I'm pretty sure it's just a reference to the phrase "in the loop", which dates back beyond the 80s: http://idioms.thefreedictionary.com/in+the+loop

Yes, "in the loop" does date back further, but as used to reference human/systems integration earliest reference I was able to find was the 80s which was the same time that Boydian like systems started popping up.

Re: Human in A.I. Loop

#22

Post by imh » Sat, Sep 10, 2016, 4:26 PM UTC

datstanfordphd wrote: post #4

Looks like what CrowdFlower calls "human in the loop computing" which is a nicer name for it. http://www.computerworld.com/article/3004013/robotics/why-hu...

Also called human computation. The past paper awards from this conference [0] gives a good flavor for the field.

[0] http://www.humancomputation.com/2016/past%20meetings.html#aw...

Re: Human in A.I. Loop

#23

Post by ayw » Sat, Sep 10, 2016, 4:42 PM UTC

Applications of human-in-the-loop systems like this are exactly why we built Scale API (www.scaleapi.com, YC S16).

Unfortunately, Mechanical Turk is often a bad choice these days for these types of applications—it's extremely difficult to guarantee quality, not to mention hard to use. Using employees also works well to a point (we did some of this at companies I've worked at too), but it doesn't scale, and should be done sparingly.

Great application of humans in the loop—this is the type of thing that really excites me. We're trending towards more and more human-augmented software, and it opens up so many possibilities for what software can do!

Re: Human in A.I. Loop

#24

Post by [deleted] » Sat, Sep 10, 2016, 5:27 PM UTC

mmastrac wrote: post #18

nxzero wrote: post #6

"In the loop" is a reference to the OODA loop, which is the decision cycle of observe, orient, decide, and act, developed by military strategist and United States Air Force Colonel John Boyd. "In the loop" has a specific tactical meaning, which is that you're able to do a full OODA loop cycle faster than a comparable AI/man system which gives a strategic advantage and maybe used against oppositional forces in a varie…

I'm pretty sure it's just a reference to the phrase "in the loop", which dates back beyond the 80s: http://idioms.thefreedictionary.com/in+the+loop

[deleted]

Re: Human in A.I. Loop

#25

Post by zo1 » Sat, Sep 10, 2016, 5:41 PM UTC

noonespecial wrote: post #10

"What we need to build is a gamified quick truther thingy that all our 200 employees in main office can log in during their lunch break and rate a few items." Lunch break? Or you could just, I don't know... go with me here, I know it sounds crazy at first..., pay them for providing this value to your company.

You're already paying them. Simply tell them to do this during any downtime they might have. Obviously don't encroach on their lunch/home time, though.

Re: Human in A.I. Loop

#26

Post by Eridrus » Sat, Sep 10, 2016, 7:21 PM UTC

nxzero wrote: post #9

Eridrus wrote: post #7

Does anyone know any good tools to make that sort of page quickly in Python? I mean, I could cobble together a web app, but I feel like dataset annotation is so common that there should be something out there already.

Why Python? Why not just focus on finding the best open source data annotation framework? (Love Python, but normally don't bias my selection of a solution by the language it's written in.)

You're right, though I do need a way to interact with it programatically from python, since that's what I prefer to write my scraping & munging code in.

It would probably be fine if it was a solution that had an API that was easily callable from Python without a silly amount of overhead, specifically being able to dump data into a named dataset is what I want.

Python would also be nice since it would be easier for me to customize; though I could deal with Java or Node. I've avoided Ruby for this many years and would prefer to keep it that way.