Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

PixQL: SQL for image processing

github.com

Post reply on HN
Print view View original

21–30 of 35 posts

Re: PixQL: SQL for image processing

#21

Post by kubiiii »

TeeWEE wrote: post #20

So how do i blur an image, probably its not possible with this kind of SQL language, right? Or can you do something like this: SELECT *: OPERATE SET COLOR AVG(ROW[-1], ROW[0], ROW[+1])) To apply a 1 pixel horizontal blur?

You could even apply it to the mask resulting from the select. Mathematical morphology, advection using several pictures, interpolation, there are many use case that would be possible with a single query. But maybe I'm too optimistic with the current possibilities. Promising project anyway.

Re: PixQL: SQL for image processing

#22

Post by phildo3 »

kbenson wrote: post #6

If you are going to use SQL select, why use a separate operate statement when you could just use SQL's method for this, update? For that matter, if you are going to use SQL syntax, I would imagine you would want to keep one of the main features, which is joining of datasets. Being able to join an image with itself in some manner (or another image...), would be really useful. Instead of globals, use the images as tabl…

Author here- My reason for deviating slightly from traditional SQL syntax is that I don't find it to be super intuitive. Yes, "UPDATE color SET r = 255 WHERE col = 100" is a pretty straightforward looking thing for those of us familiar with SQL, but simple things like the fact that you set the value before deciding what you're setting the value of are a bit off putting. The separation of queries into multiple statements along with this fact lead to just universally cleaner and more consistent looking syntax even as queries get complex.

That said, I'm still very much in the "trying things out" phase w.r.t. syntax 'n such. So the feedback is appreciated! (And you're not the only one who has suggested this...)

Curious what you'd expect the result of a join to be? I assume you mean across multiple images? Currently, that would be a bit odd as the function of "select" exists more along the lines of "composing a mask" more than it does "fetching data", so not entirely sure how that'd fit in. Still very interesting. If you're interested in fleshing that idea out here, it could be helpful for me!

Thanks!

Re: PixQL: SQL for image processing

#23

Post by phildo3 »

no_gravity wrote: post #12

Wouldn't it be easier to use JavaScript? PixQL: SELECT WHERE COLOR = #FF0000FF; OPERATE SET COLOR = #00FF00FF JS : if (rgba=='FF0000FF') rgba='00ff00ff' PixQL: OPERATE SET G = R JS : g=r PixQL: SELECT WHERE ROW % 100 = 0 OR COL % 100 = 0; OPERATE SET COLOR = WHITE JS : if (!(row%100) || !(col%100)) rgba="ffffffff"

maybe. but as it stands, so long as you can compile it, it doesn't need any external libraries or installs or anything like that, which is something I value (I assume your post is hinting at using node, rather than some in-browser thing... if not, there are plenty of other reasons I prefer to keep it out of the browser hah).

Re: PixQL: SQL for image processing

#24

Post by phildo3 »

paulasmuth wrote: post #19

I love this! Now all we need is some higher level DRAW operations (draw a line from here to there, draw a piece of rendered text here) and we can glue PixQL and ChartSQL together to implement SQL query result visualization to bitmaps completely in SQL (without going through SVG). PS: Under which license is the PixSQL code available?

Thanks for the feedback! Definitely considering where to prioritize features, and drawing or "select where in polygon(x1,y1,x2,y2,...)", etc... are definitely on the table (first I need to fiddle with some compatibility stuff and clean up the code a bit).

As far as the license, I haven't yet decided... pretty new/naive when it comes to deciding something like that... I don't plan on selling it for money, and I obviously like that the source is available, and want contributions, etc... but yeah. not sure. (Any tips would be welcome :P)

Re: PixQL: SQL for image processing

#25

Post by phildo3 »

TeeWEE wrote: post #20

So how do i blur an image, probably its not possible with this kind of SQL language, right? Or can you do something like this: SELECT *: OPERATE SET COLOR AVG(ROW[-1], ROW[0], ROW[+1])) To apply a 1 pixel horizontal blur?

It's possible, but unfortunately a bit obtuse in this language (you might want to just use photoshop for something like that...).

One way you could do it is as follows:

OPERATE SET R = (IN[COL,ROW-1].R + IN[COL-1,ROW] + ...)/8;

Unfortunately, that's just the R channel. I should find a way to consider COLOR that would be smart enough to just have it apply the operation across all channels. (right now, the COLOR keyword is nice for simple "set color to this" type of things)

Re: PixQL: SQL for image processing

#26

Post by phildo3 »

phildo3 wrote: post #25
TeeWEE wrote: post #20

So how do i blur an image, probably its not possible with this kind of SQL language, right? Or can you do something like this: SELECT *: OPERATE SET COLOR AVG(ROW[-1], ROW[0], ROW[+1])) To apply a 1 pixel horizontal blur?

It's possible, but unfortunately a bit obtuse in this language (you might want to just use photoshop for something like that...). One way you could do it is as follows: OPERATE SET R = (IN[COL,ROW-1].R + IN[COL-1,ROW] + ...)/8; Unfortunately, that's just the R channel. I should find a way to consider COLOR that would be smart enough to just have it apply the operation across all channels. (right now, the COLOR keywor…

(not to mention correcting for gamma depending on exactly what you want to do with your blur... again, pixQL probably isn't the right tool for this as it currently stands hah)

Re: PixQL: SQL for image processing

#27

Post by kubiiii »

phildo3 wrote: post #22
kbenson wrote: post #6

If you are going to use SQL select, why use a separate operate statement when you could just use SQL's method for this, update? For that matter, if you are going to use SQL syntax, I would imagine you would want to keep one of the main features, which is joining of datasets. Being able to join an image with itself in some manner (or another image...), would be really useful. Instead of globals, use the images as tabl…

Author here- My reason for deviating slightly from traditional SQL syntax is that I don't find it to be super intuitive. Yes, "UPDATE color SET r = 255 WHERE col = 100" is a pretty straightforward looking thing for those of us familiar with SQL, but simple things like the fact that you set the value before deciding what you're setting the value of are a bit off putting. The separation of queries into multiple stateme…

You can imagine composing a mask from several images using Join or Union. Summing up images to make HDR, only on some areas of the pictures based on different criteria to produce the mask.

Another possibility would be to output a mosaic based on properties of a set of pictures.

I also vote for the use of UPDATE and also the use of INSERT to insert some part of image 1 x mask in image 2 x mask, or insert geometric features x mask.

I think this project is a great idea, thanks for submiting it.

Re: PixQL: SQL for image processing

#28

Post by infogulch »

phildo3 wrote: post #22
kbenson wrote: post #6

If you are going to use SQL select, why use a separate operate statement when you could just use SQL's method for this, update? For that matter, if you are going to use SQL syntax, I would imagine you would want to keep one of the main features, which is joining of datasets. Being able to join an image with itself in some manner (or another image...), would be really useful. Instead of globals, use the images as tabl…

Author here- My reason for deviating slightly from traditional SQL syntax is that I don't find it to be super intuitive. Yes, "UPDATE color SET r = 255 WHERE col = 100" is a pretty straightforward looking thing for those of us familiar with SQL, but simple things like the fact that you set the value before deciding what you're setting the value of are a bit off putting. The separation of queries into multiple stateme…

What if you dropped the whole `OPERATE SET x = y` syntax, and instead used traditional SELECT syntax, with column names as the attribute name to change. Editing your simple examples:

    # turn all red pixels green
    # omitting column name assumes COLOR
    pixql -i in.bmp -o out.bmp -q "SELECT #00FF00FF WHERE COLOR = #FF0000FF;"
    
    # copy red channel into green channel
    pixql -i in.bmp -o out.bmp -q "SELECT R AS G;"
    
    # add white 1px 100x100 grid
    pixql -i in.bmp -o out.bmp -q "SELECT WHITE AS COLOR WHERE ROW % 100 = 0 OR COL % 100 = 0;"
Edit: Combining this with a "FROM" syntax on your last example:

    SELECT 255-R AS R, 255-G AS G, 255-B AS B
    FROM (SELECT WHITE WHERE ROW % 20

Re: PixQL: SQL for image processing

#29

Post by infogulch »

phildo3 wrote: post #22
kbenson wrote: post #6

If you are going to use SQL select, why use a separate operate statement when you could just use SQL's method for this, update? For that matter, if you are going to use SQL syntax, I would imagine you would want to keep one of the main features, which is joining of datasets. Being able to join an image with itself in some manner (or another image...), would be really useful. Instead of globals, use the images as tabl…

Author here- My reason for deviating slightly from traditional SQL syntax is that I don't find it to be super intuitive. Yes, "UPDATE color SET r = 255 WHERE col = 100" is a pretty straightforward looking thing for those of us familiar with SQL, but simple things like the fact that you set the value before deciding what you're setting the value of are a bit off putting. The separation of queries into multiple stateme…

"Curious what you'd expect the result of a join to be?"

When you join two tables in SQL, you typically include an ON expression specifying how you want to relate the tables to each other. Or, put another way, how you want the tables to be aligned.

Extending this to PixQL, the ON clause of a JOIN tells the engine how to align two different images, perhaps by offsets in the x,y directions. You could even extend further to LEFT,RIGHT,OUTER,INNER joins where it crops one image to the boundary of the other depending on the join type.

Assuming a more fleshed out FROM syntax (see my other comment) with alias support, you could select the same image multiple times but at different offsets to facilitate a blur.

Re: PixQL: SQL for image processing

#30

Post by curiously »

brobdingnagian wrote: post #13
no_gravity wrote: post #12

Wouldn't it be easier to use JavaScript? PixQL: SELECT WHERE COLOR = #FF0000FF; OPERATE SET COLOR = #00FF00FF JS : if (rgba=='FF0000FF') rgba='00ff00ff' PixQL: OPERATE SET G = R JS : g=r PixQL: SELECT WHERE ROW % 100 = 0 OR COL % 100 = 0; OPERATE SET COLOR = WHITE JS : if (!(row%100) || !(col%100)) rgba="ffffffff"

No I'm pretty sure it would be easier (aka shorter) using 7zipped brainfuck.

I don't see how that's any easier.
Post reply on HN