Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Sqinn-Go is a Golang library for accessing SQLite databases in pure Go

github.com

Post reply on HN
Print view View original

61–66 of 66 posts

Re: Show HN: Sqinn-Go is a Golang library for accessing SQLite databases in pure Go

#61

Post by cvilsmeier »

ComputerGuru wrote: post #35
parhamn wrote: post #12

Earlier quoted context omitted.

Well its a different access pattern. As the underlying library points out: > It is used in programming environments that do not allow calling C API functions. Also I guess which one is easier will be subjective. The steps are sorta similar: Step 1) install sqlite or squinn on the base system (the latter might be harder) Step 2) if sqllite use cgo, if squinn just use go (the former might be harder but more performant)

Which programming environments that do not allow calling C API functions also let you build/ship arbitrary C executables, though? (Genuinely curious what scenarios this unlocks.)

I use it for SQLite Database access in Go and Java. Java lets you theoretically interface with C code, but it's a lot of JNI/DLL/SO work. It's much easier for me to just os/exec (or Runtime/exec in Java) and send data back and forth. Your mileage may vary, of course.

Re: Show HN: Sqinn-Go is a Golang library for accessing SQLite databases in pure Go

#62

Post by hnlmorg »

hnlmorg wrote: post #60
ncruces wrote: post #56

Earlier quoted context omitted.

Can you say more, like name your project? I'm building https://github.com/ncruces/go-sqlite3 and am a community maintainer of https://wazero.io I can cross compile SQLite into all platforms that Go OOB compiles too, with the caveat that any that aren't linux/windows/darwin/freebsd/illumos (CPU architecture doesn't matter) need a build flag because of file locking: https://github.com/ncruces/go-sqlite3/blob/main/vfs/R…

Sorry, just seen this. It is https://murex.rocks sqlite3 only needs to run from one thread in my use case. Which might explain why I have fewer problems than most.

Just reread your comment and realised I was confusing your library with mattm’s library of the same name.

Re: Show HN: Sqinn-Go is a Golang library for accessing SQLite databases in pure Go

#63

Post by ncruces »

hnlmorg wrote: post #62
hnlmorg wrote: post #60

Earlier quoted context omitted.

Sorry, just seen this. It is https://murex.rocks sqlite3 only needs to run from one thread in my use case. Which might explain why I have fewer problems than most.

Just reread your comment and realised I was confusing your library with mattm’s library of the same name.

Interesting project, thanks for getting back!

My SQLite bindings should build/work fine for all your supported platforms, with the caveat that BSDs other than FreeBSD need a build tag, because my locking protocol is not compatible with SQLite's default (if you access your database concurrently with my wrapper and other SQLite processes, you may corrupt data).

Solaris and Plan9 don't have working file locking, so you can't use concurrency at all. This could be change if there was interest in it.

Re: Show HN: Sqinn-Go is a Golang library for accessing SQLite databases in pure Go

#64

Post by hnlmorg »

ncruces wrote: post #63
hnlmorg wrote: post #62

Earlier quoted context omitted.

Just reread your comment and realised I was confusing your library with mattm’s library of the same name.

Interesting project, thanks for getting back! My SQLite bindings should build/work fine for all your supported platforms, with the caveat that BSDs other than FreeBSD need a build tag, because my locking protocol is not compatible with SQLite's default (if you access your database concurrently with my wrapper and other SQLite processes, you may corrupt data). Solaris and Plan9 don't have working file locking, so you…

Here lies the problem. I now need to instruct users that different build flags are required for different platforms. Whereas that problem doesn’t exist with the cgo bindings.

Plus I also have the additional risk that I’m using someone’s hobby project that, and I say this with the greatest of respect for yourself, might get abandoned tomorrow for all I know.

Cgo might have its issues but for sqlite3 it offers far better assurances than anything else available for Go at this point in time.

Given that sqlite3 is a supporting library rather than the differentiator of my project, I want to spend as little time as I have to supporting it. At this point in time, only the cgo library seems to offer that convenience (though if anyone else wants to maintain a fork of my project using a different sqlite library then I’m more than happy with that).

Good luck with your project though. Hopefully the Go community can rally around one of these native solutions so it gains enough traction to become the new de facto standard.

Re: Show HN: Sqinn-Go is a Golang library for accessing SQLite databases in pure Go

#65

Post by ncruces »

hnlmorg wrote: post #64
ncruces wrote: post #63

Earlier quoted context omitted.

Interesting project, thanks for getting back! My SQLite bindings should build/work fine for all your supported platforms, with the caveat that BSDs other than FreeBSD need a build tag, because my locking protocol is not compatible with SQLite's default (if you access your database concurrently with my wrapper and other SQLite processes, you may corrupt data). Solaris and Plan9 don't have working file locking, so you…

Here lies the problem. I now need to instruct users that different build flags are required for different platforms. Whereas that problem doesn’t exist with the cgo bindings. Plus I also have the additional risk that I’m using someone’s hobby project that, and I say this with the greatest of respect for yourself, might get abandoned tomorrow for all I know. Cgo might have its issues but for sqlite3 it offers far bett…

Thanks for the feedback! I get it.

I could easily build on all platforms without tags… I just want to avoid accidental data corruption if users unwittingly access databases without proper synchronization.

The MVCC-WAL-VFS I'm designing now may potentially fix this, as the brokenness of POSIX advisory locks is more manageable there.

https://www.sqlite.org/src/artifact/2e8b12?ln=1073-1161

Re: Show HN: Sqinn-Go is a Golang library for accessing SQLite databases in pure Go

#66

Post by hnlmorg »

ncruces wrote: post #65
hnlmorg wrote: post #64

Earlier quoted context omitted.

Here lies the problem. I now need to instruct users that different build flags are required for different platforms. Whereas that problem doesn’t exist with the cgo bindings. Plus I also have the additional risk that I’m using someone’s hobby project that, and I say this with the greatest of respect for yourself, might get abandoned tomorrow for all I know. Cgo might have its issues but for sqlite3 it offers far bett…

Thanks for the feedback! I get it. I could easily build on all platforms without tags… I just want to avoid accidental data corruption if users unwittingly access databases without proper synchronization. The MVCC-WAL-VFS I'm designing now may potentially fix this, as the brokenness of POSIX advisory locks is more manageable there. https://www.sqlite.org/src/artifact/2e8b12?ln=1073-1161

I'll definitely keep an eye on this project. And likewise, if you feel you reach a new stable milestone that addresses my concerns, do feel free to raise an issue on my projects Github page for me to switch away from cgo :)
Post reply on HN