SQLite
-
Using WAL mode in SQLite and its interaction with VACUUM
blog.pecar.me SQLite Write-Ahead LoggingSpeed up your SQLite writes and reads with this crazy trick. 🤪
via https://fosstodon.org/@anze3db/111347782255927112
-
A few nice new features in this release. Allowing ORDER BY aggregate functions could be very useful.
-
Batch size one billion: SQLite insert speedups, from the useful to the absurd
Interesting post on how to speed up batch inserts with SQLite.
-
Short post about how SQLite sometimes creates indexes just for a single query. The SQLite documentation has a little more information.
It can be worth setting up and monitoring the error log for SQLITE_WARNING_AUTOINDEX warnings as good indication a persistent index should be created.
- corecursive.com The Untold Story of SQLite - CoRecursive Podcast
On today's show, I'm talking to Richard Hipp about surviving becoming core infrastructure for the world. SQLite is everywhere. It's in your web browser, it's in your phone, it's probably in your car, and it's definitely in commercial planes. It's where your iMessages and WhatsApp messages are stored...
Interview with Richard Hipp about the history of SQLite.
-
SQLite 3.43.0 released
The main changes look to be contentless-delete FTS5 tables and performance enhancements to the query planner and JSON functions.
-
sqlite-utils - CLI tool and Python library for manipulating SQLite databases
From the homepage:
> This library and command-line utility helps create SQLite databases from an existing collection of data. > > Most of the functionality is available as either a Python API or through the sqlite-utils command-line tool. > > sqlite-utils is not intended to be a full ORM: the focus is utility helpers to make creating the initial database and populating it with data as productive as possible. > > It is designed as a useful complement to Datasette. > > Cleaning data with sqlite-utils and Datasette provides a tutorial introduction (and accompanying ten minute video) about using this tool.
-
Handy utility to diff SQLite databases.
- turriate.com Making SQLite faster in Go
Make sqlite faster with a connection pool and prepared statements.
The author managed to reach 56,600 req/s!
While written about Go, not all the techniques used are Go specific.
- fly.io How SQLite Scales Read Concurrency
Understanding how the write-ahead log turns your scaling up to 11.
Explains how using WAL allows writes without blocking reads.
-
FerretDB - MongoDB protocol for SQLite or PostgreSQL
github.com GitHub - FerretDB/FerretDB: A truly Open Source MongoDB alternativeA truly Open Source MongoDB alternative. Contribute to FerretDB/FerretDB development by creating an account on GitHub.
Converts MongoDB protocol to SQL using SQLite or PostgreSQL as the database engine.
Could be useful if wanting to migrate off MongoDB.
-
High level overview of how SQLite rollback journal works.
-
sqlpkg - The (unofficial) SQLite package registry.
Registry of SQLite extensions along with a package manager to install them.
-
Interesting brief overview of SQLite internals.
- github.com GitHub - nalgeon/sqlean: The ultimate set of SQLite extensions
The ultimate set of SQLite extensions. Contribute to nalgeon/sqlean development by creating an account on GitHub.
A useful collection of extensions for SQLite
-
SQLite experimental high-concurrency backend HC-tree
While not ready for production, it looks really promising.
There’s some tests showing > 1 million write transactions per second in some cases.
-
Why sqlite3 temp files were renamed 'etilqs_*' (2006)
github.com sqlite/src/os.h at 18cf47156abe94255ae1495ba2da84517dce6081 · mackyle/sqliteUnofficial git mirror of SQLite sources (see link for build instructions) - sqlite/src/os.h at 18cf47156abe94255ae1495ba2da84517dce6081 · mackyle/sqlite
Saw this on Hacker News, seemed interesting.
-
SQLite 3.42.0
Adds the ability for JSON functions to read JSON5 which could be handy.