ELSEIF
Your brief EB
403 stories from 200 feeds 1256 clusters Refreshed 6 minutes ago next pull 10:14

TOPIC

Databases

Storage engines, query planners, and the pipelines that move data between them. Benchmarks with methodology, migrations with real numbers, and the failure modes worth designing around before you meet them.

5TODAY
8FEEDS
7mMEDIAN
FEEDS Techmeme 147 Hacker News 82 ClickHouse 44 Lobsters 32 PostgreSQL 19 www.theregister.com - Articles 19 Engadget 18 Tomshardware 16

DATABASES

Everything in Databases.

Signal Newest Shortest read
01 409 new

Databases Farid Zakaria’s Blog

Prototype replaces ELF executable format with SQLite database for direct execution

Why it matters — ELF is a de-facto database that reinvents indexing, string interning and schema management. Replacing it with SQLite could eliminate redundant parsers and enable declarative analysis of binaries. The prototype demonstrates feasibility but adoption would require toolchain and kernel changes

4 feeds
13 min
02 373 new

Databases Tailscale

How we tracked down a 16-year-old SQLite bug

Why it matters — SQLite is widely trusted for its stability, but this bug reveals that even mature, single-writer deployments can encounter rare but severe corruption. For engineers running SQLite at scale, the incident underscores the need for robust integrity checks and recovery pipelines. The fix also demonstrates how persistent forensic analysis can resolve elusive, low-level issues.

4 feeds
14 min
04 322 new

Databases letsencrypt.org

Let’s Encrypt builds new data warehouse using ClickHouse for improved analytics

Why it matters — Let’s Encrypt has transitioned to using ClickHouse for their data warehouse, significantly improving their ability to analyze certificate issuance data. This change addresses previous inefficiencies in data processing and provides a scalable solution for future growth. The move highlights the importance of selecting the right database technology to meet both current and future analytical needs.

1 feed
6 min
05 318 -3

Databases Blog — PlanetScale

Introducing TIN: full-text search for Postgres

Why it matters — TIN enhances Postgres with a robust full-text search capability that meets various application needs. This extension allows for complex queries and real-time updates, which can significantly improve application performance and user experience.

2 feeds
15 min
06 318 new

Databases The Consensus (Paywall)

Cassandra 6 reportedly adds strictly serializable cross-partition ACID transactions with Accord

Why it matters — For engineers building distributed applications, this change could reduce complexity by allowing multi-partition transactions without sacrificing Cassandra’s scalability. However, adoption may require schema redesign and performance tuning, as Accord’s strict serializability imposes coordination overhead.

3 feeds
3 min
07 317 -5

Databases ClickHouse

The official ClickHouse provider for Apache Airflow is now available

Why it matters — This integration allows teams using ClickHouse to orchestrate data workflows within Apache Airflow more seamlessly. By using standard SQL operators, it reduces the complexity of connecting the two systems and helps maintain compatibility with future ClickHouse updates.

1 feed
6 min
08 312 new

Databases Cloudflare

Announcing Cloudflare Wallets: The programmable wallet for the agentic Internet

Why it matters — The solution removes the manual steps agents currently face when trying new APIs, allowing them to explore services autonomously. By pairing verifiable handles with programmable spending limits, it reduces friction while keeping financial risk under human control. This creates the foundation for a two-sided agentic market where providers can sell resources headlessly and agents can consume them without constant oversight.

2 feeds
7 min
09 308 new

Databases DuckDB

A Preview of DuckDB v2.0

Why it matters — The server mode lets DuckDB run as a networked service, enabling multi-tenant and long-running deployments that were previously limited to in-process use. VARIANT becoming first-class simplifies handling of evolving semi-structured data without manual schema definition, which is valuable for real-time log ingestion. The async I/O, new parser and storage format introduce performance and compatibility changes that developers will need to evaluate when upgrading.

3 feeds
14 min
11 294 -4

Databases ClickHouse

Postgres week in the Netherlands: PGDay Lowlands & Percona Live 2026

Why it matters — PGDay Lowlands and Percona Live are significant gatherings for PostgreSQL enthusiasts and professionals. They provide an opportunity for engineers to learn about the latest developments and best practices in PostgreSQL and related technologies, such as ClickHouse integrations.

1 feed
8 min
12 279 new

Databases The Consensus (Paywall)

SQLite WAL-Reset bug let checkpoints discard committed frames for sixteen years

Why it matters — This is a data integrity bug in SQLite's WAL mechanism that has existed for sixteen years, meaning any SQLite database using WAL mode could have silently lost committed writes or become corrupted. The fact that it reproduces within seconds using only the public API makes it a practical concern for anyone relying on SQLite for durable storage.

2 feeds
3 min
13 269 new

Databases DuckDB

DuckDB v2.0: Your Database Deserves a Better Parser

Why it matters — The parser is a foundational component of any database system, dictating how SQL queries are validated and structured. A more maintainable and extensible parser reduces friction for future DuckDB enhancements, particularly as its SQL dialect diverges further from PostgreSQL. This change is transparent to users but critical for developers working on DuckDB internals or custom extensions.

2 feeds
14 min
14 267 new

Databases Farid Zakaria’s Blog

nixpkgs-multiverse explores three ways to query SQLite from inside Nix evaluation

Why it matters — Nix has no builtins.sqlite, and its JSON parsing is eager, meaning a 5.3 MB index file is fully parsed and materialized on the Nix heap for every lookup. For projects like nixpkgs-multiverse that index 305,492 package versions, this makes JSON impractical as the index grows. The post outlines escape hatches that trade safety or ergonomics for query efficiency.

2 feeds
11 min
16 257 new

Databases ClickHouse

What's new in pg_clickhouse v0.10.0: Subqueries, TPC-H Speedups, C Driver, and Aggregates

Why it matters — Engineers using PostgreSQL-to-ClickHouse federation can now run more analytical queries entirely inside ClickHouse, cutting latency by orders of magnitude for workloads that previously required row-by-row evaluation. The updated C driver reduces maintenance overhead and fixes concurrency bugs that could cause intermittent failures under load. Knowing the remaining unsupported TPC-H shapes helps teams plan further query rewrites or await future pg_clickhouse enhancements.

2 feeds
11 min
17 252 new

Databases ducklabs.com

AWS acquires DuckLabs, DuckDB and related projects to remain open source under MIT license

Why it matters — DuckDB’s adoption has grown rapidly due to its lightweight, high-performance analytical capabilities, often used for embedded analytics and data processing. AWS’s acquisition provides DuckLabs with resources to scale development and infrastructure while maintaining open-source governance. Engineers using DuckDB can expect continued support and potential deeper integration with AWS services, but long-term independence of the project may shift under AWS ownership.

2 feeds
8 min
20 252 new

Databases antithesis.com

Breaking the WAL

Why it matters — This demonstrates how automated, deterministic testing can rapidly uncover rare concurrency bugs that evade traditional testing. For engineers maintaining critical systems, it highlights the potential to reduce months of debugging to minutes of automated analysis. The event also underscores the difficulty of reproducing timing-sensitive database bugs in production environments

2 feeds
4 min
21 252 new

Databases prela-lang.org

UCLA RePL's Prela tutorial demonstrates a query language based on binary relations in 11 lines of Python

Why it matters — For engineers who model relational data, the tutorial offers a different abstraction: every wide table is decomposed into two-column relations that compose like functions, with foreign-key resolution handled implicitly. The cost is visible in the prototype, more relations to keep track of, tuple-nested results from `&`, and no query planner or persistence layer. The article is a principles tutorial rather than a production release, so any claim that Prela is "better" than SQL rests on the one line-count comparison it shows.

2 feeds
6 min
22 252 new

Databases Farid Zakaria’s Blog

Executables stored as SQLite databases enable queryable state and code in single files

Why it matters — This approach collapses binary tooling and application state into SQL, eliminating the need for separate filesystems like /var or /tmp. For engineers, it introduces a novel way to manage program state and configuration, but may complicate debugging and security auditing due to mutable executables. The trade-off between simplicity and operational risks will determine adoption

2 feeds
8 min
23 249 new

Databases Blog — PlanetScale

Concurrency vs. Throughput: why more parallelism can make databases slower

Why it matters — Engineers must recognize that locking is not the only source of contention; version chain traversal can turn read-only work into a scalability bottleneck. Understanding the difference between queuing thread pools and fail-fast transaction pools helps prevent a slowdown from cascading into widespread errors. Proper concurrency limits and backpressure mechanisms are essential to keep the database stable under load.

2 feeds
8 min
24 247 new

Databases Blog — PlanetScale

118 million queries per second on Neki

Why it matters — Independent Databases feeds picked this up separately, which is the signal elseif ranks on. Open the cluster below to compare how each feed framed it.

2 feeds
2 min
25 247 new

Databases The Verge

Walmart begins nationwide Tap to Pay rollout for Apple Pay and Google Pay by end of the year

Why it matters — Engineers will need to enable Tap to Pay functionality on Walmart’s payment systems while keeping existing Walmart Pay and Scan-and-Go options operational. The phased rollout means payment software must support both new and legacy methods during the transition, increasing testing and maintenance effort. Engineers should also plan for the later deployment at fuel stations, which will not see Tap to Pay until the middle of 2027.

4 feeds
3 min
26 245 new

Databases Blog — PlanetScale

Sharded Postgres query traverses router, four shards, and distributed planner to return unified result

Why it matters — Engineers scaling Postgres must understand how sharding transforms a simple query into a distributed operation. The router’s complexity is hidden from applications, but its failure modes and performance costs are not. This lifecycle reveals where latency, consistency, and availability trade-offs emerge in production.

2 feeds
25 min
27 240 -3

Databases LWN.net

[$] LWN.net Weekly Edition for September 17, 2026

Why it matters — The discussion on server-data encryption is critical for ensuring data security in database management. Updates on PostgreSQL patches indicate ongoing improvements and potential vulnerabilities that engineers need to address. Additionally, faster kernel builds can enhance performance and efficiency in software development processes.

1 feed
4 min
28 239 new

Databases Blog — PlanetScale

Leaked session state in PgBouncer transaction mode poisons Postgres connection pools with read-only errors

Why it matters — This issue is difficult to diagnose because the database itself is healthy, but reused connections retain stale state from previous clients. Running DISCARD ALL on pooled connections clears the poisoned state, but the application code leaking the session settings must be fixed to prevent recurrence.

2 feeds
5 min
30 221 new

Databases Techmeme

Stripe reportedly acquires AI model router OpenRouter for over $7B to integrate inference billing

Why it matters — This acquisition signals Stripe’s push into AI infrastructure, treating model inference as a payments problem. For engineers, it suggests tighter integration between AI workloads and billing systems, potentially reducing friction in multi-model deployments. The valuation jump from $1.3B to $7B in months underscores the perceived strategic value of AI routing layers.

2 feeds
33 min
34 217 -4

Databases Techmeme

EU proposes Kids Act requiring age verification tools on social networks to prevent under-15s from opening accounts

Why it matters — The Kids Act aims to enhance online safety for children by implementing strict age verification measures on social networks. This could significantly impact how social media platforms design their user registration processes and privacy policies. Compliance will require substantial updates to existing systems, affecting operational costs and user engagement strategies.

1 feed
71 min
35 214 new

Databases Simon Willison

SQLite compressed text-history prototypes

Why it matters — The technique reduces the disk footprint of versioned documents from megabytes to a few kilobytes, which can lower hosting costs and improve backup times. It also offers a relational-database-native way to keep revision history without adding a separate service, but it introduces recompression work and limits random access to individual revisions.

1 feed
4 min
39 205 new

Databases PostgreSQL

New Modern JDBC Driver for PostgreSQL

Why it matters — This driver gives Java engineers working with PostgreSQL a native API that exposes the database's full feature set directly, rather than filtering everything through JDBC's cross-database abstraction. The virtual-thread architecture on Java 21 eliminates the traditional tradeoff between async APIs and thread-per-connection models, making the driver both performant and straightforward to reason about.

1 feed
2 min
40 205 new

Databases PostgreSQL

PostgreSQL 18.6, 17.11, 16.15, 15.19, 14.24 and 19 Beta 3 Released!

Why it matters — Multiple CVEs rated CVSS 8.8 enable arbitrary code execution through heap buffer overflows in regexp, to_char, plperl, pg_stat_statements, pg_dump, and type confusion paths. Operators on any supported PostgreSQL version should upgrade immediately, and those on PostgreSQL 14 must plan a migration before its November 12, 2026 end-of-life.

1 feed
10 min
41 205 new

Databases PostgreSQL

PostgreSQL Anonymizer 3.2 : Faster Pseudonymization

Why it matters — Engineers handling PII in PostgreSQL databases now have faster, more flexible pseudonymization tools, but must migrate to new functions and address critical security fixes. The upgrade also enforces stricter privilege controls, requiring role adjustments for superuser-dependent masking workflows.

1 feed
4 min
42 205 new

Databases PostgreSQL

PostgreSQL Migrator 1.0 : first stable release

Why it matters — Migrating from Oracle or MySQL to PostgreSQL is complex and risky. PostgreSQL Migrator 1.0 offers a free, open-source path with offline catalog inspection and automated conversion, potentially reducing migration effort. Its support for a wide range of source versions and PostgreSQL targets makes it a practical option for many teams.

1 feed
2 min
44 205 new

Databases PostgreSQL

Loongson loong64 packages on apt.postgresql.org

Why it matters — Engineers running PostgreSQL on Loongson hardware can now install prebuilt packages from apt.postgresql.org instead of building from source. The GIS stack packages (postgis, pgrouting, mobilitydb, pgsql-ogr-fdw) are not yet available, pending the next postgis release.

1 feed
1 min
45 205 -1

Databases LWN.net

PostgreSQL 19 release quality questioned over late-breaking feature concerns

Why it matters — If quality issues persist into the release, teams relying on PostgreSQL's predictable annual cadence may face a choice between adopting a potentially unstable major version or delaying upgrades. The concerns also highlight tension between the project's release schedule and its feature-readiness.

1 feed
2 min
46 205 new

Databases PostgreSQL

pg_statviz 1.2 released with PostgreSQL 19 support and new features

Why it matters — Engineers gain visibility into new WAL I/O metrics and lock contention without installing external agents, as the extension runs inside the database. The optional AI provider lets teams automate severity assessments while keeping the core tool dependency-free.

1 feed
3 min
47 205 new

Databases PostgreSQL

LibreDB Studio: an open source, self-hosted SQL IDE for PostgreSQL in the browser

Why it matters — It removes the need to install an IDE on each developer machine by providing a centralized, browser-accessible tool. Deployment alongside the database ensures low-latency connections and uses pooled connections with explicit transaction control. Role-based access control and optional query assistant are tied to the database schema, limiting actions to what the connected role can see.

1 feed
2 min
48 205 new

Databases PostgreSQL

plx transpiles Ruby, PHP, and other dialects to plpgsql at CREATE FUNCTION time

Why it matters — For engineers who want to move logic into PostgreSQL without learning plpgsql, plx offers a familiar syntax while keeping plpgsql's performance and trusted-language safety. Because the generated plpgsql is stored in pg_proc.prosrc, it is inspectable and pg_dumpable, and no separate language runtime is loaded into the backend. The translation cost is paid once at creation time, not per call.

1 feed
3 min
51 204 new

Databases Simon Willison

sqlite-utils 4.2.1 fixes crash caused by missing typing-extensions dependency

Why it matters — A missing dependency in sqlite-utils 4.2 caused the tool to crash when installed directly via uvx without dev dependencies. This patch ensures the CLI remains functional in minimal environments, reducing friction for users who rely on isolated installations. The fix also introduces a smoke test to catch similar issues early.

1 feed
2 min
52 204 new

Databases Simon Willison

github-to-sqlite 2.9.1 fixes compatibility with sqlite-utils 4.x

Why it matters — Engineers using github-to-sqlite to archive GitHub data locally may have encountered failures after upgrading sqlite-utils. This update restores compatibility without requiring changes to existing workflows. If you rely on this tool, upgrading is a low-risk fix for a specific dependency conflict.

1 feed
1 min
53 200 -2

Databases rohanbansal.com

Training a 4B model reportedly produces 81% faster query plans than Postgres

Why it matters — This development suggests significant improvements in database query optimization. Faster query plans can enhance application performance, especially in data-intensive environments. The use of advanced models like this may redefine how databases are optimized in the future.

1 feed
63 min
54 198 -1

Databases PostgreSQL

pgAssistant 3.8.0 : continuous improvement loop for Postgres

Why it matters — This update shifts pgAssistant's focus from merely analyzing PostgreSQL to facilitating ongoing improvements. By implementing a structured loop, it aids teams in measuring and prioritizing enhancements, ultimately leading to better database performance.

1 feed
2 min
55 194 new

Databases Simon Willison

alchemy-utils 0.1a0

Why it matters — This brings the sqlite-utils command-line workflow, insert, upsert, create, update, and table introspection, to databases beyond SQLite. It is an early alpha built as a prototype with coding agents, so production use carries that caveat.

1 feed
3 min
56 189 -3

Databases ClickHouse

ClickHouse is now available on the dbt platform

Why it matters — The integration of ClickHouse with dbt allows for real-time analytics and effective data modeling. This is particularly valuable for teams needing sub-second query performance and immediate data availability. The collaboration enhances the capabilities of both tools for data engineers and analysts.

1 feed
9 min
57 187 new

Databases ClickHouse

WalShadow: Sub-second Postgres replication to ClickHouse from physical WAL

Why it matters — WalShadow introduces a new approach to data replication that minimizes latency and resource consumption. By leveraging the physical Write-Ahead Log (WAL), it supports complex schema changes while maintaining high performance. This can significantly improve the efficiency of analytics workflows for organizations using both Postgres and ClickHouse.

1 feed
5 min
58 185 new

Databases PostgreSQL

SynchDB 1.4 adds Oracle CDB/PDB replication across all paths and TLS-secured FDW snapshots

Why it matters — Engineers replicating from Oracle CDB/PDB deployments can now use all three Oracle replication paths without workarounds. Snapshot connections to MySQL, PostgreSQL, and Oracle sources can finally be encrypted, closing a gap that previously left initial data extraction unsecured. Runtime log-level adjustment and stability fixes under sustained load reduce operational friction for teams running continuous replication.

1 feed
3 min
59 183 -2

Databases Techmeme

Zuckerberg, Huang, and Musk reportedly stall AI regulatory plan proposed by Hassabis

Why it matters — The stalling of this AI regulatory plan could impact future governance and safety measures in AI development. It reflects the ongoing influence of tech leaders in shaping policies that affect the industry. Engineers should be aware of how regulatory environments can change, potentially affecting project timelines and compliance requirements.

1 feed
91 min
60 182 -5

Databases Rock Paper Shotgun Latest Articles Feed

The Blood of Dawnwalker's sequel might drop timer mechanics, says director

Why it matters — The potential removal of timer mechanics could significantly alter gameplay dynamics and player experience. The director's openness to modifying or removing this feature reflects a commitment to narrative coherence and player satisfaction. This decision may influence how players approach the game and their engagement with its story elements.

1 feed
3 min