gem-hunter

Keep It Simple Stupid, just use postgres. epostgres.com

The goal of this repository is to demonstrate how to use Postgres for Everything.

It's inspired by this article from the Amazing CTO as well as this GitHub gist from @cpursley.

It seems like every week I hear of a new tool on top of Postgres or another way it can being used, so I wanted a place where I can keep track of everything. If you have other examples, submit a PR.

If you have a specific code snippet, tool or project that you'll like to showcase as an example, put up a PR with a link! Make sure to use the new pull request template.

• Blog Posts & Articles
• Cron Jobs
• Embeddable Postgres
• Message Queues
• Analytics
• GIS & Mapping
• Audit Logs
• Access Control & Authorization
• Search
  • Full Text
  • Vector
  • Hybrid
• Time Series
• Column Oriented
• NoSQL
• Graph Data
• Foreign Data
• HTTP
• API Platforms
• GraphQL and Alternative Query Languages
• Events, Replication, CDC
• Caching
• Unit Tests
• HTML & Applications
• Migrations
• Performance Tuning
• Monitoring
• Testing
• Scaling & Storage
• User Interfaces & Dashboards
• CLIs
• Visualization
  • Graphics Visualization
  • Data Visualization
• Package Management
• Language Servers
• Data Privacy & Security (or Data Masking)
• Financial Ledgers
• Miscellaneous

• You can make Postgres scale
• Life Altering Postgresql Patterns
• Simplify: move code into database functions
• Just Use Postgres for Everything
• PostgreSQL is the worlds' best database
• Postgres is eating the database world
• Hacker News discussion
• Choose Postgres queue technology (2023-09-24)
• Jepsen Test on Patroni: A PostgreSQL High Availability Solution (2024-12-02)
• PostgreSQL Full-Text Search: Fast When Done Right (Debunking the Slow Myth)
• Hacking the PostgreSQL Wire Protocol
• Collection of PostgreSQL articles on optimizations, unknown features, data analysis and more

• citusdata/pg_cron
• cybertec-postgresql/pg_timetable

• PGLite: WASM Postgres build packaged into a TypeScript library (< 10MB) that can run in the browser, Node.js, Bun and Deno. It's lightweight, reactive and sync live.
• pgmicro: An in-process reimplementation of PostgreSQL, backed by a SQLite-compatible storage engine.

• tembo-io/pgmq
• SKIP LOCKED
• riverqueue/river
• sequinstream/sequin: Sequin is a tool for change data capture (CDC) in Postgres. Sequin makes it easy to stream Postgres rows and changes to streaming platforms and queues (e.g. Kafka and SQS). You can backfill existing rows and stream new changes in real-time.
• janbjorge/pgqueuer: PgQueuer is a Python library leveraging PostgreSQL for efficient job queuing.
• timgit/pg-boss: pg-boss is a job queue built in Node.js
• smartpricing/queen: PostgreSQL-backed message queue with unlimited independent FIFO partitions, Kafka-style consumer groups, and exactly-once delivery. Also available as a native PostgreSQL extension.
• NikolayS/pgque: Zero-bloat Postgres queue. One SQL file to install, pg_cron to tick.

• paradedb/pg_analytics: DuckDB-powered data lake analytics from Postgres
• duckdb/pg_duckdb: Official Postgres extension for DuckDB
• BemiHQ/BemiDB: Postgres read replica optimized for analytics
• Mooncake-Labs/pg_mooncake: Postgres extension that adds columnar storage and vectorized execution (DuckDB) for fast analytics within Postgres
• ClickHouse/pg_clickhouse: Analytics queries on ClickHouse right from PostgreSQL without rewriting any SQL.

• postgis/postgis

• arkhipov/temporal_tables
• supabase/supa_audit
• pgMemento/pgMemento
• pgaudit/pgaudit
• BemiHQ/Bemi: Automatic data change tracking for PostgreSQL

• arkhipov/acl
• https://www.postgresql.org/docs/current/pgcrypto.html
• michelp/pgjwt
• supabase.com/docs/guides/database/vault

• Postgres Full Text Search (bunch of helpful links)
• pg_search: Full text search for Postgres using BM25
• Postgres Full Text Search vs the rest
• plpgsql_bm25: BM25 search implemented in PL/pgSQL

• pgvector/pgvector
• tensorchord/VectorChord: PostgreSQL extension designed for scalable, high-performance, and disk-efficient vector similarity search. It serves as the successor to the pgvecto.rs project.
• timescale/pgai: PostgreSQL extension to allow RAG, semantic search and other AI application development from within postgres. Based on pgvector.
• timescale/pgvectorscale: DiskANN vector index implementation complementary to pgvector.

• plpgsql_bm25rrf.sql: Hybrid search (BM25+pgvector) with Reciprocal Rank Fusion implemented in PL/pgSQL

• timescale/timescaledb: TimescaleDB is PostgreSQL++ for time series and events.
• tembo-io/pg_timeseries: Open-source time-series extension for PostgreSQL

• paradedb/paradedb: Postgres for Search and Analytics
• hydradatabase/hydra
• citusdata/cstore_fdw
• pg_duckdb: DuckDB column storage inside Postgres

• JSON Types: Native support for JSON support in PostgreSQL
• robconery/dox
• https://www.ferretdb.com
• Using JSONB in PostgreSQL®: How to Effectively Store & Index JSON Data in PostgreSQL

• Apache Age: Graph Database for PostgreSQL to provide graph data processing and analytics capability to all relational databases.

• supabase/wrappers

• pramsey/pgsql-http
• supabase/pg_net

• PostgREST: RESTful API from any existing PostgreSQL database
• Hasura GraphQL Engine: Metadata-driven API platform

• PostGraphile: Extensible high-performance automatic GraphQL API for PostgresSQL
• supabase/pg_graphql: PostgreSQL extension that enables querying the database with GraphQL using a single SQL function
• dosco/graphjin: GraphJin automatically converts GraphQL into SQL queries
• kaspermarstal/plprql: PostgreSQL extension to write functions using PRQL (Pipelined Relational Query Language)

• aws/pgactive: Replication extension for creating an active-active database by AWS.
• xataio/pgstream: CDC command-line tool and library that offers Postgres replication support with DDL changes to any provided output.
• electric-sql/electric: HTTP API that enables synching Shapes (i.e. segments) of a Postgres database. It's like GraphQL for Postgres databases.
• The Notifier Pattern for Applications That Use Postgres
• SQL Notify
• cpursley/walex (Disclosure: I maintain this and think it's pretty awesome)
• PeerDB-io/peerdb
• debezium/debezium
• 2ndQuadrant/pglogical

• tidwall/pogocache: caching layer with a focus on latency and CPU efficiency.
• https://martinheinz.dev/blog/105
• readysettech/readyset

• theory/pgtap
• peterldowns/pgtestdb

• SQLpage
• Omnigres
• pg_render
• plmustache

• purcell/postgresql-migrations
• www.bytebase.com/
• xataio/pgroll
• stripe/pg-schema-diff
• pgschema/pgschema: CLI tool that brings terraform-style declarative schema migration workflow to Postgres.

• Supabase Index Advisor
• Dexter
• HypoPG
• pg_hint_plan
• PGHero
• pg_incremental: Extension to do fast, reliable, incremental batch processing.
• pgassistant: PostgreSQL assistant for developers designed to help understand and optimize PostgreSQL database performance

• StatsMgr: Efficient and organized management of statistics across WAL, SLRU, checkpointing, & more. Currently supports dynamic initialization, shared memory utilization, and SQL interfaces.
• pgMonitor: A monitoring solution that visualizes metrics using Prometheus, Grafana, SQL Exporter, and the pgMonitor extension.

• regresql: A tool implement a regression testing facility for SQL queries with support for the PostgreSQL database system.

• Snowflake-Labs/pg_lake: Enables leveraging Postgres as a standalone lakehouse system. It supports transactions and queries on Iceberg tables, enabling it to directly work with raw data files in object stores like S3.
• supabase/supavisor
• pg-sharding/spqr
• pgdogdev/pgdog: PgDog is a transaction pooler and logical replication manager that can shard PostgreSQL. Written in Rust, PgDog is fast, secure and can manage hundreds of databases and hundreds of thousands of connections.
• pgbouncer/pgbouncer: Lightweight connection pooler for PostgreSQL. See also: Scaling Postgres Connections with PgBouncer.
• orioledb.com/: OrioleDB is a PostgreSQL extension that combines the advantages of both on-disk and in-memory engines. It uses PostgreSQL pluggable storage to increase performance and cut costs.
• How Cloudflare Achieved 55 Million Requests per Second with Just 15 PostgreSQL Clusters!

• Baserow
• NocoDB
• AppSmith
• mathesar-foundation/mathesar: Intuitive spreadsheet-like interface that lets users of all technical skill levels view, edit, query, and collaborate on Postgres data directly—self hosted, with native Postgres access control.

• dbcli/pgcli: Postgres client that does auto-completion and syntax highlighting.
• sosedoff/pgweb: Simple web-based and cross platform PostgreSQL database explorer.
• Maxteabag/sqlit: A user friendly TUI (e.g. like lazysql) for any SQL databases including PostgreSQL.

• dr-jts/pg_svg: Collection of PostgreSQL functions to create SVG graphics intended to convert PostGIS geometries into styled SVG documents

• Evidence
• Metabase
• Hopara: Platform for real-time data visualization intended for Manufacturing, IoT, Life Science and Data Lakes.
• posit-dev/ggsql: A SQL extension for declarative data visualisation based on the Grammar of Graphics.

• pgxman/pgxman
• supabase/dbdev

• supabase/postgres-language-server: A collection of language tools and a Language Server Protocol (LSP) implementation for Postgres, focusing on developer experience and reliable SQL tooling.

• neondatabase/postgresql_anonymizer: A PostgreSQL extension to directly mask or replace Personally Identifiable Information (PII) or commercially sensitive data.

• pgledger: A double entry ledger implementation in PostgreSQL

• Very comprehensive list of Postgres tooling
• Unsupported PostgreSQL features in Aurora DSQL: AWS has a new database engine called Aurora DSQL, and explicitly listed what PostgreSQL features are not supported.