GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — GitHub - FlashSQL/io-optimized-pgvector: IO Optimized pgvector

BranchesTags
Open more actions menu

Latest commit

 

History

1 Commit
1 Commit

Folders and files

NameName
Last commit message
Last commit date
README.md
README.md
 
 

Repository files navigation

IO-optimized-pgvector

Overview

This repository provides an optimized implementation of pgvector with SSD-aware enhancements for high-performance vector search. The optimizations focus on improving I/O efficiency, leveraging SSD parallelism, query reordering, and locality-preserving indexing.

Branches

This repository consists of 6 branches:

  • main: Includes README file.
  • pg_orig: Vanilla (original) PostgreSQL + pgvector.
  • pg_iou: Asynchronous I/O using IOUring.
  • pg_async_iou: Asynchronous I/O + overlapping execution.
  • pg_colocation: Partitioning + locality-aware insertion.
  • pg_async_iou_colocation: pg_async_iou + pg_colocation

Prerequisites

To install the required dependencies, run:

apt install zlib1g-dev flex bison libreadline-dev gdb rsync liburing-dev

PostgreSQL & pgvector

This project builds upon the following open-source projects:

  • PostgreSQL: https://github.com/postgres/postgres
  • pgvector: https://github.com/pgvector/pgvector

ANN-Benchmark

For benchmarking ANN search performance, we use:

  • ANN-Benchmarks: https://github.com/erikbern/ann-benchmarks

Datasets

The following datasets are used for evaluation:

  • DBpedia: Hugging Face Dataset
  • Deep: Skoltech Deep1B
  • GloVe: Stanford NLP GloVe
  • NYTimes: UCI Bag of Words
  • COCO: Skoltech COCO

How to Benchmark

To reproduce the benchmark experiments:

  1. Set up PostgreSQL with pgvector following the installation guide with the desired branch.
  2. Prepare datasets using the links above.
  3. Run ANN benchmarks to evaluate approximate nearest neighbor (ANN) search performance.
  4. Run CREATE INDEX command to measure indexing performance.

About

IO Optimized pgvector

Resources

Readme
Activity
Custom properties

Stars

18 stars

Watchers

2 watching

Forks

4 forks
Report repository

Releases

Packages

Contributors

You are visitor 01402520 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.