GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — GitHub - tupleapp/vector: A high-performance observability data pipeline.

BranchesTags
Open more actions menu
 
 

Latest commit

 

History

5,662 Commits
5,662 Commits

Folders and files

NameName
Last commit message
Last commit date
.cargo
.cargo
 
 
.github
.github
 
 
benches
benches
 
 
config
config
 
 
cue.mod
cue.mod
 
 
distribution
distribution
 
 
docs
docs
 
 
lib
lib
 
 
proto
proto
 
 
rfcs
rfcs
 
 
scripts
scripts
 
 
skaffold
skaffold
 
 
soaks
soaks
 
 
src
src
 
 
tests
tests
 
 
website
website
 
 
.dockerignore
.dockerignore
 
 
.editorconfig
.editorconfig
 
 
.gitattributes
.gitattributes
 
 
.gitignore
.gitignore
 
 
.graphqlconfig
.graphqlconfig
 
 
.rustfmt.toml
.rustfmt.toml
 
 
CHANGELOG.md
CHANGELOG.md
 
 
CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md
 
 
CONTRIBUTING.md
CONTRIBUTING.md
 
 
Cargo.lock
Cargo.lock
 
 
Cargo.toml
Cargo.toml
 
 
Cross.toml
Cross.toml
 
 
LICENSE
LICENSE
 
 
Makefile
Makefile
 
 
NOTICE
NOTICE
 
 
PRIVACY.md
PRIVACY.md
 
 
README.md
README.md
 
 
RELEASES.md
RELEASES.md
 
 
SECURITY.md
SECURITY.md
 
 
VERSIONING.md
VERSIONING.md
 
 
build.rs
build.rs
 
 
clippy.toml
clippy.toml
 
 
deny.toml
deny.toml
 
 
kustomization.yaml
kustomization.yaml
 
 
netlify.toml
netlify.toml
 
 
rust-toolchain
rust-toolchain
 
 
skaffold.yaml
skaffold.yaml
 
 

Repository files navigation

Quickstart  •   Docs  •   Guides  •   Integrations  •   Chat  •   Download

Vector

What is Vector?

Vector is a high-performance, end-to-end (agent & aggregator) observability data pipeline that puts you in control of your observability data. Collect, transform, and route all your logs, metrics, and traces to any vendors you want today and any other vendors you may want tomorrow. Vector enables dramatic cost reduction, novel data enrichment, and data security where you need it, not where it is most convenient for your vendors. Additionally, it is open source and up to 10x faster than every alternative in the space.

To get started, follow our quickstart guide or install Vector.

Principles

  • Reliable - Built in Rust, Vector's primary design goal is reliability.
  • End-to-end - Deploys as an agent or aggregator. Vector is a complete platform.
  • Unified - Logs, metrics, and traces (coming soon). One tool for all of your data.

Use cases

  • Reduce total observability costs.
  • Transition vendors without disrupting workflows.
  • Enhance data quality and improve insights.
  • Consolidate agents and eliminate agent fatigue.
  • Improve overall observability performance and reliability.

Community

  • Vector is relied on by startups and enterprises like Atlassian, T-Mobile, Comcast, Zendesk, Discord, Fastly, CVS, Trivago, Tuple, Douban, Visa, Mambu, Blockfi, Claranet, Instacart, Forcepoint, and many more.
  • Vector is downloaded over 100,000 times per day.
  • Vector's largest user processes over 30TB daily.
  • Vector has over 100 contributors and growing.

Documentation

About

  • Concepts
  • Under the hood
    • Architecture - data model (log, metric), pipeline model, concurrency model, runtime model
    • Networking - ARC
    • Guarantees

Setup

  • Quickstart
  • Installation - operating systems, package managers, platforms (Kubernetes), manual
  • Deployment - roles, topologies

Reference

  • Configuration
    • Sources - docker_logs, file, http, journald, kafka, socket, and many more...
    • Transforms - dedupe, filter, geoip, log_to_metric, lua, remap, and many more...
    • Sinks - aws_cloudwatch_logs, aws_s3, clickhouse, elasticsearch, gcp_cloud_storage, and many more...
    • Unit tests
  • Remap Language
  • API
  • CLI

Administration

  • Management
  • Monitoring & observing
  • Upgrading
  • Validating

Resources

  • Community - chat, calendar, @vectordotdev
  • Releases - latest
  • Roadmap - vote on new features
  • Policies - Code of Conduct, Privacy, Releases, Security, Versioning

Comparisons

Performance

The following performance tests demonstrate baseline performance between common protocols with the exception of the Regex Parsing test.

Test Vector Filebeat FluentBit FluentD Logstash SplunkUF SplunkHF
TCP to Blackhole 86mib/s n/a 64.4mib/s 27.7mib/s 40.6mib/s n/a n/a
File to TCP 76.7mib/s 7.8mib/s 35mib/s 26.1mib/s 3.1mib/s 40.1mib/s 39mib/s
Regex Parsing 13.2mib/s n/a 20.5mib/s 2.6mib/s 4.6mib/s n/a 7.8mib/s
TCP to HTTP 26.7mib/s n/a 19.6mib/s <1mib/s 2.7mib/s n/a n/a
TCP to TCP 69.9mib/s 5mib/s 67.1mib/s 3.9mib/s 10mib/s 70.4mib/s 7.6mib/s

To learn more about our performance tests, please see the Vector test harness.

Correctness

The following correctness tests are not exhaustive, but they demonstrate fundamental differences in quality and attention to detail:

Test Vector Filebeat FluentBit FluentD Logstash Splunk UF Splunk HF
Disk Buffer Persistence ✓ ✓ ⚠ ✓ ✓
File Rotate (create) ✓ ✓ ✓ ✓ ✓ ✓ ✓
File Rotate (copytruncate) ✓ ✓ ✓
File Truncation ✓ ✓ ✓ ✓ ✓ ✓ ✓
Process (SIGHUP) ✓ ⚠ ✓ ✓
JSON (wrapped) ✓ ✓ ✓ ✓ ✓ ✓ ✓

To learn more about our correctness tests, please see the Vector test harness.

Features

Vector is an end-to-end, unified, open data platform.

Vector Beats Fluentbit Fluentd Logstash Splunk UF Splunk HF
End-to-end ✓
Agent ✓ ✓ ✓ ✓
Aggregator ✓ ✓ ✓ ✓
Unified ✓
Logs ✓ ✓ ✓ ✓ ✓ ✓ ✓
Metrics ✓ ⚠ ⚠ ⚠ ⚠ ⚠ ⚠
Traces 🚧
Open ✓ ✓ ✓
Open-source ✓ ✓ ✓ ✓ ✓
Vendor-neutral ✓ ✓ ✓
Reliability ✓
Memory-safe ✓
Delivery guarantees ✓ ✓ ✓
Multi-core ✓ ✓ ✓ ✓ ✓ ✓

⚠ = Not interoperable, metrics are represented as structured logs


Developed with ❤️ by Datadog - Security Policy - Privacy Policy

About

A high-performance observability data pipeline.

vector.dev

Resources

Readme
MPL-2.0 license

Code of conduct

Code of conduct

Contributing

Contributing

Security policy

Security policy
Activity
Custom properties

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

Packages

Used by

Contributors

Languages

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.