GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — GitHub - vectordotdev/vector: A high-performance observability data pipeline.

BranchesTags
Open more actions menu

Latest commit

 

History

14,739 Commits
14,739 Commits

Folders and files

NameName
Last commit message
Last commit date
.cargo
.cargo
 
 
.config
.config
 
 
.github
.github
 
 
agents/skills/vector-components-maturity-eval
agents/skills/vector-components-maturity-eval
 
 
benches
benches
 
 
changelog.d
changelog.d
 
 
config
config
 
 
deprecation.d
deprecation.d
 
 
distribution
distribution
 
 
docs
docs
 
 
lib
lib
 
 
licenses
licenses
 
 
proto
proto
 
 
regression
regression
 
 
rfcs
rfcs
 
 
scripts
scripts
 
 
src
src
 
 
tests
tests
 
 
tilt
tilt
 
 
vdev
vdev
 
 
website
website
 
 
.dockerignore
.dockerignore
 
 
.editorconfig
.editorconfig
 
 
.gitattributes
.gitattributes
 
 
.gitignore
.gitignore
 
 
.markdownlint.jsonc
.markdownlint.jsonc
 
 
.prettierignore
.prettierignore
 
 
.prettierrc.json
.prettierrc.json
 
 
.rustfmt.toml
.rustfmt.toml
 
 
.typos.toml
.typos.toml
 
 
AGENTS.md
AGENTS.md
 
 
AI_POLICY.md
AI_POLICY.md
 
 
CHANGELOG.md
CHANGELOG.md
 
 
CLAUDE.md
CLAUDE.md
 
 
CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md
 
 
COMMUNITY_RESPONSE_EXPECTATIONS.md
COMMUNITY_RESPONSE_EXPECTATIONS.md
 
 
CONTRIBUTING.md
CONTRIBUTING.md
 
 
Cargo.lock
Cargo.lock
 
 
Cargo.toml
Cargo.toml
 
 
Cross.toml
Cross.toml
 
 
LICENSE
LICENSE
 
 
LICENSE-3rdparty.csv
LICENSE-3rdparty.csv
 
 
Makefile
Makefile
 
 
Makefile.packaging
Makefile.packaging
 
 
NOTICE
NOTICE
 
 
PRIVACY.md
PRIVACY.md
 
 
README.md
README.md
 
 
RELEASES.md
RELEASES.md
 
 
SECURITY.md
SECURITY.md
 
 
STYLE.md
STYLE.md
 
 
Tiltfile
Tiltfile
 
 
VERSIONING.md
VERSIONING.md
 
 
amplify.yml
amplify.yml
 
 
buf.vector.yaml
buf.vector.yaml
 
 
buf.yaml
buf.yaml
 
 
build.rs
build.rs
 
 
clippy.toml
clippy.toml
 
 
deny.toml
deny.toml
 
 
license-tool.toml
license-tool.toml
 
 
rust-toolchain.toml
rust-toolchain.toml
 
 

Repository files navigation

Nightly Integration/E2E Test Suite Component Features

Vector

Quickstart  •   Docs  •   Guides  •   Integrations  •   Chat  •   Download  •   Container Images

What is Vector?

Vector is a high-performance, end-to-end (agent & aggregator) observability data pipeline that puts you in control of your observability data. Collect, transform, and route all your logs and metrics to any vendors you want today and any other vendors you may want tomorrow. Vector enables dramatic cost reduction, novel data enrichment, and data security where you need it, not where it is most convenient for your vendors. Vector is 100% open source. The complete source code and all features are publicly available.

To get started, follow our quickstart guide or install Vector.

Vector is maintained by Datadog's Community Open Source Engineering team.

Principles

  • Reliable - Built in Rust, Vector's primary design goal is reliability.
  • End-to-end - Deploys as an agent or aggregator. Vector is a complete platform.
  • Unified - Stable support for logs and metrics in one pipeline. Trace support is available in selected components, including the OpenTelemetry source. When building a trace pipeline, check each component's supported event types and limitations.

Use cases

  • Reduce total observability costs.
  • Transition vendors without disrupting workflows.
  • Enhance data quality and improve insights.
  • Consolidate agents and eliminate agent fatigue.
  • Improve overall observability performance and reliability.

Community

  • Vector powers observability pipelines at Atlassian, Riot Games, Comcast, FanDuel, Zerodha, Timescale, Quad9, OpenAI, Anthropic, and many more.
  • Contributors

Documentation

All user documentation is available at vector.dev/docs.

To build and verify a pipeline:

  1. Develop a configuration and transform events with VRL.
  2. Validate the configuration with vector validate.
  3. Test transform behavior with vector test.
  4. Inspect a running pipeline with vector top and vector tap.

Other Resources:

  • Vector Calendar
  • Policies:
    • Code of Conduct
    • Contributing
    • Privacy
    • Releases
    • Versioning
    • Security

Comparisons

Performance

The following table shows historical throughput benchmarks from the Vector test harness, in MiB/s. Higher values are better.

Performance varies with workload, configuration, hardware, and software versions. Benchmark your own pipeline with current software.

Test Vector Filebeat Fluent Bit Fluentd Logstash Splunk UF Splunk HF Highest throughput
TCP to Blackhole 86 n/a 64.4 27.7 40.6 n/a n/a Vector
File to TCP 76.7 7.8 35 26.1 3.1 40.1 39 Vector
Regex Parsing 13.2 n/a 20.5 2.6 4.6 n/a 7.8 Fluent Bit
TCP to HTTP 26.7 n/a 19.6 <1 2.7 n/a n/a Vector
TCP to TCP 69.9 5 67.1 3.9 10 70.4 7.6 Splunk UF

Correctness

The following correctness tests are not exhaustive, but they demonstrate fundamental differences in quality and attention to detail:

Test Vector Filebeat FluentBit FluentD Logstash Splunk UF Splunk HF
Disk Buffer Persistence ✓ ✓ ⚠ ✓ ✓
File Rotate (create) ✓ ✓ ✓ ✓ ✓ ✓ ✓
File Rotate (copytruncate) ✓ ✓ ✓
File Truncation ✓ ✓ ✓ ✓ ✓ ✓ ✓
Process (SIGHUP) ✓ ⚠ ✓ ✓
JSON (wrapped) ✓ ✓ ✓ ✓ ✓ ✓ ✓

To learn more about our correctness tests, please see the Vector test harness.

Features

Vector is an end-to-end, unified, open data platform.

Vector Beats Fluentbit Fluentd Logstash Splunk UF Splunk HF Telegraf
End-to-end ✓ ✓
Agent ✓ ✓ ✓ ✓ ✓
Aggregator ✓ ✓ ✓ ✓ ✓
Unified ✓ ✓
Logs ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓
Metrics ✓ ⚠ ⚠ ⚠ ⚠ ⚠ ⚠ ✓
Traces Partial
Open ✓ ✓ ✓ ✓
Open-source ✓ ✓ ✓ ✓ ✓ ✓
Vendor-neutral ✓ ✓ ✓ ✓
Reliability ✓
Memory-safe ✓ ✓
Delivery guarantees ✓ ✓ ✓
Multi-core ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓

⚠ = Not interoperable, metrics are represented as structured logs


Developed with ❤️ by Datadog - Security Policy - Privacy Policy

About

A high-performance observability data pipeline.

vector.dev

Topics

agentcloud-nativedata-transformationdatadogetleventsforwarderhacktoberfesthigh-performancelogsmetricsmonitoringobservabilitypipelinesrust-langstream-processingtelemetrytraces

Resources

Readme

Code of conduct

Code of conduct

Contributing

Contributing

Security policy

Security policy
Activity
Custom properties

Stars

22.9k stars

Watchers

151 watching

Forks

2.4k forks
Report repository

Releases

Used by

Contributors

Languages

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.