High-performance CLI data-tracer and metadata extractor.
sget is a unique blend of modern ricing and infoation tech. It allows you to inspect a website with simultaenously also able to download files like curl and also operates directly on raw HTTP streams. Built in native C++ on top of libcurl, it treats the web as a queryable data pipeline with zero runtime overhead and minimal memory consumption.
Architecture • Key Features • Quickstart • Usage
- Native
libcurlCore: Low-latency HTTP transfers, custom TLS handshakes, proxy chains, and cookie handling. - Stream Extraction: Zero-copy parsing for CSS selectors, XPath nodes, and metadata boundaries on raw streams.
- Unix-Pipeline Native: Emits clean, structured data to
stdoutdesigned to pipe directly intojq,grep, or local storage. - Low Footprint: No headless browser engines or heavy JS evaluation loops—pure C++ execution.
[ Target Endpoint ]
│
▼ (Low-Level Stream Fetch)
┌───────────┐
│ libcurl │
└───────────┘
│
▼ (Raw Memory Buffer)
┌───────────┐
│ sget │ ──► [ Extraction Engine: CSS / XPath / Metadata ]
└───────────┘
│
▼ (Flushed Output)
[ JSON / Raw ] ──► Pipe to terminal stdout / file
| Layer | Technology | Purpose |
|---|---|---|
| Network Engine | libcurl |
High-throughput HTTP/S transfer & socket management |
| Language | C++17 | Direct memory management and low-latency execution |
| Package Manager | vcpkg |
C++ dependency resolution |
| Environment | Docker / Native | Standalone cross-platform distribution |
# Clone the repository git clone [https://github.com/CoderSilicon/sget.git](https://github.com/CoderSilicon/sget.git) cd sget # Compile using Makefile make # Run sget ./bin/sget --help
# Extract open-graph metadata as JSON sget https://news.ycombinator.com --json # Extract specific CSS selectors sget https://example.com --select "p" # Run through a detail check sget https://api.example.com/data --info
Built with 💻 by CoderSilicon
"It is always better to differ from others."