Intl Explorer is an interactive tool for experimenting and trying out the ECMAScript Internationalization API.

javascript i18n typescript internationalization currency svelte intl datetimeformat collator numberformat segmenter currency-format vite relativetimeformat listformat sveltekit displaynames svelte5 paraglide-js durationformat

• Updated Oct 17, 2026
• Svelte

Linux HLS Server including uploader, segmenter, chunks dealer and media manager

ffmpeg chunk segmenter hls-segmenter

• Updated Sep 9, 2017
• Python

Transport stream web based HLS segmenter.

javascript browser video hls mpeg chunk low-latency transport-stream segmenter lhls hls-chunklist tcp-stream

• Updated Jan 4, 2023
• JavaScript

Tokenization, sentence segmentation, POS tagging and dependency parsing for biomedical texts (BMC Bioinformatics 2019)

bioinformatics tokenizer pos-tagging dependency-parsing bionlp segmenter biomedical-text-mining

• Updated Apr 6, 2019
• Python

A high-performance wrapper around Intl.Segmenter for efficient text segmentation. This class resolves memory handling issues seen with large strings and "maximum call stack exceeded" exceptions that occur when strings exceed 40-50k characters. Enhances performance by 50-500x. Only ~70 loc (with comments) and no dependencies.

processing segment text intl words splitter sentences segmenter graphemes intl-segmenter

• Updated May 2, 2025
• JavaScript

Chinese Tokenizer module for Python

nlp segment parser chinese-nlp segmenter chinese-segmenter

• Updated Jul 3, 2018
• Python

Text segmenter and tokeniser for Danish, English and other languages. Reads an RTF or flat text file and outputs the text, one line per sentence & optionally tokenized.

c-plus-plus tokenizer rtf segmentation tokeniser segmenter rtf-to-text

• Updated Dec 1, 2022
• C++

Segmenter and Orthography Standardazier (SOS) for Classical Arabic (CA)

nlp normalizer arabic segmenter standardizer

• Updated Jul 13, 2020
• Python

This is a tool that allows you to create an DASH manifest from any fmp4 stream file. There are online and CLI versions, also we provide file and stream versions

video mp4 dash fmp4 segmenter

• Updated Jan 4, 2023
• JavaScript

[DEPRECATED, see link below] Graph-Guided Token Merging (G2TM) is a lightweight one-shot module designed to eliminate redundant tokens in the early layers of a ViT-based models, through graph theory. It performs a single token merging step after a shallow attention block, enabling all subsequent layers to operate on a compact token set.

machine-learning deep-learning neural-network graph pytorch artificial-intelligence transformer networkx token segmenter vision-transformer token-reduction token-merging g2tm

• Updated Sep 15, 2026
• Python

Data for layout analysis and HTR.

png ocr xml dataset segmentation htr alto-xml page-xml segmenter

• Updated Sep 3, 2021
• Python

Dataset and models for catalogs' Layout analysis and HTR

ocr catalog segmentation htr alto-xml page-xml segmenter

• Updated Sep 5, 2021
• Python

Tool for visual timestamp annotation, automated season fingerprinting, and uploading segments to TheIntroDB and IntroDB.

preview recap credits intro segmenter theintrodb introdb introscanner

• Updated Jul 31, 2026
• C++

A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic features

nlp tokenizer segmenter

• Updated Feb 26, 2025
• Rust

An extension of Intl.Segmenter that supports ANSI escape codes – with zero dependencies.

cli ansi intl segmenter

• Updated Nov 6, 2026
• TypeScript

jieba中文分词库jieba.NET的.NET Standard版本

jieba analyser segmenter

• Updated Nov 13, 2019
• C#

Text tokenizer for linguistic purposes, such as text matching. Supports more than 40 languages, including English, French, Russian, Japanese, Thai etc.

nlp rust unicode natural-language-processing icu tokenizer snowball cjk rust-library text-matching text-search segmenter lindera rust-lib snowballstemmer

• Updated Oct 11, 2026
• Rust

A lightweight, intuitive wrapper around Intl.Segmenter for seamless segment-aware string operations in TypeScript and JavaScript

unicode string string-manipulation segmentation text-segmentation segmenter graphemes grapheme-clusters

• Updated Oct 30, 2024
• TypeScript

Sequence tagging(Word Segmenter), POS tagging and NER with Tensorflow

tensorflow nes pos-tagging segmenter

• Updated Mar 5, 2018
• Python

A native macOS SwiftUI app to split long text into clean, copy-ready segments — with smart logic and multilingual support.

macos clipboard localization xcode text-processing segmenter swiftui

• Updated Apr 9, 2025
• Swift