GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles
  • Enterprises

This view

  • Original page
  • New address

GeezerVison is showing github.com — GitHub - heye1005/simdjson-java: A Java version of simdjson, a high-performance JSON parser utilizing SIMD instructions

BranchesTags
Open more actions menu
 
 

Latest commit

 

History

46 Commits
46 Commits

Folders and files

NameName
Last commit message
Last commit date
.github/workflows
.github/workflows
 
 
gradle/wrapper
gradle/wrapper
 
 
src
src
 
 
.gitignore
.gitignore
 
 
AUTHORS
AUTHORS
 
 
LICENSE
LICENSE
 
 
README.md
README.md
 
 
build.gradle
build.gradle
 
 
gradle.properties
gradle.properties
 
 
gradlew
gradlew
 
 
gradlew.bat
gradlew.bat
 
 
settings.gradle
settings.gradle
 
 

Repository files navigation

simdjson-java

Build Status

A Java version of simdjson - a JSON parser using SIMD instructions, based on the paper Parsing Gigabytes of JSON per Second by Geoff Langdale and Daniel Lemire.

Code Sample

DOM Parser

byte[] json = loadTwitterJson();

SimdJsonParser parser = new SimdJsonParser();
JsonValue jsonValue = parser.parse(json, json.length);
Iterator<JsonValue> tweets = jsonValue.get("statuses").arrayIterator();
while (tweets.hasNext()) {
    JsonValue tweet = tweets.next();
    JsonValue user = tweet.get("user");
    if (user.get("default_profile").asBoolean()) {
        System.out.println(user.get("screen_name").asString());
    }
}

Schema-Based Parser

byte[] json = loadTwitterJson();

SimdJsonParser parser = new SimdJsonParser();
SimdJsonTwitter twitter = simdJsonParser.parse(buffer, buffer.length, SimdJsonTwitter.class);
for (SimdJsonStatus status : twitter.statuses()) {
    SimdJsonUser user = status.user();
    if (user.default_profile()) {
        System.out.println(user.screen_name());
    }
}

record SimdJsonUser(boolean default_profile, String screen_name) {
}

record SimdJsonStatus(SimdJsonUser user) {
}

record SimdJsonTwitter(List<SimdJsonStatus> statuses) {
}

Installation

The library is available in the Maven Central Repository. To include it in your project, add the following dependency to the build.gradle file:

implementation("org.simdjson:simdjson-java:0.4.0")

or to the pom.xml file:

<dependency>
    <groupId>org.simdjson</groupId>
    <artifactId>simdjson-java</artifactId>
    <version>0.4.0</version>
</dependency>

Please remember about specifying the desired version.

Note that simdjson-java follows the SemVer specification, which means, for example, that a major version of zero indicates initial development, so the library's API should not be considered stable.

We require Java 24 or better.

Benchmarks

To run the JMH benchmarks, execute the following command:

./gradlew jmh

Tests

To run the tests, execute the following command:

./gradlew test

Performance

This section presents a performance comparison of different JSON parsers available as Java libraries. The benchmark used the twitter.json dataset, and its goal was to measure the throughput (ops/s) of parsing and finding all unique users with a default profile.

256-bit Vectors

Environment:

  • CPU: Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz
  • OS: Ubuntu 24.04 LTS, kernel 6.8.0-1008-aws
  • Java: OpenJDK 64-Bit Server VM (build 21.0.3+9-Ubuntu-1ubuntu1, mixed mode, sharing)

DOM parsers (ParseAndSelectBenchmark):

Library Version Throughput (ops/s)
simdjson-java (padded) 0.3.0 783.878
simdjson-java 0.3.0 760.426
fastjson2 2.0.49 308.660
jackson 2.17.0 259.536

Schema-based parsers (SchemaBasedParseAndSelectBenchmark):

Library Version Throughput (ops/s)
simdjson-java (padded) 0.3.0 1237.432
simdjson-java 0.3.0 1216.891
jsoniter-scala 2.28.4 614.138
fastjson2 2.0.49 494.362
jackson 2.17.0 339.904

512-bit Vectors

Environment:

  • CPU: Intel(R) Xeon(R) Platinum 8375C CPU @ 2.90GHz
  • OS: Ubuntu 24.04 LTS, kernel 6.8.0-1008-aws
  • Java: OpenJDK 64-Bit Server VM (build 21.0.3+9-Ubuntu-1ubuntu1, mixed mode, sharing)

DOM parsers (ParseAndSelectBenchmark):

Library Version Throughput (ops/s)
simdjson-java (padded) 0.3.0 1842.146
simdjson-java 0.3.0 1765.592
fastjson2 2.0.49 718.133
jackson 2.17.0 616.617

Schema-based parsers (SchemaBasedParseAndSelectBenchmark):

Library Version Throughput (ops/s)
simdjson-java (padded) 0.3.0 3164.274
simdjson-java 0.3.0 2990.289
jsoniter-scala 2.28.4 1826.229
fastjson2 2.0.49 1259.622
jackson 2.17.0 789.030

To reproduce the benchmark results, execute the following command:

./gradlew jmh -Pjmh.includes='.*ParseAndSelectBenchmark.*'

The benchmark may take several minutes. Remember that you need Java 18 or better.

About

A Java version of simdjson, a high-performance JSON parser utilizing SIMD instructions

Resources

Readme
License
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

Packages

Contributors

Languages

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.