diff --git a/versions/.gitignore b/versions/.gitignore new file mode 100644 index 0000000000..330372b12e --- /dev/null +++ b/versions/.gitignore @@ -0,0 +1,9 @@ +# Prepared Native data files and cached Docker tag lists — large / regenerable. +prepare-data/data/ + +# Per-version build/run logs (artifacts) +build-from-source/logs/ +logs/ + +# Rendered per-version cloud-init files +cloud-init.*.sh diff --git a/versions/README.md b/versions/README.md index d491fad491..38ff6f6bd6 100644 --- a/versions/README.md +++ b/versions/README.md @@ -1,7 +1,214 @@ # ClickHouse Versions Benchmark -This is a benchmark for ClickHouse versions based on MgBench, Star Schema Benchmark and ClickBench. +This benchmark runs the **same** workload on the **same** data across every +historical and current ClickHouse version, to show how performance has evolved +over the years. It is published at https://benchmark.clickhouse.com/versions/ +and described in the blog post +[ClickHouse Over the Years with Benchmarks](https://clickhouse.com/blog/clickhouse-over-the-years-with-benchmarks). -It is described [here](https://clickhouse.com/blog/clickhouse-over-the-years-with-benchmarks). +Please don't confuse it with the per-commit ClickHouse Performance Test, described +[here](https://clickhouse.com/blog/testing-the-performance-of-click-house). -Please don't be confused with the per-commit ClickHouse Performance Test, that is described [here](https://clickhouse.com/blog/testing-the-performance-of-click-house). +## How it works + +Every ClickHouse release is published as a Docker image, so each version is run +in its own container — from `1.1.54xxx` (2018) to today — with no host install. + +1. **`list-versions.sh`** — selects the versions to test and resolves an image + for each. Rules: keep **all** of the `1.1.x` family; for calendar-versioned + releases (18.x+) keep only the **latest patch within each major.minor**. + Historical images come from `yandex/clickhouse-server`; modern ones from + `clickhouse/clickhouse-server`. A version with no image falls back to + installing the `.deb`/`.tgz` from packages.clickhouse.com into Ubuntu. + +2. **`prepare-data/prepare.sh`** — builds the canonical data files once, in the + **Native** format, using only the oldest-compatible types so a single set of + files loads into *every* version (validated against `1.1.54378`): + - `hits.native` — ClickBench `hits` (100M rows, 105 columns). + - `ssb.native` — Star Schema Benchmark `lineorder_flat` (scale factor 100). + - `mgbench{1,2,3}.native` — Brown benchmark `logs1`/`logs2`/`logs3`. + - `tpch_*.native` — TPC-H, 8 tables from the `dbgen` generator at scale + factor 40 (~10 GB compressed). + - `tpcds_*.native` — TPC-DS, 24 tables from the `dsdgen` generator at scale + factor 32 (~10 GB compressed). + - `coffeeshop_*.native` — Coffee Shop benchmark (`fact_sales` + `dim_locations` + + `dim_products`), from the published Iceberg tables; the smallest fact + table (`fact_sales_500m`, 500M rows) is used, minus the unused + high-cardinality `order_line_id` column. + - `ontime.native` — airline on-time performance (single table), from the saved + copy in the public bucket, narrowed to the 12 columns its queries use. + - `uk_price_paid.native` — UK land registry "price paid" (single table, ~28M + rows / ~200 MB), preprocessed per the ClickHouse docs. + - `job_*.native` — Join Order Benchmark, 21 tables (a snapshot of IMDB) from + the canonical CSV dump. + - `taxi.native` — NYC `trips` (narrowed to the 5 columns its queries use). + + Type downgrades: `LowCardinality`→`String`, `IPv4`→`String`, + `DateTime64`→`DateTime`, enums→`String`, TPC-H/TPC-DS `Decimal`→`Float64` + (TPC-H `CHAR(N)`→`FixedString(N)`; TPC-DS NULLs → type defaults so its + non-Nullable columns load); `Nullable` is kept only where the query set needs + `IS NULL` (mgbench `logs1`). Tables without a natural date carry a synthesised + `Date` column (`log_date` / TPC-H dimensions' constant `synth_date`) so the + legacy `MergeTree` engine works. + +3. **`create/create.sh `** — emits version-appropriate + DDL. Modern releases use `ENGINE = MergeTree PARTITION BY … ORDER BY …`; the + earliest `1.1.x` (before custom partitioning, < `1.1.54310`) use the legacy + positional `ENGINE = MergeTree(date, (key), 8192)`. Column lists live in + `create/schema/*.columns` (dataset-qualified, e.g. `tpcds_customer.columns`, + where a table name is shared across datasets). + +4. **`run-version.sh [image]`** — starts the server, creates each + dataset's tables **in its own database** (so same-named tables like TPC-H and + TPC-DS `customer` don't collide), loads each Native file with the simplest + possible `clickhouse-client INSERT … FORMAT Native`, then times every query in + `queries/{mgbench,ssb,hits,tpch,tpcds,coffeeshop,taxi}.sql` (`TRIES` runs each, + dropping the page cache between queries) and writes `results/.json`. + +5. **`run-all.sh`** — runs `run-version.sh` for every selected version. + +6. **`generate-results.sh`** — folds `results/*.json` into `index.html`. + +## Usage + +```bash +# 1. Prepare the data once (full scale — reproduces the original benchmark). +# For a quick smoke test use a slice: +# HITS_PARTS=0 SSB_SCALE=1 TAXI_GLOB=trips_xaa.csv.gz ./prepare-data/prepare.sh +./prepare-data/prepare.sh + +# 2. Benchmark one version, a few, or all of them. +./run-version.sh 1.1.54378 +./run-all.sh 1.1.54378 19.6.3.18 24.8.1.1 +./run-all.sh # every version from list-versions.sh + +# 3. Regenerate the website. +./generate-results.sh +``` + +Requires Docker and a recent `clickhouse` binary (used only for data prep; +install with `curl https://clickhouse.com/ | sh`). + +### Runtime and scale + +At the original-blog scale, a single version takes on the order of **hours** +(measured ~4h on `1.1.54019`), dominated by loading the ~1.3B-row taxi table and +the cold first run of each query. The full ~143-version sweep is therefore a +**multi-week** job. To make it tractable, dial down the dominant dataset at prep +time, e.g. a ~100M-row taxi slice: + +```bash +TAXI_GLOB='trips_xa[a-n].csv.gz' ./prepare-data/taxi.sh # ~14 of 175 files +``` + +Smaller `HITS_PARTS` / `SSB_SCALE` reduce the others similarly. The runner is +unchanged — only the prepared file sizes differ. + +## Running in the cloud (unattended) + +Like the main ClickBench, each version can be benchmarked on its own fresh VM +that self-terminates and sends its result to the sink: + +```bash +./run-benchmark.sh 1.1.54378 # one version on a c7a.4xlarge +machine=c6a.metal ./run-benchmark.sh 24.8.1.1 +datasets="hits ssb" ./run-benchmark.sh 25.1.1.1 # subset of datasets +./run-all-benchmarks.sh # one VM per runnable version +``` + +`run-benchmark.sh` resolves the version's image via `list-versions.sh`, renders +`cloud-init.sh.in`, and starts an EC2 instance (terminate-on-shutdown, capacity +retry). The VM installs Docker, downloads the prepared Native files from +`s3://clickhouse-public-datasets/versions-benchmark/*.native.zst`, builds the +image from source if the version has none (`clickhouse-built:*`, using the tag + +GCC from `build-from-source/versions.txt`), runs `run-version.sh`, and POSTs the +result JSON (enriched with the machine type, `kind:"versions-benchmark"`) plus +the log to `sink.data` on play.clickhouse.com. A server-side materialized view +turns those into the published report, exactly as the main benchmark does. + +Notes: all datasets run by default (`datasets="hits ssb mgbench tpch tpcds +coffeeshop taxi"`); the taxi table is narrowed to the five columns its queries +use (~15 GB), so it no longer dominates. Pass a subset via `datasets=` to skip +some. While this branch is unmerged, pass `branch=versions-benchmark-rework`. +Missing dataset files in the bucket are skipped (their queries report null). + +## Query set + +344 queries in a fixed order: mgbench (15) + Star Schema Benchmark (13) + +ClickBench/hits (43) + TPC-H (22) + TPC-DS (103) + Coffee Shop (17) + ontime (11) ++ UK price-paid (3) + Join Order Benchmark (113) + taxi (4). See `queries/*.sql`. +The TPC-H, TPC-DS and JOB queries are the official sets taken +from the ClickHouse repository (`tests/benchmarks/tpc-{h,ds}/queries`), flattened +to one line each (TPC-H Q15 is rewritten from its `CREATE VIEW` form into a single +`WITH` query; TPC-DS two-part queries become two lines, giving 103 statements from +the 99 queries). Their many joins, subqueries and window functions only run on +modern versions — older releases report `null`. Results are reported one row per +query, with `null` for queries a given version cannot run. + +The previous apt-based scripts are kept under `scripts/` and `unified_scripts/` +for reference. + +## Old-version repair + +Two fixes let the benchmark reach back to the very first published image +(`1.1.54019`, Sept 2016): + +- **IPv4 listen override** (`config/listen.xml`, mounted into every image): + old images default to `::` (IPv6) and crash on + boot when the host has IPv6 disabled. +- **Sidecar client**: the oldest server images ship only `clickhouse-server`, + no client binary. The runner detects this and drives them with the + matching-version `yandex/clickhouse-client:` image as a sidecar sharing + the server's network namespace — same native protocol, precise `--time`. + +With these, `1.1.54019` runs 62 of the 75 queries; the 13 nulls are genuine +era limitations (e.g. `Nullable`, which mgbench `logs1`/`logs3` need, postdates +that build; likewise a few `toYYYYMM` / `replaceOne` / `COUNT(DISTINCT)` cases). + +### Building the never-published versions from source + +The earliest releases — the bare-number tags `53973`..`54011` and a few `1.1.x` +that were never pushed as an image or package (`1.1.54165`, `54318`, `54335`, +`54336`, `54358`, `54362`, `54370`) — are resurrected by compiling them from +source in their contemporary environment (`build-from-source/`): + +```bash +cd build-from-source +./build.sh 1.1.54165 v1.1.54165-stable # one version -> clickhouse-built:1.1.54165 +./build-all.sh # everything in versions.txt +``` + +`Dockerfile.ubuntu1604` pins the era toolchain (Ubuntu 16.04) and builds each +tag in a contemporary environment, packaging a runnable image +(`clickhouse-built:`) with IPv4 listening, a `clickhouse` multi-call shim, +and the pre-created data dirs the 2016 server needs. `build-all.sh` runs several +builds concurrently (`JOBS`, default 6) since a single `make -j$(nproc)` doesn't +saturate the cores on these small codebases. `list-versions.sh` routes these +versions to their `clickhouse-built:` image automatically. + +What it took to make the old tree build on a modern host (encoded in the +Dockerfile and `versions.txt`): +- **Compiler escalates by era** — the required GCC is recorded per version in + `versions.txt` (4th column): gcc-5 for the 2016 tags, gcc-6 for `1.1.54318`, + gcc-7 for `1.1.54335`+ (pulled from the `ubuntu-toolchain-r` PPA via `ARG GCC`). +- **Strip `-Werror`** from the project's cmake (the tree hardcodes it and leaks + clang-only `-Wno-*` flags into the GCC build). +- **Submodules** — the 2016 tags vendor contrib (none); the later `1.1.x` use + submodules, one of which (`contrib/zookeeper`) points at a now-deleted repo, so + we init submodules tolerantly and let cmake fall back to system + `libzookeeper-mt-dev`. +- The slow apt layer is keyed only on the GCC version, so it is cached and shared + across all builds of the same compiler. + +## Notes and limitations + +- The 8 oldest builds (`1.1.54011`, `54165`, `54318`, `54335`, `54336`, + `54358`, `54362`, `54370`) were never published as an image or package, so + `list-versions.sh` lists them with the marker `unavailable` and the sweep + skips them. Everything from `1.1.54019` on is runnable. +- A version that fails to start, create a table, or load data is recorded as a + failure / `null` rows rather than aborting the sweep. +- Native files are stored zstd-compressed (level 6) and streamed through + `zstd -dc | clickhouse-client` at load time. +- Validated end-to-end on `1.1.54019` (oldest, via sidecar), `1.1.54378` + (legacy baseline), `19.8.3.8` (mid), and a modern `24.8` release. diff --git a/versions/build-from-source/Dockerfile.reconstruct b/versions/build-from-source/Dockerfile.reconstruct new file mode 100644 index 0000000000..47df1c2e13 --- /dev/null +++ b/versions/build-from-source/Dockerfile.reconstruct @@ -0,0 +1,185 @@ +# Reconstruct a pre-2016-03 ClickHouse snapshot that has no public build system. +# +# The public repo only became self-contained (root CMakeLists.txt + contrib/) at +# 2016-03. Earlier commits carry the source but not the build files or vendored +# libraries. We overlay a donor commit's build system + contrib/ (DONOR, default +# the 2016-03 snapshot) onto the target source (TAG, a raw commit SHA), reconcile +# them with reconstruct.sh, supply the vendored libs the donor no longer ships +# (QuickLZ stub, system tcmalloc), and build clickhouse-server / clickhouse-client. +# +# docker build -f Dockerfile.reconstruct \ +# --build-arg TAG= --build-arg REVISION= -t clickhouse-built: . +# +# The result behaves like the official server images (see Dockerfile.ubuntu1604). + +# Ubuntu 14.04 is the era-correct base for these pre-2016-03 snapshots: gcc-5 +# (from the toolchain PPA) defaults to the old libstdc++ ABI here, and trusty's +# system boost is old-ABI too — so both clickhouse-server AND clickhouse-client +# link (16.04's new-ABI boost breaks the client's boost::program_options). +FROM ubuntu:14.04 + +ARG GCC=5 +# Trusty is still on archive.ubuntu.com (in ESM), so keep the base sources; its +# Release is expired (Check-Valid-Until=false) and gcc-5 comes from the +# ubuntu-toolchain-r PPA ([trusted=yes] skips the GPG dance). liblz4/libzstd/ +# double-conversion come from the vendored contrib/, not the (older) system. +RUN set -eu; \ + echo 'deb [trusted=yes] http://ppa.launchpad.net/ubuntu-toolchain-r/test/ubuntu trusty main' > /etc/apt/sources.list.d/toolchain.list; \ + apt-get -o Acquire::Check-Valid-Until=false update; \ + apt-get install -y --no-install-recommends --allow-unauthenticated \ + git ca-certificates cmake make pkg-config bash python3 "gcc-${GCC}" "g++-${GCC}" \ + libicu-dev libreadline-dev libssl-dev unixodbc-dev libglib2.0-dev \ + libboost-dev libboost-thread-dev libboost-program-options-dev \ + libboost-system-dev libboost-regex-dev libboost-filesystem-dev \ + zlib1g-dev liblz4-dev libsparsehash-dev libmysqlclient-dev \ + libzookeeper-mt-dev libgoogle-perftools-dev tzdata \ + && rm -rf /var/lib/apt/lists/* + +ENV CC=gcc-${GCC} CXX=g++-${GCC} + +# DONOR: the earliest self-contained snapshot (2016-03-01), whose build system +# and contrib/ we transplant. TAG: the target snapshot's commit SHA. +ARG DONOR=5360c78806e043d0d2bf3de15a363f87fbdaf5f4 +# PATCH_REF: the last cleanly-building month (2015-12). A handful of files in the +# older trees use C++14 that this era's gcc-5 accepted but a modern gcc-5 rejects +# (recursive generic lambdas etc.); by 2015-12 they had been rewritten. We overlay +# those specific files from PATCH_REF ("an equivalent from a slightly newer +# version"). PATCH_FILES is the space-separated allowlist, extended as new +# gcc-hostile files surface while sweeping backwards. +ARG PATCH_REF=a7387d9ce431a1f288d1a4898fa0c0c36c765abc +# Two overlay sets from PATCH_REF, applied only to targets older than it: +# PATCH_COND_* — CONDITIONAL OVERWRITE. SummingSortedBlockInputStream: only the +# ~2015-06..2015-11 copies use a recursive generic lambda (decltype(auto)) that a +# modern gcc-5 rejects; older and newer copies compile as-is and match their own +# era's caller (the ctor signature differs across eras). So overwrite it from +# PATCH_REF only when the target's own copy actually contains that construct. +# PATCH_FILL — FILL, only when ABSENT in the target. The statdaemons-library +# components (Stopwatch, pools, HLL, Increment, the uniq/quantile algorithms, +# …) that pre-2015-11 trees pulled from the external ; they were +# inlined in-repo at the 2015-10 -> 2015-11 boundary. Filling only-if-missing +# means newer, self-contained trees keep their own copies (no downgrade). +# reconstruct.sh forwards the old paths to them. +ARG PATCH_COND_H=dbms/include/DB/DataStreams/SummingSortedBlockInputStream.h +ARG PATCH_COND_CPP=dbms/src/DataStreams/SummingSortedBlockInputStream.cpp +ARG PATCH_FILL="dbms/include/DB/AggregateFunctions/UniquesHashSet.h dbms/include/DB/AggregateFunctions/ReservoirSampler.h dbms/include/DB/AggregateFunctions/ReservoirSamplerDeterministic.h dbms/include/DB/Common/Stopwatch.h dbms/include/DB/Common/ConfigProcessor.h dbms/include/DB/Common/PoolBase.h dbms/include/DB/Common/PoolWithFailoverBase.h dbms/include/DB/Common/OptimizedRegularExpression.h dbms/include/DB/Common/OptimizedRegularExpression.inl dbms/include/DB/Common/HTMLForm.h dbms/include/DB/Common/AIO.h dbms/include/DB/Common/HyperLogLogCounter.h dbms/include/DB/Common/HyperLogLogBiasEstimator.h dbms/include/DB/Common/CompactArray.h dbms/include/DB/Common/NetException.h dbms/src/Common/ConfigProcessor.cpp libs/libcommon/include/common/threadpool.hpp dbms/include/DB/Common/Increment.h dbms/include/DB/Common/CounterInFile.h dbms/include/DB/Common/SimpleCache.h" +ARG TAG +RUN git init -q /src && cd /src \ + && git config advice.detachedHead false \ + && git remote add origin https://github.com/ClickHouse/ClickHouse.git \ + && git fetch -q --depth 1 origin "${TAG}" && git checkout -q --detach FETCH_HEAD \ + && git fetch -q --depth 1 origin "${DONOR}" \ + && git checkout FETCH_HEAD -- contrib \ + && git checkout FETCH_HEAD -- $(git ls-tree -r --name-only FETCH_HEAD | grep -E 'CMakeLists.txt$|\.cmake$') \ + && (git checkout FETCH_HEAD -- dbms/include/DB/Dictionaries/Embedded 2>/dev/null || true) \ + && (git checkout FETCH_HEAD -- libs/libdaemon 2>/dev/null || true) \ + && (git checkout FETCH_HEAD -- libs/libcommon 2>/dev/null || true) \ + && if [ "${PATCH_REF}" != "${TAG}" ]; then \ + git fetch -q --depth 1 origin "${PATCH_REF}"; \ + for f in ${PATCH_FILL}; do [ -e "$f" ] || (git checkout FETCH_HEAD -- "$f" 2>/dev/null || true); done; \ + if grep -q 'decltype(auto)' "${PATCH_COND_H}" 2>/dev/null; then \ + git checkout FETCH_HEAD -- "${PATCH_COND_H}" "${PATCH_COND_CPP}" 2>/dev/null || true; \ + fi; \ + fi + +# Reconcile the donor build system with the older source (globs, stubs, shims). +COPY reconstruct.sh /reconstruct.sh +RUN bash /reconstruct.sh + +# Configure, then build. re2/re2_st must be built (and put on the linker search +# path) before the server links; revision.h is generated directly (the donor's +# generator does a git-fetch that hangs on a shallow checkout). +# +# Revision: the caller passes REVISION -- the per-month value interpolated in +# monthly.tsv between the dates the DBMS_MIN_REVISION_WITH_* protocol defines were +# introduced (those constants are the real SVN revisions where each protocol feature +# landed). We then clamp it up to this snapshot's own protocol FLOOR: the maximum +# DBMS_MIN_REVISION_WITH_* constant in Core/Defines.h. The floor matters because those +# defines control the wire protocol -- the compiled-in revision must be >= every +# threshold the in-image client checks at handshake, or the client rejects its own +# server ("Server revision is too old ... at least 34482"). The resulting value is +# what the server reports (0.0.) and is written to /clickhouse-revision so +# run-version.sh reports the same on the oldest builds, which have no SELECT version(). +# With no REVISION passed it falls back to the floor, then to 53400. +ARG REVISION= +WORKDIR /src/build +RUN cmake .. -DCMAKE_BUILD_TYPE=Release -DTESTS=NO \ + -DCMAKE_C_COMPILER="gcc-${GCC}" -DCMAKE_CXX_COMPILER="g++-${GCC}" \ + && make -j"$(nproc)" re2 && make -j"$(nproc)" re2_st \ + && cp "$(find . -name libre2.a | head -1)" /usr/lib/ \ + && cp "$(find . -name libre2_st.a | head -1)" /usr/lib/ \ + && mkdir -p /src/build/libs/libcommon/src \ + && { FLOOR=$(grep -hoE 'DBMS_MIN_REVISION_WITH_[A-Z_]+[[:space:]]+[0-9]+' $(find /src -path '*/Core/Defines.h' 2>/dev/null) 2>/dev/null | grep -oE '[0-9]+$' | sort -n | tail -1); \ + REV=${REVISION:-${FLOOR}}; \ + if [ -n "${FLOOR}" ] && [ "${REV:-0}" -lt "${FLOOR}" ] 2>/dev/null; then REV=${FLOOR}; fi; \ + REV=${REV:-53400}; \ + echo "reconstruct: using revision ${REV} (protocol floor ${FLOOR:-none})"; \ + printf '%s' "${REV}" > /clickhouse-revision; \ + printf '#ifndef REVISION\n#define REVISION %s\n#endif\n#ifndef SVN_REVISION\n#define SVN_REVISION %s\n#endif\n' "${REV}" "${REV}" > /src/build/libs/libcommon/src/revision.h; } \ + && make -j"$(nproc)" clickhouse-server && make -j"$(nproc)" clickhouse-client + +# Install binaries + a multi-call shim + a minimal IPv4 config (this era ships +# no default config.xml in the tree). +RUN set -eu; \ + SRV=$(find /src/build -type f -executable -name clickhouse-server | head -1); \ + CLI=$(find /src/build -type f -executable -name clickhouse-client | head -1); \ + cp "$SRV" /usr/bin/clickhouse-server; cp "$CLI" /usr/bin/clickhouse-client; \ + printf '#!/bin/sh\ncmd="$1"; shift\nexec "/usr/bin/clickhouse-$cmd" "$@"\n' > /usr/bin/clickhouse; \ + chmod +x /usr/bin/clickhouse; \ + mkdir -p /etc/clickhouse-server /var/log/clickhouse-server \ + /opt/clickhouse/metadata/default /opt/clickhouse/data/default /opt/clickhouse/tmp +RUN cat > /etc/clickhouse-server/config.xml <<'EOF' + + error/var/log/clickhouse-server/clickhouse-server.log/var/log/clickhouse-server/err.log100M1 + 0.0.0.0 + 9000 + 8123 + /opt/clickhouse/ + /opt/clickhouse/tmp/ + + 1073741824 + 1073741824 + users.xml + default + default + + 65536 + + + ::/0 + default + default + + + +EOF +RUN cat > /etc/clickhouse-server/users.xml <<'EOF' + + + 65536 + + + ::/0 + default + default + + + +EOF + +EXPOSE 8123 9000 +WORKDIR / +ENTRYPOINT ["/usr/bin/clickhouse-server", "--config-file=/etc/clickhouse-server/config.xml"] diff --git a/versions/build-from-source/Dockerfile.ubuntu1604 b/versions/build-from-source/Dockerfile.ubuntu1604 new file mode 100644 index 0000000000..e929ea3deb --- /dev/null +++ b/versions/build-from-source/Dockerfile.ubuntu1604 @@ -0,0 +1,101 @@ +# Reproducible build of early ClickHouse (the 1.1.x era, 2016-2018) from source. +# +# These versions were never published as a Docker image or package, so we +# compile them in their contemporary environment: Ubuntu 16.04 + GCC 5, the +# toolchain named in doc/build.md of that era. The 1.1.x tags carry no git +# submodules (contrib is vendored in the tree), so a shallow tag checkout is +# self-contained. +# +# docker build --build-arg TAG=v1.1.54011-stable -t clickhouse-built:1.1.54011 \ +# -f Dockerfile.ubuntu1604 . +# +# The result behaves like the official server images: `clickhouse-server` +# entrypoint, a `clickhouse` multi-call shim so `clickhouse client` works, and +# IPv4 listening so it boots on hosts with IPv6 disabled. + +FROM ubuntu:16.04 + +# GCC version: the 2016 tags build with gcc-5; the later 1.1.x (>= ~54318, +# Dec 2017) require gcc >= 6, pulled from the ubuntu-toolchain-r PPA. +# ARG GCC is declared before apt so its layer is keyed on the compiler (one +# cached apt layer per GCC), but ARG TAG comes after so apt is shared across tags. +ARG GCC=5 + +# archive.ubuntu.com still serves xenial (16.04), so the default mirror works. +RUN set -eu; \ + if [ "${GCC}" != "5" ]; then \ + apt-get update && apt-get install -y --no-install-recommends software-properties-common && \ + add-apt-repository -y ppa:ubuntu-toolchain-r/test; \ + fi; \ + apt-get update && apt-get install -y --no-install-recommends \ + git ca-certificates cmake make pkg-config bash "gcc-${GCC}" "g++-${GCC}" \ + libicu-dev libreadline-dev libssl-dev unixodbc-dev libglib2.0-dev \ + libboost-dev libboost-thread-dev libboost-program-options-dev \ + libboost-system-dev libboost-regex-dev libboost-filesystem-dev \ + zlib1g-dev liblz4-dev libzstd-dev libdouble-conversion-dev \ + libsparsehash-dev libmysqlclient-dev libzookeeper-mt-dev tzdata \ + && rm -rf /var/lib/apt/lists/* + +ENV CC=gcc-${GCC} CXX=g++-${GCC} DISABLE_MONGODB=1 +# TAG may be a tag (v1.1.54318-stable), a bare tag (53973) or a raw commit SHA +# (for the untagged monthly snapshots). Fetch it by ref/SHA rather than clone +# --branch, which only accepts named refs. +ARG TAG +# The 2016 tree vendors contrib (no submodules). The later 1.1.x (>= ~54318, +# Dec 2017) use git submodules, and one of them (contrib/zookeeper at the dead +# ClickHouse-Extras/zookeeper.git) 404s today. Init submodules one-by-one and +# tolerate the dead one — cmake's find_zookeeper.cmake then falls back to the +# system libzookeeper-mt-dev automatically. +RUN git init -q /src && cd /src \ + && git remote add origin https://github.com/ClickHouse/ClickHouse.git \ + && git fetch --depth 1 origin "${TAG}" \ + && git checkout -q --detach FETCH_HEAD \ + && if [ -f .gitmodules ]; then \ + git config -f .gitmodules --get-regexp '\.path$' | awk '{print $2}' | while read -r p; do \ + git submodule update --init --recursive "$p" 2>/dev/null || echo "WARN: skipping unavailable submodule $p"; \ + done; \ + fi + +# The 2016 tree hardcodes -Werror in CMAKE_CXX_FLAGS and also leaks clang-only +# -Wno-* flags into the GCC build, which then fail under -Werror. Strip -Werror +# from the project's cmake so warnings (incl. unrecognised options) stay non-fatal. +# Also drop add_subdirectory(private): the 2016-06..08 tags reference a +# Yandex-internal Metrica directory ("private") that was never open-sourced, so +# the reference is a fatal cmake configure error in the public tree. +RUN find /src -name CMakeLists.txt -o -name '*.cmake' | xargs -r sed -i 's/-Werror//g' \ + && find /src -name CMakeLists.txt | xargs -r sed -i '/add_subdirectory *( *private *)/d' + +WORKDIR /src/build +# Build just the server and client. Fall back to the default target set if those +# names differ in a given revision. +RUN cmake .. -DCMAKE_BUILD_TYPE=Release \ + -DCMAKE_C_COMPILER="gcc-${GCC}" -DCMAKE_CXX_COMPILER="g++-${GCC}" \ + && ( make -j"$(nproc)" clickhouse-server clickhouse-client \ + || make -j"$(nproc)" clickhouse \ + || make -j"$(nproc)" ) + +# Install the binaries, a multi-call shim, and an IPv4 server config. +RUN set -eu; \ + SRV=$(find /src/build -type f -executable -name 'clickhouse-server' | head -1); \ + CLI=$(find /src/build -type f -executable -name 'clickhouse-client' | head -1); \ + MULTI=$(find /src/build -type f -executable -name 'clickhouse' | head -1); \ + if [ -n "$SRV" ]; then cp "$SRV" /usr/bin/clickhouse-server; fi; \ + if [ -n "$CLI" ]; then cp "$CLI" /usr/bin/clickhouse-client; fi; \ + if [ -n "$MULTI" ]; then cp "$MULTI" /usr/bin/clickhouse; \ + ln -sf /usr/bin/clickhouse /usr/bin/clickhouse-server; \ + ln -sf /usr/bin/clickhouse /usr/bin/clickhouse-client; \ + else \ + printf '#!/bin/sh\ncmd="$1"; shift\nexec "/usr/bin/clickhouse-$cmd" "$@"\n' > /usr/bin/clickhouse; \ + chmod +x /usr/bin/clickhouse; \ + fi; \ + mkdir -p /etc/clickhouse-server /var/log/clickhouse-server; \ + cp /src/dbms/src/Server/config.xml /etc/clickhouse-server/config.xml; \ + cp /src/dbms/src/Server/users.xml /etc/clickhouse-server/users.xml; \ + sed -i 's|::|0.0.0.0|' /etc/clickhouse-server/config.xml; \ + DATAPATH=$(sed -n 's@.*\(.*\).*@\1@p' /etc/clickhouse-server/config.xml | head -1); \ + DATAPATH=${DATAPATH:-/opt/clickhouse/}; \ + mkdir -p "${DATAPATH}/metadata/default" "${DATAPATH}/data/default" "${DATAPATH}/tmp" + +EXPOSE 8123 9000 +WORKDIR / +ENTRYPOINT ["/usr/bin/clickhouse-server", "--config-file=/etc/clickhouse-server/config.xml"] diff --git a/versions/build-from-source/build-all.sh b/versions/build-from-source/build-all.sh new file mode 100755 index 0000000000..5d0c73b0c1 --- /dev/null +++ b/versions/build-from-source/build-all.sh @@ -0,0 +1,42 @@ +#!/usr/bin/env bash +# Build every version listed in versions.txt from source (skipping ones whose +# image already exists). Up to JOBS builds run concurrently — these old, small +# codebases don't saturate the cores with a single `make -j$(nproc)`, so several +# builds in parallel fill the machine. Each build still uses make -j$(nproc). +# +# ./build-all.sh # build all in versions.txt +# ./build-all.sh 53973 ... # build only the given versions +# JOBS=8 ./build-all.sh # 8 concurrent builds (default 6) +# +# versions.txt is "[date]" per line. + +set -uo pipefail +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +LOGS="${HERE}/logs"; mkdir -p "${LOGS}" +JOBS="${JOBS:-6}" + +declare -A WANT=() +for a in "$@"; do WANT["$a"]=1; done + +build_one() { # version tag gcc + local version="$1" tag="$2" gcc="${3:-5}" + if sudo docker image inspect "clickhouse-built:${version}" >/dev/null 2>&1; then + echo "skip ${version}: image exists"; return + fi + if bash "${HERE}/build.sh" "${version}" "${tag}" "${gcc}" >"${LOGS}/build-${version}.log" 2>&1; then + echo "OK ${version}" + else + echo "FAILED ${version} (see ${LOGS}/build-${version}.log)" >&2 + fi +} + +echo "building from versions.txt with up to ${JOBS} concurrent builds" +while IFS=$'\t' read -r version tag _date gcc; do + [ -z "${version}" ] && continue + [ "$#" -gt 0 ] && [ -z "${WANT[$version]:-}" ] && continue + # Throttle to JOBS concurrent build_one jobs. + while [ "$(jobs -rp | wc -l)" -ge "${JOBS}" ]; do wait -n 2>/dev/null || sleep 2; done + build_one "${version}" "${tag}" "${gcc:-5}" & +done < "${HERE}/versions.txt" +wait +echo "build-all done" diff --git a/versions/build-from-source/build-monthly.sh b/versions/build-from-source/build-monthly.sh new file mode 100755 index 0000000000..88d484ff16 --- /dev/null +++ b/versions/build-from-source/build-monthly.sh @@ -0,0 +1,64 @@ +#!/usr/bin/env bash +# Build the untagged monthly snapshots (monthly.tsv) from source, newest to +# oldest, via Dockerfile.reconstruct (see reconstruct.sh). Each snapshot becomes +# image clickhouse-built:. Snapshots at/after 2016-03 have a public +# build system; earlier ones are reconstructed by transplanting the 2016-03 +# donor's build system + contrib. Going far enough back the transplant stops +# matching the source - that boundary is what this sweep discovers. +# +# ./build-monthly.sh # all months in monthly.tsv (newest first) +# ./build-monthly.sh 2016-02-01 ... # only the given months +# JOBS=3 ./build-monthly.sh # 3 concurrent builds (default 3) +# +# monthly.tsv is "" per line. + +set -uo pipefail +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +LOGS="${HERE}/logs"; mkdir -p "${LOGS}" +JOBS="${JOBS:-3}" + +declare -A WANT=() +for a in "$@"; do WANT["$a"]=1; done + +# Successfully built+booted monthly snapshots are recorded here (date, sha, +# commit-date), one per line — the record of every reconstructed patch set. +BUILT_RECORD="${HERE}/monthly-built.tsv" + +record_built() { # date sha commit_date + # append if not already recorded (atomic small-line append across jobs) + grep -q "^$1 " "${BUILT_RECORD}" 2>/dev/null || printf '%s\t%s\t%s\n' "$1" "$2" "$3" >> "${BUILT_RECORD}" +} + +build_one() { # date sha commit_date + local date="$1" sha="$2" cd="$3" + if sudo docker image inspect "clickhouse-built:${date}" >/dev/null 2>&1; then + echo "skip ${date}: image exists"; record_built "${date}" "${sha}" "${cd}"; return 0 + fi + if sudo docker buildx build --progress=plain --load \ + --build-arg "TAG=${sha}" --build-arg "GCC=${GCC:-5}" \ + -t "clickhouse-built:${date}" -f "${HERE}/Dockerfile.reconstruct" "${HERE}" \ + >"${LOGS}/reconstruct-${date}.log" 2>&1; then + # smoke test: server boots and answers a query + sudo docker rm -f "smoke-${date}" >/dev/null 2>&1 + sudo docker run -d --name "smoke-${date}" "clickhouse-built:${date}" >/dev/null 2>&1 + local v="" i + for i in $(seq 1 30); do + v=$(sudo docker exec "smoke-${date}" clickhouse client --query "SELECT version()" 2>/dev/null) && break + sleep 1 + done + sudo docker rm -f "smoke-${date}" >/dev/null 2>&1 + if [ -n "${v}" ]; then echo "OK ${date} (version ${v})"; record_built "${date}" "${sha}" "${cd}"; else echo "BUILT-BUT-NO-BOOT ${date}" >&2; fi + else + echo "FAILED ${date} (see ${LOGS}/reconstruct-${date}.log)" >&2 + fi +} + +# newest first (monthly.tsv is already newest->oldest) +while IFS=$'\t' read -r date sha cd; do + [ -z "${date}" ] && continue + [ "$#" -gt 0 ] && [ -z "${WANT[$date]:-}" ] && continue + while [ "$(jobs -rp | wc -l)" -ge "${JOBS}" ]; do wait -n 2>/dev/null || sleep 5; done + build_one "${date}" "${sha}" "${cd}" & +done < "${HERE}/monthly.tsv" +wait +echo "build-monthly done" diff --git a/versions/build-from-source/build.sh b/versions/build-from-source/build.sh new file mode 100755 index 0000000000..4923c5a546 --- /dev/null +++ b/versions/build-from-source/build.sh @@ -0,0 +1,36 @@ +#!/usr/bin/env bash +# Build an early ClickHouse version from source into a runnable Docker image. +# +# ./build.sh [tag] +# +# Produces image clickhouse-built: behaving like the official server +# images. is e.g. 1.1.54011; the git tag defaults to v-stable. +# +# Used to resurrect the handful of 1.1.x releases that were never published as +# an image or package (see ../list-versions.sh "unavailable" marker). The build +# environment (Ubuntu 16.04 + GCC 5) is pinned in Dockerfile.ubuntu1604. + +set -euo pipefail +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" + +VERSION="${1:?usage: build.sh [tag] [gcc]}" +TAG="${2:-v${VERSION}-stable}" +GCC="${3:-${GCC:-5}}" # gcc-5 for the 2016 tags; gcc-6 for >= ~1.1.54318 +IMAGE="clickhouse-built:${VERSION}" + +echo "building ${VERSION} (tag ${TAG}, gcc-${GCC}) -> ${IMAGE}" +# Use BuildKit (buildx); Docker's legacy builder hangs on recent engines. +# --progress=plain streams the full build log; --load puts the image in the +# local docker store. +sudo docker buildx build --progress=plain --load \ + --build-arg "TAG=${TAG}" --build-arg "GCC=${GCC}" -t "${IMAGE}" \ + -f "${HERE}/Dockerfile.ubuntu1604" "${HERE}" + +echo "built ${IMAGE}; smoke test:" +sudo docker rm -f chbuildtest >/dev/null 2>&1 +sudo docker run -d --name chbuildtest --ulimit nofile=262144:262144 "${IMAGE}" >/dev/null +for i in $(seq 1 30); do + sudo docker exec chbuildtest clickhouse client --query "SELECT version()" 2>/dev/null && break + sleep 1 +done +sudo docker rm -f chbuildtest >/dev/null 2>&1 diff --git a/versions/build-from-source/monthly-built.tsv b/versions/build-from-source/monthly-built.tsv new file mode 100644 index 0000000000..506a851b52 --- /dev/null +++ b/versions/build-from-source/monthly-built.tsv @@ -0,0 +1,50 @@ +2016-02-01 21fb1cca7c1342f02cda0b8df08df08a737eb7ee 2016-01-30 +2016-01-01 a6b01ee987c44a8291c616ffdedb63677ef0780a 2015-12-30 +2015-12-01 a7387d9ce431a1f288d1a4898fa0c0c36c765abc 2015-11-30 +2015-11-01 b17cc7181edbb05637b23f2f632d44d092e276e5 0.0.53350 +2015-10-01 c915538fa788697feea7910c7de5339f6b5a2ce2 0.0.53340 +2015-09-01 bc5007fc36ba2a81a6b45b9e9b0b26ff09efa994 0.0.53330 +2015-08-01 3eb7c149aba7bc650e27cc40885cf29e3332c94b 0.0.53320 +2015-07-01 719f0ee89cc560a96bec8d527ff7316f13101b33 0.0.53310 +2015-06-01 d378c76964b58eae67fbe41fa9d54694b5e88f99 boots(pre-version()) +2015-05-01 9dfd271c684c7f7792751a9ea7c72c11604afda5 boots(pre-version()) +2015-04-01 54397c6c7a99cfa7cb293651356c8b65143669e1 boots(pre-version()) +2015-03-01 3e1dafe3cb96b69fc34df13cd10bdc79adfe2818 boots(pre-version()) +2015-02-01 bd51359819f6ade46cf5de2e22e1fafc1d2080fc boots(pre-version()) +2015-01-01 43c75bb37b3b2f27d473296cc12d7e6314520505 boots(pre-version()) +2014-12-01 da4c4a05663581f9729ad1bd000481fbcd1a0353 boots(pre-version()) +2014-11-01 ec08b393dec6f513f13bcc8654055dea7069dc8b boots(pre-version()) +2014-09-01 b5624cd57fdcc354dc31348da0cb1a332fb24345 boots(pre-version()) +2014-10-01 4b83a8d3b3af54e7a816330398dfc1b3a37d686b boots(pre-version()) +2014-07-01 cbab5fb19339775223d43f5c69060096aa03f830 boots(pre-version()) +2014-08-01 36b0355c6861d695836e45cec56d7bea7dc444ae boots(pre-version()) +2014-06-01 a4fba5c6b19ceddf0340184c9f224b4c08fb80fe boots(pre-version()) +2014-05-01 4cee45e004f118bd8cf43f08a6b634021b106825 boots(pre-version()) +2014-04-01 c12d5231dd48ad2e82d4e5bfa62987b32dae8a51 boots(pre-version()) +2014-03-01 78e9b847e08b1ad50db5443dd896ad5e7100e01b boots(pre-version()) +2014-02-01 82b98ffb6d88b4a30257f623e628ecbe48925436 boots(pre-version()) +2014-01-01 5d7fb8ecce5987e108afba878e77d5364a93d960 boots(pre-version()) +2013-12-01 ff7cd145ca21b225b9734e5c08e9984475fb6d68 boots(pre-version()) +2013-11-01 6a12f5a43a902f1b843922261a6acbed88e25881 boots(pre-version()) +2013-10-01 c084250925a3fd2e30241f8ee7fb12a40ecc3002 boots(pre-version()) +2013-09-01 81d9d1deaadc29badf8122b1bd24e7aef9f2192f boots(pre-version()) +2013-08-01 0e96233d2b3c643e37fcc6302f090da4a442d3d6 boots(pre-version()) +2013-07-01 858b2805eb0eaea7efdf4c2409d0ccce9ec3ae1e boots(pre-version()) +2013-06-01 9848a42c8241cbd2fb85ffc5fc217f773a63f59d boots(pre-version()) +2013-05-01 da4454b46e583da4fa91f973b84cdb79cba2d90e boots(pre-version()) +2013-04-01 1f375250d6ca9bf2bcf5c1afbf6c08165e6dd7ce boots(pre-version()) +2013-03-01 ea816297c2ae16b50a20ebd684471a535b59e6b0 boots(pre-version()) +2013-02-01 b5937d0539a16754313c06d54b690d31d3f56561 boots(pre-version()) +2013-01-01 7b17b8f342adf339210d865f783bae4d1d5f6671 boots(pre-version()) +2012-12-01 914b41cf2f9bdcd79054d4466f1595a962f97053 boots(pre-version()) +2012-11-01 02b95a22975bf0d20cee6e6628d3e74aeac41e8d boots(pre-version()) +2012-10-01 f86d5d4d7e7e781e86d176e59fb0d669dec2e1fc boots(pre-version()) +2012-09-01 0652f9da9685041732d44d120da286a1a58c8ae4 boots(pre-version()) +2012-08-01 83337ec47416dc3166871561a54e3d52c57f1c52 boots(pre-version()) +2012-07-01 2c69e7eb4aaf8c82583520976e51cf6cbc7e467e boots(pre-version()) +2012-06-01 0b5d5b6a52ab4dd30f2ca6106bb7efdd904f9ddd boots(pre-version()) +2012-05-01 8b958c4f698830cbf22c038c9fb44616a331ed44 boots(native-handshake,0.0.28558) +2012-04-01 26096423fe53dccc5559952515fe421563cd23af boots(native-handshake,0.0.28558) +2012-03-01 c90243f7fe778ce4524341e5daad2a936bb8564f pre-server(no dbms/src/Server; earliest server is 2012-04) +2012-02-01 635f1638e2c6d5d70b3f95042398abdd2798648c pre-server(no dbms/src/Server; earliest server is 2012-04) +2012-01-01 7182920cecd3ec7d1e6fffd64ec52679d4e111ef pre-server(no dbms/src/Server; earliest server is 2012-04) diff --git a/versions/build-from-source/monthly.tsv b/versions/build-from-source/monthly.tsv new file mode 100644 index 0000000000..5eca8421b0 --- /dev/null +++ b/versions/build-from-source/monthly.tsv @@ -0,0 +1,53 @@ +2016-05-01 2b1550105cec9ff8192606560931191d69101397 2016-04-28 53452 +2016-04-01 f41bba57a546430ed2c3d3c5e97a599003a6889d 2016-04-01 53365 +2016-03-01 5360c78806e043d0d2bf3de15a363f87fbdaf5f4 2016-03-01 53265 +2016-02-01 21fb1cca7c1342f02cda0b8df08df08a737eb7ee 2016-01-30 53166 +2016-01-01 a6b01ee987c44a8291c616ffdedb63677ef0780a 2015-12-30 53066 +2015-12-01 a7387d9ce431a1f288d1a4898fa0c0c36c765abc 2015-11-30 52969 +2015-11-01 b17cc7181edbb05637b23f2f632d44d092e276e5 2015-10-31 52872 +2015-10-01 c915538fa788697feea7910c7de5339f6b5a2ce2 2015-09-30 52773 +2015-09-01 bc5007fc36ba2a81a6b45b9e9b0b26ff09efa994 2015-08-31 52676 +2015-08-01 3eb7c149aba7bc650e27cc40885cf29e3332c94b 2015-07-31 52576 +2015-07-01 719f0ee89cc560a96bec8d527ff7316f13101b33 2015-06-30 52476 +2015-06-01 d378c76964b58eae67fbe41fa9d54694b5e88f99 2015-05-31 52380 +2015-05-01 9dfd271c684c7f7792751a9ea7c72c11604afda5 2015-05-01 52283 +2015-04-01 54397c6c7a99cfa7cb293651356c8b65143669e1 2015-04-01 52186 +2015-03-01 3e1dafe3cb96b69fc34df13cd10bdc79adfe2818 2015-02-28 52083 +2015-02-01 bd51359819f6ade46cf5de2e22e1fafc1d2080fc 2015-02-01 51996 +2015-01-01 43c75bb37b3b2f27d473296cc12d7e6314520505 2014-12-31 51888 +2014-12-01 da4c4a05663581f9729ad1bd000481fbcd1a0353 2014-11-30 51733 +2014-11-01 ec08b393dec6f513f13bcc8654055dea7069dc8b 2014-11-01 51589 +2014-10-01 4b83a8d3b3af54e7a816330398dfc1b3a37d686b 2014-10-01 51408 +2014-09-01 b5624cd57fdcc354dc31348da0cb1a332fb24345 2014-08-29 51207 +2014-08-01 36b0355c6861d695836e45cec56d7bea7dc444ae 2014-08-01 51037 +2014-07-01 cbab5fb19339775223d43f5c69060096aa03f830 2014-07-01 50848 +2014-06-01 a4fba5c6b19ceddf0340184c9f224b4c08fb80fe 2014-05-30 50653 +2014-05-01 4cee45e004f118bd8cf43f08a6b634021b106825 2014-04-30 50471 +2014-04-01 c12d5231dd48ad2e82d4e5bfa62987b32dae8a51 2014-03-29 50276 +2014-03-01 78e9b847e08b1ad50db5443dd896ad5e7100e01b 2014-03-01 43454 +2014-02-01 82b98ffb6d88b4a30257f623e628ecbe48925436 2014-01-29 38671 +2014-01-01 5d7fb8ecce5987e108afba878e77d5364a93d960 2013-12-30 37961 +2013-12-01 ff7cd145ca21b225b9734e5c08e9984475fb6d68 2013-11-30 37252 +2013-11-01 6a12f5a43a902f1b843922261a6acbed88e25881 2013-10-31 36542 +2013-10-01 c084250925a3fd2e30241f8ee7fb12a40ecc3002 2013-09-30 35809 +2013-09-01 81d9d1deaadc29badf8122b1bd24e7aef9f2192f 2013-08-31 35069 +2013-08-01 0e96233d2b3c643e37fcc6302f090da4a442d3d6 2013-07-31 34180 +2013-07-01 858b2805eb0eaea7efdf4c2409d0ccce9ec3ae1e 2013-06-30 33243 +2013-06-01 9848a42c8241cbd2fb85ffc5fc217f773a63f59d 2013-05-31 32313 +2013-05-01 da4454b46e583da4fa91f973b84cdb79cba2d90e 2013-04-30 31335 +2013-04-01 1f375250d6ca9bf2bcf5c1afbf6c08165e6dd7ce 2013-03-31 30388 +2013-03-01 ea816297c2ae16b50a20ebd684471a535b59e6b0 2013-02-28 29410 +2013-02-01 b5937d0539a16754313c06d54b690d31d3f56561 2013-01-28 27270 +2013-01-01 7b17b8f342adf339210d865f783bae4d1d5f6671 2012-12-29 25199 +2012-12-01 914b41cf2f9bdcd79054d4466f1595a962f97053 2012-11-30 23197 +2012-11-01 02b95a22975bf0d20cee6e6628d3e74aeac41e8d 2012-10-30 21056 +2012-10-01 f86d5d4d7e7e781e86d176e59fb0d669dec2e1fc 2012-09-28 18847 +2012-09-01 0652f9da9685041732d44d120da286a1a58c8ae4 2012-08-31 16914 +2012-08-01 83337ec47416dc3166871561a54e3d52c57f1c52 2012-07-31 14774 +2012-07-01 2c69e7eb4aaf8c82583520976e51cf6cbc7e467e 2012-06-25 12289 +2012-06-01 0b5d5b6a52ab4dd30f2ca6106bb7efdd904f9ddd 2012-05-31 10563 +2012-05-01 8b958c4f698830cbf22c038c9fb44616a331ed44 2012-04-14 7318 +2012-04-01 26096423fe53dccc5559952515fe421563cd23af 2012-03-30 6282 +2012-03-01 c90243f7fe778ce4524341e5daad2a936bb8564f 2012-02-27 4073 +2012-02-01 635f1638e2c6d5d70b3f95042398abdd2798648c 2012-01-31 2209 +2012-01-01 7182920cecd3ec7d1e6fffd64ec52679d4e111ef 2011-12-30 0 diff --git a/versions/build-from-source/reconstruct.sh b/versions/build-from-source/reconstruct.sh new file mode 100755 index 0000000000..1995028520 --- /dev/null +++ b/versions/build-from-source/reconstruct.sh @@ -0,0 +1,1571 @@ +#!/bin/bash +# Reconstruct the build system for a pre-2016-03 ClickHouse snapshot. +# +# The public repo only became self-contained (root CMakeLists + contrib/) at +# 2016-03. Earlier snapshots have the *source* but no build system and no +# vendored libraries. This script runs inside a checkout where the target +# source is at /src and a donor commit's build system (root CMakeLists, all +# per-dir CMakeLists, cmake modules and contrib/) has already been overlaid on +# top (see Dockerfile.reconstruct). It then reconciles the donor build files +# with the older source: +# +# * glob libcommon/libdaemon sources -> absorbs file renames +# (Daemon.cpp->BaseDaemon.cpp, Revision.cpp->ClickHouseRevision.cpp, ...) +# * prune donor-listed files absent here -> handles added/removed files +# * disable the tests/ targets -> they list snapshot-specific files +# * QuickLZ -> header-only stub (dropped at open-sourcing; never imported. +# The quicklz codec is never produced/consumed with LZ4/ZSTD data) +# * re2_st -> generated from contrib/libre2 via the donor's create_st_headers.sh +# * MongoDB -> throwing stub (legacy mongoclient driver never vendored) +# +# Idempotent-ish: intended to run once on a fresh overlay. + +set -eu +cd /src + +# -- strip -Werror (and the clang-only -Wno-* flags that leak into the gcc build) -- +find /src -name CMakeLists.txt -o -name '*.cmake' | xargs -r sed -i 's/-Werror//g' + +# -- drop the tests/ subdirectories: they enumerate files that don't all exist +# in an older snapshot, which is a fatal cmake configure error -- +find /src -name CMakeLists.txt | xargs -r sed -i 's/add_subdirectory *( *tests *)//g' +sed -i 's/INCLUDE(add.test.cmake)//' CMakeLists.txt || true + +# -- drop add_subdirectory(private): the Yandex-internal Metrica code was never +# open-sourced (appears in the 2016-06+ trees). -- +find /src -name CMakeLists.txt | xargs -r sed -i '/add_subdirectory *( *private *)/d' + +# -- drop the utils/ subdirectory: standalone tools we don't need, some of which +# reference sources absent in older snapshots (a fatal configure error). -- +sed -i '/add_subdirectory *( *utils *)/d' CMakeLists.txt || true + +# -- Old libstdc++ ABI: this era used the refcounted (COW) std::string (8 bytes), +# which the code's sizing assumes (e.g. Field's DBMS_TOTAL_FIELD_SIZE=32). +# Build with _GLIBCXX_USE_CXX11_ABI=0 to get that string back (see the CXX +# flags injection below), rather than resizing structs for the new 32-byte ABI. -- + +# -- glob the two small libraries so renamed sources are still picked up -- +cat > libs/libdaemon/CMakeLists.txt <<'EOF' +file(GLOB daemon_src src/*.cpp) +add_library(daemon ${daemon_src}) +target_link_libraries(daemon dbms) +EOF + +python3 - <<'PY' +import re, os, glob +# CMakeLists in this era carry UTF-8 (Russian) comments; the container's Python +# may default to ASCII, so read/write with an explicit codec that round-trips +# arbitrary bytes. +def rd(p): return open(p, encoding="utf-8", errors="surrogateescape").read() +def wr(p, s): open(p, "w", encoding="utf-8", errors="surrogateescape").write(s) + +# libcommon: replace the explicit source list with a glob (handles renames like +# Revision.cpp -> ClickHouseRevision.cpp where the target has a file the donor +# build files don't list). +f = "libs/libcommon/CMakeLists.txt"; s = rd(f) +s = re.sub(r"add_library\s*\(\s*common.*?\)", + "file(GLOB common_src src/*.cpp)\nadd_library(common ${common_src})", + s, count=1, flags=re.S) +wr(f, s) + +# libmysqlxx: same treatment. The donor lists sources explicitly (incl. Value.cpp) +# and omits String.cpp, but pre-2014-06 defines mysqlxx::String::throwException in +# String.cpp -> undefined reference at link. Glob so the target's own sources compile. +f = "libs/libmysqlxx/CMakeLists.txt" +if os.path.exists(f): + s = rd(f) + s = re.sub(r"add_library\s*\(\s*mysqlxx\b.*?\)", + "file(GLOB mysqlxx_src src/*.cpp)\nadd_library(mysqlxx ${mysqlxx_src})", + s, count=1, flags=re.S) + # The donor CMakeLists has a POST_BUILD step running libmysqlxx/patch.sh to patch + # the bundled mysqlclient. Newer target trees ship that script, but the oldest + # (pre-2014) don't -- and the overlay only brings CMakeLists/.cmake, not patch.sh, + # so the command fails with "not found" (Error 127). We link the *system* + # libmysqlclient and never touch MySQL in the benchmark, so when the script is + # absent just drop the custom command. Guarded on patch.sh existence -> no-op on + # trees that ship it (they keep patching, as before). + if not os.path.exists("libs/libmysqlxx/patch.sh"): + s = re.sub(r"ADD_CUSTOM_COMMAND\s*\([^)]*patch\.sh[^)]*\)", "", s, flags=re.I|re.S) + wr(f, s) + +# Drop the (never-vendored) mongoclient link name wherever it appears. +f = "dbms/CMakeLists.txt"; wr(f, re.sub(r"\bmongoclient\b", "", rd(f))) + +# The dbms library is one huge explicit source list in dbms/CMakeLists.txt. +# Replace it with a recursive glob so sources renamed/moved between the target +# snapshot and the donor are all compiled (Server/Client are separate +# executables, tests are disabled). cmake 3.5 has no list(FILTER), so filter in +# a foreach. +f = "dbms/CMakeLists.txt"; s = rd(f) +glob_block = ( + 'file(GLOB_RECURSE dbms_all_sources src/*.cpp)\n' + 'set(dbms_sources "")\n' + 'foreach(f ${dbms_all_sources})\n' + ' if((NOT f MATCHES "/(Server|ODBC|tests)/") AND (NOT f MATCHES "/Client/(Client|Benchmark).cpp"))\n' + ' list(APPEND dbms_sources ${f})\n' + ' endif()\n' + 'endforeach()\n' + 'add_library (dbms ${dbms_sources})' +) +# The dbms lib includes the Client library code (Connection*.cpp) but not the +# client executable mains (Client.cpp/Benchmark.cpp); all of Server/ is the +# server executable; ODBC is a separate driver; tests are disabled. +s = re.sub(r"add_library\s*\(\s*dbms\b.*?\)", glob_block, s, count=1, flags=re.S) +wr(f, s) + +# Generic prune: the donor build files (2016-03) list sources that an *older* +# target snapshot doesn't have yet (files added later). For every add_library / +# add_executable in every CMakeLists, drop any listed source file that doesn't +# exist relative to that CMakeLists's directory — otherwise cmake configure +# fails with "Cannot find source file". +SRC_RE = re.compile(r".+\.(cpp|cc|cxx|c|h|hpp|inc)$", re.I) +def prune(cml): + d = os.path.dirname(cml); s = rd(cml) + dropped = set() + def fix(m): + head, body = m.group(1), m.group(2) + toks = body.split() + kept = [t for t in toks + if not SRC_RE.match(t) or os.path.exists(os.path.join(d, t))] + # If an executable listed source files but every one of them is absent in + # this (older) snapshot -- e.g. clickhouse-benchmark before Benchmark.cpp + # existed -- pruning would leave add_executable() with no sources, which + # cmake rejects. Drop the whole target instead (its link/INSTALL lines are + # removed below). We never build anything but clickhouse-server/-client. + emptied = (any(SRC_RE.match(t) for t in toks) + and not any(SRC_RE.match(t) for t in kept)) + if "add_executable" in head.lower() and emptied: + tm = re.search(r"\(\s*([^\s)]+)", head) + if tm: + dropped.add(tm.group(1)) + return "" + if "add_library" in head.lower() and emptied: + # A library whose every listed source is absent in this older snapshot + # (e.g. zkutil before libzkutil had any .cpp). Unlike an executable it + # can be a link dependency of dbms, so we can't drop it -- give it an + # empty stub TU so cmake can determine a link language and build an + # (empty) archive. This era has no calls into it, so no undefined refs. + stub = os.path.join(d, "reconstruct_stub.cpp") + open(stub, "w").write("// Added by reconstruct.sh: empty TU so this " + "source-less library links.\n") + kept.append("reconstruct_stub.cpp") + return head + " " + " ".join(kept) + ")" + s2 = re.sub(r"(add_(?:library|executable)\s*\(\s*[^\s)]+)(.*?)\)", fix, s, flags=re.S|re.I) + for tgt in dropped: + # a dropped target can't be linked or installed; strip those statements too. + s2 = re.sub(r"target_link_libraries\s*\(\s*" + re.escape(tgt) + r"\b.*?\)", "", s2, flags=re.S|re.I) + s2 = re.sub(r"INSTALL\s*\([^)]*\b" + re.escape(tgt) + r"\b[^)]*\)", "", s2, flags=re.S|re.I) + # Drop add_subdirectory(X) when X isn't an existing directory: the donor build + # lists component dirs (e.g. TableFunctions) that an older snapshot doesn't have + # yet. cmake errors on a missing subdir; the code that would have linked its + # library isn't present in this era's globbed dbms sources either, so no dangling + # refs. Skip variable-driven forms -- only prune bare directory-name arguments. + def fix_subdir(m): + arg = m.group(1) + if "$" in arg or "{" in arg: + return m.group(0) + return m.group(0) if os.path.isdir(os.path.join(d, arg)) else "" + s2 = re.sub(r"add_subdirectory\s*\(\s*([^\s)]+)\s*\)", fix_subdir, s2, flags=re.I) + if s2 != s: wr(cml, s2) +# os.walk (not glob(recursive=), which needs Python 3.5+; trusty ships 3.4). +for root, _dirs, files in os.walk("."): + if "CMakeLists.txt" in files: + prune(os.path.join(root, "CMakeLists.txt")) +PY + +# -- QuickLZ compile/link stub (dead code path: our data is LZ4/ZSTD) -- +mkdir -p contrib/quicklz-stub/quicklz +cat > contrib/quicklz-stub/quicklz/quicklz_level1.h <<'EOF' +#pragma once +#include +#include +#include +// QuickLZ was removed at the 2016-03 open-sourcing and never imported to the public +// repo. Data is compressed with LZ4/ZSTD, not QuickLZ, so qlz_compress/qlz_decompress +// are never called and only need to link. BUT the compressed-block reader parses the +// block-size HEADER via qlz_size_compressed/qlz_size_decompressed for LZ4 blocks too +// (the pre-2015 CompressedWriteBuffer stores the LZ4 sizes in QuickLZ header layout), +// so those two must be real: read the little-endian sizes from the header -- 4-byte +// "long" form when the 0x02 bit is set, which is what ClickHouse always writes. +// (A no-op returning 0 here silently corrupts every read -> "Checksum doesn't match".) +struct qlz_state_compress { char scratch[1000000]; }; +struct qlz_state_decompress { char scratch[1000000]; }; +inline size_t qlz_size_compressed(const char * source) +{ + if (static_cast(source[0]) & 2) { uint32_t n; std::memcpy(&n, source + 1, 4); return n; } + return static_cast(source[1]); +} +inline size_t qlz_size_decompressed(const char * source) +{ + if (static_cast(source[0]) & 2) { uint32_t n; std::memcpy(&n, source + 5, 4); return n; } + return static_cast(source[2]); +} +inline size_t qlz_compress(const void *, char * dst, size_t size, qlz_state_compress *) { (void)dst; return size; } +inline size_t qlz_decompress(const char *, void *, qlz_state_decompress *) { return 0; } +EOF +cp contrib/quicklz-stub/quicklz/quicklz_level1.h contrib/quicklz-stub/quicklz/quicklz_level2.h +cp contrib/quicklz-stub/quicklz/quicklz_level1.h contrib/quicklz-stub/quicklz/quicklz_level3.h + +# -- vendor Poco/Ext/ScopedTry.h: a Poco extension (scoped try-lock) the early +# trees use but that isn't in the donor's Poco. Placed on Poco's include path. -- +mkdir -p contrib/libpoco/Foundation/include/Poco/Ext +cat > contrib/libpoco/Foundation/include/Poco/Ext/ScopedTry.h <<'EOF' +#pragma once +// Scoped try-lock (default-construct, then lock(&mutex) attempts tryLock and +// returns success; the mutex is released on scope exit if held). Reconstructed +// to match the early-ClickHouse usage in MergeTreeData::grabOldParts. +namespace Poco +{ +template +class ScopedTry +{ +public: + ScopedTry() : _mutex(0) {} + ~ScopedTry() { if (_mutex) _mutex->unlock(); } + bool lock(M * mutex) { if (mutex->tryLock()) { _mutex = mutex; return true; } return false; } +private: + M * _mutex; + ScopedTry(const ScopedTry &); + ScopedTry & operator=(const ScopedTry &); +}; +} +EOF + +# -- statdaemons compat: the early trees pull several headers from an external +# Yandex library ("statdaemons") that the donor split up and renamed: +# * the embedded dictionaries -> DB/Dictionaries/Embedded/ (header-only), and +# * the daemon base class Daemon -> libs/libdaemon's BaseDaemon. +# Both were overlaid from the donor by the Dockerfile. Expose them at the old +# paths (dict headers forward to Embedded; daemon.h forwards +# to BaseDaemon with a typedef for the old class name; Interests.h — legacy +# OLAP interest categories, unused by the benchmark — is an empty stub). -- +mkdir -p contrib/statdaemons-compat/statdaemons +# -- DB::Exception: in the oldest trees (pre ~2015-11) the class itself lived in the +# never-public external -- DB/Core/Exception.h merely +# #includes it and adds free functions (throwFromErrno etc.). Later the class was +# inlined in-repo (DB/Common/Exception.h). If the tree defines it we let the +# auto-map below forward there; otherwise vendor an +# equivalent class (matching what 2015-12 inlined). It is created *before* the +# auto-map so the auto-map leaves it untouched. Header-only, so it adds no link +# symbols and the era's own Exception.cpp still provides the free functions. The +# StackTrace it carries was external in that era too, so stub it (no-op +# toString(); stack traces are diagnostic only, never needed by the benchmark). -- +if ! grep -rqlE 'class Exception[[:space:]]*:[[:space:]]*public[[:space:]]+Poco::Exception' dbms/include 2>/dev/null; then + cat > contrib/statdaemons-compat/statdaemons/Exception.h <<'EOF' +#pragma once +// Vendored DB::Exception + StackTrace for pre-2015-11 trees (both lived in the +// never-public external statdaemons library). Interface matches the version +// 2015-12 inlined into DB/Common/Exception.h. +#include +#include +#include + +/// Stub: real stack capture was in the external lib; only toString() is ever used +/// (for diagnostics), so an empty trace is sufficient for the benchmark. +class StackTrace +{ +public: + StackTrace() {} + std::string toString() const { return {}; } +}; + +namespace DB +{ + +class Exception : public Poco::Exception +{ +public: + Exception(int code = 0) : Poco::Exception(code) {} + Exception(const std::string & msg, int code = 0) : Poco::Exception(msg, code) {} + Exception(const std::string & msg, const std::string & arg, int code = 0) : Poco::Exception(msg, arg, code) {} + Exception(const std::string & msg, const Exception & exc, int code = 0) : Poco::Exception(msg, exc, code), trace(exc.trace) {} + Exception(const Exception & exc) : Poco::Exception(exc), trace(exc.trace) {} + explicit Exception(const Poco::Exception & exc) : Poco::Exception(exc.displayText()) {} + ~Exception() throw() {} + Exception & operator = (const Exception & exc) { Poco::Exception::operator=(exc); trace = exc.trace; return *this; } + const char * name() const throw() { return "DB::Exception"; } + const char * className() const throw() { return "DB::Exception"; } + DB::Exception * clone() const { return new DB::Exception(*this); } + void rethrow() const { throw *this; } + void addMessage(const std::string & arg) { extendedMessage(arg); } + const StackTrace & getStackTrace() const { return trace; } +private: + StackTrace trace; +}; + +/// Carries a saved errno; thrown by throwFromErrno(). (Also external in this era.) +class ErrnoException : public Exception +{ +public: + ErrnoException(int code = 0, int saved_errno_ = 0) : Exception(code), saved_errno(saved_errno_) {} + ErrnoException(const std::string & msg, int code = 0, int saved_errno_ = 0) : Exception(msg, code), saved_errno(saved_errno_) {} + ErrnoException(const std::string & msg, const std::string & arg, int code = 0, int saved_errno_ = 0) : Exception(msg, arg, code), saved_errno(saved_errno_) {} + ErrnoException(const std::string & msg, const Exception & exc, int code = 0, int saved_errno_ = 0) : Exception(msg, exc, code), saved_errno(saved_errno_) {} + ErrnoException(const ErrnoException & exc) : Exception(exc), saved_errno(exc.saved_errno) {} + int getErrno() const { return saved_errno; } +private: + int saved_errno; +}; + +} +EOF +fi +# Some back-ported (newer) headers -- NetException.h, and the PATCH_FILL +# CounterInFile.h -- include ; before the class was inlined +# there (2015-12) Exception lived at DB/Core. Forward the DB/Common path to it (only +# when the tree has no real DB/Common/Exception.h). This is independent of where the +# Exception *class* is defined -- pre-2015-11 trees keep it in DB/Core whether or not +# they vendor it -- so it lives outside the vendor-Exception guard above. +if [ ! -e dbms/include/DB/Common/Exception.h ] && [ -e dbms/include/DB/Core/Exception.h ]; then + mkdir -p dbms/include/DB/Common + { + printf '#pragma once\n#include \n' + # tryLogCurrentException(Poco::Logger *) overload was added after 2015-03; + # the back-ported ErrorHandlers.h calls it. Provide it (forwarding to the era's + # name-based overload) only when the tree already has some tryLogCurrentException + # to forward to but lacks the Poco::Logger* variant. The oldest snapshots + # (pre-2014) have no tryLogCurrentException at all -- adding the overload there + # would make its body call a non-existent function and recurse onto itself, and + # nothing needs it anyway (they have no ErrorHandlers.h). + if grep -q 'tryLogCurrentException' dbms/include/DB/Core/Exception.h 2>/dev/null \ + && ! grep -q 'tryLogCurrentException(Poco::Logger' dbms/include/DB/Core/Exception.h 2>/dev/null; then + printf '#include \n' + printf 'namespace DB { inline void tryLogCurrentException(Poco::Logger * logger, const std::string & = "") { tryLogCurrentException(logger ? logger->name().c_str() : ""); } }\n' + fi + } > dbms/include/DB/Common/Exception.h +fi +# The back-ported SummingSortedBlockInputStream.h includes ; +# before that split the Field visitors (FieldVisitorSum etc.) lived in DB/Core/Field.h. +# Forward the newer path to Field.h when the split-out header is absent. +if [ ! -e dbms/include/DB/Core/FieldVisitors.h ] && [ -e dbms/include/DB/Core/Field.h ]; then + printf '#pragma once\n#include \n' > dbms/include/DB/Core/FieldVisitors.h +fi + +# -- PoolWithFailoverBase (pre-2015-07): the failover connection-pool base lived in +# the never-public external statdaemons library and took TWO template args +# . It was reworked into a single-arg in-repo class in +# 2015-07; the back-ported (PATCH_FILL) 1-arg version is incompatible with this +# era's ConnectionPoolWithFailover (wrong arity, needs Settings::skip_unavailable_shards). +# Only ConnectionPoolWithFailover derives from it, and the single-node benchmark +# never configures remote_servers, so the pool is never even constructed. Vendor a +# minimal 2-arg base exposing just the surface the derived class uses (ctor, +# nested_pools[].pool/.state.priority, get/getMany/tryGet); get/getMany simply +# throw. Created before the auto-map so it wins over the 1-arg forward, which means +# the incompatible filled base is never included. Guarded on the 2-arg form, so it +# is skipped on 2015-07+ (their 1-arg ConnectionPoolWithFailover uses the fill). -- +if [ -f dbms/include/DB/Client/ConnectionPoolWithFailover.h ] \ + && grep -qE 'PoolWithFailoverBase<[^,>]+,' dbms/include/DB/Client/ConnectionPoolWithFailover.h; then + cat > contrib/statdaemons-compat/statdaemons/PoolWithFailoverBase.h <<'EOF' +#pragma once +// Vendored 2-argument PoolWithFailoverBase for pre-2015-07 trees (the failover pool +// base was external then). Distributed connections are never opened by the +// single-node benchmark, so this only needs to compile and expose the small surface +// ConnectionPoolWithFailover uses; get()/getMany() throw if ever called. +#include +#include +#include +#include +#include +#include +#include + +template +class PoolWithFailoverBase +{ +public: + using NestedPool = TNestedPool; + using NestedPoolPtr = Poco::SharedPtr; + using Entry = typename TNestedPool::Entry; + + // The element carries priority both directly (.priority, ~2015-03 era) and nested + // (.state.priority, ~2015-06 era) so either era's ConnectionPoolWithFailover + // compiles. get()/getMany() throw, so the value is never actually consulted. + struct PoolState { std::size_t priority = 0; }; + struct PoolWithState { NestedPoolPtr pool; PoolState state; std::size_t priority = 0; }; + using NestedPools = std::vector; + + PoolWithFailoverBase(NestedPools & nested_pools_, std::size_t max_tries_, + time_t decrease_error_period_, Poco::Logger * log_) + : max_tries(max_tries_), decrease_error_period(decrease_error_period_), log(log_) + { + nested_pools.reserve(nested_pools_.size()); + for (const auto & p : nested_pools_) + { + PoolWithState pws; + pws.pool = p; + nested_pools.push_back(pws); + } + } + virtual ~PoolWithFailoverBase() {} + + Entry get(TSettings) + { + throw Poco::Exception("Distributed connection pool is not available in this reconstructed build"); + } + std::vector getMany(TSettings) + { + throw Poco::Exception("Distributed connection pool is not available in this reconstructed build"); + } + +protected: + virtual bool tryGet(NestedPoolPtr pool, TSettings settings, Entry & out_entry, + std::stringstream & fail_message) = 0; + + std::vector nested_pools; + std::size_t max_tries; + time_t decrease_error_period; + Poco::Logger * log; +}; +EOF +fi +# Auto-map every donor header of the same basename to the old +# path: the statdaemons library's contents were dispersed into DB/Common/, +# common/ and DB/Dictionaries/Embedded/ (e.g. Exception.h -> DB/Common/Exception.h, +# RegionsHierarchies.h -> Embedded/). First match wins (DB/Common preferred). +# (DB/Core is scanned last so the newer DB/Common location wins when both exist: +# in the oldest trees Exception.h/etc. still lived under DB/Core, not DB/Common.) +for pair in "dbms/include/DB/Common:DB/Common" "libs/libcommon/include/common:common" "dbms/include/DB/Dictionaries/Embedded:DB/Dictionaries/Embedded" "dbms/include/DB/Core:DB/Core"; do + dir="${pair%%:*}"; inc="${pair##*:}"; [ -d "$dir" ] || continue + for h in "$dir"/*.h; do + [ -f "$h" ] || continue; base="$(basename "$h")" + w="contrib/statdaemons-compat/statdaemons/${base}" + [ -e "$w" ] || printf '#pragma once\n#include <%s/%s>\n' "$inc" "$base" > "$w" + done +done +if [ -f libs/libdaemon/include/daemon/BaseDaemon.h ]; then + printf '#pragma once\n#include \ntypedef BaseDaemon Daemon;\n' \ + > contrib/statdaemons-compat/statdaemons/daemon.h + # Pre-2013-05 the daemon lived at (implemented by the era's own + # libcommon/src/daemon.cpp against the never-public external Yandex/daemon.h). Map + # that include to BaseDaemon too, and drop the obsolete daemon.cpp -- BaseDaemon + # (libdaemon) is the daemon now, so the old implementation would only conflict. + printf '#pragma once\n#include \ntypedef BaseDaemon Daemon;\n' \ + > libs/libcommon/include/common/daemon.h + rm -f libs/libcommon/src/daemon.cpp + # The donor's BaseDaemon is newer and drags in evolved deps (zkutil/graphite) + # the older tree lacks. Replace it with a thin no-op base carrying just the + # API the early Server/TCPHandler use (Poco::Util::ServerApplication plus + # isCancelled/writeToGraphite/getGraphiteWriter, and the Application + # using-decl the old daemon.h exposed). Metrics/cancellation become no-ops, + # which is fine for the benchmark. + cat > libs/libdaemon/include/daemon/GraphiteWriter.h <<'EOF' +#pragma once +#include +#include +#include +#include +class GraphiteWriter +{ +public: + template using KeyValuePair = std::pair; + template using KeyValueVector = std::vector>; + template void write(const std::string &, const T &, time_t = 0, const std::string & = "") {} + template void write(const KeyValueVector &, time_t = 0, const std::string & = "") {} +}; +EOF + cat > libs/libdaemon/include/daemon/BaseDaemon.h <<'EOF' +#pragma once +#include +#include +#include +#include +#include +#include +#include +#include +#include +using Poco::Util::Application; +class BaseDaemon : public Poco::Util::ServerApplication +{ +public: + bool isCancelled() { return is_cancelled; } + static BaseDaemon & instance() { return dynamic_cast(Poco::Util::Application::instance()); } + // The real daemon's sleep() woke early on shutdown; a plain sleep is fine here + // (used only for retry backoff, e.g. mysqlxx connection-pool reconnects). + void sleep(double seconds) { std::this_thread::sleep_for(std::chrono::duration(seconds)); } + template void writeToGraphite(const std::string & key, const T & value, time_t timestamp = 0, const std::string & custom_root_path = "") { if (graphite_writer) graphite_writer->write(key, value, timestamp, custom_root_path); } + template void writeToGraphite(const GraphiteWriter::KeyValueVector & key_vals, time_t timestamp = 0, const std::string & custom_root_path = "") { if (graphite_writer) graphite_writer->write(key_vals, timestamp, custom_root_path); } + GraphiteWriter * getGraphiteWriter() { return graphite_writer.get(); } +protected: + // The real daemon registered --config-file and loaded it; replicate that so + // the server accepts the entrypoint's --config-file and reads its config. + void defineOptions(Poco::Util::OptionSet & options) override + { + Poco::Util::ServerApplication::defineOptions(options); + options.addOption(Poco::Util::Option("config-file", "C", "config file").required(false) + .repeatable(false).argument("").binding("config-file")); + } + void initialize(Poco::Util::Application & self) override + { + if (config().hasProperty("config-file")) + loadConfiguration(config().getString("config-file")); + Poco::Util::ServerApplication::initialize(self); + } + bool is_cancelled = false; + std::unique_ptr graphite_writer; +}; +EOF + rm -f libs/libdaemon/src/*.cpp + printf '// minimal daemon base (see reconstruct.sh)\n' > libs/libdaemon/src/BaseDaemon.cpp +fi +# statdaemons/Interests.h: the never-public header of interest-category bit flags that +# the pre-2014 legacy OLAP handler (dbms/src/Server/OLAPAttributesMetadata.h) masks +# against. The OLAP HTTP interface is dead code for the benchmark, so the exact bit +# values are immaterial -- distinct flags are enough to compile. Unscoped enum at global +# scope so the enumerators are visible unqualified, as the original was. +cat > contrib/statdaemons-compat/statdaemons/Interests.h <<'EOF' +#pragma once +enum Interests +{ + PHOTO = 1 << 0, MOVIE_PREMIERES = 1 << 1, TOURISM = 1 << 2, FAMILY_AND_CHILDREN = 1 << 3, + FINANCE = 1 << 4, B2B = 1 << 5, CARS = 1 << 6, MOBILE_AND_INTERNET_COMMUNICATIONS = 1 << 7, + BUILDING = 1 << 8, CULINARY = 1 << 9, ESTATE = 1 << 10, HEALTHY_LIFESTYLE = 1 << 11, + LITERATURE = 1 << 12, SOFTWARE = 1 << 13 +}; +EOF +# CategoriesHierarchy: a Metrica embedded dictionary the donor dropped (so the +# auto-map can't forward it). The benchmark never loads category dictionaries, so a +# no-op stub with the small interface Dictionaries.h / FunctionsDictionaries.h use is +# enough (templated methods avoid depending on the era's integer typedefs). Created +# only if the auto-map didn't already forward a real one. +if [ ! -e contrib/statdaemons-compat/statdaemons/CategoriesHierarchy.h ]; then + cat > contrib/statdaemons-compat/statdaemons/CategoriesHierarchy.h <<'EOF' +#pragma once +/// Stub for the never-vendored Metrica category hierarchy (unused by the benchmark). +class CategoriesHierarchy +{ +public: + CategoriesHierarchy() {} + void reload() {} + template T toParent(T x) const { return x; } + template T toMostAncestor(T x) const { return x; } + template T toSecondLevel(T x) const { return x; } + template bool in(T, T) const { return false; } +}; +EOF +fi + +# The auto-map above only handles ; the pre-2015-11 trees also +# pull and (.hpp / a subdir). +# By PATCH_REF these live in-tree as and +# (overlaid); forward the old paths to them. +[ -f libs/libcommon/include/common/threadpool.hpp ] && \ + printf '#pragma once\n#include \n' > contrib/statdaemons-compat/statdaemons/threadpool.hpp +if [ -d libs/libcommon/include/ext ]; then + mkdir -p contrib/statdaemons-compat/statdaemons/ext + for h in libs/libcommon/include/ext/*.hpp; do + [ -f "$h" ] || continue; base="$(basename "$h")" + printf '#pragma once\n#include \n' "$base" > "contrib/statdaemons-compat/statdaemons/ext/${base}" + done +fi +# ext/memory.hpp provided ext::make_unique before C++14's std::make_unique; the old +# statdaemons ext/ had it, the donor dropped it. Vendor it if not already forwarded. +if [ ! -e contrib/statdaemons-compat/statdaemons/ext/memory.hpp ]; then + mkdir -p contrib/statdaemons-compat/statdaemons/ext + cat > contrib/statdaemons-compat/statdaemons/ext/memory.hpp <<'EOF' +#pragma once +#include +#include +namespace ext +{ + template + std::unique_ptr make_unique(Args &&... args) { return std::unique_ptr(new T(std::forward(args)...)); } +} +EOF +fi +# statdaemons/stdext.h: the pre-2015 trees get make_unique from stdext::make_unique +# (the earlier name for ext::make_unique). Vendor the same thin make_unique. +if [ ! -e contrib/statdaemons-compat/statdaemons/stdext.h ]; then + cat > contrib/statdaemons-compat/statdaemons/stdext.h <<'EOF' +#pragma once +#include +#include +namespace stdext +{ + template + std::unique_ptr make_unique(Args &&... args) { return std::unique_ptr(new T(std::forward(args)...)); } +} +EOF +fi + +# -- Yandex/ -> common/: the old include prefix for the common utilities that the +# donor renamed to common/ (e.g. == ). +# Expose the donor's common headers under the old Yandex/ prefix. -- +if [ -d libs/libcommon/include/common ]; then + mkdir -p contrib/yandex-compat + ln -sfn "$(pwd)/libs/libcommon/include/common" contrib/yandex-compat/Yandex + # Yandex/Revision.h: the tiny public revision header, external in that era. The + # in-tree libcommon/src/Revision.cpp defines Revision::get() (reading REVISION + # from the generated revision.h); just declare it so the include resolves. + [ -e libs/libcommon/include/common/Revision.h ] || \ + printf '#pragma once\nnamespace Revision { unsigned get(); }\n' > libs/libcommon/include/common/Revision.h + # Yandex/optimization.h: the external header of branch-prediction macros (likely/ + # unlikely) that pre-2013 code (e.g. libpocoext/ThreadNumber.cpp) includes. The donor + # moved these to common/likely.h, so provide optimization.h under the common/ prefix + # (== the Yandex/ symlink). Guarded so it's a no-op where the header already exists. + [ -e libs/libcommon/include/common/optimization.h ] || \ + printf '#pragma once\n#if !defined(likely)\n#define likely(x) __builtin_expect(!!(x), 1)\n#endif\n#if !defined(unlikely)\n#define unlikely(x) __builtin_expect(!!(x), 0)\n#endif\n' \ + > libs/libcommon/include/common/optimization.h + # LOG_* macros: the 2012 / early-2013 prototypes call them as block statements with + # no trailing ';' (e.g. TCPHandler.cpp's connect log), which the donor's + # do{...}while(0) form rejects ("expected ';' before '}'"). Convert do{...}while(0) + # -> a plain {...} block so the trailing ';' becomes optional. Restrict this to those + # old snapshots (commit date < 2013-01-01): from 2013-02 on the code writes the ';' + # AND uses LOG in unbraced if/else (e.g. libzkutil Lock.cpp), where a bare block + # breaks the dangling-else the do/while idiom guards against. + # %ci (not %cs) -- the 14.04 image's git predates %cs (git 2.10) and would emit the + # literal "%cs", which sorts before the threshold and would wrongly match every build. + CH_COMMIT_DATE=$(git show -s --format=%ci HEAD 2>/dev/null | cut -d' ' -f1 || true) + if [ -e libs/libcommon/include/common/logger_useful.h ] \ + && printf '%s' "${CH_COMMIT_DATE}" | grep -qE '^[0-9]{4}-[0-9]{2}-[0-9]{2}$' \ + && [ "${CH_COMMIT_DATE}" \< "2013-01-01" ]; then + sed -i 's/ do {/ {/g; s/} while(0)/}/g; s/} while (0)/}/g' libs/libcommon/include/common/logger_useful.h + fi + # Yandex/time2str.h: external time helpers the donor folded into DateLUT. The only + # ones used by compiled (non-Server, non-test) code are the MergeTree part-naming + # helpers Date2OrderedIdentifier / OrderedIdentifier2Date; implement them via + # DateLUT so they stay consistent with the DateLUT the callers use. + if [ ! -e libs/libcommon/include/common/time2str.h ]; then + cat > libs/libcommon/include/common/time2str.h <<'EOF' +#pragma once +#include +#include +#include +#include +#include +/// Helpers from the external Yandex/time2str.h, reimplemented via DateLUT so they +/// stay consistent with the DateLUT the callers use. Date2OrderedIdentifier / +/// OrderedIdentifier2Date drive MergeTree part naming (must be correct); Time2Date / +/// Date2Str are used only by the legacy OLAP server code. +inline unsigned Date2OrderedIdentifier(time_t time) +{ + return DateLUT::instance().toNumYYYYMMDD(time); +} +inline time_t OrderedIdentifier2Date(const std::string & str) +{ + return DateLUT::instance().YYYYMMDDToDate(static_cast(std::strtoul(str.c_str(), nullptr, 10))); +} +inline time_t Time2Date(time_t time) +{ + return DateLUT::instance().toDate(time); +} +inline std::string Date2Str(time_t date) +{ + const auto & lut = DateLUT::instance(); + char buf[16]; + std::snprintf(buf, sizeof(buf), "%04u-%02u-%02u", lut.toYear(date), lut.toMonth(date), lut.toDayOfMonth(date)); + return std::string(buf); +} +EOF + fi +fi + +# -- double-conversion: the old code includes ; the +# donor's header is double-conversion/double-conversion.h (same namespace). -- +if [ -f contrib/libdouble-conversion/double-conversion/double-conversion.h ]; then + mkdir -p contrib/dc-compat/src + printf '#pragma once\n#include \n' > contrib/dc-compat/src/double-conversion.h +fi + +# -- strconvert/escape.h: another never-public Yandex string-escaping header. The +# only compiled use is MySQLDictionarySource's escaped_for_like (MySQL external +# dictionaries -- never exercised by the benchmark); strconvert::hash appears only +# in the OLAP server code, which is excluded from the build. Provide equivalents +# (escaped_for_like is identity-safe for compile-only use). -- +mkdir -p contrib/strconvert-compat/strconvert +cat > contrib/strconvert-compat/strconvert/escape.h <<'EOF' +#pragma once +#include +#include +namespace strconvert +{ + // MySQL external dictionaries are unsupported in this reconstructed build, so + // the escaping only needs to compile (this path is never executed). + inline std::string escaped_for_like(const std::string & s) { return s; } + inline std::size_t hash(const std::string & s) { std::size_t h = 0; for (char c : s) h = h * 131 + static_cast(c); return h; } +} +EOF +# strconvert/hash64.h: used by the legacy OLAP server code (OLAPAttributesMetadata) +# to hash attribute names. A deterministic 64-bit hash (FNV-1a) suffices; the OLAP +# protocol is not exercised by the benchmark. +cat > contrib/strconvert-compat/strconvert/hash64.h <<'EOF' +#pragma once +#include +#include +namespace strconvert +{ + inline std::uint64_t hash64(const std::string & s) + { + std::uint64_t h = 14695981039346656037ULL; + for (char c : s) { h ^= static_cast(c); h *= 1099511628211ULL; } + return h; + } +} +EOF + +# -- jsonxx.h: pre-2014-10 FileChecker (Log-table sizes.json) used the third-party +# jsonxx JSON library, later replaced by ClickHouse's own JSON. The benchmark uses +# MergeTree, never Log/StripeLog/TinyLog, so FileChecker is never exercised. Provide +# a compile-only stub: parse() is a no-op (empty map), so the getters never run. -- +mkdir -p contrib/jsonxx-compat +cat > contrib/jsonxx-compat/jsonxx.h <<'EOF' +#pragma once +// Compile-only stub of the third-party jsonxx (see reconstruct.sh). FileChecker is +// the only user and is never exercised by the benchmark (MergeTree, not Log tables). +#include +#include +#include +namespace jsonxx +{ + enum Assortment { JSON = 0, JSONx = 1 }; + class Object; + class Value + { + public: + template T & get() { static T v; return v; } + }; + class Object + { + public: + Object() {} + Object(const std::string &, const std::string &) {} + template T get(const std::string &) const { return T(); } + void import(const std::string &, const Object &) {} + std::string write(unsigned = JSON) const { return "{}"; } + const std::map & kv_map() const { return values_; } + bool parse(std::istream &) { return true; } + bool parse(const std::string &) { return true; } + private: + std::map values_; + }; +} +EOF + +# -- zookeeper/zookeeper.hh: pre-2014-07 zkutil is built on the C++ ZooKeeper client +# org::apache::zookeeper (a Yandex-internal package, never public; 2014-07 rewrote +# zkutil onto the C client). The benchmark uses plain MergeTree, never Replicated / +# ZooKeeper, so provide a compile-only stub of the C++ client API that zkutil and the +# replication code reference (enums, data::{Id,ACL,Stat}, Watch, Op::{Create,Remove, +# SetData}, OpResult, ZooKeeper). Methods return Ok / do nothing (never executed). -- +mkdir -p contrib/zkcpp-stub/zookeeper +cat > contrib/zkcpp-stub/zookeeper/zookeeper.hh <<'EOF' +#pragma once +// Compile-only stub of the never-public org::apache::zookeeper C++ client (see +// reconstruct.sh). Replication/ZooKeeper is never exercised by the benchmark. +#include +#include +#include +#include +#include + +namespace org { namespace apache { namespace zookeeper { + +namespace ReturnCode +{ + enum type { Ok = 0, NoNode, NodeExists, BadVersion, NotEmpty, + NoChildrenForEphemerals, SessionExpired, ConnectionLoss, RuntimeInconsistency, Error }; + inline std::string toString(type) { return "ReturnCode"; } +} +namespace CreateMode +{ + enum type { Persistent = 0, Ephemeral = 1, PersistentSequential = 2, EphemeralSequential = 3 }; +} +namespace SessionState +{ + enum type { Connecting = 0, Connected = 1, Expired = 2, AuthFailed = 3 }; + inline std::string toString(type) { return "SessionState"; } +} +namespace WatchEvent +{ + enum type { None = 0, NodeCreated, NodeDeleted, NodeDataChanged, NodeChildrenChanged }; + inline std::string toString(type) { return "WatchEvent"; } +} +namespace Permission +{ + enum type { Read = 1, Write = 2, Create = 4, Delete = 8, Admin = 16, All = 31 }; +} + +namespace data +{ + struct Id + { + std::string scheme, id; + std::string & getscheme() { return scheme; } + std::string & getid() { return id; } + }; + struct ACL + { + Id id_; int perms = 0; + Id & getid() { return id_; } + void setperms(int p) { perms = p; } + int getperms() const { return perms; } + }; + struct Stat + { + int64_t czxid = 0, mzxid = 0, pzxid = 0, ctime = 0, mtime = 0, ephemeralOwner = 0; + int32_t version = 0, cversion = 0, aversion = 0, dataLength = 0, numChildren = 0; + int64_t getczxid() const { return czxid; } + int32_t getversion() const { return version; } + int32_t getcversion() const { return cversion; } + int32_t getnumChildren() const { return numChildren; } + }; +} + +struct Watch +{ + virtual ~Watch() {} + virtual void process(WatchEvent::type, SessionState::type, const std::string &) = 0; +}; + +namespace OpCode { enum type { Create, Remove, SetData, Check }; } +struct Op +{ + virtual ~Op() {} + virtual OpCode::type getType() const { return OpCode::Check; } + struct Create; struct Remove; struct SetData; struct Check; +}; +struct Op::Create : Op +{ + Create(const std::string &, const std::string &, const std::vector &, CreateMode::type) {} + OpCode::type getType() const { return OpCode::Create; } +}; +struct Op::Remove : Op +{ + Remove(const std::string &, int32_t) {} + OpCode::type getType() const { return OpCode::Remove; } +}; +struct Op::SetData : Op +{ + SetData(const std::string &, const std::string &, int32_t) {} + OpCode::type getType() const { return OpCode::SetData; } +}; +struct Op::Check : Op +{ + Check(const std::string &, int32_t) {} + OpCode::type getType() const { return OpCode::Check; } +}; + +struct OpResult +{ + virtual ~OpResult() {} // polymorphic: consumers dynamic_cast to OpResult::Create + ReturnCode::type getReturnCode() const { return ReturnCode::Ok; } + std::string getPath() const { return {}; } + struct Create; struct Remove; struct SetData; struct Check; +}; +struct OpResult::Create : OpResult { std::string getPathCreated() const { return {}; } }; +struct OpResult::Remove : OpResult {}; +struct OpResult::SetData : OpResult {}; +struct OpResult::Check : OpResult {}; + +class ZooKeeper +{ +public: + ReturnCode::type init(const std::string &, int32_t, boost::shared_ptr) { return ReturnCode::Ok; } + ReturnCode::type close() { return ReturnCode::Ok; } + ReturnCode::type create(const std::string &, const std::string &, const std::vector &, CreateMode::type, std::string &) { return ReturnCode::Ok; } + ReturnCode::type remove(const std::string &, int32_t) { return ReturnCode::Ok; } + ReturnCode::type exists(const std::string &, boost::shared_ptr, data::Stat &) { return ReturnCode::Ok; } + ReturnCode::type get(const std::string &, boost::shared_ptr, std::string &, data::Stat &) { return ReturnCode::Ok; } + ReturnCode::type getChildren(const std::string &, boost::shared_ptr, std::vector &, data::Stat &) { return ReturnCode::Ok; } + ReturnCode::type set(const std::string &, const std::string &, int32_t, data::Stat &) { return ReturnCode::Ok; } + ReturnCode::type multi(const boost::ptr_vector &, boost::ptr_vector &) { return ReturnCode::Ok; } +}; + +}}} +EOF + +# -- stats/*: the pre-2015-12 trees include several headers from an external Yandex +# "stats" library that was never open-sourced. At the 2015-11 -> 2015-12 boundary +# these were inlined into the repo (a coordinated refactor). We reproduce that: +# * stats/IntHash.h -> the templated intHash32+IntHash32 functor, which +# 2015-12 moved into DB/Common/HashTable/Hash.h. Append them to the era's +# own Hash.h (which lacks intHash32) so they are visible everywhere Hash.h is +# included -- notably the overlaid UniquesHashSet -- and forward the old +# path there. (Appending, not a separate compat definition, +# avoids a double-definition when both headers land in one TU.) +# * stats/{UniquesHashSet,ReservoirSampler,ReservoirSamplerDeterministic}.h -> +# the algorithms, overlaid in-tree from PATCH_REF and forwarded. -- +mkdir -p contrib/stats-compat/stats +# intHash32/IntHash32 and intHashCRC32 lived in the external +# before ~2015-12 (2015-12 moved them into Hash.h; intHashCRC32 arrived after 2014-12). +# When Hash.h lacks a definition, INSERT it right after the includes -- not appended at +# the end -- because Hash.h itself uses intHash32<0> early (in DefaultHash64), so the +# definition must precede the first use. Guard matches the definition `intHash32(` +# (the call `intHash32<0>(` does not), so trees that already define it are untouched. +python3 - <<'PYEOF' +import os, re +p = "dbms/include/DB/Common/HashTable/Hash.h" +if os.path.exists(p): + s = open(p, encoding="utf-8", errors="surrogateescape").read() + add = "" + if "intHash32(" not in s: + add += ("template \n" + "inline DB::UInt32 intHash32(DB::UInt64 key)\n{\n" + "\tkey ^= salt;\n" + "\tkey = (~key) + (key << 18);\n" + "\tkey = key ^ ((key >> 31) | (key << 33));\n" + "\tkey = key * 21;\n" + "\tkey = key ^ ((key >> 11) | (key << 53));\n" + "\tkey = key + (key << 6);\n" + "\tkey = key ^ ((key >> 22) | (key << 42));\n" + "\treturn key;\n}\n" + "template \n" + "struct IntHash32 { size_t operator() (const T & key) const { return intHash32(key); } };\n") + if "intHashCRC32(" not in s: + add += ("inline DB::UInt64 intHashCRC32(DB::UInt64 x)\n{\n" + "\tDB::UInt64 crc = -1ULL;\n" + "\tasm(\"crc32q %[x], %[crc]\\n\" : [crc] \"+r\" (crc) : [x] \"rm\" (x));\n" + "\treturn crc;\n}\n") + if add: + # insert after (which defines UInt32/UInt64), else after the + # last include in the top block. + m = re.search(r'^#include\s*[^\n]*\n', s, re.M) + if not m: + incs = list(re.finditer(r'^#include[^\n]*\n', s, re.M)) + pos = incs[-1].end() if incs else 0 + else: + pos = m.end() + s = s[:pos] + "\n// Added by reconstruct.sh: int hashes from the external .\n" + add + "\n" + s[pos:] + open(p, "w", encoding="utf-8", errors="surrogateescape").write(s) +PYEOF +# The oldest trees (pre-2014-12) have no DB/Common/HashTable/Hash.h at all -- their +# HashMap.h pulled intHash32 straight from the external , and nothing +# in-tree defines it. Two consumers need it: that external path, and the back-ported +# (PATCH_FILL) UniquesHashSet.h, which includes + +# . So when the subdir Hash.h is absent, +# CREATE it (the int-hash helpers the external stats library provided) and forward the +# subdir HashTableAllocator.h path to this era's flat DB/Common/HashTableAllocator.h +# (the subdir split came later; the flat header already has HashTableAllocator + +# HashTableAllocatorWithStackMemory). stats/IntHash.h then forwards to this one file, so +# there is a single intHash32 definition per TU regardless of era. +if [ ! -f dbms/include/DB/Common/HashTable/Hash.h ]; then + mkdir -p dbms/include/DB/Common/HashTable + cat > dbms/include/DB/Common/HashTable/Hash.h <<'IHEOF' +#pragma once +// Added by reconstruct.sh: the int-hash helpers pre-2014-12 pulled from the external +// stats library (this era has no in-tree HashTable/Hash.h). intHash32/IntHash32 are +// used by HashMap.h (via ) and intHash32/intHashCRC32 by the +// back-ported UniquesHashSet.h. +#include + +template +inline DB::UInt32 intHash32(DB::UInt64 key) +{ + key ^= salt; + key = (~key) + (key << 18); + key = key ^ ((key >> 31) | (key << 33)); + key = key * 21; + key = key ^ ((key >> 11) | (key << 53)); + key = key + (key << 6); + key = key ^ ((key >> 22) | (key << 42)); + return key; +} + +// The 2012 HashMap.h calls the older two-template-arg form intHash32(key); +// forward it to the salt-only form. (intHash32<0>(x) still binds the one above.) +template +inline DB::UInt32 intHash32(T key) { return intHash32(static_cast(key)); } + +template +struct IntHash32 { size_t operator() (const T & key) const { return intHash32(key); } }; + +inline DB::UInt64 intHashCRC32(DB::UInt64 x) +{ + DB::UInt64 crc = -1ULL; + asm("crc32q %[x], %[crc]\n" : [crc] "+r" (crc) : [x] "rm" (x)); + return crc; +} +IHEOF + # The back-ported UniquesHashSet.h also needs , + # providing a global HashTableAllocatorWithStackMemory. Two eras: + if [ ! -e dbms/include/DB/Common/HashTable/HashTableAllocator.h ]; then + if [ -e dbms/include/DB/Common/HashTableAllocator.h ]; then + # 2014-03/04: the flat header exists but keeps the allocators in namespace + # DB, while the (global) back-ported UniquesHashSet refers to + # HashTableAllocatorWithStackMemory unqualified -- later eras exposed it as a + # global alias. Forward to the flat header and hoist both to global scope. + { + printf '#pragma once\n#include \n' + printf 'using DB::HashTableAllocator;\nusing DB::HashTableAllocatorWithStackMemory;\n' + } > dbms/include/DB/Common/HashTable/HashTableAllocator.h + else + # 2014-02 and older: no HashTableAllocator exists anywhere (uniq() used the + # external stats library's own allocation). Provide a self-contained, + # malloc-backed global allocator exposing exactly the surface the + # back-ported UniquesHashSet uses (alloc/free/realloc). We skip the + # small-object stack optimization the real one had -- it changes only + # performance, not results, which is immaterial for uniq() correctness. + cat > dbms/include/DB/Common/HashTable/HashTableAllocator.h <<'HAEOF' +#pragma once +// Added by reconstruct.sh: minimal malloc-backed HashTableAllocator for pre-2014-03 +// trees that ship no allocator at all, matching the surface the back-ported +// UniquesHashSet.h uses. Global scope (UniquesHashSet refers to it unqualified). +#include +#include + +class HashTableAllocator +{ +public: + void * alloc(size_t size) { return ::calloc(size, 1); } + void free(void * buf, size_t) { ::free(buf); } + void * realloc(void * buf, size_t old_size, size_t new_size) + { + buf = ::realloc(buf, new_size); + if (new_size > old_size) + memset(reinterpret_cast(buf) + old_size, 0, new_size - old_size); + return buf; + } +}; + +template +class HashTableAllocatorWithStackMemory : public HashTableAllocator {}; +HAEOF + fi + fi +fi +printf '#pragma once\n#include \n' > contrib/stats-compat/stats/IntHash.h + +# The overlaid 2015-12 ReservoirSampler{,Deterministic}.h back a small sample buffer +# with DB::PODArray, N>> -- but +# 2015-11's Allocator is a non-template class and lacks AllocatorWithStackMemory, and +# back-porting the templated allocator would ripple through every container. The +# buffer only ever needs push_back / [] / size / resize / begin / end / clear / swap, +# so retarget it to std::vector (the first PODArray template arg is the element type). +# quantile() is unused by the benchmark, so exact reservoir behaviour is immaterial. +for f in dbms/include/DB/AggregateFunctions/ReservoirSampler.h \ + dbms/include/DB/AggregateFunctions/ReservoirSamplerDeterministic.h; do + [ -f "$f" ] || continue + sed -i 's#include #include #' "$f" + sed -i 's#using Array = DB::PODArray<\([^,]*\),[^;]*>;#using Array = std::vector<\1>;#' "$f" +done + +# Forward the old algorithm paths to the overlaid in-tree headers. +for base in ReservoirSampler ReservoirSamplerDeterministic UniquesHashSet; do + if [ -f "dbms/include/DB/AggregateFunctions/${base}.h" ]; then + printf '#pragma once\n#include \n' "$base" \ + > "contrib/stats-compat/stats/${base}.h" + fi +done + +# -- VarInt narrow read overloads: pre-2012-07 VarInt.h declared readVarUInt only for +# UInt64, but the back-ported UniquesHashSet reads its UInt32 size fields directly +# (readVarUInt(UInt32&, ...)). Add the narrow *read* overloads (forwarding through a +# UInt64) inside namespace DB when absent. Only the read side is needed: a UInt32 *write* +# argument already widens uniquely to writeVarUInt(UInt64), whereas adding narrow write +# overloads would make int/enum callers (Connection.cpp) ambiguous. A no-op on the donor +# and every later era, which already declare the UInt32/UInt16 read overloads. -- +python3 - <<'PYEOF' +p = 'dbms/include/DB/IO/VarInt.h' +import os +if os.path.exists(p): + with open(p, encoding='utf-8', errors='surrogateescape') as f: + s = f.read() + if 'readVarUInt(UInt32' not in s: + anchor = 'void readVarUInt(UInt64 & x, ReadBuffer & istr);' + add = (anchor + '\n' + '/// Narrow read overloads (reconstruct shim): forward through UInt64.\n' + 'inline void readVarUInt(UInt32 & x, ReadBuffer & istr) { UInt64 t = 0; readVarUInt(t, istr); x = static_cast(t); }\n' + 'inline void readVarUInt(UInt16 & x, ReadBuffer & istr) { UInt64 t = 0; readVarUInt(t, istr); x = static_cast(t); }\n') + if anchor in s: + s = s.replace(anchor, add, 1) + with open(p, 'w', encoding='utf-8', errors='surrogateescape') as f: + f.write(s) +PYEOF + +# -- generate the re2_st (single-threaded re2) headers into a stable include dir -- +mkdir -p contrib/re2_st_gen +( cd contrib/re2_st_gen && sh /src/contrib/libre2/create_st_headers.sh /src/contrib/libre2 . ) + + +# -- MongoDB dictionary: throwing stub (legacy mongoclient driver not vendored) -- +cat > dbms/include/DB/Dictionaries/MongoDBBlockInputStream.h <<'EOF' +#pragma once +// Stub: MongoDB support removed (legacy mongoclient driver not vendored). +EOF +cat > dbms/include/DB/Dictionaries/MongoDBDictionarySource.h <<'EOF' +#pragma once +#include +#include +#include +#include +#include +namespace DB +{ +struct DictionaryStructure; +class Block; +class Context; +// MongoDB dictionary support is disabled in this reconstructed build; requesting +// a mongodb dictionary source throws. Never exercised by the benchmark. +class MongoDBDictionarySource final : public IDictionarySource +{ +public: + MongoDBDictionarySource(const DictionaryStructure &, const Poco::Util::AbstractConfiguration &, + const std::string &, Block &, Context &) + { throw Exception("MongoDB dictionary source is not supported in this build", 0); } + // No `override` on these: the exact IDictionarySource virtuals vary across the + // era (e.g. loadKeys did not exist before ~2015-12). Omitting the keyword makes + // each an implicit override where the matching virtual exists and a harmless + // extra method where it doesn't, so the stub is concrete for every snapshot. + BlockInputStreamPtr loadAll() { throw Exception("MongoDB not supported", 0); } + bool supportsSelectiveLoad() const { return false; } + BlockInputStreamPtr loadIds(const std::vector &) { throw Exception("MongoDB not supported", 0); } + BlockInputStreamPtr loadKeys(const ConstColumnPlainPtrs &, const std::vector &) { throw Exception("MongoDB not supported", 0); } + bool isModified() const { return false; } + DictionarySourcePtr clone() const { throw Exception("MongoDB not supported", 0); } + std::string toString() const { return "MongoDB(disabled)"; } +}; +} +EOF + +# -- member-template virt-specifiers: the early trees mark templated member +# functions with `override`/`final` (e.g. `template bool +# execute(...) override` in FunctionsMiscellaneous.h). A member template can +# never be virtual, so this is ill-formed; the era's compiler accepted it but +# gcc-5 rejects it ("member template ... may not have virt-specifiers"). Strip +# the trailing specifier from any method whose immediately-preceding non-blank +# line opens a `template<...>` declaration. -- +python3 - <<'PYEOF' +import os, re +# ") ... override|final" at end of a declaration line (body brace on next line) +spec = re.compile(r'\)\s*(?:const\s*)?(?:override|final)(?:\s+(?:override|final))?\s*$') +tmpl = re.compile(r'^\s*template\s*<') +for root, _dirs, files in os.walk('dbms'): + for fn in files: + if not fn.endswith(('.h', '.hpp', '.cpp')): + continue + p = os.path.join(root, fn) + try: + with open(p, encoding='utf-8', errors='surrogateescape') as f: + lines = f.readlines() + except OSError: + continue + changed = False + prev_nonblank = '' + for i, ln in enumerate(lines): + if spec.search(ln) and tmpl.match(prev_nonblank): + # drop just the virt-specifier keyword(s), keep the rest verbatim + lines[i] = re.sub(r'\s*(?:override|final)(?:\s+(?:override|final))?\s*$', '\n', ln) + changed = True + if ln.strip(): + prev_nonblank = ln + if changed: + with open(p, 'w', encoding='utf-8', errors='surrogateescape') as f: + f.writelines(lines) +PYEOF + +# -- ConnectionPoolWithFailover: the external (pre-2015-11) PoolWithFailoverBase +# exposed a 1-arg virtual getMany(settings); the back-ported base has a 2-arg +# getMany(settings, get_all) (non-virtual). Adapt the derived client's override +# so it compiles against the newer base. This is distributed-query plumbing the +# single-node benchmark never exercises, so only compilation matters. -- +CPF=dbms/include/DB/Client/ConnectionPoolWithFailover.h +if [ -f "$CPF" ] && grep -q 'getMany(const Settings \* settings = nullptr) override' "$CPF"; then + sed -i 's#getMany(const Settings \* settings = nullptr) override#getMany(const Settings * settings = nullptr, bool get_all = false)#' "$CPF" + sed -i 's#return Base::getMany(settings);#return Base::getMany(settings, get_all);#' "$CPF" +fi + +# -- ErrorCodes::NO_AVAILABLE_DATA: the back-ported CompactArray/HyperLogLog throw +# with this code, added to the enum only after 2015-08. Append it (with a free +# number) to the era's enum when absent, so those overlaid headers compile. -- +EC=dbms/include/DB/Core/ErrorCodes.h +if [ -f "$EC" ] && ! grep -q 'NO_AVAILABLE_DATA' "$EC"; then + python3 - "$EC" <<'PYEOF' +import sys, re +p = sys.argv[1] +s = open(p, encoding='utf-8', errors='surrogateescape').read() +m = re.search(r'enum ErrorCodes\s*\{', s) +if m: + end = s.index('};', m.end()) + nums = [int(n) for n in re.findall(r'=\s*(\d+)', s[m.end():end])] + s = s[:end] + ('\t\tNO_AVAILABLE_DATA = %d,\n\t' % ((max(nums) + 1) if nums else 10000)) + s[end:] + open(p, 'w', encoding='utf-8', errors='surrogateescape').write(s) +PYEOF +fi + +# -- ALWAYS_INLINE macro: used by the back-ported CompactArray (which includes +# DB/Core/Defines.h); added to Defines.h after 2014-10. Append it when absent. -- +DEF=dbms/include/DB/Core/Defines.h +if [ -f "$DEF" ] && ! grep -q 'ALWAYS_INLINE' "$DEF"; then + printf '\n#ifndef ALWAYS_INLINE\n#define ALWAYS_INLINE __attribute__((__always_inline__))\n#endif\n' >> "$DEF" +fi + +# -- IPv4 listen: pre-2014-12 Server.cpp hardcodes Poco SocketAddress("[::]:") +# (the IPv6 wildcard), which fails with EAI_ADDRFAMILY on an IPv6-disabled host, so +# the server exits on boot ("DNS error: EAI: -9"). Rewrite to 0.0.0.0 so it listens +# on IPv4 (the benchmark connects over 127.0.0.1). 2014-12+ take the listen host +# from config, so this is a no-op there. -- +SRV=dbms/src/Server/Server.cpp +[ -f "$SRV" ] && sed -i 's#\[::\]:#0.0.0.0:#g' "$SRV" + +# -- init.d / logrotate INCLUDEs: the donor Server/CMakeLists.txt INCLUDEs the cmake +# fragments tools/init.d/CMakeLists.init and tools/logrotate/CMakeLists.logrotate. +# Those are neither CMakeLists.txt nor .cmake, so the overlay doesn't bring them, and +# the oldest trees don't ship them at all -- cmake then fails ("include could not +# find load file"). They only add init.d/logrotate packaging, irrelevant to building +# the server binary, so drop the INCLUDE lines when the fragment is absent. No-op on +# trees that do ship the fragments. -- +SRV_CML=dbms/src/Server/CMakeLists.txt +if [ -f "$SRV_CML" ]; then + [ -f tools/init.d/CMakeLists.init ] || sed -i '/INCLUDE[[:space:]]*(.*tools\/init\.d\/CMakeLists\.init)/d' "$SRV_CML" + [ -f tools/logrotate/CMakeLists.logrotate ] || sed -i '/INCLUDE[[:space:]]*(.*tools\/logrotate\/CMakeLists\.logrotate)/d' "$SRV_CML" +fi + +# -- Poco/Ext/scopedTry.h (pre-2013-05): StorageMergeTree uses Poco::ScopedTry +# (a scoped try-lock) from this never-public libpocoext header. It was dropped later, +# so provide it when absent: default-constructed, lock(&mutex) tries and returns +# whether it acquired, destructor releases if held -- exactly the surface the caller +# (clearOldParts) uses. -- +SCT=libs/libpocoext/include/Poco/Ext/scopedTry.h +if [ -d libs/libpocoext/include/Poco/Ext ] && [ ! -e "$SCT" ]; then + cat > "$SCT" <<'EOF' +#pragma once +namespace Poco +{ + template + class ScopedTry + { + public: + ScopedTry() : m(0) {} + ~ScopedTry() { if (m) m->unlock(); } + bool lock(M * mutex) { if (mutex && mutex->tryLock()) { m = mutex; return true; } return false; } + private: + M * m; + }; +} +EOF +fi + +# -- mysqlxx/PoolWithFailover.h (pre-2013-05): the back-ported Embedded dictionaries +# (TechDataHierarchy/RegionsHierarchy) include it, but this era's mysqlxx only has +# Pool.h (the failover pool came in 2013-05). Provide a thin wrapper over mysqlxx::Pool +# exposing the surface those dicts use (ctor from a config key, Entry, Get()). MySQL +# dictionaries are never loaded by the benchmark, so it only needs to compile/link. -- +MPF=libs/libmysqlxx/include/mysqlxx/PoolWithFailover.h +if [ -e libs/libmysqlxx/include/mysqlxx/Pool.h ] && [ ! -e "$MPF" ]; then + cat > "$MPF" <<'EOF' +#pragma once +#include "Pool.h" +namespace mysqlxx +{ + class PoolWithFailover + { + public: + typedef Pool::Entry Entry; + PoolWithFailover(const std::string & config_name, unsigned = 1, unsigned = 3) : pool(config_name) {} + Entry Get() { return pool.Get(); } + private: + Pool pool; + }; +} +EOF +fi + +# -- Poco::FileOutputStream: pre-2014-07 InterpreterAlterQuery uses it without +# including (it came in transitively then, not with the donor +# Poco). Add the include when the file references it but lacks the include. -- +IAQ=dbms/src/Interpreters/InterpreterAlterQuery.cpp +[ -f "$IAQ" ] && grep -q 'Poco::FileOutputStream' "$IAQ" && ! grep -q 'Poco/FileStream.h' "$IAQ" \ + && sed -i '1i #include ' "$IAQ" + +# -- Poco::Timestamp: pre-2013 IProfilingBlockInputStream.cpp uses Poco::Timestamp:: +# TimeDiff without including (transitive then). Add it when the +# file references Poco::Timestamp but lacks the include. -- +IPBIS=dbms/src/DataStreams/IProfilingBlockInputStream.cpp +[ -f "$IPBIS" ] && grep -q 'Poco::Timestamp' "$IPBIS" && ! grep -q 'Poco/Timestamp.h' "$IPBIS" \ + && sed -i '1i #include ' "$IPBIS" + +# -- uniq on Float32/Float64 (pre-2015-09): AggregateFunctionUniq{HLL12,Combined}Data +# typedef their HyperLogLog / CombinedCardinalityEstimator Set over the raw column +# type T, so uniq(Float) instantiates the HLL on `float`. But OneAdder inserts the +# *hashed* value (AggregateFunctionUniqTraits::hash -> UInt64), and the +# back-ported HLL bit-shifts its value type (can't be float). Add Float32/Float64 +# data specializations that use a UInt64 Set (exactly as the existing +# specialization does) -- the HLL is then only ever built on UInt64, which both +# compiles and is correct (2015-09+ restructured the code the same way). -- +AFU=dbms/include/DB/AggregateFunctions/AggregateFunctionUniq.h +# Pre-2014-06 used UniquesHashSet as a plain (non-template) type, both as `typedef +# UniquesHashSet Set;` and as a bare local like `UniquesHashSet tmp_set;`. The +# back-ported UniquesHashSet is a template with a default Hash, so any bare use needs +# <>. Rewrite "UniquesHashSet ;" -> "UniquesHashSet<> ;" (this +# also covers the typedef); the include and the longer +# ...UniquesHashSetData identifiers are not followed by whitespace, so they are left +# alone. No-op once UniquesHashSet is always used with explicit arguments. +[ -f "$AFU" ] && sed -i -E 's#UniquesHashSet[[:space:]]+([A-Za-z_][A-Za-z0-9_]*)[[:space:]]*;#UniquesHashSet<> \1;#g' "$AFU" +if [ -f "$AFU" ] && grep -q 'AggregateFunctionUniqHLL12Data' "$AFU" \ + && ! grep -q 'AggregateFunctionUniqHLL12Data' "$AFU"; then + python3 - "$AFU" <<'PYEOF' +import sys +p = sys.argv[1] +s = open(p, encoding='utf-8', errors='surrogateescape').read() +def add_after_string_spec(s, base, body): + key = 'struct %s' % base + if key not in s: + return s + j = s.index('};', s.index(key)) + 2 # end of the specialization + return s[:j] + body + s[j:] +hll = ''.join('\n\ntemplate <>\nstruct AggregateFunctionUniqHLL12Data<%s>\n{\n' + '\ttypedef HyperLogLogWithSmallSetOptimization Set;\n\tSet set;\n' + '\tstatic String getName() { return "uniqHLL12"; }\n};' % t for t in ('Float32', 'Float64')) +comb = ''.join('\n\ntemplate <>\nstruct AggregateFunctionUniqCombinedData<%s>\n{\n' + '\tusing Key = UInt64;\n\tusing Set = CombinedCardinalityEstimator, HashTableGrower<4> >, 16, 16, 19>;\n\tSet set;\n' + '\tstatic String getName() { return "uniqCombined"; }\n};' % t for t in ('Float32', 'Float64')) +s = add_after_string_spec(s, 'AggregateFunctionUniqHLL12Data', hll) +s = add_after_string_spec(s, 'AggregateFunctionUniqCombinedData', comb) +open(p, 'w', encoding='utf-8', errors='surrogateescape').write(s) +PYEOF +fi + +# -- std::tr1 -> std (pre-2014-02): the oldest snapshots use the pre-C++11 TR1 +# namespace (std::tr1::unordered_set/map) and include paths, which a +# modern gcc-5 in -std=gnu++1y mode no longer provides. Rewrite both to their C++11 +# forms. Guarded by grep, so it's a no-op on trees that already use std:: directly. -- +grep -rlZ 'tr1' dbms libs 2>/dev/null | while IFS= read -r -d '' f; do + sed -i 's##<\1>#g; s#std::tr1::#std::#g' "$f" +done + +# -- StoragePtr::operator bool (pre-2013-12): the old smart-pointer wrapper's +# `operator bool() const { return ptr; }` relied on boost::shared_ptr's implicit +# safe-bool conversion, but trusty's boost makes operator bool explicit, so the +# implicit conversion in the return fails. Make it explicit. Guarded on the file + +# exact return, so it's a no-op once StoragePtr was replaced by std::shared_ptr. -- +SP=dbms/include/DB/Storages/StoragePtr.h +[ -f "$SP" ] && sed -i 's#^\(\s*\)return ptr;#\1return static_cast(ptr);#' "$SP" + +# -- HyperLogLog counter template arg order: pre-2015-09 +# HyperLogLogWithSmallSetOptimization instantiates the counter as +# HyperLogLogCounter (old 3-arg form). The back-ported +# (PATCH_REF) counter inserted a HashValueType 3rd parameter, so the old call puts +# DenominatorType (float) in the HashValueType slot -> the counter bit-shifts a +# float and won't compile. Insert the UInt32 HashValueType (the IntHash32 result +# type), matching 2015-09+. CombinedCardinalityEstimator reaches the counter +# through SmallSetOptimization, so this single fix covers both. The sed only +# matches the old 3-arg form, so it's a no-op on trees that already pass 4 args. -- +SSO=dbms/include/DB/Common/HyperLogLogWithSmallSetOptimization.h +[ -f "$SSO" ] && sed -i 's#HyperLogLogCounter#HyperLogLogCounter#' "$SSO" + +# -- DateLUT API migration (pre-2015-08): the monolithic calendar class DateLUT was +# split into DateLUT (a singleton whose instance() returns `const DateLUTImpl &`) +# and DateLUTImpl (the calendar, carrying the `Values` struct). The donor supplies +# that split (and its DateLUT.cpp/DateLUTImpl.cpp overwrite the era's old ones), so +# migrate the era's consumers exactly as 2015-08 did: +# * `DateLUT & x = DateLUT::instance(...)` -> `const auto & x = DateLUT::instance(...)` +# (the returned reference is now `const DateLUTImpl &`), and +# * `DateLUT::Values` -> `DateLUTImpl::Values`. +# `DateLUT::instance().()` already works (it returns a DateLUTImpl). A no-op +# on trees already migrated (2015-08+), which have neither pattern. -- +python3 - <<'PYEOF' +import os, re +# `DateLUT & x = DateLUT::instance(...)` -> `const auto & x = ...` (the reference is +# now const, so `const auto &` is required; a bare `DateLUTImpl &` would fail const). +ref = re.compile(r'(?:const\s+)?DateLUT\s*&\s*([A-Za-z_]\w*)\s*=\s*DateLUT::instance\(([^)]*)\)') +for base in ('dbms', 'libs'): + for root, _dirs, files in os.walk(base): + for fn in files: + if not fn.endswith(('.h', '.hpp', '.cpp', '.inl')): + continue + if fn.startswith('DateLUT'): # don't rewrite the headers that DEFINE the classes + continue + p = os.path.join(root, fn) + try: + with open(p, encoding='utf-8', errors='surrogateescape') as f: + s = f.read() + except OSError: + continue + if 'DateLUT' not in s and 'Yandex::' not in s: + continue + # Pre-2014-08 named the singleton accessor DateLUTSingleton (DateLUTSingleton + # ::instance() -> the calendar). Route it to the donor's DateLUT singleton and + # rename the type to DateLUT, so the migration below handles it uniformly. + # (Applied to ns, not s, so the ns != s write-back check still fires.) + ns = s + # Pre-2014 much of the code lived in `namespace Yandex` (libmysqlxx uses + # Yandex::DateLUTSingleton / Yandex::DateLUT::Values / Yandex::DayNum_t / + # Yandex::VisitID_t). The donor moved all of these to global scope, so drop + # the Yandex:: qualifier; the methods those callers use (getValues, + # toHourInaccurate, ...) all still exist on the donor DateLUTImpl. + ns = ns.replace('Yandex::', '') + # Pre-2013-05 named the bounds-checked day-number conversions safeFromDayNum + # / safeToDayNum; the donor dropped the "safe" prefix (fromDayNum/toDayNum are + # bounds-checked via fixDay). + ns = ns.replace('safeFromDayNum', 'fromDayNum').replace('safeToDayNum', 'toDayNum') + # Pre-2012-09 ToMondayImpl rounds down to Monday via date_lut.toWeek(...); the + # donor renamed that "start of the week" method to toFirstDayOfWeek (its toWeek, + # when it later reappeared, means the ISO week *number*). Newer eras don't call + # `.toWeek(` at all, so this is a no-op there. (DayNum_t -> time_t converts the + # same way toFirstDayOfMonth(DayNum_t) already relies on.) + ns = ns.replace('.toWeek(', '.toFirstDayOfWeek(') + if 'DateLUTSingleton' in ns: + ns = ns.replace('DateLUTSingleton::instance', 'DateLUT::instance').replace('DateLUTSingleton', 'DateLUT') + ns = ref.sub(r'const auto & \1 = DateLUT::instance(\2)', ns) + ns = ns.replace('DateLUT::Values', 'DateLUTImpl::Values') + # Any remaining reference/pointer to `DateLUT` (e.g. a `DateLUT &` function + # parameter carrying the calendar) is really the DateLUTImpl now — and it is + # read-only, since DateLUT::instance() returns `const DateLUTImpl &`, so make + # the target const (a non-const ref won't bind the const instance). Do the + # already-const forms first so we never produce `const const`. `DateLUT::` + # (instance()/statics) and `Singleton` have no ` &`/`*` and are left + # alone. + ns = ns.replace('const DateLUT &', 'const DateLUTImpl &').replace('DateLUT &', 'const DateLUTImpl &') + ns = ns.replace('const DateLUT&', 'const DateLUTImpl&').replace('DateLUT&', 'const DateLUTImpl&') + ns = ns.replace('const DateLUT *', 'const DateLUTImpl *').replace('DateLUT *', 'const DateLUTImpl *') + ns = ns.replace('const DateLUT*', 'const DateLUTImpl*').replace('DateLUT*', 'const DateLUTImpl*') + if ns != s: + with open(p, 'w', encoding='utf-8', errors='surrogateescape') as f: + f.write(ns) +PYEOF + +# -- assertChar: the back-ported Embedded dictionaries (RegionsHierarchy/RegionsNames) +# call DB::assertChar, a ReadHelpers function added after 2015-07. Add it inline in +# terms of the era's existing assertString (no new .cpp / error code) when absent. -- +RH=dbms/include/DB/IO/ReadHelpers.h +if [ -f "$RH" ] && ! grep -q 'assertChar' "$RH"; then + python3 - "$RH" <<'PYEOF' +import sys +p = sys.argv[1] +s = open(p, encoding='utf-8', errors='surrogateescape').read() +anchor = 'void assertString(const char * s, ReadBuffer & buf);' +if anchor in s: + i = s.index(anchor) + len(anchor) + add = ('\n\n/// Added by reconstruct.sh: assertChar (used by the back-ported Embedded' + '\n/// dictionaries); implemented via the era\'s existing assertString.' + '\ninline void assertChar(char symbol, ReadBuffer & buf)' + '\n{\n\tconst char s[2] = { symbol, 0 };\n\tassertString(s, buf);\n}') + open(p, 'w', encoding='utf-8', errors='surrogateescape').write(s[:i] + add + s[i:]) +PYEOF +fi + +# -- WriteBufferFromFileDescriptor::sync (pre-2014): the back-ported (PATCH_FILL) +# CounterInFile.h calls buf.sync() to flush the counter file, but this era's +# WriteBufferFromFileDescriptor only has next() (sync() was added later). Add a +# sync() that flushes the buffer -- durability/fsync is irrelevant for the ephemeral +# benchmark, and CounterInFile itself is unused by it. Guarded on the class lacking +# sync(), so it's a no-op once sync() landed. -- +WB=dbms/include/DB/IO/WriteBufferFromFileDescriptor.h +if [ -f "$WB" ] && ! grep -q 'void sync' "$WB"; then + python3 - "$WB" <<'PYEOF' +import sys, re +p = sys.argv[1] +s = open(p, encoding='utf-8', errors='surrogateescape').read() +m = re.search(r'class\s+WriteBufferFromFileDescriptor\b[^{]*\{', s) +if m: + i = m.end() + s = s[:i] + '\npublic:\n\tvoid sync() { next(); }\n' + s[i:] + open(p, 'w', encoding='utf-8', errors='surrogateescape').write(s) +PYEOF +fi + +# -- DB::toString (pre-2014): the back-ported Embedded dictionaries (RegionsHierarchy.h) +# call DB::toString, a WriteHelpers helper added later. Append the same template the +# donor defines (WriteBufferFromString + writeText) when this era's WriteHelpers.h +# lacks it. This era's WriteBufferFromString.h doesn't include WriteHelpers.h, so +# there is no circular include. No-op once toString is present. -- +WH=dbms/include/DB/IO/WriteHelpers.h +if [ -f "$WH" ] && ! grep -q 'String toString' "$WH"; then + { + printf '\n#include \n' + printf 'namespace DB { template inline std::string toString(const T & x) { std::string res; { WriteBufferFromString buf(res); writeText(x, buf); } return res; } }\n' + } >> "$WH" +fi + +# -- The back-ported Embedded RegionsHierarchy.h uses DB::toString but only includes +# ReadHelpers.h, relying on WriteHelpers.h (which carries toString) arriving +# transitively -- which it does in some eras but not others (e.g. 2013-03 fails). +# Make it self-sufficient by including WriteHelpers.h directly. Guarded on the file +# using toString and not already including it, so it's a no-op elsewhere. -- +RH_EMB=dbms/include/DB/Dictionaries/Embedded/RegionsHierarchy.h +if [ -f "$RH_EMB" ] && grep -q 'DB::toString' "$RH_EMB" && ! grep -q 'IO/WriteHelpers.h' "$RH_EMB"; then + sed -i '/#pragma once/a #include ' "$RH_EMB" +fi + +# -- ColumnWithNameAndType -> ColumnWithTypeAndName: the struct was renamed after +# 2015-07. The back-ported SummingSorted uses the new name; add a compat alias so +# it resolves against the era's old type. Guarded on the old header existing and +# the new one not, so it's a no-op once the rename landed (2015-08+). -- +CWN=dbms/include/DB/Core/ColumnWithNameAndType.h +if [ -f "$CWN" ] && [ ! -f dbms/include/DB/Core/ColumnWithTypeAndName.h ]; then + printf '\nnamespace DB { using ColumnWithTypeAndName = ColumnWithNameAndType; }\n' >> "$CWN" +fi + +# -- RegionsNames::SupportedLanguages -> Language: the region-name language enum was +# renamed (SupportedLanguages::Enum / ::RU -> Language / Language::RU); the methods +# getLanguageEnum() and getRegionName() kept their names. Rename the old references +# (regionToName in FunctionsDictionaries) to match the donor's RegionsNames. A +# no-op on 2015-01+, which no longer name the enum. -- +grep -rlZ 'RegionsNames::SupportedLanguages' dbms 2>/dev/null | while IFS= read -r -d '' f; do + sed -i 's#RegionsNames::SupportedLanguages::Enum#RegionsNames::Language#g; s#RegionsNames::SupportedLanguages::#RegionsNames::Language::#g' "$f" +done + +# -- StringRef: the donor's libcommon common/JSON.h uses an unqualified, global +# `StringRef` (its getRawString()/getRawName() return it). By 2014-05 StringRef +# lived at global scope in DB/Core/StringRef.h, but the 2014-04-and-older copy +# defines it inside `namespace DB`, so the global name the donor JSON.h expects +# is invisible. Hoist it with a global `using DB::StringRef;` — but only when the +# header defines StringRef solely inside namespace DB (guarded on the absence of a +# top-level `struct StringRef`), so it's a no-op on 2014-05+ where it's already global. -- +SR=dbms/include/DB/Core/StringRef.h +# Pre-2012-06 predates StringRef entirely (the file does not exist), yet the overlaid +# donor libcommon JSON.h includes . Create the known-good early +# (2012-06) definition -- namespace DB, backed by CityHash from contrib -- when absent; +# the hoist below then exposes it globally. A no-op once the file exists. +if [ ! -f "$SR" ]; then + mkdir -p "$(dirname "$SR")" + cat > "$SR" <<'EOF' +#pragma once + +#include +#include + +#include + + +namespace DB +{ + /// Reconstruct shim: StringRef did not exist before 2012-06 (this is that copy). + struct StringRef + { + const char * data; + size_t size; + + StringRef(const char * data_, size_t size_) : data(data_), size(size_) {} + StringRef(const unsigned char * data_, size_t size_) : data(reinterpret_cast(data_)), size(size_) {} + StringRef(const std::string & s) : data(s.data()), size(s.size()) {} + StringRef() : data(NULL), size(0) {} + }; + + inline bool operator==(StringRef lhs, StringRef rhs) + { + return lhs.size == rhs.size && 0 == memcmp(lhs.data, rhs.data, lhs.size); + } + + inline bool operator!=(StringRef lhs, StringRef rhs) + { + return !(lhs == rhs); + } + + struct StringRefHash + { + inline size_t operator() (StringRef x) const + { + return CityHash64(x.data, x.size); + } + }; +} +EOF +fi +if [ -f "$SR" ] && grep -q 'namespace DB' "$SR" && ! grep -qE '^struct StringRef' "$SR" \ + && ! grep -q 'using DB::StringRef' "$SR"; then + printf '\n// Added by reconstruct.sh: expose DB::StringRef globally for the donor libcommon JSON.h\nusing DB::StringRef;\n' >> "$SR" +fi + +# -- root CMakeLists: add the quicklz/re2_st include dirs and, on the C++ flags, +# -fpermissive plus the force-included cmath shim (anchored on the donor's +# stable libcityhash include line / -std=gnu++1y flag) -- +sed -i 's#include_directories (${METRICA_SOURCE_DIR}/contrib/libcityhash/)#include_directories (${METRICA_SOURCE_DIR}/contrib/quicklz-stub/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/re2_st_gen/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/statdaemons-compat/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/yandex-compat/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/dc-compat/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/stats-compat/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/strconvert-compat/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/jsonxx-compat/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/zkcpp-stub/)\ninclude_directories (${METRICA_SOURCE_DIR}/contrib/libcityhash/)#' CMakeLists.txt +# Force-include a few standard headers: on this (trusty) toolchain they aren't +# pulled in transitively the way the newer 16.04/boost-1.58 headers were, so code +# that assumes std::accumulate () / std::mt19937 () / +# std::unordered_set (pre-2014-05 ITableDeclaration relied on a transitive include) +# is in scope fails to compile without them. +sed -i 's#-std=gnu++1y#-std=gnu++1y -fpermissive -D_GLIBCXX_USE_CXX11_ABI=0 -include numeric -include random -include unordered_set#' CMakeLists.txt + +echo "reconstruct.sh: build system reconciled" diff --git a/versions/build-from-source/versions.txt b/versions/build-from-source/versions.txt new file mode 100644 index 0000000000..262360f1be --- /dev/null +++ b/versions/build-from-source/versions.txt @@ -0,0 +1,46 @@ +53973 53973 2016-06-01 5 +53974 53974 2016-06-03 5 +53975 53975 2016-06-03 5 +53976 53976 2016-06-06 5 +53977 53977 2016-06-07 5 +53978 53978 2016-06-07 5 +53979 53979 2016-06-08 5 +53980 53980 2016-06-09 5 +53981 53981 2016-06-11 5 +53982 53982 2016-06-21 5 +53983 53983 2016-06-27 5 +53984 53984 2016-06-27 5 +53985 53985 2016-06-28 5 +53986 53986 2016-06-28 5 +53987 53987 2016-06-28 5 +53988 53988 2016-06-28 5 +53989 53989 2016-07-01 5 +53990 53990 2016-07-01 5 +53991 53991 2016-07-07 5 +53992 53992 2016-07-14 5 +53993 53993 2016-07-14 5 +53994 53994 2016-07-14 5 +53995 53995 2016-07-14 5 +53996 53996 2016-07-14 5 +53997 53997 2016-07-17 5 +53998 53998 2016-07-21 5 +53999 53999 2016-07-25 5 +54000 54000 2016-07-27 5 +54001 54001 2016-07-28 5 +54002 54002 2016-08-02 5 +54003 54003 2016-08-03 5 +54004 54004 2016-08-03 5 +54005 54005 2016-08-07 5 +54006 54006 2016-08-10 5 +54007 54007 2016-08-10 5 +54008 54008 2016-08-13 5 +54009 54009 2016-08-15 5 +54010 54010 2016-08-15 5 +54011 54011 2016-08-17 5 +1.1.54165 v1.1.54165-stable 2017-02-14 5 +1.1.54318 v1.1.54318-stable 2017-11-30 6 +1.1.54335 v1.1.54335-stable 2018-01-16 7 +1.1.54336 v1.1.54336-stable 2018-01-16 7 +1.1.54358 v1.1.54358-stable 2018-03-07 7 +1.1.54362 v1.1.54362-stable 2018-03-10 7 +1.1.54370 v1.1.54370-stable 2018-03-16 7 diff --git a/versions/cloud-init.sh.in b/versions/cloud-init.sh.in new file mode 100644 index 0000000000..c97fdc3c0a --- /dev/null +++ b/versions/cloud-init.sh.in @@ -0,0 +1,111 @@ +#!/bin/bash -x + +# Cloud-init for the Versions Benchmark: benchmark ONE ClickHouse version on a +# fresh VM, unattended, and send the result to the sink (sink.data on +# play.clickhouse.com), then terminate. Rendered from this template by +# run-benchmark.sh (placeholders @version@ etc. are substituted there). +# +# Flow: install Docker -> download the prepared Native files from the public +# bucket -> (build the image from source if this version has no published one) +# -> run-version.sh -> POST the result JSON + log to the sink -> shutdown. + +export HOME="${HOME:-/root}" +export DEBIAN_FRONTEND=noninteractive +apt-get update -y +# docker-buildx: run-version.sh builds unpublished (clickhouse-built:*) versions +# from source with `docker buildx` (the legacy builder hangs on recent engines). +# earlyoom: loading all datasets in parallel (and heavy joins on old, less +# memory-efficient versions) can exhaust RAM; without it the kernel thrashes and +# the whole VM gets stuck (never terminating, wasting the instance). earlyoom kills +# the offending process early instead — the server crash is then recovered by +# run-version.sh's revive_server, or the query is just recorded null. Same as the +# main ClickBench cloud-init. +apt-get install -y docker.io docker-buildx git wget curl jq zstd pv aria2 earlyoom +systemctl enable --now docker +systemctl enable --now earlyoom + +git clone --depth 1 'https://github.com/@repo@.git' --branch '@branch@' ClickBench +cd ClickBench/versions + +VERSION='@version@' +IMAGE='@image@' +TAG='@tag@' +GCC='@gcc@' +DATASETS='@datasets@' +export TRIES='@tries@' +export LOAD_DATASETS="${DATASETS}" + +DATADIR=prepare-data/data +mkdir -p "${DATADIR}" +BUCKET='https://clickhouse-public-datasets.s3.amazonaws.com/versions-benchmark' + +# Download the files for the datasets we will load, in parallel. A missing file +# (e.g. ssb/taxi not uploaded yet) just fails its own wget and is skipped, so +# run-version.sh reports that dataset's queries as null rather than failing. +FILES="" +for ds in ${DATASETS}; do + case "${ds}" in + hits) FILES="${FILES} hits.native.zst" ;; + ssb) FILES="${FILES} ssb.native.zst" ;; + mgbench) FILES="${FILES} mgbench1.native.zst mgbench2.native.zst mgbench3.native.zst" ;; + tpch) FILES="${FILES} tpch_nation.native.zst tpch_region.native.zst tpch_part.native.zst tpch_supplier.native.zst tpch_partsupp.native.zst tpch_customer.native.zst tpch_orders.native.zst tpch_lineitem.native.zst" ;; + tpcds) FILES="${FILES} tpcds_call_center.native.zst tpcds_catalog_page.native.zst tpcds_catalog_returns.native.zst tpcds_catalog_sales.native.zst tpcds_customer_address.native.zst tpcds_customer_demographics.native.zst tpcds_customer.native.zst tpcds_date_dim.native.zst tpcds_household_demographics.native.zst tpcds_income_band.native.zst tpcds_inventory.native.zst tpcds_item.native.zst tpcds_promotion.native.zst tpcds_reason.native.zst tpcds_ship_mode.native.zst tpcds_store_returns.native.zst tpcds_store_sales.native.zst tpcds_store.native.zst tpcds_time_dim.native.zst tpcds_warehouse.native.zst tpcds_web_page.native.zst tpcds_web_returns.native.zst tpcds_web_sales.native.zst tpcds_web_site.native.zst" ;; + coffeeshop) FILES="${FILES} coffeeshop_fact_sales.native.zst coffeeshop_dim_locations.native.zst coffeeshop_dim_products.native.zst" ;; + ontime) FILES="${FILES} ontime.native.zst" ;; + uk) FILES="${FILES} uk_price_paid.native.zst" ;; + job) FILES="${FILES} job_aka_name.native.zst job_aka_title.native.zst job_cast_info.native.zst job_char_name.native.zst job_comp_cast_type.native.zst job_company_name.native.zst job_company_type.native.zst job_complete_cast.native.zst job_info_type.native.zst job_keyword.native.zst job_kind_type.native.zst job_link_type.native.zst job_movie_companies.native.zst job_movie_info.native.zst job_movie_info_idx.native.zst job_movie_keyword.native.zst job_movie_link.native.zst job_name.native.zst job_person_info.native.zst job_role_type.native.zst job_title.native.zst" ;; + taxi) FILES="${FILES} taxi.native.zst" ;; + esac +done +echo "downloading in parallel:${FILES}" +if command -v aria2c >/dev/null 2>&1; then + # One aria2c per file, run several at once with xargs -P. Each splits its + # file into 16 parallel byte-range segments (S3 supports Range), so the huge + # taxi file isn't one slow stream. Per-file invocation avoids aria2's -j + # cross-file size accounting; --allow-overwrite re-fetches a pre-existing + # file it can't resume instead of erroring; a missing file is skipped. + echo ${FILES} | tr ' ' '\n' | grep . | xargs -P 4 -I{} \ + aria2c --continue=true --allow-overwrite=true --auto-file-renaming=false \ + -x16 -s16 --min-split-size=20M --summary-interval=15 \ + -d "${DATADIR}" "${BUCKET}/{}" +else + echo ${FILES} | tr ' ' '\n' | grep . | \ + xargs -P 8 -I{} wget --continue --progress=dot:giga -P "${DATADIR}" "${BUCKET}/{}" +fi + +# Versions with no published Docker image (clickhouse-built:*) are built from +# source on the fly by run-version.sh itself (it looks up the recipe in +# build-from-source/versions.txt or monthly.tsv), so nothing to do here. + +echo "=== benchmarking ${VERSION} (image ${IMAGE}, datasets: ${DATASETS}) ===" +timeout @timeout@ ./run-version.sh "${VERSION}" "${IMAGE}" all 2>&1 | tee -a log + +MACHINE=$(curl -sS -H "X-aws-ec2-metadata-token: $(curl -X PUT 'http://169.254.169.254/latest/api/token' -sS -H 'X-aws-ec2-metadata-token-ttl-seconds: 21600')" 'http://169.254.169.254/latest/meta-data/instance-type') +echo "machine: ${MACHINE}, total time: ${SECONDS}s" | tee -a log + +# Build the result payload: the version's result JSON enriched with run metadata, +# as one compact line, and send it to the sink (sink.data). A server-side MV +# parses these into the versions report, mirroring the main ClickBench sink. +RESULTS_URL='https://play.clickhouse.com/?user=sink&query=INSERT+INTO+data+FORMAT+RawBLOB' +if [ -f "results/${VERSION}.json" ]; then + jq -c --arg machine "${MACHINE}" --arg kind 'versions-benchmark' \ + '. + {kind: $kind, machine: $machine}' "results/${VERSION}.json" \ + | curl "${RESULTS_URL}" --data-binary @- +fi + +# Also send the (truncated) log for diagnostics, as the main benchmark does. +send_log() { + local f="$1" size + size=$(stat -c%s "$f" 2>/dev/null || echo 0) + if [ "$size" -le 1000000 ]; then + curl "${RESULTS_URL}" --data-binary @"$f" + else + { head -c 100000 "$f" + printf '\n...[%d bytes truncated]...\n' "$((size - 1000000))" + tail -c 900000 "$f"; } | curl "${RESULTS_URL}" --data-binary @- + fi +} +send_log log +send_log /var/log/cloud-init-output.log + +shutdown now diff --git a/versions/config/listen.xml b/versions/config/listen.xml new file mode 100644 index 0000000000..1f321d1495 --- /dev/null +++ b/versions/config/listen.xml @@ -0,0 +1,9 @@ + + + + 0.0.0.0 + 127.0.0.1 + diff --git a/versions/create/create.sh b/versions/create/create.sh new file mode 100755 index 0000000000..6ce3803aa4 --- /dev/null +++ b/versions/create/create.sh @@ -0,0 +1,170 @@ +#!/usr/bin/env bash +# Emit a CREATE TABLE statement for
of , tailored to . +# +# ./create.sh
+# +# Datasets: hits | ssb | mgbench | tpch | tpcds | coffeeshop | taxi +# Each dataset is loaded into its own database (named after the dataset), so +# tables with the same name across datasets (e.g. TPC-H and TPC-DS both have a +# `customer`) never collide. The statement here is unqualified; the runner +# creates it with `--database `. +# +# The same Native data files load into every version, so only the *engine* +# clause changes with the version: +# * Modern releases use custom-partitioning syntax: +# ENGINE = MergeTree PARTITION BY toYYYYMM() ORDER BY () +# * The earliest 1.1.x releases (before custom partitioning landed) only +# understand the legacy positional syntax, which needs a Date column: +# ENGINE = MergeTree(, (), 8192) +# Every table therefore carries a Date column (a natural one where it exists, +# else a synthesised constant synth_date) usable by the legacy engine. + +set -euo pipefail +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" + +VERSION="${1:?usage: create.sh
}" +DATASET="${2:?usage: create.sh
}" +TABLE="${3:?usage: create.sh
}" + +# Custom-partitioning (new) syntax landed in 1.1.54310; everything from 18.x +# on supports it. Older 1.1.x builds get the legacy positional engine. +new_syntax() { + local major minor patch + IFS=. read -r major minor patch _ <<<"$VERSION" + if [[ "$VERSION" =~ ^[0-9]+$ ]]; then + # Bare build number (earliest 2016 releases, e.g. 53973..54011): custom + # partitioning landed at build 54310, and all bare tags predate it. + [ "$VERSION" -ge 54310 ] + elif [ "$major" = "1" ] && [ "$minor" = "1" ]; then + [ "${patch:-0}" -ge 54310 ] + else + [ "$major" -ge 18 ] + fi +} + +# The prehistoric monthly reconstructions are labeled by month (YYYY-MM-01) and all +# report version 0.0., so they can't be classified by version number. Their engine +# support (probed empirically across the reconstructed images) falls into tiers: +# 2012-04 .. 2012-12 MergeTree is non-functional -> ENGINE = Log +# 2013-01 .. 2014-03 MergeTree needs a mandatory -> MergeTree(date, , +# sampling expression (key,), 8192) +# 2014-04 and later plain positional MergeTree works -> MergeTree(date,(key),8192) +# (2012-04/05 additionally have no scriptable client, so they will load nothing regardless; +# Log is emitted for them for consistency.) Echoes the tier, or "" for non-prehistoric +# versions (handled by new_syntax above). +prehistoric_tier() { + [[ "$VERSION" =~ ^([0-9]{4})-([0-9]{2})-[0-9]{2}$ ]] || { echo ""; return; } + local ym="${BASH_REMATCH[1]}${BASH_REMATCH[2]}" + if [ "$ym" -le 201212 ]; then echo log + elif [ "$ym" -le 201403 ]; then echo legacy_sample + else echo legacy_plain + fi +} + +# `customer` exists in both TPC-H and TPC-DS with different schemas, so it is +# disambiguated by dataset (and its columns file is dataset-qualified below). +if [ "$TABLE" = "customer" ]; then + DATE_COL=synth_date + if [ "$DATASET" = "tpcds" ]; then ORDER_KEY="c_customer_sk"; else ORDER_KEY="c_custkey"; fi +else +case "$TABLE" in + hits) DATE_COL=EventDate; ORDER_KEY="CounterID, EventDate, intHash32(UserID), EventTime" ;; + lineorder_flat) DATE_COL=LO_ORDERDATE; ORDER_KEY="LO_ORDERDATE, LO_ORDERKEY" ;; + logs1) DATE_COL=log_date; ORDER_KEY="machine_group, machine_name, log_time" ;; + logs2) DATE_COL=log_date; ORDER_KEY="log_time" ;; + logs3) DATE_COL=log_date; ORDER_KEY="event_type, log_time" ;; + trips) DATE_COL=pickup_date; ORDER_KEY="cab_type, passenger_count" ;; + ontime) DATE_COL=FlightDate; ORDER_KEY="Year, Month, FlightDate, IATA_CODE_Reporting_Airline" ;; + uk_price_paid) DATE_COL=date; ORDER_KEY="postcode1, postcode2, addr1, addr2" ;; + # TPC-H. Dimension tables have no date, so they carry a synthesised constant + # synth_date usable by the legacy positional engine; the two fact tables use + # their natural date (o_orderdate / l_shipdate). + nation) DATE_COL=synth_date; ORDER_KEY="n_nationkey" ;; + region) DATE_COL=synth_date; ORDER_KEY="r_regionkey" ;; + part) DATE_COL=synth_date; ORDER_KEY="p_partkey" ;; + supplier) DATE_COL=synth_date; ORDER_KEY="s_suppkey" ;; + partsupp) DATE_COL=synth_date; ORDER_KEY="ps_partkey, ps_suppkey" ;; + orders) DATE_COL=o_orderdate; ORDER_KEY="o_orderkey" ;; + lineitem) DATE_COL=l_shipdate; ORDER_KEY="l_orderkey, l_linenumber" ;; + # TPC-DS. Only Decimal was downgraded (-> Float64); all 24 tables carry a + # constant synth_date for the legacy engine, with the spec primary key as + # the sort key. + call_center) DATE_COL=synth_date; ORDER_KEY="cc_call_center_sk" ;; + catalog_page) DATE_COL=synth_date; ORDER_KEY="cp_catalog_page_sk" ;; + catalog_returns) DATE_COL=synth_date; ORDER_KEY="cr_item_sk, cr_order_number" ;; + catalog_sales) DATE_COL=synth_date; ORDER_KEY="cs_item_sk, cs_order_number" ;; + customer_address) DATE_COL=synth_date; ORDER_KEY="ca_address_sk" ;; + customer_demographics) DATE_COL=synth_date; ORDER_KEY="cd_demo_sk" ;; + date_dim) DATE_COL=synth_date; ORDER_KEY="d_date_sk" ;; + household_demographics) DATE_COL=synth_date; ORDER_KEY="hd_demo_sk" ;; + income_band) DATE_COL=synth_date; ORDER_KEY="ib_income_band_sk" ;; + inventory) DATE_COL=synth_date; ORDER_KEY="inv_date_sk, inv_item_sk, inv_warehouse_sk" ;; + item) DATE_COL=synth_date; ORDER_KEY="i_item_sk" ;; + promotion) DATE_COL=synth_date; ORDER_KEY="p_promo_sk" ;; + reason) DATE_COL=synth_date; ORDER_KEY="r_reason_sk" ;; + ship_mode) DATE_COL=synth_date; ORDER_KEY="sm_ship_mode_sk" ;; + store_returns) DATE_COL=synth_date; ORDER_KEY="sr_item_sk, sr_ticket_number" ;; + store_sales) DATE_COL=synth_date; ORDER_KEY="ss_item_sk, ss_ticket_number" ;; + store) DATE_COL=synth_date; ORDER_KEY="s_store_sk" ;; + time_dim) DATE_COL=synth_date; ORDER_KEY="t_time_sk" ;; + warehouse) DATE_COL=synth_date; ORDER_KEY="w_warehouse_sk" ;; + web_page) DATE_COL=synth_date; ORDER_KEY="wp_web_page_sk" ;; + web_returns) DATE_COL=synth_date; ORDER_KEY="wr_item_sk, wr_order_number" ;; + web_sales) DATE_COL=synth_date; ORDER_KEY="ws_item_sk, ws_order_number" ;; + web_site) DATE_COL=synth_date; ORDER_KEY="web_site_sk" ;; + # Coffee Shop benchmark. fact_sales has a natural order_date; the two small + # dimensions carry synth_date. + fact_sales) DATE_COL=order_date; ORDER_KEY="order_id" ;; + dim_locations) DATE_COL=synth_date; ORDER_KEY="record_id" ;; + dim_products) DATE_COL=synth_date; ORDER_KEY="record_id" ;; + # Join Order Benchmark (IMDB). No date columns anywhere, so all 21 tables + # carry a constant synth_date; every table's primary key is `id`. + aka_name|aka_title|cast_info|char_name|comp_cast_type|company_name|company_type|complete_cast|info_type|keyword|kind_type|link_type|movie_companies|movie_info|movie_info_idx|movie_keyword|movie_link|name|person_info|role_type|title) + DATE_COL=synth_date; ORDER_KEY="id" ;; + *) echo "unknown table: $TABLE" >&2; exit 1 ;; +esac +fi + +# Columns file, dataset-qualified where a table name is shared across datasets +# (e.g. schema/tpcds_customer.columns), otherwise the plain schema/
.columns. +COLUMNS_FILE="${HERE}/schema/${DATASET}_${TABLE}.columns" +[ -f "${COLUMNS_FILE}" ] || COLUMNS_FILE="${HERE}/schema/${TABLE}.columns" +COLUMNS="$(cat "${COLUMNS_FILE}")" + +echo "DROP TABLE IF EXISTS ${TABLE};" +TIER="$(prehistoric_tier)" +if [ "${TIER}" = "log" ]; then + # MergeTree not usable this early: Log has no primary key / no parts (so no data_size + # metric), but loads and scans fine for the queries. + cat <= toDateTime('2017-01-11 00:00:00')) AS r GROUP BY machine_name;", + "SELECT machine_name, log_time FROM logs1 WHERE (machine_name LIKE 'cslab%' OR machine_name LIKE 'mslab%') AND load_one IS NULL AND log_time >= toDateTime('2017-01-10 00:00:00') ORDER BY machine_name, log_time;", + "SELECT dt, hr, AVG(load_fifteen) AS load_fifteen_avg, AVG(load_five) AS load_five_avg, AVG(load_one) AS load_one_avg, AVG(mem_free) AS mem_free_avg, AVG(swap_free) AS swap_free_avg FROM ( SELECT CAST(log_time AS DATE) AS dt, toHour(log_time) AS hr, load_fifteen, load_five, load_one, mem_free, swap_free FROM logs1 WHERE machine_name = 'babbage' AND load_fifteen IS NOT NULL AND load_five IS NOT NULL AND load_one IS NOT NULL AND mem_free IS NOT NULL AND swap_free IS NOT NULL AND log_time >= toDateTime('2017-01-01 00:00:00')) AS r GROUP BY dt, hr ORDER BY dt, hr;", + "SELECT machine_name, COUNT(*) AS spikes FROM logs1 WHERE machine_group = 'Servers' AND cpu_wio > 0.99 AND log_time >= toDateTime('2016-12-01 00:00:00') AND log_time < toDateTime('2017-01-01 00:00:00') GROUP BY machine_name ORDER BY spikes DESC LIMIT 10;", + "SELECT machine_name, dt, MIN(mem_free) AS mem_free_min FROM ( SELECT machine_name, CAST(log_time AS DATE) AS dt, mem_free FROM logs1 WHERE machine_group = 'DMZ' AND mem_free IS NOT NULL ) AS r GROUP BY machine_name, dt HAVING MIN(mem_free) < 10000 ORDER BY machine_name, dt;", + "SELECT dt, hr, SUM(net_in) AS net_in_sum, SUM(net_out) AS net_out_sum, SUM(net_in) + SUM(net_out) AS both_sum FROM ( SELECT CAST(log_time AS DATE) AS dt, toHour(log_time) AS hr, ifNull(bytes_in, 0.0) / 1000000000.0 AS net_in, ifNull(bytes_out, 0.0) / 1000000000.0 AS net_out FROM logs1 WHERE machine_name IN ('allsorts','andes','bigred','blackjack','bonbon','cadbury','chiclets','cotton','crows','dove','fireball','hearts','huey','lindt','milkduds','milkyway','mnm','necco','nerds','orbit','peeps','poprocks','razzles','runts','smarties','smuggler','spree','stride','tootsie','trident','wrigley','york') ) AS r GROUP BY dt, hr ORDER BY both_sum DESC LIMIT 10;", + "SELECT * FROM logs2 WHERE status_code >= 500 AND log_time >= toDateTime('2012-12-18 00:00:00') ORDER BY log_time;", + "SELECT * FROM logs2 WHERE status_code >= 200 AND status_code < 300 AND request LIKE '%/etc/passwd%' AND log_time >= toDateTime('2012-05-06 00:00:00') AND log_time < toDateTime('2012-05-20 00:00:00');", + "SELECT top_level, AVG(length(request) - length(replaceOne(request, '/',''))) AS depth_avg FROM ( SELECT substring(request, 1, len) AS top_level, request FROM ( SELECT position('/', substring(request, 2)) AS len, request FROM logs2 WHERE status_code >= 200 AND status_code < 300 AND log_time >= toDateTime('2012-12-01 00:00:00')) AS r WHERE len > 0 ) AS s WHERE top_level IN ('/about','/courses','/degrees','/events','/grad','/industry','/news','/people','/publications','/research','/teaching','/ugrad') GROUP BY top_level ORDER BY top_level;", + "SELECT client_ip, COUNT(*) AS num_requests FROM logs2 WHERE log_time >= toDateTime('2012-10-01 00:00:00') GROUP BY client_ip HAVING COUNT(*) >= 100000 ORDER BY num_requests DESC;", + "SELECT dt, COUNT(DISTINCT client_ip) FROM ( SELECT CAST(log_time AS DATE) AS dt, client_ip FROM logs2) AS r GROUP BY dt ORDER BY dt;", + "SELECT AVG(transfer) / 125000000.0 AS transfer_avg, MAX(transfer) / 125000000.0 AS transfer_max FROM ( SELECT log_time, SUM(object_size) AS transfer FROM logs2 GROUP BY log_time) AS r;", + "SELECT * FROM logs3 WHERE event_type = 'temperature' AND event_value <= 32.0 AND log_time >= '2019-11-29 17:00:00';", + "SELECT device_name, device_floor, COUNT(*) AS ct FROM logs3 WHERE event_type = 'door_open' AND log_time >= '2019-06-01 00:00:00' GROUP BY device_name, device_floor ORDER BY ct DESC;", + "SELECT yr, mo, SUM(coffee_hourly_avg) AS coffee_monthly_sum, AVG(coffee_hourly_avg) AS coffee_monthly_avg, SUM(printer_hourly_avg) AS printer_monthly_sum, AVG(printer_hourly_avg) AS printer_monthly_avg, SUM(projector_hourly_avg) AS projector_monthly_sum, AVG(projector_hourly_avg) AS projector_monthly_avg, SUM(vending_hourly_avg) AS vending_monthly_sum, AVG(vending_hourly_avg) AS vending_monthly_avg FROM ( SELECT dt, yr, mo, hr, AVG(coffee) AS coffee_hourly_avg, AVG(printer) AS printer_hourly_avg, AVG(projector) AS projector_hourly_avg, AVG(vending) AS vending_hourly_avg FROM ( SELECT CAST(log_time AS DATE) AS dt, toYear(log_time) AS yr, EXTRACT(MONTH FROM log_time) AS mo, toHour(log_time) AS hr, CASE WHEN device_name LIKE 'coffee%' THEN event_value END AS coffee, CASE WHEN device_name LIKE 'printer%' THEN event_value END AS printer, CASE WHEN device_name LIKE 'projector%' THEN event_value END AS projector, CASE WHEN device_name LIKE 'vending%' THEN event_value END AS vending FROM logs3 WHERE device_type = 'meter' ) AS r GROUP BY dt, yr, mo, hr ) AS s GROUP BY yr, mo ORDER BY yr, mo;" +]}, +{"name":"ssb","queries":[ + "SELECT sum(LO_EXTENDEDPRICE * LO_DISCOUNT) AS revenue FROM lineorder_flat WHERE F_YEAR = 1993 AND LO_DISCOUNT BETWEEN 1 AND 3 AND LO_QUANTITY < 25;", + "SELECT sum(LO_EXTENDEDPRICE * LO_DISCOUNT) AS revenue FROM lineorder_flat WHERE toYYYYMM(LO_ORDERDATE) = 199401 AND LO_DISCOUNT BETWEEN 4 AND 6 AND LO_QUANTITY BETWEEN 26 AND 35;", + "SELECT sum(LO_EXTENDEDPRICE * LO_DISCOUNT) AS revenue FROM lineorder_flat WHERE toRelativeWeekNum(LO_ORDERDATE) - toRelativeWeekNum(toDate('1994-01-01')) = 6 AND F_YEAR = 1994 AND LO_DISCOUNT BETWEEN 5 AND 7 AND LO_QUANTITY BETWEEN 26 AND 35;", + "SELECT sum(LO_REVENUE), F_YEAR AS year, P_BRAND FROM lineorder_flat WHERE P_CATEGORY = 'MFGR#12' AND S_REGION = 'AMERICA' GROUP BY year, P_BRAND ORDER BY year, P_BRAND;", + "SELECT sum(LO_REVENUE), F_YEAR AS year, P_BRAND FROM lineorder_flat WHERE P_BRAND >= 'MFGR#2221' AND P_BRAND <= 'MFGR#2228' AND S_REGION = 'ASIA' GROUP BY year, P_BRAND ORDER BY year, P_BRAND;", + "SELECT sum(LO_REVENUE), F_YEAR AS year, P_BRAND FROM lineorder_flat WHERE P_BRAND = 'MFGR#2239' AND S_REGION = 'EUROPE' GROUP BY year, P_BRAND ORDER BY year, P_BRAND;", + "SELECT C_NATION, S_NATION, F_YEAR AS year, sum(LO_REVENUE) AS revenue FROM lineorder_flat WHERE C_REGION = 'ASIA' AND S_REGION = 'ASIA' AND year >= 1992 AND year <= 1997 GROUP BY C_NATION, S_NATION, year ORDER BY year ASC, revenue DESC;", + "SELECT C_CITY, S_CITY, F_YEAR AS year, sum(LO_REVENUE) AS revenue FROM lineorder_flat WHERE C_NATION = 'UNITED STATES' AND S_NATION = 'UNITED STATES' AND year >= 1992 AND year <= 1997 GROUP BY C_CITY, S_CITY, year ORDER BY year ASC, revenue DESC;", + "SELECT C_CITY, S_CITY, F_YEAR AS year, sum(LO_REVENUE) AS revenue FROM lineorder_flat WHERE (C_CITY = 'UNITED KI1' OR C_CITY = 'UNITED KI5') AND (S_CITY = 'UNITED KI1' OR S_CITY = 'UNITED KI5') AND year >= 1992 AND year <= 1997 GROUP BY C_CITY, S_CITY, year ORDER BY year ASC, revenue DESC;", + "SELECT C_CITY, S_CITY, F_YEAR AS year, sum(LO_REVENUE) AS revenue FROM lineorder_flat WHERE (C_CITY = 'UNITED KI1' OR C_CITY = 'UNITED KI5') AND (S_CITY = 'UNITED KI1' OR S_CITY = 'UNITED KI5') AND toYYYYMM(LO_ORDERDATE) = 199712 GROUP BY C_CITY, S_CITY, year ORDER BY year ASC, revenue DESC;", + "SELECT F_YEAR AS year, C_NATION, sum(LO_REVENUE - LO_SUPPLYCOST) AS profit FROM lineorder_flat WHERE C_REGION = 'AMERICA' AND S_REGION = 'AMERICA' AND (P_MFGR = 'MFGR#1' OR P_MFGR = 'MFGR#2') GROUP BY year, C_NATION ORDER BY year ASC, C_NATION ASC;", + "SELECT F_YEAR AS year, S_NATION, P_CATEGORY, sum(LO_REVENUE - LO_SUPPLYCOST) AS profit FROM lineorder_flat WHERE C_REGION = 'AMERICA' AND S_REGION = 'AMERICA' AND (year = 1997 OR year = 1998) AND (P_MFGR = 'MFGR#1' OR P_MFGR = 'MFGR#2') GROUP BY year, S_NATION, P_CATEGORY ORDER BY year ASC, S_NATION ASC, P_CATEGORY ASC;", + "SELECT F_YEAR AS year, S_CITY, P_BRAND, sum(LO_REVENUE - LO_SUPPLYCOST) AS profit FROM lineorder_flat WHERE S_NATION = 'UNITED STATES' AND (year = 1997 OR year = 1998) AND P_CATEGORY = 'MFGR#14' GROUP BY year, S_CITY, P_BRAND ORDER BY year ASC, S_CITY ASC, P_BRAND ASC;" +]}, +{"name":"hits","queries":[ + "SELECT count() FROM hits", + "SELECT count() FROM hits WHERE AdvEngineID != 0", + "SELECT sum(AdvEngineID), count(), avg(ResolutionWidth) FROM hits", + "SELECT sum(UserID) FROM hits", + "SELECT uniq(UserID) FROM hits", + "SELECT uniq(SearchPhrase) FROM hits", + "SELECT min(EventDate), max(EventDate) FROM hits", + "SELECT AdvEngineID, count() FROM hits WHERE AdvEngineID != 0 GROUP BY AdvEngineID ORDER BY count() DESC", + "SELECT RegionID, uniq(UserID) AS u FROM hits GROUP BY RegionID ORDER BY u DESC LIMIT 10", + "SELECT RegionID, sum(AdvEngineID), count() AS c, avg(ResolutionWidth), uniq(UserID) FROM hits GROUP BY RegionID ORDER BY c DESC LIMIT 10", + "SELECT MobilePhoneModel, uniq(UserID) AS u FROM hits WHERE MobilePhoneModel != '' GROUP BY MobilePhoneModel ORDER BY u DESC LIMIT 10", + "SELECT MobilePhone, MobilePhoneModel, uniq(UserID) AS u FROM hits WHERE MobilePhoneModel != '' GROUP BY MobilePhone, MobilePhoneModel ORDER BY u DESC LIMIT 10", + "SELECT SearchPhrase, count() AS c FROM hits WHERE SearchPhrase != '' GROUP BY SearchPhrase ORDER BY c DESC LIMIT 10", + "SELECT SearchPhrase, uniq(UserID) AS u FROM hits WHERE SearchPhrase != '' GROUP BY SearchPhrase ORDER BY u DESC LIMIT 10", + "SELECT SearchEngineID, SearchPhrase, count() AS c FROM hits WHERE SearchPhrase != '' GROUP BY SearchEngineID, SearchPhrase ORDER BY c DESC LIMIT 10", + "SELECT UserID, count() FROM hits GROUP BY UserID ORDER BY count() DESC LIMIT 10", + "SELECT UserID, SearchPhrase, count() FROM hits GROUP BY UserID, SearchPhrase ORDER BY count() DESC LIMIT 10", + "SELECT UserID, SearchPhrase, count() FROM hits GROUP BY UserID, SearchPhrase LIMIT 10", + "SELECT UserID, toMinute(EventTime) AS m, SearchPhrase, count() FROM hits GROUP BY UserID, m, SearchPhrase ORDER BY count() DESC LIMIT 10", + "SELECT UserID FROM hits WHERE UserID = 12345678901234567890", + "SELECT count() FROM hits WHERE URL LIKE '%metrika%'", + "SELECT SearchPhrase, any(URL), count() AS c FROM hits WHERE URL LIKE '%metrika%' AND SearchPhrase != '' GROUP BY SearchPhrase ORDER BY c DESC LIMIT 10", + "SELECT SearchPhrase, any(URL), any(Title), count() AS c, uniq(UserID) FROM hits WHERE Title LIKE '%Яндекс%' AND URL NOT LIKE '%.yandex.%' AND SearchPhrase != '' GROUP BY SearchPhrase ORDER BY c DESC LIMIT 10", + "SELECT * FROM hits WHERE URL LIKE '%metrika%' ORDER BY EventTime LIMIT 10", + "SELECT SearchPhrase FROM hits WHERE SearchPhrase != '' ORDER BY EventTime LIMIT 10", + "SELECT SearchPhrase FROM hits WHERE SearchPhrase != '' ORDER BY SearchPhrase LIMIT 10", + "SELECT SearchPhrase FROM hits WHERE SearchPhrase != '' ORDER BY EventTime, SearchPhrase LIMIT 10", + "SELECT CounterID, avg(length(URL)) AS l, count() AS c FROM hits WHERE URL != '' GROUP BY CounterID HAVING c > 100000 ORDER BY l DESC LIMIT 25", + "SELECT domainWithoutWWW(Referer) AS key, avg(length(Referer)) AS l, count() AS c, any(Referer) FROM hits WHERE Referer != '' GROUP BY key HAVING c > 100000 ORDER BY l DESC LIMIT 25", + "SELECT sum(ResolutionWidth), sum(ResolutionWidth + 1), sum(ResolutionWidth + 2), sum(ResolutionWidth + 3), sum(ResolutionWidth + 4), sum(ResolutionWidth + 5), sum(ResolutionWidth + 6), sum(ResolutionWidth + 7), sum(ResolutionWidth + 8), sum(ResolutionWidth + 9), sum(ResolutionWidth + 10), sum(ResolutionWidth + 11), sum(ResolutionWidth + 12), sum(ResolutionWidth + 13), sum(ResolutionWidth + 14), sum(ResolutionWidth + 15), sum(ResolutionWidth + 16), sum(ResolutionWidth + 17), sum(ResolutionWidth + 18), sum(ResolutionWidth + 19), sum(ResolutionWidth + 20), sum(ResolutionWidth + 21), sum(ResolutionWidth + 22), sum(ResolutionWidth + 23), sum(ResolutionWidth + 24), sum(ResolutionWidth + 25), sum(ResolutionWidth + 26), sum(ResolutionWidth + 27), sum(ResolutionWidth + 28), sum(ResolutionWidth + 29), sum(ResolutionWidth + 30), sum(ResolutionWidth + 31), sum(ResolutionWidth + 32), sum(ResolutionWidth + 33), sum(ResolutionWidth + 34), sum(ResolutionWidth + 35), sum(ResolutionWidth + 36), sum(ResolutionWidth + 37), sum(ResolutionWidth + 38), sum(ResolutionWidth + 39), sum(ResolutionWidth + 40), sum(ResolutionWidth + 41), sum(ResolutionWidth + 42), sum(ResolutionWidth + 43), sum(ResolutionWidth + 44), sum(ResolutionWidth + 45), sum(ResolutionWidth + 46), sum(ResolutionWidth + 47), sum(ResolutionWidth + 48), sum(ResolutionWidth + 49), sum(ResolutionWidth + 50), sum(ResolutionWidth + 51), sum(ResolutionWidth + 52), sum(ResolutionWidth + 53), sum(ResolutionWidth + 54), sum(ResolutionWidth + 55), sum(ResolutionWidth + 56), sum(ResolutionWidth + 57), sum(ResolutionWidth + 58), sum(ResolutionWidth + 59), sum(ResolutionWidth + 60), sum(ResolutionWidth + 61), sum(ResolutionWidth + 62), sum(ResolutionWidth + 63), sum(ResolutionWidth + 64), sum(ResolutionWidth + 65), sum(ResolutionWidth + 66), sum(ResolutionWidth + 67), sum(ResolutionWidth + 68), sum(ResolutionWidth + 69), sum(ResolutionWidth + 70), sum(ResolutionWidth + 71), sum(ResolutionWidth + 72), sum(ResolutionWidth + 73), sum(ResolutionWidth + 74), sum(ResolutionWidth + 75), sum(ResolutionWidth + 76), sum(ResolutionWidth + 77), sum(ResolutionWidth + 78), sum(ResolutionWidth + 79), sum(ResolutionWidth + 80), sum(ResolutionWidth + 81), sum(ResolutionWidth + 82), sum(ResolutionWidth + 83), sum(ResolutionWidth + 84), sum(ResolutionWidth + 85), sum(ResolutionWidth + 86), sum(ResolutionWidth + 87), sum(ResolutionWidth + 88), sum(ResolutionWidth + 89) FROM hits", + "SELECT SearchEngineID, ClientIP, count() AS c, sum(Refresh), avg(ResolutionWidth) FROM hits WHERE SearchPhrase != '' GROUP BY SearchEngineID, ClientIP ORDER BY c DESC LIMIT 10", + "SELECT WatchID, ClientIP, count() AS c, sum(Refresh), avg(ResolutionWidth) FROM hits WHERE SearchPhrase != '' GROUP BY WatchID, ClientIP ORDER BY c DESC LIMIT 10", + "SELECT WatchID, ClientIP, count() AS c, sum(Refresh), avg(ResolutionWidth) FROM hits GROUP BY WatchID, ClientIP ORDER BY c DESC LIMIT 10", + "SELECT URL, count() AS c FROM hits GROUP BY URL ORDER BY c DESC LIMIT 10", + "SELECT 1, URL, count() AS c FROM hits GROUP BY 1, URL ORDER BY c DESC LIMIT 10", + "SELECT ClientIP AS x, x - 1, x - 2, x - 3, count() AS c FROM hits GROUP BY x, x - 1, x - 2, x - 3 ORDER BY c DESC LIMIT 10", + "SELECT URL, count() AS PageViews FROM hits WHERE CounterID = 62 AND EventDate >= toDate('2013-07-01') AND EventDate <= toDate('2013-07-31') AND NOT DontCountHits AND NOT Refresh AND notEmpty(URL) GROUP BY URL ORDER BY PageViews DESC LIMIT 10", + "SELECT Title, count() AS PageViews FROM hits WHERE CounterID = 62 AND EventDate >= toDate('2013-07-01') AND EventDate <= toDate('2013-07-31') AND NOT DontCountHits AND NOT Refresh AND notEmpty(Title) GROUP BY Title ORDER BY PageViews DESC LIMIT 10", + "SELECT URL, count() AS PageViews FROM hits WHERE CounterID = 62 AND EventDate >= toDate('2013-07-01') AND EventDate <= toDate('2013-07-31') AND NOT Refresh AND IsLink AND NOT IsDownload GROUP BY URL ORDER BY PageViews DESC LIMIT 1000", + "SELECT TraficSourceID, SearchEngineID, AdvEngineID, ((SearchEngineID = 0 AND AdvEngineID = 0) ? Referer : '') AS Src, URL AS Dst, count() AS PageViews FROM hits WHERE CounterID = 62 AND EventDate >= toDate('2013-07-01') AND EventDate <= toDate('2013-07-31') AND NOT Refresh GROUP BY TraficSourceID, SearchEngineID, AdvEngineID, Src, Dst ORDER BY PageViews DESC LIMIT 1000", + "SELECT URLHash, EventDate, count() AS PageViews FROM hits WHERE CounterID = 62 AND EventDate >= toDate('2013-07-01') AND EventDate <= toDate('2013-07-31') AND NOT Refresh AND TraficSourceID IN (-1, 6) AND RefererHash = halfMD5('http://yandex.ru/') GROUP BY URLHash, EventDate ORDER BY PageViews DESC LIMIT 100", + "SELECT WindowClientWidth, WindowClientHeight, count() AS PageViews FROM hits WHERE CounterID = 62 AND EventDate >= toDate('2013-07-01') AND EventDate <= toDate('2013-07-31') AND NOT Refresh AND NOT DontCountHits AND URLHash = halfMD5('http://yandex.ru/') GROUP BY WindowClientWidth, WindowClientHeight ORDER BY PageViews DESC LIMIT 10000;", + "SELECT toStartOfMinute(EventTime) AS Minute, count() AS PageViews FROM hits WHERE CounterID = 62 AND EventDate >= toDate('2013-07-01') AND EventDate <= toDate('2013-07-02') AND NOT Refresh AND NOT DontCountHits GROUP BY Minute ORDER BY Minute;" +]}, +{"name":"uk","queries":[ + "SELECT toYear(date) AS year, round(avg(price)) AS price FROM uk_price_paid GROUP BY year ORDER BY year", + "SELECT toYear(date) AS year, round(avg(price)) AS price FROM uk_price_paid WHERE town = 'LONDON' GROUP BY year ORDER BY year", + "SELECT town, district, count() AS c, round(avg(price)) AS price FROM uk_price_paid WHERE date >= '2020-01-01' GROUP BY town, district HAVING c >= 100 ORDER BY price DESC LIMIT 100" +]}, +{"name":"ontime","queries":[ + "SELECT avg(c1) FROM (SELECT Year, Month, count(*) AS c1 FROM ontime GROUP BY Year, Month)", + "SELECT DayOfWeek, count(*) AS c FROM ontime WHERE Year>=2000 AND Year<=2008 GROUP BY DayOfWeek ORDER BY c DESC", + "SELECT DayOfWeek, count(*) AS c FROM ontime WHERE DepDelay>10 AND Year>=2000 AND Year<=2008 GROUP BY DayOfWeek ORDER BY c DESC", + "SELECT Origin, count(*) AS c FROM ontime WHERE DepDelay>10 AND Year>=2000 AND Year<=2008 GROUP BY Origin ORDER BY c DESC LIMIT 10", + "SELECT IATA_CODE_Reporting_Airline AS Carrier, count(*) FROM ontime WHERE DepDelay>10 AND Year=2007 GROUP BY Carrier ORDER BY count(*) DESC", + "SELECT Carrier, c, c2, c*100/c2 AS c3 FROM (SELECT IATA_CODE_Reporting_Airline AS Carrier, count(*) AS c FROM ontime WHERE DepDelay>10 AND Year=2007 GROUP BY Carrier) q JOIN (SELECT IATA_CODE_Reporting_Airline AS Carrier, count(*) AS c2 FROM ontime WHERE Year=2007 GROUP BY Carrier) qq USING Carrier ORDER BY c3 DESC", + "SELECT Carrier, c, c2, c*100/c2 AS c3 FROM (SELECT IATA_CODE_Reporting_Airline AS Carrier, count(*) AS c FROM ontime WHERE DepDelay>10 AND Year>=2000 AND Year<=2008 GROUP BY Carrier) q JOIN (SELECT IATA_CODE_Reporting_Airline AS Carrier, count(*) AS c2 FROM ontime WHERE Year>=2000 AND Year<=2008 GROUP BY Carrier) qq USING Carrier ORDER BY c3 DESC", + "SELECT Year, c1/c2 FROM (SELECT Year, count(*)*100 AS c1 FROM ontime WHERE DepDelay>10 GROUP BY Year) q JOIN (SELECT Year, count(*) AS c2 FROM ontime GROUP BY Year) qq USING (Year) ORDER BY Year", + "SELECT DestCityName, uniqExact(OriginCityName) AS u FROM ontime WHERE Year >= 2000 AND Year <= 2010 GROUP BY DestCityName ORDER BY u DESC LIMIT 10", + "SELECT Year, count(*) AS c1 FROM ontime GROUP BY Year", + "SELECT min(Year), max(Year), IATA_CODE_Reporting_Airline AS Carrier, count(*) AS cnt, sum(ArrDelayMinutes>30) AS flights_delayed, round(sum(ArrDelayMinutes>30)/count(*),2) AS rate FROM ontime WHERE DayOfWeek NOT IN (6,7) AND OriginState NOT IN ('AK', 'HI', 'PR', 'VI') AND DestState NOT IN ('AK', 'HI', 'PR', 'VI') AND FlightDate < '2010-01-01' GROUP BY Carrier HAVING cnt>100000 AND max(Year)>1990 ORDER BY rate DESC LIMIT 1000" +]}, +{"name":"taxi","queries":[ + "SELECT cab_type, count(*) FROM trips GROUP BY cab_type;", + "SELECT passenger_count, avg(total_amount) FROM trips GROUP BY passenger_count;", + "SELECT passenger_count, toYear(pickup_date) AS year, count(*) FROM trips GROUP BY passenger_count, year;", + "SELECT passenger_count, toYear(pickup_date) AS year, round(trip_distance) AS distance, count(*) FROM trips GROUP BY passenger_count, year, distance ORDER BY year, count(*) DESC;" +]}, +{"name":"coffeeshop","queries":[ + "SELECT f.order_date, l.city, SUM(f.sales_amount) AS total_sales, AVG(SUM(f.sales_amount)) OVER ( PARTITION BY l.city ORDER BY f.order_date ROWS BETWEEN 6 PRECEDING AND CURRENT ROW ) AS rolling_7day_avg FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id GROUP BY f.order_date, l.city ORDER BY l.city, f.order_date", + "WITH monthly_sales AS ( SELECT DATE_TRUNC('month', f.order_date) AS sales_month, f.product_name, SUM(f.sales_amount) AS total_sales FROM fact_sales f GROUP BY DATE_TRUNC('month', f.order_date), f.product_name ) SELECT sales_month, product_name, total_sales, RANK() OVER (PARTITION BY sales_month ORDER BY total_sales DESC) AS sales_rank FROM monthly_sales ORDER BY sales_month, sales_rank", + "WITH season_discount AS ( SELECT l.city, l.state, f.season, AVG(f.discount_percentage) AS avg_discount FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id GROUP BY l.city, l.state, f.season ) SELECT city, state, season, avg_discount, discount_rank FROM ( SELECT city, state, season, avg_discount, DENSE_RANK() OVER (PARTITION BY season ORDER BY avg_discount DESC) AS discount_rank FROM season_discount ) t WHERE discount_rank <= 3 ORDER BY season, discount_rank", + "SELECT f.order_date, f.product_name, p.standard_price, p.standard_cost, SUM(f.quantity) AS total_quantity_sold, SUM(f.sales_amount) AS total_sales_amount, (p.standard_price - p.standard_cost) * SUM(f.quantity) AS theoretical_margin FROM fact_sales f JOIN dim_products p ON f.product_name = p.name AND f.order_date BETWEEN p.from_date AND p.to_date GROUP BY f.order_date, f.product_name, p.standard_price, p.standard_cost ORDER BY f.order_date, f.product_name", + "WITH daily_city_qty AS ( SELECT f.order_date, l.city, SUM(f.quantity) AS daily_qty FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id GROUP BY f.order_date, l.city ) SELECT order_date, city, daily_qty, SUM(daily_qty) OVER ( PARTITION BY city ORDER BY order_date ROWS BETWEEN 29 PRECEDING AND CURRENT ROW ) AS rolling_30day_qty FROM daily_city_qty ORDER BY city, order_date", + "WITH monthly_cat AS ( SELECT DATE_TRUNC('month', f.order_date) AS sales_month, p.category, SUM(f.sales_amount) AS monthly_revenue FROM fact_sales f JOIN dim_products p ON f.product_name = p.name AND f.order_date BETWEEN p.from_date AND p.to_date GROUP BY DATE_TRUNC('month', f.order_date), p.category ) SELECT coalesce(sales_month, DATE('1970-01-01')) AS sales_month, category, monthly_revenue FROM monthly_cat", + "WITH yearly_sales AS ( SELECT l.location_id, l.city, l.state, YEAR(f.order_date) AS sales_year, SUM(f.sales_amount) AS total_sales_year FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id GROUP BY l.location_id, l.city, l.state, YEAR(f.order_date) ) SELECT city, state, SUM(CASE WHEN sales_year = 2023 THEN total_sales_year ELSE 0 END) AS sales_2023, SUM(CASE WHEN sales_year = 2024 THEN total_sales_year ELSE 0 END) AS sales_2024, (SUM(CASE WHEN sales_year = 2024 THEN total_sales_year ELSE 0 END) - SUM(CASE WHEN sales_year = 2023 THEN total_sales_year ELSE 0 END)) AS yoy_diff FROM yearly_sales GROUP BY city, state ORDER BY city, state", + "WITH city_quarter_subcat AS ( SELECT l.city, DATE_TRUNC('quarter', f.order_date) AS sales_quarter, p.subcategory, SUM(f.sales_amount) AS total_sales FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id JOIN dim_products p ON f.product_name = p.name AND f.order_date BETWEEN p.from_date AND p.to_date GROUP BY l.city, DATE_TRUNC('quarter', f.order_date), p.subcategory ) SELECT city, sales_quarter, subcategory, total_sales, RANK() OVER (PARTITION BY city, sales_quarter ORDER BY total_sales DESC) AS subcat_rank FROM city_quarter_subcat ORDER BY city, sales_quarter, subcat_rank", + "WITH daily_discount AS ( SELECT l.city, f.order_date, AVG(f.discount_percentage) AS avg_discount FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id GROUP BY l.city, f.order_date ) SELECT city, order_date, avg_discount, AVG(avg_discount) OVER ( PARTITION BY city ORDER BY order_date ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW ) AS cumulative_avg_discount FROM daily_discount ORDER BY city, order_date", + "WITH daily_orders AS ( SELECT f.order_date, l.city, COUNT(DISTINCT f.order_id) AS daily_distinct_orders FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id GROUP BY l.city, f.order_date ) SELECT coalesce(order_date, DATE('1970-01-01')) AS order_date, coalesce(city, '') AS city, daily_distinct_orders, SUM(daily_distinct_orders) OVER ( PARTITION BY city ORDER BY order_date ROWS BETWEEN 89 PRECEDING AND CURRENT ROW ) AS rolling_90d_distinct_orders FROM daily_orders ORDER BY city, order_date", + "WITH city_quarter_subcat AS ( SELECT l.city, DATE_TRUNC('quarter', f.order_date) AS sales_quarter, p.subcategory, SUM(f.sales_amount) AS total_sales FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id JOIN dim_products p ON f.product_name = p.name AND f.order_date BETWEEN p.from_date AND p.to_date WHERE l.city IN ('Charlotte', 'Houston') GROUP BY l.city, DATE_TRUNC('quarter', f.order_date), p.subcategory ) SELECT city, sales_quarter, subcategory, total_sales, RANK() OVER (PARTITION BY city, sales_quarter ORDER BY total_sales DESC) AS subcat_rank FROM city_quarter_subcat ORDER BY city, sales_quarter, subcat_rank", + "WITH city_quarter_subcat AS ( SELECT l.city, DATE_TRUNC('quarter', f.order_date) AS sales_quarter, p.subcategory, SUM(f.sales_amount) AS total_sales FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id JOIN dim_products p ON f.product_name = p.name AND f.order_date BETWEEN p.from_date AND p.to_date WHERE l.city IN ('Charlotte', 'Houston') AND DATE_TRUNC('quarter', f.order_date) IN ( DATE('2023-01-01'), DATE('2023-04-01'), DATE('2024-01-01'), DATE('2024-04-01') ) GROUP BY l.city, DATE_TRUNC('quarter', f.order_date), p.subcategory ) SELECT city, sales_quarter, subcategory, total_sales, RANK() OVER (PARTITION BY city, sales_quarter ORDER BY total_sales DESC) AS subcat_rank FROM city_quarter_subcat ORDER BY city, sales_quarter, subcat_rank", + "WITH city_quarter_subcat AS ( SELECT l.city, DATE_TRUNC('quarter', f.order_date) AS sales_quarter, p.subcategory, SUM(f.sales_amount) AS total_sales FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id JOIN dim_products p ON f.product_name = p.name AND f.order_date BETWEEN p.from_date AND p.to_date WHERE l.city = 'Austin' AND DATE_TRUNC('quarter', f.order_date) IN ( DATE('2023-01-01'), DATE('2023-04-01'), DATE('2024-01-01'), DATE('2024-04-01') ) GROUP BY l.city, DATE_TRUNC('quarter', f.order_date), p.subcategory ) SELECT city, sales_quarter, subcategory, total_sales, RANK() OVER (PARTITION BY city, sales_quarter ORDER BY total_sales DESC) AS subcat_rank FROM city_quarter_subcat ORDER BY city, sales_quarter, subcat_rank", + "WITH city_quarter_subcat AS ( SELECT l.city, DATE_TRUNC('quarter', f.order_date) AS sales_quarter, p.subcategory, SUM(f.sales_amount) AS total_sales FROM fact_sales f JOIN dim_locations l ON f.location_id = l.location_id JOIN dim_products p ON f.product_name = p.name AND f.order_date BETWEEN p.from_date AND p.to_date WHERE DATE_TRUNC('quarter', f.order_date) IN ( DATE('2023-01-01'), DATE('2023-04-01'), DATE('2024-01-01'), DATE('2024-04-01') ) GROUP BY l.city, DATE_TRUNC('quarter', f.order_date), p.subcategory ) SELECT city, sales_quarter, subcategory, total_sales, RANK() OVER (PARTITION BY city, sales_quarter ORDER BY total_sales DESC) AS subcat_rank FROM city_quarter_subcat ORDER BY city, sales_quarter, subcat_rank", + "WITH base_data AS ( SELECT f.location_id as location_id, l.city, f.product_name, toStartOfQuarter(f.order_date) AS sales_quarter, sum(f.sales_amount) AS total_sales, sum(f.sales_amount * (f.discount_percentage / 100.0)) AS total_discount, sum(f.quantity * p.standard_cost) AS total_cogs FROM fact_sales AS f INNER JOIN dim_products AS p ON f.product_name = p.name AND f.order_date BETWEEN p.from_date AND p.to_date INNER JOIN dim_locations AS l ON f.location_id = l.location_id WHERE f.order_date BETWEEN toDate('2022-01-01') AND toDate('2024-12-31') GROUP BY f.location_id, l.city, f.product_name, sales_quarter ), with_profit AS ( SELECT *, total_sales - total_discount - total_cogs AS profit FROM base_data ) SELECT city, product_name, sales_quarter, profit, lagInFrame(profit) OVER w AS prev_profit, round( if(prev_profit = 0 OR prev_profit IS NULL, NULL, 100.0 * (profit - prev_profit) / prev_profit), 2 ) AS yoy_profit_pct FROM with_profit WINDOW w AS ( PARTITION BY location_id, product_name ORDER BY sales_quarter )", + "WITH seasonal_data AS ( SELECT l.state, f.season, p.category, SUM(f.sales_amount) AS total_sales, SUM(f.quantity) AS total_units, COUNT(DISTINCT f.order_id) AS order_count FROM fact_sales f JOIN dim_products p ON f.product_name = p.name AND DATE(f.order_date) BETWEEN DATE(p.from_date) AND DATE(p.to_date) JOIN dim_locations l ON f.location_id = l.location_id WHERE DATE(f.order_date) BETWEEN DATE('2023-01-01') AND DATE('2024-06-30') GROUP BY l.state, f.season, p.category ), ranked AS ( SELECT *, DENSE_RANK() OVER (PARTITION BY state, season ORDER BY total_sales DESC) AS category_rank FROM seasonal_data ) SELECT * FROM ranked WHERE category_rank <= 3 ORDER BY state, season, category_rank", + "WITH raw_agg AS ( SELECT l.state, f.season, p.category, SUM(f.sales_amount) AS total_sales, SUM(f.quantity) AS total_units, COUNT(DISTINCT f.order_id) AS order_count FROM fact_sales AS f JOIN dim_products AS p ON f.product_id = p.product_id AND DATE(f.order_date) BETWEEN DATE(p.from_date) AND DATE(p.to_date) JOIN dim_locations AS l ON f.location_id = l.location_id WHERE l.region = 'West' AND f.time_of_day = 'Morning' AND p.name = 'Frappe' AND DATE(f.order_date) BETWEEN DATE('2023-01-01') AND DATE('2024-06-30') GROUP BY l.state, f.season, p.category ), seasonal_data AS ( SELECT state, season, category, total_sales, total_units, order_count, SUM(total_sales) OVER (PARTITION BY state, season) AS season_total_sales FROM raw_agg ), ranked AS ( SELECT state, season, category, total_sales, total_units, order_count, season_total_sales, ROUND(100.0 * total_sales / season_total_sales, 2) AS pct_of_season, DENSE_RANK() OVER ( PARTITION BY state, season ORDER BY total_sales DESC ) AS category_rank FROM seasonal_data ) SELECT state, season, category, total_sales, total_units, order_count, pct_of_season, category_rank FROM ranked WHERE category_rank <= 3 ORDER BY state, season, category_rank" +]}, +{"name":"tpch","queries":[ + "SELECT l_returnflag, l_linestatus, sum(l_quantity) AS sum_qty, sum(l_extendedprice) AS sum_base_price, sum(l_extendedprice * (1 - l_discount)) AS sum_disc_price, sum(l_extendedprice * (1 - l_discount) * (1 + l_tax)) AS sum_charge, avg(l_quantity) AS avg_qty, avg(l_extendedprice) AS avg_price, avg(l_discount) AS avg_disc, count(*) AS count_order FROM lineitem WHERE (l_shipdate <= date '1998-12-01' - INTERVAL 90 DAY) GROUP BY l_returnflag, l_linestatus ORDER BY l_returnflag, l_linestatus", + "SELECT s_acctbal, s_name, n_name, p_partkey, p_mfgr, s_address, s_phone, s_comment FROM part, supplier, partsupp, nation, region WHERE (p_partkey = ps_partkey) AND (s_suppkey = ps_suppkey) AND (p_size = 15) AND (p_type LIKE '%BRASS') AND (s_nationkey = n_nationkey) AND (n_regionkey = r_regionkey) AND (r_name = 'EUROPE') AND (ps_supplycost = ( SELECT min(ps_supplycost) FROM partsupp, supplier, nation, region WHERE (p_partkey = ps_partkey) AND (s_suppkey = ps_suppkey) AND (s_nationkey = n_nationkey) AND (n_regionkey = r_regionkey) AND (r_name = 'EUROPE') )) ORDER BY s_acctbal DESC, n_name, s_name, p_partkey LIMIT 100", + "SELECT l_orderkey, sum(l_extendedprice * (1 - l_discount)) AS revenue, o_orderdate, o_shippriority FROM customer, orders, lineitem WHERE (c_mktsegment = 'BUILDING') AND (c_custkey = o_custkey) AND (l_orderkey = o_orderkey) AND (o_orderdate < date '1995-03-15') AND (l_shipdate > date '1995-03-15') GROUP BY l_orderkey, o_orderdate, o_shippriority ORDER BY revenue DESC, o_orderdate LIMIT 10", + "SELECT o_orderpriority, count(*) AS order_count FROM orders WHERE (o_orderdate >= date '1993-07-01') AND (o_orderdate < date '1993-07-01' + INTERVAL 3 MONTH) AND EXISTS ( SELECT * FROM lineitem WHERE (l_orderkey = o_orderkey) AND (l_commitdate < l_receiptdate) ) GROUP BY o_orderpriority ORDER BY o_orderpriority", + "SELECT n_name, sum(l_extendedprice * (1 - l_discount)) AS revenue FROM customer, orders, lineitem, supplier, nation, region WHERE (c_custkey = o_custkey) AND (l_orderkey = o_orderkey) AND (l_suppkey = s_suppkey) AND (c_nationkey = s_nationkey) AND (s_nationkey = n_nationkey) AND (n_regionkey = r_regionkey) AND (r_name = 'ASIA') AND (o_orderdate >= date '1994-01-01') AND (o_orderdate < date '1994-01-01' + INTERVAL 1 YEAR) GROUP BY n_name ORDER BY revenue DESC", + "SELECT sum(l_extendedprice * l_discount) AS revenue FROM lineitem WHERE (l_shipdate >= date '1994-01-01') AND (l_shipdate < date '1994-01-01' + INTERVAL 1 YEAR) AND (l_discount BETWEEN 0.06::Decimal(12,2) - 0.01::Decimal(12,2) AND 0.06::Decimal(12,2) + 0.01::Decimal(12,2)) AND (l_quantity < 24)", + "SELECT supp_nation, cust_nation, l_year, sum(volume) AS revenue FROM ( SELECT n1.n_name AS supp_nation, n2.n_name AS cust_nation, extract(year FROM l_shipdate) AS l_year, l_extendedprice * (1 - l_discount) AS volume FROM supplier, lineitem, orders, customer, nation AS n1, nation AS n2 WHERE (s_suppkey = l_suppkey) AND (o_orderkey = l_orderkey) AND (c_custkey = o_custkey) AND (s_nationkey = n1.n_nationkey) AND (c_nationkey = n2.n_nationkey) AND ( ((n1.n_name = 'FRANCE') AND (n2.n_name = 'GERMANY')) OR ((n1.n_name = 'GERMANY') AND (n2.n_name = 'FRANCE')) ) AND (l_shipdate BETWEEN date '1995-01-01' AND date '1996-12-31') ) AS shipping GROUP BY supp_nation, cust_nation, l_year ORDER BY supp_nation, cust_nation, l_year", + "SELECT o_year, sum(CASE WHEN nation = 'BRAZIL' THEN volume ELSE 0 END) / sum(volume) AS mkt_share FROM ( SELECT extract(year FROM o_orderdate) AS o_year, l_extendedprice * (1 - l_discount) AS volume, n2.n_name AS nation FROM part, supplier, lineitem, orders, customer, nation AS n1, nation AS n2, region WHERE (p_partkey = l_partkey) AND (s_suppkey = l_suppkey) AND (l_orderkey = o_orderkey) AND (o_custkey = c_custkey) AND (c_nationkey = n1.n_nationkey) AND (n1.n_regionkey = r_regionkey) AND (r_name = 'AMERICA') AND (s_nationkey = n2.n_nationkey) AND (o_orderdate BETWEEN date '1995-01-01' AND date '1996-12-31') AND (p_type = 'ECONOMY ANODIZED STEEL') ) AS all_nations GROUP BY o_year ORDER BY o_year", + "SELECT nation, o_year, sum(amount) AS sum_profit FROM ( SELECT n_name AS nation, extract(year FROM o_orderdate) AS o_year, l_extendedprice * (1 - l_discount) - ps_supplycost * l_quantity AS amount FROM part, supplier, lineitem, partsupp, orders, nation WHERE (s_suppkey = l_suppkey) AND (ps_suppkey = l_suppkey) AND (ps_partkey = l_partkey) AND (p_partkey = l_partkey) AND (o_orderkey = l_orderkey) AND (s_nationkey = n_nationkey) AND (p_name LIKE '%green%') ) AS profit GROUP BY nation, o_year ORDER BY nation, o_year DESC", + "SELECT c_custkey, c_name, sum(l_extendedprice * (1 - l_discount)) AS revenue, c_acctbal, n_name, c_address, c_phone, c_comment FROM customer, orders, lineitem, nation WHERE (c_custkey = o_custkey) AND (l_orderkey = o_orderkey) AND (o_orderdate >= date '1993-10-01') AND (o_orderdate < date '1993-10-01' + INTERVAL 3 MONTH) AND (l_returnflag = 'R') AND (c_nationkey = n_nationkey) GROUP BY c_custkey, c_name, c_acctbal, c_phone, n_name, c_address, c_comment ORDER BY revenue DESC LIMIT 20", + "SELECT ps_partkey, sum(ps_supplycost * ps_availqty) AS value FROM partsupp, supplier, nation WHERE (ps_suppkey = s_suppkey) AND (s_nationkey = n_nationkey) AND (n_name = 'GERMANY') GROUP BY ps_partkey HAVING sum(ps_supplycost * ps_availqty) > ( SELECT sum(ps_supplycost * ps_availqty) * 0.0001 FROM partsupp, supplier, nation WHERE (ps_suppkey = s_suppkey) AND (s_nationkey = n_nationkey) AND (n_name = 'GERMANY') ) ORDER BY value DESC", + "SELECT l_shipmode, sum(CASE WHEN (o_orderpriority = '1-URGENT') OR (o_orderpriority = '2-HIGH') THEN 1 ELSE 0 END) AS high_line_count, sum(CASE WHEN (o_orderpriority <> '1-URGENT') AND (o_orderpriority <> '2-HIGH') THEN 1 ELSE 0 END) AS low_line_count FROM orders, lineitem WHERE (o_orderkey = l_orderkey) AND (l_shipmode IN ('MAIL', 'SHIP')) AND (l_commitdate < l_receiptdate) AND (l_shipdate < l_commitdate) AND (l_receiptdate >= date '1994-01-01') AND (l_receiptdate < date '1994-01-01' + INTERVAL 1 YEAR) GROUP BY l_shipmode ORDER BY l_shipmode", + "SELECT c_count, count(*) AS custdist FROM ( SELECT c_custkey, count(o_orderkey) AS c_count FROM customer LEFT OUTER JOIN orders ON (c_custkey = o_custkey) AND (o_comment NOT LIKE '%special%requests%') GROUP BY c_custkey ) AS c_orders GROUP BY c_count ORDER BY custdist DESC, c_count DESC", + "SELECT 100.00 * sum(CASE WHEN p_type LIKE 'PROMO%' THEN l_extendedprice * (1 - l_discount) ELSE 0 END) / sum(l_extendedprice * (1 - l_discount)) AS promo_revenue FROM lineitem, part WHERE (l_partkey = p_partkey) AND (l_shipdate >= date '1995-09-01') AND (l_shipdate < date '1995-09-01' + INTERVAL 1 MONTH)", + "WITH revenue0 AS (SELECT l_suppkey AS supplier_no, sum(l_extendedprice * (1 - l_discount)) AS total_revenue FROM lineitem WHERE (l_shipdate >= date '1996-01-01') AND (l_shipdate < date '1996-01-01' + INTERVAL 3 MONTH) GROUP BY l_suppkey) SELECT s_suppkey, s_name, s_address, s_phone, total_revenue FROM supplier, revenue0 WHERE (s_suppkey = supplier_no) AND (total_revenue = (SELECT max(total_revenue) FROM revenue0)) ORDER BY s_suppkey", + "SELECT p_brand, p_type, p_size, count(DISTINCT ps_suppkey) AS supplier_cnt FROM partsupp, part WHERE (p_partkey = ps_partkey) AND (p_brand <> 'Brand#45') AND (p_type NOT LIKE 'MEDIUM POLISHED%') AND (p_size IN (49, 14, 23, 45, 19, 3, 36, 9)) AND (ps_suppkey NOT IN ( SELECT s_suppkey FROM supplier WHERE (s_comment LIKE '%Customer%Complaints%') )) GROUP BY p_brand, p_type, p_size ORDER BY supplier_cnt DESC, p_brand, p_type, p_size", + "SELECT sum(l_extendedprice) / 7.0 AS avg_yearly FROM lineitem, part WHERE (p_partkey = l_partkey) AND (p_brand = 'Brand#23') AND (p_container = 'MED BOX') AND (l_quantity < ( SELECT 0.2 * avg(l_quantity) FROM lineitem WHERE (l_partkey = p_partkey) ))", + "SELECT c_name, c_custkey, o_orderkey, o_orderdate, o_totalprice, sum(l_quantity) FROM customer, orders, lineitem WHERE (o_orderkey IN ( SELECT l_orderkey FROM lineitem GROUP BY l_orderkey HAVING sum(l_quantity) > 300 )) AND (c_custkey = o_custkey) AND (o_orderkey = l_orderkey) GROUP BY c_name, c_custkey, o_orderkey, o_orderdate, o_totalprice ORDER BY o_totalprice DESC, o_orderdate LIMIT 100", + "SELECT sum(l_extendedprice * (1 - l_discount)) AS revenue FROM lineitem, part WHERE ( (p_partkey = l_partkey) AND (p_brand = 'Brand#12') AND (p_container IN ('SM CASE', 'SM BOX', 'SM PACK', 'SM PKG')) AND (l_quantity >= 1) AND (l_quantity <= 1 + 10) AND (p_size BETWEEN 1 AND 5) AND (l_shipmode IN ('AIR', 'AIR REG')) AND (l_shipinstruct = 'DELIVER IN PERSON') ) OR ( (p_partkey = l_partkey) AND (p_brand = 'Brand#23') AND (p_container IN ('MED BAG', 'MED BOX', 'MED PKG', 'MED PACK')) AND (l_quantity >= 10) AND (l_quantity <= 10 + 10) AND (p_size BETWEEN 1 AND 10) AND (l_shipmode IN ('AIR', 'AIR REG')) AND (l_shipinstruct = 'DELIVER IN PERSON') ) OR ( (p_partkey = l_partkey) AND (p_brand = 'Brand#34') AND (p_container IN ('LG CASE', 'LG BOX', 'LG PACK', 'LG PKG')) AND (l_quantity >= 20) AND (l_quantity <= 20 + 10) AND (p_size BETWEEN 1 AND 15) AND (l_shipmode IN ('AIR', 'AIR REG')) AND (l_shipinstruct = 'DELIVER IN PERSON') )", + "SELECT s_name, s_address FROM supplier, nation WHERE (s_suppkey IN ( SELECT ps_suppkey FROM partsupp WHERE (ps_partkey IN ( SELECT p_partkey FROM part WHERE (p_name LIKE 'forest%') )) AND (ps_availqty > ( SELECT 0.5 * sum(l_quantity) FROM lineitem WHERE (l_partkey = ps_partkey) AND (l_suppkey = ps_suppkey) AND (l_shipdate >= date '1994-01-01') AND (l_shipdate < date '1994-01-01' + INTERVAL 1 YEAR) )) )) AND (s_nationkey = n_nationkey) AND (n_name = 'CANADA') ORDER BY s_name", + "SELECT s_name, count(*) AS numwait FROM supplier, lineitem AS l1, orders, nation WHERE (s_suppkey = l1.l_suppkey) AND (o_orderkey = l1.l_orderkey) AND (o_orderstatus = 'F') AND (l1.l_receiptdate > l1.l_commitdate) AND EXISTS ( SELECT * FROM lineitem AS l2 WHERE (l2.l_orderkey = l1.l_orderkey) AND (l2.l_suppkey <> l1.l_suppkey) ) AND NOT EXISTS ( SELECT * FROM lineitem AS l3 WHERE (l3.l_orderkey = l1.l_orderkey) AND (l3.l_suppkey <> l1.l_suppkey) AND (l3.l_receiptdate > l3.l_commitdate) ) AND (s_nationkey = n_nationkey) AND (n_name = 'SAUDI ARABIA') GROUP BY s_name ORDER BY numwait DESC, s_name LIMIT 100", + "SELECT cntrycode, count(*) AS numcust, sum(c_acctbal) AS totacctbal FROM ( SELECT substring(c_phone FROM 1 FOR 2) AS cntrycode, c_acctbal FROM customer WHERE (substring(c_phone FROM 1 FOR 2) IN ('13', '31', '23', '29', '30', '18', '17')) AND (c_acctbal > ( SELECT avg(c_acctbal) FROM customer WHERE (c_acctbal > 0.00) AND (substring(c_phone FROM 1 FOR 2) IN ('13', '31', '23', '29', '30', '18', '17')) )) AND NOT EXISTS ( SELECT * FROM orders WHERE (o_custkey = c_custkey) ) ) AS custsale GROUP BY cntrycode ORDER BY cntrycode" +]}, +{"name":"tpcds","queries":[ + "WITH customer_total_return AS ( SELECT sr_customer_sk AS ctr_customer_sk, sr_store_sk AS ctr_store_sk, sum(sr_return_amt) AS ctr_total_return FROM store_returns, date_dim WHERE (sr_returned_date_sk = d_date_sk) AND (d_year = 2000) GROUP BY sr_customer_sk, sr_store_sk ) SELECT c_customer_id FROM customer_total_return AS ctr1, store, customer WHERE (ctr1.ctr_total_return > ( SELECT avg(ctr_total_return) * 1.2 FROM customer_total_return AS ctr2 WHERE ctr1.ctr_store_sk = ctr2.ctr_store_sk )) AND (s_store_sk = ctr1.ctr_store_sk) AND (s_state = 'TN') AND (ctr1.ctr_customer_sk = c_customer_sk) ORDER BY c_customer_id LIMIT 100", + "WITH wscs AS ( SELECT sold_date_sk, sales_price FROM ( SELECT ws_sold_date_sk AS sold_date_sk, ws_ext_sales_price AS sales_price FROM web_sales UNION ALL SELECT cs_sold_date_sk AS sold_date_sk, cs_ext_sales_price AS sales_price FROM catalog_sales ) ), wswscs AS ( SELECT d_week_seq, sum(multiIf(d_day_name = 'Sunday', sales_price, NULL)) AS sun_sales, sum(multiIf(d_day_name = 'Monday', sales_price, NULL)) AS mon_sales, sum(multiIf(d_day_name = 'Tuesday', sales_price, NULL)) AS tue_sales, sum(multiIf(d_day_name = 'Wednesday', sales_price, NULL)) AS wed_sales, sum(multiIf(d_day_name = 'Thursday', sales_price, NULL)) AS thu_sales, sum(multiIf(d_day_name = 'Friday', sales_price, NULL)) AS fri_sales, sum(multiIf(d_day_name = 'Saturday', sales_price, NULL)) AS sat_sales FROM wscs, date_dim WHERE d_date_sk = sold_date_sk GROUP BY d_week_seq ) SELECT d_week_seq1, round(sun_sales1 / sun_sales2, 2), round(mon_sales1 / mon_sales2, 2), round(tue_sales1 / tue_sales2, 2), round(wed_sales1 / wed_sales2, 2), round(thu_sales1 / thu_sales2, 2), round(fri_sales1 / fri_sales2, 2), round(sat_sales1 / sat_sales2, 2) FROM ( SELECT wswscs.d_week_seq AS d_week_seq1, sun_sales AS sun_sales1, mon_sales AS mon_sales1, tue_sales AS tue_sales1, wed_sales AS wed_sales1, thu_sales AS thu_sales1, fri_sales AS fri_sales1, sat_sales AS sat_sales1 FROM wswscs, date_dim WHERE (date_dim.d_week_seq = wswscs.d_week_seq) AND (d_year = 2001) ) AS y, ( SELECT wswscs.d_week_seq AS d_week_seq2, sun_sales AS sun_sales2, mon_sales AS mon_sales2, tue_sales AS tue_sales2, wed_sales AS wed_sales2, thu_sales AS thu_sales2, fri_sales AS fri_sales2, sat_sales AS sat_sales2 FROM wswscs, date_dim WHERE (date_dim.d_week_seq = wswscs.d_week_seq) AND (d_year = (2001 + 1)) ) AS z WHERE d_week_seq1 = (d_week_seq2 - 53) ORDER BY d_week_seq1", + "SELECT dt.d_year, item.i_brand_id AS brand_id, item.i_brand AS brand, sum(ss_ext_sales_price) AS sum_agg FROM date_dim AS dt, store_sales, item WHERE (dt.d_date_sk = store_sales.ss_sold_date_sk) AND (store_sales.ss_item_sk = item.i_item_sk) AND (item.i_manufact_id = 128) AND (dt.d_moy = 11) GROUP BY dt.d_year, item.i_brand, item.i_brand_id ORDER BY dt.d_year, sum_agg DESC, brand_id LIMIT 100", + "WITH year_total AS ( SELECT c_customer_id AS customer_id, c_first_name AS customer_first_name, c_last_name AS customer_last_name, c_preferred_cust_flag AS customer_preferred_cust_flag, c_birth_country AS customer_birth_country, c_login AS customer_login, c_email_address AS customer_email_address, d_year AS dyear, sum((((ss_ext_list_price - ss_ext_wholesale_cost) - ss_ext_discount_amt) + ss_ext_sales_price) / 2) AS year_total, 's' AS sale_type FROM customer, store_sales, date_dim WHERE (c_customer_sk = ss_customer_sk) AND (ss_sold_date_sk = d_date_sk) GROUP BY c_customer_id, c_first_name, c_last_name, c_preferred_cust_flag, c_birth_country, c_login, c_email_address, d_year UNION ALL SELECT c_customer_id AS customer_id, c_first_name AS customer_first_name, c_last_name AS customer_last_name, c_preferred_cust_flag AS customer_preferred_cust_flag, c_birth_country AS customer_birth_country, c_login AS customer_login, c_email_address AS customer_email_address, d_year AS dyear, sum((((cs_ext_list_price - cs_ext_wholesale_cost) - cs_ext_discount_amt) + cs_ext_sales_price) / 2) AS year_total, 'c' AS sale_type FROM customer, catalog_sales, date_dim WHERE (c_customer_sk = cs_bill_customer_sk) AND (cs_sold_date_sk = d_date_sk) GROUP BY c_customer_id, c_first_name, c_last_name, c_preferred_cust_flag, c_birth_country, c_login, c_email_address, d_year UNION ALL SELECT c_customer_id AS customer_id, c_first_name AS customer_first_name, c_last_name AS customer_last_name, c_preferred_cust_flag AS customer_preferred_cust_flag, c_birth_country AS customer_birth_country, c_login AS customer_login, c_email_address AS customer_email_address, d_year AS dyear, sum((((ws_ext_list_price - ws_ext_wholesale_cost) - ws_ext_discount_amt) + ws_ext_sales_price) / 2) AS year_total, 'w' AS sale_type FROM customer, web_sales, date_dim WHERE (c_customer_sk = ws_bill_customer_sk) AND (ws_sold_date_sk = d_date_sk) GROUP BY c_customer_id, c_first_name, c_last_name, c_preferred_cust_flag, c_birth_country, c_login, c_email_address, d_year ) SELECT t_s_secyear.customer_id, t_s_secyear.customer_first_name, t_s_secyear.customer_last_name, t_s_secyear.customer_preferred_cust_flag FROM year_total AS t_s_firstyear, year_total AS t_s_secyear, year_total AS t_c_firstyear, year_total AS t_c_secyear, year_total AS t_w_firstyear, year_total AS t_w_secyear WHERE (t_s_secyear.customer_id = t_s_firstyear.customer_id) AND (t_s_firstyear.customer_id = t_c_secyear.customer_id) AND (t_s_firstyear.customer_id = t_c_firstyear.customer_id) AND (t_s_firstyear.customer_id = t_w_firstyear.customer_id) AND (t_s_firstyear.customer_id = t_w_secyear.customer_id) AND (t_s_firstyear.sale_type = 's') AND (t_c_firstyear.sale_type = 'c') AND (t_w_firstyear.sale_type = 'w') AND (t_s_secyear.sale_type = 's') AND (t_c_secyear.sale_type = 'c') AND (t_w_secyear.sale_type = 'w') AND (t_s_firstyear.dyear = 2001) AND (t_s_secyear.dyear = (2001 + 1)) AND (t_c_firstyear.dyear = 2001) AND (t_c_secyear.dyear = (2001 + 1)) AND (t_w_firstyear.dyear = 2001) AND (t_w_secyear.dyear = (2001 + 1)) AND (t_s_firstyear.year_total > 0) AND (t_c_firstyear.year_total > 0) AND (t_w_firstyear.year_total > 0) AND (multiIf(t_c_firstyear.year_total > 0, t_c_secyear.year_total / t_c_firstyear.year_total, NULL) > multiIf(t_s_firstyear.year_total > 0, t_s_secyear.year_total / t_s_firstyear.year_total, NULL)) AND (multiIf(t_c_firstyear.year_total > 0, t_c_secyear.year_total / t_c_firstyear.year_total, NULL) > multiIf(t_w_firstyear.year_total > 0, t_w_secyear.year_total / t_w_firstyear.year_total, NULL)) ORDER BY t_s_secyear.customer_id, t_s_secyear.customer_first_name, t_s_secyear.customer_last_name, t_s_secyear.customer_preferred_cust_flag LIMIT 100", + "WITH ssr AS ( SELECT s_store_id, sum(sales_price) AS sales, sum(profit) AS profit, sum(return_amt) AS returns, sum(net_loss) AS profit_loss FROM ( SELECT ss_store_sk AS store_sk, ss_sold_date_sk AS date_sk, ss_ext_sales_price AS sales_price, ss_net_profit AS profit, CAST(0, 'decimal(7, 2)') AS return_amt, CAST(0, 'decimal(7, 2)') AS net_loss FROM store_sales UNION ALL SELECT sr_store_sk AS store_sk, sr_returned_date_sk AS date_sk, CAST(0, 'decimal(7, 2)') AS sales_price, CAST(0, 'decimal(7, 2)') AS profit, sr_return_amt AS return_amt, sr_net_loss AS net_loss FROM store_returns ) AS salesreturns, date_dim, store WHERE (date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 14 day))) AND (store_sk = s_store_sk) GROUP BY s_store_id ), csr AS ( SELECT cp_catalog_page_id, sum(sales_price) AS sales, sum(profit) AS profit, sum(return_amt) AS returns, sum(net_loss) AS profit_loss FROM ( SELECT cs_catalog_page_sk AS page_sk, cs_sold_date_sk AS date_sk, cs_ext_sales_price AS sales_price, cs_net_profit AS profit, CAST(0, 'decimal(7, 2)') AS return_amt, CAST(0, 'decimal(7, 2)') AS net_loss FROM catalog_sales UNION ALL SELECT cr_catalog_page_sk AS page_sk, cr_returned_date_sk AS date_sk, CAST(0, 'decimal(7, 2)') AS sales_price, CAST(0, 'decimal(7, 2)') AS profit, cr_return_amount AS return_amt, cr_net_loss AS net_loss FROM catalog_returns ) AS salesreturns, date_dim, catalog_page WHERE (date_sk = d_date_sk) AND (d_date BETWEEN CAST('2000-08-23', 'date') AND CAST('2000-08-23', 'date') + INTERVAL 14 day) AND (page_sk = cp_catalog_page_sk) GROUP BY cp_catalog_page_id ), wsr AS ( SELECT web_site_id, sum(sales_price) AS sales, sum(profit) AS profit, sum(return_amt) AS returns, sum(net_loss) AS profit_loss FROM ( SELECT ws_web_site_sk AS wsr_web_site_sk, ws_sold_date_sk AS date_sk, ws_ext_sales_price AS sales_price, ws_net_profit AS profit, CAST(0, 'decimal(7, 2)') AS return_amt, CAST(0, 'decimal(7, 2)') AS net_loss FROM web_sales UNION ALL SELECT ws_web_site_sk AS wsr_web_site_sk, wr_returned_date_sk AS date_sk, CAST(0, 'decimal(7, 2)') AS sales_price, CAST(0, 'decimal(7, 2)') AS profit, wr_return_amt AS return_amt, wr_net_loss AS net_loss FROM web_returns LEFT JOIN web_sales ON (wr_item_sk = ws_item_sk) AND (wr_order_number = ws_order_number) ) AS salesreturns, date_dim, web_site WHERE (date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 14 day))) AND (wsr_web_site_sk = web_site_sk) GROUP BY web_site_id ) SELECT channel, id, sum(sales) AS sales, sum(returns) AS returns, sum(profit) AS profit FROM ( SELECT 'store channel' AS channel, concat('store', s_store_id) AS id, sales, returns, profit - profit_loss AS profit FROM ssr UNION ALL SELECT 'catalog channel' AS channel, concat('catalog_page', cp_catalog_page_id) AS id, sales, returns, profit - profit_loss AS profit FROM csr UNION ALL SELECT 'web channel' AS channel, concat('web_site', web_site_id) AS id, sales, returns, profit - profit_loss AS profit FROM wsr ) AS x GROUP BY channel, id WITH ROLLUP ORDER BY channel, id LIMIT 100", + "SELECT a.ca_state AS state, count(*) AS cnt FROM customer_address AS a, customer AS c, store_sales AS s, date_dim AS d, item AS i WHERE (a.ca_address_sk = c.c_current_addr_sk) AND (c.c_customer_sk = s.ss_customer_sk) AND (s.ss_sold_date_sk = d.d_date_sk) AND (s.ss_item_sk = i.i_item_sk) AND (d.d_month_seq = ( SELECT DISTINCT d_month_seq FROM date_dim WHERE (d_year = 2001) AND (d_moy = 1) )) AND (i.i_current_price > 1.2 * ( SELECT avg(j.i_current_price) FROM item AS j WHERE (j.i_category = i.i_category) )) GROUP BY a.ca_state HAVING count(*) >= 10 ORDER BY cnt, a.ca_state LIMIT 100", + "SELECT i_item_id, avg(ss_quantity) AS agg1, avg(ss_list_price) AS agg2, avg(ss_coupon_amt) AS agg3, avg(ss_sales_price) AS agg4 FROM store_sales, customer_demographics, date_dim, item, promotion WHERE (ss_sold_date_sk = d_date_sk) AND (ss_item_sk = i_item_sk) AND (ss_cdemo_sk = cd_demo_sk) AND (ss_promo_sk = p_promo_sk) AND (cd_gender = 'M') AND (cd_marital_status = 'S') AND (cd_education_status = 'College') AND ((p_channel_email = 'N') OR (p_channel_event = 'N')) AND (d_year = 2000) GROUP BY i_item_id ORDER BY i_item_id LIMIT 100", + "SELECT s_store_name, sum(ss_net_profit) FROM store_sales, date_dim, store, ( SELECT substr(ca_zip, 1, 2) AS ca_zip FROM ( SELECT substr(ca_zip, 1, 5) AS ca_zip FROM customer_address WHERE substr(ca_zip, 1, 5) IN ('24128', '76232', '65084', '87816', '83926', '77556', '20548', '26231', '43848', '15126', '91137', '61265', '98294', '25782', '17920', '18426', '98235', '40081', '84093', '28577', '55565', '17183', '54601', '67897', '22752', '86284', '18376', '38607', '45200', '21756', '29741', '96765', '23932', '89360', '29839', '25989', '28898', '91068', '72550', '10390', '18845', '47770', '82636', '41367', '76638', '86198', '81312', '37126', '39192', '88424', '72175', '81426', '53672', '10445', '42666', '66864', '66708', '41248', '48583', '82276', '18842', '78890', '49448', '14089', '38122', '34425', '79077', '19849', '43285', '39861', '66162', '77610', '13695', '99543', '83444', '83041', '12305', '57665', '68341', '25003', '57834', '62878', '49130', '81096', '18840', '27700', '23470', '50412', '21195', '16021', '76107', '71954', '68309', '18119', '98359', '64544', '10336', '86379', '27068', '39736', '98569', '28915', '24206', '56529', '57647', '54917', '42961', '91110', '63981', '14922', '36420', '23006', '67467', '32754', '30903', '20260', '31671', '51798', '72325', '85816', '68621', '13955', '36446', '41766', '68806', '16725', '15146', '22744', '35850', '88086', '51649', '18270', '52867', '39972', '96976', '63792', '11376', '94898', '13595', '10516', '90225', '58943', '39371', '94945', '28587', '96576', '57855', '28488', '26105', '83933', '25858', '34322', '44438', '73171', '30122', '34102', '22685', '71256', '78451', '54364', '13354', '45375', '40558', '56458', '28286', '45266', '47305', '69399', '83921', '26233', '11101', '15371', '69913', '35942', '15882', '25631', '24610', '44165', '99076', '33786', '70738', '26653', '14328', '72305', '62496', '22152', '10144', '64147', '48425', '14663', '21076', '18799', '30450', '63089', '81019', '68893', '24996', '51200', '51211', '45692', '92712', '70466', '79994', '22437', '25280', '38935', '71791', '73134', '56571', '14060', '19505', '72425', '56575', '74351', '68786', '51650', '20004', '18383', '76614', '11634', '18906', '15765', '41368', '73241', '76698', '78567', '97189', '28545', '76231', '75691', '22246', '51061', '90578', '56691', '68014', '51103', '94167', '57047', '14867', '73520', '15734', '63435', '25733', '35474', '24676', '94627', '53535', '17879', '15559', '53268', '59166', '11928', '59402', '33282', '45721', '43933', '68101', '33515', '36634', '71286', '19736', '58058', '55253', '67473', '41918', '19515', '36495', '19430', '22351', '77191', '91393', '49156', '50298', '87501', '18652', '53179', '18767', '63193', '23968', '65164', '68880', '21286', '72823', '58470', '67301', '13394', '31016', '70372', '67030', '40604', '24317', '45748', '39127', '26065', '77721', '31029', '31880', '60576', '24671', '45549', '13376', '50016', '33123', '19769', '22927', '97789', '46081', '72151', '15723', '46136', '51949', '68100', '96888', '64528', '14171', '79777', '28709', '11489', '25103', '32213', '78668', '22245', '15798', '27156', '37930', '62971', '21337', '51622', '67853', '10567', '38415', '15455', '58263', '42029', '60279', '37125', '56240', '88190', '50308', '26859', '64457', '89091', '82136', '62377', '36233', '63837', '58078', '17043', '30010', '60099', '28810', '98025', '29178', '87343', '73273', '30469', '64034', '39516', '86057', '21309', '90257', '67875', '40162', '11356', '73650', '61810', '72013', '30431', '22461', '19512', '13375', '55307', '30625', '83849', '68908', '26689', '96451', '38193', '46820', '88885', '84935', '69035', '83144', '47537', '56616', '94983', '48033', '69952', '25486', '61547', '27385', '61860', '58048', '56910', '16807', '17871', '35258', '31387', '35458', '35576') INTERSECT SELECT ca_zip FROM ( SELECT substr(ca_zip, 1, 5) AS ca_zip, count(*) AS cnt FROM customer_address, customer WHERE (ca_address_sk = c_current_addr_sk) AND (c_preferred_cust_flag = 'Y') GROUP BY ca_zip HAVING count(*) > 10 ) AS A1 ) AS A2 ) AS V1 WHERE (ss_store_sk = s_store_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_qoy = 2) AND (d_year = 1998) AND (substr(s_zip, 1, 2) = substr(V1.ca_zip, 1, 2)) GROUP BY s_store_name ORDER BY s_store_name LIMIT 100", + "SELECT multiIf(( SELECT count(*) FROM store_sales WHERE (ss_quantity >= 1) AND (ss_quantity <= 20) ) > 74129, ( SELECT avg(ss_ext_discount_amt) FROM store_sales WHERE (ss_quantity >= 1) AND (ss_quantity <= 20) ), ( SELECT avg(ss_net_paid) FROM store_sales WHERE (ss_quantity >= 1) AND (ss_quantity <= 20) )) AS bucket1, multiIf(( SELECT count(*) FROM store_sales WHERE (ss_quantity >= 21) AND (ss_quantity <= 40) ) > 122840, ( SELECT avg(ss_ext_discount_amt) FROM store_sales WHERE (ss_quantity >= 21) AND (ss_quantity <= 40) ), ( SELECT avg(ss_net_paid) FROM store_sales WHERE (ss_quantity >= 21) AND (ss_quantity <= 40) )) AS bucket2, multiIf(( SELECT count(*) FROM store_sales WHERE (ss_quantity >= 41) AND (ss_quantity <= 60) ) > 56580, ( SELECT avg(ss_ext_discount_amt) FROM store_sales WHERE (ss_quantity >= 41) AND (ss_quantity <= 60) ), ( SELECT avg(ss_net_paid) FROM store_sales WHERE (ss_quantity >= 41) AND (ss_quantity <= 60) )) AS bucket3, multiIf(( SELECT count(*) FROM store_sales WHERE (ss_quantity >= 61) AND (ss_quantity <= 80) ) > 10097, ( SELECT avg(ss_ext_discount_amt) FROM store_sales WHERE (ss_quantity >= 61) AND (ss_quantity <= 80) ), ( SELECT avg(ss_net_paid) FROM store_sales WHERE (ss_quantity >= 61) AND (ss_quantity <= 80) )) AS bucket4, multiIf(( SELECT count(*) FROM store_sales WHERE (ss_quantity >= 81) AND (ss_quantity <= 100) ) > 165306, ( SELECT avg(ss_ext_discount_amt) FROM store_sales WHERE (ss_quantity >= 81) AND (ss_quantity <= 100) ), ( SELECT avg(ss_net_paid) FROM store_sales WHERE (ss_quantity >= 81) AND (ss_quantity <= 100) )) AS bucket5 FROM reason WHERE r_reason_sk = 1", + "SELECT cd_gender, cd_marital_status, cd_education_status, count(*) AS cnt1, cd_purchase_estimate, count(*) AS cnt2, cd_credit_rating, count(*) AS cnt3, cd_dep_count, count(*) AS cnt4, cd_dep_employed_count, count(*) AS cnt5, cd_dep_college_count, count(*) AS cnt6 FROM customer AS c, customer_address AS ca, customer_demographics WHERE (c.c_current_addr_sk = ca.ca_address_sk) AND (ca_county IN ('Rush County', 'Toole County', 'Jefferson County', 'Dona Ana County', 'La Porte County')) AND (cd_demo_sk = c.c_current_cdemo_sk) AND exists(( SELECT * FROM store_sales, date_dim WHERE (c.c_customer_sk = ss_customer_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 2002) AND ((d_moy >= 1) AND (d_moy <= (1 + 3))) )) AND (exists(( SELECT * FROM web_sales, date_dim WHERE (c.c_customer_sk = ws_bill_customer_sk) AND (ws_sold_date_sk = d_date_sk) AND (d_year = 2002) AND ((d_moy >= 1) AND (d_moy <= (1 + 3))) )) OR exists(( SELECT * FROM catalog_sales, date_dim WHERE (c.c_customer_sk = cs_ship_customer_sk) AND (cs_sold_date_sk = d_date_sk) AND (d_year = 2002) AND ((d_moy >= 1) AND (d_moy <= (1 + 3))) ))) GROUP BY cd_gender, cd_marital_status, cd_education_status, cd_purchase_estimate, cd_credit_rating, cd_dep_count, cd_dep_employed_count, cd_dep_college_count ORDER BY cd_gender, cd_marital_status, cd_education_status, cd_purchase_estimate, cd_credit_rating, cd_dep_count, cd_dep_employed_count, cd_dep_college_count LIMIT 100", + "WITH year_total AS ( SELECT c_customer_id AS customer_id, c_first_name AS customer_first_name, c_last_name AS customer_last_name, c_preferred_cust_flag AS customer_preferred_cust_flag, c_birth_country AS customer_birth_country, c_login AS customer_login, c_email_address AS customer_email_address, d_year AS dyear, sum(ss_ext_list_price - ss_ext_discount_amt) AS year_total, 's' AS sale_type FROM customer, store_sales, date_dim WHERE (c_customer_sk = ss_customer_sk) AND (ss_sold_date_sk = d_date_sk) GROUP BY c_customer_id, c_first_name, c_last_name, c_preferred_cust_flag, c_birth_country, c_login, c_email_address, d_year UNION ALL SELECT c_customer_id AS customer_id, c_first_name AS customer_first_name, c_last_name AS customer_last_name, c_preferred_cust_flag AS customer_preferred_cust_flag, c_birth_country AS customer_birth_country, c_login AS customer_login, c_email_address AS customer_email_address, d_year AS dyear, sum(ws_ext_list_price - ws_ext_discount_amt) AS year_total, 'w' AS sale_type FROM customer, web_sales, date_dim WHERE (c_customer_sk = ws_bill_customer_sk) AND (ws_sold_date_sk = d_date_sk) GROUP BY c_customer_id, c_first_name, c_last_name, c_preferred_cust_flag, c_birth_country, c_login, c_email_address, d_year ) SELECT t_s_secyear.customer_id, t_s_secyear.customer_first_name, t_s_secyear.customer_last_name, t_s_secyear.customer_preferred_cust_flag FROM year_total AS t_s_firstyear, year_total AS t_s_secyear, year_total AS t_w_firstyear, year_total AS t_w_secyear WHERE (t_s_secyear.customer_id = t_s_firstyear.customer_id) AND (t_s_firstyear.customer_id = t_w_secyear.customer_id) AND (t_s_firstyear.customer_id = t_w_firstyear.customer_id) AND (t_s_firstyear.sale_type = 's') AND (t_w_firstyear.sale_type = 'w') AND (t_s_secyear.sale_type = 's') AND (t_w_secyear.sale_type = 'w') AND (t_s_firstyear.dyear = 2001) AND (t_s_secyear.dyear = (2001 + 1)) AND (t_w_firstyear.dyear = 2001) AND (t_w_secyear.dyear = (2001 + 1)) AND (t_s_firstyear.year_total > 0) AND (t_w_firstyear.year_total > 0) AND (multiIf(t_w_firstyear.year_total > 0, CAST(t_w_secyear.year_total AS Float32) / t_w_firstyear.year_total, 0.) > multiIf(t_s_firstyear.year_total > 0, CAST(t_s_secyear.year_total AS Float32) / t_s_firstyear.year_total, 0.)) ORDER BY t_s_secyear.customer_id, t_s_secyear.customer_first_name, t_s_secyear.customer_last_name, t_s_secyear.customer_preferred_cust_flag LIMIT 100", + "SELECT i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(ws_ext_sales_price) AS itemrevenue, (sum(ws_ext_sales_price) * 100) / sum(sum(ws_ext_sales_price)) OVER (PARTITION BY i_class) AS revenueratio FROM web_sales, item, date_dim WHERE (ws_item_sk = i_item_sk) AND (i_category IN ('Sports', 'Books', 'Home')) AND (ws_sold_date_sk = d_date_sk) AND ((d_date >= CAST('1999-02-22', 'date')) AND (d_date <= (CAST('1999-02-22', 'date') + INTERVAL 30 day))) GROUP BY i_item_id, i_item_desc, i_category, i_class, i_current_price ORDER BY i_category, i_class, i_item_id, i_item_desc, revenueratio LIMIT 100", + "SELECT avg(ss_quantity), avg(ss_ext_sales_price), avg(ss_ext_wholesale_cost), sum(ss_ext_wholesale_cost) FROM store_sales, store, customer_demographics, household_demographics, customer_address, date_dim WHERE (s_store_sk = ss_store_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 2001) AND ( ( (ss_hdemo_sk = hd_demo_sk) AND (cd_demo_sk = ss_cdemo_sk) AND (cd_marital_status = 'M') AND (cd_education_status = 'Advanced Degree') AND (ss_sales_price BETWEEN 100.00 AND 150.00) AND (hd_dep_count = 3) ) OR ( (ss_hdemo_sk = hd_demo_sk) AND (cd_demo_sk = ss_cdemo_sk) AND (cd_marital_status = 'S') AND (cd_education_status = 'College') AND (ss_sales_price BETWEEN 50.00 AND 100.00) AND (hd_dep_count = 1) ) OR ( (ss_hdemo_sk = hd_demo_sk) AND (cd_demo_sk = ss_cdemo_sk) AND (cd_marital_status = 'W') AND (cd_education_status = '2 yr Degree') AND (ss_sales_price BETWEEN 150.00 AND 200.) AND (hd_dep_count = 1) ) ) AND ( ( (ss_addr_sk = ca_address_sk) AND (ca_country = 'United States') AND (ca_state IN ('TX', 'OH', 'TX')) AND (ss_net_profit BETWEEN 100 AND 200) ) OR ( (ss_addr_sk = ca_address_sk) AND (ca_country = 'United States') AND (ca_state IN ('OR', 'NM', 'KY')) AND (ss_net_profit BETWEEN 150 AND 300) ) OR ( (ss_addr_sk = ca_address_sk) AND (ca_country = 'United States') AND (ca_state IN ('VA', 'TX', 'MS')) AND (ss_net_profit BETWEEN 50 AND 250) ) )", + "WITH cross_items AS ( SELECT i_item_sk AS ss_item_sk FROM item, ( SELECT iss.i_brand_id AS brand_id, iss.i_class_id AS class_id, iss.i_category_id AS category_id FROM store_sales, item AS iss, date_dim AS d1 WHERE (ss_item_sk = iss.i_item_sk) AND (ss_sold_date_sk = d1.d_date_sk) AND (d1.d_year BETWEEN 1999 AND 1999 + 2) INTERSECT SELECT ics.i_brand_id, ics.i_class_id, ics.i_category_id FROM catalog_sales, item AS ics, date_dim AS d2 WHERE (cs_item_sk = ics.i_item_sk) AND (cs_sold_date_sk = d2.d_date_sk) AND (d2.d_year BETWEEN 1999 AND 1999 + 2) INTERSECT SELECT iws.i_brand_id, iws.i_class_id, iws.i_category_id FROM web_sales, item AS iws, date_dim AS d3 WHERE (ws_item_sk = iws.i_item_sk) AND (ws_sold_date_sk = d3.d_date_sk) AND (d3.d_year BETWEEN 1999 AND 1999 + 2) ) WHERE (i_brand_id = brand_id) AND (i_class_id = class_id) AND (i_category_id = category_id) ), avg_sales AS ( SELECT avg(quantity * list_price) AS average_sales FROM ( SELECT ss_quantity AS quantity, ss_list_price AS list_price FROM store_sales, date_dim WHERE (ss_sold_date_sk = d_date_sk) AND (d_year BETWEEN 1999 AND 1999 + 2) UNION ALL SELECT cs_quantity AS quantity, cs_list_price AS list_price FROM catalog_sales, date_dim WHERE (cs_sold_date_sk = d_date_sk) AND (d_year BETWEEN 1999 AND 1999 + 2) UNION ALL SELECT ws_quantity AS quantity, ws_list_price AS list_price FROM web_sales, date_dim WHERE (ws_sold_date_sk = d_date_sk) AND (d_year BETWEEN 1999 AND 1999 + 2) ) AS x ) SELECT channel, i_brand_id, i_class_id, i_category_id, sum(sales), sum(number_sales) FROM ( SELECT 'store' AS channel, i_brand_id, i_class_id, i_category_id, sum(ss_quantity * ss_list_price) AS sales, count(*) AS number_sales FROM store_sales, item, date_dim WHERE (ss_item_sk IN ( SELECT ss_item_sk FROM cross_items )) AND (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = (1999 + 2)) AND (d_moy = 11) GROUP BY i_brand_id, i_class_id, i_category_id HAVING sum(ss_quantity * ss_list_price) > ( SELECT average_sales FROM avg_sales ) UNION ALL SELECT 'catalog' AS channel, i_brand_id, i_class_id, i_category_id, sum(cs_quantity * cs_list_price) AS sales, count(*) AS number_sales FROM catalog_sales, item, date_dim WHERE (cs_item_sk IN ( SELECT ss_item_sk FROM cross_items )) AND (cs_item_sk = i_item_sk) AND (cs_sold_date_sk = d_date_sk) AND (d_year = (1999 + 2)) AND (d_moy = 11) GROUP BY i_brand_id, i_class_id, i_category_id HAVING sum(cs_quantity * cs_list_price) > ( SELECT average_sales FROM avg_sales ) UNION ALL SELECT 'web' AS channel, i_brand_id, i_class_id, i_category_id, sum(ws_quantity * ws_list_price) AS sales, count(*) AS number_sales FROM web_sales, item, date_dim WHERE (ws_item_sk IN ( SELECT ss_item_sk FROM cross_items )) AND (ws_item_sk = i_item_sk) AND (ws_sold_date_sk = d_date_sk) AND (d_year = (1999 + 2)) AND (d_moy = 11) GROUP BY i_brand_id, i_class_id, i_category_id HAVING sum(ws_quantity * ws_list_price) > ( SELECT average_sales FROM avg_sales ) ) AS y GROUP BY channel, i_brand_id, i_class_id, i_category_id WITH ROLLUP ORDER BY channel, i_brand_id, i_class_id, i_category_id LIMIT 100", + "WITH cross_items AS ( SELECT i_item_sk AS ss_item_sk FROM item, ( SELECT iss.i_brand_id AS brand_id, iss.i_class_id AS class_id, iss.i_category_id AS category_id FROM store_sales, item AS iss, date_dim AS d1 WHERE (ss_item_sk = iss.i_item_sk) AND (ss_sold_date_sk = d1.d_date_sk) AND (d1.d_year BETWEEN 1999 AND 1999 + 2) INTERSECT SELECT ics.i_brand_id, ics.i_class_id, ics.i_category_id FROM catalog_sales, item AS ics, date_dim AS d2 WHERE (cs_item_sk = ics.i_item_sk) AND (cs_sold_date_sk = d2.d_date_sk) AND (d2.d_year BETWEEN 1999 AND 1999 + 2) INTERSECT SELECT iws.i_brand_id, iws.i_class_id, iws.i_category_id FROM web_sales, item AS iws, date_dim AS d3 WHERE (ws_item_sk = iws.i_item_sk) AND (ws_sold_date_sk = d3.d_date_sk) AND (d3.d_year BETWEEN 1999 AND 1999 + 2) ) WHERE (i_brand_id = brand_id) AND (i_class_id = class_id) AND (i_category_id = category_id) ), avg_sales AS ( SELECT avg(quantity * list_price) AS average_sales FROM ( SELECT ss_quantity AS quantity, ss_list_price AS list_price FROM store_sales, date_dim WHERE (ss_sold_date_sk = d_date_sk) AND (d_year BETWEEN 1999 AND 1999 + 2) UNION ALL SELECT cs_quantity AS quantity, cs_list_price AS list_price FROM catalog_sales, date_dim WHERE (cs_sold_date_sk = d_date_sk) AND (d_year BETWEEN 1999 AND 1999 + 2) UNION ALL SELECT ws_quantity AS quantity, ws_list_price AS list_price FROM web_sales, date_dim WHERE (ws_sold_date_sk = d_date_sk) AND (d_year BETWEEN 1999 AND 1999 + 2) ) AS x ) SELECT this_year.channel AS ty_channel, this_year.i_brand_id AS ty_brand, this_year.i_class_id AS ty_class, this_year.i_category_id AS ty_category, this_year.sales AS ty_sales, this_year.number_sales AS ty_number_sales, last_year.channel AS ly_channel, last_year.i_brand_id AS ly_brand, last_year.i_class_id AS ly_class, last_year.i_category_id AS ly_category, last_year.sales AS ly_sales, last_year.number_sales AS ly_number_sales FROM ( SELECT 'store' AS channel, i_brand_id, i_class_id, i_category_id, sum(ss_quantity * ss_list_price) AS sales, count(*) AS number_sales FROM store_sales, item, date_dim WHERE (ss_item_sk IN ( SELECT ss_item_sk FROM cross_items )) AND (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_week_seq = ( SELECT d_week_seq FROM date_dim WHERE (d_year = 1999 + 1) AND (d_moy = 12) AND (d_dom = 11) )) GROUP BY i_brand_id, i_class_id, i_category_id HAVING sum(ss_quantity * ss_list_price) > ( SELECT average_sales FROM avg_sales ) ) AS this_year, ( SELECT 'store' AS channel, i_brand_id, i_class_id, i_category_id, sum(ss_quantity * ss_list_price) AS sales, count(*) AS number_sales FROM store_sales, item, date_dim WHERE (ss_item_sk IN ( SELECT ss_item_sk FROM cross_items )) AND (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_week_seq = ( SELECT d_week_seq FROM date_dim WHERE (d_year = 1999) AND (d_moy = 12) AND (d_dom = 11) )) GROUP BY i_brand_id, i_class_id, i_category_id HAVING sum(ss_quantity * ss_list_price) > ( SELECT average_sales FROM avg_sales ) ) AS last_year WHERE (this_year.i_brand_id = last_year.i_brand_id) AND (this_year.i_class_id = last_year.i_class_id) AND (this_year.i_category_id = last_year.i_category_id) ORDER BY this_year.channel, this_year.i_brand_id, this_year.i_class_id, this_year.i_category_id LIMIT 100", + "SELECT ca_zip, sum(cs_sales_price) FROM catalog_sales, customer, customer_address, date_dim WHERE (cs_bill_customer_sk = c_customer_sk) AND (c_current_addr_sk = ca_address_sk) AND ((substr(ca_zip, 1, 5) IN ('85669', '86197', '88274', '83405', '86475', '85392', '85460', '80348', '81792')) OR (ca_state IN ('CA', 'WA', 'GA')) OR (cs_sales_price > 500)) AND (cs_sold_date_sk = d_date_sk) AND (d_qoy = 2) AND (d_year = 2001) GROUP BY ca_zip ORDER BY ca_zip LIMIT 100", + "SELECT count(DISTINCT cs_order_number) AS \"order count\", sum(cs_ext_ship_cost) AS \"total shipping cost\", sum(cs_net_profit) AS \"total net profit\" FROM catalog_sales AS cs1, date_dim, customer_address, call_center WHERE (d_date BETWEEN '2002-2-01' AND (CAST('2002-2-01' AS date) + INTERVAL 60 DAY)) AND (cs1.cs_ship_date_sk = d_date_sk) AND (cs1.cs_ship_addr_sk = ca_address_sk) AND (ca_state = 'GA') AND (cs1.cs_call_center_sk = cc_call_center_sk) AND (cc_county IN ('Williamson County', 'Williamson County', 'Williamson County', 'Williamson County', 'Williamson County')) AND EXISTS ( SELECT * FROM catalog_sales AS cs2 WHERE (cs1.cs_order_number = cs2.cs_order_number) AND (cs1.cs_warehouse_sk <> cs2.cs_warehouse_sk) ) AND NOT EXISTS ( SELECT * FROM catalog_returns AS cr1 WHERE (cs1.cs_order_number = cr1.cr_order_number) ) ORDER BY count(DISTINCT cs_order_number) LIMIT 100", + "SELECT i_item_id, i_item_desc, s_state, count(ss_quantity) AS store_sales_quantitycount, avg(ss_quantity) AS store_sales_quantityave, stddev_samp(ss_quantity) AS store_sales_quantitystdev, stddev_samp(ss_quantity) / avg(ss_quantity) AS store_sales_quantitycov, count(sr_return_quantity) AS store_returns_quantitycount, avg(sr_return_quantity) AS store_returns_quantityave, stddev_samp(sr_return_quantity) AS store_returns_quantitystdev, stddev_samp(sr_return_quantity) / avg(sr_return_quantity) AS store_returns_quantitycov, count(cs_quantity) AS catalog_sales_quantitycount, avg(cs_quantity) AS catalog_sales_quantityave, stddev_samp(cs_quantity) AS catalog_sales_quantitystdev, stddev_samp(cs_quantity) / avg(cs_quantity) AS catalog_sales_quantitycov FROM store_sales, store_returns, catalog_sales, date_dim AS d1, date_dim AS d2, date_dim AS d3, store, item WHERE (d1.d_quarter_name = '2001Q1') AND (d1.d_date_sk = ss_sold_date_sk) AND (i_item_sk = ss_item_sk) AND (s_store_sk = ss_store_sk) AND (ss_customer_sk = sr_customer_sk) AND (ss_item_sk = sr_item_sk) AND (ss_ticket_number = sr_ticket_number) AND (sr_returned_date_sk = d2.d_date_sk) AND (d2.d_quarter_name IN ('2001Q1', '2001Q2', '2001Q3')) AND (sr_customer_sk = cs_bill_customer_sk) AND (sr_item_sk = cs_item_sk) AND (cs_sold_date_sk = d3.d_date_sk) AND (d3.d_quarter_name IN ('2001Q1', '2001Q2', '2001Q3')) GROUP BY i_item_id, i_item_desc, s_state ORDER BY i_item_id, i_item_desc, s_state LIMIT 100", + "SELECT i_item_id, ca_country, ca_state, ca_county, avg(CAST(cs_quantity AS Nullable(decimal(12, 2)))) AS agg1, avg(CAST(cs_list_price AS Nullable(decimal(12, 2)))) AS agg2, avg(CAST(cs_coupon_amt AS Nullable(decimal(12, 2)))) AS agg3, avg(CAST(cs_sales_price AS Nullable(decimal(12, 2)))) AS agg4, avg(CAST(cs_net_profit AS Nullable(decimal(12, 2)))) AS agg5, avg(CAST(c_birth_year AS Nullable(decimal(12, 2)))) AS agg6, avg(CAST(cd1.cd_dep_count AS Nullable(decimal(12, 2)))) AS agg7 FROM catalog_sales, customer_demographics AS cd1, customer_demographics AS cd2, customer, customer_address, date_dim, item WHERE (cs_sold_date_sk = d_date_sk) AND (cs_item_sk = i_item_sk) AND (cs_bill_cdemo_sk = cd1.cd_demo_sk) AND (cs_bill_customer_sk = c_customer_sk) AND (cd1.cd_gender = 'F') AND (cd1.cd_education_status = 'Unknown') AND (c_current_cdemo_sk = cd2.cd_demo_sk) AND (c_current_addr_sk = ca_address_sk) AND (c_birth_month IN (1, 6, 8, 9, 12, 2)) AND (d_year = 1998) AND (ca_state IN ('MS', 'IN', 'ND', 'OK', 'NM', 'VA', 'MS')) GROUP BY ROLLUP (i_item_id, ca_country, ca_state, ca_county) ORDER BY ca_country, ca_state, ca_county, i_item_id LIMIT 100", + "SELECT i_brand_id AS brand_id, i_brand AS brand, i_manufact_id, i_manufact, sum(ss_ext_sales_price) AS ext_price FROM date_dim, store_sales, item, customer, customer_address, store WHERE (d_date_sk = ss_sold_date_sk) AND (ss_item_sk = i_item_sk) AND (i_manager_id = 8) AND (d_moy = 11) AND (d_year = 1998) AND (ss_customer_sk = c_customer_sk) AND (c_current_addr_sk = ca_address_sk) AND (substr(ca_zip, 1, 5) <> substr(s_zip, 1, 5)) AND (ss_store_sk = s_store_sk) GROUP BY i_brand, i_brand_id, i_manufact_id, i_manufact ORDER BY ext_price DESC, i_brand, i_brand_id, i_manufact_id, i_manufact LIMIT 100", + "SELECT i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(cs_ext_sales_price) AS itemrevenue, sum(cs_ext_sales_price) * 100 / sum(sum(cs_ext_sales_price)) OVER (PARTITION BY i_class) AS revenueratio FROM catalog_sales, item, date_dim WHERE (cs_item_sk = i_item_sk) AND (i_category IN ('Sports', 'Books', 'Home')) AND (cs_sold_date_sk = d_date_sk) AND (d_date BETWEEN CAST('1999-02-22' AS date) AND (CAST('1999-02-22' AS date) + INTERVAL 30 DAY)) GROUP BY i_item_id, i_item_desc, i_category, i_class, i_current_price ORDER BY i_category, i_class, i_item_id, i_item_desc, revenueratio LIMIT 100", + "SELECT * FROM ( SELECT w_warehouse_name, i_item_id, sum(CASE WHEN (CAST(d_date AS date) < CAST('2000-03-11' AS date)) THEN inv_quantity_on_hand ELSE 0 END) AS inv_before, sum(CASE WHEN (CAST(d_date AS date) >= CAST('2000-03-11' AS date)) THEN inv_quantity_on_hand ELSE 0 END) AS inv_after FROM inventory, warehouse, item, date_dim WHERE (i_current_price BETWEEN 0.99 AND 1.49) AND (i_item_sk = inv_item_sk) AND (inv_warehouse_sk = w_warehouse_sk) AND (inv_date_sk = d_date_sk) AND (d_date BETWEEN (CAST('2000-03-11' AS date) - INTERVAL 30 DAY) AND (CAST('2000-03-11' AS date) + INTERVAL 30 DAY)) GROUP BY w_warehouse_name, i_item_id ) AS x WHERE (CASE WHEN inv_before > 0 THEN inv_after / inv_before ELSE NULL END) BETWEEN 2.0 / 3.0 AND 3.0 / 2.0 ORDER BY w_warehouse_name, i_item_id LIMIT 100", + "SELECT i_product_name, i_brand, i_class, i_category, avg(inv_quantity_on_hand) AS qoh FROM inventory, date_dim, item WHERE (inv_date_sk = d_date_sk) AND (inv_item_sk = i_item_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) GROUP BY ROLLUP(i_product_name, i_brand, i_class, i_category) ORDER BY qoh, i_product_name, i_brand, i_class, i_category LIMIT 100", + "WITH frequent_ss_items AS ( SELECT substr(i_item_desc, 1, 30) AS itemdesc, i_item_sk AS item_sk, d_date AS solddate, count(*) AS cnt FROM store_sales, date_dim, item WHERE (ss_sold_date_sk = d_date_sk) AND (ss_item_sk = i_item_sk) AND (d_year IN (2000, 2000 + 1, 2000 + 2, 2000 + 3)) GROUP BY substr(i_item_desc, 1, 30), i_item_sk, d_date HAVING count(*) > 4 ), max_store_sales AS ( SELECT max(csales) AS tpcds_cmax FROM ( SELECT c_customer_sk, sum(ss_quantity * ss_sales_price) AS csales FROM store_sales, customer, date_dim WHERE (ss_customer_sk = c_customer_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year IN (2000, 2000 + 1, 2000 + 2, 2000 + 3)) GROUP BY c_customer_sk ) ), best_ss_customer AS ( SELECT c_customer_sk, sum(ss_quantity * ss_sales_price) AS ssales FROM store_sales, customer WHERE (ss_customer_sk = c_customer_sk) GROUP BY c_customer_sk HAVING sum(ss_quantity * ss_sales_price) > (50 / 100.0) * ( SELECT * FROM max_store_sales ) ) SELECT sum(sales) FROM ( SELECT cs_quantity * cs_list_price AS sales FROM catalog_sales, date_dim WHERE (d_year = 2000) AND (d_moy = 2) AND (cs_sold_date_sk = d_date_sk) AND (cs_item_sk IN (SELECT item_sk FROM frequent_ss_items)) AND (cs_bill_customer_sk IN (SELECT c_customer_sk FROM best_ss_customer)) UNION ALL SELECT ws_quantity * ws_list_price AS sales FROM web_sales, date_dim WHERE (d_year = 2000) AND (d_moy = 2) AND (ws_sold_date_sk = d_date_sk) AND (ws_item_sk IN (SELECT item_sk FROM frequent_ss_items)) AND (ws_bill_customer_sk IN (SELECT c_customer_sk FROM best_ss_customer)) ) LIMIT 100", + "WITH frequent_ss_items AS ( SELECT substr(i_item_desc, 1, 30) AS itemdesc, i_item_sk AS item_sk, d_date AS solddate, count(*) AS cnt FROM store_sales, date_dim, item WHERE (ss_sold_date_sk = d_date_sk) AND (ss_item_sk = i_item_sk) AND (d_year IN (2000, 2000 + 1, 2000 + 2, 2000 + 3)) GROUP BY substr(i_item_desc, 1, 30), i_item_sk, d_date HAVING count(*) > 4 ), max_store_sales AS ( SELECT max(csales) AS tpcds_cmax FROM ( SELECT c_customer_sk, sum(ss_quantity * ss_sales_price) AS csales FROM store_sales, customer, date_dim WHERE (ss_customer_sk = c_customer_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year IN (2000, 2000 + 1, 2000 + 2, 2000 + 3)) GROUP BY c_customer_sk ) ), best_ss_customer AS ( SELECT c_customer_sk, sum(ss_quantity * ss_sales_price) AS ssales FROM store_sales, customer WHERE (ss_customer_sk = c_customer_sk) GROUP BY c_customer_sk HAVING sum(ss_quantity * ss_sales_price) > (50 / 100.0) * ( SELECT * FROM max_store_sales ) ) SELECT c_last_name, c_first_name, sales FROM ( SELECT c_last_name, c_first_name, sum(cs_quantity * cs_list_price) AS sales FROM catalog_sales, customer, date_dim WHERE (d_year = 2000) AND (d_moy = 2) AND (cs_sold_date_sk = d_date_sk) AND (cs_item_sk IN (SELECT item_sk FROM frequent_ss_items)) AND (cs_bill_customer_sk IN (SELECT c_customer_sk FROM best_ss_customer)) AND (cs_bill_customer_sk = c_customer_sk) GROUP BY c_last_name, c_first_name UNION ALL SELECT c_last_name, c_first_name, sum(ws_quantity * ws_list_price) AS sales FROM web_sales, customer, date_dim WHERE (d_year = 2000) AND (d_moy = 2) AND (ws_sold_date_sk = d_date_sk) AND (ws_item_sk IN (SELECT item_sk FROM frequent_ss_items)) AND (ws_bill_customer_sk IN (SELECT c_customer_sk FROM best_ss_customer)) AND (ws_bill_customer_sk = c_customer_sk) GROUP BY c_last_name, c_first_name ) ORDER BY c_last_name, c_first_name, sales LIMIT 100", + "WITH ssales AS ( SELECT c_last_name, c_first_name, s_store_name, ca_state, s_state, i_color, i_current_price, i_manager_id, i_units, i_size, sum(ss_net_paid) AS netpaid FROM store_sales, store_returns, store, item, customer, customer_address WHERE (ss_ticket_number = sr_ticket_number) AND (ss_item_sk = sr_item_sk) AND (ss_customer_sk = c_customer_sk) AND (ss_item_sk = i_item_sk) AND (ss_store_sk = s_store_sk) AND (c_current_addr_sk = ca_address_sk) AND (c_birth_country <> upper(ca_country)) AND (s_zip = ca_zip) AND (s_market_id = 8) GROUP BY c_last_name, c_first_name, s_store_name, ca_state, s_state, i_color, i_current_price, i_manager_id, i_units, i_size ) SELECT c_last_name, c_first_name, s_store_name, sum(netpaid) AS paid FROM ssales WHERE (i_color = 'peach') GROUP BY c_last_name, c_first_name, s_store_name HAVING sum(netpaid) > ( SELECT 0.05 * avg(netpaid) FROM ssales ) ORDER BY c_last_name, c_first_name, s_store_name", + "WITH ssales AS ( SELECT c_last_name, c_first_name, s_store_name, ca_state, s_state, i_color, i_current_price, i_manager_id, i_units, i_size, sum(ss_net_paid) AS netpaid FROM store_sales, store_returns, store, item, customer, customer_address WHERE (ss_ticket_number = sr_ticket_number) AND (ss_item_sk = sr_item_sk) AND (ss_customer_sk = c_customer_sk) AND (ss_item_sk = i_item_sk) AND (ss_store_sk = s_store_sk) AND (c_current_addr_sk = ca_address_sk) AND (c_birth_country <> upper(ca_country)) AND (s_zip = ca_zip) AND (s_market_id = 8) GROUP BY c_last_name, c_first_name, s_store_name, ca_state, s_state, i_color, i_current_price, i_manager_id, i_units, i_size ) SELECT c_last_name, c_first_name, s_store_name, sum(netpaid) AS paid FROM ssales WHERE (i_color = 'saddle') GROUP BY c_last_name, c_first_name, s_store_name HAVING sum(netpaid) > ( SELECT 0.05 * avg(netpaid) FROM ssales ) ORDER BY c_last_name, c_first_name, s_store_name", + "SELECT i_item_id, i_item_desc, s_store_id, s_store_name, sum(ss_net_profit) AS store_sales_profit, sum(sr_net_loss) AS store_returns_loss, sum(cs_net_profit) AS catalog_sales_profit FROM store_sales, store_returns, catalog_sales, date_dim AS d1, date_dim AS d2, date_dim AS d3, store, item WHERE (d1.d_moy = 4) AND (d1.d_year = 2001) AND (d1.d_date_sk = ss_sold_date_sk) AND (i_item_sk = ss_item_sk) AND (s_store_sk = ss_store_sk) AND (ss_customer_sk = sr_customer_sk) AND (ss_item_sk = sr_item_sk) AND (ss_ticket_number = sr_ticket_number) AND (sr_returned_date_sk = d2.d_date_sk) AND (d2.d_moy BETWEEN 4 AND 10) AND (d2.d_year = 2001) AND (sr_customer_sk = cs_bill_customer_sk) AND (sr_item_sk = cs_item_sk) AND (cs_sold_date_sk = d3.d_date_sk) AND (d3.d_moy BETWEEN 4 AND 10) AND (d3.d_year = 2001) GROUP BY i_item_id, i_item_desc, s_store_id, s_store_name ORDER BY i_item_id, i_item_desc, s_store_id, s_store_name LIMIT 100", + "SELECT i_item_id, avg(cs_quantity) AS agg1, avg(cs_list_price) AS agg2, avg(cs_coupon_amt) AS agg3, avg(cs_sales_price) AS agg4 FROM catalog_sales, customer_demographics, date_dim, item, promotion WHERE (cs_sold_date_sk = d_date_sk) AND (cs_item_sk = i_item_sk) AND (cs_bill_cdemo_sk = cd_demo_sk) AND (cs_promo_sk = p_promo_sk) AND (cd_gender = 'M') AND (cd_marital_status = 'S') AND (cd_education_status = 'College') AND ((p_channel_email = 'N') OR (p_channel_event = 'N')) AND (d_year = 2000) GROUP BY i_item_id ORDER BY i_item_id LIMIT 100", + "SELECT i_item_id, s_state, grouping(s_state) AS g_state, avg(ss_quantity) AS agg1, avg(ss_list_price) AS agg2, avg(ss_coupon_amt) AS agg3, avg(ss_sales_price) AS agg4 FROM store_sales, customer_demographics, date_dim, store, item WHERE (ss_sold_date_sk = d_date_sk) AND (ss_item_sk = i_item_sk) AND (ss_store_sk = s_store_sk) AND (ss_cdemo_sk = cd_demo_sk) AND (cd_gender = 'M') AND (cd_marital_status = 'S') AND (cd_education_status = 'College') AND (d_year = 2002) AND (s_state IN ('TN', 'TN', 'TN', 'TN', 'TN', 'TN')) GROUP BY ROLLUP(i_item_id, s_state) ORDER BY i_item_id, s_state LIMIT 100", + "SELECT * FROM ( SELECT avg(ss_list_price) AS B1_LP, count(ss_list_price) AS B1_CNT, count(DISTINCT ss_list_price) AS B1_CNTD FROM store_sales WHERE (ss_quantity BETWEEN 0 AND 5) AND ((ss_list_price BETWEEN 8 AND 8 + 10) OR (ss_coupon_amt BETWEEN 459 AND 459 + 1000) OR (ss_wholesale_cost BETWEEN 57 AND 57 + 20)) ) AS B1, ( SELECT avg(ss_list_price) AS B2_LP, count(ss_list_price) AS B2_CNT, count(DISTINCT ss_list_price) AS B2_CNTD FROM store_sales WHERE (ss_quantity BETWEEN 6 AND 10) AND ((ss_list_price BETWEEN 90 AND 90 + 10) OR (ss_coupon_amt BETWEEN 2323 AND 2323 + 1000) OR (ss_wholesale_cost BETWEEN 31 AND 31 + 20)) ) AS B2, ( SELECT avg(ss_list_price) AS B3_LP, count(ss_list_price) AS B3_CNT, count(DISTINCT ss_list_price) AS B3_CNTD FROM store_sales WHERE (ss_quantity BETWEEN 11 AND 15) AND ((ss_list_price BETWEEN 142 AND 142 + 10) OR (ss_coupon_amt BETWEEN 12214 AND 12214 + 1000) OR (ss_wholesale_cost BETWEEN 79 AND 79 + 20)) ) AS B3, ( SELECT avg(ss_list_price) AS B4_LP, count(ss_list_price) AS B4_CNT, count(DISTINCT ss_list_price) AS B4_CNTD FROM store_sales WHERE (ss_quantity BETWEEN 16 AND 20) AND ((ss_list_price BETWEEN 135 AND 135 + 10) OR (ss_coupon_amt BETWEEN 6071 AND 6071 + 1000) OR (ss_wholesale_cost BETWEEN 38 AND 38 + 20)) ) AS B4, ( SELECT avg(ss_list_price) AS B5_LP, count(ss_list_price) AS B5_CNT, count(DISTINCT ss_list_price) AS B5_CNTD FROM store_sales WHERE (ss_quantity BETWEEN 21 AND 25) AND ((ss_list_price BETWEEN 122 AND 122 + 10) OR (ss_coupon_amt BETWEEN 836 AND 836 + 1000) OR (ss_wholesale_cost BETWEEN 17 AND 17 + 20)) ) AS B5, ( SELECT avg(ss_list_price) AS B6_LP, count(ss_list_price) AS B6_CNT, count(DISTINCT ss_list_price) AS B6_CNTD FROM store_sales WHERE (ss_quantity BETWEEN 26 AND 30) AND ((ss_list_price BETWEEN 154 AND 154 + 10) OR (ss_coupon_amt BETWEEN 7326 AND 7326 + 1000) OR (ss_wholesale_cost BETWEEN 7 AND 7 + 20)) ) AS B6 LIMIT 100", + "SELECT i_item_id, i_item_desc, s_store_id, s_store_name, sum(ss_quantity) AS store_sales_quantity, sum(sr_return_quantity) AS store_returns_quantity, sum(cs_quantity) AS catalog_sales_quantity FROM store_sales, store_returns, catalog_sales, date_dim AS d1, date_dim AS d2, date_dim AS d3, store, item WHERE (d1.d_moy = 9) AND (d1.d_year = 1999) AND (d1.d_date_sk = ss_sold_date_sk) AND (i_item_sk = ss_item_sk) AND (s_store_sk = ss_store_sk) AND (ss_customer_sk = sr_customer_sk) AND (ss_item_sk = sr_item_sk) AND (ss_ticket_number = sr_ticket_number) AND (sr_returned_date_sk = d2.d_date_sk) AND (d2.d_moy BETWEEN 9 AND 9 + 3) AND (d2.d_year = 1999) AND (sr_customer_sk = cs_bill_customer_sk) AND (sr_item_sk = cs_item_sk) AND (cs_sold_date_sk = d3.d_date_sk) AND (d3.d_year IN (1999, 1999 + 1, 1999 + 2)) GROUP BY i_item_id, i_item_desc, s_store_id, s_store_name ORDER BY i_item_id, i_item_desc, s_store_id, s_store_name LIMIT 100", + "WITH customer_total_return AS ( SELECT wr_returning_customer_sk AS ctr_customer_sk, ca_state AS ctr_state, sum(wr_return_amt) AS ctr_total_return FROM web_returns, date_dim, customer_address WHERE (wr_returned_date_sk = d_date_sk) AND (d_year = 2002) AND (wr_returning_addr_sk = ca_address_sk) GROUP BY wr_returning_customer_sk, ca_state ) SELECT c_customer_id, c_salutation, c_first_name, c_last_name, c_preferred_cust_flag, c_birth_day, c_birth_month, c_birth_year, c_birth_country, c_login, c_email_address, c_last_review_date_sk, ctr_total_return FROM customer_total_return AS ctr1, customer_address, customer WHERE (ctr1.ctr_total_return > ( SELECT avg(ctr_total_return) * 1.2 FROM customer_total_return AS ctr2 WHERE (ctr1.ctr_state = ctr2.ctr_state) )) AND (ca_address_sk = c_current_addr_sk) AND (ca_state = 'GA') AND (ctr1.ctr_customer_sk = c_customer_sk) ORDER BY c_customer_id, c_salutation, c_first_name, c_last_name, c_preferred_cust_flag, c_birth_day, c_birth_month, c_birth_year, c_birth_country, c_login, c_email_address, c_last_review_date_sk, ctr_total_return LIMIT 100", + "WITH ss AS ( SELECT ca_county, d_qoy, d_year, sum(ss_ext_sales_price) AS store_sales FROM store_sales, date_dim, customer_address WHERE (ss_sold_date_sk = d_date_sk) AND (ss_addr_sk = ca_address_sk) GROUP BY ca_county, d_qoy, d_year ), ws AS ( SELECT ca_county, d_qoy, d_year, sum(ws_ext_sales_price) AS web_sales FROM web_sales, date_dim, customer_address WHERE (ws_sold_date_sk = d_date_sk) AND (ws_bill_addr_sk = ca_address_sk) GROUP BY ca_county, d_qoy, d_year ) SELECT ss1.ca_county, ss1.d_year, CAST(ws2.web_sales AS Float64) / ws1.web_sales AS web_q1_q2_increase, CAST(ss2.store_sales AS Float64) / ss1.store_sales AS store_q1_q2_increase, CAST(ws3.web_sales AS Float64) / ws2.web_sales AS web_q2_q3_increase, CAST(ss3.store_sales AS Float64) / ss2.store_sales AS store_q2_q3_increase FROM ss AS ss1, ss AS ss2, ss AS ss3, ws AS ws1, ws AS ws2, ws AS ws3 WHERE (ss1.d_qoy = 1) AND (ss1.d_year = 2000) AND (ss1.ca_county = ss2.ca_county) AND (ss2.d_qoy = 2) AND (ss2.d_year = 2000) AND (ss2.ca_county = ss3.ca_county) AND (ss3.d_qoy = 3) AND (ss3.d_year = 2000) AND (ss1.ca_county = ws1.ca_county) AND (ws1.d_qoy = 1) AND (ws1.d_year = 2000) AND (ws1.ca_county = ws2.ca_county) AND (ws2.d_qoy = 2) AND (ws2.d_year = 2000) AND (ws1.ca_county = ws3.ca_county) AND (ws3.d_qoy = 3) AND (ws3.d_year = 2000) AND (CASE WHEN ws1.web_sales > 0 THEN CAST(ws2.web_sales AS Float64) / ws1.web_sales ELSE NULL END > CASE WHEN ss1.store_sales > 0 THEN CAST(ss2.store_sales AS Float64) / ss1.store_sales ELSE NULL END) AND (CASE WHEN ws2.web_sales > 0 THEN CAST(ws3.web_sales AS Float64) / ws2.web_sales ELSE NULL END > CASE WHEN ss2.store_sales > 0 THEN CAST(ss3.store_sales AS Float64) / ss2.store_sales ELSE NULL END) ORDER BY ss1.ca_county", + "SELECT sum(cs_ext_discount_amt) AS \"excess discount amount\" FROM catalog_sales, item, date_dim WHERE (i_manufact_id = 977) AND (i_item_sk = cs_item_sk) AND (d_date BETWEEN '2000-01-27' AND (CAST('2000-01-27' AS date) + INTERVAL 90 DAY)) AND (d_date_sk = cs_sold_date_sk) AND (cs_ext_discount_amt > ( SELECT 1.3 * avg(cs_ext_discount_amt) FROM catalog_sales, date_dim WHERE (cs_item_sk = i_item_sk) AND (d_date BETWEEN '2000-01-27' AND (CAST('2000-01-27' AS date) + INTERVAL 90 DAY)) AND (d_date_sk = cs_sold_date_sk) )) LIMIT 100", + "WITH ss AS ( SELECT i_manufact_id, sum(ss_ext_sales_price) AS total_sales FROM store_sales, date_dim, customer_address, item WHERE (i_manufact_id IN ( SELECT i_manufact_id FROM item WHERE (i_category IN ('Electronics')) )) AND (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 1998) AND (d_moy = 5) AND (ss_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_manufact_id ), cs AS ( SELECT i_manufact_id, sum(cs_ext_sales_price) AS total_sales FROM catalog_sales, date_dim, customer_address, item WHERE (i_manufact_id IN ( SELECT i_manufact_id FROM item WHERE (i_category IN ('Electronics')) )) AND (cs_item_sk = i_item_sk) AND (cs_sold_date_sk = d_date_sk) AND (d_year = 1998) AND (d_moy = 5) AND (cs_bill_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_manufact_id ), ws AS ( SELECT i_manufact_id, sum(ws_ext_sales_price) AS total_sales FROM web_sales, date_dim, customer_address, item WHERE (i_manufact_id IN ( SELECT i_manufact_id FROM item WHERE (i_category IN ('Electronics')) )) AND (ws_item_sk = i_item_sk) AND (ws_sold_date_sk = d_date_sk) AND (d_year = 1998) AND (d_moy = 5) AND (ws_bill_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_manufact_id ) SELECT i_manufact_id, sum(total_sales) AS total_sales FROM ( SELECT * FROM ss UNION ALL SELECT * FROM cs UNION ALL SELECT * FROM ws ) AS tmp1 GROUP BY i_manufact_id ORDER BY total_sales LIMIT 100", + "SELECT c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt FROM ( SELECT ss_ticket_number, ss_customer_sk, count(*) AS cnt FROM store_sales, date_dim, store, household_demographics WHERE (store_sales.ss_sold_date_sk = date_dim.d_date_sk) AND (store_sales.ss_store_sk = store.s_store_sk) AND (store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk) AND ((date_dim.d_dom BETWEEN 1 AND 3) OR (date_dim.d_dom BETWEEN 25 AND 28)) AND ((household_demographics.hd_buy_potential = '>10000') OR (household_demographics.hd_buy_potential = 'Unknown')) AND (household_demographics.hd_vehicle_count > 0) AND ((CASE WHEN household_demographics.hd_vehicle_count > 0 THEN (household_demographics.hd_dep_count) / household_demographics.hd_vehicle_count ELSE NULL END) > 1.2) AND (date_dim.d_year IN (1999, 1999 + 1, 1999 + 2)) AND (store.s_county IN ('Williamson County', 'Williamson County', 'Williamson County', 'Williamson County', 'Williamson County', 'Williamson County', 'Williamson County', 'Williamson County')) GROUP BY ss_ticket_number, ss_customer_sk ) AS dn, customer WHERE (ss_customer_sk = c_customer_sk) AND (cnt BETWEEN 15 AND 20) ORDER BY c_last_name, c_first_name, c_salutation, c_preferred_cust_flag DESC, ss_ticket_number", + "SELECT ca_state, cd_gender, cd_marital_status, cd_dep_count, count(*) AS cnt1, avg(cd_dep_count), min(cd_dep_count), min(cd_dep_count), cd_dep_employed_count, count(*) AS cnt2, avg(cd_dep_employed_count), min(cd_dep_employed_count), min(cd_dep_employed_count), cd_dep_college_count, count(*) AS cnt3, avg(cd_dep_college_count), min(cd_dep_college_count), min(cd_dep_college_count) FROM customer AS c, customer_address AS ca, customer_demographics WHERE (c.c_current_addr_sk = ca.ca_address_sk) AND (cd_demo_sk = c.c_current_cdemo_sk) AND EXISTS ( SELECT * FROM store_sales, date_dim WHERE (c.c_customer_sk = ss_customer_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 2002) AND (d_qoy < 4) ) AND ( EXISTS ( SELECT * FROM web_sales, date_dim WHERE (c.c_customer_sk = ws_bill_customer_sk) AND (ws_sold_date_sk = d_date_sk) AND (d_year = 2002) AND (d_qoy < 4) ) OR EXISTS ( SELECT * FROM catalog_sales, date_dim WHERE (c.c_customer_sk = cs_ship_customer_sk) AND (cs_sold_date_sk = d_date_sk) AND (d_year = 2002) AND (d_qoy < 4) ) ) GROUP BY ca_state, cd_gender, cd_marital_status, cd_dep_count, cd_dep_employed_count, cd_dep_college_count ORDER BY ca_state, cd_gender, cd_marital_status, cd_dep_count, cd_dep_employed_count, cd_dep_college_count LIMIT 100", + "SELECT sum(ss_net_profit) / sum(ss_ext_sales_price) AS gross_margin, i_category, i_class, grouping(i_category) + grouping(i_class) AS lochierarchy, rank() OVER ( PARTITION BY grouping(i_category) + grouping(i_class), CASE WHEN grouping(i_class) = 0 THEN i_category END ORDER BY (sum(ss_net_profit) * 1.) / sum(ss_ext_sales_price) ASC ) AS rank_within_parent FROM store_sales, date_dim AS d1, item, store WHERE (d1.d_year = 2001) AND (d1.d_date_sk = ss_sold_date_sk) AND (i_item_sk = ss_item_sk) AND (s_store_sk = ss_store_sk) AND (s_state IN ('TN', 'TN', 'TN', 'TN', 'TN', 'TN', 'TN', 'TN')) GROUP BY ROLLUP(i_category, i_class) ORDER BY lochierarchy DESC, CASE WHEN lochierarchy = 0 THEN i_category END, rank_within_parent LIMIT 100", + "SELECT i_item_id, i_item_desc, i_current_price FROM item, inventory, date_dim, catalog_sales WHERE (i_current_price BETWEEN 68 AND 68 + 30) AND (inv_item_sk = i_item_sk) AND (d_date_sk = inv_date_sk) AND (d_date BETWEEN CAST('2000-02-01' AS date) AND (CAST('2000-02-01' AS date) + INTERVAL 60 DAY)) AND (i_manufact_id IN (677, 940, 694, 808)) AND (inv_quantity_on_hand BETWEEN 100 AND 500) AND (cs_item_sk = i_item_sk) GROUP BY i_item_id, i_item_desc, i_current_price ORDER BY i_item_id LIMIT 100", + "SELECT count(*) FROM ( SELECT DISTINCT c_last_name, c_first_name, d_date FROM store_sales, date_dim, customer WHERE (store_sales.ss_sold_date_sk = date_dim.d_date_sk) AND (store_sales.ss_customer_sk = customer.c_customer_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) INTERSECT SELECT DISTINCT c_last_name, c_first_name, d_date FROM catalog_sales, date_dim, customer WHERE (catalog_sales.cs_sold_date_sk = date_dim.d_date_sk) AND (catalog_sales.cs_bill_customer_sk = customer.c_customer_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) INTERSECT SELECT DISTINCT c_last_name, c_first_name, d_date FROM web_sales, date_dim, customer WHERE (web_sales.ws_sold_date_sk = date_dim.d_date_sk) AND (web_sales.ws_bill_customer_sk = customer.c_customer_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) ) AS hot_cust LIMIT 100", + "WITH inv AS ( SELECT w_warehouse_name, w_warehouse_sk, i_item_sk, d_moy, stdev, mean, CASE mean WHEN 0 THEN NULL ELSE stdev / mean END AS cov FROM ( SELECT w_warehouse_name, w_warehouse_sk, i_item_sk, d_moy, stddev_samp(inv_quantity_on_hand) AS stdev, avg(inv_quantity_on_hand) AS mean FROM inventory, item, warehouse, date_dim WHERE (inv_item_sk = i_item_sk) AND (inv_warehouse_sk = w_warehouse_sk) AND (inv_date_sk = d_date_sk) AND (d_year = 2001) GROUP BY w_warehouse_name, w_warehouse_sk, i_item_sk, d_moy ) AS foo WHERE (CASE mean WHEN 0 THEN 0 ELSE stdev / mean END > 1) ) SELECT inv1.w_warehouse_sk, inv1.i_item_sk, inv1.d_moy, inv1.mean, inv1.cov, inv2.w_warehouse_sk, inv2.i_item_sk, inv2.d_moy, inv2.mean, inv2.cov FROM inv AS inv1, inv AS inv2 WHERE (inv1.i_item_sk = inv2.i_item_sk) AND (inv1.w_warehouse_sk = inv2.w_warehouse_sk) AND (inv1.d_moy = 1) AND (inv2.d_moy = 1 + 1) ORDER BY inv1.w_warehouse_sk, inv1.i_item_sk, inv1.d_moy, inv1.mean, inv1.cov, inv2.d_moy, inv2.mean, inv2.cov", + "WITH inv AS ( SELECT w_warehouse_name, w_warehouse_sk, i_item_sk, d_moy, stdev, mean, CASE mean WHEN 0 THEN NULL ELSE stdev / mean END AS cov FROM ( SELECT w_warehouse_name, w_warehouse_sk, i_item_sk, d_moy, stddev_samp(inv_quantity_on_hand) AS stdev, avg(inv_quantity_on_hand) AS mean FROM inventory, item, warehouse, date_dim WHERE (inv_item_sk = i_item_sk) AND (inv_warehouse_sk = w_warehouse_sk) AND (inv_date_sk = d_date_sk) AND (d_year = 2001) GROUP BY w_warehouse_name, w_warehouse_sk, i_item_sk, d_moy ) AS foo WHERE (CASE mean WHEN 0 THEN 0 ELSE stdev / mean END > 1) ) SELECT inv1.w_warehouse_sk, inv1.i_item_sk, inv1.d_moy, inv1.mean, inv1.cov, inv2.w_warehouse_sk, inv2.i_item_sk, inv2.d_moy, inv2.mean, inv2.cov FROM inv AS inv1, inv AS inv2 WHERE (inv1.i_item_sk = inv2.i_item_sk) AND (inv1.w_warehouse_sk = inv2.w_warehouse_sk) AND (inv1.d_moy = 1) AND (inv2.d_moy = 1 + 1) AND (inv1.cov > 1.5) ORDER BY inv1.w_warehouse_sk, inv1.i_item_sk, inv1.d_moy, inv1.mean, inv1.cov, inv2.d_moy, inv2.mean, inv2.cov", + "SELECT w_state, i_item_id, sum(CASE WHEN (CAST(d_date AS date) < CAST('2000-03-11' AS date)) THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END) AS sales_before, sum(CASE WHEN (CAST(d_date AS date) >= CAST('2000-03-11' AS date)) THEN cs_sales_price - coalesce(cr_refunded_cash, 0) ELSE 0 END) AS sales_after FROM catalog_sales LEFT OUTER JOIN catalog_returns ON (cs_order_number = cr_order_number) AND (cs_item_sk = cr_item_sk), warehouse, item, date_dim WHERE (i_current_price BETWEEN 0.99 AND 1.49) AND (i_item_sk = cs_item_sk) AND (cs_warehouse_sk = w_warehouse_sk) AND (cs_sold_date_sk = d_date_sk) AND (d_date BETWEEN (CAST('2000-03-11' AS date) - INTERVAL 30 DAY) AND (CAST('2000-03-11' AS date) + INTERVAL 30 DAY)) GROUP BY w_state, i_item_id ORDER BY w_state, i_item_id LIMIT 100", + "SELECT DISTINCT(i_product_name) FROM item AS i1 WHERE (i_manufact_id BETWEEN 738 AND 738 + 40) AND ( SELECT count(*) AS item_cnt FROM item WHERE ( (i_manufact = i1.i_manufact) AND ( ( (i_category = 'Women') AND (i_color = 'powder' OR i_color = 'khaki') AND (i_units = 'Ounce' OR i_units = 'Oz') AND (i_size = 'medium' OR i_size = 'extra large') ) OR ( (i_category = 'Women') AND (i_color = 'brown' OR i_color = 'honeydew') AND (i_units = 'Bunch' OR i_units = 'Ton') AND (i_size = 'N/A' OR i_size = 'small') ) OR ( (i_category = 'Men') AND (i_color = 'floral' OR i_color = 'deep') AND (i_units = 'N/A' OR i_units = 'Dozen') AND (i_size = 'petite' OR i_size = 'large') ) OR ( (i_category = 'Men') AND (i_color = 'light' OR i_color = 'cornflower') AND (i_units = 'Box' OR i_units = 'Pound') AND (i_size = 'medium' OR i_size = 'extra large') ) ) ) OR ( (i_manufact = i1.i_manufact) AND ( ( (i_category = 'Women') AND (i_color = 'midnight' OR i_color = 'snow') AND (i_units = 'Pallet' OR i_units = 'Gross') AND (i_size = 'medium' OR i_size = 'extra large') ) OR ( (i_category = 'Women') AND (i_color = 'cyan' OR i_color = 'papaya') AND (i_units = 'Cup' OR i_units = 'Dram') AND (i_size = 'N/A' OR i_size = 'small') ) OR ( (i_category = 'Men') AND (i_color = 'orange' OR i_color = 'frosted') AND (i_units = 'Each' OR i_units = 'Tbl') AND (i_size = 'petite' OR i_size = 'large') ) OR ( (i_category = 'Men') AND (i_color = 'forest' OR i_color = 'ghost') AND (i_units = 'Lb' OR i_units = 'Bundle') AND (i_size = 'medium' OR i_size = 'extra large') ) ) ) ) > 0 ORDER BY i_product_name LIMIT 100", + "SELECT dt.d_year, item.i_category_id, item.i_category, sum(ss_ext_sales_price) FROM date_dim AS dt, store_sales, item WHERE (dt.d_date_sk = store_sales.ss_sold_date_sk) AND (store_sales.ss_item_sk = item.i_item_sk) AND (item.i_manager_id = 1) AND (dt.d_moy = 11) AND (dt.d_year = 2000) GROUP BY dt.d_year, item.i_category_id, item.i_category ORDER BY sum(ss_ext_sales_price) DESC, dt.d_year, item.i_category_id, item.i_category LIMIT 100", + "SELECT s_store_name, s_store_id, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END) AS sun_sales, sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END) AS mon_sales, sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END) AS tue_sales, sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END) AS wed_sales, sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END) AS thu_sales, sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END) AS fri_sales, sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) AS sat_sales FROM date_dim, store_sales, store WHERE (d_date_sk = ss_sold_date_sk) AND (s_store_sk = ss_store_sk) AND (s_gmt_offset = -5) AND (d_year = 2000) GROUP BY s_store_name, s_store_id ORDER BY s_store_name, s_store_id, sun_sales, mon_sales, tue_sales, wed_sales, thu_sales, fri_sales, sat_sales LIMIT 100", + "SELECT asceding.rnk, i1.i_product_name AS best_performing, i2.i_product_name AS worst_performing FROM ( SELECT * FROM ( SELECT item_sk, rank() OVER (ORDER BY rank_col ASC) AS rnk FROM ( SELECT ss_item_sk AS item_sk, avg(ss_net_profit) AS rank_col FROM store_sales AS ss1 WHERE (ss_store_sk = 4) GROUP BY ss_item_sk HAVING avg(ss_net_profit) > 0.9 * ( SELECT avg(ss_net_profit) AS rank_col FROM store_sales WHERE (ss_store_sk = 4) AND (ss_addr_sk IS NULL) GROUP BY ss_store_sk ) ) AS V1 ) AS V11 WHERE (rnk < 11) ) AS asceding, ( SELECT * FROM ( SELECT item_sk, rank() OVER (ORDER BY rank_col DESC) AS rnk FROM ( SELECT ss_item_sk AS item_sk, avg(ss_net_profit) AS rank_col FROM store_sales AS ss1 WHERE (ss_store_sk = 4) GROUP BY ss_item_sk HAVING avg(ss_net_profit) > 0.9 * ( SELECT avg(ss_net_profit) AS rank_col FROM store_sales WHERE (ss_store_sk = 4) AND (ss_addr_sk IS NULL) GROUP BY ss_store_sk ) ) AS V2 ) AS V21 WHERE (rnk < 11) ) AS descending, item AS i1, item AS i2 WHERE (asceding.rnk = descending.rnk) AND (i1.i_item_sk = asceding.item_sk) AND (i2.i_item_sk = descending.item_sk) ORDER BY asceding.rnk LIMIT 100", + "SELECT ca_zip, ca_city, sum(ws_sales_price) FROM web_sales, customer, customer_address, date_dim, item WHERE (ws_bill_customer_sk = c_customer_sk) AND (c_current_addr_sk = ca_address_sk) AND (ws_item_sk = i_item_sk) AND ( (substr(ca_zip, 1, 5) IN ('85669', '86197', '88274', '83405', '86475', '85392', '85460', '80348', '81792')) OR (i_item_id IN ( SELECT i_item_id FROM item WHERE (i_item_sk IN (2, 3, 5, 7, 11, 13, 17, 19, 23, 29)) )) ) AND (ws_sold_date_sk = d_date_sk) AND (d_qoy = 2) AND (d_year = 2001) GROUP BY ca_zip, ca_city ORDER BY ca_zip, ca_city LIMIT 100", + "SELECT c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, amt, profit FROM ( SELECT ss_ticket_number, ss_customer_sk, ca_city AS bought_city, sum(ss_coupon_amt) AS amt, sum(ss_net_profit) AS profit FROM store_sales, date_dim, store, household_demographics, customer_address WHERE (store_sales.ss_sold_date_sk = date_dim.d_date_sk) AND (store_sales.ss_store_sk = store.s_store_sk) AND (store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk) AND (store_sales.ss_addr_sk = customer_address.ca_address_sk) AND ((household_demographics.hd_dep_count = 4) OR (household_demographics.hd_vehicle_count = 3)) AND (date_dim.d_dow IN (6, 0)) AND (date_dim.d_year IN (1999, 1999 + 1, 1999 + 2)) AND (store.s_city IN ('Fairview', 'Midway', 'Fairview', 'Fairview', 'Fairview')) GROUP BY ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city ) AS dn, customer, customer_address AS current_addr WHERE (ss_customer_sk = c_customer_sk) AND (customer.c_current_addr_sk = current_addr.ca_address_sk) AND (current_addr.ca_city <> bought_city) ORDER BY c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number LIMIT 100", + "WITH v1 AS ( SELECT i_category, i_brand, s_store_name, s_company_name, d_year, d_moy, sum(ss_sales_price) AS sum_sales, avg(sum(ss_sales_price)) OVER (PARTITION BY i_category, i_brand, s_store_name, s_company_name, d_year) AS avg_monthly_sales, rank() OVER (PARTITION BY i_category, i_brand, s_store_name, s_company_name ORDER BY d_year, d_moy) AS rn FROM item, store_sales, date_dim, store WHERE (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (ss_store_sk = s_store_sk) AND ( (d_year = 1999) OR ((d_year = 1999 - 1) AND (d_moy = 12)) OR ((d_year = 1999 + 1) AND (d_moy = 1)) ) GROUP BY i_category, i_brand, s_store_name, s_company_name, d_year, d_moy ), v2 AS ( SELECT v1.i_category, v1.i_brand, v1.s_store_name, v1.s_company_name, v1.d_year, v1.d_moy, v1.avg_monthly_sales, v1.sum_sales, v1_lag.sum_sales AS psum, v1_lead.sum_sales AS nsum FROM v1, v1 AS v1_lag, v1 AS v1_lead WHERE (v1.i_category = v1_lag.i_category) AND (v1.i_category = v1_lead.i_category) AND (v1.i_brand = v1_lag.i_brand) AND (v1.i_brand = v1_lead.i_brand) AND (v1.s_store_name = v1_lag.s_store_name) AND (v1.s_store_name = v1_lead.s_store_name) AND (v1.s_company_name = v1_lag.s_company_name) AND (v1.s_company_name = v1_lead.s_company_name) AND (v1.rn = v1_lag.rn + 1) AND (v1.rn = v1_lead.rn - 1) ) SELECT * FROM v2 WHERE (v1.d_year = 1999) AND (v1.avg_monthly_sales > 0) AND (CASE WHEN v1.avg_monthly_sales > 0 THEN abs(v1.sum_sales - v1.avg_monthly_sales) / v1.avg_monthly_sales ELSE NULL END > 0.1) ORDER BY v1.sum_sales - v1.avg_monthly_sales, v1.s_store_name LIMIT 100", + "SELECT sum(ss_quantity) FROM store_sales, store, customer_demographics, customer_address, date_dim WHERE (s_store_sk = ss_store_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 2000) AND ( ( (cd_demo_sk = ss_cdemo_sk) AND (cd_marital_status = 'M') AND (cd_education_status = '4 yr Degree') AND (ss_sales_price BETWEEN 100.00 AND 150.00) ) OR ( (cd_demo_sk = ss_cdemo_sk) AND (cd_marital_status = 'D') AND (cd_education_status = '2 yr Degree') AND (ss_sales_price BETWEEN 50.00 AND 100.00) ) OR ( (cd_demo_sk = ss_cdemo_sk) AND (cd_marital_status = 'S') AND (cd_education_status = 'College') AND (ss_sales_price BETWEEN 150.00 AND 200.00) ) ) AND ( ( (ss_addr_sk = ca_address_sk) AND (ca_country = 'United States') AND (ca_state IN ('CO', 'OH', 'TX')) AND (ss_net_profit BETWEEN 0 AND 2000) ) OR ( (ss_addr_sk = ca_address_sk) AND (ca_country = 'United States') AND (ca_state IN ('OR', 'MN', 'KY')) AND (ss_net_profit BETWEEN 150 AND 3000) ) OR ( (ss_addr_sk = ca_address_sk) AND (ca_country = 'United States') AND (ca_state IN ('VA', 'CA', 'MS')) AND (ss_net_profit BETWEEN 50 AND 25000) ) )", + "SELECT channel, item, return_ratio, return_rank, currency_rank FROM ( SELECT 'web' AS channel, web.item, web.return_ratio, web.return_rank, web.currency_rank FROM ( SELECT item, return_ratio, currency_ratio, rank() OVER (ORDER BY return_ratio) AS return_rank, rank() OVER (ORDER BY currency_ratio) AS currency_rank FROM ( SELECT ws.ws_item_sk AS item, (CAST(sum(coalesce(wr.wr_return_quantity, 0)) AS decimal(15, 4)) / CAST(sum(coalesce(ws.ws_quantity, 0)) AS decimal(15, 4))) AS return_ratio, (CAST(sum(coalesce(wr.wr_return_amt, 0)) AS decimal(15, 4)) / CAST(sum(coalesce(ws.ws_net_paid, 0)) AS decimal(15, 4))) AS currency_ratio FROM web_sales AS ws LEFT OUTER JOIN web_returns AS wr ON (ws.ws_order_number = wr.wr_order_number) AND (ws.ws_item_sk = wr.wr_item_sk), date_dim WHERE (wr.wr_return_amt > 10000) AND (ws.ws_net_profit > 1) AND (ws.ws_net_paid > 0) AND (ws.ws_quantity > 0) AND (ws_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy = 12) GROUP BY ws.ws_item_sk ) AS in_web ) AS web WHERE (web.return_rank <= 10) OR (web.currency_rank <= 10) UNION SELECT 'catalog' AS channel, catalog.item, catalog.return_ratio, catalog.return_rank, catalog.currency_rank FROM ( SELECT item, return_ratio, currency_ratio, rank() OVER (ORDER BY return_ratio) AS return_rank, rank() OVER (ORDER BY currency_ratio) AS currency_rank FROM ( SELECT cs.cs_item_sk AS item, (CAST(sum(coalesce(cr.cr_return_quantity, 0)) AS decimal(15, 4)) / CAST(sum(coalesce(cs.cs_quantity, 0)) AS decimal(15, 4))) AS return_ratio, (CAST(sum(coalesce(cr.cr_return_amount, 0)) AS decimal(15, 4)) / CAST(sum(coalesce(cs.cs_net_paid, 0)) AS decimal(15, 4))) AS currency_ratio FROM catalog_sales AS cs LEFT OUTER JOIN catalog_returns AS cr ON (cs.cs_order_number = cr.cr_order_number) AND (cs.cs_item_sk = cr.cr_item_sk), date_dim WHERE (cr.cr_return_amount > 10000) AND (cs.cs_net_profit > 1) AND (cs.cs_net_paid > 0) AND (cs.cs_quantity > 0) AND (cs_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy = 12) GROUP BY cs.cs_item_sk ) AS in_cat ) AS catalog WHERE (catalog.return_rank <= 10) OR (catalog.currency_rank <= 10) UNION SELECT 'store' AS channel, store.item, store.return_ratio, store.return_rank, store.currency_rank FROM ( SELECT item, return_ratio, currency_ratio, rank() OVER (ORDER BY return_ratio) AS return_rank, rank() OVER (ORDER BY currency_ratio) AS currency_rank FROM ( SELECT sts.ss_item_sk AS item, (CAST(sum(coalesce(sr.sr_return_quantity, 0)) AS decimal(15, 4)) / CAST(sum(coalesce(sts.ss_quantity, 0)) AS decimal(15, 4))) AS return_ratio, (CAST(sum(coalesce(sr.sr_return_amt, 0)) AS decimal(15, 4)) / CAST(sum(coalesce(sts.ss_net_paid, 0)) AS decimal(15, 4))) AS currency_ratio FROM store_sales AS sts LEFT OUTER JOIN store_returns AS sr ON (sts.ss_ticket_number = sr.sr_ticket_number) AND (sts.ss_item_sk = sr.sr_item_sk), date_dim WHERE (sr.sr_return_amt > 10000) AND (sts.ss_net_profit > 1) AND (sts.ss_net_paid > 0) AND (sts.ss_quantity > 0) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy = 12) GROUP BY sts.ss_item_sk ) AS in_store ) AS store WHERE (store.return_rank <= 10) OR (store.currency_rank <= 10) ) ORDER BY 1, 4, 5, 2 LIMIT 100", + "SELECT s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip, sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk <= 30) THEN 1 ELSE 0 END) AS \"30 days\", sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 30) AND (sr_returned_date_sk - ss_sold_date_sk <= 60) THEN 1 ELSE 0 END) AS \"31-60 days\", sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 60) AND (sr_returned_date_sk - ss_sold_date_sk <= 90) THEN 1 ELSE 0 END) AS \"61-90 days\", sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 90) AND (sr_returned_date_sk - ss_sold_date_sk <= 120) THEN 1 ELSE 0 END) AS \"91-120 days\", sum(CASE WHEN (sr_returned_date_sk - ss_sold_date_sk > 120) THEN 1 ELSE 0 END) AS \">120 days\" FROM store_sales, store_returns, store, date_dim AS d1, date_dim AS d2 WHERE (d2.d_year = 2001) AND (d2.d_moy = 8) AND (ss_ticket_number = sr_ticket_number) AND (ss_item_sk = sr_item_sk) AND (ss_sold_date_sk = d1.d_date_sk) AND (sr_returned_date_sk = d2.d_date_sk) AND (ss_customer_sk = sr_customer_sk) AND (ss_store_sk = s_store_sk) GROUP BY s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip ORDER BY s_store_name, s_company_id, s_street_number, s_street_name, s_street_type, s_suite_number, s_city, s_county, s_state, s_zip LIMIT 100", + "WITH web_v1 AS ( SELECT ws_item_sk AS item_sk, d_date, sum(sum(ws_sales_price)) OVER (PARTITION BY ws_item_sk ORDER BY d_date ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW) AS cume_sales FROM web_sales, date_dim WHERE (ws_sold_date_sk = d_date_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) AND (ws_item_sk IS NOT NULL) GROUP BY ws_item_sk, d_date ), store_v1 AS ( SELECT ss_item_sk AS item_sk, d_date, sum(sum(ss_sales_price)) OVER (PARTITION BY ss_item_sk ORDER BY d_date ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW) AS cume_sales FROM store_sales, date_dim WHERE (ss_sold_date_sk = d_date_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) AND (ss_item_sk IS NOT NULL) GROUP BY ss_item_sk, d_date ) SELECT * FROM ( SELECT item_sk, d_date, web_sales, store_sales, max(web_sales) OVER (PARTITION BY item_sk ORDER BY d_date ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW) AS web_cumulative, max(store_sales) OVER (PARTITION BY item_sk ORDER BY d_date ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW) AS store_cumulative FROM ( SELECT CASE WHEN web.item_sk IS NOT NULL THEN web.item_sk ELSE store.item_sk END AS item_sk, CASE WHEN web.d_date IS NOT NULL THEN web.d_date ELSE store.d_date END AS d_date, web.cume_sales AS web_sales, store.cume_sales AS store_sales FROM web_v1 AS web FULL OUTER JOIN store_v1 AS store ON (web.item_sk = store.item_sk) AND (web.d_date = store.d_date) ) AS x ) AS y WHERE (web_cumulative > store_cumulative) ORDER BY item_sk, d_date LIMIT 100", + "SELECT dt.d_year, item.i_brand_id AS brand_id, item.i_brand AS brand, sum(ss_ext_sales_price) AS ext_price FROM date_dim AS dt, store_sales, item WHERE (dt.d_date_sk = store_sales.ss_sold_date_sk) AND (store_sales.ss_item_sk = item.i_item_sk) AND (item.i_manager_id = 1) AND (dt.d_moy = 11) AND (dt.d_year = 2000) GROUP BY dt.d_year, item.i_brand, item.i_brand_id ORDER BY dt.d_year, ext_price DESC, brand_id LIMIT 100", + "SELECT * FROM ( SELECT i_manufact_id, sum(ss_sales_price) AS sum_sales, avg(sum(ss_sales_price)) OVER (PARTITION BY i_manufact_id) AS avg_quarterly_sales FROM item, store_sales, date_dim, store WHERE (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (ss_store_sk = s_store_sk) AND (d_month_seq IN (1200, 1200 + 1, 1200 + 2, 1200 + 3, 1200 + 4, 1200 + 5, 1200 + 6, 1200 + 7, 1200 + 8, 1200 + 9, 1200 + 10, 1200 + 11)) AND ( ( (i_category IN ('Books', 'Children', 'Electronics')) AND (i_class IN ('personal', 'portable', 'reference', 'self-help')) AND (i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) ) OR ( (i_category IN ('Women', 'Music', 'Men')) AND (i_class IN ('accessories', 'classical', 'fragrances', 'pants')) AND (i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')) ) ) GROUP BY i_manufact_id, d_qoy ) AS tmp1 WHERE (CASE WHEN avg_quarterly_sales > 0 THEN abs(sum_sales - avg_quarterly_sales) / avg_quarterly_sales ELSE NULL END > 0.1) ORDER BY avg_quarterly_sales, sum_sales, i_manufact_id LIMIT 100", + "WITH my_customers AS ( SELECT DISTINCT c_customer_sk, c_current_addr_sk FROM ( SELECT cs_sold_date_sk AS sold_date_sk, cs_bill_customer_sk AS customer_sk, cs_item_sk AS item_sk FROM catalog_sales UNION ALL SELECT ws_sold_date_sk AS sold_date_sk, ws_bill_customer_sk AS customer_sk, ws_item_sk AS item_sk FROM web_sales ) AS cs_or_ws_sales, item, date_dim, customer WHERE (sold_date_sk = d_date_sk) AND (item_sk = i_item_sk) AND (i_category = 'Women') AND (i_class = 'maternity') AND (c_customer_sk = cs_or_ws_sales.customer_sk) AND (d_moy = 12) AND (d_year = 1998) ), my_revenue AS ( SELECT c_customer_sk, sum(ss_ext_sales_price) AS revenue FROM my_customers, store_sales, customer_address, store, date_dim WHERE (c_current_addr_sk = ca_address_sk) AND (ca_county = s_county) AND (ca_state = s_state) AND (ss_sold_date_sk = d_date_sk) AND (c_customer_sk = ss_customer_sk) AND (d_month_seq BETWEEN ( SELECT DISTINCT d_month_seq + 1 FROM date_dim WHERE (d_year = 1998) AND (d_moy = 12) ) AND ( SELECT DISTINCT d_month_seq + 3 FROM date_dim WHERE (d_year = 1998) AND (d_moy = 12) )) GROUP BY c_customer_sk ), segments AS ( SELECT CAST((revenue / 50) AS int) AS segment FROM my_revenue ) SELECT segment, count(*) AS num_customers, segment * 50 AS segment_base FROM segments GROUP BY segment ORDER BY segment, num_customers LIMIT 100", + "SELECT i_brand_id AS brand_id, i_brand AS brand, sum(ss_ext_sales_price) AS ext_price FROM date_dim, store_sales, item WHERE (d_date_sk = ss_sold_date_sk) AND (ss_item_sk = i_item_sk) AND (i_manager_id = 28) AND (d_moy = 11) AND (d_year = 1999) GROUP BY i_brand, i_brand_id ORDER BY ext_price DESC, i_brand_id LIMIT 100", + "WITH ss AS ( SELECT i_item_id, sum(ss_ext_sales_price) AS total_sales FROM store_sales, date_dim, customer_address, item WHERE (i_item_id IN ( SELECT i_item_id FROM item WHERE (i_color IN ('slate', 'blanched', 'burnished')) )) AND (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy = 2) AND (ss_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_item_id ), cs AS ( SELECT i_item_id, sum(cs_ext_sales_price) AS total_sales FROM catalog_sales, date_dim, customer_address, item WHERE (i_item_id IN ( SELECT i_item_id FROM item WHERE (i_color IN ('slate', 'blanched', 'burnished')) )) AND (cs_item_sk = i_item_sk) AND (cs_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy = 2) AND (cs_bill_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_item_id ), ws AS ( SELECT i_item_id, sum(ws_ext_sales_price) AS total_sales FROM web_sales, date_dim, customer_address, item WHERE (i_item_id IN ( SELECT i_item_id FROM item WHERE (i_color IN ('slate', 'blanched', 'burnished')) )) AND (ws_item_sk = i_item_sk) AND (ws_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy = 2) AND (ws_bill_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_item_id ) SELECT i_item_id, sum(total_sales) AS total_sales FROM ( SELECT * FROM ss UNION ALL SELECT * FROM cs UNION ALL SELECT * FROM ws ) AS tmp1 GROUP BY i_item_id ORDER BY total_sales, i_item_id LIMIT 100", + "WITH v1 AS ( SELECT i_category, i_brand, cc_name, d_year, d_moy, sum(cs_sales_price) AS sum_sales, avg(sum(cs_sales_price)) OVER (PARTITION BY i_category, i_brand, cc_name, d_year) AS avg_monthly_sales, rank() OVER (PARTITION BY i_category, i_brand, cc_name ORDER BY d_year, d_moy) AS rn FROM item, catalog_sales, date_dim, call_center WHERE (cs_item_sk = i_item_sk) AND (cs_sold_date_sk = d_date_sk) AND (cc_call_center_sk = cs_call_center_sk) AND ( (d_year = 1999) OR ((d_year = 1999 - 1) AND (d_moy = 12)) OR ((d_year = 1999 + 1) AND (d_moy = 1)) ) GROUP BY i_category, i_brand, cc_name, d_year, d_moy ), v2 AS ( SELECT v1.i_category, v1.i_brand, v1.cc_name, v1.d_year, v1.d_moy, v1.avg_monthly_sales, v1.sum_sales, v1_lag.sum_sales AS psum, v1_lead.sum_sales AS nsum FROM v1, v1 AS v1_lag, v1 AS v1_lead WHERE (v1.i_category = v1_lag.i_category) AND (v1.i_category = v1_lead.i_category) AND (v1.i_brand = v1_lag.i_brand) AND (v1.i_brand = v1_lead.i_brand) AND (v1.cc_name = v1_lag.cc_name) AND (v1.cc_name = v1_lead.cc_name) AND (v1.rn = v1_lag.rn + 1) AND (v1.rn = v1_lead.rn - 1) ) SELECT * FROM v2 WHERE (v1.d_year = 1999) AND (v1.avg_monthly_sales > 0) AND (CASE WHEN v1.avg_monthly_sales > 0 THEN abs(v1.sum_sales - v1.avg_monthly_sales) / v1.avg_monthly_sales ELSE NULL END > 0.1) ORDER BY v1.sum_sales - v1.avg_monthly_sales, v1.cc_name LIMIT 100", + "WITH ss_items AS ( SELECT i_item_id AS item_id, sum(ss_ext_sales_price) AS ss_item_rev FROM store_sales, item, date_dim WHERE (ss_item_sk = i_item_sk) AND (d_date IN ( SELECT d_date FROM date_dim WHERE (d_week_seq = ( SELECT d_week_seq FROM date_dim WHERE (d_date = '2000-01-03') )) )) AND (ss_sold_date_sk = d_date_sk) GROUP BY i_item_id ), cs_items AS ( SELECT i_item_id AS item_id, sum(cs_ext_sales_price) AS cs_item_rev FROM catalog_sales, item, date_dim WHERE (cs_item_sk = i_item_sk) AND (d_date IN ( SELECT d_date FROM date_dim WHERE (d_week_seq = ( SELECT d_week_seq FROM date_dim WHERE (d_date = '2000-01-03') )) )) AND (cs_sold_date_sk = d_date_sk) GROUP BY i_item_id ), ws_items AS ( SELECT i_item_id AS item_id, sum(ws_ext_sales_price) AS ws_item_rev FROM web_sales, item, date_dim WHERE (ws_item_sk = i_item_sk) AND (d_date IN ( SELECT d_date FROM date_dim WHERE (d_week_seq = ( SELECT d_week_seq FROM date_dim WHERE (d_date = '2000-01-03') )) )) AND (ws_sold_date_sk = d_date_sk) GROUP BY i_item_id ) SELECT ss_items.item_id, ss_item_rev, ss_item_rev / ((CAST(ss_item_rev AS Float64) + cs_item_rev + ws_item_rev) / 3) * 100 AS ss_dev, cs_item_rev, cs_item_rev / ((CAST(ss_item_rev AS Float64) + cs_item_rev + ws_item_rev) / 3) * 100 AS cs_dev, ws_item_rev, ws_item_rev / ((CAST(ss_item_rev AS Float64) + cs_item_rev + ws_item_rev) / 3) * 100 AS ws_dev, (ss_item_rev + cs_item_rev + ws_item_rev) / 3 AS average FROM ss_items, cs_items, ws_items WHERE (ss_items.item_id = cs_items.item_id) AND (ss_items.item_id = ws_items.item_id) AND (ss_item_rev BETWEEN 0.9 * cs_item_rev AND 1.1 * cs_item_rev) AND (ss_item_rev BETWEEN 0.9 * ws_item_rev AND 1.1 * ws_item_rev) AND (cs_item_rev BETWEEN 0.9 * ss_item_rev AND 1.1 * ss_item_rev) AND (cs_item_rev BETWEEN 0.9 * ws_item_rev AND 1.1 * ws_item_rev) AND (ws_item_rev BETWEEN 0.9 * ss_item_rev AND 1.1 * ss_item_rev) AND (ws_item_rev BETWEEN 0.9 * cs_item_rev AND 1.1 * cs_item_rev) ORDER BY ss_items.item_id, ss_item_rev LIMIT 100", + "WITH wss AS ( SELECT d_week_seq, ss_store_sk, sum(CASE WHEN (d_day_name = 'Sunday') THEN ss_sales_price ELSE NULL END) AS sun_sales, sum(CASE WHEN (d_day_name = 'Monday') THEN ss_sales_price ELSE NULL END) AS mon_sales, sum(CASE WHEN (d_day_name = 'Tuesday') THEN ss_sales_price ELSE NULL END) AS tue_sales, sum(CASE WHEN (d_day_name = 'Wednesday') THEN ss_sales_price ELSE NULL END) AS wed_sales, sum(CASE WHEN (d_day_name = 'Thursday') THEN ss_sales_price ELSE NULL END) AS thu_sales, sum(CASE WHEN (d_day_name = 'Friday') THEN ss_sales_price ELSE NULL END) AS fri_sales, sum(CASE WHEN (d_day_name = 'Saturday') THEN ss_sales_price ELSE NULL END) AS sat_sales FROM store_sales, date_dim WHERE (d_date_sk = ss_sold_date_sk) GROUP BY d_week_seq, ss_store_sk ) SELECT s_store_name1, s_store_id1, d_week_seq1, sun_sales1 / sun_sales2, mon_sales1 / mon_sales2, tue_sales1 / tue_sales2, wed_sales1 / wed_sales2, thu_sales1 / thu_sales2, fri_sales1 / fri_sales2, sat_sales1 / sat_sales2 FROM ( SELECT s_store_name AS s_store_name1, wss.d_week_seq AS d_week_seq1, s_store_id AS s_store_id1, sun_sales AS sun_sales1, mon_sales AS mon_sales1, tue_sales AS tue_sales1, wed_sales AS wed_sales1, thu_sales AS thu_sales1, fri_sales AS fri_sales1, sat_sales AS sat_sales1 FROM wss, store, date_dim AS d WHERE (d.d_week_seq = wss.d_week_seq) AND (ss_store_sk = s_store_sk) AND (d_month_seq BETWEEN 1212 AND 1212 + 11) ) AS y, ( SELECT s_store_name AS s_store_name2, wss.d_week_seq AS d_week_seq2, s_store_id AS s_store_id2, sun_sales AS sun_sales2, mon_sales AS mon_sales2, tue_sales AS tue_sales2, wed_sales AS wed_sales2, thu_sales AS thu_sales2, fri_sales AS fri_sales2, sat_sales AS sat_sales2 FROM wss, store, date_dim AS d WHERE (d.d_week_seq = wss.d_week_seq) AND (ss_store_sk = s_store_sk) AND (d_month_seq BETWEEN 1212 + 12 AND 1212 + 23) ) AS x WHERE (s_store_id1 = s_store_id2) AND (d_week_seq1 = d_week_seq2 - 52) ORDER BY s_store_name1, s_store_id1, d_week_seq1 LIMIT 100", + "WITH ss AS ( SELECT i_item_id, sum(ss_ext_sales_price) AS total_sales FROM store_sales, date_dim, customer_address, item WHERE (i_item_id IN ( SELECT i_item_id FROM item WHERE (i_category IN ('Music')) )) AND (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 1998) AND (d_moy = 9) AND (ss_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_item_id ), cs AS ( SELECT i_item_id, sum(cs_ext_sales_price) AS total_sales FROM catalog_sales, date_dim, customer_address, item WHERE (i_item_id IN ( SELECT i_item_id FROM item WHERE (i_category IN ('Music')) )) AND (cs_item_sk = i_item_sk) AND (cs_sold_date_sk = d_date_sk) AND (d_year = 1998) AND (d_moy = 9) AND (cs_bill_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_item_id ), ws AS ( SELECT i_item_id, sum(ws_ext_sales_price) AS total_sales FROM web_sales, date_dim, customer_address, item WHERE (i_item_id IN ( SELECT i_item_id FROM item WHERE (i_category IN ('Music')) )) AND (ws_item_sk = i_item_sk) AND (ws_sold_date_sk = d_date_sk) AND (d_year = 1998) AND (d_moy = 9) AND (ws_bill_addr_sk = ca_address_sk) AND (ca_gmt_offset = -5) GROUP BY i_item_id ) SELECT i_item_id, sum(total_sales) AS total_sales FROM ( SELECT * FROM ss UNION ALL SELECT * FROM cs UNION ALL SELECT * FROM ws ) AS tmp1 GROUP BY i_item_id ORDER BY i_item_id, total_sales LIMIT 100", + "SELECT promotions, total, CAST(promotions AS decimal(15, 4)) / CAST(total AS decimal(15, 4)) * 100 FROM ( SELECT sum(ss_ext_sales_price) AS promotions FROM store_sales, store, promotion, date_dim, customer, customer_address, item WHERE (ss_sold_date_sk = d_date_sk) AND (ss_store_sk = s_store_sk) AND (ss_promo_sk = p_promo_sk) AND (ss_customer_sk = c_customer_sk) AND (ca_address_sk = c_current_addr_sk) AND (ss_item_sk = i_item_sk) AND (ca_gmt_offset = -5) AND (i_category = 'Jewelry') AND ((p_channel_dmail = 'Y') OR (p_channel_email = 'Y') OR (p_channel_tv = 'Y')) AND (s_gmt_offset = -5) AND (d_year = 1998) AND (d_moy = 11) ) AS promotional_sales, ( SELECT sum(ss_ext_sales_price) AS total FROM store_sales, store, date_dim, customer, customer_address, item WHERE (ss_sold_date_sk = d_date_sk) AND (ss_store_sk = s_store_sk) AND (ss_customer_sk = c_customer_sk) AND (ca_address_sk = c_current_addr_sk) AND (ss_item_sk = i_item_sk) AND (ca_gmt_offset = -5) AND (i_category = 'Jewelry') AND (s_gmt_offset = -5) AND (d_year = 1998) AND (d_moy = 11) ) AS all_sales ORDER BY promotions, total LIMIT 100", + "SELECT substr(w_warehouse_name, 1, 20), sm_type, web_name, sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk <= 30) THEN 1 ELSE 0 END) AS \"30 days\", sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 30) AND (ws_ship_date_sk - ws_sold_date_sk <= 60) THEN 1 ELSE 0 END) AS \"31-60 days\", sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 60) AND (ws_ship_date_sk - ws_sold_date_sk <= 90) THEN 1 ELSE 0 END) AS \"61-90 days\", sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 90) AND (ws_ship_date_sk - ws_sold_date_sk <= 120) THEN 1 ELSE 0 END) AS \"91-120 days\", sum(CASE WHEN (ws_ship_date_sk - ws_sold_date_sk > 120) THEN 1 ELSE 0 END) AS \">120 days\" FROM web_sales, warehouse, ship_mode, web_site, date_dim WHERE (d_month_seq BETWEEN 1200 AND 1200 + 11) AND (ws_ship_date_sk = d_date_sk) AND (ws_warehouse_sk = w_warehouse_sk) AND (ws_ship_mode_sk = sm_ship_mode_sk) AND (ws_web_site_sk = web_site_sk) GROUP BY substr(w_warehouse_name, 1, 20), sm_type, web_name ORDER BY substr(w_warehouse_name, 1, 20), sm_type, web_name LIMIT 100", + "SELECT * FROM ( SELECT i_manager_id, sum(ss_sales_price) AS sum_sales, avg(sum(ss_sales_price)) OVER (PARTITION BY i_manager_id) AS avg_monthly_sales FROM item, store_sales, date_dim, store WHERE (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (ss_store_sk = s_store_sk) AND (d_month_seq IN (1200, 1200 + 1, 1200 + 2, 1200 + 3, 1200 + 4, 1200 + 5, 1200 + 6, 1200 + 7, 1200 + 8, 1200 + 9, 1200 + 10, 1200 + 11)) AND ( ( (i_category IN ('Books', 'Children', 'Electronics')) AND (i_class IN ('personal', 'portable', 'reference', 'self-help')) AND (i_brand IN ('scholaramalgamalg #14', 'scholaramalgamalg #7', 'exportiunivamalg #9', 'scholaramalgamalg #9')) ) OR ( (i_category IN ('Women', 'Music', 'Men')) AND (i_class IN ('accessories', 'classical', 'fragrances', 'pants')) AND (i_brand IN ('amalgimporto #1', 'edu packscholar #1', 'exportiimporto #1', 'importoamalg #1')) ) ) GROUP BY i_manager_id, d_moy ) AS tmp1 WHERE (CASE WHEN avg_monthly_sales > 0 THEN abs(sum_sales - avg_monthly_sales) / avg_monthly_sales ELSE NULL END > 0.1) ORDER BY i_manager_id, avg_monthly_sales, sum_sales LIMIT 100", + "WITH cs_ui AS ( SELECT cs_item_sk, sum(cs_ext_list_price) AS sale, sum((cr_refunded_cash + cr_reversed_charge) + cr_store_credit) AS refund FROM catalog_sales, catalog_returns WHERE (cs_item_sk = cr_item_sk) AND (cs_order_number = cr_order_number) GROUP BY cs_item_sk HAVING sum(cs_ext_list_price) > (2 * sum((cr_refunded_cash + cr_reversed_charge) + cr_store_credit)) ), cross_sales AS ( SELECT i_product_name AS product_name, i_item_sk AS item_sk, s_store_name AS store_name, s_zip AS store_zip, ad1.ca_street_number AS b_street_number, ad1.ca_street_name AS b_street_name, ad1.ca_city AS b_city, ad1.ca_zip AS b_zip, ad2.ca_street_number AS c_street_number, ad2.ca_street_name AS c_street_name, ad2.ca_city AS c_city, ad2.ca_zip AS c_zip, d1.d_year AS syear, d2.d_year AS fsyear, d3.d_year AS s2year, count(*) AS cnt, sum(ss_wholesale_cost) AS s1, sum(ss_list_price) AS s2, sum(ss_coupon_amt) AS s3 FROM store_sales, store_returns, cs_ui, date_dim AS d1, date_dim AS d2, date_dim AS d3, store, customer, customer_demographics AS cd1, customer_demographics AS cd2, promotion, household_demographics AS hd1, household_demographics AS hd2, customer_address AS ad1, customer_address AS ad2, income_band AS ib1, income_band AS ib2, item WHERE (ss_store_sk = s_store_sk) AND (ss_sold_date_sk = d1.d_date_sk) AND (ss_customer_sk = c_customer_sk) AND (ss_cdemo_sk = cd1.cd_demo_sk) AND (ss_hdemo_sk = hd1.hd_demo_sk) AND (ss_addr_sk = ad1.ca_address_sk) AND (ss_item_sk = i_item_sk) AND (ss_item_sk = sr_item_sk) AND (ss_ticket_number = sr_ticket_number) AND (ss_item_sk = cs_ui.cs_item_sk) AND (c_current_cdemo_sk = cd2.cd_demo_sk) AND (c_current_hdemo_sk = hd2.hd_demo_sk) AND (c_current_addr_sk = ad2.ca_address_sk) AND (c_first_sales_date_sk = d2.d_date_sk) AND (c_first_shipto_date_sk = d3.d_date_sk) AND (ss_promo_sk = p_promo_sk) AND (hd1.hd_income_band_sk = ib1.ib_income_band_sk) AND (hd2.hd_income_band_sk = ib2.ib_income_band_sk) AND (cd1.cd_marital_status != cd2.cd_marital_status) AND (i_color IN ('purple', 'burlywood', 'indian', 'spring', 'floral', 'medium')) AND ((i_current_price >= 64) AND (i_current_price <= (64 + 10))) AND ((i_current_price >= (64 + 1)) AND (i_current_price <= (64 + 15))) GROUP BY i_product_name, i_item_sk, s_store_name, s_zip, ad1.ca_street_number, ad1.ca_street_name, ad1.ca_city, ad1.ca_zip, ad2.ca_street_number, ad2.ca_street_name, ad2.ca_city, ad2.ca_zip, d1.d_year, d2.d_year, d3.d_year ) SELECT cs1.product_name, cs1.store_name, cs1.store_zip, cs1.b_street_number, cs1.b_street_name, cs1.b_city, cs1.b_zip, cs1.c_street_number, cs1.c_street_name, cs1.c_city, cs1.c_zip, cs1.syear, cs1.cnt, cs1.s1 AS s11, cs1.s2 AS s21, cs1.s3 AS s31, cs2.s1 AS s12, cs2.s2 AS s22, cs2.s3 AS s32, cs2.syear, cs2.cnt FROM cross_sales AS cs1, cross_sales AS cs2 WHERE (cs1.item_sk = cs2.item_sk) AND (cs1.syear = 1999) AND (cs2.syear = (1999 + 1)) AND (cs2.cnt <= cs1.cnt) AND (cs1.store_name = cs2.store_name) AND (cs1.store_zip = cs2.store_zip) ORDER BY cs1.product_name, cs1.store_name, cs2.cnt, cs1.s1, cs2.s1", + "SELECT s_store_name, i_item_desc, sc.revenue, i_current_price, i_wholesale_cost, i_brand FROM store, item, ( SELECT ss_store_sk, avg(revenue) AS ave FROM ( SELECT ss_store_sk, ss_item_sk, sum(ss_sales_price) AS revenue FROM store_sales, date_dim WHERE ss_sold_date_sk = d_date_sk AND d_month_seq BETWEEN 1176 AND 1176+11 GROUP BY ss_store_sk, ss_item_sk ) AS sa GROUP BY ss_store_sk ) AS sb, ( SELECT ss_store_sk, ss_item_sk, sum(ss_sales_price) AS revenue FROM store_sales, date_dim WHERE ss_sold_date_sk = d_date_sk AND d_month_seq BETWEEN 1176 AND 1176+11 GROUP BY ss_store_sk, ss_item_sk ) AS sc WHERE (sb.ss_store_sk = sc.ss_store_sk) AND (sc.revenue <= (0.1 * sb.ave)) AND (s_store_sk = sc.ss_store_sk) AND (i_item_sk = sc.ss_item_sk) ORDER BY s_store_name, i_item_desc LIMIT 100", + "SELECT w_warehouse_name, w_warehouse_sq_ft, w_city, w_county, w_state, w_country, ship_carriers, year, sum(x.jan_sales) AS jan_sales, sum(x.feb_sales) AS feb_sales, sum(x.mar_sales) AS mar_sales, sum(x.apr_sales) AS apr_sales, sum(x.may_sales) AS may_sales, sum(x.jun_sales) AS jun_sales, sum(x.jul_sales) AS jul_sales, sum(x.aug_sales) AS aug_sales, sum(x.sep_sales) AS sep_sales, sum(x.oct_sales) AS oct_sales, sum(x.nov_sales) AS nov_sales, sum(x.dec_sales) AS dec_sales, sum(CAST(x.jan_sales AS Float64) / w_warehouse_sq_ft) AS jan_sales_per_sq_foot, sum(CAST(x.feb_sales AS Float64) / w_warehouse_sq_ft) AS feb_sales_per_sq_foot, sum(CAST(x.mar_sales AS Float64) / w_warehouse_sq_ft) AS mar_sales_per_sq_foot, sum(CAST(x.apr_sales AS Float64) / w_warehouse_sq_ft) AS apr_sales_per_sq_foot, sum(CAST(x.may_sales AS Float64) / w_warehouse_sq_ft) AS may_sales_per_sq_foot, sum(CAST(x.jun_sales AS Float64) / w_warehouse_sq_ft) AS jun_sales_per_sq_foot, sum(CAST(x.jul_sales AS Float64) / w_warehouse_sq_ft) AS jul_sales_per_sq_foot, sum(CAST(x.aug_sales AS Float64) / w_warehouse_sq_ft) AS aug_sales_per_sq_foot, sum(CAST(x.sep_sales AS Float64) / w_warehouse_sq_ft) AS sep_sales_per_sq_foot, sum(CAST(x.oct_sales AS Float64) / w_warehouse_sq_ft) AS oct_sales_per_sq_foot, sum(CAST(x.nov_sales AS Float64) / w_warehouse_sq_ft) AS nov_sales_per_sq_foot, sum(CAST(x.dec_sales AS Float64) / w_warehouse_sq_ft) AS dec_sales_per_sq_foot, sum(x.jan_net) AS jan_net, sum(x.feb_net) AS feb_net, sum(x.mar_net) AS mar_net, sum(x.apr_net) AS apr_net, sum(x.may_net) AS may_net, sum(x.jun_net) AS jun_net, sum(x.jul_net) AS jul_net, sum(x.aug_net) AS aug_net, sum(x.sep_net) AS sep_net, sum(x.oct_net) AS oct_net, sum(x.nov_net) AS nov_net, sum(x.dec_net) AS dec_net FROM ( SELECT w_warehouse_name, w_warehouse_sq_ft, w_city, w_county, w_state, w_country, concat('DHL', ',', 'BARIAN') AS ship_carriers, d_year AS year, sum(multiIf(d_moy = 1, ws_ext_sales_price * ws_quantity, 0)) AS jan_sales, sum(multiIf(d_moy = 2, ws_ext_sales_price * ws_quantity, 0)) AS feb_sales, sum(multiIf(d_moy = 3, ws_ext_sales_price * ws_quantity, 0)) AS mar_sales, sum(multiIf(d_moy = 4, ws_ext_sales_price * ws_quantity, 0)) AS apr_sales, sum(multiIf(d_moy = 5, ws_ext_sales_price * ws_quantity, 0)) AS may_sales, sum(multiIf(d_moy = 6, ws_ext_sales_price * ws_quantity, 0)) AS jun_sales, sum(multiIf(d_moy = 7, ws_ext_sales_price * ws_quantity, 0)) AS jul_sales, sum(multiIf(d_moy = 8, ws_ext_sales_price * ws_quantity, 0)) AS aug_sales, sum(multiIf(d_moy = 9, ws_ext_sales_price * ws_quantity, 0)) AS sep_sales, sum(multiIf(d_moy = 10, ws_ext_sales_price * ws_quantity, 0)) AS oct_sales, sum(multiIf(d_moy = 11, ws_ext_sales_price * ws_quantity, 0)) AS nov_sales, sum(multiIf(d_moy = 12, ws_ext_sales_price * ws_quantity, 0)) AS dec_sales, sum(multiIf(d_moy = 1, ws_net_paid * ws_quantity, 0)) AS jan_net, sum(multiIf(d_moy = 2, ws_net_paid * ws_quantity, 0)) AS feb_net, sum(multiIf(d_moy = 3, ws_net_paid * ws_quantity, 0)) AS mar_net, sum(multiIf(d_moy = 4, ws_net_paid * ws_quantity, 0)) AS apr_net, sum(multiIf(d_moy = 5, ws_net_paid * ws_quantity, 0)) AS may_net, sum(multiIf(d_moy = 6, ws_net_paid * ws_quantity, 0)) AS jun_net, sum(multiIf(d_moy = 7, ws_net_paid * ws_quantity, 0)) AS jul_net, sum(multiIf(d_moy = 8, ws_net_paid * ws_quantity, 0)) AS aug_net, sum(multiIf(d_moy = 9, ws_net_paid * ws_quantity, 0)) AS sep_net, sum(multiIf(d_moy = 10, ws_net_paid * ws_quantity, 0)) AS oct_net, sum(multiIf(d_moy = 11, ws_net_paid * ws_quantity, 0)) AS nov_net, sum(multiIf(d_moy = 12, ws_net_paid * ws_quantity, 0)) AS dec_net FROM web_sales, warehouse, date_dim, time_dim, ship_mode WHERE (ws_warehouse_sk = w_warehouse_sk) AND (ws_sold_date_sk = d_date_sk) AND (ws_sold_time_sk = t_time_sk) AND (ws_ship_mode_sk = sm_ship_mode_sk) AND (d_year = 2001) AND (t_time BETWEEN 30838 AND 30838 + 28800) AND (sm_carrier IN ('DHL', 'BARIAN')) GROUP BY w_warehouse_name, w_warehouse_sq_ft, w_city, w_county, w_state, w_country, d_year UNION ALL SELECT w_warehouse_name, w_warehouse_sq_ft, w_city, w_county, w_state, w_country, concat('DHL', ',', 'BARIAN') AS ship_carriers, d_year AS year, sum(multiIf(d_moy = 1, cs_sales_price * cs_quantity, 0)) AS jan_sales, sum(multiIf(d_moy = 2, cs_sales_price * cs_quantity, 0)) AS feb_sales, sum(multiIf(d_moy = 3, cs_sales_price * cs_quantity, 0)) AS mar_sales, sum(multiIf(d_moy = 4, cs_sales_price * cs_quantity, 0)) AS apr_sales, sum(multiIf(d_moy = 5, cs_sales_price * cs_quantity, 0)) AS may_sales, sum(multiIf(d_moy = 6, cs_sales_price * cs_quantity, 0)) AS jun_sales, sum(multiIf(d_moy = 7, cs_sales_price * cs_quantity, 0)) AS jul_sales, sum(multiIf(d_moy = 8, cs_sales_price * cs_quantity, 0)) AS aug_sales, sum(multiIf(d_moy = 9, cs_sales_price * cs_quantity, 0)) AS sep_sales, sum(multiIf(d_moy = 10, cs_sales_price * cs_quantity, 0)) AS oct_sales, sum(multiIf(d_moy = 11, cs_sales_price * cs_quantity, 0)) AS nov_sales, sum(multiIf(d_moy = 12, cs_sales_price * cs_quantity, 0)) AS dec_sales, sum(multiIf(d_moy = 1, cs_net_paid_inc_tax * cs_quantity, 0)) AS jan_net, sum(multiIf(d_moy = 2, cs_net_paid_inc_tax * cs_quantity, 0)) AS feb_net, sum(multiIf(d_moy = 3, cs_net_paid_inc_tax * cs_quantity, 0)) AS mar_net, sum(multiIf(d_moy = 4, cs_net_paid_inc_tax * cs_quantity, 0)) AS apr_net, sum(multiIf(d_moy = 5, cs_net_paid_inc_tax * cs_quantity, 0)) AS may_net, sum(multiIf(d_moy = 6, cs_net_paid_inc_tax * cs_quantity, 0)) AS jun_net, sum(multiIf(d_moy = 7, cs_net_paid_inc_tax * cs_quantity, 0)) AS jul_net, sum(multiIf(d_moy = 8, cs_net_paid_inc_tax * cs_quantity, 0)) AS aug_net, sum(multiIf(d_moy = 9, cs_net_paid_inc_tax * cs_quantity, 0)) AS sep_net, sum(multiIf(d_moy = 10, cs_net_paid_inc_tax * cs_quantity, 0)) AS oct_net, sum(multiIf(d_moy = 11, cs_net_paid_inc_tax * cs_quantity, 0)) AS nov_net, sum(multiIf(d_moy = 12, cs_net_paid_inc_tax * cs_quantity, 0)) AS dec_net FROM catalog_sales, warehouse, date_dim, time_dim, ship_mode WHERE (cs_warehouse_sk = w_warehouse_sk) AND (cs_sold_date_sk = d_date_sk) AND (cs_sold_time_sk = t_time_sk) AND (cs_ship_mode_sk = sm_ship_mode_sk) AND (d_year = 2001) AND ((t_time >= 30838) AND (t_time <= (30838 + 28800))) AND (sm_carrier IN ('DHL', 'BARIAN')) GROUP BY w_warehouse_name, w_warehouse_sq_ft, w_city, w_county, w_state, w_country, d_year ) AS x GROUP BY w_warehouse_name, w_warehouse_sq_ft, w_city, w_county, w_state, w_country, ship_carriers, year ORDER BY w_warehouse_name LIMIT 100", + "SELECT * FROM ( SELECT i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id, sumsales, rank() OVER (PARTITION BY i_category ORDER BY sumsales DESC) AS rk FROM ( SELECT i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id, sum(coalesce(ss_sales_price * ss_quantity, 0)) AS sumsales FROM store_sales, date_dim, store, item WHERE (ss_sold_date_sk = d_date_sk) AND (ss_item_sk = i_item_sk) AND (ss_store_sk = s_store_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) GROUP BY i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id WITH ROLLUP ) AS dw1 ) AS dw2 WHERE (rk <= 100) ORDER BY i_category, i_class, i_brand, i_product_name, d_year, d_qoy, d_moy, s_store_id, sumsales, rk LIMIT 100", + "SELECT c_last_name, c_first_name, ca_city, bought_city, ss_ticket_number, extended_price, extended_tax, list_price FROM ( SELECT ss_ticket_number, ss_customer_sk, ca_city AS bought_city, sum(ss_ext_sales_price) AS extended_price, sum(ss_ext_list_price) AS list_price, sum(ss_ext_tax) AS extended_tax FROM store_sales, date_dim, store, household_demographics, customer_address WHERE (store_sales.ss_sold_date_sk = date_dim.d_date_sk) AND (store_sales.ss_store_sk = store.s_store_sk) AND (store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk) AND (store_sales.ss_addr_sk = customer_address.ca_address_sk) AND ((date_dim.d_dom >= 1) AND (date_dim.d_dom <= 2)) AND ((household_demographics.hd_dep_count = 4) OR (household_demographics.hd_vehicle_count = 3)) AND (date_dim.d_year IN (1999, 1999 + 1, 1999 + 2)) AND (store.s_city IN ('Midway', 'Fairview')) GROUP BY ss_ticket_number, ss_customer_sk, ss_addr_sk, ca_city ) AS dn, customer, customer_address AS current_addr WHERE (ss_customer_sk = c_customer_sk) AND (customer.c_current_addr_sk = current_addr.ca_address_sk) AND (current_addr.ca_city != bought_city) ORDER BY c_last_name, ss_ticket_number LIMIT 100", + "SELECT cd_gender, cd_marital_status, cd_education_status, count(*) AS cnt1, cd_purchase_estimate, count(*) AS cnt2, cd_credit_rating, count(*) AS cnt3 FROM customer AS c, customer_address AS ca, customer_demographics WHERE (c.c_current_addr_sk = ca.ca_address_sk) AND (ca_state IN ('KY', 'GA', 'NM')) AND (cd_demo_sk = c.c_current_cdemo_sk) AND EXISTS ( SELECT * FROM store_sales, date_dim WHERE (c.c_customer_sk = ss_customer_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy BETWEEN 4 AND 4 + 2) ) AND ( NOT EXISTS ( SELECT * FROM web_sales, date_dim WHERE (c.c_customer_sk = ws_bill_customer_sk) AND (ws_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy BETWEEN 4 AND 4 + 2) ) AND NOT EXISTS ( SELECT * FROM catalog_sales, date_dim WHERE (c.c_customer_sk = cs_ship_customer_sk) AND (cs_sold_date_sk = d_date_sk) AND (d_year = 2001) AND (d_moy BETWEEN 4 AND 4 + 2) ) ) GROUP BY cd_gender, cd_marital_status, cd_education_status, cd_purchase_estimate, cd_credit_rating ORDER BY cd_gender, cd_marital_status, cd_education_status, cd_purchase_estimate, cd_credit_rating LIMIT 100", + "SELECT sum(ss_net_profit) AS total_sum, s_state, s_county, grouping(s_state) + grouping(s_county) AS lochierarchy, rank() OVER (PARTITION BY grouping(s_state) + grouping(s_county), multiIf(grouping(s_county) = 0, s_state, NULL) ORDER BY sum(ss_net_profit) DESC) AS rank_within_parent FROM store_sales, date_dim AS d1, store WHERE ((d1.d_month_seq >= 1200) AND (d1.d_month_seq <= (1200 + 11))) AND (d1.d_date_sk = ss_sold_date_sk) AND (s_store_sk = ss_store_sk) AND (s_state IN ( SELECT s_state FROM ( SELECT s_state AS s_state, rank() OVER (PARTITION BY s_state ORDER BY sum(ss_net_profit) DESC) AS ranking FROM store_sales, store, date_dim WHERE ((d_month_seq >= 1200) AND (d_month_seq <= (1200 + 11))) AND (d_date_sk = ss_sold_date_sk) AND (s_store_sk = ss_store_sk) GROUP BY s_state ) AS tmp1 WHERE (ranking <= 5) )) GROUP BY s_state, s_county WITH ROLLUP ORDER BY lochierarchy DESC, multiIf(lochierarchy = 0, s_state, NULL), rank_within_parent LIMIT 100", + "SELECT i_brand_id AS brand_id, i_brand AS brand, t_hour, t_minute, sum(ext_price) AS ext_price FROM item, ( SELECT ws_ext_sales_price AS ext_price, ws_sold_date_sk AS sold_date_sk, ws_item_sk AS sold_item_sk, ws_sold_time_sk AS time_sk FROM web_sales, date_dim WHERE (d_date_sk = ws_sold_date_sk) AND (d_moy = 11) AND (d_year = 1999) UNION ALL SELECT cs_ext_sales_price AS ext_price, cs_sold_date_sk AS sold_date_sk, cs_item_sk AS sold_item_sk, cs_sold_time_sk AS time_sk FROM catalog_sales, date_dim WHERE (d_date_sk = cs_sold_date_sk) AND (d_moy = 11) AND (d_year = 1999) UNION ALL SELECT ss_ext_sales_price AS ext_price, ss_sold_date_sk AS sold_date_sk, ss_item_sk AS sold_item_sk, ss_sold_time_sk AS time_sk FROM store_sales, date_dim WHERE (d_date_sk = ss_sold_date_sk) AND (d_moy = 11) AND (d_year = 1999) ) AS tmp, time_dim WHERE (sold_item_sk = i_item_sk) AND (i_manager_id = 1) AND (time_sk = t_time_sk) AND ((t_meal_time = 'breakfast') OR (t_meal_time = 'dinner')) GROUP BY i_brand, i_brand_id, t_hour, t_minute ORDER BY ext_price DESC, i_brand_id", + "SELECT i_item_desc, w_warehouse_name, d1.d_week_seq, sum(multiIf(p_promo_sk IS NULL, 1, 0)) AS no_promo, sum(multiIf(p_promo_sk IS NOT NULL, 1, 0)) AS promo, count(*) AS total_cnt FROM catalog_sales INNER JOIN inventory ON cs_item_sk = inv_item_sk INNER JOIN warehouse ON w_warehouse_sk = inv_warehouse_sk INNER JOIN item ON i_item_sk = cs_item_sk INNER JOIN customer_demographics ON cs_bill_cdemo_sk = cd_demo_sk INNER JOIN household_demographics ON cs_bill_hdemo_sk = hd_demo_sk INNER JOIN date_dim AS d1 ON cs_sold_date_sk = d1.d_date_sk INNER JOIN date_dim AS d2 ON inv_date_sk = d2.d_date_sk INNER JOIN date_dim AS d3 ON cs_ship_date_sk = d3.d_date_sk LEFT JOIN promotion ON cs_promo_sk = p_promo_sk LEFT JOIN catalog_returns ON (cr_item_sk = cs_item_sk) AND (cr_order_number = cs_order_number) WHERE (d1.d_week_seq = d2.d_week_seq) AND (inv_quantity_on_hand < cs_quantity) AND (d3.d_date > (d1.d_date + 5)) AND (hd_buy_potential = '>10000') AND (d1.d_year = 1999) AND (cd_marital_status = 'D') GROUP BY i_item_desc, w_warehouse_name, d_week_seq ORDER BY total_cnt DESC, i_item_desc, w_warehouse_name, d_week_seq LIMIT 100", + "SELECT c_last_name, c_first_name, c_salutation, c_preferred_cust_flag, ss_ticket_number, cnt FROM ( SELECT ss_ticket_number, ss_customer_sk, count(*) AS cnt FROM store_sales, date_dim, store, household_demographics WHERE (store_sales.ss_sold_date_sk = date_dim.d_date_sk) AND (store_sales.ss_store_sk = store.s_store_sk) AND (store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk) AND ((date_dim.d_dom >= 1) AND (date_dim.d_dom <= 2)) AND ((household_demographics.hd_buy_potential = '>10000') OR (household_demographics.hd_buy_potential = 'Unknown')) AND (household_demographics.hd_vehicle_count > 0) AND (multiIf(household_demographics.hd_vehicle_count > 0, household_demographics.hd_dep_count / household_demographics.hd_vehicle_count, NULL) > 1) AND (date_dim.d_year IN (1999, 1999 + 1, 1999 + 2)) AND (store.s_county IN ('Williamson County', 'Franklin Parish', 'Bronx County', 'Orange County')) GROUP BY ss_ticket_number, ss_customer_sk ) AS dj, customer WHERE (ss_customer_sk = c_customer_sk) AND ((cnt >= 1) AND (cnt <= 5)) ORDER BY cnt DESC, c_last_name", + "WITH year_total AS ( SELECT c_customer_id AS customer_id, c_first_name AS customer_first_name, c_last_name AS customer_last_name, d_year AS year, sum(ss_net_paid) AS year_total, 's' AS sale_type FROM customer, store_sales, date_dim WHERE (c_customer_sk = ss_customer_sk) AND (ss_sold_date_sk = d_date_sk) AND (d_year IN (2001, 2001 + 1)) GROUP BY c_customer_id, c_first_name, c_last_name, d_year UNION ALL SELECT c_customer_id AS customer_id, c_first_name AS customer_first_name, c_last_name AS customer_last_name, d_year AS year, sum(ws_net_paid) AS year_total, 'w' AS sale_type FROM customer, web_sales, date_dim WHERE (c_customer_sk = ws_bill_customer_sk) AND (ws_sold_date_sk = d_date_sk) AND (d_year IN (2001, 2001 + 1)) GROUP BY c_customer_id, c_first_name, c_last_name, d_year ) SELECT t_s_secyear.customer_id, t_s_secyear.customer_first_name, t_s_secyear.customer_last_name FROM year_total AS t_s_firstyear, year_total AS t_s_secyear, year_total AS t_w_firstyear, year_total AS t_w_secyear WHERE (t_s_secyear.customer_id = t_s_firstyear.customer_id) AND (t_s_firstyear.customer_id = t_w_secyear.customer_id) AND (t_s_firstyear.customer_id = t_w_firstyear.customer_id) AND (t_s_firstyear.sale_type = 's') AND (t_w_firstyear.sale_type = 'w') AND (t_s_secyear.sale_type = 's') AND (t_w_secyear.sale_type = 'w') AND (t_s_firstyear.year = 2001) AND (t_s_secyear.year = (2001 + 1)) AND (t_w_firstyear.year = 2001) AND (t_w_secyear.year = (2001 + 1)) AND (t_s_firstyear.year_total > 0) AND (t_w_firstyear.year_total > 0) AND (multiIf(t_w_firstyear.year_total > 0, t_w_secyear.year_total / t_w_firstyear.year_total, NULL) > multiIf(t_s_firstyear.year_total > 0, t_s_secyear.year_total / t_s_firstyear.year_total, NULL)) ORDER BY 1, 2, 3 LIMIT 100", + "WITH all_sales AS ( SELECT d_year, i_brand_id, i_class_id, i_category_id, i_manufact_id, SUM(sales_cnt) AS sales_cnt, SUM(sales_amt) AS sales_amt FROM ( SELECT d_year, i_brand_id, i_class_id, i_category_id, i_manufact_id, cs_quantity - COALESCE(cr_return_quantity, 0) AS sales_cnt, cs_ext_sales_price - COALESCE(cr_return_amount, CAST('0.0', 'Decimal(7, 2)')) AS sales_amt FROM catalog_sales INNER JOIN item ON i_item_sk = cs_item_sk INNER JOIN date_dim ON d_date_sk = cs_sold_date_sk LEFT JOIN catalog_returns ON (cs_order_number = cr_order_number) AND (cs_item_sk = cr_item_sk) WHERE (i_category = 'Books') UNION SELECT d_year, i_brand_id, i_class_id, i_category_id, i_manufact_id, ss_quantity - COALESCE(sr_return_quantity, 0) AS sales_cnt, ss_ext_sales_price - COALESCE(sr_return_amt, CAST('0.0', 'Decimal(7, 2)')) AS sales_amt FROM store_sales INNER JOIN item ON i_item_sk = ss_item_sk INNER JOIN date_dim ON d_date_sk = ss_sold_date_sk LEFT JOIN store_returns ON (ss_ticket_number = sr_ticket_number) AND (ss_item_sk = sr_item_sk) WHERE (i_category = 'Books') UNION SELECT d_year, i_brand_id, i_class_id, i_category_id, i_manufact_id, ws_quantity - COALESCE(wr_return_quantity, 0) AS sales_cnt, ws_ext_sales_price - COALESCE(wr_return_amt, CAST('0.0', 'Decimal(7, 2)')) AS sales_amt FROM web_sales INNER JOIN item ON i_item_sk = ws_item_sk INNER JOIN date_dim ON d_date_sk = ws_sold_date_sk LEFT JOIN web_returns ON (ws_order_number = wr_order_number) AND (ws_item_sk = wr_item_sk) WHERE (i_category = 'Books') ) AS sales_detail GROUP BY d_year, i_brand_id, i_class_id, i_category_id, i_manufact_id ) SELECT prev_yr.d_year AS prev_year, curr_yr.d_year AS year, curr_yr.i_brand_id, curr_yr.i_class_id, curr_yr.i_category_id, curr_yr.i_manufact_id, prev_yr.sales_cnt AS prev_yr_cnt, curr_yr.sales_cnt AS curr_yr_cnt, curr_yr.sales_cnt - prev_yr.sales_cnt AS sales_cnt_diff, curr_yr.sales_amt - prev_yr.sales_amt AS sales_amt_diff FROM all_sales AS curr_yr, all_sales AS prev_yr WHERE (curr_yr.i_brand_id = prev_yr.i_brand_id) AND (curr_yr.i_class_id = prev_yr.i_class_id) AND (curr_yr.i_category_id = prev_yr.i_category_id) AND (curr_yr.i_manufact_id = prev_yr.i_manufact_id) AND (curr_yr.d_year = 2002) AND (prev_yr.d_year = (2002 - 1)) AND ((CAST(curr_yr.sales_cnt, 'DECIMAL(17, 2)') / CAST(prev_yr.sales_cnt, 'DECIMAL(17, 2)')) < 0.9) ORDER BY sales_cnt_diff, sales_amt_diff LIMIT 100", + "SELECT channel, col_name, d_year, d_qoy, i_category, COUNT(*) AS sales_cnt, SUM(ext_sales_price) AS sales_amt FROM ( SELECT 'store' AS channel, 'ss_store_sk' AS col_name, d_year, d_qoy, i_category, ss_ext_sales_price AS ext_sales_price FROM store_sales, item, date_dim WHERE (ss_store_sk IS NULL) AND (ss_sold_date_sk = d_date_sk) AND (ss_item_sk = i_item_sk) UNION ALL SELECT 'web' AS channel, 'ws_ship_customer_sk' AS col_name, d_year, d_qoy, i_category, ws_ext_sales_price AS ext_sales_price FROM web_sales, item, date_dim WHERE (ws_ship_customer_sk IS NULL) AND (ws_sold_date_sk = d_date_sk) AND (ws_item_sk = i_item_sk) UNION ALL SELECT 'catalog' AS channel, 'cs_ship_addr_sk' AS col_name, d_year, d_qoy, i_category, cs_ext_sales_price AS ext_sales_price FROM catalog_sales, item, date_dim WHERE (cs_ship_addr_sk IS NULL) AND (cs_sold_date_sk = d_date_sk) AND (cs_item_sk = i_item_sk) ) AS foo GROUP BY channel, col_name, d_year, d_qoy, i_category ORDER BY channel, col_name, d_year, d_qoy, i_category LIMIT 100", + "WITH ss AS ( SELECT s_store_sk, sum(ss_ext_sales_price) AS sales, sum(ss_net_profit) AS profit FROM store_sales, date_dim, store WHERE (ss_sold_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) AND (ss_store_sk = s_store_sk) GROUP BY s_store_sk ), sr AS ( SELECT s_store_sk, sum(sr_return_amt) AS returns, sum(sr_net_loss) AS profit_loss FROM store_returns, date_dim, store WHERE (sr_returned_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) AND (sr_store_sk = s_store_sk) GROUP BY s_store_sk ), cs AS ( SELECT cs_call_center_sk, sum(cs_ext_sales_price) AS sales, sum(cs_net_profit) AS profit FROM catalog_sales, date_dim WHERE (cs_sold_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) GROUP BY cs_call_center_sk ), cr AS ( SELECT cr_call_center_sk, sum(cr_return_amount) AS returns, sum(cr_net_loss) AS profit_loss FROM catalog_returns, date_dim WHERE (cr_returned_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) GROUP BY cr_call_center_sk ), ws AS ( SELECT wp_web_page_sk, sum(ws_ext_sales_price) AS sales, sum(ws_net_profit) AS profit FROM web_sales, date_dim, web_page WHERE (ws_sold_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) AND (ws_web_page_sk = wp_web_page_sk) GROUP BY wp_web_page_sk ), wr AS ( SELECT wp_web_page_sk, sum(wr_return_amt) AS returns, sum(wr_net_loss) AS profit_loss FROM web_returns, date_dim, web_page WHERE (wr_returned_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) AND (wr_web_page_sk = wp_web_page_sk) GROUP BY wp_web_page_sk ) SELECT channel, id, sum(sales) AS sales, sum(returns) AS returns, sum(profit) AS profit FROM ( SELECT 'store channel' AS channel, ss.s_store_sk AS id, sales, coalesce(returns, 0) AS returns, profit - coalesce(profit_loss, 0) AS profit FROM ss LEFT JOIN sr ON ss.s_store_sk = sr.s_store_sk UNION ALL SELECT 'catalog channel' AS channel, cs_call_center_sk AS id, sales, returns, profit - profit_loss AS profit FROM cs, cr UNION ALL SELECT 'web channel' AS channel, ws.wp_web_page_sk AS id, sales, coalesce(returns, 0) AS returns, profit - coalesce(profit_loss, 0) AS profit FROM ws LEFT JOIN wr ON ws.wp_web_page_sk = wr.wp_web_page_sk ) AS x GROUP BY channel, id WITH ROLLUP ORDER BY channel, id LIMIT 100", + "WITH ws AS ( SELECT d_year AS ws_sold_year, ws_item_sk, ws_bill_customer_sk AS ws_customer_sk, sum(ws_quantity) AS ws_qty, sum(ws_wholesale_cost) AS ws_wc, sum(ws_sales_price) AS ws_sp FROM web_sales LEFT JOIN web_returns ON (wr_order_number = ws_order_number) AND (ws_item_sk = wr_item_sk) INNER JOIN date_dim ON ws_sold_date_sk = d_date_sk WHERE wr_order_number IS NULL GROUP BY d_year, ws_item_sk, ws_bill_customer_sk ), cs AS ( SELECT d_year AS cs_sold_year, cs_item_sk, cs_bill_customer_sk AS cs_customer_sk, sum(cs_quantity) AS cs_qty, sum(cs_wholesale_cost) AS cs_wc, sum(cs_sales_price) AS cs_sp FROM catalog_sales LEFT JOIN catalog_returns ON (cr_order_number = cs_order_number) AND (cs_item_sk = cr_item_sk) INNER JOIN date_dim ON cs_sold_date_sk = d_date_sk WHERE cr_order_number IS NULL GROUP BY d_year, cs_item_sk, cs_bill_customer_sk ), ss AS ( SELECT d_year AS ss_sold_year, ss_item_sk, ss_customer_sk, sum(ss_quantity) AS ss_qty, sum(ss_wholesale_cost) AS ss_wc, sum(ss_sales_price) AS ss_sp FROM store_sales LEFT JOIN store_returns ON (sr_ticket_number = ss_ticket_number) AND (ss_item_sk = sr_item_sk) INNER JOIN date_dim ON ss_sold_date_sk = d_date_sk WHERE sr_ticket_number IS NULL GROUP BY d_year, ss_item_sk, ss_customer_sk ) SELECT ss_sold_year, ss_item_sk, ss_customer_sk, round(ss_qty / (coalesce(ws_qty, 0) + coalesce(cs_qty, 0)), 2) AS ratio, ss_qty AS store_qty, ss_wc AS store_wholesale_cost, ss_sp AS store_sales_price, coalesce(ws_qty, 0) + coalesce(cs_qty, 0) AS other_chan_qty, coalesce(ws_wc, 0) + coalesce(cs_wc, 0) AS other_chan_wholesale_cost, coalesce(ws_sp, 0) + coalesce(cs_sp, 0) AS other_chan_sales_price FROM ss LEFT JOIN ws ON (ws_sold_year = ss_sold_year) AND (ws_item_sk = ss_item_sk) AND (ws_customer_sk = ss_customer_sk) LEFT JOIN cs ON (cs_sold_year = ss_sold_year) AND (cs_item_sk = ss_item_sk) AND (cs_customer_sk = ss_customer_sk) WHERE ((coalesce(ws_qty, 0) > 0) OR (coalesce(cs_qty, 0) > 0)) AND (ss_sold_year = 2000) ORDER BY ss_sold_year, ss_item_sk, ss_customer_sk, ss_qty DESC, ss_wc DESC, ss_sp DESC, other_chan_qty, other_chan_wholesale_cost, other_chan_sales_price, ratio LIMIT 100", + "SELECT c_last_name, c_first_name, substr(s_city, 1, 30), ss_ticket_number, amt, profit FROM ( SELECT ss_ticket_number, ss_customer_sk, store.s_city, sum(ss_coupon_amt) AS amt, sum(ss_net_profit) AS profit FROM store_sales, date_dim, store, household_demographics WHERE (store_sales.ss_sold_date_sk = date_dim.d_date_sk) AND (store_sales.ss_store_sk = store.s_store_sk) AND (store_sales.ss_hdemo_sk = household_demographics.hd_demo_sk) AND ((household_demographics.hd_dep_count = 6) OR (household_demographics.hd_vehicle_count > 2)) AND (date_dim.d_dow = 1) AND (date_dim.d_year IN (1999, 1999 + 1, 1999 + 2)) AND ((store.s_number_employees >= 200) AND (store.s_number_employees <= 295)) GROUP BY ss_ticket_number, ss_customer_sk, ss_addr_sk, store.s_city ) AS ms, customer WHERE (ss_customer_sk = c_customer_sk) ORDER BY c_last_name, c_first_name, substr(s_city, 1, 30), profit LIMIT 100", + "WITH ssr AS ( SELECT s_store_id AS store_id, sum(ss_ext_sales_price) AS sales, sum(coalesce(sr_return_amt, 0)) AS returns, sum(ss_net_profit - coalesce(sr_net_loss, 0)) AS profit FROM store_sales LEFT JOIN store_returns ON (ss_item_sk = sr_item_sk) AND (ss_ticket_number = sr_ticket_number), date_dim, store, item, promotion WHERE (ss_sold_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) AND (ss_store_sk = s_store_sk) AND (ss_item_sk = i_item_sk) AND (i_current_price > 50) AND (ss_promo_sk = p_promo_sk) AND (p_channel_tv = 'N') GROUP BY s_store_id ), csr AS ( SELECT cp_catalog_page_id AS catalog_page_id, sum(cs_ext_sales_price) AS sales, sum(coalesce(cr_return_amount, 0)) AS returns, sum(cs_net_profit - coalesce(cr_net_loss, 0)) AS profit FROM catalog_sales LEFT JOIN catalog_returns ON (cs_item_sk = cr_item_sk) AND (cs_order_number = cr_order_number), date_dim, catalog_page, item, promotion WHERE (cs_sold_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) AND (cs_catalog_page_sk = cp_catalog_page_sk) AND (cs_item_sk = i_item_sk) AND (i_current_price > 50) AND (cs_promo_sk = p_promo_sk) AND (p_channel_tv = 'N') GROUP BY cp_catalog_page_id ), wsr AS ( SELECT web_site_id, sum(ws_ext_sales_price) AS sales, sum(coalesce(wr_return_amt, 0)) AS returns, sum(ws_net_profit - coalesce(wr_net_loss, 0)) AS profit FROM web_sales LEFT JOIN web_returns ON (ws_item_sk = wr_item_sk) AND (ws_order_number = wr_order_number), date_dim, web_site, item, promotion WHERE (ws_sold_date_sk = d_date_sk) AND ((d_date >= CAST('2000-08-23', 'date')) AND (d_date <= (CAST('2000-08-23', 'date') + INTERVAL 30 DAY))) AND (ws_web_site_sk = web_site_sk) AND (ws_item_sk = i_item_sk) AND (i_current_price > 50) AND (ws_promo_sk = p_promo_sk) AND (p_channel_tv = 'N') GROUP BY web_site_id ) SELECT channel, id, sum(sales) AS sales, sum(returns) AS returns, sum(profit) AS profit FROM ( SELECT 'store channel' AS channel, concat('store', store_id) AS id, sales, returns, profit FROM ssr UNION ALL SELECT 'catalog channel' AS channel, concat('catalog_page', catalog_page_id) AS id, sales, returns, profit FROM csr UNION ALL SELECT 'web channel' AS channel, concat('web_site', web_site_id) AS id, sales, returns, profit FROM wsr ) AS x GROUP BY channel, id WITH ROLLUP ORDER BY channel, id LIMIT 100", + "WITH customer_total_return AS ( SELECT cr_returning_customer_sk AS ctr_customer_sk, ca_state AS ctr_state, sum(cr_return_amt_inc_tax) AS ctr_total_return FROM catalog_returns, date_dim, customer_address WHERE (cr_returned_date_sk = d_date_sk) AND (d_year = 2000) AND (cr_returning_addr_sk = ca_address_sk) GROUP BY cr_returning_customer_sk, ca_state ) SELECT c_customer_id, c_salutation, c_first_name, c_last_name, ca_street_number, ca_street_name, ca_street_type, ca_suite_number, ca_city, ca_county, ca_state, ca_zip, ca_country, ca_gmt_offset, ca_location_type, ctr_total_return FROM customer_total_return AS ctr1, customer_address, customer WHERE (ctr1.ctr_total_return > ( SELECT avg(ctr_total_return) * 1.2 FROM customer_total_return AS ctr2 WHERE (ctr1.ctr_state = ctr2.ctr_state) )) AND (ca_address_sk = c_current_addr_sk) AND (ca_state = 'GA') AND (ctr1.ctr_customer_sk = c_customer_sk) ORDER BY c_customer_id, c_salutation, c_first_name, c_last_name, ca_street_number, ca_street_name, ca_street_type, ca_suite_number, ca_city, ca_county, ca_state, ca_zip, ca_country, ca_gmt_offset, ca_location_type, ctr_total_return LIMIT 100", + "SELECT i_item_id, i_item_desc, i_current_price FROM item, inventory, date_dim, store_sales WHERE (i_current_price BETWEEN 62 AND 62 + 30) AND (inv_item_sk = i_item_sk) AND (d_date_sk = inv_date_sk) AND (d_date BETWEEN CAST('2000-05-25', 'date') AND (CAST('2000-05-25', 'date') + INTERVAL 60 DAY)) AND (i_manufact_id IN (129, 270, 821, 423)) AND (inv_quantity_on_hand BETWEEN 100 AND 500) AND (ss_item_sk = i_item_sk) GROUP BY i_item_id, i_item_desc, i_current_price ORDER BY i_item_id LIMIT 100", + "WITH sr_items AS ( SELECT i_item_id AS item_id, sum(sr_return_quantity) AS sr_item_qty FROM store_returns, item, date_dim WHERE (sr_item_sk = i_item_sk) AND (d_date IN ( SELECT d_date FROM date_dim WHERE (d_week_seq IN ( SELECT d_week_seq FROM date_dim WHERE (d_date IN ('2000-06-30', '2000-09-27', '2000-11-17')) )) )) AND (sr_returned_date_sk = d_date_sk) GROUP BY i_item_id ), cr_items AS ( SELECT i_item_id AS item_id, sum(cr_return_quantity) AS cr_item_qty FROM catalog_returns, item, date_dim WHERE (cr_item_sk = i_item_sk) AND (d_date IN ( SELECT d_date FROM date_dim WHERE (d_week_seq IN ( SELECT d_week_seq FROM date_dim WHERE (d_date IN ('2000-06-30', '2000-09-27', '2000-11-17')) )) )) AND (cr_returned_date_sk = d_date_sk) GROUP BY i_item_id ), wr_items AS ( SELECT i_item_id AS item_id, sum(wr_return_quantity) AS wr_item_qty FROM web_returns, item, date_dim WHERE (wr_item_sk = i_item_sk) AND (d_date IN ( SELECT d_date FROM date_dim WHERE (d_week_seq IN ( SELECT d_week_seq FROM date_dim WHERE (d_date IN ('2000-06-30', '2000-09-27', '2000-11-17')) )) )) AND (wr_returned_date_sk = d_date_sk) GROUP BY i_item_id ) SELECT sr_items.item_id, sr_item_qty, ((sr_item_qty / ((sr_item_qty + cr_item_qty) + wr_item_qty)) / 3.) * 100 AS sr_dev, cr_item_qty, ((cr_item_qty / ((sr_item_qty + cr_item_qty) + wr_item_qty)) / 3.) * 100 AS cr_dev, wr_item_qty, ((wr_item_qty / ((sr_item_qty + cr_item_qty) + wr_item_qty)) / 3.) * 100 AS wr_dev, ((sr_item_qty + cr_item_qty) + wr_item_qty) / 3. AS average FROM sr_items, cr_items, wr_items WHERE (sr_items.item_id = cr_items.item_id) AND (sr_items.item_id = wr_items.item_id) ORDER BY sr_items.item_id, sr_item_qty LIMIT 100", + "SELECT c_customer_id AS customer_id, concat(coalesce(c_last_name, ''), ', ', coalesce(c_first_name, '')) AS customername FROM customer, customer_address, customer_demographics, household_demographics, income_band, store_returns WHERE (ca_city = 'Edgewood') AND (c_current_addr_sk = ca_address_sk) AND (ib_lower_bound >= 38128) AND (ib_upper_bound <= (38128 + 50000)) AND (ib_income_band_sk = hd_income_band_sk) AND (cd_demo_sk = c_current_cdemo_sk) AND (hd_demo_sk = c_current_hdemo_sk) AND (sr_cdemo_sk = cd_demo_sk) ORDER BY c_customer_id LIMIT 100", + "SELECT substr(r_reason_desc, 1, 20), avg(ws_quantity), avg(wr_refunded_cash), avg(wr_fee) FROM web_sales, web_returns, web_page, customer_demographics AS cd1, customer_demographics AS cd2, customer_address, date_dim, reason WHERE (ws_web_page_sk = wp_web_page_sk) AND (ws_item_sk = wr_item_sk) AND (ws_order_number = wr_order_number) AND (ws_sold_date_sk = d_date_sk) AND (d_year = 2000) AND (cd1.cd_demo_sk = wr_refunded_cdemo_sk) AND (cd2.cd_demo_sk = wr_returning_cdemo_sk) AND (ca_address_sk = wr_refunded_addr_sk) AND (r_reason_sk = wr_reason_sk) AND ( ( (cd1.cd_marital_status = 'M') AND (cd1.cd_marital_status = cd2.cd_marital_status) AND (cd1.cd_education_status = 'Advanced Degree') AND (cd1.cd_education_status = cd2.cd_education_status) AND ((ws_sales_price >= 100.0) AND (ws_sales_price <= 150.0)) ) OR ( (cd1.cd_marital_status = 'S') AND (cd1.cd_marital_status = cd2.cd_marital_status) AND (cd1.cd_education_status = 'College') AND (cd1.cd_education_status = cd2.cd_education_status) AND ((ws_sales_price >= 50.0) AND (ws_sales_price <= 100.0)) ) OR ( (cd1.cd_marital_status = 'W') AND (cd1.cd_marital_status = cd2.cd_marital_status) AND (cd1.cd_education_status = '2 yr Degree') AND (cd1.cd_education_status = cd2.cd_education_status) AND ((ws_sales_price >= 150.0) AND (ws_sales_price <= 200.0)) ) ) AND ( ( (ca_country = 'United States') AND (ca_state IN ('IN', 'OH', 'NJ')) AND ((ws_net_profit >= 100) AND (ws_net_profit <= 200)) ) OR ( (ca_country = 'United States') AND (ca_state IN ('WI', 'CT', 'KY')) AND ((ws_net_profit >= 150) AND (ws_net_profit <= 300)) ) OR ( (ca_country = 'United States') AND (ca_state IN ('LA', 'IA', 'AR')) AND ((ws_net_profit >= 50) AND (ws_net_profit <= 250)) ) ) GROUP BY r_reason_desc ORDER BY substr(r_reason_desc, 1, 20), avg(ws_quantity), avg(wr_refunded_cash), avg(wr_fee) LIMIT 100", + "SELECT sum(ws_net_paid) AS total_sum, i_category, i_class, grouping(i_category) + grouping(i_class) AS lochierarchy, rank() OVER (PARTITION BY grouping(i_category) + grouping(i_class), multiIf(grouping(i_class) = 0, i_category, NULL) ORDER BY sum(ws_net_paid) DESC) AS rank_within_parent FROM web_sales, date_dim AS d1, item WHERE ((d1.d_month_seq >= 1200) AND (d1.d_month_seq <= (1200 + 11))) AND (d1.d_date_sk = ws_sold_date_sk) AND (i_item_sk = ws_item_sk) GROUP BY i_category, i_class WITH ROLLUP ORDER BY lochierarchy DESC, multiIf(lochierarchy = 0, i_category, NULL), rank_within_parent LIMIT 100", + "SELECT count(*) FROM ( SELECT DISTINCT c_last_name, c_first_name, d_date FROM store_sales, date_dim, customer WHERE (store_sales.ss_sold_date_sk = date_dim.d_date_sk) AND (store_sales.ss_customer_sk = customer.c_customer_sk) AND ((d_month_seq >= 1200) AND (d_month_seq <= (1200 + 11))) EXCEPT SELECT DISTINCT c_last_name, c_first_name, d_date FROM catalog_sales, date_dim, customer WHERE (catalog_sales.cs_sold_date_sk = date_dim.d_date_sk) AND (catalog_sales.cs_bill_customer_sk = customer.c_customer_sk) AND ((d_month_seq >= 1200) AND (d_month_seq <= (1200 + 11))) EXCEPT SELECT DISTINCT c_last_name, c_first_name, d_date FROM web_sales, date_dim, customer WHERE (web_sales.ws_sold_date_sk = date_dim.d_date_sk) AND (web_sales.ws_bill_customer_sk = customer.c_customer_sk) AND ((d_month_seq >= 1200) AND (d_month_seq <= (1200 + 11))) ) AS cool_cust", + "SELECT * FROM ( SELECT count(*) AS h8_30_to_9 FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 8) AND (time_dim.t_minute >= 30) AND ( ((household_demographics.hd_dep_count = 4) AND (household_demographics.hd_vehicle_count <= (4 + 2))) OR ((household_demographics.hd_dep_count = 2) AND (household_demographics.hd_vehicle_count <= (2 + 2))) OR ((household_demographics.hd_dep_count = 0) AND (household_demographics.hd_vehicle_count <= (0 + 2))) ) AND (store.s_store_name = 'ese') ) AS s1, ( SELECT count(*) AS h9_to_9_30 FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 9) AND (time_dim.t_minute < 30) AND ( ((household_demographics.hd_dep_count = 4) AND (household_demographics.hd_vehicle_count <= (4 + 2))) OR ((household_demographics.hd_dep_count = 2) AND (household_demographics.hd_vehicle_count <= (2 + 2))) OR ((household_demographics.hd_dep_count = 0) AND (household_demographics.hd_vehicle_count <= (0 + 2))) ) AND (store.s_store_name = 'ese') ) AS s2, ( SELECT count(*) AS h9_30_to_10 FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 9) AND (time_dim.t_minute >= 30) AND ( ((household_demographics.hd_dep_count = 4) AND (household_demographics.hd_vehicle_count <= (4 + 2))) OR ((household_demographics.hd_dep_count = 2) AND (household_demographics.hd_vehicle_count <= (2 + 2))) OR ((household_demographics.hd_dep_count = 0) AND (household_demographics.hd_vehicle_count <= (0 + 2))) ) AND (store.s_store_name = 'ese') ) AS s3, ( SELECT count(*) AS h10_to_10_30 FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 10) AND (time_dim.t_minute < 30) AND ( ((household_demographics.hd_dep_count = 4) AND (household_demographics.hd_vehicle_count <= (4 + 2))) OR ((household_demographics.hd_dep_count = 2) AND (household_demographics.hd_vehicle_count <= (2 + 2))) OR ((household_demographics.hd_dep_count = 0) AND (household_demographics.hd_vehicle_count <= (0 + 2))) ) AND (store.s_store_name = 'ese') ) AS s4, ( SELECT count(*) AS h10_30_to_11 FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 10) AND (time_dim.t_minute >= 30) AND ( ((household_demographics.hd_dep_count = 4) AND (household_demographics.hd_vehicle_count <= (4 + 2))) OR ((household_demographics.hd_dep_count = 2) AND (household_demographics.hd_vehicle_count <= (2 + 2))) OR ((household_demographics.hd_dep_count = 0) AND (household_demographics.hd_vehicle_count <= (0 + 2))) ) AND (store.s_store_name = 'ese') ) AS s5, ( SELECT count(*) AS h11_to_11_30 FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 11) AND (time_dim.t_minute < 30) AND ( ((household_demographics.hd_dep_count = 4) AND (household_demographics.hd_vehicle_count <= (4 + 2))) OR ((household_demographics.hd_dep_count = 2) AND (household_demographics.hd_vehicle_count <= (2 + 2))) OR ((household_demographics.hd_dep_count = 0) AND (household_demographics.hd_vehicle_count <= (0 + 2))) ) AND (store.s_store_name = 'ese') ) AS s6, ( SELECT count(*) AS h11_30_to_12 FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 11) AND (time_dim.t_minute >= 30) AND ( ((household_demographics.hd_dep_count = 4) AND (household_demographics.hd_vehicle_count <= (4 + 2))) OR ((household_demographics.hd_dep_count = 2) AND (household_demographics.hd_vehicle_count <= (2 + 2))) OR ((household_demographics.hd_dep_count = 0) AND (household_demographics.hd_vehicle_count <= (0 + 2))) ) AND (store.s_store_name = 'ese') ) AS s7, ( SELECT count(*) AS h12_to_12_30 FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 12) AND (time_dim.t_minute < 30) AND ( ((household_demographics.hd_dep_count = 4) AND (household_demographics.hd_vehicle_count <= (4 + 2))) OR ((household_demographics.hd_dep_count = 2) AND (household_demographics.hd_vehicle_count <= (2 + 2))) OR ((household_demographics.hd_dep_count = 0) AND (household_demographics.hd_vehicle_count <= (0 + 2))) ) AND (store.s_store_name = 'ese') ) AS s8", + "SELECT * FROM ( SELECT i_category, i_class, i_brand, s_store_name, s_company_name, d_moy, sum(ss_sales_price) AS sum_sales, avg(sum(ss_sales_price)) OVER (PARTITION BY i_category, i_brand, s_store_name, s_company_name) AS avg_monthly_sales FROM item, store_sales, date_dim, store WHERE (ss_item_sk = i_item_sk) AND (ss_sold_date_sk = d_date_sk) AND (ss_store_sk = s_store_sk) AND (d_year IN (1999)) AND ( ((i_category IN ('Women', 'Jewelry', 'Men')) AND (i_class IN ('dresses', 'birdal', 'shirts'))) OR ((i_category IN ('Sports', 'Electronics', 'Books')) AND (i_class IN ('football', 'stereo', 'computers'))) ) GROUP BY i_category, i_class, i_brand, s_store_name, s_company_name, d_moy ) AS tmp1 WHERE (multiIf(avg_monthly_sales != 0, abs(sum_sales - avg_monthly_sales) / avg_monthly_sales, NULL) > 0.1) ORDER BY sum_sales - avg_monthly_sales, s_store_name LIMIT 100", + "SELECT CAST(amc AS DECIMAL(15, 4)) / CAST(pmc AS DECIMAL(15, 4)) AS am_pm_ratio FROM ( SELECT count(*) AS amc FROM web_sales, household_demographics, time_dim, web_page WHERE (ws_sold_time_sk = time_dim.t_time_sk) AND (ws_ship_hdemo_sk = household_demographics.hd_demo_sk) AND (ws_web_page_sk = web_page.wp_web_page_sk) AND (time_dim.t_hour BETWEEN 8 AND 8 + 1) AND (household_demographics.hd_dep_count = 6) AND (web_page.wp_char_count BETWEEN 5000 AND 5200) ) AS at, ( SELECT count(*) AS pmc FROM web_sales, household_demographics, time_dim, web_page WHERE (ws_sold_time_sk = time_dim.t_time_sk) AND (ws_ship_hdemo_sk = household_demographics.hd_demo_sk) AND (ws_web_page_sk = web_page.wp_web_page_sk) AND (time_dim.t_hour BETWEEN 19 AND 19 + 1) AND (household_demographics.hd_dep_count = 6) AND (web_page.wp_char_count BETWEEN 5000 AND 5200) ) AS pt ORDER BY am_pm_ratio LIMIT 100", + "SELECT cc_call_center_id AS Call_Center, cc_name AS Call_Center_Name, cc_manager AS Manager, sum(cr_net_loss) AS Returns_Loss FROM call_center, catalog_returns, date_dim, customer, customer_address, customer_demographics, household_demographics WHERE (cr_call_center_sk = cc_call_center_sk) AND (cr_returned_date_sk = d_date_sk) AND (cr_returning_customer_sk = c_customer_sk) AND (cd_demo_sk = c_current_cdemo_sk) AND (hd_demo_sk = c_current_hdemo_sk) AND (ca_address_sk = c_current_addr_sk) AND (d_year = 1998) AND (d_moy = 11) AND ( ((cd_marital_status = 'M') AND (cd_education_status = 'Unknown')) OR ((cd_marital_status = 'W') AND (cd_education_status = 'Advanced Degree')) ) AND (hd_buy_potential LIKE 'Unknown%') AND (ca_gmt_offset = -7) GROUP BY cc_call_center_id, cc_name, cc_manager, cd_marital_status, cd_education_status ORDER BY sum(cr_net_loss) DESC", + "SELECT sum(ws_ext_discount_amt) AS `Excess Discount Amount` FROM web_sales, item, date_dim WHERE (i_manufact_id = 350) AND (i_item_sk = ws_item_sk) AND ((d_date >= '2000-01-27') AND (d_date <= (CAST('2000-01-27', 'date') + INTERVAL 90 DAY))) AND (d_date_sk = ws_sold_date_sk) AND (ws_ext_discount_amt > ( SELECT 1.3 * avg(ws_ext_discount_amt) FROM web_sales, date_dim WHERE (ws_item_sk = i_item_sk) AND ((d_date >= '2000-01-27') AND (d_date <= (CAST('2000-01-27', 'date') + INTERVAL 90 DAY))) AND (d_date_sk = ws_sold_date_sk) )) ORDER BY sum(ws_ext_discount_amt) LIMIT 100", + "SELECT ss_customer_sk, sum(act_sales) AS sumsales FROM ( SELECT ss_item_sk, ss_ticket_number, ss_customer_sk, multiIf(sr_return_quantity IS NOT NULL, (ss_quantity - sr_return_quantity) * ss_sales_price, ss_quantity * ss_sales_price) AS act_sales FROM store_sales LEFT JOIN store_returns ON (sr_item_sk = ss_item_sk) AND (sr_ticket_number = ss_ticket_number), reason WHERE (sr_reason_sk = r_reason_sk) AND (r_reason_desc = 'reason 28') ) AS t GROUP BY ss_customer_sk ORDER BY sumsales, ss_customer_sk LIMIT 100", + "SELECT count(DISTINCT ws_order_number) AS \"order count\", sum(ws_ext_ship_cost) AS \"total shipping cost\", sum(ws_net_profit) AS \"total net profit\" FROM web_sales AS ws1, date_dim, customer_address, web_site WHERE (d_date BETWEEN '1999-2-01' AND (CAST('1999-2-01', 'date') + INTERVAL 60 DAY)) AND (ws1.ws_ship_date_sk = d_date_sk) AND (ws1.ws_ship_addr_sk = ca_address_sk) AND (ca_state = 'IL') AND (ws1.ws_web_site_sk = web_site_sk) AND (web_company_name = 'pri') AND EXISTS ( SELECT * FROM web_sales AS ws2 WHERE (ws1.ws_order_number = ws2.ws_order_number) AND (ws1.ws_warehouse_sk <> ws2.ws_warehouse_sk) ) AND NOT EXISTS ( SELECT * FROM web_returns AS wr1 WHERE (ws1.ws_order_number = wr1.wr_order_number) ) ORDER BY count(DISTINCT ws_order_number) LIMIT 100", + "WITH ws_wh AS ( SELECT ws1.ws_order_number, ws1.ws_warehouse_sk AS wh1, ws2.ws_warehouse_sk AS wh2 FROM web_sales AS ws1, web_sales AS ws2 WHERE (ws1.ws_order_number = ws2.ws_order_number) AND (ws1.ws_warehouse_sk != ws2.ws_warehouse_sk) ) SELECT countDistinct(ws_order_number) AS `order count`, sum(ws_ext_ship_cost) AS `total shipping cost`, sum(ws_net_profit) AS `total net profit` FROM web_sales AS ws1, date_dim, customer_address, web_site WHERE ((d_date >= '1999-2-01') AND (d_date <= (CAST('1999-2-01', 'date') + INTERVAL 60 DAY))) AND (ws1.ws_ship_date_sk = d_date_sk) AND (ws1.ws_ship_addr_sk = ca_address_sk) AND (ca_state = 'IL') AND (ws1.ws_web_site_sk = web_site_sk) AND (web_company_name = 'pri') AND (ws1.ws_order_number IN ( SELECT ws_order_number FROM ws_wh )) AND (ws1.ws_order_number IN ( SELECT wr_order_number FROM web_returns, ws_wh WHERE (wr_order_number = ws_wh.ws_order_number) )) ORDER BY countDistinct(ws_order_number) LIMIT 100", + "SELECT count(*) FROM store_sales, household_demographics, time_dim, store WHERE (ss_sold_time_sk = time_dim.t_time_sk) AND (ss_hdemo_sk = household_demographics.hd_demo_sk) AND (ss_store_sk = s_store_sk) AND (time_dim.t_hour = 20) AND (time_dim.t_minute >= 30) AND (household_demographics.hd_dep_count = 7) AND (store.s_store_name = 'ese') ORDER BY count(*) LIMIT 100", + "WITH ssci AS ( SELECT ss_customer_sk AS customer_sk, ss_item_sk AS item_sk FROM store_sales, date_dim WHERE (ss_sold_date_sk = d_date_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) GROUP BY ss_customer_sk, ss_item_sk ), csci AS ( SELECT cs_bill_customer_sk AS customer_sk, cs_item_sk AS item_sk FROM catalog_sales, date_dim WHERE (cs_sold_date_sk = d_date_sk) AND (d_month_seq BETWEEN 1200 AND 1200 + 11) GROUP BY cs_bill_customer_sk, cs_item_sk ) SELECT sum(CASE WHEN (ssci.customer_sk IS NOT NULL) AND (csci.customer_sk IS NULL) THEN 1 ELSE 0 END) AS store_only, sum(CASE WHEN (ssci.customer_sk IS NULL) AND (csci.customer_sk IS NOT NULL) THEN 1 ELSE 0 END) AS catalog_only, sum(CASE WHEN (ssci.customer_sk IS NOT NULL) AND (csci.customer_sk IS NOT NULL) THEN 1 ELSE 0 END) AS store_and_catalog FROM ssci FULL OUTER JOIN csci ON (ssci.customer_sk = csci.customer_sk) AND (ssci.item_sk = csci.item_sk) LIMIT 100", + "SELECT i_item_id, i_item_desc, i_category, i_class, i_current_price, sum(ss_ext_sales_price) AS itemrevenue, sum(ss_ext_sales_price) * 100 / sum(sum(ss_ext_sales_price)) OVER (PARTITION BY i_class) AS revenueratio FROM store_sales, item, date_dim WHERE (ss_item_sk = i_item_sk) AND (i_category IN ('Sports', 'Books', 'Home')) AND (ss_sold_date_sk = d_date_sk) AND (d_date BETWEEN CAST('1999-02-22', 'date') AND (CAST('1999-02-22', 'date') + INTERVAL 30 DAY)) GROUP BY i_item_id, i_item_desc, i_category, i_class, i_current_price ORDER BY i_category, i_class, i_item_id, i_item_desc, revenueratio", + "SELECT substr(w_warehouse_name, 1, 20), sm_type, cc_name, sum(CASE WHEN (cs_ship_date_sk - cs_sold_date_sk <= 30) THEN 1 ELSE 0 END) AS \"30 days\", sum(CASE WHEN (cs_ship_date_sk - cs_sold_date_sk > 30) AND (cs_ship_date_sk - cs_sold_date_sk <= 60) THEN 1 ELSE 0 END) AS \"31-60 days\", sum(CASE WHEN (cs_ship_date_sk - cs_sold_date_sk > 60) AND (cs_ship_date_sk - cs_sold_date_sk <= 90) THEN 1 ELSE 0 END) AS \"61-90 days\", sum(CASE WHEN (cs_ship_date_sk - cs_sold_date_sk > 90) AND (cs_ship_date_sk - cs_sold_date_sk <= 120) THEN 1 ELSE 0 END) AS \"91-120 days\", sum(CASE WHEN (cs_ship_date_sk - cs_sold_date_sk > 120) THEN 1 ELSE 0 END) AS \">120 days\" FROM catalog_sales, warehouse, ship_mode, call_center, date_dim WHERE (d_month_seq BETWEEN 1200 AND 1200 + 11) AND (cs_ship_date_sk = d_date_sk) AND (cs_warehouse_sk = w_warehouse_sk) AND (cs_ship_mode_sk = sm_ship_mode_sk) AND (cs_call_center_sk = cc_call_center_sk) GROUP BY substr(w_warehouse_name, 1, 20), sm_type, cc_name ORDER BY substr(w_warehouse_name, 1, 20), sm_type, cc_name LIMIT 100" +]}, +{"name":"job","queries":[ + "SELECT MIN(mc.note) AS production_note, MIN(t.title) AS movie_title, MIN(t.production_year) AS movie_year FROM company_type AS ct, info_type AS it, movie_companies AS mc, movie_info_idx AS mi_idx, title AS t WHERE ct.kind = 'production companies' AND it.info = 'top 250 rank' AND mc.note NOT LIKE '%(as Metro-Goldwyn-Mayer Pictures)%' AND (mc.note LIKE '%(co-production)%' OR mc.note LIKE '%(presents)%') AND ct.id = mc.company_type_id AND t.id = mc.movie_id AND t.id = mi_idx.movie_id AND mc.movie_id = mi_idx.movie_id AND it.id = mi_idx.info_type_id", + "SELECT MIN(mc.note) AS production_note, MIN(t.title) AS movie_title, MIN(t.production_year) AS movie_year FROM company_type AS ct, info_type AS it, movie_companies AS mc, movie_info_idx AS mi_idx, title AS t WHERE ct.kind = 'production companies' AND it.info = 'bottom 10 rank' AND mc.note NOT LIKE '%(as Metro-Goldwyn-Mayer Pictures)%' AND t.production_year BETWEEN 2005 AND 2010 AND ct.id = mc.company_type_id AND t.id = mc.movie_id AND t.id = mi_idx.movie_id AND mc.movie_id = mi_idx.movie_id AND it.id = mi_idx.info_type_id", + "SELECT MIN(mc.note) AS production_note, MIN(t.title) AS movie_title, MIN(t.production_year) AS movie_year FROM company_type AS ct, info_type AS it, movie_companies AS mc, movie_info_idx AS mi_idx, title AS t WHERE ct.kind = 'production companies' AND it.info = 'top 250 rank' AND mc.note NOT LIKE '%(as Metro-Goldwyn-Mayer Pictures)%' AND (mc.note LIKE '%(co-production)%') AND t.production_year >2010 AND ct.id = mc.company_type_id AND t.id = mc.movie_id AND t.id = mi_idx.movie_id AND mc.movie_id = mi_idx.movie_id AND it.id = mi_idx.info_type_id", + "SELECT MIN(mc.note) AS production_note, MIN(t.title) AS movie_title, MIN(t.production_year) AS movie_year FROM company_type AS ct, info_type AS it, movie_companies AS mc, movie_info_idx AS mi_idx, title AS t WHERE ct.kind = 'production companies' AND it.info = 'bottom 10 rank' AND mc.note NOT LIKE '%(as Metro-Goldwyn-Mayer Pictures)%' AND t.production_year >2000 AND ct.id = mc.company_type_id AND t.id = mc.movie_id AND t.id = mi_idx.movie_id AND mc.movie_id = mi_idx.movie_id AND it.id = mi_idx.info_type_id", + "SELECT MIN(t.title) AS movie_title FROM company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, title AS t WHERE cn.country_code ='[de]' AND k.keyword ='character-name-in-title' AND cn.id = mc.company_id AND mc.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND mc.movie_id = mk.movie_id", + "SELECT MIN(t.title) AS movie_title FROM company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, title AS t WHERE cn.country_code ='[nl]' AND k.keyword ='character-name-in-title' AND cn.id = mc.company_id AND mc.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND mc.movie_id = mk.movie_id", + "SELECT MIN(t.title) AS movie_title FROM company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, title AS t WHERE cn.country_code ='[sm]' AND k.keyword ='character-name-in-title' AND cn.id = mc.company_id AND mc.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND mc.movie_id = mk.movie_id", + "SELECT MIN(t.title) AS movie_title FROM company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, title AS t WHERE cn.country_code ='[us]' AND k.keyword ='character-name-in-title' AND cn.id = mc.company_id AND mc.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND mc.movie_id = mk.movie_id", + "SELECT MIN(t.title) AS movie_title FROM keyword AS k, movie_info AS mi, movie_keyword AS mk, title AS t WHERE k.keyword LIKE '%sequel%' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German') AND t.production_year > 2005 AND t.id = mi.movie_id AND t.id = mk.movie_id AND mk.movie_id = mi.movie_id AND k.id = mk.keyword_id", + "SELECT MIN(t.title) AS movie_title FROM keyword AS k, movie_info AS mi, movie_keyword AS mk, title AS t WHERE k.keyword LIKE '%sequel%' AND mi.info IN ('Bulgaria') AND t.production_year > 2010 AND t.id = mi.movie_id AND t.id = mk.movie_id AND mk.movie_id = mi.movie_id AND k.id = mk.keyword_id", + "SELECT MIN(t.title) AS movie_title FROM keyword AS k, movie_info AS mi, movie_keyword AS mk, title AS t WHERE k.keyword LIKE '%sequel%' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German', 'USA', 'American') AND t.production_year > 1990 AND t.id = mi.movie_id AND t.id = mk.movie_id AND mk.movie_id = mi.movie_id AND k.id = mk.keyword_id", + "SELECT MIN(mi_idx.info) AS rating, MIN(t.title) AS movie_title FROM info_type AS it, keyword AS k, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE it.info ='rating' AND k.keyword LIKE '%sequel%' AND mi_idx.info > '5.0' AND t.production_year > 2005 AND t.id = mi_idx.movie_id AND t.id = mk.movie_id AND mk.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it.id = mi_idx.info_type_id", + "SELECT MIN(mi_idx.info) AS rating, MIN(t.title) AS movie_title FROM info_type AS it, keyword AS k, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE it.info ='rating' AND k.keyword LIKE '%sequel%' AND mi_idx.info > '9.0' AND t.production_year > 2010 AND t.id = mi_idx.movie_id AND t.id = mk.movie_id AND mk.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it.id = mi_idx.info_type_id", + "SELECT MIN(mi_idx.info) AS rating, MIN(t.title) AS movie_title FROM info_type AS it, keyword AS k, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE it.info ='rating' AND k.keyword LIKE '%sequel%' AND mi_idx.info > '2.0' AND t.production_year > 1990 AND t.id = mi_idx.movie_id AND t.id = mk.movie_id AND mk.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it.id = mi_idx.info_type_id", + "SELECT MIN(t.title) AS typical_european_movie FROM company_type AS ct, info_type AS it, movie_companies AS mc, movie_info AS mi, title AS t WHERE ct.kind = 'production companies' AND mc.note LIKE '%(theatrical)%' AND mc.note LIKE '%(France)%' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German') AND t.production_year > 2005 AND t.id = mi.movie_id AND t.id = mc.movie_id AND mc.movie_id = mi.movie_id AND ct.id = mc.company_type_id AND it.id = mi.info_type_id", + "SELECT MIN(t.title) AS american_vhs_movie FROM company_type AS ct, info_type AS it, movie_companies AS mc, movie_info AS mi, title AS t WHERE ct.kind = 'production companies' AND mc.note LIKE '%(VHS)%' AND mc.note LIKE '%(USA)%' AND mc.note LIKE '%(1994)%' AND mi.info IN ('USA', 'America') AND t.production_year > 2010 AND t.id = mi.movie_id AND t.id = mc.movie_id AND mc.movie_id = mi.movie_id AND ct.id = mc.company_type_id AND it.id = mi.info_type_id", + "SELECT MIN(t.title) AS american_movie FROM company_type AS ct, info_type AS it, movie_companies AS mc, movie_info AS mi, title AS t WHERE ct.kind = 'production companies' AND mc.note NOT LIKE '%(TV)%' AND mc.note LIKE '%(USA)%' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German', 'USA', 'American') AND t.production_year > 1990 AND t.id = mi.movie_id AND t.id = mc.movie_id AND mc.movie_id = mi.movie_id AND ct.id = mc.company_type_id AND it.id = mi.info_type_id", + "SELECT MIN(k.keyword) AS movie_keyword, MIN(n.name) AS actor_name, MIN(t.title) AS marvel_movie FROM cast_info AS ci, keyword AS k, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword = 'marvel-cinematic-universe' AND n.name LIKE '%Downey%Robert%' AND t.production_year > 2010 AND k.id = mk.keyword_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND ci.movie_id = mk.movie_id AND n.id = ci.person_id", + "SELECT MIN(k.keyword) AS movie_keyword, MIN(n.name) AS actor_name, MIN(t.title) AS hero_movie FROM cast_info AS ci, keyword AS k, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword IN ('superhero', 'sequel', 'second-part', 'marvel-comics', 'based-on-comic', 'tv-special', 'fight', 'violence') AND n.name LIKE '%Downey%Robert%' AND t.production_year > 2014 AND k.id = mk.keyword_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND ci.movie_id = mk.movie_id AND n.id = ci.person_id", + "SELECT MIN(k.keyword) AS movie_keyword, MIN(n.name) AS actor_name, MIN(t.title) AS marvel_movie FROM cast_info AS ci, keyword AS k, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword = 'marvel-cinematic-universe' AND n.name LIKE '%Downey%Robert%' AND t.production_year > 2014 AND k.id = mk.keyword_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND ci.movie_id = mk.movie_id AND n.id = ci.person_id", + "SELECT MIN(k.keyword) AS movie_keyword, MIN(n.name) AS actor_name, MIN(t.title) AS hero_movie FROM cast_info AS ci, keyword AS k, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword IN ('superhero', 'sequel', 'second-part', 'marvel-comics', 'based-on-comic', 'tv-special', 'fight', 'violence') AND n.name LIKE '%Downey%Robert%' AND t.production_year > 2000 AND k.id = mk.keyword_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND ci.movie_id = mk.movie_id AND n.id = ci.person_id", + "SELECT MIN(k.keyword) AS movie_keyword, MIN(n.name) AS actor_name, MIN(t.title) AS marvel_movie FROM cast_info AS ci, keyword AS k, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword = 'marvel-cinematic-universe' AND n.name LIKE '%Downey%Robert%' AND t.production_year > 2000 AND k.id = mk.keyword_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND ci.movie_id = mk.movie_id AND n.id = ci.person_id", + "SELECT MIN(k.keyword) AS movie_keyword, MIN(n.name) AS actor_name, MIN(t.title) AS hero_movie FROM cast_info AS ci, keyword AS k, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword IN ('superhero', 'sequel', 'second-part', 'marvel-comics', 'based-on-comic', 'tv-special', 'fight', 'violence') AND t.production_year > 2000 AND k.id = mk.keyword_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND ci.movie_id = mk.movie_id AND n.id = ci.person_id", + "SELECT MIN(n.name) AS of_person, MIN(t.title) AS biography_movie FROM aka_name AS an, cast_info AS ci, info_type AS it, link_type AS lt, movie_link AS ml, name AS n, person_info AS pi, title AS t WHERE an.name LIKE '%a%' AND it.info ='mini biography' AND lt.link ='features' AND n.name_pcode_cf BETWEEN 'A' AND 'F' AND (n.gender='m' OR (n.gender = 'f' AND n.name LIKE 'B%')) AND pi.note ='Volker Boehm' AND t.production_year BETWEEN 1980 AND 1995 AND n.id = an.person_id AND n.id = pi.person_id AND ci.person_id = n.id AND t.id = ci.movie_id AND ml.linked_movie_id = t.id AND lt.id = ml.link_type_id AND it.id = pi.info_type_id AND pi.person_id = an.person_id AND pi.person_id = ci.person_id AND an.person_id = ci.person_id AND ci.movie_id = ml.linked_movie_id", + "SELECT MIN(n.name) AS of_person, MIN(t.title) AS biography_movie FROM aka_name AS an, cast_info AS ci, info_type AS it, link_type AS lt, movie_link AS ml, name AS n, person_info AS pi, title AS t WHERE an.name LIKE '%a%' AND it.info ='mini biography' AND lt.link ='features' AND n.name_pcode_cf LIKE 'D%' AND n.gender='m' AND pi.note ='Volker Boehm' AND t.production_year BETWEEN 1980 AND 1984 AND n.id = an.person_id AND n.id = pi.person_id AND ci.person_id = n.id AND t.id = ci.movie_id AND ml.linked_movie_id = t.id AND lt.id = ml.link_type_id AND it.id = pi.info_type_id AND pi.person_id = an.person_id AND pi.person_id = ci.person_id AND an.person_id = ci.person_id AND ci.movie_id = ml.linked_movie_id", + "SELECT MIN(n.name) AS cast_member_name, MIN(pi.info) AS cast_member_info FROM aka_name AS an, cast_info AS ci, info_type AS it, link_type AS lt, movie_link AS ml, name AS n, person_info AS pi, title AS t WHERE an.name IS NOT NULL AND (an.name LIKE '%a%' OR an.name LIKE 'A%') AND it.info ='mini biography' AND lt.link IN ('references', 'referenced in', 'features', 'featured in') AND n.name_pcode_cf BETWEEN 'A' AND 'F' AND (n.gender='m' OR (n.gender = 'f' AND n.name LIKE 'A%')) AND pi.note IS NOT NULL AND t.production_year BETWEEN 1980 AND 2010 AND n.id = an.person_id AND n.id = pi.person_id AND ci.person_id = n.id AND t.id = ci.movie_id AND ml.linked_movie_id = t.id AND lt.id = ml.link_type_id AND it.id = pi.info_type_id AND pi.person_id = an.person_id AND pi.person_id = ci.person_id AND an.person_id = ci.person_id AND ci.movie_id = ml.linked_movie_id", + "SELECT MIN(an1.name) AS actress_pseudonym, MIN(t.title) AS japanese_movie_dubbed FROM aka_name AS an1, cast_info AS ci, company_name AS cn, movie_companies AS mc, name AS n1, role_type AS rt, title AS t WHERE ci.note ='(voice: English version)' AND cn.country_code ='[jp]' AND mc.note LIKE '%(Japan)%' AND mc.note NOT LIKE '%(USA)%' AND n1.name LIKE '%Yo%' AND n1.name NOT LIKE '%Yu%' AND rt.role ='actress' AND an1.person_id = n1.id AND n1.id = ci.person_id AND ci.movie_id = t.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.role_id = rt.id AND an1.person_id = ci.person_id AND ci.movie_id = mc.movie_id", + "SELECT MIN(an.name) AS acress_pseudonym, MIN(t.title) AS japanese_anime_movie FROM aka_name AS an, cast_info AS ci, company_name AS cn, movie_companies AS mc, name AS n, role_type AS rt, title AS t WHERE ci.note ='(voice: English version)' AND cn.country_code ='[jp]' AND mc.note LIKE '%(Japan)%' AND mc.note NOT LIKE '%(USA)%' AND (mc.note LIKE '%(2006)%' OR mc.note LIKE '%(2007)%') AND n.name LIKE '%Yo%' AND n.name NOT LIKE '%Yu%' AND rt.role ='actress' AND t.production_year BETWEEN 2006 AND 2007 AND (t.title LIKE 'One Piece%' OR t.title LIKE 'Dragon Ball Z%') AND an.person_id = n.id AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.role_id = rt.id AND an.person_id = ci.person_id AND ci.movie_id = mc.movie_id", + "SELECT MIN(a1.name) AS writer_pseudo_name, MIN(t.title) AS movie_title FROM aka_name AS a1, cast_info AS ci, company_name AS cn, movie_companies AS mc, name AS n1, role_type AS rt, title AS t WHERE cn.country_code ='[us]' AND rt.role ='writer' AND a1.person_id = n1.id AND n1.id = ci.person_id AND ci.movie_id = t.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.role_id = rt.id AND a1.person_id = ci.person_id AND ci.movie_id = mc.movie_id", + "SELECT MIN(an1.name) AS costume_designer_pseudo, MIN(t.title) AS movie_with_costumes FROM aka_name AS an1, cast_info AS ci, company_name AS cn, movie_companies AS mc, name AS n1, role_type AS rt, title AS t WHERE cn.country_code ='[us]' AND rt.role ='costume designer' AND an1.person_id = n1.id AND n1.id = ci.person_id AND ci.movie_id = t.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.role_id = rt.id AND an1.person_id = ci.person_id AND ci.movie_id = mc.movie_id", + "SELECT MIN(an.name) AS alternative_name, MIN(chn.name) AS character_name, MIN(t.title) AS movie FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, movie_companies AS mc, name AS n, role_type AS rt, title AS t WHERE ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND mc.note IS NOT NULL AND (mc.note LIKE '%(USA)%' OR mc.note LIKE '%(worldwide)%') AND n.gender ='f' AND n.name LIKE '%Ang%' AND rt.role ='actress' AND t.production_year BETWEEN 2005 AND 2015 AND ci.movie_id = t.id AND t.id = mc.movie_id AND ci.movie_id = mc.movie_id AND mc.company_id = cn.id AND ci.role_id = rt.id AND n.id = ci.person_id AND chn.id = ci.person_role_id AND an.person_id = n.id AND an.person_id = ci.person_id", + "SELECT MIN(an.name) AS alternative_name, MIN(chn.name) AS voiced_character, MIN(n.name) AS voicing_actress, MIN(t.title) AS american_movie FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, movie_companies AS mc, name AS n, role_type AS rt, title AS t WHERE ci.note = '(voice)' AND cn.country_code ='[us]' AND mc.note LIKE '%(200%)%' AND (mc.note LIKE '%(USA)%' OR mc.note LIKE '%(worldwide)%') AND n.gender ='f' AND n.name LIKE '%Angel%' AND rt.role ='actress' AND t.production_year BETWEEN 2007 AND 2010 AND ci.movie_id = t.id AND t.id = mc.movie_id AND ci.movie_id = mc.movie_id AND mc.company_id = cn.id AND ci.role_id = rt.id AND n.id = ci.person_id AND chn.id = ci.person_role_id AND an.person_id = n.id AND an.person_id = ci.person_id", + "SELECT MIN(an.name) AS alternative_name, MIN(chn.name) AS voiced_character_name, MIN(n.name) AS voicing_actress, MIN(t.title) AS american_movie FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, movie_companies AS mc, name AS n, role_type AS rt, title AS t WHERE ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND n.gender ='f' AND n.name LIKE '%An%' AND rt.role ='actress' AND ci.movie_id = t.id AND t.id = mc.movie_id AND ci.movie_id = mc.movie_id AND mc.company_id = cn.id AND ci.role_id = rt.id AND n.id = ci.person_id AND chn.id = ci.person_role_id AND an.person_id = n.id AND an.person_id = ci.person_id", + "SELECT MIN(an.name) AS alternative_name, MIN(chn.name) AS voiced_char_name, MIN(n.name) AS voicing_actress, MIN(t.title) AS american_movie FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, movie_companies AS mc, name AS n, role_type AS rt, title AS t WHERE ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND n.gender ='f' AND rt.role ='actress' AND ci.movie_id = t.id AND t.id = mc.movie_id AND ci.movie_id = mc.movie_id AND mc.company_id = cn.id AND ci.role_id = rt.id AND n.id = ci.person_id AND chn.id = ci.person_role_id AND an.person_id = n.id AND an.person_id = ci.person_id", + "SELECT MIN(chn.name) AS uncredited_voiced_character, MIN(t.title) AS russian_movie FROM char_name AS chn, cast_info AS ci, company_name AS cn, company_type AS ct, movie_companies AS mc, role_type AS rt, title AS t WHERE ci.note LIKE '%(voice)%' AND ci.note LIKE '%(uncredited)%' AND cn.country_code = '[ru]' AND rt.role = 'actor' AND t.production_year > 2005 AND t.id = mc.movie_id AND t.id = ci.movie_id AND ci.movie_id = mc.movie_id AND chn.id = ci.person_role_id AND rt.id = ci.role_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id", + "SELECT MIN(chn.name) AS character, MIN(t.title) AS russian_mov_with_actor_producer FROM char_name AS chn, cast_info AS ci, company_name AS cn, company_type AS ct, movie_companies AS mc, role_type AS rt, title AS t WHERE ci.note LIKE '%(producer)%' AND cn.country_code = '[ru]' AND rt.role = 'actor' AND t.production_year > 2010 AND t.id = mc.movie_id AND t.id = ci.movie_id AND ci.movie_id = mc.movie_id AND chn.id = ci.person_role_id AND rt.id = ci.role_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id", + "SELECT MIN(chn.name) AS character, MIN(t.title) AS movie_with_american_producer FROM char_name AS chn, cast_info AS ci, company_name AS cn, company_type AS ct, movie_companies AS mc, role_type AS rt, title AS t WHERE ci.note LIKE '%(producer)%' AND cn.country_code = '[us]' AND t.production_year > 1990 AND t.id = mc.movie_id AND t.id = ci.movie_id AND ci.movie_id = mc.movie_id AND chn.id = ci.person_role_id AND rt.id = ci.role_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id", + "SELECT MIN(cn.name) AS from_company, MIN(lt.link) AS movie_link_type, MIN(t.title) AS non_polish_sequel_movie FROM company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cn.country_code !='[pl]' AND (cn.name LIKE '%Film%' OR cn.name LIKE '%Warner%') AND ct.kind ='production companies' AND k.keyword ='sequel' AND lt.link LIKE '%follow%' AND mc.note IS NULL AND t.production_year BETWEEN 1950 AND 2000 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id", + "SELECT MIN(cn.name) AS from_company, MIN(lt.link) AS movie_link_type, MIN(t.title) AS sequel_movie FROM company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cn.country_code !='[pl]' AND (cn.name LIKE '%Film%' OR cn.name LIKE '%Warner%') AND ct.kind ='production companies' AND k.keyword ='sequel' AND lt.link LIKE '%follows%' AND mc.note IS NULL AND t.production_year = 1998 AND t.title LIKE '%Money%' AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id", + "SELECT MIN(cn.name) AS from_company, MIN(mc.note) AS production_note, MIN(t.title) AS movie_based_on_book FROM company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cn.country_code !='[pl]' AND (cn.name LIKE '20th Century Fox%' OR cn.name LIKE 'Twentieth Century Fox%') AND ct.kind != 'production companies' AND ct.kind IS NOT NULL AND k.keyword IN ('sequel', 'revenge', 'based-on-novel') AND mc.note IS NOT NULL AND t.production_year > 1950 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id", + "SELECT MIN(cn.name) AS from_company, MIN(mc.note) AS production_note, MIN(t.title) AS movie_based_on_book FROM company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cn.country_code !='[pl]' AND ct.kind != 'production companies' AND ct.kind IS NOT NULL AND k.keyword IN ('sequel', 'revenge', 'based-on-novel') AND mc.note IS NOT NULL AND t.production_year > 1950 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS drama_horror_movie FROM company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, title AS t WHERE cn.country_code = '[us]' AND ct.kind = 'production companies' AND it1.info = 'genres' AND it2.info = 'rating' AND mi.info IN ('Drama', 'Horror') AND mi_idx.info > '8.0' AND t.production_year BETWEEN 2005 AND 2008 AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND mi.info_type_id = it1.id AND mi_idx.info_type_id = it2.id AND t.id = mc.movie_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id AND mc.movie_id = mi.movie_id AND mc.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id", + "SELECT MIN(mi.info) AS budget, MIN(t.title) AS unsuccsessful_movie FROM company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, title AS t WHERE cn.country_code ='[us]' AND ct.kind IS NOT NULL AND (ct.kind ='production companies' OR ct.kind = 'distributors') AND it1.info ='budget' AND it2.info ='bottom 10 rank' AND t.production_year >2000 AND (t.title LIKE 'Birdemic%' OR t.title LIKE '%Movie%') AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND mi.info_type_id = it1.id AND mi_idx.info_type_id = it2.id AND t.id = mc.movie_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id AND mc.movie_id = mi.movie_id AND mc.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS mainstream_movie FROM company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, title AS t WHERE cn.country_code = '[us]' AND ct.kind = 'production companies' AND it1.info = 'genres' AND it2.info = 'rating' AND mi.info IN ('Drama', 'Horror', 'Western', 'Family') AND mi_idx.info > '7.0' AND t.production_year BETWEEN 2000 AND 2010 AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND mi.info_type_id = it1.id AND mi_idx.info_type_id = it2.id AND t.id = mc.movie_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id AND mc.movie_id = mi.movie_id AND mc.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id", + "SELECT MIN(mi.info) AS release_date, MIN(miidx.info) AS rating, MIN(t.title) AS german_movie FROM company_name AS cn, company_type AS ct, info_type AS it, info_type AS it2, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS miidx, title AS t WHERE cn.country_code ='[de]' AND ct.kind ='production companies' AND it.info ='rating' AND it2.info ='release dates' AND kt.kind ='movie' AND mi.movie_id = t.id AND it2.id = mi.info_type_id AND kt.id = t.kind_id AND mc.movie_id = t.id AND cn.id = mc.company_id AND ct.id = mc.company_type_id AND miidx.movie_id = t.id AND it.id = miidx.info_type_id AND mi.movie_id = miidx.movie_id AND mi.movie_id = mc.movie_id AND miidx.movie_id = mc.movie_id", + "SELECT MIN(cn.name) AS producing_company, MIN(miidx.info) AS rating, MIN(t.title) AS movie_about_winning FROM company_name AS cn, company_type AS ct, info_type AS it, info_type AS it2, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS miidx, title AS t WHERE cn.country_code ='[us]' AND ct.kind ='production companies' AND it.info ='rating' AND it2.info ='release dates' AND kt.kind ='movie' AND t.title != '' AND (t.title LIKE '%Champion%' OR t.title LIKE '%Loser%') AND mi.movie_id = t.id AND it2.id = mi.info_type_id AND kt.id = t.kind_id AND mc.movie_id = t.id AND cn.id = mc.company_id AND ct.id = mc.company_type_id AND miidx.movie_id = t.id AND it.id = miidx.info_type_id AND mi.movie_id = miidx.movie_id AND mi.movie_id = mc.movie_id AND miidx.movie_id = mc.movie_id", + "SELECT MIN(cn.name) AS producing_company, MIN(miidx.info) AS rating, MIN(t.title) AS movie_about_winning FROM company_name AS cn, company_type AS ct, info_type AS it, info_type AS it2, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS miidx, title AS t WHERE cn.country_code ='[us]' AND ct.kind ='production companies' AND it.info ='rating' AND it2.info ='release dates' AND kt.kind ='movie' AND t.title != '' AND (t.title LIKE 'Champion%' OR t.title LIKE 'Loser%') AND mi.movie_id = t.id AND it2.id = mi.info_type_id AND kt.id = t.kind_id AND mc.movie_id = t.id AND cn.id = mc.company_id AND ct.id = mc.company_type_id AND miidx.movie_id = t.id AND it.id = miidx.info_type_id AND mi.movie_id = miidx.movie_id AND mi.movie_id = mc.movie_id AND miidx.movie_id = mc.movie_id", + "SELECT MIN(cn.name) AS producing_company, MIN(miidx.info) AS rating, MIN(t.title) AS movie FROM company_name AS cn, company_type AS ct, info_type AS it, info_type AS it2, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS miidx, title AS t WHERE cn.country_code ='[us]' AND ct.kind ='production companies' AND it.info ='rating' AND it2.info ='release dates' AND kt.kind ='movie' AND mi.movie_id = t.id AND it2.id = mi.info_type_id AND kt.id = t.kind_id AND mc.movie_id = t.id AND cn.id = mc.company_id AND ct.id = mc.company_type_id AND miidx.movie_id = t.id AND it.id = miidx.info_type_id AND mi.movie_id = miidx.movie_id AND mi.movie_id = mc.movie_id AND miidx.movie_id = mc.movie_id", + "SELECT MIN(mi_idx.info) AS rating, MIN(t.title) AS northern_dark_movie FROM info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind = 'movie' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German', 'USA', 'American') AND mi_idx.info < '8.5' AND t.production_year > 2010 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(mi_idx.info) AS rating, MIN(t.title) AS western_dark_production FROM info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title') AND kt.kind = 'movie' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German', 'USA', 'American') AND mi_idx.info > '6.0' AND t.production_year > 2010 AND (t.title LIKE '%murder%' OR t.title LIKE '%Murder%' OR t.title LIKE '%Mord%') AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(mi_idx.info) AS rating, MIN(t.title) AS north_european_dark_production FROM info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IS NOT NULL AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind IN ('movie', 'episode') AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Danish', 'Norwegian', 'German', 'USA', 'American') AND mi_idx.info < '8.5' AND t.production_year > 2005 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(mi.info) AS release_date, MIN(t.title) AS internet_movie FROM aka_title AS at, company_name AS cn, company_type AS ct, info_type AS it1, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, title AS t WHERE cn.country_code = '[us]' AND it1.info = 'release dates' AND mc.note LIKE '%(200%)%' AND mc.note LIKE '%(worldwide)%' AND mi.note LIKE '%internet%' AND mi.info LIKE 'USA:% 200%' AND t.production_year > 2000 AND t.id = at.movie_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = at.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = at.movie_id AND mc.movie_id = at.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id", + "SELECT MIN(mi.info) AS release_date, MIN(t.title) AS youtube_movie FROM aka_title AS at, company_name AS cn, company_type AS ct, info_type AS it1, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, title AS t WHERE cn.country_code = '[us]' AND cn.name = 'YouTube' AND it1.info = 'release dates' AND mc.note LIKE '%(200%)%' AND mc.note LIKE '%(worldwide)%' AND mi.note LIKE '%internet%' AND mi.info LIKE 'USA:% 200%' AND t.production_year BETWEEN 2005 AND 2010 AND t.id = at.movie_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = at.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = at.movie_id AND mc.movie_id = at.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id", + "SELECT MIN(mi.info) AS release_date, MIN(t.title) AS modern_american_internet_movie FROM aka_title AS at, company_name AS cn, company_type AS ct, info_type AS it1, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, title AS t WHERE cn.country_code = '[us]' AND it1.info = 'release dates' AND mi.note LIKE '%internet%' AND mi.info IS NOT NULL AND (mi.info LIKE 'USA:% 199%' OR mi.info LIKE 'USA:% 200%') AND t.production_year > 1990 AND t.id = at.movie_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = at.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = at.movie_id AND mc.movie_id = at.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id", + "SELECT MIN(at.title) AS aka_title, MIN(t.title) AS internet_movie_title FROM aka_title AS at, company_name AS cn, company_type AS ct, info_type AS it1, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, title AS t WHERE cn.country_code = '[us]' AND it1.info = 'release dates' AND mi.note LIKE '%internet%' AND t.production_year > 1990 AND t.id = at.movie_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = at.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = at.movie_id AND mc.movie_id = at.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id", + "SELECT MIN(an.name) AS cool_actor_pseudonym, MIN(t.title) AS series_named_after_char FROM aka_name AS an, cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE cn.country_code ='[us]' AND k.keyword ='character-name-in-title' AND t.episode_nr >= 50 AND t.episode_nr < 100 AND an.person_id = n.id AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND an.person_id = ci.person_id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(an.name) AS cool_actor_pseudonym, MIN(t.title) AS series_named_after_char FROM aka_name AS an, cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE cn.country_code ='[us]' AND k.keyword ='character-name-in-title' AND an.person_id = n.id AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND an.person_id = ci.person_id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(an.name) AS cool_actor_pseudonym, MIN(t.title) AS series_named_after_char FROM aka_name AS an, cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE cn.country_code ='[us]' AND k.keyword ='character-name-in-title' AND t.episode_nr < 100 AND an.person_id = n.id AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND an.person_id = ci.person_id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(an.name) AS cool_actor_pseudonym, MIN(t.title) AS series_named_after_char FROM aka_name AS an, cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE cn.country_code ='[us]' AND k.keyword ='character-name-in-title' AND t.episode_nr >= 5 AND t.episode_nr < 100 AND an.person_id = n.id AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND an.person_id = ci.person_id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(n.name) AS member_in_charnamed_american_movie, MIN(n.name) AS a1 FROM cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE cn.country_code ='[us]' AND k.keyword ='character-name-in-title' AND n.name LIKE 'B%' AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(n.name) AS member_in_charnamed_movie, MIN(n.name) AS a1 FROM cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword ='character-name-in-title' AND n.name LIKE 'Z%' AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(n.name) AS member_in_charnamed_movie, MIN(n.name) AS a1 FROM cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword ='character-name-in-title' AND n.name LIKE 'X%' AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(n.name) AS member_in_charnamed_movie FROM cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword ='character-name-in-title' AND n.name LIKE '%Bert%' AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(n.name) AS member_in_charnamed_movie FROM cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE cn.country_code ='[us]' AND k.keyword ='character-name-in-title' AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(n.name) AS member_in_charnamed_movie FROM cast_info AS ci, company_name AS cn, keyword AS k, movie_companies AS mc, movie_keyword AS mk, name AS n, title AS t WHERE k.keyword ='character-name-in-title' AND n.name LIKE '%B%' AND n.id = ci.person_id AND ci.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_id = cn.id AND ci.movie_id = mc.movie_id AND ci.movie_id = mk.movie_id AND mc.movie_id = mk.movie_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(t.title) AS movie_title FROM cast_info AS ci, info_type AS it1, info_type AS it2, movie_info AS mi, movie_info_idx AS mi_idx, name AS n, title AS t WHERE ci.note IN ('(producer)', '(executive producer)') AND it1.info = 'budget' AND it2.info = 'votes' AND n.gender = 'm' AND n.name LIKE '%Tim%' AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(t.title) AS movie_title FROM cast_info AS ci, info_type AS it1, info_type AS it2, movie_info AS mi, movie_info_idx AS mi_idx, name AS n, title AS t WHERE ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND it1.info = 'genres' AND it2.info = 'rating' AND mi.info IN ('Horror', 'Thriller') AND mi.note IS NULL AND mi_idx.info > '8.0' AND n.gender IS NOT NULL AND n.gender = 'f' AND t.production_year BETWEEN 2008 AND 2014 AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(t.title) AS movie_title FROM cast_info AS ci, info_type AS it1, info_type AS it2, movie_info AS mi, movie_info_idx AS mi_idx, name AS n, title AS t WHERE ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND it1.info = 'genres' AND it2.info = 'votes' AND mi.info IN ('Horror', 'Action', 'Sci-Fi', 'Thriller', 'Crime', 'War') AND n.gender = 'm' AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND mi.movie_id = mi_idx.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(n.name) AS voicing_actress, MIN(t.title) AS voiced_movie FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, movie_companies AS mc, movie_info AS mi, name AS n, role_type AS rt, title AS t WHERE ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND it.info = 'release dates' AND mc.note IS NOT NULL AND (mc.note LIKE '%(USA)%' OR mc.note LIKE '%(worldwide)%') AND mi.info IS NOT NULL AND (mi.info LIKE 'Japan:%200%' OR mi.info LIKE 'USA:%200%') AND n.gender ='f' AND n.name LIKE '%Ang%' AND rt.role ='actress' AND t.production_year BETWEEN 2005 AND 2009 AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mi.movie_id = ci.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id", + "SELECT MIN(n.name) AS voicing_actress, MIN(t.title) AS kung_fu_panda FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, movie_companies AS mc, movie_info AS mi, name AS n, role_type AS rt, title AS t WHERE ci.note = '(voice)' AND cn.country_code ='[us]' AND it.info = 'release dates' AND mc.note LIKE '%(200%)%' AND (mc.note LIKE '%(USA)%' OR mc.note LIKE '%(worldwide)%') AND mi.info IS NOT NULL AND (mi.info LIKE 'Japan:%2007%' OR mi.info LIKE 'USA:%2008%') AND n.gender ='f' AND n.name LIKE '%Angel%' AND rt.role ='actress' AND t.production_year BETWEEN 2007 AND 2008 AND t.title LIKE '%Kung%Fu%Panda%' AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mi.movie_id = ci.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id", + "SELECT MIN(n.name) AS voicing_actress, MIN(t.title) AS jap_engl_voiced_movie FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, movie_companies AS mc, movie_info AS mi, name AS n, role_type AS rt, title AS t WHERE ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND it.info = 'release dates' AND mi.info IS NOT NULL AND (mi.info LIKE 'Japan:%200%' OR mi.info LIKE 'USA:%200%') AND n.gender ='f' AND n.name LIKE '%An%' AND rt.role ='actress' AND t.production_year > 2000 AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mi.movie_id = ci.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id", + "SELECT MIN(n.name) AS voicing_actress, MIN(t.title) AS jap_engl_voiced_movie FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, movie_companies AS mc, movie_info AS mi, name AS n, role_type AS rt, title AS t WHERE ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND it.info = 'release dates' AND n.gender ='f' AND rt.role ='actress' AND t.production_year > 2000 AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mi.movie_id = ci.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id", + "SELECT MIN(t.title) AS complete_downey_ironman_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, keyword AS k, kind_type AS kt, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind = 'cast' AND cct2.kind LIKE '%complete%' AND chn.name NOT LIKE '%Sherlock%' AND (chn.name LIKE '%Tony%Stark%' OR chn.name LIKE '%Iron%Man%') AND k.keyword IN ('superhero', 'sequel', 'second-part', 'marvel-comics', 'based-on-comic', 'tv-special', 'fight', 'violence') AND kt.kind = 'movie' AND t.production_year > 1950 AND kt.id = t.kind_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND t.id = cc.movie_id AND mk.movie_id = ci.movie_id AND mk.movie_id = cc.movie_id AND ci.movie_id = cc.movie_id AND chn.id = ci.person_role_id AND n.id = ci.person_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(t.title) AS complete_downey_ironman_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, keyword AS k, kind_type AS kt, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind = 'cast' AND cct2.kind LIKE '%complete%' AND chn.name NOT LIKE '%Sherlock%' AND (chn.name LIKE '%Tony%Stark%' OR chn.name LIKE '%Iron%Man%') AND k.keyword IN ('superhero', 'sequel', 'second-part', 'marvel-comics', 'based-on-comic', 'tv-special', 'fight', 'violence') AND kt.kind = 'movie' AND n.name LIKE '%Downey%Robert%' AND t.production_year > 2000 AND kt.id = t.kind_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND t.id = cc.movie_id AND mk.movie_id = ci.movie_id AND mk.movie_id = cc.movie_id AND ci.movie_id = cc.movie_id AND chn.id = ci.person_role_id AND n.id = ci.person_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(n.name) AS cast_member, MIN(t.title) AS complete_dynamic_hero_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, keyword AS k, kind_type AS kt, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind = 'cast' AND cct2.kind LIKE '%complete%' AND chn.name IS NOT NULL AND (chn.name LIKE '%man%' OR chn.name LIKE '%Man%') AND k.keyword IN ('superhero', 'marvel-comics', 'based-on-comic', 'tv-special', 'fight', 'violence', 'magnet', 'web', 'claw', 'laser') AND kt.kind = 'movie' AND t.production_year > 2000 AND kt.id = t.kind_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND t.id = cc.movie_id AND mk.movie_id = ci.movie_id AND mk.movie_id = cc.movie_id AND ci.movie_id = cc.movie_id AND chn.id = ci.person_role_id AND n.id = ci.person_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(cn.name) AS company_name, MIN(lt.link) AS link_type, MIN(t.title) AS western_follow_up FROM company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cn.country_code !='[pl]' AND (cn.name LIKE '%Film%' OR cn.name LIKE '%Warner%') AND ct.kind ='production companies' AND k.keyword ='sequel' AND lt.link LIKE '%follow%' AND mc.note IS NULL AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German') AND t.production_year BETWEEN 1950 AND 2000 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND mi.movie_id = t.id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND ml.movie_id = mi.movie_id AND mk.movie_id = mi.movie_id AND mc.movie_id = mi.movie_id", + "SELECT MIN(cn.name) AS company_name, MIN(lt.link) AS link_type, MIN(t.title) AS german_follow_up FROM company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cn.country_code !='[pl]' AND (cn.name LIKE '%Film%' OR cn.name LIKE '%Warner%') AND ct.kind ='production companies' AND k.keyword ='sequel' AND lt.link LIKE '%follow%' AND mc.note IS NULL AND mi.info IN ('Germany', 'German') AND t.production_year BETWEEN 2000 AND 2010 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND mi.movie_id = t.id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND ml.movie_id = mi.movie_id AND mk.movie_id = mi.movie_id AND mc.movie_id = mi.movie_id", + "SELECT MIN(cn.name) AS company_name, MIN(lt.link) AS link_type, MIN(t.title) AS western_follow_up FROM company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cn.country_code !='[pl]' AND (cn.name LIKE '%Film%' OR cn.name LIKE '%Warner%') AND ct.kind ='production companies' AND k.keyword ='sequel' AND lt.link LIKE '%follow%' AND mc.note IS NULL AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German', 'English') AND t.production_year BETWEEN 1950 AND 2010 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND mi.movie_id = t.id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND ml.movie_id = mi.movie_id AND mk.movie_id = mi.movie_id AND mc.movie_id = mi.movie_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS western_violent_movie FROM company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE cn.country_code != '[us]' AND it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind IN ('movie', 'episode') AND mc.note NOT LIKE '%(USA)%' AND mc.note LIKE '%(200%)%' AND mi.info IN ('Germany', 'German', 'USA', 'American') AND mi_idx.info < '7.0' AND t.production_year > 2008 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND t.id = mc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mk.movie_id = mc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mc.movie_id AND mc.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS western_violent_movie FROM company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE cn.country_code != '[us]' AND it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind IN ('movie', 'episode') AND mc.note NOT LIKE '%(USA)%' AND mc.note LIKE '%(200%)%' AND mi.info IN ('Germany', 'German', 'USA', 'American') AND mi_idx.info < '7.0' AND t.production_year > 2009 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND t.id = mc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mk.movie_id = mc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mc.movie_id AND mc.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS western_violent_movie FROM company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE cn.country_code != '[us]' AND it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind IN ('movie', 'episode') AND mc.note NOT LIKE '%(USA)%' AND mc.note LIKE '%(200%)%' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Danish', 'Norwegian', 'German', 'USA', 'American') AND mi_idx.info < '8.5' AND t.production_year > 2005 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND t.id = mc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mk.movie_id = mc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mc.movie_id AND mc.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS western_violent_movie FROM company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE cn.country_code != '[us]' AND it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind IN ('movie', 'episode') AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Danish', 'Norwegian', 'German', 'USA', 'American') AND mi_idx.info < '8.5' AND t.production_year > 2005 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND t.id = mc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mk.movie_id = mc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mc.movie_id AND mc.movie_id = mi_idx.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id", + "SELECT MIN(kt.kind) AS movie_kind, MIN(t.title) AS complete_us_internet_movie FROM complete_cast AS cc, comp_cast_type AS cct1, company_name AS cn, company_type AS ct, info_type AS it1, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, title AS t WHERE cct1.kind = 'complete+verified' AND cn.country_code = '[us]' AND it1.info = 'release dates' AND kt.kind IN ('movie') AND mi.note LIKE '%internet%' AND mi.info IS NOT NULL AND (mi.info LIKE 'USA:% 199%' OR mi.info LIKE 'USA:% 200%') AND t.production_year > 2000 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND t.id = cc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = cc.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = cc.movie_id AND mc.movie_id = cc.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id AND cct1.id = cc.status_id", + "SELECT MIN(kt.kind) AS movie_kind, MIN(t.title) AS complete_nerdy_internet_movie FROM complete_cast AS cc, comp_cast_type AS cct1, company_name AS cn, company_type AS ct, info_type AS it1, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, title AS t WHERE cct1.kind = 'complete+verified' AND cn.country_code = '[us]' AND it1.info = 'release dates' AND k.keyword IN ('nerd', 'loner', 'alienation', 'dignity') AND kt.kind IN ('movie') AND mi.note LIKE '%internet%' AND mi.info LIKE 'USA:% 200%' AND t.production_year > 2000 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND t.id = cc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = cc.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = cc.movie_id AND mc.movie_id = cc.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id AND cct1.id = cc.status_id", + "SELECT MIN(kt.kind) AS movie_kind, MIN(t.title) AS complete_us_internet_movie FROM complete_cast AS cc, comp_cast_type AS cct1, company_name AS cn, company_type AS ct, info_type AS it1, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, title AS t WHERE cct1.kind = 'complete+verified' AND cn.country_code = '[us]' AND it1.info = 'release dates' AND kt.kind IN ('movie', 'tv movie', 'video movie', 'video game') AND mi.note LIKE '%internet%' AND mi.info IS NOT NULL AND (mi.info LIKE 'USA:% 199%' OR mi.info LIKE 'USA:% 200%') AND t.production_year > 1990 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND t.id = cc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = cc.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = cc.movie_id AND mc.movie_id = cc.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND cn.id = mc.company_id AND ct.id = mc.company_type_id AND cct1.id = cc.status_id", + "SELECT MIN(chn.name) AS voiced_char_name, MIN(n.name) AS voicing_actress_name, MIN(t.title) AS voiced_action_movie_jap_eng FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, name AS n, role_type AS rt, title AS t WHERE ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND it.info = 'release dates' AND k.keyword IN ('hero', 'martial-arts', 'hand-to-hand-combat') AND mi.info IS NOT NULL AND (mi.info LIKE 'Japan:%201%' OR mi.info LIKE 'USA:%201%') AND n.gender ='f' AND n.name LIKE '%An%' AND rt.role ='actress' AND t.production_year > 2010 AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mc.movie_id = mk.movie_id AND mi.movie_id = ci.movie_id AND mi.movie_id = mk.movie_id AND ci.movie_id = mk.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id AND k.id = mk.keyword_id", + "SELECT MIN(chn.name) AS voiced_char_name, MIN(n.name) AS voicing_actress_name, MIN(t.title) AS kung_fu_panda FROM aka_name AS an, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, name AS n, role_type AS rt, title AS t WHERE ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND cn.name = 'DreamWorks Animation' AND it.info = 'release dates' AND k.keyword IN ('hero', 'martial-arts', 'hand-to-hand-combat', 'computer-animated-movie') AND mi.info IS NOT NULL AND (mi.info LIKE 'Japan:%201%' OR mi.info LIKE 'USA:%201%') AND n.gender ='f' AND n.name LIKE '%An%' AND rt.role ='actress' AND t.production_year > 2010 AND t.title LIKE 'Kung Fu Panda%' AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mc.movie_id = mk.movie_id AND mi.movie_id = ci.movie_id AND mi.movie_id = mk.movie_id AND ci.movie_id = mk.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id AND k.id = mk.keyword_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS male_writer, MIN(t.title) AS violent_movie_title FROM cast_info AS ci, info_type AS it1, info_type AS it2, keyword AS k, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'blood', 'gore', 'death', 'female-nudity') AND mi.info = 'Horror' AND n.gender = 'm' AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi_idx.movie_id = mk.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS male_writer, MIN(t.title) AS violent_movie_title FROM cast_info AS ci, info_type AS it1, info_type AS it2, keyword AS k, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'blood', 'gore', 'death', 'female-nudity') AND mi.info = 'Horror' AND n.gender = 'm' AND t.production_year > 2010 AND t.title LIKE 'Vampire%' AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi_idx.movie_id = mk.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS male_writer, MIN(t.title) AS violent_movie_title FROM cast_info AS ci, info_type AS it1, info_type AS it2, keyword AS k, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'violence', 'blood', 'gore', 'death', 'female-nudity', 'hospital') AND mi.info IN ('Horror', 'Action', 'Sci-Fi', 'Thriller', 'Crime', 'War') AND n.gender = 'm' AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi_idx.movie_id = mk.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id", + "SELECT MIN(chn.name) AS character_name, MIN(mi_idx.info) AS rating, MIN(n.name) AS playing_actor, MIN(t.title) AS complete_hero_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, info_type AS it2, keyword AS k, kind_type AS kt, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind = 'cast' AND cct2.kind LIKE '%complete%' AND chn.name IS NOT NULL AND (chn.name LIKE '%man%' OR chn.name LIKE '%Man%') AND it2.info = 'rating' AND k.keyword IN ('superhero', 'marvel-comics', 'based-on-comic', 'tv-special', 'fight', 'violence', 'magnet', 'web', 'claw', 'laser') AND kt.kind = 'movie' AND mi_idx.info > '7.0' AND t.production_year > 2000 AND kt.id = t.kind_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND t.id = cc.movie_id AND t.id = mi_idx.movie_id AND mk.movie_id = ci.movie_id AND mk.movie_id = cc.movie_id AND mk.movie_id = mi_idx.movie_id AND ci.movie_id = cc.movie_id AND ci.movie_id = mi_idx.movie_id AND cc.movie_id = mi_idx.movie_id AND chn.id = ci.person_role_id AND n.id = ci.person_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(chn.name) AS character_name, MIN(mi_idx.info) AS rating, MIN(t.title) AS complete_hero_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, info_type AS it2, keyword AS k, kind_type AS kt, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind = 'cast' AND cct2.kind LIKE '%complete%' AND chn.name IS NOT NULL AND (chn.name LIKE '%man%' OR chn.name LIKE '%Man%') AND it2.info = 'rating' AND k.keyword IN ('superhero', 'marvel-comics', 'based-on-comic', 'fight') AND kt.kind = 'movie' AND mi_idx.info > '8.0' AND t.production_year > 2005 AND kt.id = t.kind_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND t.id = cc.movie_id AND t.id = mi_idx.movie_id AND mk.movie_id = ci.movie_id AND mk.movie_id = cc.movie_id AND mk.movie_id = mi_idx.movie_id AND ci.movie_id = cc.movie_id AND ci.movie_id = mi_idx.movie_id AND cc.movie_id = mi_idx.movie_id AND chn.id = ci.person_role_id AND n.id = ci.person_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(chn.name) AS character_name, MIN(mi_idx.info) AS rating, MIN(t.title) AS complete_hero_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, info_type AS it2, keyword AS k, kind_type AS kt, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind = 'cast' AND cct2.kind LIKE '%complete%' AND chn.name IS NOT NULL AND (chn.name LIKE '%man%' OR chn.name LIKE '%Man%') AND it2.info = 'rating' AND k.keyword IN ('superhero', 'marvel-comics', 'based-on-comic', 'tv-special', 'fight', 'violence', 'magnet', 'web', 'claw', 'laser') AND kt.kind = 'movie' AND t.production_year > 2000 AND kt.id = t.kind_id AND t.id = mk.movie_id AND t.id = ci.movie_id AND t.id = cc.movie_id AND t.id = mi_idx.movie_id AND mk.movie_id = ci.movie_id AND mk.movie_id = cc.movie_id AND mk.movie_id = mi_idx.movie_id AND ci.movie_id = cc.movie_id AND ci.movie_id = mi_idx.movie_id AND cc.movie_id = mi_idx.movie_id AND chn.id = ci.person_role_id AND n.id = ci.person_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id AND it2.id = mi_idx.info_type_id", + "SELECT MIN(cn.name) AS producing_company, MIN(lt.link) AS link_type, MIN(t.title) AS complete_western_sequel FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cct1.kind IN ('cast', 'crew') AND cct2.kind = 'complete' AND cn.country_code !='[pl]' AND (cn.name LIKE '%Film%' OR cn.name LIKE '%Warner%') AND ct.kind ='production companies' AND k.keyword ='sequel' AND lt.link LIKE '%follow%' AND mc.note IS NULL AND mi.info IN ('Sweden', 'Germany', 'Swedish', 'German') AND t.production_year BETWEEN 1950 AND 2000 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND mi.movie_id = t.id AND t.id = cc.movie_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND ml.movie_id = mi.movie_id AND mk.movie_id = mi.movie_id AND mc.movie_id = mi.movie_id AND ml.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND mc.movie_id = cc.movie_id AND mi.movie_id = cc.movie_id", + "SELECT MIN(cn.name) AS producing_company, MIN(lt.link) AS link_type, MIN(t.title) AS complete_western_sequel FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cct1.kind IN ('cast', 'crew') AND cct2.kind = 'complete' AND cn.country_code !='[pl]' AND (cn.name LIKE '%Film%' OR cn.name LIKE '%Warner%') AND ct.kind ='production companies' AND k.keyword ='sequel' AND lt.link LIKE '%follow%' AND mc.note IS NULL AND mi.info IN ('Sweden', 'Germany', 'Swedish', 'German') AND t.production_year = 1998 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND mi.movie_id = t.id AND t.id = cc.movie_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND ml.movie_id = mi.movie_id AND mk.movie_id = mi.movie_id AND mc.movie_id = mi.movie_id AND ml.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND mc.movie_id = cc.movie_id AND mi.movie_id = cc.movie_id", + "SELECT MIN(cn.name) AS producing_company, MIN(lt.link) AS link_type, MIN(t.title) AS complete_western_sequel FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, company_name AS cn, company_type AS ct, keyword AS k, link_type AS lt, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, movie_link AS ml, title AS t WHERE cct1.kind = 'cast' AND cct2.kind LIKE 'complete%' AND cn.country_code !='[pl]' AND (cn.name LIKE '%Film%' OR cn.name LIKE '%Warner%') AND ct.kind ='production companies' AND k.keyword ='sequel' AND lt.link LIKE '%follow%' AND mc.note IS NULL AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Denish', 'Norwegian', 'German', 'English') AND t.production_year BETWEEN 1950 AND 2010 AND lt.id = ml.link_type_id AND ml.movie_id = t.id AND t.id = mk.movie_id AND mk.keyword_id = k.id AND t.id = mc.movie_id AND mc.company_type_id = ct.id AND mc.company_id = cn.id AND mi.movie_id = t.id AND t.id = cc.movie_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id AND ml.movie_id = mk.movie_id AND ml.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND ml.movie_id = mi.movie_id AND mk.movie_id = mi.movie_id AND mc.movie_id = mi.movie_id AND ml.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND mc.movie_id = cc.movie_id AND mi.movie_id = cc.movie_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS complete_euro_dark_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE cct1.kind = 'crew' AND cct2.kind != 'complete+verified' AND cn.country_code != '[us]' AND it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind IN ('movie', 'episode') AND mc.note NOT LIKE '%(USA)%' AND mc.note LIKE '%(200%)%' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Danish', 'Norwegian', 'German', 'USA', 'American') AND mi_idx.info < '8.5' AND t.production_year > 2000 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND t.id = mc.movie_id AND t.id = cc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = cc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = cc.movie_id AND mc.movie_id = mi_idx.movie_id AND mc.movie_id = cc.movie_id AND mi_idx.movie_id = cc.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS complete_euro_dark_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE cct1.kind = 'crew' AND cct2.kind != 'complete+verified' AND cn.country_code != '[us]' AND it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind IN ('movie', 'episode') AND mc.note NOT LIKE '%(USA)%' AND mc.note LIKE '%(200%)%' AND mi.info IN ('Sweden', 'Germany', 'Swedish', 'German') AND mi_idx.info > '6.5' AND t.production_year > 2005 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND t.id = mc.movie_id AND t.id = cc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = cc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = cc.movie_id AND mc.movie_id = mi_idx.movie_id AND mc.movie_id = cc.movie_id AND mi_idx.movie_id = cc.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(cn.name) AS movie_company, MIN(mi_idx.info) AS rating, MIN(t.title) AS complete_euro_dark_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, company_name AS cn, company_type AS ct, info_type AS it1, info_type AS it2, keyword AS k, kind_type AS kt, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, title AS t WHERE cct1.kind = 'cast' AND cct2.kind = 'complete' AND cn.country_code != '[us]' AND it1.info = 'countries' AND it2.info = 'rating' AND k.keyword IN ('murder', 'murder-in-title', 'blood', 'violence') AND kt.kind IN ('movie', 'episode') AND mc.note NOT LIKE '%(USA)%' AND mc.note LIKE '%(200%)%' AND mi.info IN ('Sweden', 'Norway', 'Germany', 'Denmark', 'Swedish', 'Danish', 'Norwegian', 'German', 'USA', 'American') AND mi_idx.info < '8.5' AND t.production_year > 2005 AND kt.id = t.kind_id AND t.id = mi.movie_id AND t.id = mk.movie_id AND t.id = mi_idx.movie_id AND t.id = mc.movie_id AND t.id = cc.movie_id AND mk.movie_id = mi.movie_id AND mk.movie_id = mi_idx.movie_id AND mk.movie_id = mc.movie_id AND mk.movie_id = cc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mc.movie_id AND mi.movie_id = cc.movie_id AND mc.movie_id = mi_idx.movie_id AND mc.movie_id = cc.movie_id AND mi_idx.movie_id = cc.movie_id AND k.id = mk.keyword_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND ct.id = mc.company_type_id AND cn.id = mc.company_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(chn.name) AS voiced_char, MIN(n.name) AS voicing_actress, MIN(t.title) AS voiced_animation FROM aka_name AS an, complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, info_type AS it3, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, name AS n, person_info AS pi, role_type AS rt, title AS t WHERE cct1.kind ='cast' AND cct2.kind ='complete+verified' AND chn.name = 'Queen' AND ci.note IN ('(voice)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND it.info = 'release dates' AND it3.info = 'trivia' AND k.keyword = 'computer-animation' AND mi.info IS NOT NULL AND (mi.info LIKE 'Japan:%200%' OR mi.info LIKE 'USA:%200%') AND n.gender ='f' AND n.name LIKE '%An%' AND rt.role ='actress' AND t.title = 'Shrek 2' AND t.production_year BETWEEN 2000 AND 2010 AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = cc.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mc.movie_id = mk.movie_id AND mc.movie_id = cc.movie_id AND mi.movie_id = ci.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = cc.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id AND n.id = pi.person_id AND ci.person_id = pi.person_id AND it3.id = pi.info_type_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(chn.name) AS voiced_char, MIN(n.name) AS voicing_actress, MIN(t.title) AS voiced_animation FROM aka_name AS an, complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, info_type AS it3, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, name AS n, person_info AS pi, role_type AS rt, title AS t WHERE cct1.kind ='cast' AND cct2.kind ='complete+verified' AND chn.name = 'Queen' AND ci.note IN ('(voice)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND it.info = 'release dates' AND it3.info = 'height' AND k.keyword = 'computer-animation' AND mi.info LIKE 'USA:%200%' AND n.gender ='f' AND n.name LIKE '%An%' AND rt.role ='actress' AND t.title = 'Shrek 2' AND t.production_year BETWEEN 2000 AND 2005 AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = cc.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mc.movie_id = mk.movie_id AND mc.movie_id = cc.movie_id AND mi.movie_id = ci.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = cc.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id AND n.id = pi.person_id AND ci.person_id = pi.person_id AND it3.id = pi.info_type_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(chn.name) AS voiced_char, MIN(n.name) AS voicing_actress, MIN(t.title) AS voiced_animation FROM aka_name AS an, complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, char_name AS chn, cast_info AS ci, company_name AS cn, info_type AS it, info_type AS it3, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_keyword AS mk, name AS n, person_info AS pi, role_type AS rt, title AS t WHERE cct1.kind ='cast' AND cct2.kind ='complete+verified' AND ci.note IN ('(voice)', '(voice: Japanese version)', '(voice) (uncredited)', '(voice: English version)') AND cn.country_code ='[us]' AND it.info = 'release dates' AND it3.info = 'trivia' AND k.keyword = 'computer-animation' AND mi.info IS NOT NULL AND (mi.info LIKE 'Japan:%200%' OR mi.info LIKE 'USA:%200%') AND n.gender ='f' AND n.name LIKE '%An%' AND rt.role ='actress' AND t.production_year BETWEEN 2000 AND 2010 AND t.id = mi.movie_id AND t.id = mc.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = cc.movie_id AND mc.movie_id = ci.movie_id AND mc.movie_id = mi.movie_id AND mc.movie_id = mk.movie_id AND mc.movie_id = cc.movie_id AND mi.movie_id = ci.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = cc.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND cn.id = mc.company_id AND it.id = mi.info_type_id AND n.id = ci.person_id AND rt.id = ci.role_id AND n.id = an.person_id AND ci.person_id = an.person_id AND chn.id = ci.person_role_id AND n.id = pi.person_id AND ci.person_id = pi.person_id AND it3.id = pi.info_type_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS writer, MIN(t.title) AS complete_violent_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, cast_info AS ci, info_type AS it1, info_type AS it2, keyword AS k, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind IN ('cast', 'crew') AND cct2.kind ='complete+verified' AND ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'violence', 'blood', 'gore', 'death', 'female-nudity', 'hospital') AND mi.info IN ('Horror', 'Thriller') AND n.gender = 'm' AND t.production_year > 2000 AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = cc.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = cc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = cc.movie_id AND mi_idx.movie_id = mk.movie_id AND mi_idx.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS writer, MIN(t.title) AS complete_gore_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, cast_info AS ci, info_type AS it1, info_type AS it2, keyword AS k, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind IN ('cast', 'crew') AND cct2.kind ='complete+verified' AND ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'violence', 'blood', 'gore', 'death', 'female-nudity', 'hospital') AND mi.info IN ('Horror', 'Thriller') AND n.gender = 'm' AND t.production_year > 2000 AND (t.title LIKE '%Freddy%' OR t.title LIKE '%Jason%' OR t.title LIKE 'Saw%') AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = cc.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = cc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = cc.movie_id AND mi_idx.movie_id = mk.movie_id AND mi_idx.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS writer, MIN(t.title) AS complete_violent_movie FROM complete_cast AS cc, comp_cast_type AS cct1, comp_cast_type AS cct2, cast_info AS ci, info_type AS it1, info_type AS it2, keyword AS k, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE cct1.kind = 'cast' AND cct2.kind ='complete+verified' AND ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'violence', 'blood', 'gore', 'death', 'female-nudity', 'hospital') AND mi.info IN ('Horror', 'Action', 'Sci-Fi', 'Thriller', 'Crime', 'War') AND n.gender = 'm' AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = cc.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = cc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = cc.movie_id AND mi_idx.movie_id = mk.movie_id AND mi_idx.movie_id = cc.movie_id AND mk.movie_id = cc.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id AND cct1.id = cc.subject_id AND cct2.id = cc.status_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS writer, MIN(t.title) AS violent_liongate_movie FROM cast_info AS ci, company_name AS cn, info_type AS it1, info_type AS it2, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND cn.name LIKE 'Lionsgate%' AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'violence', 'blood', 'gore', 'death', 'female-nudity', 'hospital') AND mi.info IN ('Horror', 'Thriller') AND n.gender = 'm' AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = mc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = mc.movie_id AND mi_idx.movie_id = mk.movie_id AND mi_idx.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id AND cn.id = mc.company_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS writer, MIN(t.title) AS violent_liongate_movie FROM cast_info AS ci, company_name AS cn, info_type AS it1, info_type AS it2, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND cn.name LIKE 'Lionsgate%' AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'violence', 'blood', 'gore', 'death', 'female-nudity', 'hospital') AND mc.note LIKE '%(Blu-ray)%' AND mi.info IN ('Horror', 'Thriller') AND n.gender = 'm' AND t.production_year > 2000 AND (t.title LIKE '%Freddy%' OR t.title LIKE '%Jason%' OR t.title LIKE 'Saw%') AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = mc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = mc.movie_id AND mi_idx.movie_id = mk.movie_id AND mi_idx.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id AND cn.id = mc.company_id", + "SELECT MIN(mi.info) AS movie_budget, MIN(mi_idx.info) AS movie_votes, MIN(n.name) AS writer, MIN(t.title) AS violent_liongate_movie FROM cast_info AS ci, company_name AS cn, info_type AS it1, info_type AS it2, keyword AS k, movie_companies AS mc, movie_info AS mi, movie_info_idx AS mi_idx, movie_keyword AS mk, name AS n, title AS t WHERE ci.note IN ('(writer)', '(head writer)', '(written by)', '(story)', '(story editor)') AND cn.name LIKE 'Lionsgate%' AND it1.info = 'genres' AND it2.info = 'votes' AND k.keyword IN ('murder', 'violence', 'blood', 'gore', 'death', 'female-nudity', 'hospital') AND mi.info IN ('Horror', 'Action', 'Sci-Fi', 'Thriller', 'Crime', 'War') AND t.id = mi.movie_id AND t.id = mi_idx.movie_id AND t.id = ci.movie_id AND t.id = mk.movie_id AND t.id = mc.movie_id AND ci.movie_id = mi.movie_id AND ci.movie_id = mi_idx.movie_id AND ci.movie_id = mk.movie_id AND ci.movie_id = mc.movie_id AND mi.movie_id = mi_idx.movie_id AND mi.movie_id = mk.movie_id AND mi.movie_id = mc.movie_id AND mi_idx.movie_id = mk.movie_id AND mi_idx.movie_id = mc.movie_id AND mk.movie_id = mc.movie_id AND n.id = ci.person_id AND it1.id = mi.info_type_id AND it2.id = mi_idx.info_type_id AND k.id = mk.keyword_id AND cn.id = mc.company_id", + "SELECT MIN(lt.link) AS link_type, MIN(t1.title) AS first_movie, MIN(t2.title) AS second_movie FROM keyword AS k, link_type AS lt, movie_keyword AS mk, movie_link AS ml, title AS t1, title AS t2 WHERE k.keyword ='10,000-mile-club' AND mk.keyword_id = k.id AND t1.id = mk.movie_id AND ml.movie_id = t1.id AND ml.linked_movie_id = t2.id AND lt.id = ml.link_type_id AND mk.movie_id = t1.id", + "SELECT MIN(lt.link) AS link_type, MIN(t1.title) AS first_movie, MIN(t2.title) AS second_movie FROM keyword AS k, link_type AS lt, movie_keyword AS mk, movie_link AS ml, title AS t1, title AS t2 WHERE k.keyword ='character-name-in-title' AND mk.keyword_id = k.id AND t1.id = mk.movie_id AND ml.movie_id = t1.id AND ml.linked_movie_id = t2.id AND lt.id = ml.link_type_id AND mk.movie_id = t1.id", + "SELECT MIN(cn1.name) AS first_company, MIN(cn2.name) AS second_company, MIN(mi_idx1.info) AS first_rating, MIN(mi_idx2.info) AS second_rating, MIN(t1.title) AS first_movie, MIN(t2.title) AS second_movie FROM company_name AS cn1, company_name AS cn2, info_type AS it1, info_type AS it2, kind_type AS kt1, kind_type AS kt2, link_type AS lt, movie_companies AS mc1, movie_companies AS mc2, movie_info_idx AS mi_idx1, movie_info_idx AS mi_idx2, movie_link AS ml, title AS t1, title AS t2 WHERE cn1.country_code = '[us]' AND it1.info = 'rating' AND it2.info = 'rating' AND kt1.kind IN ('tv series') AND kt2.kind IN ('tv series') AND lt.link IN ('sequel', 'follows', 'followed by') AND mi_idx2.info < '3.0' AND t2.production_year BETWEEN 2005 AND 2008 AND lt.id = ml.link_type_id AND t1.id = ml.movie_id AND t2.id = ml.linked_movie_id AND it1.id = mi_idx1.info_type_id AND t1.id = mi_idx1.movie_id AND kt1.id = t1.kind_id AND cn1.id = mc1.company_id AND t1.id = mc1.movie_id AND ml.movie_id = mi_idx1.movie_id AND ml.movie_id = mc1.movie_id AND mi_idx1.movie_id = mc1.movie_id AND it2.id = mi_idx2.info_type_id AND t2.id = mi_idx2.movie_id AND kt2.id = t2.kind_id AND cn2.id = mc2.company_id AND t2.id = mc2.movie_id AND ml.linked_movie_id = mi_idx2.movie_id AND ml.linked_movie_id = mc2.movie_id AND mi_idx2.movie_id = mc2.movie_id", + "SELECT MIN(cn1.name) AS first_company, MIN(cn2.name) AS second_company, MIN(mi_idx1.info) AS first_rating, MIN(mi_idx2.info) AS second_rating, MIN(t1.title) AS first_movie, MIN(t2.title) AS second_movie FROM company_name AS cn1, company_name AS cn2, info_type AS it1, info_type AS it2, kind_type AS kt1, kind_type AS kt2, link_type AS lt, movie_companies AS mc1, movie_companies AS mc2, movie_info_idx AS mi_idx1, movie_info_idx AS mi_idx2, movie_link AS ml, title AS t1, title AS t2 WHERE cn1.country_code = '[nl]' AND it1.info = 'rating' AND it2.info = 'rating' AND kt1.kind IN ('tv series') AND kt2.kind IN ('tv series') AND lt.link LIKE '%follow%' AND mi_idx2.info < '3.0' AND t2.production_year = 2007 AND lt.id = ml.link_type_id AND t1.id = ml.movie_id AND t2.id = ml.linked_movie_id AND it1.id = mi_idx1.info_type_id AND t1.id = mi_idx1.movie_id AND kt1.id = t1.kind_id AND cn1.id = mc1.company_id AND t1.id = mc1.movie_id AND ml.movie_id = mi_idx1.movie_id AND ml.movie_id = mc1.movie_id AND mi_idx1.movie_id = mc1.movie_id AND it2.id = mi_idx2.info_type_id AND t2.id = mi_idx2.movie_id AND kt2.id = t2.kind_id AND cn2.id = mc2.company_id AND t2.id = mc2.movie_id AND ml.linked_movie_id = mi_idx2.movie_id AND ml.linked_movie_id = mc2.movie_id AND mi_idx2.movie_id = mc2.movie_id", + "SELECT MIN(cn1.name) AS first_company, MIN(cn2.name) AS second_company, MIN(mi_idx1.info) AS first_rating, MIN(mi_idx2.info) AS second_rating, MIN(t1.title) AS first_movie, MIN(t2.title) AS second_movie FROM company_name AS cn1, company_name AS cn2, info_type AS it1, info_type AS it2, kind_type AS kt1, kind_type AS kt2, link_type AS lt, movie_companies AS mc1, movie_companies AS mc2, movie_info_idx AS mi_idx1, movie_info_idx AS mi_idx2, movie_link AS ml, title AS t1, title AS t2 WHERE cn1.country_code != '[us]' AND it1.info = 'rating' AND it2.info = 'rating' AND kt1.kind IN ('tv series', 'episode') AND kt2.kind IN ('tv series', 'episode') AND lt.link IN ('sequel', 'follows', 'followed by') AND mi_idx2.info < '3.5' AND t2.production_year BETWEEN 2000 AND 2010 AND lt.id = ml.link_type_id AND t1.id = ml.movie_id AND t2.id = ml.linked_movie_id AND it1.id = mi_idx1.info_type_id AND t1.id = mi_idx1.movie_id AND kt1.id = t1.kind_id AND cn1.id = mc1.company_id AND t1.id = mc1.movie_id AND ml.movie_id = mi_idx1.movie_id AND ml.movie_id = mc1.movie_id AND mi_idx1.movie_id = mc1.movie_id AND it2.id = mi_idx2.info_type_id AND t2.id = mi_idx2.movie_id AND kt2.id = t2.kind_id AND cn2.id = mc2.company_id AND t2.id = mc2.movie_id AND ml.linked_movie_id = mi_idx2.movie_id AND ml.linked_movie_id = mc2.movie_id AND mi_idx2.movie_id = mc2.movie_id" +]} +]; + +const data = [{"actual_version":"1.1.53991","data_size":{"default":4096,"hits":14209193259,"job":1816841964,"mgbench":1074964708,"ontime":2322016698,"ssb":74364787031,"taxi":23041024997,"tpcds":19006083968,"tpch":17160629361,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":228,"job":32,"mgbench":29,"ontime":94,"ssb":2208,"taxi":1242,"tpcds":238,"tpch":350,"uk":63},"machine":"c7a.4xlarge","release_date":"2016-07-07","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.084,0.011,0.010,0.011,0.010,0.010],[0.068,0.025,0.023,0.025,0.026,0.024],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[60.852,7.748,7.687,3.970,5.615,7.595],[null,null,null,null,null,null],[49.465,8.777,8.773,8.882,8.842,8.855],[72.640,17.056,16.911,17.005,16.887,16.830],[51.027,13.798,13.876,13.738,13.914,13.983],[50.524,13.568,13.608,13.619,13.602,13.568],[71.123,20.588,20.632,20.630,20.701,20.633],[68.361,20.756,20.743,20.800,20.664,19.723],[49.396,14.812,14.877,14.956,14.915,14.823],[null,null,null,null,null,null],[71.351,22.054,21.976,22.067,22.053,22.032],[53.631,14.780,14.617,14.570,14.633,14.594],[50.530,12.980,13.010,12.892,12.924,12.976],[0.066,0.013,0.012,0.012,0.013,0.013],[0.071,0.012,0.012,0.013,0.012,0.012],[0.116,0.060,0.060,0.062,0.060,0.064],[0.153,0.102,0.101,0.101,0.101,0.101],[0.238,0.183,0.180,0.180,0.177,0.183],[0.333,0.251,0.258,0.258,0.268,0.254],[0.102,0.041,0.042,0.041,0.041,0.042],[0.067,0.014,0.013,0.013,0.014,0.014],[0.401,0.335,0.337,0.344,0.349,0.348],[0.455,0.403,0.408,0.413,0.410,0.391],[0.418,0.369,0.365,0.362,0.366,0.360],[0.443,0.390,0.388,0.383,0.368,0.386],[0.577,0.505,0.500,0.505,0.501,0.521],[0.746,0.667,0.678,0.675,0.663,0.666],[0.647,0.589,0.581,0.584,0.590,0.587],[0.628,0.580,0.587,0.584,0.585,0.590],[1.397,1.329,1.277,1.291,1.252,1.277],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.388,0.317,0.313,0.314,0.317,0.321],[1.512,0.798,0.805,0.823,0.801,0.812],[1.228,1.004,1.011,1.009,1.008,1.007],[1.938,1.909,1.883,1.886,1.768,1.906],[0.677,0.595,0.601,0.596,0.602,0.609],[0.936,0.844,0.851,0.839,0.856,0.859],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.079,0.010,0.010,0.009,0.009,0.010],[0.057,0.004,0.004,0.004,0.004,0.004],[0.544,0.070,0.070,0.069,0.070,0.068],[0.613,0.143,0.143,0.142,0.143,0.142],[0.214,0.088,0.086,0.089,0.090,0.086],[0.686,0.167,0.169,0.167,0.163,0.160],[0.346,0.054,0.053,0.053,0.053,0.054],[0.436,0.097,0.098,0.094,0.096,0.094],[0.479,0.140,0.138,0.141,0.140,0.139],[0.387,0.071,0.071,0.069,0.069,0.086],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.912,0.527,0.532,0.539,0.537,0.536],[0.556,0.059,0.059,0.060,0.060,0.062],[1.014,0.616,0.613,0.616,0.616,0.618],[36.501,6.922,6.976,6.948,6.979,6.978],[37.223,4.301,4.274,4.262,4.232,4.255],[35.901,5.580,5.617,5.598,5.594,5.615],[43.451,12.554,12.396,9.820,13.700,13.207],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.505,4.427,4.435,4.438,4.424,4.439],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.53991","source":"results/1.1.53991.json"} +,{"actual_version":"1.1.53996","data_size":{"default":4096,"hits":14201142436,"job":1816841964,"mgbench":1074964708,"ontime":2322016698,"ssb":73863016869,"taxi":23070344169,"tpcds":18998707930,"tpch":17160587981,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":253,"job":35,"mgbench":31,"ontime":105,"ssb":2468,"taxi":1363,"tpcds":263,"tpch":396,"uk":71},"machine":"c7a.4xlarge","release_date":"2016-07-14","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.109,0.011,0.011,0.010,0.011,0.011],[0.080,0.026,0.027,0.027,0.027,0.026],[null,null,null,null,null,null],[0.191,0.133,0.127,0.134,0.126,0.130],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[61.663,8.440,8.448,8.466,8.479,8.427],[null,null,null,null,null,null],[51.154,9.696,9.842,9.868,9.835,9.819],[74.353,18.751,18.839,18.778,18.463,15.393],[53.510,15.431,15.291,15.383,15.531,15.323],[53.155,15.034,15.090,15.113,15.066,15.016],[72.163,22.836,22.853,22.806,22.940,22.792],[69.126,21.296,19.598,23.322,23.298,23.333],[54.153,16.571,16.487,16.463,16.292,16.615],[null,null,null,null,null,null],[72.863,24.276,24.294,24.156,24.215,24.230],[54.587,15.893,15.797,15.688,15.790,15.731],[55.597,14.581,14.569,14.596,14.623,14.491],[0.066,0.013,0.013,0.013,0.013,0.013],[0.069,0.014,0.014,0.011,0.013,0.013],[0.117,0.059,0.059,0.061,0.062,0.059],[0.164,0.113,0.111,0.112,0.112,0.112],[0.256,0.194,0.196,0.198,0.201,0.196],[0.348,0.286,0.290,0.288,0.289,0.282],[0.100,0.037,0.036,0.037,0.038,0.037],[0.065,0.014,0.013,0.014,0.014,0.015],[0.441,0.367,0.383,0.364,0.392,0.381],[0.508,0.439,0.436,0.444,0.432,0.439],[0.461,0.413,0.408,0.405,0.407,0.407],[0.481,0.427,0.428,0.424,0.414,0.416],[0.632,0.568,0.563,0.564,0.567,0.562],[0.842,0.753,0.745,0.752,0.752,0.758],[0.733,0.648,0.653,0.650,0.649,0.662],[0.716,0.656,0.660,0.665,0.659,0.680],[1.573,1.418,1.439,1.424,1.348,1.420],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.423,0.345,0.353,0.357,0.345,0.352],[1.523,0.857,0.876,0.867,0.863,0.871],[1.252,1.136,1.134,1.115,1.128,1.112],[2.053,2.008,2.021,2.024,2.003,2.019],[0.760,0.673,0.663,0.661,0.661,0.649],[1.034,0.949,0.947,0.945,0.948,0.949],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.080,0.011,0.010,0.011,0.009,0.010],[0.054,0.004,0.004,0.004,0.004,0.004],[0.568,0.076,0.075,0.075,0.075,0.076],[0.640,0.160,0.159,0.158,0.160,0.158],[0.238,0.092,0.101,0.093,0.095,0.098],[0.721,0.179,0.184,0.193,0.188,0.188],[0.371,0.059,0.062,0.060,0.062,0.058],[0.467,0.106,0.105,0.105,0.103,0.105],[0.512,0.154,0.155,0.154,0.153,0.153],[0.416,0.079,0.080,0.081,0.094,0.080],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.985,0.594,0.591,0.595,0.602,0.596],[0.587,0.069,0.068,0.071,0.067,0.069],[1.102,0.678,0.680,0.686,0.679,0.682],[42.226,7.919,7.895,7.877,7.911,7.941],[43.282,5.152,5.153,5.197,5.170,5.148],[41.992,6.638,6.614,6.572,6.631,6.625],[50.828,14.319,14.290,14.374,14.359,14.270],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.855,4.776,4.745,4.768,4.772,4.782],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.53996","source":"results/1.1.53996.json"} +,{"actual_version":"1.1.53997","data_size":{"default":4096,"hits":14198619492,"job":1816841964,"mgbench":1074964708,"ontime":2322016698,"ssb":74210221733,"taxi":23074808571,"tpcds":18995398847,"tpch":17160715451,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":221,"job":32,"mgbench":28,"ontime":95,"ssb":2338,"taxi":1233,"tpcds":234,"tpch":344,"uk":62},"machine":"c7a.4xlarge","release_date":"2016-07-17","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.101,0.011,0.011,0.011,0.010,0.010],[0.079,0.026,0.026,0.025,0.025,0.026],[null,null,null,null,null,null],[0.182,0.124,0.121,0.123,0.119,0.120],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[61.081,8.194,8.205,8.165,8.222,8.141],[null,null,null,null,null,null],[50.109,9.341,9.385,9.396,9.436,9.394],[72.930,17.992,18.052,18.096,17.944,17.939],[49.880,14.710,14.641,14.668,14.729,14.603],[51.101,14.204,14.267,14.163,14.334,14.286],[71.198,21.656,21.731,21.647,21.687,21.683],[68.746,19.440,18.601,21.762,21.726,21.713],[52.527,15.650,15.619,15.580,15.583,15.571],[null,null,null,null,null,null],[71.478,22.699,22.447,22.669,22.704,22.517],[53.868,15.036,15.044,15.037,15.066,15.015],[53.098,13.818,13.681,13.555,13.688,13.550],[0.060,0.014,0.013,0.012,0.012,0.013],[0.066,0.011,0.012,0.012,0.012,0.011],[0.102,0.053,0.052,0.056,0.052,0.054],[0.085,0.047,0.045,0.044,0.044,0.044],[0.258,0.198,0.193,0.195,0.187,0.192],[0.339,0.271,0.272,0.269,0.273,0.265],[0.089,0.030,0.031,0.032,0.032,0.031],[0.066,0.012,0.014,0.013,0.013,0.014],[0.403,0.353,0.366,0.369,0.353,0.362],[0.468,0.411,0.394,0.395,0.405,0.414],[0.438,0.392,0.387,0.386,0.390,0.384],[0.448,0.413,0.411,0.398,0.407,0.407],[0.596,0.508,0.513,0.516,0.514,0.511],[0.749,0.680,0.687,0.681,0.702,0.687],[0.651,0.592,0.590,0.602,0.591,0.595],[0.654,0.589,0.592,0.594,0.595,0.597],[1.406,1.298,1.261,1.266,1.250,1.252],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.391,0.325,0.324,0.332,0.319,0.324],[1.501,0.806,0.796,0.808,0.791,0.800],[1.231,1.013,1.012,1.015,1.006,1.000],[1.724,1.668,1.687,1.718,1.675,1.712],[0.680,0.594,0.597,0.590,0.591,0.599],[0.954,0.862,0.861,0.863,0.876,0.847],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.090,0.011,0.011,0.010,0.011,0.010],[0.061,0.004,0.004,0.004,0.004,0.004],[0.579,0.071,0.070,0.072,0.071,0.070],[0.633,0.148,0.147,0.146,0.146,0.147],[0.234,0.087,0.095,0.095,0.089,0.090],[0.721,0.161,0.161,0.161,0.162,0.163],[0.361,0.054,0.055,0.057,0.054,0.054],[0.464,0.099,0.098,0.098,0.096,0.096],[0.496,0.140,0.137,0.143,0.142,0.142],[0.420,0.074,0.089,0.070,0.072,0.071],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.966,0.536,0.532,0.539,0.542,0.534],[0.605,0.063,0.063,0.062,0.062,0.063],[1.048,0.604,0.604,0.606,0.613,0.612],[42.495,7.322,7.319,7.332,7.325,7.347],[42.798,4.891,4.894,4.905,4.890,4.898],[41.969,6.144,6.128,6.155,6.131,6.192],[48.910,13.290,13.276,13.312,13.276,13.285],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.462,4.374,4.381,4.365,4.374,4.368],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.53997","source":"results/1.1.53997.json"} +,{"actual_version":"1.1.53998","data_size":{"default":4096,"hits":14191108176,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":74365128477,"taxi":23053191247,"tpcds":19000100167,"tpch":17160679038,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":226,"job":32,"mgbench":28,"ontime":93,"ssb":2223,"taxi":1233,"tpcds":232,"tpch":354,"uk":61},"machine":"c7a.4xlarge","release_date":"2016-07-21","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.101,0.010,0.010,0.010,0.010,0.010],[0.071,0.026,0.025,0.024,0.024,0.023],[null,null,null,null,null,null],[0.174,0.111,0.123,0.115,0.114,0.117],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[61.902,7.549,7.543,7.548,7.561,7.533],[null,null,null,null,null,null],[50.931,8.781,8.786,8.803,8.818,8.881],[74.400,16.802,17.000,16.850,16.929,16.992],[51.979,13.961,14.031,13.955,14.127,13.957],[49.866,13.368,13.328,13.336,13.496,13.435],[72.731,20.325,20.439,20.382,20.328,20.372],[69.940,20.413,20.279,20.544,20.398,20.548],[52.024,12.597,14.575,14.540,14.567,14.486],[null,null,null,null,null,null],[73.063,21.166,21.224,21.239,21.255,21.211],[53.978,14.002,13.979,13.975,13.989,13.874],[51.983,12.814,12.814,12.716,10.981,12.205],[0.067,0.013,0.012,0.013,0.012,0.013],[0.069,0.012,0.013,0.014,0.015,0.013],[0.109,0.055,0.053,0.053,0.055,0.051],[0.145,0.096,0.096,0.095,0.097,0.096],[0.226,0.178,0.173,0.180,0.176,0.173],[0.313,0.254,0.257,0.254,0.251,0.251],[0.088,0.033,0.034,0.031,0.030,0.031],[0.062,0.015,0.014,0.014,0.013,0.014],[0.392,0.335,0.336,0.330,0.342,0.336],[0.445,0.397,0.404,0.400,0.387,0.390],[0.400,0.343,0.345,0.343,0.349,0.349],[0.421,0.364,0.368,0.359,0.367,0.365],[0.558,0.489,0.480,0.484,0.480,0.499],[0.716,0.642,0.638,0.630,0.640,0.637],[0.624,0.566,0.562,0.567,0.564,0.571],[0.637,0.576,0.570,0.568,0.565,0.562],[1.353,1.231,1.231,1.212,1.235,1.259],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.366,0.295,0.298,0.304,0.296,0.301],[1.486,0.790,0.797,0.780,0.805,0.798],[1.227,0.995,0.999,1.004,0.987,0.998],[1.728,1.675,1.688,1.701,1.707,1.705],[0.671,0.592,0.586,0.576,0.581,0.604],[0.906,0.841,0.839,0.844,0.821,0.832],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.079,0.010,0.010,0.010,0.010,0.010],[0.050,0.004,0.004,0.004,0.004,0.004],[0.540,0.068,0.067,0.068,0.067,0.067],[0.603,0.138,0.139,0.139,0.139,0.141],[0.217,0.083,0.091,0.086,0.089,0.083],[0.697,0.159,0.161,0.162,0.165,0.160],[0.352,0.052,0.054,0.053,0.052,0.053],[0.436,0.092,0.091,0.091,0.093,0.092],[0.478,0.136,0.137,0.139,0.135,0.141],[0.389,0.068,0.071,0.072,0.072,0.070],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.861,0.517,0.535,0.521,0.529,0.533],[0.559,0.059,0.060,0.059,0.060,0.061],[1.008,0.600,0.609,0.603,0.608,0.606],[37.725,6.766,6.776,6.729,6.759,6.745],[38.925,4.323,4.314,4.303,4.306,4.314],[38.305,5.567,5.577,5.579,5.588,5.581],[45.107,12.183,12.197,12.256,12.222,12.179],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.167,4.083,4.088,4.078,4.072,4.080],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.53998","source":"results/1.1.53998.json"} +,{"actual_version":"1.1.53999","data_size":{"default":4096,"hits":14192680688,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":74263380572,"taxi":23080117282,"tpcds":19006234252,"tpch":17160633190,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":221,"job":34,"mgbench":28,"ontime":98,"ssb":2262,"taxi":1245,"tpcds":233,"tpch":345,"uk":63},"machine":"c7a.4xlarge","release_date":"2016-07-25","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.089,0.006,0.006,0.006,0.006,0.006],[0.076,0.021,0.019,0.019,0.020,0.020],[null,null,null,null,null,null],[0.243,0.146,0.147,0.122,0.120,0.115],[null,null,null,null,null,null],[0.645,0.561,0.550,0.552,0.542,0.562],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[61.199,7.840,7.880,7.864,7.880,7.882],[null,null,null,null,null,null],[50.174,9.110,9.123,9.170,9.189,9.130],[73.585,17.118,17.186,17.233,17.307,17.124],[51.210,14.086,14.131,10.870,11.993,14.078],[51.720,13.663,13.681,13.663,13.700,13.673],[71.148,20.711,20.751,20.864,20.873,20.831],[68.696,21.042,21.097,21.016,19.832,17.015],[51.838,14.903,14.919,14.858,14.859,14.848],[null,null,null,null,null,null],[71.716,22.062,22.144,21.819,21.922,21.907],[54.005,14.860,14.865,14.851,14.847,14.603],[51.287,13.331,13.348,13.341,13.396,13.244],[0.072,0.013,0.014,0.012,0.013,0.013],[0.079,0.016,0.014,0.014,0.014,0.014],[0.124,0.063,0.061,0.059,0.060,0.060],[0.162,0.102,0.102,0.101,0.102,0.102],[0.245,0.182,0.182,0.181,0.179,0.180],[0.328,0.252,0.255,0.259,0.267,0.258],[0.103,0.040,0.040,0.040,0.039,0.040],[0.078,0.014,0.013,0.014,0.013,0.012],[0.408,0.340,0.334,0.338,0.327,0.341],[0.459,0.396,0.399,0.396,0.394,0.397],[0.426,0.368,0.366,0.366,0.360,0.361],[0.455,0.377,0.382,0.385,0.381,0.389],[0.582,0.493,0.506,0.503,0.500,0.502],[0.752,0.658,0.656,0.661,0.655,0.661],[0.653,0.584,0.563,0.580,0.601,0.608],[0.644,0.590,0.573,0.580,0.581,0.581],[1.391,1.283,1.242,1.294,1.259,1.265],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.401,0.316,0.317,0.323,0.309,0.312],[1.518,0.809,0.801,0.811,0.808,0.797],[1.235,0.988,1.000,1.004,0.994,1.006],[1.807,1.755,1.728,1.745,1.749,1.769],[0.693,0.601,0.587,0.614,0.602,0.591],[0.959,0.854,0.851,0.849,0.873,0.849],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.097,0.011,0.011,0.011,0.011,0.011],[0.060,0.004,0.004,0.004,0.004,0.004],[0.560,0.071,0.070,0.071,0.070,0.070],[0.638,0.148,0.147,0.149,0.146,0.146],[0.237,0.088,0.084,0.090,0.086,0.095],[0.715,0.162,0.160,0.159,0.160,0.161],[0.356,0.054,0.053,0.055,0.057,0.055],[0.452,0.095,0.097,0.093,0.096,0.096],[0.498,0.137,0.138,0.142,0.137,0.140],[0.403,0.072,0.073,0.088,0.073,0.077],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.932,0.532,0.532,0.539,0.533,0.528],[0.603,0.062,0.059,0.061,0.062,0.061],[1.043,0.605,0.620,0.612,0.616,0.609],[43.589,7.470,7.430,7.464,7.450,7.431],[44.288,5.050,5.036,5.034,5.049,5.040],[43.139,6.288,6.326,6.330,6.314,6.252],[50.901,13.086,13.037,13.094,13.054,13.068],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.370,4.319,4.313,4.310,4.320,4.311],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.53999","source":"results/1.1.53999.json"} +,{"actual_version":"1.1.54000","data_size":{"default":4096,"hits":14196707698,"job":1816841964,"mgbench":1074956453,"ontime":2322016698,"ssb":74042223875,"taxi":23048975292,"tpcds":18993645330,"tpch":17160699682,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":228,"job":31,"mgbench":28,"ontime":96,"ssb":2340,"taxi":1247,"tpcds":229,"tpch":350,"uk":61},"machine":"c7a.4xlarge","release_date":"2016-07-27","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.088,0.011,0.010,0.010,0.010,0.010],[0.074,0.026,0.025,0.024,0.025,0.023],[null,null,null,null,null,null],[0.170,0.122,0.121,0.135,0.143,0.116],[null,null,null,null,null,null],[0.622,0.545,0.554,0.553,0.558,0.542],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[61.782,8.048,8.062,8.049,8.033,8.056],[null,null,null,null,null,null],[50.725,9.475,9.423,9.486,9.446,9.539],[74.153,18.065,18.020,18.124,18.228,18.181],[52.484,14.749,14.797,14.770,14.852,14.767],[52.389,14.644,14.611,14.447,14.593,14.470],[72.769,22.111,22.219,22.200,22.163,22.143],[71.558,19.139,22.389,22.377,22.513,22.430],[53.211,15.850,15.903,15.848,15.875,15.903],[null,null,null,null,null,null],[72.993,23.332,23.658,23.515,23.683,23.532],[54.574,15.834,15.730,15.669,15.758,15.524],[53.504,14.391,14.499,14.448,14.454,14.317],[0.059,0.012,0.014,0.013,0.012,0.012],[0.069,0.014,0.014,0.013,0.014,0.013],[0.106,0.052,0.052,0.052,0.053,0.054],[0.159,0.108,0.109,0.107,0.107,0.108],[0.235,0.188,0.186,0.184,0.188,0.186],[0.323,0.268,0.270,0.268,0.260,0.275],[0.083,0.033,0.035,0.033,0.034,0.034],[0.064,0.013,0.012,0.012,0.013,0.013],[0.408,0.347,0.349,0.344,0.339,0.339],[0.457,0.401,0.397,0.394,0.398,0.401],[0.449,0.395,0.393,0.394,0.391,0.401],[0.466,0.418,0.413,0.413,0.414,0.416],[0.595,0.526,0.523,0.525,0.530,0.527],[0.767,0.707,0.704,0.705,0.709,0.706],[0.661,0.599,0.601,0.594,0.605,0.612],[0.640,0.589,0.591,0.583,0.590,0.595],[1.389,1.298,1.275,1.293,1.266,1.257],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.401,0.332,0.332,0.334,0.336,0.329],[1.483,0.810,0.810,0.824,0.807,0.817],[1.225,1.033,1.024,1.026,1.023,1.020],[1.775,1.727,1.735,1.708,1.719,1.740],[0.686,0.619,0.622,0.635,0.647,0.630],[0.940,0.878,0.876,0.888,0.880,0.881],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.068,0.010,0.009,0.010,0.010,0.010],[0.047,0.004,0.004,0.004,0.004,0.004],[0.544,0.075,0.074,0.072,0.073,0.074],[0.616,0.155,0.154,0.154,0.155,0.153],[0.241,0.090,0.088,0.089,0.096,0.089],[0.679,0.163,0.163,0.169,0.161,0.169],[0.343,0.058,0.055,0.057,0.057,0.056],[0.418,0.099,0.094,0.098,0.098,0.099],[0.475,0.140,0.142,0.141,0.142,0.141],[0.381,0.077,0.078,0.076,0.077,0.076],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.922,0.543,0.552,0.538,0.544,0.546],[0.543,0.063,0.062,0.061,0.064,0.062],[1.014,0.610,0.616,0.626,0.627,0.629],[37.936,7.598,7.564,7.546,7.545,7.568],[38.357,4.694,4.699,4.698,4.719,4.707],[37.326,5.931,5.948,5.916,5.907,5.975],[44.953,13.284,13.257,13.275,13.255,13.300],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.555,4.491,4.493,4.483,4.488,4.480],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54000","source":"results/1.1.54000.json"} +,{"actual_version":"1.1.54001","data_size":{"default":4096,"hits":14180926864,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":74275163938,"taxi":23107721724,"tpcds":19001674446,"tpch":17160660411,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":222,"job":31,"mgbench":29,"ontime":95,"ssb":2298,"taxi":1241,"tpcds":230,"tpch":353,"uk":61},"machine":"c7a.4xlarge","release_date":"2016-07-28","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.107,0.011,0.011,0.011,0.011,0.011],[0.088,0.028,0.025,0.026,0.025,0.026],[null,null,null,null,null,null],[0.192,0.126,0.125,0.123,0.119,0.119],[null,null,null,null,null,null],[0.680,0.575,0.572,0.571,0.572,0.570],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[78.298,9.404,9.340,9.232,9.459,9.318],[null,null,null,null,null,null],[65.242,10.853,10.879,10.900,10.960,10.900],[91.196,20.514,20.373,16.477,18.353,20.272],[67.218,16.565,16.704,16.491,16.483,16.400],[65.335,16.044,16.194,16.111,16.133,16.058],[88.085,24.300,19.776,20.129,23.507,23.419],[85.355,23.521,23.403,23.385,23.386,23.484],[66.307,16.633,16.666,16.555,16.667,16.675],[null,null,null,null,null,null],[89.152,24.338,24.382,24.127,24.272,24.339],[69.611,16.450,16.467,16.499,16.640,16.528],[67.501,15.005,14.961,14.934,14.848,14.874],[0.074,0.014,0.012,0.013,0.012,0.013],[0.082,0.014,0.013,0.015,0.013,0.013],[0.112,0.052,0.050,0.053,0.052,0.051],[0.164,0.104,0.105,0.105,0.105,0.110],[0.243,0.175,0.170,0.171,0.170,0.168],[0.339,0.240,0.237,0.240,0.238,0.236],[0.093,0.033,0.032,0.033,0.033,0.033],[0.073,0.015,0.014,0.013,0.014,0.012],[0.368,0.298,0.322,0.305,0.305,0.292],[0.446,0.369,0.378,0.368,0.353,0.343],[0.338,0.303,0.297,0.293,0.292,0.276],[0.470,0.403,0.411,0.408,0.403,0.404],[0.605,0.510,0.515,0.507,0.516,0.524],[0.771,0.687,0.701,0.689,0.682,0.677],[0.674,0.596,0.589,0.608,0.602,0.605],[0.655,0.592,0.614,0.602,0.602,0.601],[1.416,1.337,1.310,1.311,1.302,1.315],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.410,0.329,0.331,0.320,0.331,0.333],[1.511,0.821,0.808,0.827,0.809,0.811],[1.229,1.002,1.003,0.997,0.997,1.022],[1.809,1.712,1.727,1.698,1.701,1.732],[0.705,0.607,0.601,0.602,0.597,0.609],[1.028,0.871,0.870,0.876,0.870,0.864],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.099,0.011,0.010,0.010,0.010,0.010],[0.063,0.004,0.004,0.005,0.004,0.004],[0.606,0.073,0.071,0.072,0.072,0.071],[0.717,0.152,0.151,0.152,0.152,0.153],[0.243,0.089,0.091,0.092,0.090,0.087],[0.783,0.162,0.161,0.161,0.162,0.170],[0.415,0.056,0.057,0.055,0.058,0.058],[0.510,0.096,0.097,0.096,0.097,0.098],[0.564,0.139,0.143,0.151,0.145,0.144],[0.442,0.095,0.078,0.091,0.077,0.076],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.981,0.545,0.541,0.552,0.549,0.540],[0.664,0.062,0.064,0.061,0.063,0.061],[1.087,0.623,0.623,0.617,0.611,0.608],[52.491,7.893,7.900,7.907,7.946,7.912],[54.716,5.721,5.731,5.702,5.730,5.708],[54.398,6.876,6.852,6.846,6.854,6.881],[61.222,14.213,13.657,10.918,14.014,14.188],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.559,4.492,4.477,4.466,4.462,4.461],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54001","source":"results/1.1.54001.json"} +,{"actual_version":"1.1.54002","data_size":{"default":4096,"hits":14196149253,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":74449242934,"taxi":23078754504,"tpcds":18995996916,"tpch":17160582604,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":223,"job":32,"mgbench":28,"ontime":96,"ssb":2216,"taxi":1232,"tpcds":230,"tpch":354,"uk":62},"machine":"c7a.4xlarge","release_date":"2016-08-02","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.100,0.011,0.011,0.010,0.010,0.011],[0.076,0.027,0.026,0.025,0.025,0.026],[null,null,null,null,null,null],[0.185,0.123,0.129,0.120,0.124,0.120],[null,null,null,null,null,null],[0.645,0.573,0.562,0.571,0.565,0.554],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[62.798,3.870,8.594,8.450,8.393,8.312],[null,null,null,null,null,null],[49.702,9.491,9.479,9.472,9.500,9.461],[73.099,17.654,17.835,17.717,17.597,17.685],[51.384,14.423,14.559,14.418,14.480,14.460],[49.349,13.986,13.905,14.002,14.013,13.969],[71.086,21.271,21.295,21.375,21.299,21.334],[68.424,21.227,21.261,21.250,21.200,21.325],[51.768,11.844,12.941,15.166,15.165,15.099],[null,null,null,null,null,null],[71.800,22.199,22.250,22.398,22.307,22.357],[53.337,15.035,14.973,14.921,14.786,14.857],[51.618,13.489,13.592,13.554,12.578,13.364],[0.081,0.013,0.012,0.013,0.012,0.013],[0.085,0.013,0.016,0.014,0.013,0.015],[0.131,0.063,0.061,0.061,0.061,0.064],[0.162,0.103,0.104,0.102,0.102,0.105],[0.248,0.183,0.182,0.183,0.183,0.183],[0.345,0.255,0.256,0.259,0.269,0.258],[0.105,0.039,0.039,0.039,0.038,0.044],[0.078,0.014,0.014,0.015,0.015,0.014],[0.420,0.334,0.338,0.349,0.340,0.341],[0.462,0.386,0.394,0.395,0.393,0.398],[0.450,0.374,0.375,0.378,0.358,0.376],[0.476,0.397,0.385,0.396,0.383,0.390],[0.594,0.505,0.503,0.507,0.510,0.503],[0.767,0.667,0.677,0.676,0.673,0.673],[0.667,0.584,0.575,0.579,0.584,0.589],[0.646,0.583,0.585,0.573,0.595,0.582],[1.408,1.278,1.267,1.273,1.258,1.238],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.405,0.315,0.317,0.320,0.326,0.314],[1.510,0.809,0.815,0.830,0.829,0.815],[1.248,1.040,1.014,1.010,1.012,1.021],[1.885,1.806,1.805,1.825,1.801,1.839],[0.704,0.609,0.603,0.597,0.599,0.599],[0.991,0.859,0.863,0.848,0.857,0.854],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.084,0.012,0.012,0.011,0.012,0.011],[0.054,0.004,0.005,0.004,0.004,0.004],[0.534,0.071,0.070,0.070,0.071,0.068],[0.595,0.147,0.146,0.147,0.144,0.146],[0.216,0.088,0.097,0.088,0.094,0.092],[0.665,0.165,0.165,0.168,0.170,0.163],[0.342,0.055,0.055,0.055,0.054,0.053],[0.422,0.095,0.095,0.095,0.096,0.095],[0.472,0.142,0.141,0.141,0.140,0.138],[0.391,0.072,0.072,0.070,0.072,0.074],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.905,0.544,0.534,0.527,0.540,0.538],[0.566,0.061,0.060,0.061,0.061,0.062],[1.004,0.610,0.616,0.611,0.620,0.617],[41.304,7.367,7.324,7.359,7.364,7.313],[44.262,4.948,4.971,4.960,5.031,4.968],[43.377,6.140,6.192,6.189,6.184,6.176],[50.180,13.247,13.205,13.276,12.212,12.236],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.824,4.722,4.717,4.699,4.714,4.710],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54002","source":"results/1.1.54002.json"} +,{"actual_version":"1.1.54004","data_size":{"default":4096,"hits":14210514404,"job":1816841964,"mgbench":1074952778,"ontime":2322012602,"ssb":74313461874,"taxi":23091773264,"tpcds":18998300004,"tpch":17160664555,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":228,"job":29,"mgbench":28,"ontime":92,"ssb":2417,"taxi":1223,"tpcds":235,"tpch":350,"uk":61},"machine":"c7a.4xlarge","release_date":"2016-08-03","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.111,0.011,0.010,0.011,0.010,0.010],[0.080,0.024,0.025,0.025,0.026,0.025],[null,null,null,null,null,null],[0.183,0.118,0.123,0.117,0.122,0.118],[null,null,null,null,null,null],[0.645,0.550,0.551,0.542,0.541,0.541],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[71.786,7.765,7.831,7.818,7.780,7.764],[null,null,null,null,null,null],[60.468,9.092,9.133,9.177,9.095,9.145],[85.625,14.248,18.536,18.211,17.992,17.955],[61.792,14.699,14.587,14.601,14.545,14.512],[61.331,14.179,14.260,14.230,14.128,14.258],[82.107,20.377,16.270,21.395,21.217,21.045],[78.620,21.130,21.143,21.021,20.885,20.974],[61.091,14.952,14.907,14.970,15.010,15.016],[null,null,null,null,null,null],[82.215,22.042,22.012,21.983,22.002,22.015],[61.790,14.746,14.674,14.767,14.731,14.736],[62.795,13.426,13.393,13.403,13.359,13.350],[0.086,0.013,0.012,0.015,0.013,0.013],[0.094,0.015,0.015,0.014,0.013,0.015],[0.133,0.054,0.060,0.053,0.054,0.055],[0.169,0.099,0.100,0.099,0.099,0.099],[0.252,0.180,0.177,0.179,0.179,0.184],[0.359,0.264,0.268,0.269,0.260,0.259],[0.112,0.033,0.033,0.032,0.034,0.032],[0.092,0.016,0.015,0.014,0.016,0.013],[0.421,0.333,0.338,0.339,0.343,0.337],[0.489,0.407,0.390,0.396,0.401,0.399],[0.448,0.365,0.363,0.365,0.359,0.356],[0.468,0.385,0.384,0.379,0.374,0.385],[0.597,0.500,0.502,0.513,0.513,0.510],[0.768,0.689,0.672,0.678,0.662,0.661],[0.681,0.582,0.588,0.587,0.587,0.603],[0.656,0.585,0.603,0.593,0.583,0.584],[1.413,1.284,1.289,1.311,1.268,1.279],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.405,0.313,0.309,0.318,0.316,0.317],[1.539,0.812,0.791,0.820,0.816,0.823],[1.236,1.008,1.005,0.998,0.998,1.004],[1.787,1.718,1.722,1.722,1.693,1.712],[0.701,0.608,0.610,0.608,0.590,0.593],[0.946,0.838,0.841,0.839,0.844,0.856],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.094,0.010,0.011,0.011,0.011,0.011],[0.067,0.004,0.004,0.005,0.004,0.004],[0.664,0.069,0.069,0.069,0.068,0.069],[0.716,0.145,0.143,0.144,0.144,0.144],[0.260,0.091,0.091,0.088,0.086,0.090],[0.804,0.161,0.169,0.167,0.162,0.161],[0.409,0.052,0.055,0.054,0.055,0.053],[0.509,0.092,0.092,0.094,0.095,0.095],[0.552,0.143,0.138,0.138,0.142,0.146],[0.458,0.071,0.090,0.076,0.073,0.074],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.993,0.533,0.531,0.527,0.533,0.540],[0.681,0.060,0.061,0.061,0.060,0.062],[1.094,0.612,0.612,0.609,0.610,0.612],[52.228,7.260,7.207,6.927,5.677,5.068],[53.536,5.121,5.149,5.112,5.144,5.147],[52.607,6.414,6.354,6.312,6.300,6.366],[59.230,13.117,13.167,13.149,13.209,13.230],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.372,4.272,4.264,4.257,4.250,4.242],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54004","source":"results/1.1.54004.json"} +,{"actual_version":"1.1.54005","data_size":{"default":4096,"hits":14191752872,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":74362068380,"taxi":23075371046,"tpcds":19001973008,"tpch":17160663461,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":211,"job":32,"mgbench":28,"ontime":88,"ssb":2097,"taxi":1199,"tpcds":231,"tpch":335,"uk":60},"machine":"c7a.4xlarge","release_date":"2016-08-07","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.096,0.010,0.010,0.010,0.009,0.009],[0.068,0.024,0.025,0.024,0.024,0.025],[null,null,null,null,null,null],[0.178,0.121,0.114,0.122,0.122,0.117],[null,null,null,null,null,null],[0.630,0.554,0.563,0.559,0.552,0.552],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[59.817,7.814,7.877,7.876,7.871,7.875],[null,null,null,null,null,null],[49.775,4.723,9.000,9.174,9.148,9.146],[71.653,17.748,17.805,17.671,17.718,17.825],[50.463,14.675,14.745,14.641,14.625,14.636],[50.826,14.411,14.385,14.448,14.428,14.424],[70.322,21.765,21.579,21.684,21.755,21.739],[67.577,21.861,21.894,21.900,21.758,21.784],[51.970,15.636,15.641,15.630,15.683,15.698],[null,null,null,null,null,null],[70.823,22.459,22.728,22.666,22.739,22.606],[52.810,14.905,14.828,14.864,14.921,14.720],[51.495,13.535,13.648,13.533,13.505,13.435],[0.076,0.013,0.012,0.013,0.012,0.013],[0.079,0.014,0.011,0.014,0.013,0.014],[0.121,0.062,0.062,0.060,0.061,0.061],[0.159,0.100,0.102,0.103,0.101,0.100],[0.238,0.186,0.182,0.183,0.183,0.181],[0.336,0.263,0.260,0.259,0.255,0.251],[0.100,0.038,0.038,0.037,0.039,0.038],[0.075,0.013,0.014,0.013,0.013,0.013],[0.404,0.339,0.341,0.346,0.344,0.338],[0.465,0.389,0.396,0.400,0.387,0.394],[0.432,0.377,0.374,0.374,0.371,0.369],[0.453,0.398,0.387,0.382,0.381,0.390],[0.593,0.516,0.510,0.511,0.503,0.529],[0.766,0.651,0.632,0.602,0.596,0.588],[0.613,0.518,0.497,0.490,0.486,0.484],[0.527,0.517,0.477,0.450,0.435,0.432],[1.313,1.207,1.137,1.119,1.140,1.152],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.404,0.323,0.328,0.332,0.325,0.324],[1.490,0.816,0.822,0.822,0.802,0.824],[1.214,1.021,1.014,1.019,1.022,1.017],[1.823,1.792,1.795,1.787,1.777,1.759],[0.695,0.610,0.604,0.598,0.602,0.608],[0.934,0.865,0.854,0.858,0.855,0.863],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.082,0.010,0.009,0.009,0.009,0.009],[0.055,0.004,0.004,0.004,0.004,0.004],[0.527,0.070,0.069,0.070,0.073,0.071],[0.597,0.146,0.148,0.145,0.145,0.145],[0.219,0.088,0.093,0.099,0.090,0.089],[0.654,0.165,0.165,0.163,0.164,0.165],[0.336,0.053,0.054,0.053,0.052,0.054],[0.411,0.094,0.094,0.096,0.093,0.095],[0.456,0.141,0.142,0.141,0.140,0.141],[0.380,0.074,0.070,0.072,0.093,0.076],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.893,0.544,0.543,0.552,0.536,0.535],[0.528,0.064,0.065,0.063,0.067,0.064],[0.989,0.603,0.607,0.606,0.607,0.617],[40.841,7.395,7.373,7.347,7.387,7.350],[42.093,4.897,4.881,4.884,4.851,4.873],[40.840,6.131,6.198,6.194,6.173,6.200],[47.493,13.178,13.178,13.189,13.188,13.172],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.386,4.312,4.319,4.317,4.321,4.290],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54005","source":"results/1.1.54005.json"} +,{"actual_version":"1.1.54006","data_size":{"default":4096,"hits":14199514105,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":74296656856,"taxi":23092808646,"tpcds":19001791214,"tpch":17160615313,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":215,"job":29,"mgbench":28,"ontime":87,"ssb":2084,"taxi":1195,"tpcds":230,"tpch":343,"uk":58},"machine":"c7a.4xlarge","release_date":"2016-08-10","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.102,0.010,0.010,0.010,0.010,0.010],[0.083,0.024,0.024,0.026,0.025,0.024],[null,null,null,null,null,null],[0.188,0.121,0.125,0.118,0.119,0.117],[null,null,null,null,null,null],[0.643,0.592,0.575,0.566,0.562,0.552],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[63.882,8.271,8.425,8.268,8.277,8.273],[null,null,null,null,null,null],[52.498,9.673,9.602,9.566,9.586,9.646],[75.890,18.763,18.698,18.889,18.894,18.792],[55.298,15.701,15.598,15.653,15.547,15.630],[54.355,15.284,15.307,15.181,13.790,11.658],[73.852,23.171,23.119,23.154,23.055,23.142],[70.024,23.192,23.239,23.130,23.222,23.166],[56.143,16.676,16.648,16.664,16.650,16.642],[null,null,null,null,null,null],[74.925,24.101,24.005,24.209,24.123,24.094],[56.970,15.766,15.944,15.890,15.778,15.847],[54.575,14.494,14.465,14.328,14.358,14.399],[0.080,0.013,0.013,0.013,0.013,0.013],[0.080,0.015,0.014,0.013,0.011,0.012],[0.120,0.054,0.051,0.053,0.056,0.054],[0.168,0.106,0.104,0.104,0.105,0.105],[0.256,0.190,0.192,0.189,0.188,0.196],[0.353,0.262,0.265,0.268,0.264,0.266],[0.102,0.032,0.031,0.034,0.032,0.032],[0.081,0.015,0.014,0.013,0.015,0.014],[0.395,0.336,0.332,0.319,0.315,0.317],[0.465,0.397,0.386,0.394,0.386,0.384],[0.360,0.278,0.245,0.212,0.183,0.176],[0.252,0.176,0.172,0.173,0.167,0.166],[0.537,0.578,0.603,0.552,0.563,0.549],[0.842,0.757,0.751,0.736,0.736,0.736],[0.714,0.631,0.629,0.618,0.619,0.615],[0.688,0.634,0.633,0.619,0.615,0.623],[1.462,1.341,1.324,1.286,1.335,1.311],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.425,0.339,0.339,0.342,0.341,0.340],[1.516,0.842,0.819,0.829,0.830,0.823],[1.233,1.050,1.069,1.057,1.047,1.048],[1.834,1.721,1.727,1.742,1.762,1.715],[0.752,0.625,0.624,0.618,0.619,0.624],[1.009,0.913,0.908,0.910,0.902,0.891],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.097,0.012,0.010,0.011,0.011,0.010],[0.064,0.004,0.004,0.004,0.004,0.004],[0.570,0.072,0.072,0.073,0.073,0.073],[0.660,0.155,0.155,0.155,0.155,0.154],[0.244,0.091,0.091,0.096,0.095,0.093],[0.717,0.165,0.164,0.171,0.167,0.164],[0.380,0.056,0.055,0.056,0.056,0.055],[0.462,0.100,0.097,0.096,0.097,0.099],[0.502,0.145,0.146,0.143,0.149,0.142],[0.404,0.079,0.077,0.077,0.077,0.092],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.940,0.559,0.561,0.569,0.561,0.554],[0.597,0.066,0.065,0.065,0.066,0.066],[1.057,0.615,0.618,0.620,0.616,0.626],[45.054,7.802,7.832,7.833,7.815,7.850],[47.590,5.363,5.376,5.374,5.350,5.334],[46.925,6.754,6.816,6.757,6.780,6.838],[54.345,14.354,14.352,14.353,14.325,14.342],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.317,2.959,2.156,1.865,1.720,1.797],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54006","source":"results/1.1.54006.json"} +,{"actual_version":"1.1.54007","data_size":{"default":4096,"hits":14195144580,"job":1816836300,"mgbench":1074968383,"ontime":2322016698,"ssb":74350591169,"taxi":23091516719,"tpcds":18994056134,"tpch":17160584050,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":211,"job":29,"mgbench":27,"ontime":87,"ssb":2063,"taxi":1192,"tpcds":226,"tpch":329,"uk":55},"machine":"c7a.4xlarge","release_date":"2016-08-10","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.100,0.011,0.011,0.010,0.010,0.010],[0.077,0.025,0.024,0.025,0.025,0.025],[null,null,null,null,null,null],[0.174,0.121,0.118,0.118,0.122,0.121],[null,null,null,null,null,null],[0.641,0.574,0.566,0.551,0.565,0.556],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[62.443,8.354,8.452,8.367,8.338,8.260],[null,null,null,null,null,null],[50.730,9.715,9.700,9.679,9.649,9.646],[73.527,18.789,18.662,18.835,18.588,18.817],[54.292,15.533,15.566,15.505,15.476,15.570],[52.740,15.124,15.091,15.172,15.232,9.155],[72.910,23.121,23.020,23.002,23.139,23.042],[69.088,22.903,23.045,23.016,23.154,23.258],[54.040,16.696,16.659,13.925,13.710,16.599],[null,null,null,null,null,null],[73.024,24.526,24.280,24.352,24.340,24.484],[56.174,15.893,15.898,15.916,15.864,15.925],[53.396,14.465,14.455,13.513,13.721,14.341],[0.074,0.015,0.013,0.015,0.013,0.013],[0.078,0.015,0.013,0.015,0.014,0.014],[0.113,0.053,0.058,0.054,0.053,0.055],[0.161,0.106,0.105,0.105,0.107,0.110],[0.264,0.191,0.191,0.191,0.190,0.190],[0.354,0.268,0.263,0.262,0.262,0.259],[0.099,0.033,0.031,0.032,0.032,0.032],[0.076,0.016,0.015,0.014,0.013,0.015],[0.420,0.344,0.360,0.356,0.360,0.354],[0.487,0.406,0.407,0.403,0.396,0.412],[0.466,0.394,0.392,0.373,0.393,0.403],[0.489,0.403,0.414,0.413,0.415,0.419],[0.623,0.540,0.527,0.524,0.526,0.525],[0.828,0.710,0.732,0.719,0.706,0.714],[0.697,0.613,0.609,0.612,0.614,0.615],[0.678,0.613,0.609,0.614,0.610,0.605],[1.420,1.288,1.307,1.307,1.313,1.305],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.432,0.332,0.326,0.337,0.332,0.334],[1.547,0.810,0.828,0.823,0.823,0.809],[1.244,1.026,1.028,1.034,1.040,1.040],[1.787,1.719,1.749,1.718,1.717,1.712],[0.742,0.635,0.618,0.611,0.616,0.617],[1.043,0.895,0.891,0.895,0.881,0.905],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.092,0.012,0.012,0.011,0.011,0.011],[0.062,0.004,0.004,0.004,0.004,0.004],[0.567,0.074,0.072,0.073,0.074,0.072],[0.627,0.153,0.153,0.152,0.153,0.154],[0.233,0.091,0.088,0.091,0.094,0.095],[0.682,0.168,0.185,0.172,0.166,0.169],[0.352,0.056,0.057,0.057,0.058,0.056],[0.416,0.100,0.101,0.100,0.098,0.100],[0.498,0.145,0.148,0.145,0.142,0.144],[0.423,0.074,0.076,0.077,0.077,0.077],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.911,0.552,0.547,0.547,0.550,0.542],[0.554,0.064,0.063,0.063,0.064,0.065],[0.995,0.612,0.608,0.614,0.623,0.618],[44.407,7.757,7.738,7.762,7.812,7.768],[45.412,5.393,5.380,5.341,5.393,5.347],[44.077,6.701,6.792,6.767,6.722,6.690],[51.456,14.207,14.230,14.209,12.467,14.118],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.865,4.793,4.788,4.763,4.768,4.767],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54007","source":"results/1.1.54007.json"} +,{"actual_version":"1.1.54008","data_size":{"default":4096,"hits":14217151698,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":74353535824,"taxi":23088659377,"tpcds":19012286996,"tpch":17160633248,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":222,"job":35,"mgbench":28,"ontime":93,"ssb":2130,"taxi":1247,"tpcds":240,"tpch":352,"uk":66},"machine":"c7a.4xlarge","release_date":"2016-08-13","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.112,0.011,0.010,0.010,0.010,0.009],[0.079,0.025,0.023,0.025,0.024,0.024],[null,null,null,null,null,null],[0.188,0.113,0.115,0.119,0.118,0.117],[null,null,null,null,null,null],[0.649,0.557,0.556,0.545,0.548,0.554],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[66.871,7.700,7.651,7.672,7.671,7.650],[null,null,null,null,null,null],[55.756,8.952,8.801,8.846,8.873,8.820],[78.221,17.557,17.409,17.605,17.429,17.508],[58.150,14.412,14.446,14.453,14.538,14.454],[57.744,14.094,14.184,14.076,8.552,14.000],[75.528,21.458,21.601,21.626,21.680,21.597],[72.699,21.658,21.770,21.841,21.665,21.740],[58.429,15.267,13.388,12.580,15.358,15.204],[null,null,null,null,null,null],[75.927,22.366,22.470,22.451,22.441,22.479],[59.318,14.530,14.657,14.601,14.695,14.564],[58.078,13.372,13.320,13.394,11.752,14.886],[0.093,0.014,0.012,0.013,0.013,0.013],[0.100,0.013,0.013,0.014,0.014,0.014],[0.138,0.051,0.050,0.051,0.054,0.052],[0.178,0.105,0.106,0.107,0.109,0.108],[0.267,0.192,0.192,0.190,0.185,0.188],[0.351,0.269,0.267,0.261,0.261,0.269],[0.109,0.029,0.032,0.029,0.029,0.029],[0.096,0.015,0.015,0.014,0.014,0.015],[0.415,0.352,0.341,0.343,0.345,0.363],[0.483,0.396,0.401,0.405,0.397,0.391],[0.441,0.377,0.377,0.378,0.378,0.382],[0.484,0.388,0.398,0.386,0.403,0.402],[0.607,0.516,0.521,0.518,0.516,0.510],[0.790,0.689,0.691,0.684,0.683,0.687],[0.697,0.608,0.598,0.596,0.593,0.597],[0.665,0.595,0.596,0.596,0.596,0.604],[1.391,1.279,1.292,1.254,1.253,1.249],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.414,0.311,0.313,0.318,0.314,0.317],[1.495,0.794,0.794,0.787,0.793,0.794],[1.244,1.015,1.012,1.023,1.024,1.030],[1.788,1.689,1.687,1.709,1.711,1.694],[0.720,0.606,0.609,0.609,0.602,0.609],[0.979,0.864,0.864,0.867,0.868,0.891],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.102,0.011,0.012,0.011,0.010,0.010],[0.076,0.004,0.004,0.004,0.004,0.004],[0.641,0.070,0.069,0.070,0.069,0.070],[0.718,0.147,0.146,0.145,0.145,0.145],[0.259,0.088,0.087,0.090,0.087,0.087],[0.769,0.166,0.165,0.163,0.166,0.164],[0.407,0.054,0.055,0.055,0.054,0.054],[0.496,0.095,0.096,0.092,0.095,0.096],[0.540,0.140,0.140,0.144,0.140,0.141],[0.454,0.089,0.071,0.071,0.095,0.091],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.972,0.542,0.534,0.539,0.552,0.525],[0.653,0.059,0.062,0.061,0.061,0.062],[1.066,0.607,0.599,0.608,0.601,0.601],[51.523,7.445,7.426,7.469,7.433,7.475],[53.162,5.170,5.134,5.152,5.162,5.142],[51.903,6.428,6.473,6.423,6.383,6.455],[59.256,12.064,10.181,13.975,14.287,14.158],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.580,4.520,4.518,4.502,4.518,4.503],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54008","source":"results/1.1.54008.json"} +,{"actual_version":"1.1.54010","data_size":{"default":4096,"hits":14196520679,"job":1816841964,"mgbench":1074952778,"ontime":2322012602,"ssb":74279157074,"taxi":23053414273,"tpcds":18998579059,"tpch":17160637732,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":206,"job":30,"mgbench":28,"ontime":89,"ssb":2132,"taxi":1203,"tpcds":233,"tpch":338,"uk":59},"machine":"c7a.4xlarge","release_date":"2016-08-15","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.085,0.011,0.011,0.010,0.010,0.011],[0.069,0.025,0.024,0.025,0.023,0.025],[null,null,null,null,null,null],[0.167,0.119,0.117,0.113,0.117,0.116],[null,null,null,null,null,null],[0.641,0.566,0.562,0.569,0.575,0.573],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[60.409,8.027,7.998,8.046,4.974,6.351],[null,null,null,null,null,null],[49.291,9.309,9.242,9.358,9.363,9.304],[71.674,18.096,18.139,18.096,18.153,18.109],[51.655,14.894,15.024,14.889,14.931,15.002],[51.274,14.599,14.560,14.606,14.704,14.700],[70.626,22.116,22.130,22.056,22.106,22.137],[67.777,22.060,22.150,22.072,22.195,22.287],[49.407,15.798,15.776,15.914,15.864,15.898],[null,null,null,null,null,null],[70.901,22.986,23.313,23.269,23.361,23.304],[53.937,15.113,15.162,15.178,15.079,15.112],[51.980,13.777,13.794,13.855,13.896,13.876],[0.065,0.013,0.012,0.014,0.014,0.014],[0.069,0.016,0.014,0.013,0.014,0.014],[0.114,0.062,0.060,0.065,0.060,0.062],[0.148,0.104,0.104,0.104,0.103,0.106],[0.238,0.188,0.186,0.187,0.186,0.187],[0.338,0.258,0.264,0.262,0.260,0.260],[0.091,0.039,0.039,0.038,0.041,0.043],[0.064,0.013,0.014,0.013,0.014,0.013],[0.377,0.302,0.299,0.292,0.294,0.293],[0.427,0.373,0.389,0.388,0.380,0.392],[0.211,0.156,0.155,0.151,0.256,0.369],[0.420,0.349,0.329,0.316,0.314,0.312],[0.602,0.516,0.515,0.515,0.529,0.522],[0.793,0.700,0.716,0.701,0.690,0.694],[0.657,0.592,0.603,0.596,0.608,0.596],[0.647,0.593,0.601,0.610,0.608,0.595],[1.390,1.256,1.283,1.299,1.266,1.303],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.390,0.321,0.321,0.326,0.326,0.324],[1.495,0.811,0.820,0.795,0.816,0.822],[1.215,1.022,1.028,1.027,1.028,1.044],[1.866,1.847,1.854,1.853,1.858,1.829],[0.702,0.612,0.612,0.628,0.610,0.601],[0.956,0.892,0.873,0.915,0.878,0.883],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.082,0.011,0.011,0.011,0.010,0.011],[0.052,0.004,0.004,0.004,0.004,0.004],[0.543,0.073,0.071,0.072,0.072,0.073],[0.614,0.152,0.153,0.152,0.153,0.152],[0.230,0.099,0.088,0.099,0.092,0.096],[0.684,0.168,0.165,0.171,0.164,0.162],[0.353,0.057,0.055,0.056,0.055,0.058],[0.440,0.098,0.096,0.098,0.096,0.098],[0.488,0.142,0.144,0.147,0.145,0.144],[0.402,0.075,0.094,0.074,0.075,0.080],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.926,0.548,0.546,0.545,0.559,0.556],[0.562,0.067,0.067,0.068,0.066,0.068],[1.013,0.612,0.619,0.625,0.615,0.615],[38.855,7.508,7.473,7.493,7.467,7.470],[39.199,4.720,4.703,4.710,4.739,4.751],[38.282,6.073,6.064,6.011,6.087,6.080],[46.099,13.483,13.467,13.508,13.571,13.571],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.612,4.535,4.530,4.528,4.523,3.822],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54010","source":"results/1.1.54010.json"} +,{"actual_version":"1.1.54011","data_size":{"default":4096,"hits":14210047497,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":74361491509,"taxi":23087975925,"tpcds":18995588434,"tpch":17160626068,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":210,"job":30,"mgbench":27,"ontime":89,"ssb":2088,"taxi":1222,"tpcds":228,"tpch":335,"uk":59},"machine":"c7a.4xlarge","release_date":"2016-08-17","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.105,0.011,0.011,0.011,0.011,0.011],[0.079,0.027,0.026,0.025,0.026,0.025],[null,null,null,null,null,null],[0.186,0.125,0.122,0.129,0.123,0.118],[null,null,null,null,null,null],[0.657,0.579,0.563,0.571,0.572,0.574],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[60.713,8.502,8.583,8.511,8.592,8.520],[null,null,null,null,null,null],[50.871,6.481,5.031,9.518,9.967,9.953],[72.139,18.738,18.712,18.736,18.859,18.605],[52.553,15.650,15.619,15.571,15.551,15.544],[52.070,15.197,15.092,15.125,15.122,15.188],[71.864,22.862,22.844,22.782,22.839,22.794],[67.638,22.755,23.001,22.796,22.853,22.980],[52.874,16.442,16.492,16.351,14.354,14.053],[null,null,null,null,null,null],[70.244,23.772,24.060,23.912,24.043,23.947],[54.728,16.027,15.801,15.795,15.757,15.882],[52.527,14.439,14.473,14.458,14.498,14.473],[0.072,0.013,0.013,0.012,0.013,0.014],[0.081,0.014,0.014,0.014,0.014,0.015],[0.122,0.054,0.052,0.052,0.054,0.053],[0.166,0.111,0.111,0.108,0.113,0.116],[0.253,0.196,0.198,0.197,0.200,0.196],[0.349,0.253,0.256,0.265,0.249,0.249],[0.090,0.031,0.031,0.031,0.031,0.032],[0.072,0.013,0.014,0.013,0.013,0.015],[0.375,0.296,0.340,0.330,0.392,0.364],[0.495,0.423,0.425,0.416,0.423,0.414],[0.467,0.409,0.420,0.416,0.412,0.417],[0.496,0.434,0.439,0.438,0.426,0.433],[0.632,0.547,0.558,0.552,0.553,0.551],[0.819,0.751,0.737,0.760,0.752,0.744],[0.703,0.635,0.628,0.632,0.633,0.629],[0.675,0.620,0.620,0.630,0.632,0.632],[1.440,1.324,1.323,1.304,1.305,1.324],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.432,0.345,0.345,0.348,0.346,0.341],[1.500,0.812,0.801,0.805,0.813,0.810],[1.233,1.072,1.063,1.072,1.068,1.065],[1.756,1.710,1.743,1.718,1.697,1.717],[0.728,0.636,0.640,0.642,0.630,0.650],[1.043,0.941,0.929,0.932,0.940,0.931],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.092,0.011,0.010,0.011,0.011,0.011],[0.060,0.004,0.004,0.004,0.004,0.004],[0.563,0.075,0.075,0.076,0.075,0.076],[0.637,0.160,0.159,0.161,0.160,0.159],[0.242,0.093,0.094,0.089,0.098,0.097],[0.694,0.169,0.168,0.167,0.167,0.167],[0.352,0.059,0.058,0.058,0.059,0.059],[0.452,0.100,0.101,0.100,0.099,0.098],[0.507,0.143,0.148,0.148,0.149,0.148],[0.408,0.078,0.079,0.077,0.077,0.078],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.973,0.584,0.551,0.560,0.553,0.550],[0.609,0.068,0.066,0.066,0.068,0.065],[1.044,0.623,0.626,0.631,0.628,0.621],[43.467,8.002,7.999,8.047,8.060,8.018],[46.689,5.586,5.619,5.628,5.618,5.606],[45.876,6.891,6.906,6.895,6.927,6.883],[53.291,14.663,14.741,14.568,14.088,10.661],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.863,4.750,4.739,4.734,4.727,4.727],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54011","source":"results/1.1.54011.json"} +,{"actual_version":"1.1.54019","data_size":{"default":4096,"hits":14212886527,"job":1816841964,"mgbench":1074952778,"ontime":2322016698,"ssb":74342854748,"taxi":23118404107,"tpcds":19012720281,"tpch":18888239027,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":215,"job":64,"mgbench":26,"ontime":75,"ssb":1719,"taxi":842,"tpcds":271,"tpch":305,"uk":49},"machine":"c7a.4xlarge","release_date":"2016-09-14","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.111,0.011,0.011,0.011,0.011,0.011],[0.081,0.026,0.027,0.026,0.026,0.024],[null,null,null,null,null,null],[0.187,0.126,0.122,0.124,0.122,0.125],[null,null,null,null,null,null],[0.677,0.569,0.569,0.575,0.565,0.581],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[94.873,10.799,10.816,10.805,10.832,10.814],[null,null,null,null,null,null],[80.873,12.715,12.711,12.671,12.628,12.545],[null,null,null,null,null,null],[80.489,19.494,19.440,19.703,19.514,19.508],[78.752,19.196,19.367,19.283,19.196,19.210],[null,null,null,null,null,null],[null,null,null,null,null,null],[79.824,20.148,19.997,19.603,13.318,20.855],[null,null,null,null,null,null],[null,null,null,null,null,null],[85.369,21.072,20.866,21.001,21.175,21.039],[83.693,19.344,19.342,15.228,19.119,19.323],[0.088,0.014,0.013,0.013,0.015,0.014],[0.101,0.014,0.015,0.014,0.015,0.014],[0.140,0.051,0.052,0.051,0.058,0.052],[0.186,0.108,0.110,0.109,0.107,0.107],[0.273,0.196,0.200,0.194,0.194,0.195],[0.383,0.272,0.271,0.270,0.268,0.274],[0.118,0.032,0.033,0.033,0.031,0.031],[0.103,0.016,0.016,0.015,0.015,0.016],[0.444,0.365,0.360,0.356,0.351,0.354],[0.497,0.411,0.401,0.411,0.399,0.401],[0.461,0.392,0.390,0.395,0.397,0.398],[0.499,0.417,0.411,0.419,0.428,0.418],[0.644,0.528,0.550,0.553,0.542,0.558],[0.812,0.699,0.706,0.700,0.708,0.700],[0.707,0.633,0.635,0.628,0.621,0.607],[0.694,0.614,0.611,0.610,0.615,0.611],[1.527,1.390,1.376,1.329,1.323,1.349],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.434,0.334,0.337,0.322,0.331,0.339],[1.564,0.829,0.813,0.799,0.805,0.815],[1.271,1.038,1.016,1.015,1.014,1.020],[1.833,1.768,1.756,1.759,1.746,1.761],[0.731,0.608,0.625,0.608,0.609,0.599],[1.015,0.881,0.867,0.874,0.880,0.878],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.104,0.010,0.010,0.011,0.010,0.010],[0.073,0.005,0.005,0.005,0.005,0.005],[0.623,0.071,0.072,0.072,0.070,0.071],[0.707,0.152,0.148,0.149,0.150,0.149],[0.243,0.087,0.098,0.092,0.096,0.095],[0.761,0.168,0.168,0.170,0.172,0.167],[0.440,0.056,0.055,0.055,0.055,0.057],[0.512,0.096,0.094,0.093,0.094,0.097],[0.568,0.144,0.144,0.139,0.143,0.142],[0.474,0.075,0.092,0.073,0.093,0.076],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.999,0.556,0.553,0.551,0.551,0.549],[0.675,0.066,0.066,0.063,0.066,0.064],[1.096,0.610,0.608,0.613,0.602,0.611],[52.523,7.972,7.991,7.989,7.994,7.998],[55.319,5.924,5.950,5.932,5.921,5.934],[54.412,7.106,6.592,5.919,4.471,7.421],[62.850,14.615,14.561,14.564,14.563,14.527],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.617,4.526,4.506,4.504,4.528,4.515],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54019","source":"results/1.1.54019.json"} +,{"actual_version":"1.1.54020","data_size":{"default":4096,"hits":14184888768,"job":1816919209,"mgbench":1074964708,"ontime":2322012602,"ssb":74477542364,"taxi":23114296273,"tpcds":19014838034,"tpch":17160565865,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":217,"job":70,"mgbench":24,"ontime":69,"ssb":1717,"taxi":846,"tpcds":277,"tpch":287,"uk":48},"machine":"c7a.4xlarge","release_date":"2016-09-21","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.095,0.012,0.011,0.011,0.011,0.011],[0.074,0.027,0.028,0.026,0.028,0.028],[null,null,null,null,null,null],[0.178,0.128,0.155,0.125,0.125,0.122],[null,null,null,null,null,null],[0.673,0.616,0.626,0.609,0.606,0.603],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[82.817,10.845,10.893,10.828,10.806,10.884],[null,null,null,null,null,null],[68.762,9.000,13.553,13.244,13.098,13.128],[98.192,23.997,23.963,24.043,23.979,24.088],[70.650,19.868,19.762,19.711,19.833,20.092],[70.007,19.183,19.463,19.427,19.349,19.375],[94.874,28.030,27.819,27.941,28.095,27.731],[91.513,28.111,28.205,28.250,28.268,28.097],[67.705,20.206,20.232,20.249,20.252,20.360],[null,null,null,null,null,null],[96.609,30.721,30.579,30.733,30.692,30.211],[72.198,20.294,20.914,20.876,20.714,20.644],[71.484,18.992,18.923,18.833,18.920,18.944],[0.057,0.013,0.012,0.012,0.012,0.012],[0.055,0.012,0.012,0.012,0.013,0.013],[0.109,0.074,0.063,0.064,0.062,0.060],[0.156,0.112,0.112,0.112,0.112,0.111],[0.232,0.198,0.192,0.198,0.198,0.194],[0.341,0.271,0.287,0.270,0.272,0.284],[0.084,0.040,0.039,0.041,0.042,0.040],[0.052,0.013,0.014,0.013,0.013,0.014],[0.408,0.349,0.361,0.351,0.349,0.344],[0.457,0.403,0.413,0.434,0.412,0.403],[0.433,0.399,0.402,0.404,0.399,0.404],[0.471,0.426,0.423,0.422,0.426,0.425],[0.605,0.543,0.550,0.554,0.558,0.544],[0.789,0.730,0.735,0.734,0.746,0.726],[0.682,0.639,0.640,0.622,0.630,0.618],[0.672,0.647,0.622,0.650,0.630,0.640],[1.502,1.365,1.360,1.405,1.377,1.364],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.384,0.340,0.339,0.334,0.339,0.342],[1.485,0.825,0.819,0.832,0.807,0.840],[1.223,1.024,1.030,1.029,1.039,1.034],[1.951,1.911,1.916,1.922,1.926,1.920],[0.693,0.628,0.633,0.622,0.630,0.618],[0.981,0.914,0.915,0.914,0.902,0.925],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.070,0.013,0.013,0.012,0.012,0.013],[0.043,0.004,0.004,0.004,0.004,0.004],[0.536,0.074,0.073,0.073,0.073,0.073],[0.616,0.154,0.154,0.154,0.153,0.156],[0.221,0.100,0.090,0.091,0.097,0.092],[0.684,0.175,0.173,0.171,0.171,0.180],[0.384,0.055,0.057,0.055,0.056,0.056],[0.441,0.099,0.098,0.099,0.097,0.097],[0.488,0.150,0.142,0.147,0.146,0.144],[0.403,0.077,0.094,0.076,0.078,0.078],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.939,0.562,0.564,0.559,0.570,0.577],[0.543,0.067,0.066,0.064,0.065,0.066],[1.021,0.624,0.609,0.618,0.616,0.611],[47.161,8.022,8.041,8.033,8.054,8.076],[48.916,5.931,5.970,5.933,5.938,5.904],[48.094,7.299,7.182,7.173,7.187,7.246],[54.834,14.784,14.845,14.708,14.749,14.698],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.687,4.611,4.608,4.619,4.601,4.614],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54020","source":"results/1.1.54020.json"} +,{"actual_version":"1.1.54022","data_size":{"default":4096,"hits":14196191963,"job":1816841964,"mgbench":1074952778,"ontime":2322016698,"ssb":74477093198,"taxi":23115513171,"tpcds":18997798023,"tpch":17160590188,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":220,"job":77,"mgbench":27,"ontime":75,"ssb":1743,"taxi":846,"tpcds":280,"tpch":309,"uk":53},"machine":"c7a.4xlarge","release_date":"2016-09-28","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.099,0.012,0.011,0.011,0.011,0.011],[0.080,0.027,0.030,0.027,0.027,0.030],[null,null,null,null,null,null],[0.193,0.135,0.136,0.136,0.129,0.124],[null,null,null,null,null,null],[0.688,0.600,0.621,0.622,0.634,0.616],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[87.180,10.931,10.854,10.986,11.039,10.979],[null,null,null,null,null,null],[73.074,12.884,12.874,12.829,12.762,12.792],[null,null,null,null,null,null],[75.797,20.997,20.908,20.910,21.023,20.799],[73.242,18.485,20.630,20.620,20.470,20.463],[null,null,null,null,null,null],[95.166,28.218,28.607,27.955,27.944,28.145],[72.123,19.971,19.955,19.907,19.946,20.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[78.702,21.584,21.435,21.345,21.391,21.238],[76.336,19.861,19.755,19.784,19.554,19.561],[0.065,0.016,0.013,0.014,0.015,0.014],[0.073,0.014,0.014,0.014,0.013,0.014],[0.118,0.061,0.058,0.061,0.058,0.058],[0.166,0.116,0.114,0.111,0.117,0.118],[0.255,0.208,0.203,0.207,0.201,0.194],[0.362,0.284,0.291,0.299,0.304,0.292],[0.094,0.037,0.041,0.036,0.038,0.039],[0.070,0.015,0.014,0.015,0.014,0.014],[0.437,0.383,0.371,0.386,0.375,0.373],[0.510,0.462,0.440,0.446,0.434,0.439],[0.474,0.415,0.425,0.405,0.406,0.417],[0.489,0.436,0.449,0.434,0.442,0.431],[0.669,0.587,0.597,0.598,0.595,0.586],[0.857,0.774,0.781,0.783,0.773,0.773],[0.736,0.671,0.674,0.670,0.653,0.648],[0.704,0.665,0.657,0.656,0.649,0.648],[1.570,1.456,1.455,1.456,1.418,1.416],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.411,0.350,0.365,0.351,0.351,0.353],[1.493,0.876,0.854,0.845,0.863,0.855],[1.242,1.121,1.086,1.079,1.116,1.083],[2.092,2.098,1.933,1.922,1.907,1.916],[0.729,0.636,0.666,0.643,0.642,0.641],[1.039,0.933,0.931,0.954,0.933,0.959],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.093,0.012,0.011,0.011,0.010,0.011],[0.061,0.005,0.004,0.004,0.004,0.004],[0.585,0.076,0.075,0.076,0.076,0.074],[0.654,0.159,0.159,0.160,0.161,0.161],[0.240,0.098,0.093,0.097,0.102,0.095],[0.720,0.178,0.180,0.183,0.178,0.186],[0.412,0.059,0.060,0.059,0.059,0.060],[0.467,0.102,0.104,0.103,0.105,0.102],[0.535,0.154,0.159,0.159,0.150,0.153],[0.442,0.077,0.080,0.095,0.078,0.078],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.006,0.606,0.602,0.600,0.598,0.585],[0.596,0.069,0.070,0.067,0.068,0.068],[1.095,0.657,0.652,0.659,0.660,0.649],[50.347,8.382,8.418,8.391,8.395,8.465],[51.700,3.820,3.056,4.854,6.140,6.351],[50.028,7.566,7.584,7.472,7.608,7.575],[58.736,15.142,15.149,15.247,15.131,15.193],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.804,4.691,4.694,4.687,4.682,4.704],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54022","source":"results/1.1.54022.json"} +,{"actual_version":"1.1.54023","data_size":{"default":4096,"hits":14176201503,"job":1816919209,"mgbench":1074964708,"ontime":2322016698,"ssb":74304835336,"taxi":23111147491,"tpcds":18997168969,"tpch":18352835285,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":210,"job":67,"mgbench":26,"ontime":74,"ssb":1721,"taxi":835,"tpcds":262,"tpch":309,"uk":48},"machine":"c7a.4xlarge","release_date":"2016-10-10","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.086,0.012,0.011,0.011,0.011,0.011],[0.070,0.026,0.026,0.025,0.028,0.028],[null,null,null,null,null,null],[0.180,0.130,0.124,0.127,0.124,0.131],[null,null,null,null,null,null],[0.702,0.621,0.619,0.618,0.618,0.620],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[80.492,11.433,11.408,11.433,11.410,11.406],[null,null,null,null,null,null],[66.823,13.308,13.371,13.312,13.384,13.388],[96.966,24.687,24.687,24.604,24.742,24.749],[69.612,20.455,20.544,20.422,20.295,18.589],[67.387,19.404,19.529,19.490,19.486,19.260],[94.161,28.180,27.882,28.370,28.283,28.122],[92.814,25.512,29.206,28.661,28.823,29.257],[69.506,20.997,21.011,20.963,21.149,20.936],[null,null,null,null,null,null],[94.995,29.622,30.799,31.271,31.180,31.371],[73.979,21.343,21.347,21.494,21.473,21.340],[71.495,19.615,19.620,19.721,19.727,16.697],[0.061,0.014,0.014,0.013,0.012,0.012],[0.058,0.012,0.012,0.013,0.012,0.013],[0.108,0.062,0.062,0.065,0.062,0.061],[0.160,0.117,0.115,0.116,0.113,0.115],[0.245,0.203,0.198,0.200,0.197,0.198],[0.329,0.277,0.281,0.282,0.283,0.271],[0.086,0.040,0.038,0.038,0.040,0.040],[0.052,0.014,0.013,0.013,0.014,0.013],[0.411,0.371,0.363,0.359,0.360,0.380],[0.474,0.419,0.424,0.419,0.433,0.436],[0.473,0.426,0.420,0.421,0.420,0.420],[0.495,0.437,0.453,0.445,0.445,0.441],[0.631,0.578,0.574,0.570,0.571,0.572],[0.838,0.796,0.787,0.776,0.764,0.781],[0.686,0.660,0.653,0.645,0.646,0.657],[0.705,0.665,0.667,0.675,0.664,0.655],[1.540,1.464,1.466,1.405,1.418,1.433],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.410,0.349,0.361,0.354,0.347,0.360],[1.479,0.865,0.858,0.871,0.860,0.872],[1.220,1.108,1.138,1.111,1.095,1.117],[1.883,1.828,1.864,1.848,1.857,1.863],[0.729,0.653,0.657,0.649,0.661,0.655],[1.049,1.001,0.992,0.982,0.991,0.996],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.077,0.011,0.011,0.011,0.011,0.011],[0.045,0.004,0.004,0.004,0.004,0.004],[0.519,0.079,0.080,0.079,0.079,0.080],[0.598,0.170,0.169,0.170,0.170,0.170],[0.215,0.105,0.098,0.096,0.094,0.100],[0.665,0.181,0.184,0.182,0.175,0.179],[0.382,0.060,0.061,0.060,0.061,0.061],[0.447,0.108,0.105,0.102,0.106,0.103],[0.498,0.146,0.150,0.153,0.158,0.149],[0.412,0.082,0.083,0.082,0.101,0.099],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.976,0.603,0.604,0.601,0.600,0.599],[0.542,0.071,0.073,0.073,0.072,0.073],[1.032,0.633,0.637,0.631,0.633,0.632],[47.568,9.019,9.020,8.999,9.001,8.990],[47.201,6.604,6.614,6.627,6.618,6.589],[47.399,7.844,7.820,7.789,7.866,7.833],[56.577,16.004,15.991,15.965,16.026,15.888],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.103,5.033,5.038,5.034,5.013,5.024],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54023","source":"results/1.1.54023.json"} +,{"actual_version":"1.1.54030","data_size":{"default":4096,"hits":14205774288,"job":1816919209,"mgbench":1074964708,"ontime":2322016698,"ssb":179937909038,"taxi":23138684102,"tpcds":19006041285,"tpch":17160594015,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":216,"job":60,"mgbench":24,"ontime":66,"ssb":1778,"taxi":851,"tpcds":274,"tpch":287,"uk":47},"machine":"c7a.4xlarge","release_date":"2016-10-25","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.106,0.010,0.009,0.008,0.011,0.010],[0.086,0.025,0.024,0.022,0.024,0.023],[null,null,null,null,null,null],[0.203,0.127,0.128,0.117,0.112,0.112],[null,null,null,null,null,null],[0.726,0.525,0.576,0.550,0.553,0.574],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.749,0.265,0.254,0.246,0.251,0.254],[null,null,null,null,null,null],[0.788,0.352,0.341,0.322,0.319,0.323],[7.081,3.521,3.490,4.052,3.481,3.508],[5.232,2.746,2.769,2.518,2.557,2.715],[5.141,2.961,2.659,2.805,3.174,2.792],[6.370,6.514,6.698,6.813,6.831,6.792],[7.587,6.668,6.602,6.664,6.610,6.815],[4.790,4.447,4.335,4.402,4.712,4.451],[null,null,null,null,null,null],[8.134,5.773,5.747,5.965,5.674,5.678],[2.574,2.326,2.222,2.229,2.249,2.238],[2.196,1.982,2.131,1.955,1.932,1.939],[0.073,0.014,0.015,0.012,0.013,0.013],[0.072,0.013,0.012,0.013,0.018,0.012],[0.115,0.057,0.056,0.059,0.054,0.054],[0.153,0.109,0.102,0.098,0.105,0.104],[0.250,0.182,0.185,0.183,0.187,0.186],[0.346,0.276,0.268,0.264,0.268,0.265],[0.088,0.037,0.037,0.037,0.039,0.036],[0.071,0.015,0.014,0.014,0.015,0.015],[0.424,0.369,0.369,0.367,0.370,0.370],[0.477,0.424,0.427,0.436,0.419,0.427],[0.426,0.365,0.367,0.371,0.366,0.378],[0.451,0.405,0.397,0.399,0.379,0.399],[0.648,0.560,0.554,0.555,0.566,0.562],[0.823,0.748,0.780,0.740,0.749,0.756],[0.696,0.639,0.636,0.647,0.643,0.664],[0.674,0.644,0.630,0.633,0.638,0.639],[1.489,1.404,1.404,1.412,1.387,1.377],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.408,0.313,0.317,0.315,0.336,0.341],[1.591,0.845,0.836,0.825,0.815,0.838],[1.304,1.092,1.087,1.098,1.073,1.078],[1.813,1.786,1.762,1.795,1.777,1.797],[0.763,0.642,0.647,0.649,0.654,0.657],[1.064,0.949,0.945,0.963,0.957,0.943],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.096,0.011,0.010,0.011,0.010,0.010],[0.066,0.004,0.004,0.004,0.004,0.004],[0.600,0.073,0.072,0.072,0.071,0.073],[0.704,0.149,0.149,0.148,0.145,0.151],[0.242,0.093,0.100,0.097,0.089,0.093],[0.771,0.171,0.171,0.169,0.169,0.177],[0.505,0.056,0.055,0.056,0.055,0.055],[0.527,0.096,0.095,0.100,0.106,0.101],[0.552,0.145,0.148,0.147,0.148,0.147],[0.474,0.092,0.074,0.072,0.074,0.073],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.024,0.563,0.561,0.560,0.567,0.563],[0.632,0.062,0.067,0.063,0.063,0.064],[1.104,0.592,0.590,0.603,0.607,0.590],[52.415,8.822,8.850,8.837,8.837,8.774],[52.182,6.944,6.955,6.939,6.902,6.906],[51.809,7.942,7.876,8.058,7.896,7.864],[60.508,15.949,15.932,15.992,15.908,15.948],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.998,4.955,4.932,4.938,4.926,4.906],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54030","source":"results/1.1.54030.json"} +,{"actual_version":"1.1.54046","data_size":{"default":4096,"hits":14193325166,"job":1816841964,"mgbench":1074964708,"ontime":2322012602,"ssb":182776263901,"taxi":23139380416,"tpcds":19001265398,"tpch":17160604071,"uk":722425129},"kind":"versions-benchmark","load_time":{"hits":206,"job":74,"mgbench":22,"ontime":65,"ssb":1780,"taxi":847,"tpcds":265,"tpch":300,"uk":46},"machine":"c7a.4xlarge","release_date":"2016-11-08","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.120,0.009,0.009,0.009,0.009,0.010],[0.098,0.024,0.024,0.026,0.022,0.023],[null,null,null,null,null,null],[0.197,0.115,0.123,0.126,0.118,0.126],[null,null,null,null,null,null],[0.692,0.576,0.577,0.565,0.550,0.567],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.831,0.278,0.263,0.249,0.248,0.270],[null,null,null,null,null,null],[0.802,0.322,0.331,0.326,0.325,0.331],[6.994,3.906,3.978,3.811,4.032,3.910],[5.140,2.866,3.443,3.292,3.509,3.453],[5.020,3.477,3.390,3.371,3.442,3.394],[7.480,6.903,6.960,6.901,6.998,6.870],[7.495,6.814,6.888,6.922,6.859,6.824],[4.951,4.546,4.494,4.570,4.522,4.493],[null,null,null,null,null,null],[8.133,5.922,5.827,5.840,5.848,5.897],[2.544,2.326,2.313,2.308,2.310,2.317],[2.300,1.995,2.057,1.982,1.940,1.950],[0.086,0.013,0.017,0.014,0.015,0.014],[0.083,0.015,0.014,0.014,0.015,0.014],[0.131,0.066,0.062,0.063,0.061,0.063],[0.166,0.108,0.109,0.106,0.105,0.104],[0.259,0.197,0.195,0.185,0.188,0.185],[0.353,0.260,0.264,0.271,0.269,0.267],[0.104,0.035,0.039,0.036,0.034,0.039],[0.077,0.018,0.014,0.014,0.015,0.016],[0.441,0.376,0.368,0.370,0.370,0.362],[0.501,0.420,0.434,0.422,0.432,0.422],[0.453,0.382,0.383,0.391,0.385,0.385],[0.487,0.415,0.409,0.400,0.401,0.424],[0.656,0.571,0.563,0.573,0.564,0.575],[0.847,0.769,0.762,0.758,0.757,0.756],[0.721,0.655,0.662,0.648,0.652,0.658],[0.695,0.635,0.642,0.641,0.654,0.638],[1.534,1.416,1.393,1.395,1.693,1.296],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.417,0.327,0.322,0.322,0.331,0.329],[1.581,0.826,0.823,0.822,0.822,0.823],[1.312,1.088,1.086,1.085,1.107,1.088],[1.898,1.821,1.823,1.849,1.841,1.808],[0.778,0.675,0.672,0.680,0.673,0.702],[1.096,0.997,0.989,0.992,1.012,0.994],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.096,0.012,0.011,0.011,0.011,0.012],[0.066,0.004,0.004,0.004,0.004,0.004],[0.618,0.072,0.075,0.073,0.074,0.075],[0.685,0.154,0.158,0.158,0.151,0.158],[0.243,0.095,0.095,0.095,0.097,0.091],[0.793,0.174,0.177,0.179,0.181,0.176],[0.443,0.060,0.058,0.058,0.059,0.058],[0.511,0.103,0.109,0.102,0.100,0.099],[0.575,0.155,0.142,0.151,0.155,0.150],[0.475,0.076,0.075,0.100,0.078,0.078],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.025,0.586,0.579,0.570,0.581,0.584],[0.642,0.074,0.071,0.070,0.072,0.072],[1.089,0.635,0.637,0.631,0.640,0.635],[53.584,9.230,9.126,9.159,9.156,9.170],[54.257,7.090,7.126,7.094,7.058,7.120],[53.910,8.125,8.149,8.203,8.021,8.134],[62.500,16.400,16.323,16.360,16.314,16.322],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.198,5.110,5.068,5.072,5.044,5.075],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54046","source":"results/1.1.54046.json"} +,{"actual_version":"1.1.54074","data_size":{"default":4096,"hits":22047502436,"job":2039063141,"mgbench":1075160211,"ontime":2323896016,"ssb":150793487202,"taxi":22869846705,"tpcds":22856867909,"tpch":19203452121,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":561,"job":56,"mgbench":21,"ontime":57,"ssb":1644,"taxi":808,"tpcds":253,"tpch":278,"uk":42},"machine":"c7a.4xlarge","release_date":"2016-11-24","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.156,0.014,0.013,0.014,0.014,0.014],[0.121,0.032,0.033,0.031,0.036,0.030],[null,null,null,null,null,null],[0.216,0.108,0.103,0.107,0.104,0.103],[null,null,null,null,null,null],[0.574,0.451,0.448,0.457,0.451,0.452],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.585,0.306,0.301,0.308,0.306,0.311],[null,null,null,null,null,null],[1.361,0.362,0.357,0.363,0.358,0.357],[7.639,2.738,2.825,2.691,2.794,2.724],[5.953,2.252,2.274,2.258,2.271,2.246],[5.873,2.271,2.230,2.207,2.209,2.219],[7.125,4.226,4.209,4.188,4.171,4.190],[8.206,3.882,3.788,3.827,3.787,3.857],[5.582,2.991,2.946,2.903,2.879,2.879],[null,null,null,null,null,null],[9.031,3.776,3.752,3.735,3.712,3.659],[3.217,1.506,1.509,1.487,1.494,1.497],[3.085,1.194,1.179,1.174,1.167,1.172],[0.055,0.011,0.011,0.011,0.011,0.012],[0.059,0.011,0.012,0.011,0.010,0.011],[0.100,0.058,0.056,0.055,0.057,0.055],[0.097,0.054,0.050,0.048,0.047,0.048],[0.219,0.150,0.134,0.149,0.149,0.144],[0.290,0.234,0.238,0.226,0.228,0.233],[0.079,0.034,0.034,0.035,0.036,0.034],[0.055,0.013,0.011,0.012,0.011,0.011],[0.361,0.303,0.288,0.302,0.308,0.288],[0.427,0.364,0.386,0.371,0.380,0.379],[0.220,0.179,0.181,0.181,0.190,0.188],[0.261,0.200,0.199,0.201,0.211,0.207],[0.483,0.406,0.392,0.390,0.398,0.391],[0.584,0.513,0.509,0.517,0.506,0.518],[0.559,0.498,0.497,0.505,0.501,0.499],[0.524,0.473,0.473,0.476,0.463,0.470],[1.307,1.149,1.160,1.137,1.172,1.169],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.278,0.216,0.205,0.206,0.208,0.207],[1.490,0.751,0.749,0.749,0.744,0.735],[1.200,0.925,0.910,0.918,0.920,0.912],[1.688,1.645,1.723,1.616,1.638,1.620],[0.596,0.522,0.524,0.519,0.508,0.506],[0.789,0.651,0.661,0.660,0.663,0.655],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.074,0.009,0.009,0.008,0.009,0.009],[0.055,0.003,0.003,0.003,0.003,0.003],[0.830,0.065,0.066,0.065,0.065,0.065],[0.864,0.109,0.110,0.109,0.113,0.111],[0.264,0.077,0.080,0.078,0.076,0.079],[0.860,0.167,0.162,0.166,0.167,0.163],[0.500,0.047,0.044,0.046,0.046,0.044],[0.535,0.083,0.084,0.083,0.085,0.083],[0.618,0.133,0.134,0.137,0.133,0.137],[0.511,0.056,0.054,0.054,0.056,0.053],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.018,0.507,0.507,0.512,0.495,0.518],[0.721,0.055,0.055,0.056,0.055,0.056],[1.048,0.574,0.576,0.577,0.573,0.575],[6.666,4.611,4.599,4.609,4.586,4.599],[9.064,1.466,1.472,1.466,1.462,1.467],[4.549,2.724,2.657,2.689,2.687,2.688],[14.694,8.635,8.555,8.557,8.472,8.574],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.233,2.123,2.113,2.116,2.105,2.116],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54074","source":"results/1.1.54074.json"} +,{"actual_version":"1.1.54080","data_size":{"default":4096,"hits":14157970401,"job":2039063141,"mgbench":1179516870,"ontime":2323896016,"ssb":166251116698,"taxi":22993545261,"tpcds":19027761249,"tpch":19071092400,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":433,"job":58,"mgbench":23,"ontime":55,"ssb":1656,"taxi":816,"tpcds":258,"tpch":279,"uk":41},"machine":"c7a.4xlarge","release_date":"2016-11-25","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.150,0.013,0.013,0.013,0.014,0.012],[0.129,0.030,0.027,0.034,0.032,0.033],[null,null,null,null,null,null],[0.202,0.101,0.101,0.099,0.102,0.102],[null,null,null,null,null,null],[0.572,0.457,0.455,0.466,0.469,0.451],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.460,0.303,0.298,0.308,0.304,0.305],[null,null,null,null,null,null],[1.423,0.361,0.366,0.363,0.366,0.368],[7.530,2.889,2.878,2.889,2.840,2.829],[5.664,2.251,2.301,2.324,2.303,2.307],[5.732,2.302,2.291,2.258,2.264,2.257],[7.042,4.255,4.305,4.315,4.308,4.309],[7.950,3.923,3.970,3.936,3.983,3.966],[5.490,2.995,2.985,3.005,2.954,3.001],[null,null,null,null,null,null],[8.923,3.776,3.779,3.742,3.770,3.758],[2.817,1.512,1.509,1.513,1.504,1.530],[2.966,1.206,1.206,1.206,1.209,1.201],[0.061,0.012,0.011,0.012,0.011,0.011],[0.057,0.012,0.011,0.010,0.011,0.011],[0.113,0.064,0.066,0.065,0.064,0.066],[0.096,0.050,0.050,0.049,0.047,0.047],[0.204,0.151,0.148,0.150,0.150,0.147],[0.291,0.234,0.233,0.226,0.233,0.234],[0.079,0.041,0.040,0.041,0.040,0.042],[0.062,0.012,0.013,0.011,0.011,0.012],[0.370,0.290,0.303,0.298,0.301,0.298],[0.448,0.361,0.372,0.372,0.368,0.361],[0.225,0.190,0.189,0.186,0.187,0.182],[0.250,0.208,0.206,0.208,0.203,0.200],[0.467,0.410,0.408,0.408,0.405,0.404],[0.587,0.535,0.521,0.534,0.525,0.530],[0.567,0.504,0.503,0.504,0.502,0.492],[0.509,0.462,0.450,0.466,0.464,0.470],[1.302,1.167,1.165,1.162,1.157,1.163],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.279,0.208,0.211,0.215,0.212,0.206],[1.499,0.745,0.748,0.748,0.748,0.742],[1.197,0.925,0.920,0.914,0.923,0.924],[1.724,1.708,1.695,1.697,1.712,1.710],[0.612,0.518,0.517,0.521,0.523,0.517],[0.847,0.677,0.666,0.674,0.675,0.670],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.074,0.009,0.009,0.009,0.009,0.009],[0.055,0.003,0.003,0.003,0.003,0.003],[0.816,0.069,0.067,0.069,0.069,0.067],[0.911,0.118,0.118,0.115,0.116,0.114],[0.258,0.081,0.078,0.079,0.079,0.077],[0.902,0.168,0.163,0.167,0.163,0.165],[0.496,0.046,0.047,0.047,0.047,0.048],[0.541,0.085,0.085,0.086,0.090,0.089],[0.618,0.134,0.136,0.140,0.138,0.133],[0.490,0.079,0.058,0.059,0.057,0.057],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.038,0.501,0.511,0.515,0.515,0.500],[0.754,0.056,0.056,0.057,0.057,0.056],[1.074,0.581,0.575,0.581,0.577,0.571],[6.644,4.682,4.672,4.655,4.684,4.649],[9.037,1.454,1.471,1.475,1.461,1.462],[4.421,2.715,2.661,2.665,2.675,2.659],[14.737,8.707,8.646,8.629,8.633,8.625],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.370,2.261,2.249,2.263,2.242,2.248],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54080","source":"results/1.1.54080.json"} +,{"actual_version":"1.1.54083","data_size":{"default":4096,"hits":14189015000,"job":1816888719,"mgbench":1075159690,"ontime":2323896016,"ssb":152897822456,"taxi":22881830737,"tpcds":19028185227,"tpch":17168070196,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":212,"job":72,"mgbench":22,"ontime":62,"ssb":1753,"taxi":849,"tpcds":293,"tpch":327,"uk":43},"machine":"c7a.4xlarge","release_date":"2016-12-01","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.136,0.017,0.017,0.018,0.018,0.017],[0.103,0.032,0.037,0.032,0.034,0.032],[null,null,null,null,null,null],[0.211,0.118,0.121,0.116,0.115,0.116],[null,null,null,null,null,null],[0.638,0.510,0.512,0.484,0.501,0.492],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.392,0.400,0.401,0.389,0.397,0.397],[null,null,null,null,null,null],[1.539,0.489,0.491,0.498,0.497,0.493],[7.394,4.013,3.929,3.882,3.898,3.899],[5.734,3.009,3.000,2.975,2.952,2.958],[5.793,2.947,2.937,2.892,2.909,2.920],[6.938,5.780,5.896,5.855,5.847,5.889],[8.020,5.880,5.778,5.852,5.823,5.773],[5.443,4.097,4.097,4.176,4.138,4.124],[null,null,null,null,null,null],[8.782,4.910,4.892,4.956,4.924,4.861],[3.232,2.103,2.109,2.078,2.066,2.044],[3.019,1.842,1.828,1.826,1.788,1.775],[0.059,0.011,0.011,0.011,0.011,0.011],[0.060,0.011,0.012,0.013,0.011,0.011],[0.099,0.050,0.052,0.050,0.049,0.050],[0.126,0.083,0.085,0.086,0.085,0.086],[0.223,0.171,0.173,0.174,0.177,0.170],[0.306,0.245,0.243,0.246,0.248,0.246],[0.077,0.030,0.030,0.031,0.031,0.031],[0.064,0.013,0.013,0.012,0.013,0.012],[0.383,0.331,0.329,0.330,0.341,0.330],[0.457,0.405,0.396,0.392,0.399,0.391],[0.362,0.327,0.330,0.319,0.318,0.320],[0.385,0.339,0.345,0.325,0.328,0.337],[0.556,0.480,0.485,0.475,0.478,0.473],[0.716,0.660,0.659,0.655,0.647,0.654],[0.608,0.554,0.549,0.562,0.558,0.557],[0.578,0.535,0.539,0.536,0.540,0.540],[1.407,1.282,1.259,1.263,1.263,1.249],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.325,0.260,0.257,0.269,0.272,0.265],[1.490,0.785,0.761,0.786,0.797,0.791],[1.218,1.009,1.009,1.010,1.009,1.013],[1.694,1.659,1.658,1.654,1.663,1.670],[0.659,0.577,0.577,0.580,0.578,0.584],[0.913,0.815,0.822,0.816,0.811,0.812],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.083,0.010,0.010,0.010,0.010,0.010],[0.060,0.004,0.004,0.004,0.003,0.003],[0.747,0.092,0.093,0.091,0.091,0.089],[0.843,0.164,0.165,0.165,0.164,0.164],[0.243,0.098,0.098,0.086,0.086,0.086],[0.811,0.173,0.171,0.173,0.176,0.173],[0.464,0.059,0.061,0.061,0.061,0.059],[0.518,0.104,0.102,0.103,0.105,0.099],[0.579,0.148,0.146,0.145,0.148,0.150],[0.479,0.078,0.079,0.075,0.076,0.076],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.968,0.515,0.536,0.526,0.532,0.519],[0.695,0.068,0.065,0.066,0.067,0.066],[1.091,0.614,0.617,0.600,0.609,0.609],[6.586,5.045,5.048,5.027,5.045,5.044],[8.585,1.472,1.478,1.498,1.494,1.501],[4.073,2.687,2.735,2.655,2.730,2.710],[14.265,9.230,9.215,9.231,9.198,9.203],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.609,3.550,3.561,3.556,3.556,3.559],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54083","source":"results/1.1.54083.json"} +,{"actual_version":"1.1.54112","data_size":{"default":4096,"hits":14243198704,"job":1816888719,"mgbench":1170506399,"ontime":2323896016,"ssb":153790419828,"taxi":22875510488,"tpcds":19013237059,"tpch":17168739250,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":204,"job":59,"mgbench":22,"ontime":61,"ssb":1804,"taxi":859,"tpcds":307,"tpch":335,"uk":41},"machine":"c7a.4xlarge","release_date":"2016-12-13","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.159,0.018,0.017,0.018,0.018,0.018],[0.118,0.035,0.033,0.033,0.035,0.034],[null,null,null,null,null,null],[0.226,0.123,0.120,0.123,0.119,0.120],[null,null,null,null,null,null],[0.652,0.508,0.508,0.515,0.505,0.522],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.428,0.382,0.385,0.386,0.398,0.382],[null,null,null,null,null,null],[1.649,0.489,0.494,0.489,0.492,0.488],[7.599,4.162,4.031,4.027,3.981,4.008],[5.854,3.090,3.086,3.099,3.053,3.033],[5.948,3.072,2.992,2.980,2.986,3.081],[7.326,5.972,6.110,6.071,6.106,6.072],[8.133,6.109,6.051,6.142,6.069,6.071],[5.553,4.273,4.306,4.325,4.282,4.269],[null,null,null,null,null,null],[8.741,5.129,5.050,5.031,5.140,5.151],[3.476,2.151,2.206,2.181,2.149,2.136],[3.211,1.926,1.912,1.897,1.867,1.853],[0.102,0.014,0.013,0.014,0.014,0.013],[0.099,0.014,0.015,0.014,0.014,0.014],[0.136,0.052,0.053,0.053,0.061,0.053],[0.161,0.089,0.090,0.092,0.092,0.091],[0.262,0.177,0.176,0.171,0.173,0.176],[0.355,0.253,0.257,0.255,0.248,0.257],[0.114,0.031,0.032,0.033,0.034,0.031],[0.102,0.014,0.016,0.016,0.015,0.016],[0.418,0.340,0.352,0.335,0.344,0.341],[0.495,0.411,0.398,0.399,0.418,0.414],[0.415,0.341,0.324,0.335,0.334,0.333],[0.431,0.365,0.363,0.361,0.363,0.358],[0.611,0.509,0.517,0.513,0.510,0.508],[0.777,0.669,0.682,0.670,0.678,0.671],[0.683,0.588,0.590,0.595,0.597,0.604],[0.656,0.571,0.579,0.578,0.573,0.557],[1.468,1.329,1.295,1.277,1.291,1.301],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.395,0.291,0.293,0.299,0.292,0.291],[1.547,0.805,0.820,0.822,0.815,0.810],[1.257,1.028,1.040,1.046,1.058,1.051],[1.817,1.734,1.728,1.698,1.697,1.707],[0.702,0.591,0.586,0.591,0.602,0.597],[0.979,0.840,0.848,0.841,0.847,0.844],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.126,0.011,0.011,0.010,0.011,0.011],[0.099,0.005,0.005,0.006,0.005,0.006],[0.794,0.095,0.093,0.092,0.093,0.092],[0.948,0.174,0.172,0.172,0.171,0.172],[0.272,0.095,0.091,0.091,0.089,0.099],[0.861,0.179,0.176,0.177,0.177,0.177],[0.505,0.062,0.064,0.062,0.064,0.061],[0.584,0.106,0.104,0.107,0.111,0.106],[0.624,0.153,0.153,0.154,0.155,0.155],[0.503,0.082,0.098,0.078,0.078,0.080],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.043,0.543,0.547,0.542,0.543,0.548],[0.753,0.070,0.070,0.069,0.069,0.068],[1.100,0.613,0.609,0.610,0.595,0.621],[6.930,5.226,5.231,5.206,5.195,5.209],[8.770,1.505,1.531,1.534,1.505,1.497],[4.621,2.746,2.709,2.765,2.795,2.752],[14.404,9.370,9.242,9.256,9.264,9.289],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.837,3.744,3.755,3.752,3.757,3.758],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54112","source":"results/1.1.54112.json"} +,{"actual_version":"1.1.54127","data_size":{"default":4096,"hits":14228342995,"job":1816888719,"mgbench":3053340644,"ontime":2323896016,"ssb":151238253214,"taxi":22879837577,"tpcds":19039520682,"tpch":17169139070,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":209,"job":67,"mgbench":91,"ontime":63,"ssb":1801,"taxi":882,"tpcds":302,"tpch":327,"uk":43},"machine":"c7a.4xlarge","release_date":"2016-12-23","result":[[null,null,null,null,null,null],[0.106,0.012,0.012,0.011,0.012,0.012],[null,null,null,null,null,null],[0.124,0.017,0.016,0.016,0.015,0.015],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.150,0.018,0.017,0.018,0.017,0.018],[0.115,0.036,0.037,0.040,0.037,0.036],[null,null,null,null,null,null],[0.235,0.121,0.121,0.124,0.120,0.122],[null,null,null,null,null,null],[0.652,0.514,0.517,0.526,0.516,0.520],[null,null,null,null,null,null],[0.127,0.019,0.020,0.019,0.020,0.020],[null,null,null,null,null,null],[1.595,0.400,0.387,0.395,0.397,0.397],[null,null,null,null,null,null],[1.776,0.513,0.512,0.504,0.512,0.508],[7.724,4.442,4.434,4.309,4.290,4.342],[5.780,3.254,3.298,3.287,3.260,3.271],[5.996,3.279,3.219,3.207,3.254,3.265],[8.001,6.544,6.503,6.502,6.553,6.483],[8.303,6.502,6.536,6.466,6.541,6.469],[6.302,4.536,4.543,4.636,4.561,4.559],[null,null,null,null,null,null],[8.945,5.500,5.475,5.452,5.525,5.488],[3.724,2.332,2.332,2.329,2.286,2.288],[3.480,2.084,2.062,2.029,2.001,2.015],[0.083,0.013,0.012,0.013,0.012,0.012],[0.089,0.013,0.014,0.014,0.014,0.014],[0.137,0.058,0.061,0.057,0.058,0.057],[0.157,0.093,0.093,0.099,0.099,0.097],[0.257,0.178,0.175,0.179,0.179,0.177],[0.360,0.264,0.261,0.262,0.258,0.275],[0.104,0.035,0.035,0.037,0.035,0.035],[0.088,0.015,0.015,0.014,0.014,0.014],[0.430,0.344,0.352,0.358,0.359,0.339],[0.482,0.398,0.409,0.404,0.403,0.413],[0.406,0.353,0.353,0.348,0.361,0.357],[0.441,0.376,0.377,0.383,0.388,0.384],[0.624,0.511,0.514,0.497,0.512,0.512],[0.794,0.683,0.684,0.690,0.684,0.690],[0.687,0.596,0.601,0.600,0.633,0.598],[0.628,0.554,0.557,0.556,0.554,0.550],[1.437,1.296,1.272,1.289,1.294,1.299],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.408,0.300,0.303,0.307,0.303,0.304],[1.536,0.814,0.806,0.800,0.795,0.812],[1.266,1.043,1.052,1.046,1.049,1.045],[1.736,1.637,1.674,1.647,1.670,1.672],[0.707,0.603,0.587,0.596,0.596,0.595],[0.987,0.883,0.858,0.859,0.873,0.855],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.115,0.010,0.010,0.010,0.010,0.010],[0.089,0.005,0.005,0.005,0.005,0.005],[0.920,0.098,0.097,0.096,0.096,0.096],[1.038,0.183,0.181,0.182,0.180,0.181],[0.283,0.099,0.093,0.092,0.092,0.095],[0.957,0.175,0.173,0.174,0.174,0.175],[0.548,0.065,0.064,0.066,0.065,0.065],[0.608,0.109,0.109,0.109,0.109,0.107],[0.671,0.153,0.155,0.153,0.153,0.155],[0.558,0.083,0.083,0.084,0.083,0.084],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.115,0.578,0.574,0.572,0.571,0.562],[0.838,0.075,0.071,0.071,0.071,0.070],[1.170,0.638,0.632,0.639,0.637,0.637],[7.635,5.807,5.802,5.748,5.771,5.728],[8.968,1.501,1.518,1.507,1.506,1.510],[4.647,2.600,2.671,2.696,2.684,2.734],[14.647,9.605,9.552,9.561,9.536,9.560],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.992,3.945,3.928,3.924,3.930,3.928],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54127","source":"results/1.1.54127.json"} +,{"actual_version":"1.1.54133","data_size":{"default":4096,"hits":14211996090,"job":1816888719,"mgbench":3057427069,"ontime":2323896016,"ssb":151350763834,"taxi":22873470307,"tpcds":19026154918,"tpch":17168886677,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":238,"job":59,"mgbench":109,"ontime":70,"ssb":1899,"taxi":948,"tpcds":332,"tpch":363,"uk":56},"machine":"c7a.4xlarge","release_date":"2017-01-13","result":[[null,null,null,null,null,null],[0.077,0.013,0.012,0.011,0.012,0.012],[null,null,null,null,null,null],[0.099,0.016,0.015,0.015,0.015,0.015],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.121,0.018,0.018,0.018,0.018,0.018],[0.103,0.038,0.033,0.038,0.037,0.035],[null,null,null,null,null,null],[0.231,0.129,0.124,0.129,0.129,0.127],[null,null,null,null,null,null],[0.648,0.558,0.560,0.556,0.546,0.540],[null,null,null,null,null,null],[0.107,0.021,0.018,0.020,0.021,0.020],[null,null,null,null,null,null],[1.387,0.404,0.407,0.415,0.416,0.419],[null,null,null,null,null,null],[1.525,0.520,0.505,0.513,0.511,0.513],[7.401,4.691,4.589,4.592,4.599,4.569],[5.729,3.478,3.391,3.357,3.355,3.474],[5.616,3.369,3.390,3.460,3.419,3.378],[8.012,6.746,6.802,6.770,6.738,6.770],[8.028,6.688,6.643,6.765,6.645,6.729],[6.006,4.883,4.916,4.853,4.897,4.887],[null,null,null,null,null,null],[8.787,5.835,5.746,5.789,5.866,5.742],[3.551,2.485,2.469,2.426,2.446,2.439],[3.269,2.169,2.134,2.112,2.105,2.078],[0.066,0.014,0.013,0.014,0.013,0.014],[0.071,0.014,0.013,0.014,0.016,0.014],[0.123,0.066,0.064,0.064,0.063,0.063],[0.141,0.098,0.099,0.097,0.098,0.100],[0.233,0.188,0.190,0.185,0.191,0.187],[0.340,0.278,0.275,0.272,0.279,0.271],[0.088,0.037,0.037,0.038,0.037,0.038],[0.068,0.015,0.013,0.015,0.014,0.012],[0.430,0.381,0.369,0.375,0.367,0.365],[0.486,0.437,0.437,0.433,0.441,0.443],[0.398,0.358,0.373,0.370,0.364,0.345],[0.431,0.390,0.402,0.397,0.394,0.390],[0.610,0.543,0.533,0.528,0.527,0.531],[0.800,0.728,0.732,0.725,0.721,0.729],[0.691,0.628,0.631,0.629,0.623,0.627],[0.622,0.584,0.587,0.578,0.584,0.576],[1.472,1.354,1.361,1.364,1.366,1.357],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.388,0.319,0.319,0.327,0.313,0.314],[1.489,0.827,0.820,0.822,0.830,0.832],[1.238,1.126,1.122,1.134,1.130,1.140],[2.029,1.981,1.968,1.980,1.953,1.992],[0.700,0.613,0.622,0.613,0.627,0.620],[0.972,0.899,0.914,0.917,0.908,0.911],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.085,0.011,0.010,0.010,0.011,0.011],[0.062,0.004,0.004,0.004,0.004,0.004],[0.761,0.102,0.100,0.099,0.098,0.099],[0.857,0.184,0.184,0.185,0.183,0.183],[0.244,0.095,0.092,0.096,0.097,0.093],[0.817,0.188,0.189,0.188,0.187,0.189],[0.472,0.067,0.069,0.065,0.068,0.066],[0.534,0.114,0.111,0.114,0.113,0.111],[0.588,0.162,0.163,0.162,0.168,0.165],[0.485,0.103,0.087,0.088,0.085,0.085],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.051,0.594,0.587,0.593,0.598,0.599],[0.695,0.076,0.077,0.077,0.076,0.080],[1.140,0.680,0.686,0.685,0.695,0.685],[7.365,5.761,5.790,5.721,5.735,5.736],[8.618,1.648,1.656,1.675,1.654,1.687],[4.357,2.853,2.816,2.858,2.963,2.913],[13.936,10.548,10.518,10.483,10.505,10.504],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.156,4.092,4.084,4.070,4.087,4.104],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54133","source":"results/1.1.54133.json"} +,{"actual_version":"1.1.54134","data_size":{"default":4096,"hits":14179856901,"job":1816888719,"mgbench":3075488768,"ontime":2323896016,"ssb":152684277481,"taxi":22873848904,"tpcds":18995581133,"tpch":17167466598,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":219,"job":58,"mgbench":96,"ontime":63,"ssb":1811,"taxi":880,"tpcds":319,"tpch":338,"uk":48},"machine":"c7a.4xlarge","release_date":"2017-01-16","result":[[null,null,null,null,null,null],[0.105,0.012,0.012,0.012,0.012,0.012],[null,null,null,null,null,null],[0.128,0.015,0.016,0.015,0.015,0.015],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.142,0.018,0.018,0.018,0.019,0.018],[0.116,0.036,0.036,0.038,0.037,0.037],[null,null,null,null,null,null],[0.245,0.129,0.124,0.127,0.122,0.127],[null,null,null,null,null,null],[0.645,0.503,0.506,0.509,0.501,0.508],[null,null,null,null,null,null],[0.117,0.018,0.018,0.018,0.017,0.017],[null,null,null,null,null,null],[1.743,0.396,0.391,0.392,0.392,0.389],[null,null,null,null,null,null],[1.688,0.516,0.513,0.509,0.499,0.505],[7.729,4.699,4.525,4.499,4.550,4.456],[6.087,3.459,3.410,3.401,3.399,3.511],[5.881,3.352,3.433,3.393,3.318,3.361],[8.427,6.692,6.772,6.677,6.804,6.682],[8.512,6.615,6.664,6.621,6.668,6.649],[6.365,4.747,4.701,4.730,4.788,4.730],[null,null,null,null,null,null],[9.033,5.682,5.593,5.610,5.595,5.552],[3.707,2.358,2.326,2.337,2.336,2.351],[3.412,2.078,2.043,2.015,1.990,2.017],[0.059,0.013,0.012,0.011,0.011,0.012],[0.059,0.011,0.013,0.012,0.012,0.011],[0.106,0.056,0.056,0.055,0.055,0.055],[0.139,0.092,0.095,0.095,0.095,0.095],[0.232,0.178,0.181,0.178,0.181,0.182],[0.320,0.256,0.259,0.262,0.261,0.260],[0.076,0.034,0.034,0.032,0.033,0.036],[0.055,0.012,0.011,0.013,0.012,0.012],[0.405,0.348,0.345,0.353,0.343,0.347],[0.457,0.407,0.408,0.402,0.404,0.414],[0.385,0.356,0.371,0.368,0.366,0.360],[0.419,0.384,0.395,0.393,0.395,0.387],[0.583,0.516,0.512,0.515,0.515,0.504],[0.758,0.692,0.690,0.703,0.698,0.708],[0.650,0.594,0.595,0.594,0.602,0.592],[0.596,0.561,0.547,0.549,0.550,0.554],[1.402,1.278,1.300,1.301,1.306,1.301],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.388,0.308,0.307,0.306,0.296,0.293],[1.505,0.794,0.819,0.807,0.810,0.801],[1.216,1.047,1.056,1.040,1.033,1.035],[1.772,1.689,1.705,1.708,1.705,1.714],[0.674,0.591,0.594,0.597,0.596,0.595],[1.034,0.879,0.878,0.875,0.885,0.884],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.081,0.010,0.009,0.009,0.009,0.009],[0.055,0.003,0.003,0.003,0.003,0.003],[0.886,0.101,0.100,0.099,0.098,0.099],[1.021,0.185,0.185,0.186,0.183,0.184],[0.291,0.098,0.103,0.094,0.095,0.091],[0.976,0.177,0.176,0.177,0.181,0.177],[0.569,0.067,0.066,0.065,0.067,0.065],[0.613,0.111,0.109,0.111,0.110,0.112],[0.675,0.155,0.155,0.153,0.156,0.156],[0.563,0.087,0.086,0.085,0.086,0.085],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.139,0.556,0.552,0.555,0.558,0.557],[0.819,0.072,0.072,0.073,0.072,0.074],[1.189,0.641,0.631,0.641,0.642,0.644],[7.705,5.668,5.643,5.638,5.655,5.642],[8.929,1.522,1.516,1.508,1.493,1.508],[4.784,2.638,2.631,2.700,2.673,2.616],[14.607,9.771,9.738,9.722,9.722,9.729],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.182,4.101,4.106,4.068,4.084,4.080],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54134","source":"results/1.1.54134.json"} +,{"actual_version":"1.1.54134","data_size":{"default":4096,"hits":14229497135,"job":1816888719,"mgbench":3057272660,"ontime":2323896016,"ssb":154482525105,"taxi":22884879964,"tpcds":19013765144,"tpch":17169027801,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":208,"job":62,"mgbench":93,"ontime":62,"ssb":1792,"taxi":876,"tpcds":326,"tpch":344,"uk":45},"machine":"c7a.4xlarge","release_date":"2017-01-20","result":[[null,null,null,null,null,null],[0.094,0.011,0.011,0.012,0.011,0.011],[null,null,null,null,null,null],[0.112,0.016,0.017,0.016,0.016,0.017],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.123,0.018,0.018,0.018,0.018,0.018],[0.104,0.037,0.039,0.037,0.035,0.034],[null,null,null,null,null,null],[0.220,0.126,0.119,0.125,0.119,0.127],[null,null,null,null,null,null],[0.618,0.509,0.507,0.503,0.508,0.508],[null,null,null,null,null,null],[0.113,0.019,0.019,0.019,0.023,0.019],[null,null,null,null,null,null],[1.502,0.390,0.398,0.386,0.397,0.389],[null,null,null,null,null,null],[1.513,0.505,0.495,0.493,0.496,0.488],[7.524,4.365,4.256,4.222,4.247,4.216],[5.833,3.225,3.224,3.181,3.183,3.198],[5.739,3.217,3.174,3.145,3.199,3.230],[7.506,6.291,6.224,6.162,6.245,6.156],[8.174,6.143,6.154,6.197,6.093,6.212],[5.807,4.409,4.442,4.434,4.415,4.486],[null,null,null,null,null,null],[8.892,5.233,5.112,5.174,5.235,5.171],[3.497,2.223,2.233,2.237,2.197,2.162],[3.168,1.933,1.962,1.908,1.877,1.854],[0.076,0.013,0.013,0.012,0.014,0.012],[0.077,0.013,0.014,0.013,0.014,0.014],[0.119,0.052,0.053,0.054,0.058,0.053],[0.142,0.089,0.092,0.092,0.092,0.092],[0.247,0.176,0.172,0.174,0.172,0.173],[0.354,0.268,0.262,0.260,0.259,0.259],[0.101,0.032,0.032,0.037,0.031,0.031],[0.084,0.014,0.013,0.013,0.013,0.014],[0.404,0.340,0.348,0.344,0.342,0.348],[0.494,0.399,0.408,0.405,0.390,0.401],[0.387,0.338,0.349,0.346,0.341,0.342],[0.423,0.359,0.369,0.368,0.361,0.359],[0.611,0.517,0.511,0.517,0.515,0.521],[0.792,0.676,0.686,0.685,0.684,0.674],[0.671,0.579,0.580,0.579,0.587,0.585],[0.628,0.562,0.563,0.560,0.561,0.566],[1.421,1.266,1.252,1.260,1.254,1.255],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.390,0.300,0.302,0.294,0.302,0.292],[1.533,0.793,0.789,0.790,0.795,0.792],[1.243,1.029,1.029,1.034,1.052,1.050],[1.733,1.694,1.665,1.681,1.644,1.649],[0.700,0.591,0.588,0.588,0.589,0.598],[0.996,0.852,0.845,0.850,0.841,0.849],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.111,0.010,0.012,0.010,0.010,0.011],[0.086,0.005,0.005,0.005,0.005,0.005],[0.806,0.095,0.097,0.095,0.096,0.094],[0.901,0.175,0.176,0.173,0.176,0.173],[0.254,0.096,0.093,0.098,0.088,0.091],[0.802,0.174,0.175,0.173,0.170,0.170],[0.475,0.063,0.062,0.063,0.061,0.063],[0.537,0.109,0.110,0.110,0.106,0.107],[0.607,0.151,0.150,0.157,0.157,0.154],[0.494,0.080,0.082,0.082,0.082,0.080],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.038,0.558,0.560,0.558,0.558,0.563],[0.706,0.070,0.068,0.069,0.070,0.069],[1.098,0.643,0.635,0.654,0.616,0.636],[7.333,5.736,5.744,5.730,5.727,5.725],[8.567,1.497,1.490,1.477,1.499,1.504],[4.106,2.647,2.723,2.617,2.600,2.589],[14.404,9.472,9.413,9.389,9.416,9.447],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.906,3.837,3.804,3.809,3.795,3.808],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54135","source":"results/1.1.54135.json"} +,{"actual_version":"1.1.54140","data_size":{"default":4096,"hits":14192624367,"job":1816888719,"mgbench":3062559142,"ontime":2323896016,"ssb":158095723103,"taxi":22873047277,"tpcds":19023406015,"tpch":17168274654,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":262,"job":68,"mgbench":140,"ontime":72,"ssb":1664,"taxi":851,"tpcds":328,"tpch":339,"uk":43},"machine":"c7a.4xlarge","release_date":"2017-02-01","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.102,0.012,0.013,0.012,0.013,0.012],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.116,0.011,0.011,0.011,0.011,0.010],[0.100,0.026,0.034,0.031,0.031,0.028],[null,null,null,null,null,null],[0.202,0.106,0.102,0.108,0.101,0.102],[null,null,null,null,null,null],[0.560,0.431,0.396,0.395,0.407,0.415],[null,null,null,null,null,null],[0.104,0.012,0.014,0.013,0.013,0.013],[null,null,null,null,null,null],[1.656,0.225,0.222,0.236,0.224,0.222],[null,null,null,null,null,null],[1.672,0.230,0.225,0.229,0.227,0.230],[7.866,2.827,2.833,2.840,2.833,2.802],[6.121,2.237,2.231,2.228,2.230,2.223],[6.004,2.253,2.223,2.210,2.231,2.217],[7.494,4.176,4.140,4.184,4.177,4.107],[8.480,3.649,3.738,3.702,3.741,3.659],[5.744,3.016,2.932,2.927,2.888,2.890],[null,null,null,null,null,null],[9.328,3.825,3.784,3.781,3.769,3.795],[3.349,1.433,1.434,1.442,1.442,1.440],[3.392,1.126,1.127,1.115,1.150,1.112],[0.069,0.013,0.011,0.012,0.014,0.012],[0.067,0.012,0.011,0.013,0.011,0.011],[0.107,0.054,0.051,0.055,0.056,0.056],[0.091,0.040,0.040,0.041,0.038,0.038],[0.187,0.137,0.142,0.131,0.139,0.139],[0.300,0.234,0.239,0.237,0.233,0.232],[0.078,0.032,0.032,0.033,0.033,0.032],[0.070,0.012,0.012,0.011,0.012,0.012],[0.342,0.290,0.284,0.300,0.291,0.299],[0.424,0.358,0.347,0.353,0.374,0.360],[0.208,0.161,0.163,0.170,0.162,0.156],[0.236,0.182,0.183,0.191,0.186,0.188],[0.465,0.387,0.382,0.390,0.377,0.379],[0.557,0.491,0.487,0.487,0.496,0.490],[0.555,0.482,0.488,0.488,0.484,0.486],[0.496,0.432,0.433,0.446,0.434,0.425],[1.883,1.658,1.242,1.146,1.144,1.131],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.276,0.208,0.210,0.217,0.200,0.203],[1.491,0.723,0.712,0.732,0.728,0.735],[1.220,0.952,0.946,0.943,0.929,0.945],[1.675,1.696,1.639,1.703,1.628,1.638],[0.576,0.491,0.498,0.495,0.491,0.489],[0.738,0.634,0.638,0.645,0.632,0.641],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.074,0.010,0.010,0.009,0.010,0.010],[0.059,0.004,0.004,0.004,0.004,0.004],[0.722,0.053,0.052,0.052,0.053,0.053],[0.777,0.100,0.095,0.096,0.098,0.097],[0.242,0.075,0.076,0.073,0.075,0.084],[0.796,0.157,0.158,0.157,0.158,0.159],[0.449,0.039,0.039,0.039,0.040,0.040],[0.494,0.079,0.079,0.079,0.079,0.079],[0.557,0.131,0.132,0.134,0.135,0.133],[0.449,0.066,0.068,0.048,0.072,0.049],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.978,0.539,0.534,0.544,0.532,0.532],[0.679,0.055,0.052,0.051,0.055,0.056],[1.045,0.595,0.595,0.592,0.580,0.591],[6.115,4.589,4.576,4.545,4.487,4.534],[8.625,1.454,1.427,1.406,1.403,1.453],[4.383,2.608,2.568,2.606,2.548,2.608],[14.230,8.490,8.578,8.350,8.391,8.416],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.879,1.787,1.799,1.793,1.798,1.798],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54144","source":"results/1.1.54144.json"} +,{"actual_version":"1.1.54140","data_size":{"default":4096,"hits":14147247566,"job":1816888719,"mgbench":3057330058,"ontime":2323896016,"ssb":157386636978,"taxi":22874382873,"tpcds":19027869772,"tpch":17167591040,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":213,"job":61,"mgbench":117,"ontime":72,"ssb":1705,"taxi":872,"tpcds":331,"tpch":383,"uk":43},"machine":"c7a.4xlarge","release_date":"2017-02-07","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.111,0.012,0.013,0.014,0.013,0.012],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.120,0.011,0.010,0.011,0.011,0.011],[0.095,0.029,0.025,0.027,0.025,0.031],[null,null,null,null,null,null],[0.207,0.105,0.100,0.100,0.102,0.107],[null,null,null,null,null,null],[0.549,0.420,0.399,0.416,0.407,0.412],[null,null,null,null,null,null],[0.108,0.013,0.012,0.013,0.012,0.013],[null,null,null,null,null,null],[1.720,0.233,0.233,0.225,0.228,0.223],[null,null,null,null,null,null],[1.768,0.238,0.247,0.263,0.245,0.239],[7.966,2.833,2.844,2.881,2.847,2.826],[6.254,2.243,2.248,2.253,2.235,2.253],[6.036,2.216,2.256,2.228,2.253,2.259],[7.469,4.251,4.214,4.148,4.126,4.210],[8.382,3.810,3.809,3.705,3.722,3.689],[5.968,3.048,3.071,3.063,3.059,3.079],[null,null,null,null,null,null],[9.312,3.789,3.807,3.867,3.839,3.872],[3.437,1.503,1.480,1.488,1.522,1.500],[3.603,1.154,1.146,1.135,1.165,1.151],[0.063,0.013,0.012,0.013,0.012,0.011],[0.055,0.011,0.012,0.011,0.013,0.010],[0.097,0.053,0.050,0.051,0.054,0.052],[0.091,0.041,0.043,0.041,0.038,0.041],[0.188,0.139,0.145,0.147,0.140,0.144],[0.298,0.230,0.235,0.231,0.233,0.237],[0.072,0.031,0.030,0.030,0.030,0.030],[0.050,0.011,0.012,0.011,0.012,0.011],[0.349,0.294,0.299,0.300,0.284,0.287],[0.431,0.372,0.384,0.371,0.364,0.379],[0.215,0.165,0.164,0.166,0.168,0.164],[0.230,0.189,0.185,0.187,0.186,0.189],[0.444,0.386,0.380,0.381,0.387,0.388],[0.545,0.497,0.496,0.494,0.511,0.500],[0.541,0.479,0.481,0.484,0.483,0.491],[0.498,0.447,0.470,0.451,0.459,0.463],[1.459,1.213,1.171,1.166,1.167,1.155],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.285,0.222,0.217,0.204,0.212,0.217],[1.489,0.741,0.760,0.753,0.766,0.766],[1.196,0.948,0.940,0.936,0.960,0.946],[1.776,1.915,1.686,1.689,1.696,1.692],[0.567,0.494,0.493,0.498,0.492,0.489],[0.810,0.637,0.628,0.639,0.631,0.649],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.055,0.009,0.008,0.008,0.008,0.007],[0.043,0.003,0.003,0.003,0.003,0.003],[0.786,0.051,0.053,0.051,0.053,0.052],[0.810,0.098,0.097,0.097,0.096,0.096],[0.233,0.079,0.078,0.074,0.075,0.076],[0.774,0.161,0.161,0.168,0.171,0.160],[0.443,0.039,0.040,0.038,0.042,0.038],[0.518,0.076,0.080,0.078,0.080,0.080],[0.581,0.131,0.132,0.127,0.131,0.130],[0.453,0.073,0.064,0.068,0.061,0.050],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.995,0.525,0.520,0.522,0.526,0.518],[0.719,0.053,0.051,0.057,0.052,0.052],[1.051,0.580,0.596,0.602,0.595,0.584],[6.099,4.458,4.486,4.455,4.436,4.424],[8.662,1.410,1.423,1.399,1.411,1.421],[4.328,2.540,2.573,2.553,2.583,2.554],[14.342,8.410,8.495,8.448,8.439,8.351],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.949,1.792,1.773,1.782,1.786,1.779],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54159","source":"results/1.1.54159.json"} +,{"actual_version":"1.1.54180","data_size":{"default":4096,"hits":14145727804,"job":1816888719,"mgbench":3045933979,"ontime":2323896016,"ssb":159905912674,"taxi":22872365615,"tpcds":19007453640,"tpch":17168527204,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":211,"job":72,"mgbench":146,"ontime":71,"ssb":1586,"taxi":835,"tpcds":335,"tpch":371,"uk":43},"machine":"c7a.4xlarge","release_date":"2017-03-11","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.109,0.012,0.011,0.012,0.012,0.012],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.115,0.010,0.010,0.010,0.010,0.010],[0.096,0.027,0.024,0.028,0.027,0.025],[null,null,null,null,null,null],[0.191,0.102,0.102,0.105,0.108,0.099],[null,null,null,null,null,null],[0.544,0.419,0.397,0.419,0.390,0.375],[null,null,null,null,null,null],[0.108,0.013,0.013,0.012,0.013,0.012],[null,null,null,null,null,null],[1.589,0.229,0.216,0.219,0.233,0.222],[null,null,null,null,null,null],[1.729,0.228,0.234,0.234,0.231,0.242],[7.737,2.585,2.605,2.548,2.571,2.561],[6.091,2.071,2.067,2.068,2.054,2.077],[5.872,2.054,2.077,2.105,2.108,2.097],[7.397,3.912,3.786,3.874,3.832,3.866],[8.319,3.439,3.455,3.351,3.328,3.350],[5.691,2.845,2.856,2.790,2.829,2.769],[null,null,null,null,null,null],[9.341,3.510,3.438,3.458,3.448,3.496],[3.295,1.351,1.344,1.340,1.338,1.335],[3.398,1.065,1.057,1.055,1.066,1.046],[0.048,0.011,0.011,0.011,0.010,0.009],[0.041,0.009,0.010,0.009,0.009,0.010],[0.082,0.047,0.051,0.049,0.049,0.049],[0.080,0.042,0.037,0.037,0.039,0.037],[0.181,0.141,0.126,0.142,0.134,0.142],[0.272,0.218,0.217,0.215,0.224,0.221],[0.062,0.034,0.034,0.034,0.037,0.034],[0.041,0.011,0.013,0.011,0.012,0.010],[0.332,0.291,0.286,0.297,0.287,0.290],[0.388,0.345,0.366,0.366,0.351,0.357],[0.191,0.152,0.153,0.151,0.148,0.149],[0.214,0.173,0.170,0.167,0.167,0.171],[0.428,0.367,0.372,0.366,0.370,0.373],[0.541,0.476,0.495,0.481,0.494,0.478],[0.492,0.453,0.466,0.464,0.463,0.462],[0.453,0.422,0.427,0.431,0.429,0.433],[1.391,1.494,1.202,1.107,1.120,1.122],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.292,0.203,0.192,0.196,0.202,0.206],[1.472,0.701,0.711,0.724,0.716,0.719],[1.173,0.894,0.903,0.886,0.889,0.897],[1.769,1.624,1.681,1.619,1.643,1.616],[0.540,0.468,0.473,0.467,0.465,0.472],[0.838,0.621,0.604,0.610,0.603,0.611],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.058,0.009,0.008,0.008,0.008,0.008],[0.041,0.002,0.002,0.002,0.002,0.002],[0.737,0.051,0.051,0.055,0.053,0.050],[0.901,0.092,0.093,0.090,0.088,0.090],[0.232,0.076,0.070,0.073,0.072,0.071],[0.777,0.157,0.156,0.157,0.154,0.155],[0.439,0.037,0.037,0.036,0.038,0.037],[0.485,0.074,0.075,0.078,0.075,0.074],[0.557,0.131,0.128,0.129,0.128,0.130],[0.477,0.067,0.071,0.046,0.046,0.046],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.952,0.515,0.520,0.515,0.496,0.513],[0.704,0.052,0.057,0.052,0.052,0.051],[1.046,0.556,0.575,0.578,0.578,0.577],[5.710,4.139,4.100,4.082,4.036,4.070],[8.405,1.409,1.406,1.400,1.401,1.397],[4.331,2.590,2.626,2.529,2.587,2.570],[14.339,8.370,8.250,8.434,8.409,8.349],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.919,1.769,1.771,1.760,1.781,1.760],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54181","source":"results/1.1.54181.json"} +,{"actual_version":"1.1.54187","data_size":{"default":4096,"hits":14181433816,"job":1816888719,"mgbench":3048569792,"ontime":2323896016,"ssb":158376926708,"taxi":22869064198,"tpcds":19025241051,"tpch":17166722167,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":257,"job":76,"mgbench":130,"ontime":69,"ssb":1648,"taxi":1161,"tpcds":338,"tpch":334,"uk":65},"machine":"c7a.4xlarge","release_date":"2017-03-17","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.101,0.011,0.011,0.011,0.011,0.011],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.117,0.010,0.010,0.011,0.010,0.010],[0.102,0.033,0.024,0.027,0.026,0.029],[null,null,null,null,null,null],[0.199,0.102,0.104,0.104,0.101,0.110],[null,null,null,null,null,null],[0.555,0.424,0.420,0.429,0.402,0.416],[null,null,null,null,null,null],[0.109,0.012,0.012,0.012,0.013,0.012],[null,null,null,null,null,null],[1.709,0.227,0.222,0.222,0.222,0.216],[null,null,null,null,null,null],[1.715,0.260,0.255,0.271,0.252,0.230],[7.780,2.879,2.932,2.825,2.859,2.826],[6.204,2.320,2.233,2.293,2.368,2.360],[5.972,2.277,2.307,2.344,2.331,2.346],[7.446,4.098,4.170,4.394,4.180,4.198],[8.428,3.516,3.541,3.667,3.674,3.668],[5.839,3.020,3.154,3.117,2.976,2.979],[null,null,null,null,null,null],[9.359,3.860,3.863,3.784,3.806,4.134],[3.444,1.541,1.545,1.495,1.528,1.595],[3.313,1.176,1.127,1.144,1.093,1.100],[0.077,0.013,0.013,0.012,0.011,0.012],[0.076,0.011,0.011,0.013,0.011,0.011],[0.129,0.066,0.057,0.058,0.060,0.060],[0.098,0.043,0.042,0.040,0.056,0.044],[0.206,0.157,0.150,0.133,0.144,0.146],[0.308,0.231,0.227,0.233,0.236,0.234],[0.094,0.033,0.036,0.039,0.034,0.034],[0.077,0.013,0.011,0.011,0.012,0.011],[0.366,0.302,0.313,0.316,0.304,0.314],[0.450,0.363,0.378,0.384,0.381,0.375],[0.221,0.162,0.161,0.166,0.170,0.164],[0.250,0.186,0.182,0.186,0.188,0.181],[0.458,0.379,0.387,0.387,0.387,0.411],[0.583,0.510,0.501,0.497,0.512,0.511],[0.591,0.487,0.483,0.501,0.484,0.496],[0.511,0.457,0.442,0.445,0.445,0.440],[1.786,1.653,1.285,1.419,1.205,1.526],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.321,0.232,0.223,0.224,0.223,0.218],[1.496,0.826,0.760,0.771,0.762,0.770],[1.215,0.977,0.980,0.970,0.972,1.016],[2.091,1.817,1.841,1.859,1.857,1.871],[0.644,0.537,0.530,0.524,0.523,0.525],[0.773,0.671,0.661,0.666,0.675,0.656],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.083,0.010,0.010,0.010,0.009,0.011],[0.059,0.003,0.004,0.003,0.003,0.003],[0.723,0.058,0.062,0.061,0.059,0.059],[0.801,0.106,0.103,0.103,0.103,0.102],[0.251,0.079,0.086,0.077,0.077,0.081],[0.794,0.160,0.160,0.162,0.166,0.166],[0.440,0.043,0.043,0.044,0.043,0.041],[0.498,0.081,0.076,0.082,0.081,0.081],[0.550,0.136,0.139,0.136,0.146,0.140],[0.454,0.051,0.073,0.069,0.051,0.051],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.965,0.546,0.554,0.552,0.542,0.535],[0.671,0.058,0.057,0.058,0.057,0.056],[1.035,0.591,0.584,0.613,0.589,0.593],[5.960,4.430,4.445,4.451,4.385,4.351],[8.606,1.522,1.531,1.518,1.493,1.515],[4.479,2.800,2.772,2.701,2.762,2.828],[14.194,9.382,9.313,9.459,9.357,9.272],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.132,2.047,2.033,2.087,2.042,2.053],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54188","source":"results/1.1.54188.json"} +,{"actual_version":"1.1.54189","data_size":{"default":4096,"hits":14226450451,"job":1816888719,"mgbench":3050465131,"ontime":2323896016,"ssb":160067285668,"taxi":22868049157,"tpcds":19020306880,"tpch":17168156000,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":210,"job":80,"mgbench":141,"ontime":72,"ssb":1594,"taxi":1118,"tpcds":315,"tpch":347,"uk":54},"machine":"c7a.4xlarge","release_date":"2017-03-22","result":[[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.119,0.012,0.011,0.012,0.011,0.011],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.128,0.010,0.010,0.010,0.010,0.010],[0.104,0.025,0.024,0.025,0.027,0.029],[null,null,null,null,null,null],[0.214,0.096,0.099,0.099,0.100,0.096],[null,null,null,null,null,null],[0.534,0.408,0.431,0.408,0.410,0.384],[null,null,null,null,null,null],[0.121,0.021,0.013,0.013,0.013,0.013],[null,null,null,null,null,null],[1.841,0.208,0.209,0.212,0.210,0.205],[null,null,null,null,null,null],[1.750,0.223,0.245,0.222,0.224,0.228],[8.006,2.685,2.634,2.633,2.688,2.599],[6.319,2.149,2.161,2.185,2.149,2.176],[6.086,2.111,2.151,2.162,2.124,2.164],[7.600,3.862,3.933,3.910,4.031,3.878],[8.481,3.451,3.428,3.530,3.426,3.406],[5.820,2.876,2.850,2.872,2.881,2.930],[null,null,null,null,null,null],[9.285,3.556,3.651,3.502,3.641,3.620],[3.730,1.366,1.335,1.354,1.356,1.358],[3.513,1.076,1.069,1.058,1.066,1.053],[0.089,0.011,0.010,0.012,0.010,0.011],[0.089,0.012,0.010,0.010,0.010,0.010],[0.137,0.056,0.056,0.060,0.054,0.055],[0.107,0.046,0.038,0.041,0.037,0.037],[0.214,0.133,0.138,0.137,0.146,0.138],[0.323,0.220,0.201,0.220,0.230,0.208],[0.107,0.034,0.035,0.034,0.034,0.036],[0.089,0.012,0.012,0.011,0.012,0.012],[0.394,0.291,0.290,0.282,0.296,0.298],[0.460,0.369,0.348,0.352,0.354,0.370],[0.223,0.154,0.153,0.149,0.150,0.151],[0.256,0.180,0.175,0.179,0.177,0.176],[0.488,0.389,0.373,0.379,0.382,0.376],[0.587,0.487,0.491,0.498,0.487,0.494],[0.573,0.478,0.469,0.481,0.478,0.467],[0.492,0.419,0.420,0.426,0.431,0.434],[1.465,1.546,1.235,1.501,1.207,1.106],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.332,0.195,0.198,0.209,0.207,0.202],[1.550,0.715,0.715,0.710,0.725,0.708],[1.226,0.934,0.927,0.922,0.928,0.936],[1.795,1.694,1.663,1.813,1.663,1.683],[0.612,0.484,0.496,0.481,0.497,0.490],[0.817,0.626,0.632,0.630,0.628,0.637],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.134,0.009,0.008,0.008,0.008,0.009],[0.093,0.004,0.004,0.004,0.004,0.004],[0.795,0.050,0.050,0.049,0.050,0.049],[0.841,0.090,0.088,0.089,0.087,0.088],[0.264,0.070,0.072,0.071,0.071,0.067],[0.824,0.156,0.158,0.154,0.165,0.154],[0.479,0.037,0.039,0.038,0.042,0.040],[0.524,0.077,0.075,0.078,0.075,0.076],[0.584,0.129,0.128,0.127,0.129,0.130],[0.458,0.065,0.064,0.064,0.061,0.062],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.974,0.493,0.500,0.496,0.502,0.500],[0.719,0.052,0.052,0.051,0.052,0.051],[1.030,0.584,0.548,0.550,0.560,0.553],[5.762,4.041,4.114,4.087,4.061,4.058],[8.678,1.413,1.423,1.406,1.398,1.402],[4.254,2.593,2.617,2.720,2.634,2.595],[14.285,8.668,8.512,8.476,8.636,8.466],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.907,1.806,1.790,1.788,1.786,1.786],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54190","source":"results/1.1.54190.json"} +,{"actual_version":"1.1.54198","data_size":{"default":4096,"hits":14156396481,"job":1816888719,"mgbench":3065520171,"ontime":2323896016,"ssb":159068914409,"taxi":22866337040,"tpcds":19028335122,"tpch":17168644864,"uk":770881854},"kind":"versions-benchmark","load_time":{"hits":253,"job":64,"mgbench":104,"ontime":64,"ssb":1677,"taxi":1166,"tpcds":334,"tpch":337,"uk":53},"machine":"c7a.4xlarge","release_date":"2017-03-29","result":[[0.238,0.014,0.013,0.012,0.013,0.013],[0.108,0.007,0.007,0.008,0.007,0.007],[null,null,null,null,null,null],[0.110,0.011,0.012,0.013,0.013,0.011],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.130,0.010,0.010,0.010,0.010,0.010],[0.105,0.025,0.026,0.030,0.031,0.024],[null,null,null,null,null,null],[0.221,0.110,0.103,0.114,0.111,0.104],[null,null,null,null,null,null],[0.564,0.424,0.417,0.423,0.431,0.422],[0.232,0.028,0.028,0.029,0.029,0.028],[0.119,0.012,0.012,0.012,0.013,0.012],[null,null,null,null,null,null],[1.595,0.222,0.227,0.214,0.221,0.224],[null,null,null,null,null,null],[1.825,0.239,0.237,0.233,0.232,0.231],[7.902,2.835,2.805,2.835,2.854,2.860],[6.199,2.314,2.288,2.273,2.255,2.276],[6.207,2.330,2.321,2.267,2.327,2.291],[7.766,4.136,4.110,4.203,4.093,4.167],[8.471,3.697,3.685,3.576,3.567,3.681],[5.898,3.116,2.963,3.003,3.111,3.026],[null,null,null,null,null,null],[9.528,3.744,3.807,3.797,3.810,3.877],[3.528,1.460,1.449,1.470,1.476,1.456],[3.667,1.131,1.087,1.100,1.141,1.130],[0.054,0.012,0.013,0.012,0.011,0.011],[0.052,0.010,0.012,0.013,0.010,0.011],[0.104,0.064,0.063,0.066,0.063,0.063],[0.089,0.045,0.048,0.041,0.041,0.043],[0.199,0.148,0.148,0.126,0.148,0.138],[0.290,0.236,0.246,0.234,0.234,0.231],[0.072,0.036,0.036,0.036,0.036,0.036],[0.050,0.014,0.011,0.011,0.010,0.011],[0.352,0.316,0.315,0.314,0.309,0.327],[0.434,0.389,0.379,0.383,0.396,0.392],[0.206,0.164,0.168,0.170,0.172,0.162],[0.231,0.186,0.187,0.183,0.185,0.186],[0.459,0.386,0.391,0.389,0.389,0.385],[0.571,0.525,0.510,0.505,0.509,0.516],[0.540,0.498,0.493,0.495,0.491,0.493],[0.490,0.446,0.443,0.444,0.434,0.447],[1.817,1.299,1.504,1.275,1.149,1.167],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.317,0.217,0.220,0.207,0.215,0.215],[1.483,0.743,0.740,0.742,0.733,0.745],[1.173,0.959,0.946,0.961,0.953,0.950],[2.061,1.875,1.868,1.871,1.858,1.844],[0.575,0.517,0.525,0.515,0.517,0.500],[0.819,0.664,0.645,0.643,0.656,0.669],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.066,0.007,0.008,0.007,0.007,0.008],[0.046,0.003,0.003,0.003,0.003,0.003],[0.814,0.052,0.055,0.053,0.054,0.054],[0.872,0.094,0.096,0.095,0.094,0.094],[0.258,0.080,0.075,0.075,0.072,0.077],[0.844,0.164,0.164,0.166,0.164,0.166],[0.459,0.039,0.044,0.040,0.040,0.040],[0.525,0.084,0.083,0.080,0.081,0.082],[0.599,0.141,0.139,0.141,0.141,0.142],[0.496,0.067,0.045,0.065,0.066,0.066],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.056,0.548,0.538,0.555,0.545,0.537],[0.762,0.057,0.060,0.061,0.058,0.057],[1.078,0.570,0.581,0.597,0.588,0.598],[6.125,4.403,4.380,4.371,4.379,4.349],[8.477,1.616,1.710,1.737,1.601,1.598],[4.775,2.851,2.823,3.012,2.782,2.841],[14.318,9.581,9.668,9.461,9.461,9.706],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.090,1.972,1.981,1.965,1.981,1.952],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54198","source":"results/1.1.54198.json"} +,{"actual_version":"1.1.54236","data_size":{"default":4096,"hits":14421235501,"job":1829937291,"mgbench":2950446241,"ontime":2703516377,"ssb":160583556762,"taxi":24208399538,"tpcds":18787729772,"tpch":17377070618,"uk":786632464},"kind":"versions-benchmark","load_time":{"hits":248,"job":56,"mgbench":102,"ontime":64,"ssb":1608,"taxi":1117,"tpcds":334,"tpch":374,"uk":53},"machine":"c7a.4xlarge","release_date":"2017-05-25","result":[[0.225,0.014,0.013,0.014,0.014,0.013],[0.106,0.008,0.008,0.008,0.008,0.008],[null,null,null,null,null,null],[0.111,0.011,0.011,0.012,0.011,0.012],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.142,0.015,0.016,0.015,0.016,0.015],[0.119,0.031,0.028,0.031,0.028,0.031],[null,null,null,null,null,null],[0.221,0.111,0.107,0.109,0.106,0.107],[null,null,null,null,null,null],[0.548,0.440,0.406,0.427,0.404,0.429],[0.236,0.042,0.041,0.042,0.041,0.042],[0.128,0.014,0.015,0.021,0.014,0.014],[null,null,null,null,null,null],[1.746,0.235,0.232,0.240,0.244,0.250],[null,null,null,null,null,null],[1.666,0.286,0.281,0.278,0.274,0.273],[8.065,5.366,5.099,5.293,4.236,5.020],[5.948,2.576,2.688,2.669,2.665,2.614],[5.958,2.739,2.583,3.069,2.844,2.922],[11.590,9.294,8.120,7.784,8.438,8.192],[11.665,7.824,8.970,9.181,9.011,7.374],[6.460,3.779,3.560,4.098,3.385,3.681],[null,null,null,null,null,null],[10.732,6.357,6.454,6.622,7.019,6.668],[5.296,2.031,2.102,2.322,2.255,2.604],[3.461,1.923,1.957,1.903,1.820,2.059],[0.085,0.014,0.012,0.013,0.012,0.012],[0.078,0.012,0.011,0.010,0.011,0.012],[0.128,0.059,0.056,0.061,0.059,0.057],[0.098,0.040,0.039,0.038,0.050,0.041],[0.204,0.142,0.127,0.132,0.135,0.146],[0.310,0.235,0.234,0.226,0.233,0.234],[0.100,0.035,0.035,0.034,0.035,0.035],[0.077,0.012,0.012,0.012,0.012,0.011],[0.380,0.288,0.292,0.310,0.291,0.301],[0.464,0.362,0.368,0.370,0.372,0.355],[0.222,0.166,0.167,0.163,0.162,0.163],[0.259,0.185,0.176,0.186,0.188,0.182],[0.484,0.388,0.384,0.403,0.390,0.397],[0.624,0.521,0.523,0.504,0.538,0.508],[0.579,0.508,0.511,0.508,0.512,0.497],[0.528,0.442,0.443,0.452,0.442,0.441],[1.763,1.249,1.392,1.205,1.133,1.147],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.319,0.225,0.212,0.229,0.222,0.240],[1.491,0.734,0.753,0.729,0.735,0.733],[1.227,1.128,1.127,1.122,1.116,1.120],[1.697,1.616,1.622,1.634,1.637,1.671],[0.624,0.520,0.522,0.521,0.523,0.523],[0.847,0.685,0.683,0.706,0.698,0.708],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.097,0.009,0.009,0.009,0.009,0.009],[0.074,0.005,0.005,0.005,0.005,0.005],[0.772,0.067,0.068,0.067,0.065,0.067],[0.901,0.112,0.114,0.115,0.112,0.112],[0.260,0.078,0.088,0.081,0.083,0.083],[0.822,0.167,0.163,0.174,0.164,0.166],[0.456,0.046,0.046,0.046,0.045,0.045],[0.534,0.096,0.098,0.095,0.095,0.097],[0.606,0.148,0.151,0.151,0.151,0.151],[0.463,0.075,0.072,0.077,0.075,0.079],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.041,0.585,0.580,0.585,0.580,0.579],[0.729,0.058,0.059,0.058,0.059,0.058],[1.090,0.631,0.628,0.638,0.610,0.627],[5.720,4.135,4.141,4.136,4.126,4.121],[9.972,1.639,1.645,1.666,1.626,1.624],[4.596,2.871,2.660,2.696,2.730,2.730],[14.207,8.822,8.775,8.922,8.717,8.665],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.019,1.895,1.900,1.886,1.884,1.891],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54236","source":"results/1.1.54236.json"} +,{"actual_version":"1.1.54236","data_size":{"default":4096,"hits":14409243463,"job":1829937291,"mgbench":2944740107,"ontime":2703516377,"ssb":158818841399,"taxi":24208141737,"tpcds":18804470241,"tpch":17376671669,"uk":786632464},"kind":"versions-benchmark","load_time":{"hits":213,"job":77,"mgbench":107,"ontime":69,"ssb":1614,"taxi":1106,"tpcds":301,"tpch":363,"uk":48},"machine":"c7a.4xlarge","release_date":"2017-06-27","result":[[0.235,0.014,0.013,0.013,0.014,0.013],[0.098,0.008,0.008,0.008,0.008,0.008],[null,null,null,null,null,null],[0.109,0.011,0.012,0.011,0.011,0.011],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.138,0.015,0.015,0.015,0.015,0.015],[0.118,0.028,0.030,0.028,0.028,0.029],[null,null,null,null,null,null],[0.214,0.105,0.109,0.108,0.108,0.113],[null,null,null,null,null,null],[0.572,0.426,0.418,0.429,0.418,0.424],[0.240,0.040,0.040,0.041,0.041,0.042],[0.111,0.016,0.013,0.014,0.015,0.014],[null,null,null,null,null,null],[1.889,0.247,0.245,0.251,0.251,0.246],[null,null,null,null,null,null],[1.721,0.284,0.285,0.293,0.285,0.280],[8.209,5.399,4.474,5.095,5.426,5.172],[6.372,2.574,2.729,2.736,2.890,2.608],[6.354,2.648,2.982,2.559,2.946,2.557],[12.039,7.537,7.822,8.389,7.458,8.399],[11.722,8.103,8.923,7.651,8.618,7.378],[6.719,4.356,4.702,3.637,3.590,3.973],[null,null,null,null,null,null],[10.915,7.155,6.534,6.534,6.623,6.820],[5.269,3.307,3.448,3.512,3.523,3.495],[3.341,1.912,1.902,1.927,1.926,1.811],[0.066,0.011,0.011,0.012,0.012,0.011],[0.067,0.011,0.011,0.010,0.011,0.011],[0.111,0.057,0.057,0.055,0.056,0.054],[0.094,0.037,0.038,0.039,0.041,0.044],[0.202,0.135,0.141,0.146,0.139,0.142],[0.299,0.229,0.231,0.234,0.230,0.228],[0.086,0.035,0.033,0.034,0.034,0.034],[0.068,0.011,0.012,0.013,0.011,0.011],[0.379,0.300,0.293,0.310,0.290,0.298],[0.426,0.364,0.372,0.356,0.356,0.358],[0.222,0.169,0.161,0.163,0.161,0.160],[0.256,0.178,0.181,0.178,0.179,0.182],[0.481,0.390,0.393,0.394,0.413,0.388],[0.596,0.510,0.519,0.509,0.516,0.538],[0.582,0.506,0.501,0.507,0.491,0.507],[0.508,0.416,0.446,0.438,0.431,0.439],[1.705,1.244,1.156,1.570,1.274,1.181],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.305,0.230,0.212,0.217,0.219,0.212],[1.483,0.757,0.748,0.756,0.758,0.758],[1.277,1.166,1.166,1.157,1.160,1.171],[1.727,1.654,1.592,1.608,1.621,1.595],[0.624,0.528,0.517,0.516,0.521,0.526],[0.968,0.696,0.691,0.706,0.685,0.677],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.093,0.008,0.008,0.008,0.008,0.008],[0.063,0.004,0.004,0.004,0.004,0.004],[0.772,0.066,0.067,0.068,0.066,0.072],[0.868,0.111,0.114,0.113,0.113,0.114],[0.250,0.080,0.080,0.080,0.086,0.077],[0.830,0.166,0.166,0.166,0.169,0.165],[0.470,0.046,0.045,0.044,0.048,0.044],[0.549,0.097,0.100,0.095,0.097,0.100],[0.609,0.145,0.148,0.151,0.150,0.150],[0.494,0.057,0.058,0.076,0.075,0.074],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.058,0.564,0.586,0.579,0.581,0.579],[0.710,0.057,0.056,0.059,0.057,0.058],[1.097,0.613,0.605,0.606,0.621,0.627],[5.740,4.147,4.116,4.117,4.123,4.102],[9.670,1.656,1.640,1.662,1.634,1.650],[4.413,2.744,2.756,2.837,2.675,2.726],[14.166,8.830,8.621,8.740,8.738,8.819],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.965,1.865,1.859,1.858,1.849,1.846],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54242","source":"results/1.1.54242.json"} +,{"actual_version":"1.1.54245","data_size":{"default":4096,"hits":14451965812,"job":1829937291,"mgbench":2950369877,"ontime":2703516377,"ssb":160034760367,"taxi":24208429489,"tpcds":18802642752,"tpch":17376522072,"uk":786636560},"kind":"versions-benchmark","load_time":{"hits":218,"job":123,"mgbench":100,"ontime":80,"ssb":1615,"taxi":902,"tpcds":290,"tpch":335,"uk":45},"machine":"c7a.4xlarge","release_date":"2017-07-05","result":[[0.188,0.013,0.013,0.013,0.013,0.013],[0.088,0.007,0.007,0.007,0.007,0.007],[null,null,null,null,null,null],[0.100,0.013,0.011,0.013,0.013,0.015],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.130,0.015,0.015,0.014,0.015,0.015],[0.113,0.029,0.030,0.029,0.028,0.029],[null,null,null,null,null,null],[0.212,0.111,0.110,0.120,0.112,0.105],[null,null,null,null,null,null],[0.539,0.397,0.418,0.406,0.436,0.406],[0.217,0.042,0.041,0.043,0.044,0.042],[0.114,0.014,0.014,0.016,0.014,0.015],[null,null,null,null,null,null],[1.579,0.237,0.239,0.241,0.233,0.239],[null,null,null,null,null,null],[1.597,0.269,0.273,0.272,0.274,0.268],[7.649,4.277,3.932,4.985,3.804,4.411],[5.867,2.563,2.514,2.574,2.719,2.538],[5.872,2.603,2.697,2.655,2.607,2.685],[11.666,7.747,7.504,7.505,7.661,7.978],[11.157,9.154,7.387,7.703,7.605,8.937],[6.061,4.548,3.621,3.697,3.600,3.596],[null,null,null,null,null,null],[10.513,6.521,6.592,6.220,7.078,6.784],[4.498,2.169,2.471,2.425,2.606,2.670],[3.327,1.648,1.710,1.687,1.668,1.726],[0.079,0.013,0.013,0.012,0.012,0.013],[0.079,0.011,0.012,0.011,0.012,0.011],[0.124,0.055,0.053,0.054,0.055,0.054],[0.094,0.037,0.038,0.039,0.038,0.038],[0.194,0.133,0.145,0.143,0.142,0.142],[0.305,0.235,0.234,0.239,0.230,0.224],[0.093,0.033,0.035,0.035,0.033,0.034],[0.077,0.012,0.013,0.013,0.012,0.013],[0.365,0.281,0.292,0.298,0.290,0.289],[0.468,0.366,0.353,0.377,0.349,0.347],[0.222,0.157,0.163,0.157,0.159,0.163],[0.261,0.185,0.184,0.179,0.183,0.183],[0.499,0.411,0.392,0.397,0.399,0.398],[0.617,0.515,0.512,0.509,0.530,0.505],[0.580,0.501,0.500,0.501,0.504,0.492],[0.513,0.432,0.446,0.447,0.444,0.425],[1.801,1.295,1.129,1.121,1.126,1.133],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.302,0.230,0.214,0.220,0.219,0.221],[1.472,0.734,0.755,0.732,0.740,0.717],[1.283,1.116,1.137,1.109,1.137,1.126],[1.736,1.649,1.644,1.646,1.629,1.618],[0.637,0.512,0.533,0.525,0.520,0.523],[0.828,0.663,0.676,0.655,0.676,0.660],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.096,0.009,0.008,0.008,0.008,0.008],[0.079,0.005,0.005,0.005,0.005,0.005],[0.739,0.069,0.070,0.070,0.067,0.067],[0.809,0.114,0.117,0.116,0.113,0.115],[0.251,0.078,0.068,0.074,0.073,0.078],[0.782,0.166,0.167,0.164,0.166,0.167],[0.437,0.044,0.046,0.046,0.045,0.050],[0.506,0.097,0.095,0.101,0.095,0.096],[0.558,0.147,0.147,0.152,0.146,0.148],[0.438,0.058,0.072,0.056,0.057,0.054],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.024,0.578,0.570,0.576,0.587,0.558],[0.662,0.059,0.060,0.058,0.057,0.058],[1.072,0.603,0.605,0.604,0.596,0.606],[5.286,4.118,4.092,4.185,4.126,4.105],[9.828,1.643,1.662,1.673,1.658,1.644],[4.414,2.791,2.731,2.689,2.910,2.700],[14.090,8.665,8.776,8.681,8.765,8.884],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.941,1.886,1.898,1.871,1.855,1.856],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54245","source":"results/1.1.54245.json"} +,{"actual_version":"1.1.54276","data_size":{"default":4096,"hits":14394100004,"job":1829937291,"mgbench":2957182320,"ontime":2703516377,"ssb":159396753521,"taxi":24207933491,"tpcds":18801291742,"tpch":17376935323,"uk":786636560},"kind":"versions-benchmark","load_time":{"hits":206,"job":68,"mgbench":120,"ontime":69,"ssb":1623,"taxi":919,"tpcds":352,"tpch":350,"uk":44},"machine":"c7a.4xlarge","release_date":"2017-08-16","result":[[0.219,0.012,0.013,0.012,0.013,0.013],[0.102,0.007,0.007,0.007,0.007,0.008],[0.230,0.016,0.018,0.017,0.018,0.017],[0.116,0.012,0.010,0.010,0.012,0.010],[0.115,0.030,0.033,0.029,0.032,0.031],[0.212,0.028,0.024,0.025,0.026,0.027],[0.155,0.012,0.012,0.012,0.012,0.012],[0.126,0.028,0.028,0.028,0.026,0.027],[0.193,0.054,0.060,0.061,0.060,0.058],[0.248,0.112,0.107,0.102,0.106,0.107],[0.555,0.413,0.411,0.414,0.415,0.407],[0.571,0.428,0.395,0.392,0.416,0.384],[0.229,0.031,0.031,0.031,0.032,0.031],[0.126,0.012,0.012,0.013,0.012,0.011],[null,null,null,null,null,null],[1.832,0.240,0.231,0.232,0.236,0.234],[0.084,0.019,0.020,0.020,0.020,0.018],[1.788,0.284,0.269,0.273,0.265,0.272],[8.232,4.135,4.190,4.070,4.066,4.213],[6.104,2.647,2.480,2.462,2.576,2.469],[6.086,2.702,2.560,2.567,2.578,2.492],[11.547,7.849,7.627,8.083,7.538,7.625],[11.386,8.277,7.272,7.957,8.255,7.490],[6.524,3.561,3.543,3.579,3.531,4.465],[0.137,0.063,0.064,0.060,0.053,0.066],[10.599,6.645,6.743,7.598,6.407,6.477],[5.033,2.040,2.142,1.880,1.977,2.415],[3.369,1.645,1.642,1.664,1.635,1.737],[0.077,0.015,0.013,0.013,0.012,0.012],[0.076,0.011,0.011,0.013,0.011,0.012],[0.117,0.056,0.058,0.058,0.055,0.056],[0.101,0.040,0.040,0.042,0.039,0.043],[0.204,0.141,0.143,0.128,0.129,0.141],[0.304,0.227,0.213,0.232,0.237,0.234],[0.091,0.035,0.036,0.036,0.037,0.038],[0.076,0.012,0.013,0.012,0.012,0.014],[0.360,0.304,0.282,0.298,0.287,0.303],[0.448,0.371,0.376,0.369,0.345,0.363],[0.230,0.162,0.162,0.162,0.166,0.164],[0.252,0.181,0.183,0.186,0.188,0.181],[0.494,0.401,0.395,0.400,0.398,0.395],[0.598,0.513,0.526,0.508,0.505,0.514],[0.557,0.499,0.498,0.507,0.497,0.491],[0.511,0.434,0.441,0.442,0.420,0.440],[1.377,1.123,1.487,1.238,1.121,1.134],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.303,0.221,0.224,0.221,0.218,0.217],[1.471,0.735,0.736,0.729,0.719,0.724],[1.285,1.112,1.120,1.121,1.114,1.137],[1.678,1.622,1.648,1.720,1.610,1.611],[0.637,0.540,0.545,0.533,0.537,0.541],[0.891,0.695,0.726,0.685,0.739,0.731],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.080,0.008,0.008,0.008,0.008,0.008],[0.068,0.004,0.004,0.004,0.004,0.004],[0.782,0.063,0.068,0.060,0.065,0.064],[0.868,0.108,0.103,0.109,0.105,0.102],[0.247,0.067,0.069,0.069,0.070,0.073],[0.849,0.160,0.160,0.159,0.161,0.160],[0.493,0.041,0.042,0.041,0.041,0.043],[0.553,0.086,0.084,0.086,0.086,0.086],[0.607,0.141,0.147,0.140,0.143,0.138],[0.502,0.064,0.048,0.061,0.059,0.063],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.080,0.580,0.579,0.560,0.570,0.570],[0.753,0.057,0.058,0.056,0.057,0.056],[1.181,0.626,0.616,0.621,0.632,0.608],[5.612,4.316,4.335,4.336,4.346,4.306],[9.756,1.627,1.627,1.618,1.676,1.624],[4.477,2.838,2.666,2.751,2.917,2.684],[14.200,9.312,9.382,9.388,9.430,9.375],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.034,1.915,1.912,1.920,1.931,1.910],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54276","source":"results/1.1.54276.json"} +,{"actual_version":"1.1.54282","data_size":{"default":4096,"hits":14457069579,"job":1829937291,"mgbench":2957085128,"ontime":2703516377,"ssb":159871620575,"taxi":24208757920,"tpcds":18800953717,"tpch":17377945806,"uk":786636560},"kind":"versions-benchmark","load_time":{"hits":250,"job":55,"mgbench":102,"ontime":68,"ssb":1616,"taxi":911,"tpcds":316,"tpch":371,"uk":45},"machine":"c7a.4xlarge","release_date":"2017-08-23","result":[[0.196,0.014,0.014,0.012,0.013,0.013],[0.113,0.008,0.008,0.008,0.007,0.007],[0.269,0.016,0.016,0.016,0.016,0.017],[0.114,0.010,0.011,0.011,0.010,0.011],[0.142,0.031,0.029,0.031,0.031,0.030],[0.262,0.025,0.023,0.025,0.030,0.026],[0.155,0.012,0.012,0.012,0.012,0.012],[0.118,0.026,0.031,0.029,0.029,0.027],[0.178,0.054,0.055,0.055,0.057,0.055],[0.216,0.106,0.109,0.108,0.112,0.112],[0.553,0.412,0.416,0.426,0.422,0.421],[0.561,0.388,0.392,0.423,0.404,0.404],[0.222,0.030,0.030,0.030,0.031,0.030],[0.116,0.012,0.013,0.013,0.012,0.012],[null,null,null,null,null,null],[1.574,0.232,0.231,0.236,0.229,0.230],[0.093,0.019,0.019,0.019,0.019,0.019],[1.705,0.261,0.264,0.265,0.266,0.266],[8.061,4.133,4.558,4.085,4.367,4.606],[6.124,2.509,2.508,2.447,2.563,2.547],[5.877,2.549,2.557,2.625,2.548,2.656],[11.594,7.868,7.709,8.078,7.932,8.150],[11.247,7.374,7.513,7.977,7.539,7.743],[6.151,3.926,3.626,3.620,3.619,3.746],[0.117,0.050,0.065,0.066,0.053,0.061],[10.970,6.647,6.800,6.986,6.945,6.990],[4.937,2.178,2.172,2.078,2.072,2.304],[3.566,1.716,1.810,1.714,1.754,1.717],[0.104,0.015,0.014,0.014,0.015,0.013],[0.095,0.013,0.012,0.012,0.013,0.014],[0.144,0.055,0.054,0.054,0.055,0.055],[0.113,0.044,0.039,0.046,0.040,0.042],[0.218,0.134,0.141,0.134,0.124,0.133],[0.355,0.239,0.240,0.240,0.238,0.241],[0.107,0.032,0.038,0.032,0.032,0.034],[0.095,0.014,0.013,0.013,0.013,0.013],[0.388,0.302,0.289,0.294,0.285,0.285],[0.495,0.369,0.353,0.378,0.351,0.375],[0.256,0.167,0.163,0.159,0.160,0.165],[0.289,0.185,0.185,0.187,0.185,0.186],[0.517,0.409,0.420,0.399,0.390,0.388],[0.640,0.523,0.521,0.536,0.533,0.526],[0.627,0.502,0.505,0.501,0.510,0.520],[0.521,0.445,0.441,0.426,0.429,0.425],[1.379,1.565,1.249,1.133,1.148,1.129],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.342,0.220,0.229,0.218,0.224,0.221],[1.528,0.755,0.753,0.743,0.739,0.742],[1.332,1.104,1.108,1.106,1.104,1.072],[1.853,1.640,1.641,1.649,1.650,1.629],[0.692,0.541,0.545,0.543,0.552,0.540],[0.913,0.710,0.702,0.702,0.721,0.685],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.114,0.010,0.009,0.010,0.010,0.010],[0.091,0.006,0.006,0.006,0.006,0.006],[0.705,0.059,0.062,0.062,0.060,0.059],[0.835,0.101,0.103,0.107,0.101,0.104],[0.247,0.067,0.068,0.062,0.076,0.069],[0.792,0.159,0.161,0.160,0.156,0.162],[0.429,0.040,0.040,0.041,0.043,0.044],[0.498,0.084,0.090,0.086,0.085,0.090],[0.587,0.137,0.141,0.143,0.138,0.143],[0.450,0.060,0.050,0.064,0.066,0.063],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.032,0.569,0.569,0.569,0.580,0.585],[0.697,0.052,0.055,0.057,0.054,0.056],[1.109,0.619,0.609,0.637,0.608,0.612],[5.467,4.163,4.165,4.161,4.162,4.168],[9.871,1.618,1.619,1.606,1.602,1.600],[4.618,2.677,2.719,2.717,2.744,2.858],[14.181,9.346,9.319,9.238,9.299,9.539],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.019,1.914,1.920,1.907,1.899,1.897],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54282","source":"results/1.1.54282.json"} +,{"actual_version":"1.1.54284","data_size":{"default":4096,"hits":14401204138,"job":1829937291,"mgbench":2946527845,"ontime":2703516377,"ssb":159705558614,"taxi":24208979075,"tpcds":18790066323,"tpch":17378213523,"uk":786636560},"kind":"versions-benchmark","load_time":{"hits":250,"job":72,"mgbench":102,"ontime":77,"ssb":1619,"taxi":914,"tpcds":295,"tpch":331,"uk":52},"machine":"c7a.4xlarge","release_date":"2017-08-30","result":[[0.193,0.014,0.013,0.013,0.013,0.013],[0.097,0.008,0.007,0.008,0.007,0.008],[0.187,0.017,0.017,0.017,0.017,0.018],[0.108,0.010,0.011,0.010,0.010,0.011],[0.113,0.029,0.030,0.034,0.032,0.033],[0.198,0.025,0.026,0.029,0.024,0.027],[0.142,0.013,0.013,0.012,0.012,0.012],[0.116,0.027,0.028,0.028,0.027,0.029],[0.182,0.057,0.059,0.055,0.066,0.062],[0.226,0.107,0.116,0.109,0.112,0.107],[0.553,0.419,0.420,0.422,0.415,0.419],[0.550,0.393,0.414,0.436,0.412,0.404],[0.237,0.035,0.034,0.035,0.034,0.035],[0.120,0.014,0.013,0.012,0.012,0.011],[null,null,null,null,null,null],[1.758,0.248,0.245,0.241,0.242,0.240],[0.084,0.018,0.018,0.019,0.020,0.021],[1.858,0.283,0.268,0.277,0.275,0.274],[8.234,4.431,4.047,4.286,4.035,4.041],[6.060,2.765,2.461,2.476,2.509,2.498],[6.111,2.537,2.511,2.914,2.572,2.542],[11.572,8.210,7.781,7.829,8.067,7.809],[11.431,7.385,7.506,7.342,7.639,7.802],[6.467,3.591,3.498,3.608,4.144,3.688],[0.117,0.064,0.067,0.066,0.052,0.051],[10.909,6.640,7.075,6.677,6.463,7.427],[5.212,2.178,1.898,2.179,2.327,2.166],[3.653,1.717,1.693,1.735,1.827,1.677],[0.083,0.014,0.013,0.013,0.013,0.013],[0.086,0.012,0.013,0.013,0.012,0.012],[0.132,0.058,0.061,0.058,0.057,0.059],[0.109,0.044,0.046,0.041,0.043,0.047],[0.202,0.124,0.128,0.123,0.152,0.144],[0.322,0.236,0.229,0.240,0.243,0.239],[0.098,0.035,0.034,0.034,0.036,0.035],[0.084,0.014,0.014,0.013,0.013,0.013],[0.361,0.308,0.289,0.267,0.295,0.286],[0.455,0.362,0.350,0.372,0.363,0.381],[0.239,0.167,0.167,0.163,0.167,0.171],[0.268,0.189,0.186,0.186,0.188,0.185],[0.493,0.402,0.401,0.392,0.395,0.388],[0.609,0.528,0.511,0.523,0.521,0.515],[0.591,0.503,0.509,0.497,0.497,0.507],[0.520,0.440,0.428,0.450,0.427,0.436],[1.754,1.280,1.135,1.133,1.190,1.127],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.315,0.222,0.217,0.223,0.215,0.230],[1.479,0.756,0.764,0.765,0.751,0.759],[1.323,1.134,1.150,1.145,1.130,1.119],[1.682,1.640,1.642,1.636,1.637,1.634],[0.662,0.546,0.551,0.543,0.540,0.539],[0.914,0.695,0.697,0.696,0.705,0.718],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.088,0.010,0.009,0.008,0.008,0.008],[0.056,0.004,0.004,0.004,0.004,0.004],[0.773,0.065,0.064,0.064,0.063,0.061],[0.830,0.106,0.109,0.105,0.106,0.109],[0.260,0.068,0.073,0.062,0.069,0.069],[0.843,0.165,0.161,0.160,0.160,0.158],[0.540,0.041,0.041,0.044,0.043,0.042],[0.543,0.090,0.094,0.090,0.086,0.090],[0.606,0.140,0.149,0.141,0.144,0.141],[0.488,0.065,0.064,0.059,0.061,0.067],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.070,0.577,0.568,0.576,0.563,0.568],[0.722,0.060,0.060,0.056,0.055,0.060],[1.163,0.610,0.625,0.614,0.654,0.627],[5.902,4.354,4.321,4.338,4.334,4.340],[9.896,1.634,1.620,1.624,1.647,1.639],[4.315,2.767,2.731,2.746,2.759,2.698],[13.858,9.476,9.493,9.536,9.321,9.384],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.062,1.962,1.959,1.949,1.951,1.953],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54284","source":"results/1.1.54284.json"} +,{"actual_version":"1.1.54289","data_size":{"default":4096,"hits":14408701035,"job":1829927550,"mgbench":2974726188,"ontime":2703516377,"ssb":166052397988,"taxi":24207140816,"tpcds":18786840555,"tpch":17377143987,"uk":786636560},"kind":"versions-benchmark","load_time":{"hits":235,"job":74,"mgbench":96,"ontime":66,"ssb":1464,"taxi":1013,"tpcds":327,"tpch":326,"uk":45},"machine":"c7a.4xlarge","release_date":"2017-09-14","result":[[0.173,0.015,0.014,0.015,0.015,0.015],[0.094,0.008,0.008,0.008,0.009,0.008],[0.176,0.019,0.020,0.018,0.021,0.018],[0.099,0.011,0.011,0.010,0.012,0.012],[0.100,0.033,0.033,0.031,0.039,0.031],[0.177,0.029,0.030,0.027,0.027,0.027],[0.133,0.015,0.015,0.015,0.015,0.015],[0.108,0.033,0.031,0.030,0.031,0.031],[0.185,0.071,0.070,0.075,0.072,0.070],[0.217,0.113,0.117,0.119,0.119,0.114],[0.572,0.449,0.453,0.456,0.452,0.463],[0.597,0.447,0.441,0.449,0.432,0.443],[0.215,0.039,0.038,0.038,0.040,0.040],[0.109,0.013,0.013,0.013,0.013,0.014],[null,null,null,null,null,null],[1.648,0.297,0.296,0.294,0.294,0.296],[0.083,0.021,0.021,0.020,0.020,0.020],[1.777,0.355,0.354,0.356,0.362,0.350],[8.157,4.383,4.229,4.251,4.400,4.563],[5.991,2.675,2.682,2.738,2.648,2.772],[5.985,2.778,2.756,2.773,2.752,2.691],[11.890,8.097,7.869,7.845,7.827,8.150],[11.492,8.294,7.580,7.881,7.415,7.436],[6.336,3.827,3.853,3.808,4.001,3.854],[0.118,0.058,0.059,0.060,0.056,0.067],[10.860,6.862,6.864,6.841,6.736,6.826],[5.145,2.198,2.367,2.256,2.459,2.331],[3.441,1.832,1.797,1.766,1.820,1.870],[0.070,0.016,0.015,0.015,0.015,0.015],[0.070,0.014,0.014,0.013,0.013,0.012],[0.120,0.060,0.058,0.060,0.057,0.059],[0.107,0.059,0.057,0.059,0.059,0.057],[0.208,0.152,0.151,0.153,0.141,0.157],[0.323,0.257,0.253,0.252,0.259,0.260],[0.079,0.035,0.034,0.037,0.035,0.036],[0.069,0.014,0.014,0.013,0.013,0.013],[0.395,0.324,0.312,0.316,0.323,0.323],[0.470,0.380,0.383,0.365,0.367,0.379],[0.283,0.217,0.217,0.219,0.213,0.215],[0.301,0.240,0.235,0.238,0.231,0.242],[0.538,0.455,0.457,0.457,0.455,0.452],[0.680,0.583,0.599,0.564,0.565,0.567],[0.616,0.546,0.541,0.544,0.546,0.545],[0.552,0.483,0.508,0.488,0.493,0.498],[1.426,1.227,1.212,1.241,1.216,1.218],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.319,0.242,0.244,0.250,0.243,0.240],[1.457,0.896,0.910,0.904,0.907,0.913],[1.460,1.288,1.280,1.321,1.291,1.272],[1.911,1.863,1.815,1.804,1.791,1.800],[0.686,0.584,0.584,0.587,0.584,0.589],[0.913,0.760,0.762,0.758,0.766,0.748],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.084,0.009,0.009,0.009,0.009,0.009],[0.067,0.004,0.005,0.004,0.004,0.004],[0.756,0.077,0.078,0.076,0.076,0.076],[0.842,0.131,0.126,0.124,0.125,0.126],[0.256,0.099,0.074,0.073,0.081,0.075],[0.804,0.177,0.178,0.174,0.175,0.177],[0.459,0.052,0.054,0.053,0.052,0.055],[0.531,0.109,0.108,0.104,0.103,0.108],[0.584,0.160,0.161,0.157,0.161,0.171],[0.463,0.071,0.074,0.063,0.072,0.072],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.092,0.615,0.623,0.604,0.611,0.605],[0.695,0.063,0.068,0.064,0.065,0.069],[1.181,0.669,0.668,0.671,0.660,0.663],[6.338,4.839,4.808,4.808,4.803,4.805],[9.844,1.771,1.749,1.765,1.770,1.779],[4.519,2.848,2.866,3.020,2.924,2.858],[14.089,10.395,10.364,10.512,10.557,10.423],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.800,2.700,2.646,2.654,2.646,2.625],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54289","source":"results/1.1.54289.json"} +,{"actual_version":"1.1.54292","data_size":{"default":4096,"hits":14408011266,"job":1829937291,"mgbench":2955822549,"ontime":2703516377,"ssb":166787653870,"taxi":24208191086,"tpcds":18785312409,"tpch":17377770553,"uk":786636560},"kind":"versions-benchmark","load_time":{"hits":239,"job":79,"mgbench":108,"ontime":72,"ssb":1459,"taxi":955,"tpcds":323,"tpch":312,"uk":44},"machine":"c7a.4xlarge","release_date":"2017-09-27","result":[[0.220,0.016,0.015,0.014,0.015,0.014],[0.111,0.009,0.009,0.009,0.009,0.008],[0.197,0.019,0.020,0.019,0.018,0.021],[0.119,0.011,0.011,0.011,0.011,0.011],[0.121,0.036,0.032,0.032,0.032,0.031],[0.205,0.027,0.027,0.028,0.027,0.026],[0.159,0.015,0.015,0.015,0.015,0.015],[0.126,0.030,0.030,0.031,0.031,0.031],[0.210,0.064,0.071,0.071,0.074,0.071],[0.248,0.111,0.113,0.110,0.108,0.110],[0.577,0.424,0.424,0.425,0.432,0.431],[0.590,0.409,0.433,0.416,0.399,0.411],[0.255,0.042,0.041,0.042,0.043,0.043],[0.135,0.014,0.014,0.014,0.013,0.013],[null,null,null,null,null,null],[2.079,0.274,0.279,0.283,0.279,0.269],[0.091,0.020,0.022,0.022,0.021,0.020],[1.924,0.348,0.347,0.342,0.337,0.342],[8.343,4.663,4.304,4.115,4.774,4.597],[6.215,2.600,2.485,2.514,2.481,2.541],[6.213,2.658,2.658,2.630,2.523,2.574],[12.181,9.761,7.988,7.695,8.827,8.458],[11.282,7.408,7.346,7.485,7.348,7.824],[6.296,3.600,3.534,3.554,3.634,3.541],[0.123,0.056,0.055,0.055,0.060,0.053],[11.022,6.767,6.898,6.798,6.545,6.584],[5.446,2.626,2.113,2.151,2.126,2.208],[3.865,1.767,1.779,1.739,1.723,1.767],[0.086,0.015,0.012,0.015,0.013,0.013],[0.086,0.012,0.013,0.013,0.013,0.013],[0.128,0.057,0.056,0.057,0.058,0.057],[0.120,0.061,0.055,0.059,0.057,0.057],[0.220,0.135,0.145,0.142,0.133,0.143],[0.328,0.253,0.238,0.257,0.235,0.233],[0.102,0.032,0.034,0.033,0.033,0.033],[0.083,0.014,0.013,0.015,0.014,0.014],[0.393,0.314,0.311,0.307,0.299,0.304],[0.467,0.376,0.372,0.377,0.368,0.366],[0.284,0.208,0.208,0.208,0.210,0.212],[0.307,0.220,0.219,0.219,0.218,0.230],[0.528,0.422,0.420,0.416,0.433,0.430],[0.654,0.558,0.555,0.552,0.551,0.556],[0.617,0.533,0.535,0.525,0.521,0.521],[0.545,0.452,0.466,0.468,0.459,0.463],[1.699,1.215,1.448,1.231,1.586,1.591],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.306,0.211,0.233,0.222,0.231,0.235],[1.488,0.711,0.706,0.724,0.715,0.724],[1.312,1.126,1.143,1.157,1.160,1.167],[1.746,1.656,1.631,1.615,1.596,1.596],[0.648,0.531,0.540,0.540,0.537,0.560],[0.887,0.752,0.725,0.713,0.718,0.722],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.086,0.009,0.009,0.009,0.008,0.009],[0.067,0.004,0.004,0.004,0.004,0.004],[0.931,0.074,0.075,0.074,0.072,0.075],[1.003,0.123,0.122,0.126,0.122,0.123],[0.289,0.071,0.071,0.077,0.072,0.077],[0.985,0.167,0.166,0.167,0.167,0.169],[0.558,0.050,0.051,0.050,0.050,0.050],[0.632,0.100,0.101,0.099,0.107,0.104],[0.694,0.157,0.152,0.146,0.149,0.153],[0.558,0.075,0.071,0.068,0.074,0.070],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.172,0.560,0.583,0.563,0.565,0.580],[0.848,0.063,0.066,0.064,0.061,0.066],[1.248,0.627,0.613,0.631,0.621,0.615],[6.372,4.536,4.530,4.545,4.540,4.544],[10.206,1.621,1.661,1.639,1.627,1.645],[4.548,2.733,2.715,2.716,2.723,2.680],[14.216,8.654,8.654,8.643,8.613,8.598],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.060,2.967,2.959,2.933,2.944,2.943],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54292","source":"results/1.1.54292.json"} +,{"actual_version":"1.1.54304","data_size":{"default":4096,"hits":14399609515,"job":1829937312,"mgbench":2957085131,"ontime":2703516378,"ssb":165182734536,"taxi":24207103528,"tpcds":18779265382,"tpch":17377980648,"uk":786636561},"kind":"versions-benchmark","load_time":{"hits":243,"job":30,"mgbench":88,"ontime":67,"ssb":1514,"taxi":966,"tpcds":307,"tpch":316,"uk":50},"machine":"c7a.4xlarge","release_date":"2017-10-24","result":[[0.172,0.015,0.014,0.014,0.015,0.013],[0.078,0.008,0.008,0.008,0.008,0.008],[0.194,0.018,0.017,0.018,0.021,0.018],[0.087,0.011,0.011,0.013,0.012,0.011],[0.087,0.035,0.032,0.039,0.029,0.031],[0.194,0.026,0.027,0.026,0.026,0.026],[0.128,0.015,0.015,0.014,0.014,0.014],[0.105,0.029,0.030,0.030,0.030,0.031],[0.168,0.071,0.068,0.067,0.067,0.072],[0.207,0.114,0.111,0.110,0.111,0.114],[0.529,0.418,0.421,0.424,0.430,0.426],[0.578,0.428,0.448,0.428,0.446,0.434],[0.222,0.039,0.038,0.040,0.039,0.041],[0.094,0.013,0.014,0.014,0.013,0.016],[null,null,null,null,null,null],[1.876,0.279,0.280,0.276,0.275,0.278],[0.059,0.019,0.019,0.020,0.021,0.020],[1.972,0.341,0.343,0.342,0.343,0.350],[7.997,4.093,4.199,4.283,4.181,4.164],[6.053,2.521,2.524,2.588,2.642,2.541],[6.040,2.602,2.523,2.689,2.581,2.643],[11.325,7.747,7.903,7.340,7.567,8.869],[11.189,7.406,7.370,7.211,7.225,7.452],[6.014,3.594,3.618,3.824,3.632,3.546],[0.106,0.057,0.058,0.056,0.054,0.052],[11.041,6.617,6.629,6.480,6.802,6.356],[5.151,2.349,2.212,2.043,2.103,2.000],[3.620,1.750,1.740,1.820,1.764,1.720],[0.058,0.014,0.013,0.013,0.013,0.012],[0.058,0.012,0.011,0.014,0.013,0.012],[0.107,0.060,0.060,0.059,0.058,0.058],[0.094,0.054,0.054,0.056,0.054,0.059],[0.191,0.138,0.135,0.147,0.140,0.142],[0.301,0.246,0.242,0.243,0.241,0.236],[0.075,0.032,0.032,0.032,0.034,0.032],[0.053,0.013,0.012,0.012,0.012,0.013],[0.358,0.301,0.293,0.296,0.310,0.299],[0.447,0.368,0.380,0.367,0.383,0.371],[0.264,0.216,0.213,0.211,0.213,0.217],[0.285,0.226,0.225,0.223,0.222,0.219],[0.501,0.424,0.426,0.427,0.420,0.423],[0.633,0.546,0.544,0.546,0.545,0.549],[0.599,0.536,0.540,0.540,0.541,0.536],[0.523,0.450,0.474,0.473,0.479,0.486],[1.377,1.163,1.161,1.153,1.153,1.142],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.305,0.224,0.230,0.232,0.231,0.227],[1.460,0.865,0.881,0.878,0.865,0.873],[1.362,1.217,1.209,1.220,1.204,1.209],[1.696,1.631,1.662,1.642,1.646,1.706],[0.664,0.574,0.569,0.587,0.576,0.571],[0.889,0.755,0.748,0.754,0.734,0.745],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.069,0.009,0.009,0.009,0.008,0.008],[0.038,0.003,0.003,0.003,0.003,0.003],[0.836,0.076,0.076,0.073,0.074,0.074],[0.861,0.122,0.123,0.122,0.120,0.122],[0.239,0.080,0.071,0.070,0.082,0.074],[0.847,0.170,0.167,0.170,0.166,0.170],[0.447,0.051,0.051,0.051,0.051,0.052],[0.547,0.103,0.103,0.105,0.100,0.102],[0.603,0.151,0.152,0.155,0.155,0.156],[0.473,0.069,0.071,0.069,0.073,0.068],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.088,0.572,0.566,0.581,0.586,0.577],[0.739,0.061,0.063,0.061,0.064,0.063],[1.192,0.629,0.639,0.621,0.617,0.624],[6.288,4.553,4.522,4.545,4.518,4.512],[9.871,1.679,1.641,1.657,1.657,1.654],[4.480,2.783,2.901,2.706,2.700,2.670],[14.125,8.662,8.584,8.517,8.514,8.508],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.609,2.513,2.527,2.518,2.506,2.493],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54304","source":"results/1.1.54304.json"} +,{"actual_version":"1.1.54335","data_size":{"default":4096,"hits":14422511694,"job":1829942310,"mgbench":2954450513,"ontime":2703567993,"ssb":159271504972,"taxi":24206706118,"tpcds":18794468315,"tpch":17377038291,"uk":786706493},"kind":"versions-benchmark","load_time":{"hits":245,"job":30,"mgbench":87,"ontime":64,"ssb":1640,"taxi":969,"tpcds":287,"tpch":318,"uk":48},"machine":"c7a.4xlarge","release_date":"2018-01-16","result":[[0.144,0.014,0.015,0.014,0.015,0.014],[0.066,0.008,0.008,0.008,0.008,0.009],[0.153,0.017,0.018,0.018,0.018,0.019],[0.078,0.011,0.012,0.010,0.013,0.011],[0.082,0.029,0.032,0.031,0.031,0.029],[0.149,0.031,0.030,0.028,0.029,0.027],[0.118,0.016,0.016,0.016,0.015,0.016],[0.095,0.030,0.030,0.032,0.031,0.029],[0.172,0.070,0.075,0.075,0.077,0.071],[0.206,0.112,0.113,0.112,0.111,0.112],[0.530,0.434,0.433,0.440,0.425,0.426],[0.551,0.433,0.430,0.421,0.401,0.435],[0.213,0.041,0.041,0.040,0.041,0.041],[0.092,0.014,0.013,0.013,0.014,0.013],[null,null,null,null,null,null],[1.615,0.290,0.278,0.283,0.283,0.280],[0.051,0.020,0.018,0.019,0.021,0.019],[1.490,0.342,0.353,0.349,0.344,0.345],[7.647,4.027,3.911,4.134,3.792,3.853],[5.544,2.886,2.522,2.595,2.490,2.506],[5.822,2.558,2.530,2.708,2.568,2.537],[11.090,7.000,7.314,7.193,6.979,7.093],[11.042,7.111,6.755,6.861,7.218,7.152],[5.956,3.449,3.681,3.591,3.517,3.599],[0.099,0.052,0.065,0.063,0.055,0.068],[10.380,6.368,6.061,5.983,6.103,6.094],[4.600,2.169,2.557,2.299,2.313,2.260],[3.250,1.642,1.775,1.629,1.663,1.602],[0.072,0.013,0.014,0.014,0.013,0.013],[0.074,0.013,0.013,0.012,0.013,0.013],[0.113,0.056,0.056,0.056,0.057,0.057],[0.102,0.055,0.058,0.058,0.058,0.056],[0.201,0.149,0.157,0.129,0.155,0.150],[0.309,0.246,0.247,0.245,0.246,0.248],[0.087,0.039,0.043,0.034,0.034,0.034],[0.071,0.015,0.014,0.013,0.015,0.015],[0.383,0.314,0.308,0.329,0.322,0.312],[0.464,0.381,0.376,0.388,0.380,0.388],[0.279,0.216,0.212,0.214,0.218,0.220],[0.302,0.229,0.226,0.227,0.234,0.234],[0.503,0.415,0.417,0.418,0.420,0.420],[0.645,0.546,0.563,0.555,0.561,0.554],[0.610,0.536,0.535,0.528,0.536,0.531],[0.536,0.489,0.474,0.478,0.482,0.480],[1.364,1.164,1.144,1.150,1.178,1.147],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.310,0.221,0.218,0.225,0.219,0.225],[1.466,0.888,0.879,0.893,0.893,0.883],[1.247,1.134,1.134,1.150,1.134,1.123],[1.669,1.603,1.648,1.610,1.642,1.623],[0.646,0.556,0.547,0.557,0.557,0.559],[0.876,0.725,0.713,0.717,0.719,0.722],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.082,0.011,0.010,0.010,0.010,0.010],[0.063,0.006,0.005,0.005,0.005,0.005],[0.761,0.077,0.077,0.075,0.076,0.076],[0.793,0.130,0.130,0.129,0.130,0.129],[0.221,0.076,0.074,0.077,0.074,0.077],[0.810,0.208,0.209,0.210,0.214,0.211],[0.406,0.052,0.051,0.052,0.054,0.052],[0.520,0.103,0.100,0.098,0.098,0.100],[0.554,0.153,0.156,0.156,0.159,0.160],[0.433,0.073,0.073,0.075,0.072,0.075],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.017,0.576,0.570,0.567,0.571,0.576],[0.677,0.063,0.069,0.063,0.061,0.065],[1.140,0.603,0.613,0.612,0.613,0.602],[5.895,4.486,4.548,4.527,4.499,4.460],[9.665,1.676,1.692,1.672,1.684,1.705],[5.113,3.458,3.453,3.502,3.465,3.482],[13.940,8.784,8.735,8.709,8.753,8.707],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.683,2.578,2.558,2.554,2.550,2.525],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54335","source":"results/1.1.54335.json"} +,{"actual_version":"1.1.54336","data_size":{"default":4096,"hits":14438053767,"job":1829942310,"mgbench":2960712540,"ontime":2703567993,"ssb":158443266129,"taxi":24207584438,"tpcds":18795622850,"tpch":17376781147,"uk":786706493},"kind":"versions-benchmark","load_time":{"hits":237,"job":31,"mgbench":87,"ontime":65,"ssb":1630,"taxi":978,"tpcds":276,"tpch":317,"uk":46},"machine":"c7a.4xlarge","release_date":"2018-01-16","result":[[0.194,0.014,0.014,0.014,0.015,0.014],[0.079,0.008,0.009,0.009,0.009,0.008],[0.207,0.019,0.019,0.019,0.019,0.019],[0.091,0.012,0.011,0.012,0.011,0.010],[0.101,0.031,0.029,0.031,0.029,0.028],[0.185,0.028,0.028,0.030,0.028,0.028],[0.135,0.016,0.016,0.017,0.016,0.015],[0.112,0.030,0.032,0.030,0.031,0.030],[0.169,0.066,0.067,0.068,0.065,0.065],[0.213,0.106,0.105,0.103,0.105,0.107],[0.541,0.426,0.428,0.426,0.428,0.423],[0.588,0.431,0.427,0.432,0.417,0.429],[0.227,0.041,0.040,0.039,0.040,0.040],[0.110,0.015,0.014,0.013,0.014,0.013],[null,null,null,null,null,null],[1.683,0.274,0.270,0.271,0.277,0.281],[0.061,0.020,0.021,0.020,0.019,0.019],[1.819,0.344,0.340,0.342,0.343,0.336],[7.972,4.206,3.729,3.869,3.835,4.126],[5.987,2.530,2.449,2.418,2.423,2.403],[5.986,2.511,2.960,2.533,2.503,2.522],[11.815,7.248,7.099,7.124,7.388,7.134],[11.203,6.976,7.050,6.906,7.004,6.866],[6.421,3.555,3.623,3.639,3.681,3.615],[0.108,0.055,0.055,0.058,0.053,0.055],[10.991,6.241,6.223,6.183,6.662,6.346],[5.167,2.434,2.275,2.506,2.311,2.176],[3.573,1.731,1.745,1.607,1.686,1.729],[0.072,0.014,0.013,0.013,0.013,0.013],[0.071,0.014,0.013,0.013,0.013,0.013],[0.110,0.055,0.053,0.054,0.053,0.057],[0.096,0.055,0.056,0.055,0.056,0.054],[0.204,0.140,0.156,0.155,0.147,0.145],[0.319,0.258,0.246,0.252,0.245,0.252],[0.080,0.031,0.033,0.031,0.032,0.031],[0.067,0.014,0.015,0.013,0.015,0.014],[0.382,0.325,0.319,0.313,0.312,0.305],[0.470,0.369,0.387,0.366,0.390,0.367],[0.267,0.206,0.208,0.215,0.217,0.207],[0.287,0.227,0.228,0.227,0.226,0.226],[0.508,0.429,0.429,0.429,0.435,0.422],[0.660,0.565,0.552,0.552,0.549,0.548],[0.583,0.526,0.514,0.519,0.518,0.522],[0.526,0.475,0.475,0.472,0.473,0.477],[1.353,1.162,1.182,1.167,1.165,1.200],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.314,0.226,0.225,0.226,0.225,0.219],[1.476,0.877,0.883,0.891,0.881,0.870],[1.290,1.134,1.139,1.141,1.141,1.138],[1.746,1.691,1.687,1.678,1.698,1.684],[0.659,0.535,0.525,0.539,0.536,0.542],[0.874,0.721,0.698,0.698,0.707,0.738],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.085,0.010,0.011,0.010,0.010,0.010],[0.060,0.005,0.005,0.005,0.005,0.005],[0.811,0.080,0.078,0.077,0.078,0.075],[0.890,0.126,0.126,0.126,0.131,0.127],[0.249,0.077,0.077,0.082,0.077,0.080],[0.967,0.211,0.207,0.208,0.207,0.213],[0.481,0.048,0.048,0.051,0.052,0.051],[0.559,0.098,0.101,0.097,0.098,0.096],[0.598,0.160,0.157,0.156,0.154,0.150],[0.480,0.077,0.074,0.070,0.071,0.070],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.119,0.560,0.544,0.554,0.575,0.560],[0.774,0.063,0.062,0.066,0.065,0.064],[1.172,0.600,0.605,0.593,0.610,0.607],[5.784,4.453,4.465,4.453,4.450,4.455],[9.776,1.681,1.758,1.728,1.713,1.717],[5.096,3.512,3.497,3.515,3.502,3.502],[13.880,8.752,8.704,8.687,8.691,8.760],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.505,2.408,2.410,2.390,2.394,2.393],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54336","source":"results/1.1.54336.json"} +,{"actual_version":"1.1.54337","data_size":{"default":4096,"hits":14370099877,"job":1829942310,"mgbench":2956946209,"ontime":2703567993,"ssb":161907141637,"taxi":24208537779,"tpcds":18810070449,"tpch":17378439074,"uk":786706493},"kind":"versions-benchmark","load_time":{"hits":238,"job":36,"mgbench":88,"ontime":63,"ssb":1545,"taxi":972,"tpcds":292,"tpch":307,"uk":47},"machine":"c7a.4xlarge","release_date":"2018-01-18","result":[[0.184,0.016,0.014,0.014,0.017,0.014],[0.075,0.008,0.009,0.008,0.008,0.009],[0.210,0.018,0.018,0.018,0.018,0.017],[0.084,0.012,0.011,0.010,0.010,0.010],[0.085,0.027,0.033,0.030,0.031,0.033],[0.186,0.031,0.029,0.029,0.028,0.030],[0.133,0.015,0.016,0.015,0.014,0.015],[0.097,0.031,0.032,0.030,0.031,0.031],[0.168,0.068,0.070,0.068,0.071,0.072],[0.208,0.119,0.111,0.109,0.116,0.110],[0.540,0.429,0.429,0.424,0.426,0.432],[0.554,0.404,0.422,0.427,0.433,0.406],[0.233,0.039,0.037,0.039,0.037,0.037],[0.103,0.014,0.014,0.014,0.013,0.013],[null,null,null,null,null,null],[1.743,0.279,0.271,0.270,0.273,0.281],[0.065,0.020,0.018,0.020,0.020,0.019],[2.003,0.334,0.330,0.337,0.340,0.334],[8.035,3.841,3.856,5.227,4.173,4.238],[6.086,2.503,2.479,2.492,2.544,2.512],[6.117,2.739,2.513,2.522,2.518,2.552],[11.544,7.256,7.441,6.949,7.204,7.193],[11.712,6.889,6.848,7.090,6.711,6.732],[6.357,3.436,3.432,3.591,3.540,3.585],[0.095,0.055,0.053,0.055,0.054,0.061],[10.724,6.074,6.639,6.052,5.931,6.059],[5.007,2.482,2.177,2.700,2.723,2.257],[3.631,1.697,1.625,1.621,1.784,1.645],[0.029,0.011,0.012,0.011,0.012,0.012],[0.030,0.011,0.010,0.011,0.011,0.010],[0.077,0.058,0.059,0.060,0.059,0.060],[0.076,0.056,0.054,0.055,0.056,0.054],[0.171,0.144,0.149,0.142,0.137,0.146],[0.269,0.247,0.242,0.245,0.250,0.245],[0.045,0.031,0.032,0.031,0.032,0.032],[0.028,0.012,0.013,0.010,0.012,0.011],[0.330,0.291,0.296,0.310,0.316,0.294],[0.412,0.377,0.371,0.358,0.365,0.382],[0.234,0.208,0.207,0.209,0.216,0.211],[0.250,0.220,0.218,0.217,0.224,0.225],[0.462,0.417,0.420,0.418,0.428,0.418],[0.574,0.522,0.515,0.514,0.514,0.515],[0.543,0.515,0.520,0.531,0.530,0.523],[0.495,0.469,0.472,0.462,0.463,0.464],[1.308,1.144,1.131,1.138,1.122,1.138],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.263,0.218,0.208,0.221,0.221,0.216],[1.430,0.856,0.867,0.864,0.861,0.868],[1.165,1.089,1.096,1.000,1.085,1.087],[1.698,1.688,1.694,1.688,1.679,1.687],[0.594,0.539,0.529,0.532,0.530,0.537],[0.797,0.685,0.679,0.688,0.676,0.671],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.045,0.009,0.008,0.008,0.008,0.008],[0.022,0.003,0.003,0.003,0.003,0.003],[0.780,0.075,0.074,0.073,0.073,0.073],[0.832,0.125,0.123,0.123,0.126,0.121],[0.241,0.080,0.075,0.077,0.071,0.076],[0.912,0.211,0.217,0.214,0.208,0.211],[0.442,0.051,0.048,0.048,0.048,0.051],[0.533,0.096,0.099,0.094,0.096,0.096],[0.595,0.146,0.146,0.160,0.146,0.147],[0.467,0.077,0.073,0.072,0.072,0.070],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.065,0.560,0.562,0.559,0.559,0.542],[0.744,0.064,0.061,0.062,0.064,0.064],[1.127,0.594,0.590,0.594,0.594,0.589],[5.949,4.420,4.409,4.415,4.408,4.393],[9.783,1.662,1.656,1.705,1.645,1.641],[5.204,3.447,3.434,3.460,3.452,3.422],[14.040,8.654,8.735,8.724,8.602,8.613],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.491,2.437,2.411,2.422,2.411,2.413],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54337","source":"results/1.1.54337.json"} +,{"actual_version":"1.1.54342","data_size":{"default":4096,"hits":14445984523,"job":1829942310,"mgbench":2950731649,"ontime":2703567993,"ssb":162817448883,"taxi":24210418694,"tpcds":18820220101,"tpch":17376918058,"uk":786706493},"kind":"versions-benchmark","load_time":{"hits":241,"job":33,"mgbench":86,"ontime":63,"ssb":1540,"taxi":964,"tpcds":308,"tpch":320,"uk":46},"machine":"c7a.4xlarge","release_date":"2018-01-22","result":[[0.169,0.016,0.014,0.014,0.014,0.014],[0.078,0.008,0.008,0.008,0.008,0.008],[0.203,0.020,0.018,0.017,0.018,0.017],[0.089,0.014,0.011,0.011,0.010,0.010],[0.094,0.034,0.029,0.029,0.030,0.034],[0.175,0.031,0.028,0.029,0.026,0.027],[0.131,0.015,0.017,0.015,0.015,0.014],[0.099,0.029,0.030,0.029,0.030,0.031],[0.169,0.071,0.070,0.068,0.067,0.069],[0.198,0.107,0.104,0.106,0.110,0.104],[0.534,0.424,0.428,0.421,0.429,0.430],[0.545,0.413,0.415,0.426,0.416,0.424],[0.225,0.038,0.037,0.038,0.037,0.038],[0.096,0.013,0.013,0.013,0.014,0.014],[null,null,null,null,null,null],[1.911,0.276,0.274,0.276,0.280,0.275],[0.056,0.020,0.020,0.021,0.018,0.019],[2.070,0.344,0.345,0.338,0.340,0.341],[8.013,4.422,4.015,3.933,3.780,3.820],[6.130,2.464,2.629,2.515,2.528,2.456],[6.235,2.544,2.651,2.532,2.530,2.522],[11.567,7.184,6.971,7.489,7.257,6.994],[11.212,6.915,6.741,7.106,6.710,6.685],[6.427,3.470,3.537,4.016,3.604,3.580],[0.107,0.061,0.056,0.057,0.061,0.070],[10.852,6.103,5.924,5.955,6.161,6.205],[5.037,2.314,2.396,2.186,2.429,2.089],[3.787,1.726,1.636,1.605,1.573,1.599],[0.075,0.014,0.013,0.013,0.013,0.013],[0.079,0.013,0.012,0.012,0.012,0.013],[0.125,0.062,0.062,0.061,0.060,0.062],[0.096,0.054,0.054,0.051,0.054,0.052],[0.202,0.149,0.144,0.142,0.138,0.153],[0.330,0.248,0.254,0.236,0.247,0.246],[0.089,0.038,0.038,0.038,0.044,0.038],[0.066,0.014,0.014,0.013,0.014,0.013],[0.381,0.302,0.305,0.298,0.294,0.302],[0.470,0.374,0.362,0.358,0.366,0.358],[0.269,0.211,0.214,0.211,0.211,0.212],[0.293,0.224,0.220,0.221,0.222,0.224],[0.491,0.411,0.418,0.423,0.428,0.405],[0.627,0.543,0.532,0.529,0.540,0.536],[0.598,0.513,0.514,0.517,0.511,0.523],[0.507,0.453,0.451,0.453,0.458,0.465],[1.326,1.161,1.130,1.131,1.129,1.117],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.320,0.226,0.228,0.228,0.231,0.223],[1.494,0.856,0.861,0.871,0.860,0.865],[1.247,1.108,1.112,1.114,1.127,1.108],[1.776,1.709,1.692,1.668,1.685,1.664],[0.660,0.543,0.542,0.546,0.546,0.546],[0.854,0.685,0.699,0.700,0.707,0.712],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.096,0.010,0.009,0.010,0.009,0.009],[0.069,0.005,0.005,0.005,0.005,0.005],[0.832,0.073,0.072,0.072,0.071,0.072],[0.888,0.119,0.120,0.120,0.121,0.117],[0.238,0.086,0.079,0.070,0.073,0.073],[0.915,0.217,0.209,0.209,0.212,0.212],[0.439,0.050,0.049,0.048,0.050,0.050],[0.540,0.092,0.099,0.097,0.102,0.097],[0.599,0.151,0.149,0.152,0.148,0.141],[0.484,0.072,0.074,0.070,0.072,0.068],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.068,0.558,0.557,0.573,0.582,0.569],[0.755,0.060,0.059,0.064,0.065,0.067],[1.165,0.583,0.585,0.585,0.583,0.591],[6.138,4.386,4.362,4.375,4.357,4.375],[9.790,1.677,1.699,1.703,1.640,1.645],[5.118,3.385,3.504,3.404,3.395,3.397],[14.021,8.748,8.642,8.674,8.653,8.650],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.461,2.409,2.382,2.359,2.372,2.356],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54342","source":"results/1.1.54342.json"} +,{"actual_version":"1.1.54342","data_size":{"default":4096,"hits":14448609753,"job":1829942310,"mgbench":2940080768,"ontime":2703567993,"ssb":165586592449,"taxi":24209441300,"tpcds":18779395730,"tpch":17377030207,"uk":786706493},"kind":"versions-benchmark","load_time":{"hits":238,"job":32,"mgbench":85,"ontime":65,"ssb":1525,"taxi":961,"tpcds":295,"tpch":312,"uk":47},"machine":"c7a.4xlarge","release_date":"2018-02-08","result":[[0.175,0.014,0.015,0.015,0.014,0.015],[0.072,0.008,0.008,0.008,0.008,0.008],[0.192,0.017,0.018,0.019,0.019,0.020],[0.091,0.012,0.011,0.012,0.010,0.013],[0.088,0.030,0.033,0.031,0.031,0.031],[0.177,0.028,0.026,0.026,0.029,0.028],[0.123,0.016,0.015,0.015,0.015,0.015],[0.096,0.030,0.031,0.030,0.029,0.032],[0.167,0.071,0.072,0.071,0.069,0.068],[0.199,0.108,0.103,0.105,0.106,0.106],[0.528,0.426,0.420,0.421,0.423,0.427],[0.555,0.407,0.411,0.406,0.430,0.417],[0.239,0.040,0.039,0.037,0.037,0.038],[0.100,0.013,0.012,0.013,0.012,0.012],[null,null,null,null,null,null],[1.838,0.270,0.269,0.271,0.270,0.272],[0.062,0.019,0.018,0.020,0.018,0.020],[1.864,0.337,0.338,0.340,0.335,0.342],[7.797,3.772,3.747,3.852,3.793,3.895],[5.997,2.524,2.486,2.478,2.467,2.455],[6.002,2.466,2.503,2.518,2.546,2.501],[11.348,6.904,7.012,6.984,7.138,6.857],[11.204,6.823,6.882,6.670,6.604,6.657],[6.284,3.564,3.579,3.485,3.525,3.509],[0.096,0.064,0.057,0.059,0.059,0.055],[10.499,5.868,5.999,6.127,5.936,6.107],[4.835,2.182,2.062,2.286,2.077,2.320],[3.602,1.616,1.622,1.621,1.684,1.634],[0.071,0.014,0.014,0.014,0.014,0.014],[0.067,0.013,0.012,0.013,0.012,0.013],[0.115,0.063,0.061,0.061,0.061,0.067],[0.094,0.054,0.056,0.053,0.055,0.055],[0.193,0.142,0.148,0.138,0.145,0.146],[0.310,0.238,0.238,0.248,0.250,0.233],[0.085,0.039,0.039,0.039,0.039,0.039],[0.060,0.014,0.014,0.013,0.012,0.013],[0.373,0.301,0.316,0.319,0.302,0.305],[0.461,0.374,0.381,0.386,0.368,0.385],[0.265,0.213,0.211,0.210,0.207,0.206],[0.284,0.223,0.220,0.223,0.222,0.214],[0.494,0.407,0.417,0.416,0.421,0.422],[0.631,0.546,0.538,0.548,0.542,0.544],[0.592,0.522,0.528,0.521,0.529,0.526],[0.499,0.468,0.470,0.457,0.454,0.457],[1.302,1.121,1.118,1.109,1.103,1.114],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.320,0.244,0.226,0.237,0.229,0.225],[1.509,0.874,0.862,0.864,0.871,0.874],[1.270,1.123,1.128,1.105,1.101,1.102],[1.776,1.694,1.719,1.723,1.710,1.702],[0.649,0.545,0.541,0.539,0.546,0.556],[0.851,0.704,0.718,0.694,0.701,0.687],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.077,0.009,0.009,0.009,0.009,0.009],[0.056,0.005,0.005,0.005,0.005,0.005],[0.824,0.071,0.075,0.074,0.074,0.072],[0.856,0.123,0.120,0.121,0.122,0.121],[0.230,0.090,0.076,0.072,0.083,0.077],[0.911,0.211,0.210,0.214,0.218,0.222],[0.470,0.050,0.048,0.052,0.050,0.048],[0.538,0.100,0.096,0.094,0.101,0.098],[0.576,0.156,0.150,0.148,0.159,0.148],[0.446,0.070,0.076,0.075,0.069,0.067],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.059,0.581,0.571,0.574,0.571,0.560],[0.704,0.064,0.064,0.068,0.066,0.066],[1.131,0.583,0.582,0.590,0.580,0.585],[5.915,4.448,4.377,4.383,4.395,4.361],[9.795,1.655,1.658,1.656,1.670,1.659],[5.108,3.405,3.428,3.390,3.413,3.394],[13.913,8.743,8.720,8.605,8.697,8.686],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.559,2.463,2.435,2.427,2.425,2.425],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54343","source":"results/1.1.54343.json"} +,{"actual_version":"1.1.54358","data_size":{"default":4096,"hits":14443283160,"job":1829942310,"mgbench":2955177948,"ontime":2703567993,"ssb":158440441199,"taxi":24215857360,"tpcds":18803288518,"tpch":17445581714,"uk":786706493},"kind":"versions-benchmark","load_time":{"hits":243,"job":35,"mgbench":87,"ontime":65,"ssb":1659,"taxi":966,"tpcds":287,"tpch":313,"uk":49},"machine":"c7a.4xlarge","release_date":"2018-03-07","result":[[0.187,0.022,0.022,0.023,0.022,0.022],[0.088,0.008,0.009,0.008,0.009,0.008],[0.232,0.021,0.020,0.020,0.021,0.021],[0.113,0.012,0.012,0.013,0.012,0.011],[0.099,0.029,0.034,0.033,0.033,0.031],[0.235,0.034,0.031,0.034,0.036,0.033],[0.147,0.016,0.016,0.020,0.017,0.017],[0.120,0.032,0.031,0.032,0.033,0.031],[0.188,0.072,0.071,0.075,0.072,0.076],[0.206,0.110,0.112,0.111,0.108,0.112],[0.536,0.431,0.440,0.433,0.429,0.429],[0.543,0.420,0.405,0.421,0.429,0.424],[0.256,0.044,0.045,0.045,0.045,0.044],[0.112,0.015,0.015,0.014,0.015,0.015],[null,null,null,null,null,null],[1.724,0.283,0.284,0.286,0.282,0.283],[0.059,0.022,0.021,0.021,0.020,0.020],[1.878,0.342,0.340,0.345,0.343,0.342],[7.975,4.038,4.398,3.723,3.745,3.918],[5.965,2.542,2.549,2.501,2.497,2.565],[5.990,2.570,2.565,2.550,2.684,2.568],[11.982,7.294,7.207,7.182,7.401,7.175],[11.331,7.304,6.962,7.076,7.202,7.321],[6.310,3.634,3.591,3.583,3.675,3.496],[0.113,0.062,0.060,0.063,0.062,0.064],[11.007,6.293,6.210,6.086,7.007,6.459],[4.666,2.220,2.246,2.228,2.107,2.276],[3.612,1.775,1.686,1.743,1.858,1.622],[0.074,0.015,0.015,0.014,0.014,0.017],[0.076,0.013,0.013,0.013,0.013,0.013],[0.116,0.056,0.055,0.052,0.053,0.055],[0.120,0.053,0.054,0.056,0.055,0.054],[0.208,0.146,0.149,0.152,0.139,0.148],[0.331,0.244,0.241,0.257,0.254,0.258],[0.091,0.036,0.040,0.038,0.036,0.037],[0.077,0.014,0.015,0.014,0.014,0.015],[0.386,0.322,0.318,0.313,0.336,0.307],[0.488,0.389,0.393,0.392,0.390,0.393],[0.284,0.215,0.211,0.208,0.211,0.212],[0.299,0.227,0.227,0.224,0.223,0.222],[0.553,0.448,0.449,0.447,0.445,0.450],[0.675,0.567,0.574,0.569,0.582,0.578],[0.625,0.531,0.527,0.533,0.530,0.532],[0.511,0.459,0.468,0.468,0.463,0.475],[1.330,1.146,1.111,1.124,1.125,1.123],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.346,0.226,0.224,0.227,0.229,0.229],[1.489,0.871,0.881,0.871,0.876,0.881],[1.314,1.130,1.130,1.128,1.136,1.146],[1.718,1.640,1.640,1.611,1.632,1.635],[0.675,0.553,0.550,0.559,0.558,0.564],[0.896,0.720,0.710,0.715,0.725,0.721],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.084,0.010,0.011,0.010,0.010,0.010],[0.061,0.005,0.005,0.005,0.005,0.005],[0.829,0.079,0.078,0.076,0.075,0.077],[0.822,0.126,0.127,0.129,0.127,0.126],[0.240,0.071,0.081,0.079,0.077,0.075],[0.849,0.204,0.207,0.203,0.202,0.206],[0.433,0.052,0.052,0.054,0.054,0.051],[0.540,0.099,0.098,0.099,0.100,0.103],[0.604,0.156,0.154,0.153,0.154,0.154],[0.504,0.069,0.074,0.070,0.071,0.073],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.073,0.582,0.580,0.576,0.582,0.569],[0.704,0.065,0.062,0.062,0.067,0.065],[1.163,0.622,0.623,0.620,0.627,0.614],[6.259,4.679,4.663,4.658,4.676,4.685],[9.680,1.674,1.681,1.680,1.682,1.679],[5.108,3.421,3.523,3.654,3.395,3.464],[14.006,8.583,8.615,8.520,8.524,8.523],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.560,2.477,2.462,2.475,2.441,2.445],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54358","source":"results/1.1.54358.json"} +,{"actual_version":"1.1.54362","data_size":{"default":4096,"hits":14422348624,"job":1829942310,"mgbench":2945813463,"ontime":2703567993,"ssb":162120039560,"taxi":24207561459,"tpcds":18809417091,"tpch":17376745065,"uk":786706493},"kind":"versions-benchmark","load_time":{"hits":239,"job":33,"mgbench":84,"ontime":65,"ssb":1601,"taxi":969,"tpcds":296,"tpch":310,"uk":50},"machine":"c7a.4xlarge","release_date":"2018-03-10","result":[[0.172,0.022,0.022,0.021,0.021,0.022],[0.079,0.009,0.009,0.009,0.009,0.008],[0.161,0.022,0.019,0.021,0.020,0.020],[0.087,0.013,0.012,0.011,0.011,0.012],[0.082,0.030,0.032,0.032,0.029,0.034],[0.163,0.030,0.032,0.033,0.031,0.030],[0.124,0.016,0.016,0.016,0.016,0.017],[0.096,0.031,0.030,0.029,0.029,0.031],[0.161,0.072,0.070,0.072,0.072,0.068],[0.201,0.110,0.109,0.108,0.112,0.110],[0.541,0.434,0.433,0.438,0.429,0.431],[0.521,0.407,0.412,0.412,0.402,0.386],[0.226,0.043,0.044,0.043,0.042,0.041],[0.096,0.015,0.014,0.015,0.014,0.014],[null,null,null,null,null,null],[1.686,0.279,0.281,0.287,0.285,0.283],[0.052,0.020,0.019,0.020,0.021,0.020],[1.580,0.354,0.348,0.349,0.352,0.355],[7.790,3.852,3.820,4.168,3.857,3.745],[5.557,2.552,2.454,2.442,2.460,2.619],[5.881,2.685,2.485,2.551,2.570,2.573],[11.597,7.809,7.484,7.319,7.144,7.254],[11.106,7.129,7.273,7.247,7.617,7.093],[6.189,3.570,3.555,3.543,3.678,3.732],[0.097,0.071,0.060,0.065,0.062,0.068],[10.639,6.337,6.343,6.362,6.338,6.198],[5.242,2.438,2.250,2.235,2.295,2.272],[3.426,1.641,1.624,1.678,1.653,1.724],[0.058,0.015,0.014,0.014,0.014,0.015],[0.059,0.012,0.012,0.013,0.013,0.013],[0.103,0.061,0.056,0.055,0.054,0.057],[0.092,0.057,0.059,0.056,0.056,0.057],[0.193,0.153,0.153,0.150,0.152,0.159],[0.304,0.250,0.268,0.246,0.252,0.257],[0.078,0.037,0.036,0.036,0.035,0.035],[0.057,0.013,0.014,0.013,0.014,0.014],[0.369,0.296,0.298,0.315,0.303,0.294],[0.447,0.359,0.360,0.354,0.369,0.388],[0.270,0.215,0.217,0.213,0.213,0.213],[0.280,0.236,0.231,0.225,0.226,0.226],[0.520,0.449,0.455,0.450,0.443,0.443],[0.646,0.575,0.561,0.563,0.574,0.568],[0.575,0.521,0.523,0.527,0.524,0.535],[0.502,0.451,0.469,0.465,0.462,0.453],[1.331,1.195,1.155,1.164,1.171,1.193],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.290,0.230,0.235,0.234,0.227,0.223],[1.453,0.878,0.875,0.873,0.870,0.875],[1.244,1.113,1.119,1.120,1.105,1.110],[1.694,1.660,1.641,1.649,1.638,1.648],[0.645,0.547,0.542,0.555,0.554,0.547],[0.852,0.729,0.717,0.710,0.700,0.705],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.079,0.010,0.010,0.011,0.011,0.010],[0.053,0.006,0.005,0.005,0.005,0.005],[0.770,0.077,0.077,0.077,0.077,0.072],[0.820,0.128,0.128,0.128,0.128,0.127],[0.232,0.076,0.079,0.075,0.082,0.082],[0.849,0.221,0.222,0.215,0.217,0.215],[0.414,0.053,0.051,0.051,0.054,0.052],[0.510,0.100,0.103,0.103,0.097,0.104],[0.557,0.151,0.154,0.152,0.151,0.152],[0.422,0.070,0.068,0.067,0.068,0.068],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.042,0.571,0.558,0.573,0.573,0.574],[0.673,0.069,0.066,0.061,0.067,0.066],[1.132,0.621,0.617,0.615,0.613,0.621],[6.080,4.641,4.648,4.591,4.653,4.558],[9.706,1.659,1.661,1.694,1.664,1.685],[5.089,3.475,3.445,3.443,3.438,3.424],[13.901,8.667,8.760,8.655,8.604,8.646],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.548,2.466,2.462,2.455,2.460,2.456],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54362","source":"results/1.1.54362.json"} +,{"actual_version":"1.1.54370","data_size":{"default":4096,"hits":14385323034,"job":1829942310,"mgbench":2949534965,"ontime":2703567993,"ssb":155227207024,"taxi":24205561400,"tpcds":18797246847,"tpch":17376739401,"uk":786706493},"kind":"versions-benchmark","load_time":{"hits":239,"job":31,"mgbench":87,"ontime":65,"ssb":1755,"taxi":960,"tpcds":277,"tpch":322,"uk":49},"machine":"c7a.4xlarge","release_date":"2018-03-16","result":[[0.193,0.021,0.024,0.022,0.021,0.023],[0.085,0.008,0.008,0.008,0.009,0.008],[0.170,0.021,0.020,0.023,0.020,0.021],[0.090,0.011,0.011,0.012,0.011,0.010],[0.087,0.031,0.031,0.034,0.029,0.030],[0.170,0.033,0.034,0.034,0.035,0.032],[0.142,0.016,0.017,0.017,0.016,0.016],[0.105,0.031,0.032,0.034,0.032,0.032],[0.185,0.076,0.076,0.072,0.070,0.075],[0.213,0.113,0.108,0.112,0.111,0.110],[0.535,0.417,0.420,0.419,0.421,0.423],[0.563,0.441,0.431,0.422,0.435,0.438],[0.258,0.043,0.042,0.041,0.042,0.043],[0.110,0.014,0.014,0.014,0.015,0.014],[null,null,null,null,null,null],[1.814,0.279,0.280,0.279,0.274,0.276],[0.053,0.021,0.019,0.021,0.019,0.022],[2.005,0.345,0.357,0.346,0.350,0.347],[8.232,3.866,3.774,3.868,3.923,4.050],[6.175,2.509,2.433,2.401,2.570,2.383],[6.181,2.511,2.519,2.469,2.523,2.519],[11.899,7.313,7.218,7.122,7.089,7.305],[11.347,7.074,7.429,7.252,7.115,7.010],[6.383,3.468,3.550,3.440,3.603,3.492],[0.097,0.062,0.063,0.062,0.061,0.059],[10.969,6.543,6.183,6.292,6.444,6.301],[5.204,2.427,3.189,2.270,2.178,2.354],[3.600,1.775,1.716,1.665,1.715,1.686],[0.051,0.014,0.013,0.012,0.013,0.014],[0.054,0.012,0.012,0.012,0.012,0.012],[0.095,0.057,0.054,0.053,0.053,0.053],[0.086,0.056,0.059,0.057,0.055,0.054],[0.192,0.132,0.148,0.149,0.140,0.144],[0.289,0.251,0.252,0.243,0.244,0.249],[0.072,0.037,0.035,0.036,0.035,0.035],[0.051,0.014,0.012,0.013,0.013,0.013],[0.358,0.313,0.295,0.308,0.311,0.320],[0.445,0.381,0.369,0.357,0.361,0.367],[0.256,0.210,0.215,0.210,0.208,0.211],[0.274,0.222,0.227,0.224,0.227,0.219],[0.510,0.443,0.442,0.440,0.442,0.441],[0.637,0.569,0.569,0.562,0.558,0.562],[0.586,0.534,0.529,0.532,0.538,0.533],[0.500,0.487,0.478,0.466,0.476,0.461],[1.317,1.138,1.135,1.132,1.130,1.133],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.287,0.226,0.232,0.231,0.227,0.235],[1.444,0.896,0.887,0.889,0.900,0.901],[1.273,1.128,1.116,1.117,1.120,1.117],[1.706,1.655,1.650,1.635,1.652,1.653],[0.621,0.548,0.552,0.555,0.557,0.554],[0.848,0.720,0.732,0.730,0.738,0.717],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.053,0.009,0.009,0.010,0.008,0.009],[0.031,0.003,0.004,0.003,0.003,0.004],[0.904,0.075,0.075,0.073,0.073,0.077],[0.958,0.129,0.126,0.126,0.124,0.129],[0.259,0.077,0.075,0.073,0.073,0.075],[0.989,0.216,0.213,0.222,0.219,0.205],[0.530,0.051,0.050,0.053,0.053,0.053],[0.597,0.103,0.108,0.101,0.098,0.098],[0.642,0.155,0.153,0.150,0.152,0.146],[0.548,0.069,0.070,0.070,0.072,0.072],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.146,0.573,0.584,0.573,0.575,0.574],[0.842,0.068,0.062,0.063,0.061,0.066],[1.220,0.607,0.604,0.601,0.599,0.607],[6.357,4.594,4.600,4.571,4.562,4.578],[9.950,1.662,1.639,1.654,1.646,1.634],[5.156,3.449,3.472,3.449,3.429,3.430],[14.148,8.619,8.612,8.701,8.584,8.588],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.583,2.488,2.501,2.490,2.470,2.475],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54370","source":"results/1.1.54370.json"} +,{"actual_version":"1.1.54378","data_size":{"hits":14391436209,"job":1829577745,"mgbench":2937217244,"ontime":2701085816,"ssb":164120378175,"taxi":24200763345,"tpcds":18790511503,"tpch":17371088631,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":238,"job":36,"mgbench":82,"ontime":65,"ssb":1544,"taxi":960,"tpcds":298,"tpch":315,"uk":46},"machine":"c7a.4xlarge","release_date":"2018-04-16","result":[[0.192,0.022,0.022,0.023,0.023,0.021],[0.097,0.008,0.008,0.008,0.008,0.009],[0.203,0.019,0.019,0.018,0.020,0.018],[0.089,0.011,0.011,0.011,0.011,0.011],[0.085,0.029,0.028,0.028,0.027,0.027],[0.193,0.030,0.034,0.029,0.030,0.031],[0.130,0.015,0.016,0.016,0.015,0.015],[0.099,0.027,0.026,0.026,0.026,0.028],[0.162,0.055,0.057,0.057,0.060,0.057],[0.205,0.105,0.112,0.107,0.104,0.106],[0.538,0.436,0.447,0.433,0.437,0.442],[0.538,0.435,0.414,0.410,0.423,0.408],[0.249,0.041,0.041,0.039,0.040,0.040],[0.093,0.013,0.014,0.013,0.013,0.013],[null,null,null,null,null,null],[1.869,0.220,0.224,0.224,0.222,0.224],[0.049,0.019,0.017,0.018,0.019,0.018],[1.766,0.280,0.281,0.279,0.279,0.282],[8.039,3.971,3.864,3.820,3.784,3.764],[6.124,2.366,2.285,2.304,2.272,2.235],[6.072,2.447,2.347,2.376,2.375,2.329],[8.838,5.059,5.080,5.023,4.879,4.966],[9.186,4.238,4.468,4.523,4.263,4.178],[5.933,2.861,2.875,2.857,2.841,2.843],[0.112,0.061,0.066,0.057,0.056,0.055],[12.768,6.543,6.684,6.931,6.702,6.460],[4.519,1.867,2.377,1.894,1.823,2.001],[3.453,1.223,1.348,1.226,1.144,1.165],[0.062,0.012,0.012,0.013,0.012,0.012],[0.065,0.011,0.010,0.010,0.010,0.010],[0.109,0.062,0.063,0.059,0.060,0.060],[0.097,0.052,0.051,0.053,0.052,0.052],[0.198,0.145,0.137,0.149,0.158,0.147],[0.308,0.257,0.252,0.247,0.243,0.246],[0.079,0.036,0.033,0.033,0.035,0.032],[0.063,0.013,0.013,0.012,0.011,0.011],[0.366,0.303,0.326,0.307,0.312,0.309],[0.459,0.375,0.370,0.367,0.375,0.378],[0.265,0.204,0.201,0.204,0.200,0.209],[0.285,0.214,0.216,0.215,0.218,0.221],[0.498,0.431,0.432,0.435,0.446,0.434],[0.633,0.548,0.541,0.550,0.538,0.545],[0.576,0.519,0.501,0.505,0.498,0.502],[0.516,0.457,0.464,0.458,0.454,0.458],[1.324,1.149,1.145,1.143,1.131,1.152],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.298,0.237,0.230,0.229,0.217,0.211],[1.475,0.684,0.669,0.668,0.663,0.670],[1.241,1.103,1.098,1.110,1.112,1.121],[1.761,1.693,1.699,1.725,1.718,1.728],[0.605,0.529,0.529,0.515,0.508,0.513],[0.834,0.674,0.674,0.671,0.664,0.679],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.071,0.010,0.010,0.010,0.010,0.010],[0.041,0.004,0.004,0.004,0.004,0.005],[0.799,0.075,0.073,0.071,0.075,0.073],[0.869,0.129,0.125,0.123,0.123,0.123],[0.230,0.074,0.068,0.067,0.065,0.066],[0.935,0.210,0.206,0.209,0.205,0.204],[0.459,0.053,0.052,0.052,0.049,0.050],[0.543,0.095,0.094,0.090,0.099,0.088],[0.604,0.134,0.141,0.141,0.140,0.144],[0.480,0.066,0.067,0.068,0.069,0.071],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.091,0.575,0.559,0.565,0.563,0.563],[0.745,0.057,0.060,0.067,0.057,0.060],[1.104,0.575,0.585,0.588,0.585,0.583],[6.306,4.577,4.565,4.623,4.616,4.623],[9.781,1.678,1.733,1.676,1.707,1.698],[5.508,3.634,3.468,3.471,3.548,3.531],[14.389,8.956,8.778,8.908,8.663,8.805],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.470,2.410,2.391,2.390,2.388,2.369],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54378","source":"results/1.1.54378.json"} +,{"actual_version":"1.1.54380","data_size":{"hits":14434119821,"job":1829577745,"mgbench":2950100642,"ontime":2701085816,"ssb":167301817685,"taxi":24201895710,"tpcds":18803469607,"tpch":17371221622,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":244,"job":32,"mgbench":87,"ontime":67,"ssb":1502,"taxi":960,"tpcds":304,"tpch":315,"uk":49},"machine":"c7a.4xlarge","release_date":"2018-04-21","result":[[0.162,0.022,0.021,0.023,0.022,0.022],[0.077,0.009,0.008,0.009,0.009,0.009],[0.163,0.021,0.019,0.020,0.019,0.020],[0.081,0.013,0.011,0.012,0.011,0.011],[0.078,0.030,0.029,0.027,0.026,0.029],[0.166,0.031,0.031,0.029,0.033,0.032],[0.118,0.015,0.015,0.015,0.016,0.015],[0.092,0.025,0.026,0.026,0.026,0.027],[0.156,0.063,0.067,0.063,0.061,0.063],[0.198,0.113,0.114,0.110,0.115,0.108],[0.531,0.438,0.436,0.436,0.443,0.446],[0.537,0.422,0.421,0.411,0.423,0.421],[0.218,0.039,0.039,0.039,0.040,0.038],[0.089,0.014,0.015,0.015,0.015,0.014],[null,null,null,null,null,null],[1.639,0.214,0.225,0.223,0.228,0.218],[0.046,0.018,0.019,0.020,0.021,0.021],[1.498,0.283,0.281,0.276,0.283,0.284],[7.545,4.074,3.885,3.988,3.896,3.991],[5.895,2.300,2.337,2.346,2.529,2.303],[5.851,2.362,2.380,2.357,2.389,2.334],[8.655,4.805,4.979,4.844,4.995,5.345],[8.841,4.408,4.287,4.386,4.401,4.579],[5.700,2.857,2.831,2.879,2.834,2.881],[0.102,0.065,0.058,0.057,0.061,0.062],[10.867,7.675,6.573,6.306,6.667,6.496],[4.115,2.028,2.259,2.360,2.048,1.937],[3.191,1.278,1.144,1.209,1.186,1.214],[0.066,0.014,0.013,0.013,0.013,0.013],[0.066,0.011,0.010,0.010,0.011,0.011],[0.114,0.060,0.061,0.062,0.061,0.061],[0.094,0.056,0.054,0.054,0.054,0.055],[0.192,0.143,0.148,0.143,0.151,0.144],[0.310,0.244,0.245,0.248,0.252,0.249],[0.081,0.033,0.034,0.035,0.032,0.032],[0.061,0.012,0.012,0.013,0.012,0.012],[0.383,0.312,0.294,0.316,0.307,0.318],[0.465,0.395,0.383,0.383,0.369,0.376],[0.263,0.206,0.200,0.202,0.202,0.202],[0.284,0.216,0.218,0.222,0.219,0.214],[0.527,0.447,0.455,0.450,0.447,0.451],[0.660,0.566,0.559,0.564,0.563,0.565],[0.613,0.531,0.534,0.546,0.528,0.541],[0.509,0.462,0.478,0.464,0.457,0.455],[1.360,1.177,1.164,1.136,1.142,1.155],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.302,0.226,0.222,0.223,0.221,0.227],[1.454,0.683,0.681,0.687,0.679,0.691],[1.292,1.147,1.139,1.136,1.143,1.142],[1.825,1.751,1.770,1.744,1.754,1.727],[0.637,0.543,0.546,0.542,0.542,0.548],[0.845,0.712,0.709,0.709,0.705,0.698],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.076,0.009,0.010,0.009,0.009,0.008],[0.051,0.005,0.005,0.005,0.005,0.005],[0.739,0.072,0.071,0.069,0.072,0.069],[0.788,0.119,0.117,0.118,0.118,0.116],[0.219,0.070,0.071,0.062,0.070,0.069],[0.855,0.213,0.210,0.207,0.214,0.209],[0.421,0.051,0.051,0.048,0.050,0.050],[0.490,0.091,0.094,0.091,0.090,0.092],[0.543,0.138,0.139,0.139,0.143,0.141],[0.445,0.068,0.065,0.069,0.064,0.066],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.054,0.577,0.577,0.580,0.585,0.592],[0.694,0.059,0.060,0.060,0.063,0.057],[1.078,0.586,0.586,0.581,0.587,0.570],[5.907,4.684,4.615,4.553,4.521,4.495],[9.899,1.673,1.697,1.687,1.686,1.682],[5.481,3.464,3.408,3.435,3.506,3.580],[14.152,9.131,8.745,8.872,8.678,8.785],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.464,2.384,2.386,2.368,2.367,2.348],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54380","source":"results/1.1.54380.json"} +,{"actual_version":"1.1.54381","data_size":{"hits":14395334484,"job":1829577745,"mgbench":2956146121,"ontime":2701085816,"ssb":164467602166,"taxi":24201139876,"tpcds":18794812509,"tpch":17371321826,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":245,"job":32,"mgbench":85,"ontime":66,"ssb":1541,"taxi":954,"tpcds":295,"tpch":304,"uk":47},"machine":"c7a.4xlarge","release_date":"2018-05-14","result":[[0.255,0.021,0.022,0.022,0.022,0.020],[0.119,0.008,0.009,0.008,0.008,0.008],[0.317,0.019,0.019,0.023,0.018,0.019],[0.104,0.011,0.012,0.011,0.011,0.012],[0.097,0.029,0.031,0.029,0.031,0.028],[0.276,0.033,0.029,0.029,0.029,0.030],[0.146,0.016,0.016,0.015,0.016,0.016],[0.117,0.026,0.028,0.027,0.026,0.028],[0.178,0.057,0.057,0.059,0.057,0.056],[0.220,0.112,0.108,0.108,0.107,0.117],[0.541,0.441,0.438,0.433,0.429,0.431],[0.568,0.418,0.405,0.412,0.408,0.427],[0.249,0.039,0.038,0.039,0.038,0.038],[0.110,0.014,0.014,0.013,0.014,0.013],[null,null,null,null,null,null],[1.830,0.218,0.222,0.220,0.226,0.224],[0.067,0.020,0.018,0.019,0.018,0.019],[2.132,0.289,0.278,0.285,0.289,0.285],[8.143,4.375,4.315,3.998,3.899,3.871],[6.374,2.321,2.216,2.269,2.222,2.309],[6.217,2.403,2.447,2.339,2.335,2.343],[9.235,4.858,4.892,4.919,4.781,4.976],[9.381,4.500,4.255,4.259,4.176,4.190],[6.074,2.855,2.883,2.979,2.855,2.864],[0.096,0.054,0.054,0.056,0.060,0.057],[12.898,6.321,6.353,7.372,7.217,6.673],[4.607,2.082,1.926,2.116,2.121,1.966],[3.606,1.238,1.154,1.165,1.168,1.241],[0.056,0.014,0.014,0.013,0.013,0.013],[0.057,0.011,0.011,0.011,0.013,0.011],[0.107,0.062,0.061,0.060,0.061,0.062],[0.146,0.053,0.053,0.052,0.053,0.053],[0.195,0.141,0.132,0.141,0.146,0.151],[0.305,0.241,0.237,0.240,0.238,0.249],[0.073,0.034,0.037,0.035,0.034,0.032],[0.053,0.011,0.011,0.011,0.012,0.012],[0.362,0.318,0.296,0.291,0.308,0.297],[0.467,0.386,0.374,0.405,0.378,0.376],[0.263,0.201,0.204,0.202,0.203,0.201],[0.280,0.216,0.215,0.212,0.214,0.212],[0.497,0.424,0.423,0.421,0.424,0.427],[0.630,0.538,0.541,0.538,0.543,0.543],[0.571,0.507,0.502,0.512,0.508,0.514],[0.505,0.465,0.467,0.459,0.462,0.439],[1.319,1.128,1.126,1.113,1.132,1.104],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.411,0.211,0.210,0.233,0.211,0.221],[1.467,0.661,0.666,0.658,0.657,0.660],[1.224,1.030,1.016,1.021,1.027,1.012],[1.727,1.707,1.707,1.741,1.732,1.712],[0.622,0.523,0.522,0.522,0.524,0.521],[1.008,0.680,0.700,0.671,0.661,0.678],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.067,0.010,0.009,0.009,0.009,0.010],[0.037,0.004,0.004,0.004,0.004,0.003],[0.888,0.072,0.070,0.070,0.070,0.070],[0.860,0.123,0.125,0.119,0.127,0.121],[0.222,0.064,0.069,0.067,0.071,0.072],[1.011,0.205,0.221,0.209,0.209,0.218],[0.470,0.051,0.054,0.051,0.049,0.048],[0.598,0.089,0.091,0.088,0.086,0.090],[0.671,0.145,0.138,0.138,0.134,0.135],[0.526,0.066,0.066,0.066,0.066,0.067],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.139,0.563,0.565,0.561,0.594,0.564],[0.830,0.061,0.056,0.057,0.057,0.055],[1.156,0.574,0.572,0.578,0.572,0.580],[6.335,4.585,4.601,4.549,4.515,4.571],[10.022,1.733,1.679,1.713,1.673,1.658],[5.637,3.482,3.500,3.517,3.478,3.461],[14.223,8.833,8.674,8.736,8.805,8.813],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.493,2.403,2.403,2.420,2.398,2.395],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54381","source":"results/1.1.54381.json"} +,{"actual_version":"1.1.54383","data_size":{"hits":14443695339,"job":1829577745,"mgbench":2953057858,"ontime":2701085816,"ssb":163192384835,"taxi":24202502026,"tpcds":18796805133,"tpch":17371326536,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":234,"job":33,"mgbench":87,"ontime":66,"ssb":1565,"taxi":942,"tpcds":303,"tpch":320,"uk":47},"machine":"c7a.4xlarge","release_date":"2018-05-22","result":[[0.153,0.021,0.023,0.020,0.022,0.020],[0.078,0.008,0.009,0.009,0.008,0.008],[0.161,0.019,0.019,0.019,0.021,0.019],[0.083,0.012,0.014,0.012,0.012,0.011],[0.076,0.031,0.026,0.027,0.025,0.029],[0.168,0.032,0.030,0.031,0.030,0.030],[0.113,0.015,0.015,0.015,0.015,0.015],[0.089,0.026,0.025,0.027,0.026,0.027],[0.151,0.062,0.064,0.060,0.060,0.065],[0.199,0.115,0.113,0.110,0.109,0.111],[0.541,0.439,0.437,0.437,0.437,0.436],[0.530,0.412,0.429,0.408,0.398,0.390],[0.204,0.036,0.037,0.036,0.036,0.037],[0.093,0.014,0.014,0.013,0.014,0.013],[null,null,null,null,null,null],[1.627,0.216,0.217,0.216,0.215,0.220],[0.052,0.019,0.019,0.019,0.018,0.019],[1.512,0.281,0.279,0.283,0.279,0.280],[7.690,4.136,3.919,4.711,4.071,3.837],[5.918,2.342,2.278,2.244,2.279,2.237],[5.885,2.382,2.542,2.511,2.381,2.381],[8.451,4.937,4.964,5.091,4.909,5.097],[8.888,4.461,4.732,4.215,4.207,4.318],[5.723,2.822,2.829,3.011,2.799,2.755],[0.098,0.060,0.058,0.058,0.056,0.055],[10.989,6.472,6.413,6.254,6.435,6.233],[4.109,2.186,1.886,2.331,1.888,1.838],[3.204,1.135,1.147,1.131,1.216,1.161],[0.069,0.014,0.015,0.013,0.013,0.013],[0.069,0.011,0.011,0.011,0.011,0.010],[0.118,0.064,0.063,0.065,0.062,0.060],[0.097,0.055,0.054,0.055,0.055,0.054],[0.197,0.147,0.147,0.149,0.148,0.147],[0.312,0.245,0.246,0.247,0.248,0.252],[0.081,0.031,0.034,0.032,0.031,0.032],[0.062,0.012,0.012,0.012,0.012,0.012],[0.367,0.300,0.303,0.298,0.302,0.292],[0.466,0.375,0.364,0.369,0.368,0.382],[0.262,0.207,0.203,0.202,0.200,0.201],[0.279,0.217,0.216,0.213,0.215,0.212],[0.531,0.440,0.448,0.435,0.441,0.444],[0.635,0.549,0.551,0.554,0.544,0.546],[0.598,0.526,0.533,0.536,0.532,0.537],[0.499,0.465,0.456,0.471,0.463,0.455],[1.295,1.130,1.133,1.127,1.125,1.131],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.300,0.239,0.230,0.227,0.234,0.226],[1.481,0.681,0.679,0.678,0.679,0.678],[1.271,1.129,1.122,1.117,1.121,1.117],[1.756,1.689,1.701,1.704,1.700,1.702],[0.636,0.540,0.539,0.537,0.541,0.546],[0.829,0.685,0.688,0.699,0.694,0.678],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.069,0.009,0.009,0.009,0.009,0.009],[0.051,0.005,0.005,0.005,0.005,0.004],[0.735,0.070,0.069,0.073,0.069,0.068],[0.779,0.119,0.117,0.118,0.117,0.114],[0.221,0.064,0.064,0.072,0.072,0.066],[0.856,0.206,0.212,0.210,0.213,0.209],[0.417,0.047,0.050,0.048,0.047,0.051],[0.506,0.093,0.090,0.092,0.091,0.090],[0.541,0.141,0.135,0.135,0.138,0.139],[0.446,0.067,0.064,0.067,0.063,0.067],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.064,0.585,0.582,0.579,0.591,0.587],[0.696,0.075,0.069,0.066,0.074,0.069],[1.082,0.576,0.571,0.573,0.574,0.579],[5.953,4.652,4.562,4.554,4.514,4.481],[9.833,1.726,1.695,1.687,1.685,1.690],[5.349,3.422,3.451,3.426,3.476,3.569],[13.968,8.825,8.600,8.773,8.673,8.591],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.411,2.370,2.350,2.340,2.346,2.348],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54383","source":"results/1.1.54383.json"} +,{"actual_version":"1.1.54385","data_size":{"hits":14370063012,"job":1829577745,"mgbench":2954146325,"ontime":2701085816,"ssb":164621795869,"taxi":24202201440,"tpcds":18815628254,"tpch":17371394517,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":245,"job":34,"mgbench":86,"ontime":65,"ssb":1547,"taxi":944,"tpcds":303,"tpch":302,"uk":49},"machine":"c7a.4xlarge","release_date":"2018-06-01","result":[[0.153,0.023,0.023,0.023,0.022,0.021],[0.080,0.008,0.008,0.008,0.008,0.008],[0.168,0.019,0.019,0.019,0.019,0.019],[0.080,0.011,0.011,0.011,0.011,0.012],[0.077,0.031,0.031,0.028,0.029,0.030],[0.158,0.030,0.030,0.029,0.030,0.033],[0.109,0.015,0.015,0.015,0.015,0.014],[0.089,0.025,0.026,0.027,0.026,0.027],[0.145,0.059,0.063,0.064,0.066,0.069],[0.193,0.110,0.116,0.111,0.116,0.113],[0.522,0.432,0.431,0.436,0.435,0.435],[0.536,0.414,0.432,0.427,0.421,0.447],[0.204,0.041,0.040,0.041,0.041,0.040],[0.085,0.014,0.014,0.015,0.014,0.014],[null,null,null,null,null,null],[1.687,0.222,0.224,0.217,0.224,0.216],[0.051,0.019,0.018,0.020,0.019,0.018],[1.688,0.291,0.288,0.290,0.286,0.289],[7.779,4.001,3.915,4.025,3.903,3.868],[5.899,2.332,2.617,2.586,2.318,2.288],[5.925,2.542,2.288,2.392,2.304,2.382],[8.602,4.760,4.829,5.066,4.849,5.294],[8.889,4.665,4.162,4.314,4.323,4.266],[5.771,2.879,2.868,2.841,2.871,2.843],[0.088,0.053,0.059,0.060,0.060,0.060],[10.872,6.471,6.691,6.412,6.344,6.821],[4.307,2.127,1.914,2.086,1.853,2.209],[3.386,1.181,1.196,1.265,1.197,1.147],[0.027,0.012,0.012,0.011,0.011,0.011],[0.025,0.010,0.010,0.010,0.009,0.011],[0.073,0.059,0.058,0.057,0.057,0.057],[0.069,0.054,0.054,0.054,0.053,0.053],[0.167,0.152,0.149,0.144,0.147,0.140],[0.273,0.245,0.240,0.232,0.247,0.242],[0.046,0.032,0.031,0.032,0.032,0.031],[0.026,0.011,0.010,0.011,0.011,0.010],[0.343,0.306,0.311,0.309,0.311,0.301],[0.419,0.370,0.368,0.356,0.385,0.370],[0.236,0.211,0.213,0.214,0.213,0.210],[0.249,0.219,0.221,0.227,0.229,0.222],[0.465,0.441,0.436,0.438,0.445,0.452],[0.589,0.556,0.547,0.548,0.542,0.560],[0.543,0.512,0.521,0.521,0.525,0.518],[0.490,0.470,0.456,0.459,0.451,0.454],[1.268,1.126,1.127,1.128,1.123,1.158],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.245,0.212,0.217,0.212,0.216,0.218],[1.417,0.675,0.663,0.672,0.677,0.673],[1.178,1.122,1.119,1.114,1.120,1.111],[1.768,1.724,1.732,1.712,1.736,1.734],[0.575,0.514,0.520,0.515,0.534,0.552],[0.775,0.673,0.673,0.679,0.677,0.680],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.043,0.009,0.009,0.009,0.009,0.009],[0.020,0.003,0.003,0.003,0.003,0.003],[0.719,0.073,0.073,0.072,0.071,0.070],[0.759,0.124,0.124,0.123,0.121,0.125],[0.210,0.067,0.067,0.065,0.073,0.079],[0.816,0.222,0.211,0.211,0.206,0.207],[0.401,0.049,0.052,0.051,0.051,0.051],[0.483,0.091,0.093,0.090,0.090,0.096],[0.511,0.135,0.135,0.137,0.140,0.138],[0.437,0.068,0.067,0.068,0.066,0.064],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.031,0.564,0.570,0.570,0.564,0.571],[0.672,0.066,0.071,0.066,0.065,0.069],[1.053,0.567,0.569,0.583,0.571,0.576],[5.986,4.611,4.608,4.617,4.551,4.525],[9.825,1.700,1.687,1.716,1.718,1.702],[5.096,3.463,3.417,3.625,3.487,3.529],[14.101,8.994,8.707,9.133,8.752,8.898],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.562,2.491,2.485,2.483,2.464,2.479],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54385","source":"results/1.1.54385.json"} +,{"actual_version":"1.1.54388","data_size":{"hits":14423636125,"job":1829577745,"mgbench":2949197795,"ontime":2701085816,"ssb":164125655414,"taxi":24200413066,"tpcds":18784781862,"tpch":17371082841,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":237,"job":30,"mgbench":83,"ontime":65,"ssb":1580,"taxi":963,"tpcds":303,"tpch":315,"uk":47},"machine":"c7a.4xlarge","release_date":"2018-06-28","result":[[0.187,0.022,0.023,0.021,0.022,0.022],[0.092,0.009,0.008,0.007,0.008,0.008],[0.216,0.018,0.018,0.018,0.018,0.018],[0.089,0.011,0.012,0.012,0.011,0.012],[0.082,0.026,0.028,0.028,0.027,0.031],[0.192,0.030,0.032,0.031,0.032,0.031],[0.124,0.015,0.015,0.014,0.015,0.014],[0.098,0.025,0.027,0.025,0.027,0.026],[0.158,0.055,0.059,0.057,0.058,0.061],[0.218,0.109,0.112,0.108,0.117,0.109],[0.539,0.434,0.442,0.436,0.451,0.438],[0.541,0.431,0.418,0.413,0.398,0.406],[0.229,0.035,0.034,0.034,0.035,0.035],[0.094,0.013,0.014,0.013,0.014,0.013],[null,null,null,null,null,null],[1.819,0.211,0.214,0.214,0.208,0.216],[0.057,0.018,0.018,0.019,0.019,0.019],[1.709,0.266,0.271,0.269,0.269,0.267],[7.939,4.201,4.173,3.994,3.847,4.052],[6.076,2.287,2.369,2.328,2.398,2.337],[6.026,2.498,2.387,2.642,2.338,2.386],[9.094,4.856,4.846,5.149,5.488,5.010],[9.069,4.585,4.366,4.610,4.237,4.292],[5.969,2.983,2.762,2.792,2.810,2.770],[0.095,0.053,0.054,0.054,0.055,0.051],[12.455,6.749,6.554,6.432,6.766,6.555],[4.543,2.166,2.092,2.003,1.962,2.017],[3.457,1.141,1.182,1.138,1.120,1.231],[0.066,0.014,0.015,0.013,0.013,0.014],[0.067,0.012,0.011,0.011,0.010,0.011],[0.118,0.064,0.063,0.064,0.064,0.063],[0.109,0.049,0.045,0.045,0.044,0.049],[0.191,0.136,0.124,0.142,0.134,0.133],[0.308,0.240,0.243,0.241,0.243,0.243],[0.094,0.043,0.043,0.043,0.047,0.043],[0.066,0.013,0.012,0.012,0.013,0.013],[0.364,0.309,0.306,0.303,0.305,0.326],[0.448,0.376,0.375,0.381,0.377,0.370],[0.227,0.172,0.177,0.176,0.179,0.173],[0.249,0.189,0.197,0.193,0.189,0.189],[0.529,0.440,0.442,0.443,0.438,0.441],[0.643,0.558,0.558,0.555,0.561,0.555],[0.598,0.527,0.525,0.528,0.521,0.529],[0.483,0.437,0.437,0.433,0.434,0.433],[1.360,1.141,1.133,1.141,1.151,1.151],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.348,0.232,0.232,0.224,0.223,0.222],[1.474,0.630,0.622,0.622,0.637,0.626],[1.238,1.089,1.084,1.084,1.088,1.086],[1.818,1.851,1.787,1.805,1.813,1.776],[0.646,0.548,0.540,0.540,0.530,0.535],[0.865,0.709,0.699,0.685,0.673,0.682],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.074,0.009,0.009,0.009,0.009,0.008],[0.052,0.004,0.004,0.004,0.004,0.004],[0.851,0.068,0.065,0.068,0.066,0.065],[0.834,0.110,0.106,0.110,0.110,0.109],[0.226,0.069,0.062,0.064,0.063,0.065],[0.960,0.211,0.212,0.214,0.208,0.209],[0.445,0.053,0.049,0.047,0.056,0.047],[0.545,0.087,0.090,0.091,0.089,0.087],[0.624,0.135,0.139,0.136,0.137,0.137],[0.502,0.062,0.065,0.065,0.062,0.062],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.100,0.578,0.581,0.587,0.578,0.576],[0.776,0.068,0.061,0.059,0.058,0.060],[1.133,0.607,0.597,0.607,0.591,0.592],[5.962,4.332,4.379,4.369,4.346,4.372],[10.079,1.715,1.710,1.768,1.795,1.753],[5.747,3.621,3.538,3.579,3.648,3.694],[14.224,9.017,8.910,8.750,8.766,8.709],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.257,2.219,2.189,2.186,2.188,2.183],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54388","source":"results/1.1.54388.json"} +,{"actual_version":"1.1.54390","data_size":{"hits":14422128370,"job":1829577745,"mgbench":2954964114,"ontime":2701085816,"ssb":163807744107,"taxi":24201623835,"tpcds":18796878117,"tpch":17371211257,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":239,"job":33,"mgbench":84,"ontime":66,"ssb":1552,"taxi":969,"tpcds":301,"tpch":316,"uk":49},"machine":"c7a.4xlarge","release_date":"2018-07-09","result":[[0.162,0.022,0.022,0.022,0.022,0.020],[0.076,0.009,0.009,0.009,0.008,0.009],[0.154,0.018,0.020,0.019,0.018,0.019],[0.078,0.012,0.013,0.012,0.012,0.011],[0.080,0.032,0.029,0.025,0.025,0.029],[0.160,0.029,0.030,0.030,0.030,0.030],[0.116,0.015,0.015,0.015,0.015,0.014],[0.089,0.025,0.025,0.026,0.026,0.026],[0.157,0.062,0.057,0.060,0.058,0.057],[0.195,0.111,0.107,0.110,0.105,0.109],[0.516,0.437,0.425,0.429,0.435,0.430],[0.505,0.408,0.404,0.403,0.408,0.411],[0.203,0.035,0.034,0.035,0.033,0.034],[0.097,0.013,0.014,0.013,0.014,0.013],[null,null,null,null,null,null],[1.708,0.213,0.222,0.219,0.216,0.214],[0.052,0.018,0.023,0.019,0.022,0.020],[1.578,0.267,0.275,0.269,0.270,0.270],[7.879,4.376,4.335,4.189,4.208,3.913],[5.910,2.408,2.337,2.312,2.276,2.294],[5.953,2.416,2.381,2.428,2.382,2.512],[9.051,5.120,5.247,5.299,5.136,4.940],[9.169,5.307,4.569,4.771,4.816,4.929],[5.839,2.752,2.734,2.961,2.721,2.811],[0.100,0.057,0.057,0.055,0.058,0.057],[12.014,6.631,6.767,6.578,7.033,6.784],[4.450,2.115,1.994,2.041,1.963,2.080],[3.319,1.182,1.192,1.143,1.201,1.316],[0.050,0.014,0.019,0.014,0.013,0.013],[0.048,0.011,0.011,0.011,0.011,0.010],[0.097,0.058,0.057,0.056,0.056,0.055],[0.078,0.047,0.046,0.046,0.051,0.049],[0.180,0.150,0.142,0.154,0.133,0.147],[0.290,0.237,0.238,0.244,0.249,0.238],[0.063,0.032,0.032,0.033,0.034,0.034],[0.045,0.011,0.012,0.011,0.012,0.013],[0.349,0.311,0.297,0.301,0.294,0.305],[0.424,0.364,0.372,0.367,0.355,0.370],[0.217,0.177,0.178,0.177,0.175,0.177],[0.239,0.194,0.197,0.194,0.194,0.196],[0.524,0.449,0.452,0.448,0.454,0.449],[0.628,0.573,0.561,0.554,0.539,0.547],[0.566,0.509,0.521,0.526,0.526,0.526],[0.457,0.420,0.427,0.430,0.425,0.433],[1.331,1.155,1.164,1.179,1.147,1.176],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.285,0.244,0.214,0.220,0.228,0.212],[1.455,0.614,0.624,0.616,0.619,0.624],[1.210,1.094,1.101,1.106,1.117,1.106],[1.695,1.632,1.647,1.643,1.637,1.627],[0.616,0.537,0.530,0.534,0.528,0.534],[0.779,0.667,0.689,0.679,0.669,0.674],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.064,0.010,0.010,0.009,0.009,0.010],[0.046,0.004,0.005,0.004,0.005,0.004],[0.764,0.067,0.067,0.067,0.069,0.067],[0.817,0.108,0.112,0.109,0.110,0.110],[0.222,0.066,0.064,0.063,0.064,0.062],[0.882,0.208,0.210,0.209,0.212,0.212],[0.440,0.047,0.046,0.046,0.046,0.044],[0.515,0.088,0.086,0.094,0.088,0.088],[0.567,0.139,0.134,0.143,0.140,0.134],[0.457,0.065,0.061,0.064,0.062,0.065],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.074,0.585,0.586,0.578,0.571,0.575],[0.728,0.062,0.063,0.063,0.060,0.062],[1.079,0.579,0.578,0.583,0.577,0.568],[5.683,4.168,4.136,4.084,4.080,4.088],[9.845,1.736,1.776,1.945,1.758,1.730],[5.715,3.988,3.647,3.730,3.672,3.665],[14.113,8.825,8.830,8.808,8.719,9.076],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.237,2.180,2.184,2.169,2.183,2.189],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54390","source":"results/1.1.54390.json"} +,{"actual_version":"1.1.54394","data_size":{"hits":14429265304,"job":1829577745,"mgbench":2955788259,"ontime":2701085816,"ssb":161249582873,"taxi":24202052798,"tpcds":18792542560,"tpch":17372213316,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":243,"job":33,"mgbench":85,"ontime":66,"ssb":1600,"taxi":968,"tpcds":296,"tpch":320,"uk":49},"machine":"c7a.4xlarge","release_date":"2018-07-12","result":[[0.232,0.022,0.023,0.023,0.023,0.024],[0.096,0.009,0.008,0.008,0.009,0.008],[0.235,0.018,0.019,0.021,0.019,0.019],[0.098,0.012,0.011,0.011,0.011,0.012],[0.094,0.029,0.029,0.029,0.027,0.026],[0.248,0.034,0.032,0.031,0.030,0.029],[0.146,0.014,0.015,0.015,0.015,0.015],[0.113,0.026,0.026,0.026,0.025,0.026],[0.177,0.059,0.054,0.055,0.058,0.053],[0.221,0.109,0.114,0.107,0.116,0.112],[0.557,0.431,0.436,0.440,0.442,0.436],[0.546,0.410,0.421,0.393,0.394,0.395],[0.243,0.035,0.035,0.035,0.035,0.035],[0.115,0.014,0.014,0.014,0.015,0.014],[null,null,null,null,null,null],[2.236,0.218,0.216,0.216,0.221,0.220],[0.054,0.020,0.019,0.019,0.020,0.018],[2.152,0.263,0.271,0.269,0.268,0.268],[8.682,4.096,4.289,3.948,3.990,4.033],[6.421,2.367,2.325,2.279,2.359,2.295],[6.492,2.507,2.575,2.350,2.457,2.388],[9.969,4.956,4.941,4.950,5.091,5.093],[9.614,4.641,4.363,4.500,4.362,4.575],[6.282,2.724,2.709,2.718,2.710,2.696],[0.090,0.054,0.053,0.057,0.054,0.058],[13.110,6.870,6.637,6.935,7.540,6.548],[5.039,2.040,2.060,2.012,1.977,2.026],[3.891,1.221,1.151,1.208,1.135,1.140],[0.075,0.013,0.013,0.013,0.013,0.013],[0.072,0.011,0.010,0.011,0.011,0.010],[0.114,0.055,0.054,0.054,0.054,0.058],[0.107,0.045,0.046,0.051,0.046,0.046],[0.202,0.145,0.145,0.149,0.151,0.130],[0.311,0.237,0.252,0.239,0.237,0.240],[0.084,0.033,0.033,0.033,0.032,0.032],[0.071,0.013,0.011,0.013,0.012,0.012],[0.367,0.294,0.317,0.305,0.293,0.290],[0.470,0.365,0.376,0.385,0.368,0.373],[0.235,0.178,0.181,0.174,0.173,0.178],[0.257,0.195,0.196,0.192,0.195,0.192],[0.534,0.455,0.444,0.441,0.441,0.447],[0.661,0.549,0.553,0.557,0.552,0.555],[0.592,0.521,0.517,0.523,0.523,0.520],[0.497,0.445,0.430,0.429,0.437,0.433],[1.390,1.167,1.139,1.130,1.132,1.149],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.369,0.207,0.225,0.219,0.199,0.215],[1.495,0.641,0.621,0.621,0.641,0.632],[1.262,1.099,1.107,1.114,1.096,1.097],[1.720,1.686,1.635,1.633,1.629,1.658],[0.656,0.548,0.544,0.559,0.549,0.540],[0.942,0.701,0.687,0.681,0.704,0.696],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.079,0.010,0.010,0.010,0.010,0.010],[0.053,0.005,0.004,0.004,0.005,0.004],[0.910,0.066,0.065,0.066,0.066,0.064],[0.960,0.110,0.109,0.106,0.110,0.110],[0.257,0.063,0.061,0.066,0.068,0.071],[0.998,0.211,0.211,0.218,0.222,0.212],[0.516,0.046,0.048,0.047,0.046,0.047],[0.623,0.087,0.089,0.086,0.086,0.088],[0.675,0.146,0.135,0.133,0.136,0.137],[0.549,0.063,0.063,0.062,0.062,0.062],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.187,0.573,0.582,0.584,0.593,0.581],[0.878,0.058,0.062,0.063,0.062,0.064],[1.177,0.568,0.572,0.574,0.569,0.574],[6.003,4.199,4.188,4.222,4.145,4.144],[10.045,1.754,1.744,1.766,1.732,1.790],[5.989,3.588,3.651,3.593,3.580,3.672],[14.551,8.853,8.655,8.661,8.664,8.584],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.234,2.160,2.145,2.143,2.152,2.151],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"1.1.54394","source":"results/1.1.54394.json"} +,{"actual_version":"18.4.0","data_size":{"hits":14370063012,"job":1829577745,"mgbench":2955024633,"ontime":2701085816,"ssb":72845190154,"taxi":24198669895,"tpcds":18782670535,"tpch":17371348612,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":213,"job":26,"mgbench":56,"ontime":49,"ssb":1534,"taxi":937,"tpcds":261,"tpch":276,"uk":37},"machine":"c7a.4xlarge","release_date":"2018-07-20","result":[[0.209,0.020,0.020,0.022,0.022,0.021],[0.099,0.007,0.008,0.009,0.008,0.007],[0.241,0.017,0.017,0.016,0.018,0.018],[0.098,0.013,0.013,0.012,0.013,0.012],[0.091,0.028,0.039,0.027,0.027,0.028],[0.222,0.028,0.031,0.029,0.032,0.028],[0.136,0.015,0.014,0.014,0.014,0.015],[0.105,0.026,0.026,0.026,0.025,0.025],[0.167,0.054,0.056,0.055,0.065,0.057],[0.210,0.117,0.110,0.108,0.110,0.112],[0.526,0.418,0.422,0.422,0.420,0.413],[0.524,0.388,0.417,0.410,0.409,0.404],[0.250,0.035,0.034,0.034,0.033,0.034],[0.115,0.013,0.013,0.012,0.013,0.012],[null,null,null,null,null,null],[2.108,0.218,0.214,0.209,0.199,0.206],[0.065,0.018,0.018,0.019,0.018,0.019],[2.126,0.255,0.253,0.248,0.250,0.250],[8.158,3.963,4.049,4.422,3.886,3.933],[6.323,2.386,2.359,2.266,2.273,2.258],[6.407,2.695,2.467,2.338,2.423,2.400],[9.296,4.796,5.036,4.959,5.901,4.978],[9.192,4.334,4.332,4.357,4.315,4.340],[6.221,2.761,2.679,2.688,2.842,2.642],[0.097,0.055,0.051,0.053,0.053,0.055],[12.494,6.733,6.511,6.444,6.621,6.727],[4.658,2.093,2.143,2.065,2.049,1.991],[3.691,1.147,1.165,1.164,1.102,1.142],[0.031,0.012,0.013,0.013,0.012,0.012],[0.027,0.010,0.010,0.010,0.010,0.011],[0.069,0.052,0.053,0.051,0.052,0.051],[0.082,0.043,0.042,0.044,0.042,0.046],[0.176,0.150,0.147,0.143,0.134,0.144],[0.265,0.225,0.235,0.235,0.219,0.237],[0.049,0.031,0.036,0.032,0.032,0.031],[0.025,0.012,0.011,0.011,0.011,0.010],[0.343,0.299,0.291,0.307,0.318,0.309],[0.419,0.358,0.373,0.372,0.369,0.362],[0.187,0.163,0.165,0.168,0.162,0.165],[0.203,0.179,0.185,0.186,0.182,0.180],[0.475,0.431,0.424,0.421,0.430,0.418],[0.592,0.531,0.530,0.532,0.546,0.532],[0.540,0.504,0.503,0.506,0.505,0.510],[0.457,0.440,0.449,0.435,0.441,0.437],[1.302,1.142,1.136,1.135,1.135,1.138],[0.711,0.722,0.814,0.715,0.781,0.687],[3.673,2.522,2.569,2.573,2.540,2.501],[0.080,0.047,0.048,0.046,0.046,0.045],[1.399,0.455,0.461,0.453,0.461,0.460],[1.749,0.662,0.666,0.664,0.675,0.666],[4.045,1.501,1.500,1.533,1.487,1.488],[3.082,0.572,0.564,0.568,0.552,0.551],[0.286,0.217,0.193,0.198,0.213,0.198],[0.215,0.189,0.202,0.222,0.191,0.190],[0.325,0.205,0.216,0.207,0.202,0.215],[1.426,0.599,0.597,0.588,0.594,0.600],[1.184,1.074,1.089,1.090,1.082,1.097],[2.038,1.668,1.711,2.103,1.634,1.655],[0.561,0.510,0.507,0.508,0.500,0.509],[0.906,0.667,0.652,0.679,0.683,0.664],[3.862,3.496,3.390,3.398,3.390,3.391],[2.093,2.140,1.799,1.758,1.784,1.760],[2.088,1.781,1.776,1.794,1.770,1.790],[0.878,0.852,0.854,0.861,0.856,0.847],[0.115,0.068,0.070,0.067,0.065,0.078],[0.066,0.042,0.039,0.041,0.046,0.043],[0.076,0.029,0.031,0.032,0.031,0.029],[0.236,0.147,0.144,0.146,0.142,0.146],[0.047,0.009,0.009,0.010,0.010,0.010],[0.038,0.008,0.008,0.009,0.008,0.008],[0.022,0.003,0.003,0.003,0.003,0.003],[0.956,0.065,0.063,0.064,0.067,0.064],[1.006,0.104,0.105,0.105,0.106,0.106],[0.242,0.067,0.061,0.060,0.066,0.062],[1.061,0.212,0.208,0.211,0.209,0.205],[0.536,0.046,0.045,0.046,0.046,0.045],[0.648,0.086,0.083,0.087,0.087,0.088],[0.701,0.136,0.138,0.133,0.135,0.138],[0.584,0.063,0.063,0.067,0.062,0.066],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.208,0.575,0.562,0.563,0.556,0.560],[0.876,0.057,0.057,0.063,0.061,0.058],[1.224,0.575,0.570,0.579,0.573,0.575],[6.435,4.080,4.091,4.086,4.087,4.069],[9.987,1.723,1.747,1.710,1.695,1.717],[5.707,3.584,3.599,3.702,3.522,3.564],[14.255,8.773,8.775,8.714,8.920,8.773],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.246,2.147,2.136,2.152,2.159,2.145],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"18.1.0","source":"results/18.1.0.json"} +,{"actual_version":"18.4.0","data_size":{"hits":14373217648,"job":1829561723,"mgbench":2954036882,"ontime":2701085816,"ssb":72845051057,"taxi":24198695713,"tpcds":18790083877,"tpch":17370873666,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":205,"job":23,"mgbench":57,"ontime":50,"ssb":1547,"taxi":934,"tpcds":263,"tpch":266,"uk":36},"machine":"c7a.4xlarge","release_date":"2018-07-28","result":[[0.201,0.022,0.023,0.022,0.022,0.021],[0.096,0.008,0.007,0.008,0.008,0.007],[0.300,0.018,0.018,0.018,0.017,0.017],[0.102,0.012,0.011,0.012,0.011,0.013],[0.113,0.029,0.029,0.028,0.026,0.025],[0.274,0.029,0.031,0.029,0.031,0.028],[0.134,0.014,0.014,0.014,0.014,0.014],[0.106,0.027,0.026,0.025,0.025,0.025],[0.162,0.058,0.055,0.057,0.052,0.059],[0.201,0.109,0.111,0.110,0.106,0.112],[0.527,0.419,0.419,0.421,0.421,0.415],[0.548,0.403,0.399,0.404,0.400,0.409],[0.223,0.034,0.034,0.034,0.034,0.034],[0.101,0.013,0.013,0.014,0.013,0.012],[null,null,null,null,null,null],[1.767,0.201,0.208,0.211,0.207,0.209],[0.055,0.018,0.018,0.018,0.017,0.018],[1.826,0.248,0.248,0.254,0.252,0.249],[7.829,4.125,4.003,4.125,4.010,4.044],[6.088,2.482,2.302,2.410,2.327,2.536],[6.071,2.448,2.368,2.664,2.294,2.473],[8.987,4.835,4.990,4.935,4.817,5.617],[8.769,4.429,4.347,4.286,4.611,4.422],[6.076,2.717,2.716,2.670,2.793,2.738],[0.106,0.053,0.056,0.054,0.053,0.057],[11.933,6.545,6.919,6.545,6.714,6.563],[4.274,2.042,2.100,2.043,2.112,2.046],[3.407,1.132,1.361,1.201,1.252,1.176],[0.048,0.015,0.014,0.014,0.014,0.013],[0.045,0.012,0.012,0.011,0.012,0.012],[0.091,0.054,0.057,0.053,0.054,0.054],[0.096,0.049,0.044,0.046,0.044,0.042],[0.188,0.134,0.148,0.135,0.139,0.145],[0.285,0.232,0.220,0.222,0.217,0.234],[0.059,0.031,0.033,0.032,0.037,0.031],[0.042,0.012,0.012,0.012,0.013,0.012],[0.357,0.305,0.308,0.333,0.280,0.312],[0.430,0.366,0.373,0.372,0.375,0.360],[0.197,0.165,0.168,0.161,0.161,0.162],[0.219,0.180,0.178,0.179,0.182,0.183],[0.501,0.428,0.432,0.427,0.428,0.431],[0.598,0.547,0.522,0.545,0.538,0.550],[0.564,0.512,0.503,0.510,0.519,0.518],[0.480,0.432,0.447,0.419,0.430,0.422],[1.373,1.159,1.156,1.144,1.135,1.141],[0.791,0.711,0.865,0.709,0.824,0.822],[3.737,2.555,2.512,2.538,2.520,2.540],[0.110,0.046,0.046,0.048,0.050,0.045],[1.442,0.461,0.460,0.467,0.459,0.468],[1.748,0.652,0.660,0.667,0.651,0.649],[4.085,1.495,1.501,1.488,1.518,1.495],[3.230,0.583,0.579,0.583,0.581,0.573],[0.345,0.235,0.201,0.215,0.213,0.195],[0.257,0.195,0.188,0.182,0.204,0.184],[0.316,0.198,0.199,0.212,0.205,0.227],[1.452,0.598,0.606,0.606,0.601,0.594],[1.226,1.079,1.095,1.087,1.086,1.093],[2.095,1.685,2.027,1.726,1.657,1.636],[0.581,0.528,0.529,0.530,0.527,0.522],[0.996,0.678,0.674,0.684,0.673,0.676],[3.934,3.558,3.417,3.391,3.379,3.458],[2.102,1.896,1.929,1.809,2.166,1.958],[2.169,1.945,1.769,1.752,1.773,1.759],[0.890,0.853,0.855,0.845,0.835,0.828],[0.115,0.065,0.068,0.066,0.066,0.067],[0.066,0.042,0.042,0.044,0.043,0.042],[0.077,0.027,0.030,0.029,0.032,0.030],[0.227,0.145,0.145,0.148,0.144,0.143],[0.049,0.010,0.010,0.009,0.010,0.009],[0.037,0.009,0.008,0.008,0.008,0.008],[0.023,0.003,0.003,0.003,0.003,0.003],[0.889,0.064,0.063,0.062,0.064,0.066],[0.850,0.102,0.104,0.105,0.106,0.103],[0.220,0.061,0.065,0.059,0.062,0.065],[0.969,0.208,0.206,0.207,0.212,0.209],[0.476,0.046,0.047,0.044,0.045,0.043],[0.582,0.085,0.084,0.087,0.094,0.084],[0.654,0.133,0.131,0.133,0.135,0.135],[0.543,0.064,0.062,0.062,0.063,0.060],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.120,0.565,0.559,0.561,0.573,0.555],[0.812,0.057,0.067,0.060,0.059,0.062],[1.169,0.571,0.585,0.569,0.580,0.573],[5.716,4.113,4.402,4.096,4.110,4.097],[9.747,1.709,1.715,1.719,1.707,1.706],[5.210,3.579,3.527,3.542,3.599,3.581],[14.030,8.746,8.795,8.772,8.932,8.854],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.228,2.139,2.133,2.138,2.130,2.122],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"18.4.0","source":"results/18.4.0.json"} +,{"actual_version":"18.5.1","data_size":{"hits":14444826446,"job":1829577745,"mgbench":2955417842,"ontime":2701085816,"ssb":72845772466,"taxi":24198666730,"tpcds":18801628561,"tpch":17370953245,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":220,"job":23,"mgbench":56,"ontime":52,"ssb":1547,"taxi":937,"tpcds":266,"tpch":276,"uk":37},"machine":"c7a.4xlarge","release_date":"2018-07-31","result":[[0.175,0.022,0.024,0.021,0.020,0.021],[0.084,0.008,0.008,0.008,0.008,0.009],[0.177,0.019,0.019,0.021,0.018,0.017],[0.088,0.011,0.012,0.011,0.012,0.011],[0.083,0.027,0.029,0.025,0.026,0.029],[0.228,0.027,0.030,0.030,0.031,0.029],[0.109,0.014,0.014,0.015,0.014,0.014],[0.090,0.026,0.026,0.025,0.026,0.025],[0.148,0.058,0.054,0.057,0.054,0.058],[0.182,0.114,0.112,0.112,0.113,0.113],[0.509,0.424,0.426,0.429,0.423,0.420],[0.495,0.402,0.390,0.402,0.392,0.396],[0.209,0.035,0.035,0.035,0.035,0.035],[0.093,0.014,0.014,0.013,0.014,0.013],[null,null,null,null,null,null],[1.677,0.211,0.211,0.214,0.215,0.212],[0.043,0.019,0.018,0.019,0.018,0.019],[1.831,0.259,0.257,0.257,0.266,0.257],[7.855,4.014,4.124,3.938,3.884,4.417],[6.039,2.292,2.333,2.338,2.294,2.251],[6.041,2.425,2.428,2.388,2.534,2.363],[8.916,5.055,5.105,5.022,4.902,5.346],[8.941,4.484,4.994,4.535,4.302,4.594],[5.863,2.898,2.820,2.802,2.862,2.825],[0.105,0.057,0.061,0.061,0.061,0.058],[12.443,7.303,7.871,7.309,7.047,7.606],[4.487,2.123,2.139,2.323,2.325,2.123],[3.449,1.236,1.208,1.151,1.154,1.145],[0.060,0.014,0.014,0.014,0.015,0.013],[0.056,0.011,0.012,0.011,0.012,0.011],[0.107,0.058,0.058,0.058,0.059,0.056],[0.084,0.051,0.050,0.051,0.047,0.055],[0.194,0.153,0.147,0.139,0.146,0.144],[0.317,0.242,0.243,0.247,0.240,0.241],[0.074,0.034,0.033,0.034,0.035,0.033],[0.058,0.014,0.012,0.013,0.012,0.012],[0.370,0.325,0.315,0.295,0.317,0.300],[0.490,0.416,0.406,0.417,0.423,0.427],[0.225,0.179,0.177,0.175,0.176,0.174],[0.244,0.200,0.197,0.191,0.195,0.199],[0.544,0.470,0.472,0.467,0.463,0.466],[0.670,0.580,0.593,0.575,0.572,0.573],[0.606,0.537,0.555,0.544,0.555,0.549],[0.507,0.464,0.449,0.463,0.475,0.479],[1.469,1.276,1.273,1.335,1.251,1.226],[0.843,0.824,0.973,0.863,0.799,1.140],[3.921,2.828,3.338,3.147,2.787,2.743],[0.093,0.054,0.054,0.053,0.053,0.053],[1.453,0.508,0.521,0.513,0.508,0.517],[1.793,0.795,0.791,0.808,0.787,0.796],[4.123,1.702,1.707,1.697,1.710,1.719],[3.611,0.624,0.615,0.626,0.624,0.622],[0.291,0.248,0.262,0.247,0.236,0.239],[0.271,0.212,0.208,0.202,0.204,0.204],[0.290,0.223,0.211,0.225,0.234,0.211],[1.451,0.628,0.630,0.688,0.713,0.714],[1.313,1.189,1.197,1.186,1.203,1.194],[1.912,1.882,2.100,2.046,2.211,1.830],[0.624,0.540,0.536,0.536,0.541,0.543],[0.909,0.711,0.704,0.716,0.720,0.691],[3.929,3.578,3.449,3.426,3.419,3.452],[2.157,2.189,2.034,1.960,1.888,1.946],[2.200,2.113,1.847,1.846,1.965,2.119],[0.948,0.915,0.904,0.847,0.867,0.853],[0.138,0.056,0.052,0.066,0.063,0.062],[0.099,0.036,0.035,0.039,0.033,0.036],[0.101,0.029,0.030,0.024,0.027,0.027],[0.206,0.110,0.108,0.112,0.109,0.107],[0.070,0.010,0.009,0.009,0.009,0.009],[0.070,0.008,0.008,0.008,0.008,0.009],[0.063,0.005,0.005,0.005,0.005,0.005],[0.727,0.066,0.064,0.065,0.064,0.068],[0.835,0.105,0.106,0.107,0.107,0.109],[0.214,0.065,0.065,0.061,0.066,0.061],[0.918,0.207,0.206,0.206,0.201,0.207],[0.449,0.046,0.046,0.046,0.045,0.046],[0.533,0.090,0.086,0.088,0.090,0.088],[0.588,0.144,0.145,0.146,0.138,0.142],[0.492,0.064,0.065,0.064,0.065,0.064],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.142,0.624,0.620,0.614,0.627,0.617],[0.747,0.064,0.061,0.063,0.064,0.069],[1.164,0.622,0.618,0.627,0.618,0.616],[5.857,4.433,4.447,4.539,4.225,4.287],[9.707,1.812,1.832,1.816,1.832,1.824],[5.515,3.746,3.743,3.694,3.632,3.651],[13.934,9.184,9.097,9.125,9.054,9.167],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.341,2.296,2.305,2.295,2.295,2.300],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"18.5.1","source":"results/18.5.1.json"} +,{"actual_version":"18.6.0","data_size":{"hits":14370063012,"job":1829565517,"mgbench":2955417842,"ontime":2701085816,"ssb":72845891304,"taxi":24198670500,"tpcds":18826222852,"tpch":17370979567,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":226,"job":25,"mgbench":59,"ontime":49,"ssb":1557,"taxi":933,"tpcds":277,"tpch":280,"uk":36},"machine":"c7a.4xlarge","release_date":"2018-08-01","result":[[0.181,0.020,0.021,0.022,0.020,0.020],[0.083,0.008,0.008,0.009,0.008,0.008],[0.183,0.019,0.019,0.017,0.018,0.016],[0.091,0.011,0.010,0.011,0.012,0.011],[0.083,0.024,0.027,0.025,0.028,0.029],[0.215,0.031,0.030,0.028,0.028,0.030],[0.105,0.014,0.017,0.014,0.014,0.015],[0.088,0.028,0.025,0.026,0.026,0.025],[0.139,0.055,0.052,0.057,0.055,0.056],[0.174,0.106,0.107,0.106,0.105,0.116],[0.517,0.424,0.420,0.427,0.427,0.426],[0.487,0.402,0.417,0.407,0.416,0.417],[0.210,0.038,0.036,0.036,0.035,0.036],[0.091,0.014,0.015,0.012,0.014,0.013],[null,null,null,null,null,null],[1.742,0.218,0.223,0.220,0.218,0.222],[0.065,0.019,0.019,0.019,0.021,0.020],[1.714,0.275,0.278,0.273,0.280,0.273],[7.881,4.068,4.099,4.067,4.979,4.155],[5.995,2.279,2.345,2.312,2.303,2.306],[6.050,2.428,2.338,2.320,2.351,2.309],[8.889,5.140,5.514,5.029,4.942,5.150],[8.980,4.545,4.496,4.723,4.549,4.369],[5.889,2.876,2.785,2.743,2.683,2.679],[0.096,0.051,0.054,0.055,0.052,0.056],[11.790,7.140,6.497,7.013,7.209,7.309],[4.285,1.979,1.997,2.192,1.969,2.152],[3.379,1.122,1.136,1.159,1.172,1.156],[0.025,0.014,0.013,0.012,0.012,0.012],[0.026,0.011,0.010,0.011,0.011,0.011],[0.072,0.056,0.056,0.055,0.052,0.053],[0.063,0.049,0.047,0.047,0.048,0.053],[0.171,0.136,0.142,0.143,0.146,0.134],[0.258,0.239,0.227,0.236,0.215,0.235],[0.045,0.032,0.033,0.034,0.033,0.032],[0.025,0.012,0.012,0.011,0.012,0.012],[0.333,0.298,0.309,0.293,0.298,0.310],[0.410,0.375,0.375,0.373,0.366,0.377],[0.195,0.175,0.178,0.182,0.179,0.171],[0.215,0.190,0.189,0.194,0.189,0.192],[0.481,0.435,0.434,0.433,0.430,0.436],[0.592,0.541,0.531,0.532,0.541,0.544],[0.536,0.506,0.510,0.520,0.526,0.515],[0.466,0.448,0.443,0.437,0.447,0.443],[1.366,1.239,1.145,1.150,1.143,1.229],[0.767,0.833,0.779,0.724,0.704,0.819],[3.631,2.630,3.035,2.593,2.557,2.535],[0.068,0.049,0.050,0.050,0.050,0.049],[1.405,0.463,0.474,0.476,0.468,0.475],[1.741,0.696,0.707,0.706,0.700,0.715],[4.050,1.534,1.539,1.524,1.521,1.517],[3.036,0.557,0.556,0.553,0.559,0.563],[0.255,0.209,0.230,0.204,0.206,0.209],[0.215,0.193,0.190,0.201,0.191,0.191],[0.252,0.214,0.236,0.217,0.209,0.212],[1.416,0.611,0.608,0.622,0.608,0.609],[1.185,1.079,1.102,1.088,1.102,1.094],[1.735,2.089,1.803,1.753,1.735,1.735],[0.580,0.526,0.888,0.525,0.535,0.516],[0.791,0.669,0.723,0.678,0.680,0.684],[3.872,3.598,3.475,3.451,3.448,3.455],[2.092,2.348,1.844,1.790,1.950,1.861],[2.109,1.812,1.817,1.815,1.829,1.833],[0.889,0.882,0.882,0.864,0.874,0.865],[0.110,0.066,0.069,0.067,0.079,0.064],[0.071,0.042,0.041,0.045,0.038,0.041],[0.066,0.031,0.028,0.030,0.031,0.030],[0.211,0.148,0.143,0.145,0.147,0.143],[0.045,0.010,0.010,0.010,0.010,0.009],[0.037,0.008,0.008,0.009,0.009,0.008],[0.023,0.003,0.003,0.003,0.003,0.003],[0.735,0.065,0.064,0.064,0.069,0.066],[0.829,0.108,0.108,0.107,0.109,0.107],[0.218,0.067,0.061,0.065,0.061,0.062],[0.923,0.208,0.209,0.209,0.208,0.207],[0.459,0.045,0.046,0.046,0.047,0.047],[0.559,0.094,0.090,0.089,0.088,0.088],[0.581,0.136,0.137,0.137,0.141,0.135],[0.465,0.060,0.065,0.067,0.062,0.067],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.075,0.562,0.560,0.554,0.558,0.565],[0.734,0.063,0.061,0.059,0.057,0.061],[1.099,0.572,0.577,0.575,0.583,0.582],[5.613,4.289,4.143,4.151,4.125,4.128],[9.625,1.853,1.764,1.760,1.769,1.774],[5.467,3.563,3.642,3.641,3.588,3.606],[13.669,8.744,8.718,8.849,8.982,8.863],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.277,2.228,2.213,2.207,2.208,2.216],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"18.6.0","source":"results/18.6.0.json"} +,{"actual_version":"18.12.17","data_size":{"hits":14406213516,"job":1829571991,"mgbench":2955417842,"ontime":2701085816,"ssb":72845853136,"taxi":24198687672,"tpcds":18814863501,"tpch":17371418006,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":240,"job":23,"mgbench":57,"ontime":47,"ssb":1431,"taxi":867,"tpcds":268,"tpch":272,"uk":32},"machine":"c7a.4xlarge","release_date":"2018-09-16","result":[[0.163,0.041,0.022,0.021,0.017,0.023],[0.065,0.007,0.007,0.007,0.007,0.008],[0.150,0.017,0.016,0.017,0.018,0.017],[0.077,0.012,0.011,0.011,0.010,0.011],[0.069,0.024,0.023,0.024,0.023,0.024],[0.156,0.029,0.028,0.029,0.030,0.026],[0.107,0.011,0.011,0.011,0.012,0.012],[0.084,0.022,0.023,0.022,0.022,0.022],[0.124,0.040,0.042,0.040,0.040,0.041],[0.183,0.102,0.097,0.093,0.093,0.098],[0.584,0.468,0.462,0.460,0.464,0.455],[0.614,0.411,0.404,0.403,0.407,0.394],[0.199,0.025,0.026,0.026,0.026,0.025],[0.093,0.014,0.019,0.013,0.013,0.012],[1.182,0.985,1.002,0.998,0.989,0.998],[1.450,0.158,0.151,0.156,0.149,0.156],[0.055,0.018,0.019,0.020,0.019,0.019],[1.622,0.152,0.149,0.149,0.145,0.152],[7.750,1.786,1.784,1.794,1.808,1.903],[5.923,1.372,1.372,1.361,1.376,1.368],[5.943,1.400,1.411,1.386,1.416,1.401],[7.323,2.457,2.440,2.479,2.434,2.425],[8.339,2.189,2.171,2.155,2.152,2.131],[5.719,1.979,1.978,1.968,1.984,1.968],[0.082,0.046,0.052,0.049,0.050,0.051],[9.186,2.569,2.552,2.556,2.518,2.538],[3.335,1.090,1.098,1.062,1.044,1.069],[3.305,0.769,0.749,0.750,0.742,0.739],[0.056,0.017,0.017,0.016,0.017,0.015],[0.055,0.013,0.015,0.015,0.016,0.013],[0.103,0.066,0.061,0.061,0.065,0.062],[0.078,0.037,0.036,0.038,0.037,0.039],[0.181,0.141,0.139,0.140,0.121,0.137],[0.265,0.202,0.208,0.184,0.204,0.209],[0.071,0.039,0.035,0.035,0.044,0.036],[0.051,0.014,0.013,0.017,0.022,0.014],[0.345,0.288,0.306,0.283,0.282,0.295],[0.411,0.357,0.357,0.368,0.348,0.348],[0.171,0.123,0.125,0.127,0.130,0.127],[0.182,0.139,0.141,0.139,0.134,0.135],[0.480,0.399,0.397,0.410,0.400,0.386],[0.575,0.494,0.503,0.499,0.496,0.518],[0.521,0.458,0.454,0.445,0.447,0.467],[0.468,0.439,0.427,0.428,0.436,0.426],[1.199,1.087,1.110,1.088,1.094,1.099],[0.870,0.851,0.777,0.741,0.733,0.728],[2.586,2.382,2.452,2.491,2.463,2.396],[0.073,0.035,0.051,0.026,0.026,0.025],[1.453,0.424,0.422,0.442,0.422,0.411],[1.782,0.446,0.437,0.437,0.440,0.438],[4.084,1.245,1.229,1.221,1.238,1.223],[3.344,0.558,0.537,0.536,0.537,0.516],[0.242,0.198,0.202,0.199,0.173,0.199],[0.210,0.169,0.172,0.145,0.181,0.166],[0.238,0.191,0.198,0.201,0.192,0.189],[1.455,0.501,0.476,0.476,0.478,0.482],[1.176,0.827,0.826,0.802,0.815,0.816],[1.819,1.727,1.733,1.724,1.722,1.732],[0.515,0.454,0.451,0.435,0.437,0.454],[0.697,0.578,0.592,0.593,0.596,0.570],[3.663,3.346,3.427,3.562,3.569,3.547],[2.163,1.829,1.823,1.803,1.815,1.833],[2.175,1.805,1.784,1.751,1.762,1.809],[0.922,0.820,0.841,0.827,0.831,0.834],[0.115,0.054,0.052,0.054,0.058,0.050],[0.066,0.024,0.026,0.029,0.024,0.023],[0.087,0.026,0.021,0.021,0.027,0.021],[0.203,0.104,0.105,0.101,0.094,0.095],[0.056,0.010,0.009,0.009,0.008,0.008],[0.053,0.008,0.008,0.008,0.009,0.008],[0.036,0.005,0.004,0.004,0.004,0.004],[0.714,0.058,0.069,0.060,0.076,0.073],[0.768,0.106,0.112,0.100,0.103,0.116],[0.219,0.063,0.056,0.060,0.054,0.056],[0.841,0.158,0.157,0.164,0.157,0.161],[0.450,0.044,0.037,0.041,0.040,0.041],[0.513,0.076,0.079,0.077,0.070,0.078],[0.557,0.113,0.116,0.114,0.119,0.122],[0.473,0.052,0.052,0.048,0.056,0.050],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.065,0.510,0.513,0.501,0.494,0.494],[0.727,0.077,0.077,0.075,0.076,0.076],[1.066,0.499,0.490,0.490,0.490,0.481],[4.165,2.676,2.670,2.638,2.652,2.630],[9.731,1.622,1.595,1.592,1.604,1.610],[3.882,2.466,2.461,2.499,2.513,2.487],[13.872,6.536,6.515,6.557,6.554,6.543],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.367,1.294,1.286,1.292,1.290,1.289],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"18.12.17","source":"results/18.12.17.json"} +,{"actual_version":"18.14.19","data_size":{"hits":14394791316,"job":1829571991,"mgbench":2955024633,"ontime":2701085816,"ssb":72846158313,"taxi":24198700237,"tpcds":18794822787,"tpch":17371147829,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":231,"job":23,"mgbench":55,"ontime":47,"ssb":1424,"taxi":863,"tpcds":262,"tpch":267,"uk":33},"machine":"c7a.4xlarge","release_date":"2018-12-19","result":[[0.162,0.021,0.021,0.025,0.019,0.019],[0.060,0.007,0.007,0.007,0.007,0.007],[0.144,0.021,0.019,0.017,0.016,0.016],[0.070,0.011,0.012,0.010,0.010,0.011],[0.072,0.026,0.020,0.021,0.023,0.022],[0.150,0.026,0.025,0.030,0.026,0.028],[0.101,0.012,0.013,0.011,0.011,0.011],[0.083,0.022,0.024,0.022,0.021,0.022],[0.124,0.042,0.037,0.043,0.038,0.039],[0.183,0.091,0.086,0.083,0.083,0.098],[0.560,0.443,0.449,0.451,0.446,0.447],[0.616,0.397,0.414,0.394,0.408,0.394],[0.189,0.026,0.026,0.026,0.026,0.025],[0.093,0.012,0.015,0.013,0.012,0.012],[1.132,0.934,0.940,0.958,0.954,0.938],[1.485,0.152,0.145,0.143,0.141,0.142],[0.044,0.018,0.020,0.019,0.022,0.018],[1.581,0.140,0.134,0.133,0.130,0.131],[7.726,1.727,1.742,1.701,1.734,1.709],[5.888,1.344,1.339,1.338,1.329,1.352],[5.973,1.366,1.352,1.376,1.395,1.384],[7.380,2.032,2.056,2.055,2.058,2.076],[8.334,1.767,1.726,1.770,1.726,1.710],[5.678,1.803,1.806,1.809,1.817,1.818],[0.090,0.047,0.049,0.046,0.047,0.047],[9.204,2.446,2.452,2.462,2.447,2.446],[3.242,0.966,0.976,0.961,0.942,0.961],[3.360,0.665,0.631,0.625,0.626,0.632],[0.049,0.015,0.014,0.015,0.017,0.014],[0.049,0.013,0.014,0.014,0.013,0.012],[0.095,0.060,0.058,0.059,0.059,0.057],[0.086,0.039,0.041,0.040,0.040,0.038],[0.182,0.146,0.149,0.148,0.143,0.144],[0.258,0.197,0.217,0.206,0.205,0.205],[0.071,0.038,0.040,0.042,0.039,0.037],[0.047,0.012,0.022,0.017,0.013,0.017],[0.327,0.294,0.291,0.282,0.276,0.293],[0.409,0.340,0.341,0.331,0.338,0.346],[0.162,0.123,0.129,0.123,0.124,0.123],[0.175,0.138,0.135,0.137,0.135,0.135],[0.485,0.413,0.417,0.411,0.391,0.395],[0.559,0.505,0.534,0.502,0.493,0.526],[0.510,0.459,0.462,0.449,0.440,0.447],[0.482,0.463,0.417,0.423,0.430,0.447],[1.196,1.111,1.103,1.089,1.088,1.098],[0.799,0.765,0.802,0.751,0.776,0.741],[2.635,2.416,2.421,2.462,2.529,2.535],[0.082,0.036,0.034,0.031,0.031,0.025],[1.432,0.390,0.401,0.395,0.381,0.384],[1.778,0.437,0.426,0.428,0.430,0.438],[4.073,1.193,1.174,1.186,1.168,1.176],[3.160,0.511,0.502,0.515,0.473,0.484],[0.218,0.191,0.198,0.200,0.201,0.190],[0.208,0.155,0.177,0.190,0.170,0.167],[0.205,0.195,0.193,0.193,0.189,0.190],[1.430,0.497,0.479,0.483,0.481,0.476],[1.143,0.826,0.820,0.810,0.815,0.818],[1.694,1.640,1.633,1.633,1.639,1.622],[0.493,0.433,0.433,0.445,0.432,0.454],[0.715,0.602,0.591,0.585,0.590,0.601],[3.674,3.337,3.440,3.586,3.554,3.574],[2.174,1.883,1.863,1.834,1.833,1.853],[2.151,1.844,1.846,1.819,1.819,1.805],[0.896,0.822,0.811,0.777,0.830,0.818],[0.122,0.063,0.063,0.062,0.067,0.064],[0.066,0.030,0.029,0.028,0.031,0.031],[0.080,0.028,0.024,0.023,0.024,0.024],[0.259,0.138,0.141,0.132,0.142,0.125],[0.052,0.010,0.010,0.010,0.011,0.010],[0.044,0.008,0.008,0.008,0.008,0.008],[0.032,0.004,0.004,0.004,0.004,0.004],[0.710,0.054,0.064,0.063,0.055,0.070],[0.734,0.105,0.096,0.108,0.097,0.105],[0.202,0.053,0.055,0.056,0.059,0.060],[0.783,0.162,0.154,0.166,0.152,0.154],[0.402,0.040,0.050,0.044,0.041,0.034],[0.507,0.082,0.075,0.071,0.073,0.072],[0.500,0.114,0.112,0.115,0.114,0.116],[0.427,0.049,0.053,0.047,0.048,0.049],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.964,0.466,0.463,0.459,0.458,0.468],[0.712,0.083,0.074,0.067,0.076,0.073],[1.050,0.490,0.471,0.471,0.463,0.468],[3.981,2.504,2.521,2.511,2.488,2.486],[9.654,1.543,1.536,1.542,1.541,1.547],[3.646,2.378,2.376,2.375,2.354,2.363],[13.956,5.966,6.003,6.019,5.911,6.031],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.336,1.248,1.233,1.243,1.247,1.224],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"18.14.19","source":"results/18.14.19.json"} +,{"actual_version":"18.16.1","data_size":{"hits":14415656123,"job":1829573347,"mgbench":2955417842,"ontime":2701085816,"ssb":72845595899,"taxi":24198676285,"tpcds":18787777834,"tpch":17370953336,"uk":783724604},"kind":"versions-benchmark","load_time":{"hits":232,"job":22,"mgbench":57,"ontime":48,"ssb":1423,"taxi":874,"tpcds":271,"tpch":272,"uk":34},"machine":"c7a.4xlarge","release_date":"2018-12-21","result":[[0.172,0.340,0.027,0.028,0.026,0.028],[0.067,0.036,0.009,0.011,0.011,0.010],[0.155,0.038,0.025,0.029,0.026,0.026],[0.076,0.029,0.016,0.015,0.014,0.014],[0.075,0.029,0.026,0.025,0.029,0.028],[0.166,0.037,0.036,0.040,0.037,0.043],[0.119,0.016,0.016,0.016,0.017,0.015],[0.091,0.044,0.025,0.027,0.026,0.026],[0.148,0.045,0.055,0.043,0.047,0.045],[0.202,0.120,0.114,0.116,0.119,0.114],[0.592,0.524,0.528,0.513,0.526,0.523],[0.608,0.464,0.491,0.458,0.481,0.464],[0.194,0.029,0.029,0.031,0.030,0.031],[0.096,0.018,0.015,0.015,0.016,0.016],[1.121,0.961,0.951,0.950,0.942,0.942],[1.570,0.171,0.159,0.167,0.158,0.160],[0.059,0.038,0.025,0.025,0.028,0.025],[1.436,0.178,0.167,0.168,0.163,0.155],[7.601,1.746,1.740,1.762,1.718,1.737],[5.901,1.371,1.351,1.359,1.363,1.362],[5.947,1.392,1.395,1.393,1.395,1.507],[7.301,2.020,2.028,2.024,2.010,2.009],[8.333,1.765,1.726,1.714,1.696,1.691],[5.737,1.794,1.796,1.786,1.754,1.782],[0.094,0.072,0.058,0.059,0.063,0.064],[9.194,2.444,2.407,2.386,2.364,2.374],[3.316,0.976,0.953,0.961,0.972,0.965],[3.282,0.668,0.660,0.674,0.663,0.665],[0.073,0.023,0.024,0.023,0.022,0.024],[0.070,0.020,0.019,0.018,0.020,0.021],[0.123,0.069,0.070,0.073,0.069,0.066],[0.098,0.044,0.048,0.045,0.047,0.046],[0.200,0.158,0.129,0.139,0.148,0.127],[0.282,0.227,0.214,0.225,0.205,0.223],[0.084,0.042,0.043,0.041,0.041,0.040],[0.062,0.019,0.018,0.019,0.019,0.020],[0.382,0.319,0.322,0.317,0.302,0.329],[0.452,0.388,0.389,0.391,0.385,0.394],[0.197,0.135,0.148,0.142,0.147,0.143],[0.216,0.163,0.167,0.167,0.157,0.161],[0.536,0.422,0.441,0.430,0.416,0.420],[0.635,0.550,0.546,0.559,0.542,0.577],[0.584,0.517,0.502,0.502,0.525,0.524],[0.528,0.508,0.492,0.497,0.488,0.507],[1.322,1.205,1.195,1.206,1.165,1.188],[0.916,0.848,0.838,0.812,0.705,0.864],[2.694,2.496,2.579,2.573,2.487,2.538],[0.204,0.089,0.051,0.046,0.034,0.038],[1.469,0.420,0.413,0.424,0.418,0.421],[1.784,0.451,0.455,0.448,0.455,0.447],[4.103,1.219,1.199,1.192,1.209,1.193],[4.802,0.822,0.780,0.762,0.753,0.754],[0.317,0.248,0.261,0.257,0.261,0.259],[0.278,0.216,0.215,0.207,0.214,0.206],[0.306,0.239,0.236,0.225,0.235,0.232],[1.447,0.496,0.496,0.497,0.493,0.494],[1.161,0.842,0.836,0.822,0.836,0.828],[1.731,1.661,1.662,1.680,1.655,1.673],[0.574,0.491,0.522,0.509,0.501,0.509],[0.777,0.669,0.663,0.653,0.651,0.643],[3.760,3.544,3.550,3.581,3.565,3.557],[2.193,1.846,1.833,1.843,1.812,1.842],[2.213,1.860,1.827,1.825,1.794,1.875],[0.974,0.909,0.912,0.921,0.883,0.873],[0.139,0.086,0.079,0.074,0.083,0.091],[0.089,0.052,0.043,0.041,0.041,0.041],[0.097,0.041,0.029,0.028,0.030,0.027],[0.301,0.212,0.188,0.186,0.185,0.188],[0.073,0.026,0.013,0.013,0.014,0.013],[0.063,0.022,0.011,0.011,0.014,0.011],[0.047,0.021,0.005,0.011,0.005,0.005],[0.758,0.071,0.076,0.073,0.077,0.073],[0.778,0.125,0.121,0.110,0.113,0.117],[0.239,0.064,0.063,0.063,0.069,0.066],[0.836,0.165,0.165,0.167,0.162,0.165],[0.432,0.046,0.038,0.038,0.036,0.037],[0.523,0.090,0.084,0.085,0.080,0.079],[0.560,0.137,0.132,0.139,0.136,0.129],[0.472,0.060,0.060,0.057,0.051,0.063],[0.529,0.126,0.102,0.101,0.098,0.096],[0.648,0.212,0.194,0.196,0.199,0.195],[0.980,0.248,0.247,0.247,0.239,0.237],[1.014,0.491,0.483,0.488,0.487,0.482],[0.734,0.081,0.084,0.079,0.081,0.082],[1.049,0.522,0.506,0.502,0.498,0.497],[3.943,2.447,2.483,2.506,2.489,2.517],[9.706,1.537,1.556,1.520,1.526,1.519],[3.660,2.354,2.381,2.369,2.369,2.332],[13.855,5.934,5.938,5.938,5.963,5.928],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.542,1.468,1.449,1.448,1.446,1.439],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"18.16.1","source":"results/18.16.1.json"} +,{"actual_version":"19.1.16.79","data_size":{"hits":14446358318,"job":1829540184,"mgbench":2954749821,"ontime":2700248370,"ssb":72842695813,"taxi":24197923255,"tpcds":18794718584,"tpch":17369267943,"uk":782692733},"kind":"versions-benchmark","load_time":{"hits":229,"job":23,"mgbench":59,"ontime":47,"ssb":1347,"taxi":863,"tpcds":268,"tpch":251,"uk":33},"machine":"c7a.4xlarge","release_date":"2019-04-02","result":[[0.176,0.025,0.022,0.023,0.024,0.019],[0.079,0.007,0.008,0.012,0.007,0.007],[0.172,0.016,0.016,0.016,0.016,0.015],[0.090,0.011,0.011,0.010,0.010,0.011],[0.084,0.023,0.021,0.021,0.022,0.022],[0.167,0.028,0.026,0.025,0.027,0.027],[0.138,0.012,0.011,0.011,0.012,0.011],[0.102,0.021,0.022,0.021,0.022,0.021],[0.148,0.036,0.034,0.035,0.037,0.038],[0.210,0.087,0.089,0.091,0.089,0.084],[0.586,0.441,0.450,0.436,0.440,0.451],[0.631,0.408,0.394,0.413,0.387,0.404],[0.256,0.027,0.029,0.030,0.027,0.026],[0.106,0.013,0.012,0.012,0.013,0.012],[1.190,0.943,0.950,0.933,0.916,0.937],[1.663,0.150,0.156,0.148,0.154,0.149],[0.066,0.020,0.020,0.022,0.020,0.019],[1.897,0.147,0.147,0.147,0.146,0.147],[8.036,1.696,1.717,1.693,1.697,1.722],[6.094,1.338,1.320,1.320,1.332,1.325],[6.159,1.358,1.357,1.361,1.548,1.364],[7.565,2.046,2.023,2.001,2.019,2.017],[8.492,1.684,1.676,1.666,1.684,1.671],[5.911,1.784,1.756,1.763,1.756,1.768],[0.092,0.048,0.046,0.046,0.045,0.046],[9.580,2.412,2.397,2.438,2.411,2.425],[3.549,0.991,0.974,0.955,0.963,0.988],[3.544,0.675,0.641,0.650,0.640,0.640],[0.083,0.018,0.018,0.017,0.017,0.017],[0.076,0.014,0.014,0.013,0.014,0.013],[0.127,0.056,0.055,0.057,0.056,0.061],[0.096,0.037,0.038,0.039,0.041,0.039],[0.195,0.143,0.132,0.144,0.141,0.145],[0.280,0.202,0.205,0.205,0.205,0.208],[0.092,0.043,0.035,0.033,0.034,0.033],[0.068,0.019,0.014,0.015,0.014,0.014],[0.371,0.286,0.303,0.283,0.294,0.293],[0.450,0.373,0.359,0.365,0.357,0.380],[0.189,0.123,0.126,0.123,0.136,0.120],[0.209,0.133,0.141,0.163,0.131,0.133],[0.473,0.389,0.373,0.376,0.358,0.382],[0.573,0.474,0.481,0.488,0.479,0.455],[0.550,0.458,0.457,0.461,0.475,0.445],[0.480,0.441,0.439,0.426,0.411,0.435],[1.244,1.094,1.100,1.088,1.099,1.094],[0.802,0.761,0.717,0.689,0.741,0.660],[2.592,2.448,2.387,2.515,2.498,2.581],[0.104,0.042,0.046,0.030,0.028,0.027],[1.460,0.401,0.405,0.398,0.405,0.389],[1.800,0.429,0.424,0.421,0.422,0.429],[4.119,1.190,1.172,1.168,1.175,1.177],[5.274,0.685,0.666,0.637,0.598,0.600],[0.240,0.201,0.201,0.191,0.214,0.195],[0.230,0.179,0.182,0.172,0.190,0.172],[0.266,0.192,0.207,0.199,0.218,0.192],[1.472,0.491,0.488,0.479,0.476,0.478],[1.176,0.806,0.799,0.788,0.776,0.775],[1.619,1.515,1.506,1.526,1.508,1.501],[0.557,0.435,0.438,0.441,0.444,0.447],[0.732,0.569,0.589,0.595,0.582,0.591],[3.773,3.379,3.478,3.630,3.652,3.606],[2.218,1.827,1.825,1.756,1.729,1.758],[2.188,1.752,1.741,1.732,1.742,1.806],[0.924,0.838,0.816,0.840,0.809,0.817],[0.160,0.055,0.058,0.064,0.053,0.056],[0.113,0.026,0.031,0.027,0.034,0.024],[0.114,0.031,0.025,0.024,0.023,0.035],[0.249,0.109,0.103,0.101,0.097,0.095],[0.106,0.012,0.011,0.013,0.013,0.011],[0.092,0.010,0.010,0.012,0.009,0.010],[0.074,0.005,0.005,0.005,0.005,0.005],[0.874,0.117,0.069,0.067,0.058,0.081],[0.918,0.130,0.101,0.103,0.116,0.115],[0.277,0.062,0.053,0.053,0.056,0.058],[0.968,0.156,0.161,0.156,0.159,0.153],[0.560,0.040,0.038,0.038,0.038,0.035],[0.632,0.075,0.076,0.074,0.070,0.077],[0.678,0.117,0.118,0.119,0.119,0.118],[0.576,0.051,0.049,0.048,0.048,0.053],[0.622,0.122,0.093,0.088,0.104,0.083],[0.738,0.193,0.185,0.227,0.181,0.190],[1.101,0.248,0.246,0.241,0.241,0.234],[1.090,0.437,0.428,0.429,0.430,0.426],[0.881,0.063,0.069,0.070,0.059,0.070],[1.140,0.478,0.466,0.462,0.460,0.458],[4.213,2.338,2.318,2.340,2.326,2.342],[9.994,1.526,1.519,1.508,1.512,1.516],[4.044,2.359,2.353,2.357,2.370,2.353],[14.222,5.795,5.829,5.756,5.786,5.777],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.330,1.233,1.240,1.249,1.237,1.246],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.1.16.79","source":"results/19.1.16.79.json"} +,{"actual_version":"19.3.9.12","data_size":{"hits":14385548295,"job":1829540184,"mgbench":2954749821,"ontime":2700248370,"ssb":72842764142,"taxi":24197856444,"tpcds":18812978875,"tpch":17369271130,"uk":782692733},"kind":"versions-benchmark","load_time":{"hits":236,"job":27,"mgbench":61,"ontime":51,"ssb":1388,"taxi":880,"tpcds":279,"tpch":272,"uk":34},"machine":"c7a.4xlarge","release_date":"2019-04-02","result":[[0.171,0.416,0.042,0.044,0.035,0.021],[0.075,0.032,0.007,0.007,0.008,0.007],[0.173,0.031,0.022,0.031,0.027,0.020],[0.095,0.027,0.011,0.011,0.010,0.010],[0.084,0.027,0.024,0.022,0.022,0.028],[0.177,0.030,0.029,0.032,0.030,0.027],[0.126,0.010,0.011,0.013,0.012,0.009],[0.095,0.035,0.022,0.020,0.020,0.020],[0.151,0.040,0.044,0.034,0.034,0.036],[0.186,0.086,0.092,0.088,0.086,0.087],[0.584,0.516,0.518,0.526,0.517,0.522],[0.654,0.464,0.457,0.458,0.459,0.453],[0.218,0.024,0.028,0.024,0.024,0.023],[0.097,0.012,0.016,0.015,0.012,0.013],[1.209,1.012,0.992,0.994,0.998,0.991],[1.778,0.145,0.129,0.130,0.129,0.130],[0.057,0.026,0.016,0.016,0.015,0.016],[1.735,0.148,0.135,0.132,0.131,0.129],[7.958,1.833,1.822,1.825,1.838,1.849],[5.684,1.447,1.459,1.452,1.438,1.446],[6.086,1.445,1.466,1.442,1.444,1.448],[7.449,2.117,2.098,2.109,2.122,2.144],[8.436,1.759,1.734,1.743,1.745,1.739],[5.758,1.829,1.827,1.821,1.821,1.847],[0.098,0.060,0.047,0.048,0.049,0.050],[9.489,2.574,2.544,2.587,2.609,2.597],[3.506,0.987,0.966,0.950,0.946,0.950],[3.461,0.673,0.646,0.640,0.634,0.631],[0.063,0.014,0.015,0.015,0.014,0.013],[0.062,0.014,0.012,0.014,0.014,0.014],[0.116,0.073,0.071,0.072,0.069,0.069],[0.089,0.039,0.043,0.039,0.039,0.039],[0.190,0.141,0.147,0.146,0.148,0.146],[0.279,0.216,0.213,0.209,0.210,0.210],[0.085,0.042,0.041,0.040,0.043,0.041],[0.060,0.012,0.011,0.012,0.011,0.011],[0.360,0.302,0.299,0.295,0.292,0.288],[0.452,0.357,0.365,0.360,0.364,0.358],[0.181,0.128,0.133,0.130,0.130,0.129],[0.201,0.146,0.146,0.145,0.146,0.143],[0.468,0.389,0.381,0.388,0.363,0.401],[0.555,0.479,0.482,0.490,0.492,0.474],[0.548,0.477,0.463,0.461,0.481,0.481],[0.573,0.485,0.497,0.497,0.486,0.464],[1.254,1.140,1.125,1.130,1.137,1.120],[0.918,0.774,0.845,0.818,0.777,0.751],[2.678,2.414,2.369,2.385,2.468,2.429],[0.104,0.040,0.053,0.046,0.038,0.049],[1.427,0.469,0.449,0.449,0.451,0.462],[1.770,0.471,0.461,0.449,0.455,0.462],[4.059,1.204,1.186,1.186,1.169,1.183],[4.402,0.677,0.659,0.648,0.640,0.635],[0.343,0.245,0.186,0.212,0.203,0.231],[0.305,0.201,0.208,0.194,0.178,0.181],[0.310,0.220,0.207,0.192,0.192,0.192],[1.430,0.482,0.478,0.473,0.475,0.479],[1.143,0.815,0.795,0.798,0.791,0.790],[1.917,1.973,1.862,1.821,1.904,1.887],[0.539,0.444,0.441,0.442,0.445,0.443],[0.722,0.589,0.594,0.572,0.590,0.586],[3.835,3.456,3.547,3.652,3.640,3.588],[2.123,1.711,1.716,1.712,1.702,1.695],[2.139,1.726,1.724,1.708,1.706,1.707],[0.922,0.839,0.834,0.817,0.838,0.830],[0.128,0.103,0.063,0.072,0.065,0.053],[0.066,0.035,0.026,0.029,0.027,0.021],[0.073,0.029,0.025,0.022,0.027,0.021],[0.206,0.165,0.134,0.131,0.124,0.134],[0.058,0.021,0.009,0.013,0.010,0.010],[0.053,0.018,0.008,0.008,0.007,0.010],[0.038,0.019,0.004,0.003,0.003,0.003],[0.822,0.081,0.080,0.081,0.079,0.077],[0.867,0.119,0.123,0.122,0.119,0.123],[0.252,0.064,0.056,0.053,0.051,0.051],[0.882,0.152,0.151,0.152,0.153,0.152],[0.460,0.038,0.032,0.032,0.032,0.032],[0.577,0.079,0.074,0.073,0.073,0.071],[0.615,0.117,0.114,0.114,0.114,0.118],[0.507,0.044,0.043,0.043,0.046,0.044],[0.552,0.092,0.076,0.077,0.079,0.075],[0.687,0.193,0.189,0.181,0.188,0.183],[1.056,0.273,0.277,0.277,0.279,0.286],[1.113,0.483,0.457,0.461,0.458,0.460],[0.810,0.084,0.083,0.084,0.083,0.082],[1.095,0.484,0.473,0.452,0.449,0.453],[4.112,2.598,2.601,2.605,2.608,2.589],[9.864,1.643,1.634,1.623,1.621,1.626],[3.770,2.311,2.307,2.310,2.308,2.322],[13.968,6.101,6.019,6.064,5.993,6.022],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.422,1.336,1.316,1.327,1.325,1.322],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.3.9.12","source":"results/19.3.9.12.json"} +,{"actual_version":"19.4.5.35","data_size":{"hits":14424232744,"job":1829535369,"mgbench":2954749821,"ontime":2700248370,"ssb":72842832671,"taxi":24197860710,"tpcds":18809235710,"tpch":17369149603,"uk":782692733},"kind":"versions-benchmark","load_time":{"hits":235,"job":27,"mgbench":54,"ontime":48,"ssb":1391,"taxi":746,"tpcds":278,"tpch":274,"uk":31},"machine":"c7a.4xlarge","release_date":"2019-05-13","result":[[0.133,0.009,0.010,0.017,0.010,0.010],[0.090,0.023,0.027,0.024,0.025,0.023],[0.096,0.011,0.010,0.014,0.010,0.012],[0.085,0.012,0.013,0.011,0.013,0.011],[0.076,0.023,0.020,0.026,0.023,0.020],[0.120,0.019,0.018,0.021,0.018,0.019],[0.124,0.011,0.011,0.010,0.012,0.011],[0.099,0.028,0.027,0.031,0.033,0.038],[0.140,0.042,0.038,0.044,0.040,0.040],[0.173,0.083,0.088,0.086,0.080,0.085],[0.565,0.506,0.496,0.507,0.511,0.503],[0.632,0.441,0.418,0.438,0.448,0.449],[0.211,0.026,0.031,0.028,0.023,0.023],[0.083,0.011,0.020,0.011,0.012,0.011],[1.112,0.897,0.898,0.889,0.899,0.891],[1.757,0.149,0.148,0.146,0.145,0.141],[0.061,0.020,0.020,0.019,0.020,0.018],[1.675,0.199,0.196,0.190,0.190,0.188],[7.765,1.635,1.658,1.661,1.661,1.671],[5.586,1.269,1.251,1.233,1.245,1.261],[5.946,1.256,1.236,1.236,1.248,1.217],[6.750,2.077,2.062,2.080,2.061,2.100],[7.624,1.578,1.557,1.561,1.567,1.576],[5.177,1.152,1.129,1.126,1.148,1.129],[0.091,0.037,0.040,0.040,0.038,0.036],[9.153,2.336,2.330,2.342,2.344,2.520],[3.796,1.140,1.124,1.129,1.124,1.130],[3.277,0.625,0.603,0.596,0.600,0.601],[0.057,0.013,0.014,0.016,0.014,0.019],[0.055,0.014,0.012,0.013,0.030,0.014],[0.108,0.058,0.055,0.060,0.055,0.055],[0.081,0.037,0.048,0.036,0.036,0.037],[0.159,0.132,0.140,0.142,0.142,0.139],[0.263,0.201,0.184,0.200,0.198,0.196],[0.067,0.030,0.031,0.031,0.031,0.032],[0.053,0.011,0.011,0.011,0.010,0.010],[0.352,0.291,0.294,0.287,0.292,0.295],[0.434,0.350,0.344,0.358,0.350,0.352],[0.150,0.103,0.102,0.101,0.103,0.102],[0.175,0.117,0.117,0.116,0.118,0.117],[0.425,0.356,0.334,0.359,0.342,0.352],[0.528,0.481,0.461,0.453,0.440,0.450],[0.503,0.437,0.423,0.426,0.435,0.439],[0.541,0.469,0.471,0.472,0.464,0.465],[1.254,1.119,1.103,1.082,1.123,1.091],[0.807,0.815,0.761,0.693,0.675,0.743],[2.547,2.367,2.418,2.395,2.492,2.524],[0.101,0.045,0.075,0.043,0.051,0.046],[1.439,0.368,0.365,0.363,0.345,0.354],[1.792,0.431,0.415,0.415,0.407,0.410],[4.105,1.188,1.176,1.163,1.168,1.166],[5.182,0.658,0.592,0.583,0.612,0.578],[0.326,0.202,0.198,0.178,0.173,0.180],[0.193,0.174,0.168,0.146,0.137,0.137],[0.266,0.205,0.184,0.181,0.192,0.190],[1.464,0.496,0.483,0.481,0.476,0.480],[1.151,0.794,0.794,0.787,0.788,0.781],[1.596,1.554,1.524,1.521,1.522,1.524],[0.545,0.445,0.414,0.415,0.418,0.420],[0.750,0.579,0.567,0.560,0.578,0.567],[3.893,3.512,3.553,3.659,3.581,3.576],[2.165,1.733,1.722,1.720,1.754,1.764],[2.179,1.743,1.714,1.740,1.710,1.702],[0.917,0.820,0.830,0.822,0.828,0.828],[0.126,0.075,0.071,0.084,0.066,0.071],[0.085,0.027,0.032,0.024,0.022,0.030],[0.086,0.020,0.021,0.021,0.025,0.020],[0.271,0.143,0.150,0.125,0.121,0.114],[0.080,0.011,0.013,0.011,0.011,0.012],[0.063,0.010,0.010,0.010,0.009,0.009],[0.055,0.007,0.007,0.006,0.006,0.006],[0.743,0.064,0.071,0.080,0.070,0.070],[0.777,0.112,0.112,0.113,0.114,0.111],[0.237,0.073,0.055,0.052,0.053,0.049],[0.827,0.133,0.132,0.131,0.132,0.130],[0.446,0.035,0.035,0.035,0.037,0.035],[0.551,0.069,0.069,0.069,0.067,0.068],[0.573,0.123,0.110,0.112,0.108,0.110],[0.473,0.038,0.036,0.036,0.037,0.036],[0.509,0.061,0.059,0.062,0.058,0.057],[0.668,0.190,0.180,0.175,0.177,0.176],[0.990,0.257,0.250,0.251,0.257,0.250],[0.990,0.440,0.432,0.421,0.420,0.422],[0.739,0.068,0.074,0.070,0.072,0.075],[0.980,0.447,0.419,0.423,0.420,0.413],[3.989,2.387,2.372,2.368,2.357,2.366],[9.801,1.532,1.521,1.511,1.505,1.512],[3.677,2.219,2.209,2.217,2.210,2.201],[13.994,5.667,5.710,5.690,5.764,5.748],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.313,1.165,1.169,1.177,1.158,1.162],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.4.5.35","source":"results/19.4.5.35.json"} +,{"actual_version":"19.5.4.22","data_size":{"hits":14373166954,"job":1829540184,"mgbench":2954749821,"ontime":2700248370,"ssb":72843514886,"taxi":24197871292,"tpcds":18775054594,"tpch":17369373164,"uk":782692733},"kind":"versions-benchmark","load_time":{"hits":234,"job":24,"mgbench":54,"ontime":47,"ssb":1427,"taxi":736,"tpcds":274,"tpch":269,"uk":29},"machine":"c7a.4xlarge","release_date":"2019-05-13","result":[[0.106,0.015,0.010,0.009,0.009,0.009],[0.091,0.034,0.046,0.029,0.030,0.025],[0.092,0.010,0.011,0.012,0.012,0.010],[0.080,0.011,0.013,0.015,0.012,0.012],[0.075,0.026,0.028,0.025,0.024,0.022],[0.127,0.020,0.017,0.021,0.020,0.019],[0.154,0.011,0.012,0.010,0.013,0.010],[0.103,0.030,0.029,0.028,0.027,0.026],[0.177,0.051,0.040,0.042,0.044,0.042],[0.181,0.087,0.086,0.087,0.086,0.084],[0.576,0.506,0.497,0.503,0.504,0.499],[0.666,0.457,0.448,0.452,0.425,0.440],[0.213,0.027,0.024,0.025,0.027,0.025],[0.083,0.012,0.013,0.014,0.013,0.013],[1.156,0.932,0.916,0.919,0.910,0.922],[1.846,0.157,0.149,0.148,0.153,0.147],[0.049,0.020,0.020,0.020,0.029,0.019],[1.810,0.205,0.201,0.200,0.201,0.200],[7.918,1.680,1.645,1.645,1.637,1.650],[5.793,1.243,1.227,1.229,1.229,1.239],[6.114,1.267,1.240,1.265,1.240,1.243],[6.981,2.148,2.130,2.133,2.135,2.153],[7.760,1.656,1.650,1.643,1.638,1.820],[5.450,1.163,1.139,1.138,1.143,1.139],[0.093,0.038,0.042,0.038,0.038,0.038],[9.445,2.343,2.345,2.331,2.345,2.349],[3.964,1.172,1.146,1.154,1.150,1.147],[3.642,0.634,0.618,0.612,0.608,0.616],[0.047,0.016,0.014,0.015,0.014,0.014],[0.049,0.015,0.017,0.013,0.012,0.014],[0.100,0.068,0.067,0.065,0.066,0.066],[0.122,0.039,0.037,0.035,0.037,0.040],[0.184,0.142,0.136,0.139,0.143,0.145],[0.256,0.213,0.212,0.205,0.201,0.202],[0.071,0.038,0.039,0.041,0.039,0.039],[0.040,0.014,0.012,0.012,0.011,0.011],[0.341,0.294,0.303,0.291,0.292,0.285],[0.460,0.357,0.342,0.358,0.348,0.357],[0.147,0.103,0.102,0.101,0.102,0.100],[0.171,0.117,0.118,0.118,0.114,0.122],[0.422,0.357,0.333,0.332,0.333,0.339],[0.519,0.465,0.440,0.450,0.452,0.455],[0.498,0.435,0.449,0.454,0.464,0.469],[0.520,0.493,0.515,0.491,0.481,0.496],[1.244,1.203,1.138,1.142,1.105,1.148],[0.873,0.794,0.835,0.827,0.724,0.765],[2.657,2.469,2.591,null,null,null],[null,null,null,null,null,null],[1.427,0.346,0.345,0.343,0.339,0.342],[1.772,0.405,0.406,0.404,0.397,0.403],[4.053,1.172,1.145,1.141,1.155,1.148],[4.424,0.643,0.601,0.568,0.590,0.583],[0.308,0.168,0.173,0.169,0.170,0.164],[0.162,0.124,0.115,0.120,0.122,0.120],[0.252,0.171,0.168,0.162,0.175,0.170],[1.439,0.474,0.470,0.469,0.463,0.463],[1.134,0.767,0.782,0.765,0.770,0.767],[1.876,1.816,1.774,1.828,1.799,1.794],[0.514,0.425,0.410,0.405,0.415,0.416],[0.771,0.566,0.560,0.552,0.548,0.566],[3.803,3.524,3.517,3.545,3.481,3.492],[2.084,1.696,1.704,1.692,1.706,1.697],[2.120,1.745,1.701,1.679,1.691,1.681],[1.005,0.920,0.889,0.891,0.889,0.895],[0.135,0.076,0.092,0.084,0.083,0.073],[0.053,0.029,0.029,0.026,0.029,0.036],[0.068,0.026,0.025,0.032,0.020,0.026],[0.245,0.181,0.182,0.182,0.160,0.164],[0.052,0.012,0.011,0.011,0.019,0.012],[0.036,0.015,0.010,0.011,0.009,0.010],[0.023,0.005,0.005,0.005,0.005,0.005],[0.755,0.085,0.076,0.074,0.070,0.070],[0.747,0.114,0.114,0.112,0.114,0.112],[0.226,0.057,0.051,0.049,0.047,0.046],[0.848,0.131,0.131,0.129,0.129,0.129],[0.403,0.035,0.036,0.034,0.035,0.034],[0.527,0.070,0.067,0.067,0.068,0.068],[0.590,0.112,0.108,0.106,0.108,0.107],[0.462,0.036,0.037,0.037,0.039,0.037],[0.515,0.061,0.061,0.058,0.060,0.061],[0.640,0.182,0.187,0.177,0.178,0.172],[1.053,0.256,0.253,0.256,0.248,0.256],[1.012,0.443,0.430,0.433,0.429,0.425],[0.742,0.067,0.072,0.070,0.072,0.064],[0.972,0.437,0.435,0.423,0.429,0.418],[3.962,2.455,2.465,2.479,2.455,2.454],[9.667,1.515,1.507,1.539,1.529,1.519],[3.439,2.200,2.200,2.189,2.199,2.232],[13.925,5.651,5.627,5.640,5.657,5.625],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.261,0.066,0.064,0.064,0.065,0.062],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.895,0.213,0.213,0.217,0.198,0.206],[0.757,0.206,0.204,0.172,0.193,0.200],[0.791,0.193,0.186,0.198,0.205,0.192],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.924,0.259,0.227,0.245,0.238,0.213],[0.878,0.240,0.249,0.242,0.226,0.249],[0.869,0.250,0.240,0.250,0.235,0.243],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.5.4.22","source":"results/19.5.4.22.json"} +,{"actual_version":"19.8.3.8","data_size":{"hits":14384159666,"job":1829539014,"mgbench":2954360644,"ontime":2700245189,"ssb":72842860976,"taxi":24197868651,"tpcds":18783220059,"tpch":17369309597,"uk":782689681},"kind":"versions-benchmark","load_time":{"hits":264,"job":25,"mgbench":63,"ontime":54,"ssb":1529,"taxi":814,"tpcds":283,"tpch":284,"uk":33},"machine":"c7a.4xlarge","release_date":"2019-06-11","result":[[0.100,0.011,0.010,0.011,0.011,0.011],[0.087,0.026,0.028,0.028,0.036,0.027],[0.094,0.011,0.012,0.012,0.012,0.011],[0.079,0.012,0.014,0.012,0.011,0.013],[0.074,0.026,0.029,0.027,0.021,0.025],[0.103,0.022,0.021,0.023,0.022,0.020],[0.116,0.012,0.015,0.013,0.016,0.012],[0.094,0.038,0.034,0.037,0.032,0.032],[0.146,0.051,0.054,0.060,0.050,0.055],[0.182,0.097,0.100,0.106,0.106,0.106],[0.667,0.608,0.615,0.630,0.611,0.614],[0.661,0.482,0.475,0.480,0.471,0.475],[0.208,0.027,0.034,0.025,0.029,0.029],[0.076,0.016,0.016,0.015,0.013,0.012],[1.301,1.063,1.065,1.049,1.053,1.067],[1.442,0.177,0.177,0.170,0.175,0.173],[0.050,0.021,0.022,0.019,0.021,0.021],[1.566,0.228,0.236,0.229,0.237,0.233],[7.695,2.034,1.939,2.055,1.983,2.068],[5.730,1.559,1.535,1.394,1.505,1.477],[5.881,1.473,1.510,1.399,1.483,1.459],[6.894,2.596,2.478,2.601,2.498,2.382],[7.556,1.970,1.971,1.996,2.002,2.000],[5.351,1.353,1.348,1.352,1.389,1.368],[0.087,0.045,0.040,0.040,0.041,0.042],[9.232,2.905,2.916,2.934,2.911,2.922],[3.781,1.385,1.370,1.364,1.373,1.373],[3.395,0.815,0.785,0.789,0.726,0.724],[0.042,0.018,0.017,0.020,0.018,0.016],[0.040,0.014,0.014,0.015,0.017,0.014],[0.093,0.072,0.071,0.071,0.071,0.071],[0.076,0.051,0.045,0.045,0.047,0.047],[0.185,0.160,0.159,0.157,0.158,0.172],[0.278,0.240,0.237,0.241,0.240,0.234],[0.060,0.038,0.038,0.038,0.039,0.038],[0.035,0.013,0.014,0.013,0.013,0.013],[0.381,0.338,0.325,0.335,0.332,0.324],[0.442,0.399,0.399,0.404,0.404,0.431],[0.159,0.128,0.127,0.126,0.127,0.122],[0.178,0.146,0.134,0.142,0.142,0.141],[0.485,0.404,0.406,0.389,0.417,0.367],[0.593,0.538,0.532,0.545,0.531,0.524],[0.545,0.526,0.498,0.514,0.502,0.510],[0.582,0.539,0.534,0.538,0.479,0.488],[1.422,1.299,1.276,1.295,1.290,1.282],[0.908,0.900,0.934,0.838,0.819,0.795],[2.980,2.880,2.808,2.743,2.876,2.813],[0.109,0.093,0.073,0.060,0.055,0.047],[1.415,0.449,0.419,0.390,0.391,0.428],[1.743,0.530,0.516,0.507,0.497,0.489],[4.038,1.416,1.394,1.399,1.379,1.415],[4.481,0.767,0.725,0.722,0.755,0.738],[0.393,0.275,0.277,0.232,0.235,0.251],[0.198,0.193,0.159,0.177,0.171,0.150],[0.277,0.245,0.241,0.232,0.240,0.239],[1.420,0.585,0.583,0.579,0.585,0.583],[1.153,1.004,0.998,0.992,0.971,0.977],[2.041,2.009,1.871,1.995,2.006,1.992],[0.563,0.503,0.512,0.513,0.540,0.502],[0.771,0.706,0.680,0.662,0.689,0.688],[4.335,4.015,4.173,4.181,4.170,4.069],[2.274,2.075,2.042,2.057,2.050,2.036],[2.174,2.139,2.059,1.846,1.872,1.858],[1.047,0.908,0.940,0.912,0.917,0.953],[0.112,0.074,0.069,0.061,0.058,0.069],[0.065,0.030,0.030,0.031,0.028,0.030],[0.069,0.031,0.019,0.025,0.036,0.025],[0.194,0.169,0.166,0.151,0.132,0.138],[0.054,0.025,0.012,0.011,0.021,0.010],[0.041,0.009,0.009,0.013,0.010,0.010],[0.031,0.004,0.004,0.005,0.008,0.003],[0.722,0.070,0.080,0.080,0.071,0.069],[0.771,0.128,0.124,0.121,0.125,0.127],[0.239,0.063,0.064,0.066,0.059,0.063],[0.797,0.155,0.149,0.147,0.147,0.147],[0.422,0.038,0.037,0.038,0.037,0.037],[0.498,0.080,0.079,0.080,0.077,0.078],[0.543,0.128,0.128,0.124,0.124,0.124],[0.433,0.041,0.040,0.039,0.044,0.043],[0.469,0.069,0.066,0.065,0.066,0.066],[0.654,0.212,0.211,0.208,0.205,0.215],[0.951,0.299,0.306,0.301,0.313,0.287],[1.073,0.504,0.472,0.480,0.473,0.474],[0.715,0.082,0.109,0.085,0.083,0.083],[1.015,0.497,0.483,0.481,0.482,0.468],[4.241,2.809,2.802,2.778,2.768,2.794],[9.673,1.745,1.747,1.752,1.750,1.769],[3.887,2.516,2.539,2.527,2.528,2.521],[13.833,6.469,6.417,6.383,6.510,6.449],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.989,21.133,20.943,20.936,21.114,21.221],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.414,1.318,1.324,1.323,1.300,1.308],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[22.132,21.354,21.530,22.346,23.087,21.671],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.588,21.512,21.545,21.513,21.500,21.884],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.155,0.043,0.039,0.038,0.038,0.038],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.593,0.178,0.188,0.188,0.180,0.181],[0.480,0.182,0.175,0.149,0.168,0.175],[0.479,0.150,0.165,0.176,0.181,0.181],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.505,0.190,0.196,0.190,0.156,0.160],[0.543,0.203,0.220,0.204,0.204,0.205],[0.502,0.204,0.187,0.201,0.205,0.201],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.8.3.8","source":"results/19.8.3.8.json"} +,{"actual_version":"19.6.3.18","data_size":{"hits":14373166954,"job":1829540184,"mgbench":2954390822,"ontime":2700248370,"ssb":72842703616,"taxi":24197916959,"tpcds":18783834755,"tpch":17369178762,"uk":782692733},"kind":"versions-benchmark","load_time":{"hits":230,"job":22,"mgbench":55,"ontime":47,"ssb":1367,"taxi":741,"tpcds":272,"tpch":271,"uk":30},"machine":"c7a.4xlarge","release_date":"2019-06-15","result":[[0.134,0.010,0.011,0.011,0.013,0.009],[0.096,0.038,0.026,0.026,0.023,0.022],[0.118,0.010,0.010,0.010,0.010,0.010],[0.101,0.011,0.033,0.011,0.010,0.010],[0.086,0.023,0.021,0.023,0.020,0.038],[0.123,0.019,0.018,0.019,0.021,0.017],[0.147,0.011,0.011,0.011,0.010,0.011],[0.107,0.032,0.033,0.028,0.027,0.034],[0.168,0.054,0.046,0.045,0.046,0.052],[0.203,0.090,0.088,0.088,0.085,0.084],[0.609,0.526,0.527,0.516,0.514,0.522],[0.648,0.438,0.429,0.436,0.433,0.428],[0.257,0.025,0.024,0.025,0.025,0.023],[0.098,0.013,0.011,0.012,0.011,0.019],[1.170,0.923,0.912,0.896,0.890,0.902],[1.918,0.162,0.149,0.149,0.146,0.147],[0.054,0.020,0.020,0.021,0.020,0.018],[1.982,0.200,0.200,0.195,0.193,0.191],[7.937,1.695,1.700,1.645,1.650,1.649],[5.838,1.235,1.227,1.214,1.209,1.228],[6.342,1.252,1.204,1.209,1.208,1.212],[7.165,2.065,2.060,2.071,2.083,2.126],[7.894,1.721,1.721,1.730,1.726,1.726],[5.389,1.159,1.166,1.140,1.168,1.171],[0.093,0.040,0.037,0.038,0.039,0.041],[9.615,2.319,2.313,2.398,2.390,2.299],[4.151,1.202,1.195,1.190,1.175,1.188],[3.707,0.676,0.653,0.651,0.643,0.647],[0.056,0.015,0.015,0.016,0.015,0.016],[0.055,0.017,0.015,0.014,0.011,0.013],[0.102,0.058,0.057,0.060,0.061,0.062],[0.093,0.040,0.039,0.040,0.038,0.038],[0.188,0.144,0.142,0.142,0.139,0.139],[0.268,0.207,0.206,0.209,0.194,0.202],[0.072,0.036,0.036,0.036,0.035,0.035],[0.051,0.012,0.012,0.011,0.012,0.012],[0.347,0.287,0.289,0.288,0.298,0.290],[0.442,0.356,0.366,0.368,0.353,0.356],[0.155,0.103,0.103,0.100,0.100,0.100],[0.181,0.117,0.117,0.115,0.115,0.114],[0.428,0.346,0.334,0.355,0.353,0.329],[0.534,0.467,0.472,0.466,0.442,0.487],[0.533,0.440,0.451,0.447,0.421,0.438],[0.539,0.498,0.494,0.474,0.485,0.473],[1.224,1.122,1.134,1.096,1.140,1.142],[0.857,0.769,0.707,0.777,0.732,0.707],[2.667,2.510,2.557,2.654,null,null],[null,null,null,null,null,null],[1.431,0.361,0.357,0.353,0.351,0.362],[1.776,0.444,0.428,0.432,0.444,0.413],[4.050,1.192,1.171,1.152,1.209,1.226],[4.450,0.661,0.593,0.582,0.632,0.610],[0.257,0.192,0.188,0.184,0.190,0.199],[0.168,0.132,0.137,0.126,0.132,0.133],[0.316,0.179,0.196,0.182,0.185,0.173],[1.454,0.495,0.482,0.478,0.476,0.473],[1.135,0.801,0.797,0.795,0.781,0.776],[1.718,1.640,1.655,1.653,1.679,1.648],[0.529,0.441,0.418,0.426,0.411,0.414],[0.802,0.588,0.578,0.563,0.560,0.552],[3.846,3.568,3.640,3.621,3.621,3.645],[2.129,1.726,1.762,1.744,1.694,1.677],[2.100,1.717,1.692,1.671,1.672,1.698],[0.922,0.852,0.847,0.829,0.865,0.864],[0.126,0.064,0.062,0.064,0.067,0.069],[0.057,0.033,0.031,0.036,0.027,0.039],[0.079,0.030,0.025,0.038,0.030,0.026],[0.228,0.168,0.166,0.175,0.157,0.184],[0.059,0.013,0.011,0.011,0.011,0.011],[0.040,0.013,0.009,0.011,0.011,0.013],[0.027,0.005,0.005,0.005,0.005,0.005],[0.817,0.077,0.079,0.073,0.071,0.070],[0.869,0.113,0.109,0.115,0.114,0.113],[0.242,0.056,0.053,0.051,0.046,0.046],[0.933,0.133,0.132,0.130,0.131,0.130],[0.483,0.036,0.034,0.033,0.033,0.032],[0.621,0.068,0.067,0.066,0.067,0.068],[0.665,0.112,0.108,0.110,0.109,0.107],[0.551,0.036,0.036,0.038,0.037,0.036],[0.573,0.062,0.057,0.058,0.059,0.061],[0.729,0.187,0.183,0.177,0.183,0.186],[1.174,0.260,0.258,0.264,0.259,0.262],[1.094,0.449,0.442,0.440,0.441,0.441],[0.884,0.076,0.073,0.074,0.073,0.073],[1.062,0.438,0.426,0.427,0.423,0.425],[4.529,2.706,2.701,2.728,2.671,2.702],[10.051,1.533,1.544,1.546,1.534,1.519],[3.794,2.261,2.260,2.257,2.261,2.265],[14.201,5.735,5.682,5.693,5.690,5.650],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.441,1.148,1.137,1.140,1.143,1.141],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.314,0.074,0.062,0.059,0.056,0.055],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.368,0.080,0.074,0.072,0.069,0.063],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.955,0.209,0.222,0.223,0.211,0.201],[0.741,0.209,0.195,0.207,0.210,0.201],[0.785,0.209,0.210,0.206,0.179,0.208],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.943,0.237,0.233,0.240,0.235,0.239],[0.887,0.235,0.249,0.244,0.240,0.225],[1.034,0.237,0.244,0.234,0.229,0.229],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.6.3.18","source":"results/19.6.3.18.json"} +,{"actual_version":"19.7.5.29","data_size":{"hits":14465108382,"job":1829539014,"mgbench":2955130175,"ontime":2700245189,"ssb":72842525885,"taxi":24197891560,"tpcds":18807793879,"tpch":17369276069,"uk":782689681},"kind":"versions-benchmark","load_time":{"hits":261,"job":27,"mgbench":62,"ontime":53,"ssb":1476,"taxi":795,"tpcds":289,"tpch":291,"uk":34},"machine":"c7a.4xlarge","release_date":"2019-07-05","result":[[0.105,0.010,0.009,0.009,0.013,0.011],[0.093,0.026,0.029,0.034,0.027,0.026],[0.108,0.011,0.013,0.010,0.011,0.010],[0.095,0.014,0.011,0.011,0.014,0.011],[0.080,0.027,0.021,0.025,0.022,0.023],[0.112,0.019,0.019,0.019,0.019,0.019],[0.133,0.012,0.011,0.012,0.012,0.013],[0.106,0.031,0.039,0.034,0.031,0.032],[0.148,0.050,0.048,0.054,0.047,0.051],[0.195,0.104,0.099,0.099,0.095,0.100],[0.653,0.598,0.579,0.593,0.606,0.581],[0.708,0.508,0.500,0.472,0.485,0.482],[0.210,0.024,0.023,0.025,0.026,0.025],[0.080,0.013,0.011,0.012,0.013,0.011],[1.273,1.031,1.039,1.022,1.028,1.055],[1.549,0.176,0.177,0.168,0.174,0.171],[0.056,0.024,0.022,0.022,0.019,0.020],[1.672,0.233,0.227,0.227,0.221,0.220],[7.705,1.949,1.921,1.900,1.907,1.887],[5.605,1.512,1.531,1.509,1.522,1.494],[6.101,1.472,1.544,1.503,1.549,1.543],[6.929,2.479,2.537,2.586,2.620,2.647],[7.662,2.150,2.167,2.174,2.191,2.178],[5.357,1.496,1.465,1.442,1.473,1.486],[0.105,0.046,0.044,0.046,0.046,0.047],[9.344,2.979,3.015,3.041,3.034,3.057],[4.073,1.578,1.530,1.551,1.534,1.553],[3.543,0.711,0.714,0.774,0.781,0.780],[0.088,0.019,0.018,0.017,0.016,0.017],[0.090,0.020,0.018,0.018,0.018,0.014],[0.151,0.070,0.068,0.072,0.068,0.068],[0.119,0.049,0.047,0.047,0.046,0.046],[0.245,0.179,0.178,0.174,0.176,0.178],[0.356,0.262,0.265,0.259,0.265,0.255],[0.108,0.041,0.041,0.036,0.040,0.040],[0.085,0.014,0.015,0.015,0.015,0.014],[0.451,0.368,0.363,0.361,0.364,0.365],[0.557,0.442,0.434,0.410,0.382,0.393],[0.201,0.125,0.122,0.129,0.125,0.120],[0.244,0.140,0.142,0.138,0.139,0.127],[0.571,0.423,0.433,0.427,0.448,0.415],[0.713,0.625,0.597,0.555,0.570,0.570],[0.643,0.525,0.554,0.555,0.559,0.580],[0.673,0.587,0.579,0.574,0.606,0.502],[1.554,1.360,1.378,1.361,1.350,1.324],[1.097,0.919,0.952,0.916,0.887,0.937],[3.293,3.002,3.016,3.108,2.934,2.968],[0.153,0.072,0.077,0.077,0.082,0.048],[1.495,0.462,0.445,0.444,0.457,0.438],[1.820,0.582,0.538,0.541,0.529,0.497],[4.197,1.438,1.388,1.419,1.401,1.422],[5.198,0.688,0.682,0.672,0.652,0.675],[0.383,0.233,0.258,0.235,0.238,0.202],[0.257,0.160,0.145,0.161,0.149,0.155],[0.346,0.223,0.219,0.214,0.214,0.211],[1.502,0.534,0.539,0.530,0.528,0.534],[1.195,0.895,0.900,0.890,0.892,0.903],[1.916,1.709,1.711,1.756,1.822,1.817],[0.622,0.467,0.460,0.448,0.458,0.462],[0.803,0.607,0.613,0.622,0.580,0.605],[4.027,3.654,3.725,3.837,3.686,3.785],[2.265,1.905,1.897,1.875,1.907,1.940],[2.299,1.935,1.916,1.919,1.908,1.898],[1.040,0.939,0.910,0.917,0.939,0.947],[0.155,0.094,0.076,0.080,0.071,0.071],[0.124,0.033,0.032,0.040,0.029,0.032],[0.136,0.024,0.027,0.023,0.023,0.026],[0.266,0.149,0.138,0.127,0.120,0.121],[0.108,0.014,0.013,0.013,0.014,0.015],[0.097,0.014,0.012,0.011,0.011,0.011],[0.085,0.006,0.007,0.007,0.006,0.007],[0.746,0.081,0.079,0.080,0.080,0.078],[0.810,0.124,0.122,0.123,0.124,0.126],[0.240,0.067,0.064,0.054,0.054,0.053],[0.872,0.150,0.148,0.152,0.150,0.148],[0.470,0.036,0.036,0.038,0.037,0.036],[0.563,0.077,0.078,0.075,0.077,0.075],[0.605,0.128,0.125,0.122,0.120,0.119],[0.508,0.039,0.129,0.042,0.041,0.042],[0.535,0.067,0.064,0.063,0.067,0.065],[0.711,0.213,0.208,0.206,0.202,0.198],[1.016,0.285,0.282,0.279,0.284,0.283],[1.098,0.499,0.503,0.501,0.530,0.491],[0.785,0.078,0.079,0.081,0.083,0.084],[1.093,0.500,0.489,0.480,0.486,0.483],[4.359,2.784,2.776,2.785,2.771,2.810],[9.742,1.805,1.793,1.792,1.846,1.861],[4.016,2.530,2.564,2.561,2.529,2.548],[13.916,6.502,6.538,6.531,6.582,6.478],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[22.701,23.205,23.128,23.549,24.093,23.841],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.549,1.421,1.404,1.396,1.409,1.389],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.988,21.662,21.668,21.525,21.228,21.526],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.253,20.959,21.440,20.830,20.967,21.380],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.148,0.040,0.036,0.036,0.036,0.036],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.213,0.056,0.049,0.048,0.044,0.046],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.741,0.191,0.180,0.167,0.173,0.150],[0.573,0.162,0.169,0.169,0.171,0.171],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.589,0.174,0.186,0.162,0.187,0.166],[0.617,0.189,0.196,0.156,0.173,0.198],[0.635,0.171,0.201,0.174,0.165,0.199],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.7.5.29","source":"results/19.7.5.29.json"} +,{"actual_version":"19.10.1.5","data_size":{"hits":14370038106,"job":1829539014,"mgbench":2954747641,"ontime":2700245189,"ssb":72842399964,"taxi":24197908218,"tpcds":18804979470,"tpch":17369298843,"uk":782689681},"kind":"versions-benchmark","load_time":{"hits":233,"job":21,"mgbench":54,"ontime":46,"ssb":1356,"taxi":725,"tpcds":272,"tpch":263,"uk":30},"machine":"c7a.4xlarge","release_date":"2019-07-12","result":[[0.084,0.009,0.008,0.009,0.009,0.012],[0.065,0.023,0.022,0.026,0.022,0.023],[0.071,0.008,0.010,0.009,0.009,0.009],[0.066,0.011,0.011,0.023,0.009,0.011],[0.052,0.025,0.024,0.022,0.021,0.020],[0.088,0.017,0.019,0.018,0.018,0.020],[0.047,0.007,0.007,0.007,0.008,0.008],[0.070,0.029,0.031,0.031,0.027,0.027],[0.082,0.044,0.042,0.045,0.042,0.045],[0.112,0.083,0.087,0.085,0.084,0.084],[0.531,0.513,0.530,0.531,0.517,0.525],[0.559,0.431,0.425,0.428,0.421,0.416],[0.066,0.016,0.013,0.014,0.013,0.013],[0.033,0.011,0.009,0.011,0.008,0.008],[0.977,0.927,0.887,0.900,0.897,0.909],[0.232,0.115,0.109,0.109,0.109,0.111],[0.043,0.020,0.019,0.019,0.021,0.020],[0.196,0.151,0.150,0.149,0.145,0.144],[6.457,1.660,1.638,1.632,1.664,1.661],[4.781,1.225,1.204,1.203,1.207,1.209],[4.797,1.235,1.220,1.220,1.225,1.213],[5.456,2.060,2.058,2.063,2.073,2.069],[6.269,1.691,1.686,1.693,1.695,1.701],[4.030,1.128,1.116,1.119,1.101,1.119],[0.064,0.038,0.034,0.036,0.038,0.036],[7.742,2.289,2.271,2.279,2.285,2.279],[2.383,1.151,1.149,1.145,1.141,1.132],[1.971,0.611,0.592,0.585,0.575,0.576],[0.044,0.013,0.018,0.015,0.014,0.014],[0.041,0.013,0.014,0.011,0.013,0.010],[0.084,0.057,0.057,0.054,0.055,0.054],[0.068,0.036,0.037,0.039,0.037,0.036],[0.164,0.144,0.145,0.145,0.145,0.146],[0.251,0.207,0.208,0.204,0.203,0.200],[0.057,0.031,0.032,0.031,0.032,0.031],[0.037,0.011,0.011,0.011,0.012,0.011],[0.341,0.299,0.280,0.287,0.291,0.283],[0.405,0.357,0.351,0.344,0.353,0.350],[0.141,0.102,0.104,0.100,0.102,0.100],[0.153,0.115,0.114,0.113,0.114,0.115],[0.414,0.348,0.346,0.334,0.327,0.322],[0.492,0.455,0.454,0.462,0.428,0.448],[0.472,0.428,0.425,0.422,0.420,0.419],[0.511,0.467,0.461,0.454,0.456,0.444],[1.207,1.125,1.092,1.091,1.119,1.101],[0.779,0.692,0.766,0.675,0.730,0.751],[2.558,2.391,2.387,2.328,2.395,2.370],[0.075,0.045,0.042,0.050,0.050,0.042],[1.400,0.351,0.333,0.328,0.328,0.331],[1.735,0.408,0.399,0.396,0.392,0.399],[4.037,1.154,1.140,1.144,1.140,1.131],[4.333,0.582,0.568,0.557,0.566,0.553],[0.295,0.207,0.209,0.196,0.208,0.206],[0.192,0.156,0.141,0.138,0.108,0.112],[0.240,0.188,0.196,0.185,0.186,0.181],[1.418,0.467,0.476,0.458,0.461,0.471],[1.146,0.797,0.777,0.780,0.775,0.783],[1.638,1.569,1.552,1.558,1.566,1.565],[0.490,0.410,0.415,0.404,0.418,0.413],[0.654,0.568,0.556,0.557,0.557,0.553],[3.696,3.381,3.464,3.523,3.419,3.360],[2.111,1.687,1.683,1.656,1.655,1.647],[2.081,1.681,1.648,1.636,1.636,1.650],[0.946,0.852,0.846,0.829,0.870,0.853],[0.121,0.070,0.074,0.077,0.081,0.074],[0.060,0.034,0.027,0.031,0.040,0.027],[0.074,0.034,0.025,0.022,0.027,0.024],[0.244,0.154,0.182,0.186,0.176,0.139],[0.054,0.019,0.013,0.012,0.013,0.012],[0.046,0.012,0.011,0.010,0.008,0.009],[0.026,0.006,0.003,0.003,0.003,0.003],[0.117,0.062,0.059,0.055,0.059,0.058],[0.133,0.089,0.088,0.088,0.090,0.087],[0.107,0.054,0.044,0.047,0.043,0.041],[0.151,0.121,0.123,0.123,0.119,0.124],[0.066,0.027,0.027,0.026,0.027,0.027],[0.105,0.060,0.057,0.059,0.059,0.059],[0.151,0.101,0.101,0.100,0.115,0.099],[0.066,0.024,0.026,0.027,0.024,0.024],[0.090,0.043,0.043,0.042,0.042,0.039],[0.219,0.172,0.170,0.167,0.165,0.163],[0.281,0.245,0.237,0.233,0.242,0.236],[0.529,0.435,0.426,0.426,0.428,0.417],[0.096,0.056,0.064,0.067,0.068,0.066],[0.508,0.418,0.424,0.403,0.403,0.407],[2.400,2.381,2.374,2.376,2.380,2.479],[8.502,1.545,1.527,1.540,1.534,1.526],[2.292,2.240,2.258,2.328,2.250,2.226],[12.743,5.737,5.714,5.740,5.697,5.726],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.423,20.556,20.404,20.727,20.350,20.485],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.274,1.172,1.157,1.151,1.161,1.161],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.004,20.665,20.635,20.627,21.378,20.663],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.103,0.040,0.037,0.036,0.036,0.036],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.198,0.050,0.043,0.045,0.041,0.041],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.484,0.171,0.172,0.172,0.168,0.168],[0.452,0.161,0.161,0.143,0.161,0.160],[0.439,0.130,0.164,0.160,0.160,0.149],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.501,0.184,0.191,0.190,0.186,0.186],[0.526,0.149,0.190,0.183,0.179,0.188],[0.545,0.185,0.186,0.178,0.191,0.157],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.10.1.5","source":"results/19.10.1.5.json"} +,{"actual_version":"19.9.5.36","data_size":{"hits":14426059234,"job":1829539014,"mgbench":2954747641,"ontime":2700245189,"ssb":72842222992,"taxi":24197850136,"tpcds":18790504449,"tpch":17369262378,"uk":782689681},"kind":"versions-benchmark","load_time":{"hits":230,"job":21,"mgbench":55,"ontime":47,"ssb":1407,"taxi":737,"tpcds":258,"tpch":257,"uk":30},"machine":"c7a.4xlarge","release_date":"2019-07-20","result":[[0.156,0.011,0.022,0.009,0.012,0.010],[0.097,0.027,0.046,0.025,0.023,0.026],[0.107,0.010,0.011,0.010,0.010,0.010],[0.094,0.014,0.011,0.012,0.011,0.014],[0.082,0.019,0.023,0.023,0.023,0.021],[0.111,0.018,0.021,0.018,0.018,0.019],[0.141,0.011,0.011,0.012,0.011,0.012],[0.104,0.031,0.037,0.034,0.027,0.032],[0.163,0.054,0.041,0.045,0.044,0.046],[0.209,0.085,0.087,0.083,0.088,0.085],[0.610,0.527,0.523,0.519,0.528,0.514],[0.664,0.452,0.449,0.422,0.438,0.432],[0.273,0.025,0.026,0.025,0.024,0.023],[0.109,0.013,0.015,0.012,0.017,0.011],[1.205,0.915,0.924,0.939,0.930,0.947],[1.702,0.158,0.155,0.150,0.147,0.144],[0.070,0.021,0.022,0.023,0.020,0.019],[1.899,0.191,0.191,0.191,0.189,0.192],[7.827,1.708,1.693,1.703,1.692,1.715],[5.767,1.272,1.243,1.226,1.232,1.242],[6.171,1.277,1.281,1.239,1.228,1.230],[7.035,2.132,2.131,2.119,2.084,2.120],[7.859,1.696,1.701,1.697,1.703,1.717],[5.347,1.206,1.212,1.222,1.209,1.206],[0.084,0.042,0.037,0.039,0.037,0.038],[9.570,2.356,2.338,2.374,2.388,2.316],[4.225,1.229,1.196,1.224,1.185,1.209],[3.719,0.648,0.648,0.636,0.642,0.634],[0.086,0.015,0.016,0.017,0.014,0.016],[0.090,0.016,0.013,0.028,0.012,0.017],[0.136,0.058,0.054,0.061,0.060,0.058],[0.104,0.046,0.039,0.040,0.039,0.037],[0.208,0.145,0.143,0.149,0.143,0.147],[0.296,0.206,0.210,0.206,0.211,0.202],[0.096,0.033,0.032,0.032,0.032,0.031],[0.085,0.013,0.012,0.012,0.011,0.011],[0.390,0.286,0.288,0.296,0.297,0.303],[0.454,0.368,0.359,0.349,0.346,0.347],[0.178,0.102,0.108,0.104,0.103,0.102],[0.202,0.125,0.118,0.118,0.118,0.116],[0.453,0.350,0.361,0.347,0.337,0.333],[0.596,0.470,0.495,0.488,0.468,0.472],[0.529,0.422,0.438,0.443,0.441,0.441],[0.550,0.481,0.488,0.491,0.467,0.475],[1.298,1.145,1.146,1.104,1.084,1.116],[0.897,0.732,0.781,0.719,0.709,0.714],[2.650,2.431,2.560,null,null,null],[null,null,null,null,null,null],[1.446,0.345,0.341,0.343,0.340,0.331],[1.803,0.407,0.405,0.413,0.402,0.406],[4.101,1.162,1.147,1.146,1.133,1.153],[4.989,0.603,0.587,0.607,0.598,0.608],[0.262,0.188,0.184,0.179,0.176,0.189],[0.232,0.108,0.110,0.124,0.126,0.126],[0.293,0.184,0.193,0.191,0.188,0.188],[1.479,0.507,0.516,0.496,0.509,0.486],[1.158,0.788,0.790,0.787,0.792,0.796],[1.778,1.588,1.574,1.587,1.617,1.575],[0.544,0.448,0.443,0.428,0.436,0.420],[0.715,0.589,0.566,0.566,0.579,0.569],[3.792,3.494,3.495,3.575,3.452,3.520],[2.175,1.770,1.806,1.754,1.796,1.749],[2.173,1.801,1.732,1.810,1.743,1.800],[1.006,0.895,0.898,0.892,0.916,0.918],[0.174,0.070,0.060,0.071,0.061,0.069],[0.093,0.027,0.026,0.025,0.028,0.026],[0.095,0.019,0.020,0.023,0.019,0.025],[0.244,0.141,0.142,0.130,0.124,0.132],[0.085,0.011,0.011,0.011,0.011,0.014],[0.079,0.012,0.009,0.009,0.012,0.013],[0.064,0.006,0.004,0.004,0.004,0.004],[0.858,0.075,0.080,0.074,0.068,0.073],[0.930,0.116,0.117,0.109,0.114,0.113],[0.259,0.056,0.051,0.051,0.049,0.060],[0.959,0.131,0.130,0.129,0.130,0.130],[0.518,0.033,0.033,0.032,0.032,0.032],[0.624,0.071,0.069,0.068,0.068,0.069],[0.661,0.113,0.111,0.111,0.109,0.108],[0.544,0.036,0.035,0.037,0.036,0.039],[0.593,0.057,0.060,0.059,0.059,0.061],[0.739,0.182,0.182,0.181,0.178,0.170],[1.115,0.265,0.259,0.268,0.264,0.261],[1.081,0.432,0.430,0.426,0.419,0.425],[0.881,0.066,0.076,0.076,0.076,0.076],[1.097,0.432,0.422,0.420,0.420,0.416],[4.057,2.234,2.232,2.225,2.244,2.210],[10.055,1.571,1.579,1.555,1.555,1.570],[3.811,2.218,2.226,2.215,2.230,2.236],[14.182,5.651,5.689,5.724,5.685,5.683],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.270,20.756,20.450,20.534,21.406,21.009],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.284,1.155,1.161,1.166,1.161,1.173],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.253,21.281,21.158,21.736,21.289,21.379],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.182,0.041,0.037,0.037,0.037,0.037],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.223,0.053,0.050,0.046,0.045,0.041],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.535,0.185,0.172,0.173,0.168,0.165],[0.488,0.159,0.164,0.142,0.147,0.157],[0.444,0.163,0.152,0.169,0.160,0.166],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.527,0.179,0.148,0.193,0.186,0.174],[0.527,0.188,0.189,0.144,0.183,0.192],[0.530,0.182,0.194,0.181,0.145,0.187],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.9.5.36","source":"results/19.9.5.36.json"} +,{"actual_version":"19.13.7.57","data_size":{"hits":14421460144,"job":1830084078,"mgbench":2958691295,"ontime":2702850997,"ssb":73373167844,"taxi":24214974446,"tpcds":18794495281,"tpch":17320054625,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":270,"job":25,"mgbench":61,"ontime":52,"ssb":1553,"taxi":811,"tpcds":281,"tpch":286,"uk":33},"machine":"c7a.4xlarge","release_date":"2019-11-06","result":[[0.073,0.010,0.014,0.021,0.013,0.014],[0.072,0.029,0.026,0.026,0.025,0.025],[0.055,0.009,0.011,0.009,0.011,0.009],[0.074,0.011,0.011,0.011,0.011,0.011],[0.053,0.024,0.022,0.022,0.022,0.024],[0.079,0.023,0.018,0.019,0.019,0.021],[0.045,0.007,0.007,0.007,0.007,0.006],[0.088,0.041,0.049,0.041,0.038,0.044],[0.095,0.055,0.052,0.047,0.048,0.049],[0.144,0.113,0.113,0.107,0.114,0.112],[0.572,0.580,0.639,0.544,0.562,0.583],[0.634,0.491,0.533,0.533,0.558,0.531],[0.043,0.004,0.009,0.005,0.004,0.006],[0.041,0.013,0.013,0.018,0.021,0.011],[1.233,1.072,1.099,1.129,1.094,1.115],[0.265,0.132,0.130,0.128,0.122,0.125],[0.048,0.022,0.022,0.022,0.021,0.019],[0.251,0.199,0.197,0.194,0.192,0.190],[6.465,2.278,2.272,2.099,1.978,2.120],[4.734,1.567,1.463,1.485,1.561,1.413],[4.785,1.557,1.564,1.548,1.496,1.521],[5.446,2.506,2.606,2.802,2.768,2.677],[6.298,2.076,2.049,2.121,2.121,2.181],[4.023,1.380,1.291,1.368,1.347,1.336],[0.077,0.041,0.042,0.041,0.042,0.043],[7.903,2.924,2.846,2.707,3.001,2.788],[2.424,1.431,1.425,1.395,1.560,1.553],[2.004,0.677,0.762,0.743,0.732,0.733],[0.046,0.028,0.028,0.027,0.028,0.025],[0.038,0.016,0.013,0.015,0.013,0.015],[0.113,0.085,0.075,0.085,0.085,0.088],[0.078,0.045,0.044,0.051,0.046,0.049],[0.186,0.154,0.146,0.144,0.165,0.165],[0.274,0.242,0.260,0.247,0.243,0.252],[0.064,0.052,0.051,0.049,0.046,0.047],[0.033,0.013,0.014,0.012,0.014,0.013],[0.387,0.325,0.370,0.298,0.294,0.321],[0.511,0.437,0.431,0.398,0.381,0.459],[0.139,0.113,0.125,0.128,0.130,0.138],[0.192,0.147,0.155,0.141,0.135,0.135],[0.492,0.436,0.410,0.400,0.375,0.399],[0.639,0.571,0.586,0.551,0.581,0.562],[0.590,0.575,0.549,0.495,0.504,0.517],[0.570,0.519,0.531,0.523,0.554,0.545],[1.572,1.258,1.299,1.282,1.246,1.242],[0.977,0.854,0.973,0.907,1.020,0.963],[3.133,2.945,2.890,3.241,3.129,2.925],[0.090,0.060,0.051,0.078,0.056,0.055],[1.434,0.479,0.442,0.454,0.436,0.423],[1.786,0.567,0.549,0.529,0.528,0.541],[4.094,1.401,1.347,1.292,1.301,1.296],[5.069,0.677,0.651,0.638,0.614,0.601],[0.350,0.244,0.228,0.249,0.256,0.243],[0.233,0.184,0.176,0.171,0.155,0.141],[0.247,0.228,0.233,0.224,0.219,0.221],[1.428,0.554,0.531,0.506,0.534,0.557],[1.070,0.790,0.762,0.775,0.778,0.788],[2.579,2.376,2.281,2.526,2.259,2.222],[0.543,0.465,0.459,0.458,0.474,0.475],[0.738,0.638,0.631,0.635,0.628,0.625],[3.980,3.459,3.498,3.804,3.798,3.755],[2.216,2.074,1.916,1.850,1.936,1.950],[2.266,2.022,2.017,2.105,2.118,2.108],[1.112,0.969,0.997,1.020,1.001,1.000],[0.225,0.088,0.097,0.107,0.084,0.076],[0.059,0.031,0.035,0.033,0.036,0.037],[0.077,0.040,0.043,0.027,0.024,0.032],[0.280,0.167,0.170,0.174,0.169,0.162],[0.049,0.012,0.016,0.016,0.015,0.014],[0.043,0.013,0.012,0.013,0.013,0.013],[0.028,0.006,0.006,0.006,0.006,0.006],[0.125,0.079,0.076,0.078,0.079,0.070],[0.163,0.107,0.100,0.103,0.108,0.102],[0.106,0.062,0.053,0.058,0.054,0.052],[0.186,0.154,0.154,0.144,0.153,0.154],[0.058,0.036,0.035,0.033,0.035,0.034],[0.109,0.071,0.068,0.069,0.068,0.064],[0.148,0.113,0.122,0.121,0.121,0.122],[0.044,0.021,0.021,0.023,0.025,0.020],[0.074,0.035,0.039,0.038,0.039,0.037],[0.234,0.189,0.195,0.186,0.176,0.175],[0.354,0.308,0.306,0.301,0.297,0.299],[0.614,0.542,0.535,0.538,0.531,0.530],[0.114,0.091,0.090,0.091,0.092,0.091],[0.566,0.448,0.456,0.457,0.480,0.497],[3.126,2.851,2.824,2.806,2.797,2.793],[8.440,1.792,1.672,1.677,1.771,1.797],[2.400,2.325,2.301,2.302,2.301,2.301],[12.656,5.964,6.091,5.958,5.983,5.990],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.009,19.873,20.016,20.258,20.041,19.879],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.314,1.251,1.248,1.257,1.242,1.245],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.913,20.261,20.346,20.678,20.452,20.672],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.346,21.289,21.671,20.529,20.784,20.316],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.127,0.050,0.048,0.047,0.049,0.047],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.228,0.076,0.070,0.069,0.071,0.071],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.576,0.218,0.223,0.213,0.223,0.222],[0.548,0.217,0.196,0.188,0.183,0.192],[0.526,0.196,0.189,0.161,0.206,0.194],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.616,0.245,0.242,0.265,0.237,0.262],[0.615,0.242,0.252,0.242,0.248,0.233],[0.572,0.255,0.256,0.234,0.249,0.236],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.13.7.57","source":"results/19.13.7.57.json"} +,{"actual_version":"19.11.14.1","data_size":{"hits":14408547690,"job":1830089086,"mgbench":2962381664,"ontime":2702850997,"ssb":73372540489,"taxi":24214963459,"tpcds":18792264503,"tpch":17319413908,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":234,"job":22,"mgbench":54,"ontime":47,"ssb":1362,"taxi":737,"tpcds":270,"tpch":280,"uk":29},"machine":"c7a.4xlarge","release_date":"2019-12-04","result":[[0.058,0.008,0.074,0.008,0.009,0.010],[0.057,0.023,0.023,0.022,0.023,0.023],[0.046,0.009,0.009,0.008,0.009,0.008],[0.049,0.018,0.012,0.010,0.011,0.009],[0.044,0.021,0.025,0.039,0.024,0.020],[0.068,0.017,0.016,0.017,0.016,0.022],[0.034,0.006,0.005,0.006,0.005,0.005],[0.069,0.032,0.031,0.031,0.033,0.032],[0.072,0.046,0.043,0.039,0.038,0.035],[0.106,0.087,0.092,0.083,0.085,0.084],[0.526,0.521,0.460,0.455,0.456,0.453],[0.574,0.437,0.422,0.417,0.417,0.435],[0.033,0.004,0.006,0.005,0.004,0.003],[0.033,0.010,0.008,0.009,0.009,0.008],[0.974,0.893,0.905,0.906,0.886,0.876],[0.264,0.119,0.117,0.113,0.115,0.117],[0.039,0.020,0.023,0.019,0.020,0.020],[0.202,0.156,0.157,0.155,0.158,0.155],[6.471,1.736,1.703,1.718,1.707,1.704],[4.732,1.259,1.270,1.254,1.258,1.255],[4.794,1.261,1.245,1.236,1.244,1.249],[5.453,2.137,2.156,2.151,2.134,2.166],[6.279,1.848,1.839,1.858,1.890,1.887],[4.074,1.189,1.217,1.183,1.177,1.189],[0.062,0.039,0.037,0.037,0.041,0.038],[7.942,2.435,2.401,2.409,2.408,2.402],[2.440,1.205,1.200,1.173,1.166,1.179],[2.000,0.645,0.643,0.646,0.650,0.649],[0.030,0.017,0.015,0.014,0.014,0.015],[0.028,0.012,0.011,0.011,0.012,0.011],[0.076,0.058,0.061,0.058,0.058,0.057],[0.062,0.040,0.037,0.036,0.036,0.037],[0.167,0.141,0.138,0.139,0.136,0.140],[0.243,0.210,0.209,0.211,0.204,0.207],[0.047,0.033,0.033,0.034,0.033,0.032],[0.026,0.012,0.011,0.012,0.011,0.011],[0.324,0.295,0.296,0.296,0.302,0.288],[0.394,0.344,0.358,0.345,0.354,0.349],[0.126,0.098,0.104,0.107,0.102,0.103],[0.150,0.119,0.117,0.120,0.119,0.118],[0.409,0.367,0.351,0.323,0.356,0.349],[0.497,0.479,0.447,0.443,0.446,0.460],[0.488,0.436,0.442,0.429,0.439,0.452],[0.514,0.474,0.459,0.449,0.458,0.467],[1.231,1.107,1.100,1.098,1.106,1.113],[0.801,0.749,0.793,0.743,0.750,0.771],[2.656,2.463,2.402,2.529,2.457,2.465],[0.092,0.040,0.059,0.048,0.040,0.054],[1.414,0.371,0.356,0.344,0.342,0.342],[1.750,0.434,0.415,0.411,0.412,0.407],[4.058,1.173,1.155,1.158,1.148,1.155],[5.040,0.585,0.570,0.568,0.585,0.565],[0.270,0.192,0.200,0.212,0.203,0.184],[0.162,0.142,0.115,0.116,0.140,0.118],[0.240,0.197,0.186,0.191,0.186,0.181],[1.422,0.475,0.476,0.477,0.480,0.469],[1.055,0.615,0.633,0.623,0.631,0.630],[1.711,1.625,1.618,1.626,1.644,1.635],[0.487,0.411,0.413,0.426,0.423,0.412],[0.657,0.563,0.555,0.557,0.563,0.539],[3.652,3.364,3.397,3.513,3.403,3.375],[2.131,1.717,1.679,1.705,1.712,1.705],[2.127,1.716,1.693,1.710,1.722,1.770],[0.871,0.772,0.788,0.787,0.793,0.807],[0.089,0.069,0.067,0.054,0.065,0.069],[0.052,0.030,0.029,0.039,0.033,0.029],[0.053,0.021,0.020,0.022,0.026,0.025],[0.218,0.130,0.129,0.129,0.131,0.125],[0.044,0.011,0.011,0.011,0.011,0.010],[0.035,0.009,0.009,0.009,0.010,0.011],[0.021,0.004,0.004,0.004,0.004,0.004],[0.120,0.057,0.062,0.057,0.059,0.060],[0.129,0.089,0.086,0.088,0.089,0.089],[0.089,0.051,0.048,0.042,0.042,0.042],[0.147,0.117,0.119,0.117,0.116,0.117],[0.044,0.026,0.024,0.023,0.023,0.025],[0.086,0.054,0.053,0.054,0.054,0.052],[0.131,0.096,0.097,0.094,0.094,0.091],[0.033,0.018,0.017,0.017,0.016,0.016],[0.054,0.025,0.028,0.026,0.027,0.028],[0.188,0.159,0.164,0.159,0.154,0.163],[0.269,0.238,0.236,0.235,0.241,0.236],[0.496,0.428,0.417,0.417,0.418,0.412],[0.089,0.056,0.067,0.065,0.068,0.068],[0.503,0.416,0.420,0.411,0.410,0.402],[2.410,2.362,2.358,2.387,2.374,2.377],[8.448,1.555,1.557,1.553,1.555,1.539],[2.287,2.241,2.221,2.221,2.410,2.220],[12.746,5.790,5.812,5.797,5.828,5.823],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.144,21.038,20.963,20.682,21.114,20.022],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.287,1.174,1.167,1.182,1.173,1.157],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[19.938,19.715,19.750,19.787,19.810,19.985],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[19.794,19.770,19.946,19.727,20.530,20.067],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.102,0.038,0.036,0.036,0.036,0.036],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.197,0.052,0.044,0.050,0.044,0.044],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.507,0.177,0.170,0.186,0.172,0.177],[0.457,0.165,0.163,0.176,0.131,0.160],[0.477,0.166,0.156,0.168,0.155,0.162],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.502,0.190,0.194,0.198,0.194,0.181],[0.509,0.199,0.196,0.197,0.194,0.197],[0.500,0.187,0.198,0.201,0.187,0.200],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.11.14.1","source":"results/19.11.14.1.json"} +,{"actual_version":"19.15.7.30","data_size":{"hits":14346715904,"job":1830084078,"mgbench":2958703705,"ontime":2702850997,"ssb":73372979516,"taxi":24214944292,"tpcds":18804897596,"tpch":17319747817,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":241,"job":26,"mgbench":57,"ontime":47,"ssb":1374,"taxi":751,"tpcds":271,"tpch":255,"uk":31},"machine":"c7a.4xlarge","release_date":"2019-12-29","result":[[0.078,0.010,0.010,0.011,0.009,0.010],[0.063,0.024,0.024,0.022,0.025,0.022],[0.051,0.009,0.013,0.009,0.009,0.011],[0.063,0.013,0.011,0.011,0.012,0.012],[0.049,0.022,0.020,0.020,0.022,0.020],[0.076,0.018,0.020,0.017,0.018,0.017],[0.030,0.004,0.004,0.004,0.005,0.004],[0.081,0.031,0.030,0.034,0.031,0.032],[0.075,0.040,0.039,0.039,0.034,0.041],[0.112,0.089,0.087,0.085,0.087,0.083],[0.499,0.487,0.513,0.504,0.504,0.507],[0.537,0.428,0.410,0.412,0.411,0.404],[0.032,0.005,0.005,0.004,0.004,0.005],[0.032,0.011,0.012,0.008,0.011,0.010],[0.977,0.934,0.939,0.921,0.899,0.894],[0.322,0.128,0.126,0.121,0.121,0.116],[0.047,0.020,0.023,0.021,0.019,0.019],[0.206,0.151,0.149,0.145,0.148,0.148],[6.473,1.757,1.740,1.828,1.857,1.780],[4.808,1.282,1.282,1.273,1.282,1.255],[4.804,1.300,1.343,1.261,1.273,1.473],[5.454,2.210,2.194,2.232,2.195,2.206],[6.273,1.761,1.713,1.720,1.721,1.731],[4.029,1.136,1.133,1.127,1.108,1.122],[0.061,0.038,0.036,0.038,0.039,0.037],[7.939,2.529,2.565,2.485,2.398,2.406],[2.439,1.161,1.149,1.143,1.134,1.139],[2.014,0.624,0.608,0.610,0.605,0.590],[0.024,0.010,0.010,0.012,0.010,0.010],[0.031,0.016,0.012,0.014,0.014,0.015],[0.045,0.027,0.030,0.028,0.027,0.027],[0.066,0.032,0.035,0.032,0.030,0.030],[0.159,0.128,0.130,0.130,0.137,0.133],[0.247,0.210,0.207,0.204,0.203,0.196],[0.035,0.018,0.017,0.018,0.017,0.016],[0.029,0.014,0.014,0.013,0.013,0.012],[0.330,0.307,0.283,0.306,0.283,0.289],[0.393,0.344,0.334,0.326,0.311,0.330],[0.130,0.105,0.107,0.101,0.104,0.103],[0.156,0.114,0.117,0.116,0.118,0.119],[0.400,0.360,0.358,0.344,0.355,0.338],[0.496,0.477,0.451,0.452,0.452,0.449],[0.473,0.437,0.427,0.447,0.447,0.453],[0.512,0.459,0.482,0.469,0.479,0.474],[1.218,1.145,1.141,1.100,1.115,1.111],[0.818,0.786,0.774,0.839,0.764,0.779],[2.915,2.543,2.586,2.462,2.502,null],[0.074,0.031,0.027,0.028,0.026,0.028],[1.405,0.369,0.358,0.345,0.342,0.338],[1.738,0.425,0.414,0.422,0.410,0.409],[4.022,1.153,1.152,1.133,1.135,1.139],[4.450,0.670,0.620,0.597,0.578,0.571],[0.240,0.206,0.198,0.191,0.192,0.188],[0.141,0.112,0.129,0.130,0.140,0.129],[0.233,0.194,0.189,0.183,0.190,0.188],[1.411,0.472,0.464,0.466,0.454,0.461],[1.059,0.628,0.619,0.621,0.618,0.628],[1.122,1.098,1.078,1.072,1.087,1.073],[0.462,0.399,0.402,0.414,0.406,0.396],[0.677,0.549,0.553,0.542,0.538,0.540],[3.650,3.337,3.377,3.405,3.404,3.472],[2.084,1.708,1.703,1.746,1.718,1.746],[2.075,1.731,1.732,1.704,1.694,1.750],[0.843,0.776,0.786,0.789,0.792,0.787],[0.121,0.089,0.088,0.074,0.074,0.078],[0.049,0.027,0.042,0.028,0.031,0.030],[0.064,0.048,0.033,0.027,0.025,0.027],[0.271,0.215,0.194,0.167,0.196,0.158],[0.048,0.023,0.012,0.032,0.012,0.022],[0.031,0.009,0.009,0.009,0.009,0.009],[0.014,0.003,0.003,0.003,0.003,0.003],[0.115,0.094,0.075,0.065,0.064,0.062],[0.136,0.094,0.089,0.093,0.091,0.091],[0.093,0.054,0.047,0.046,0.043,0.041],[0.148,0.123,0.119,0.121,0.122,0.118],[0.037,0.022,0.021,0.021,0.020,0.021],[0.090,0.057,0.054,0.058,0.054,0.053],[0.120,0.099,0.096,0.098,0.094,0.093],[0.031,0.019,0.020,0.017,0.017,0.017],[0.058,0.032,0.033,0.029,0.029,0.029],[0.179,0.149,0.144,0.146,0.151,0.150],[0.285,0.234,0.228,0.228,0.235,0.229],[0.487,0.422,0.424,0.411,0.408,0.404],[0.079,0.061,0.060,0.058,0.059,0.055],[0.471,0.376,0.365,0.362,0.361,0.366],[2.437,2.369,2.396,2.360,2.354,2.387],[8.444,1.811,1.811,1.821,1.813,1.822],[2.241,2.202,2.192,2.194,2.194,2.193],[12.658,5.578,5.557,5.559,5.545,5.575],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.326,20.307,20.386,20.363,20.524,20.305],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.109,0.927,0.930,0.925,0.926,0.935],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.036,21.361,20.778,20.556,20.659,20.827],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.112,0.046,0.051,0.045,0.045,0.045],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.687,0.208,0.194,0.200,0.168,0.197],[0.604,0.193,0.179,0.146,0.157,0.177],[0.595,0.187,0.190,0.162,0.188,0.186],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.692,0.218,0.221,0.232,0.230,0.235],[0.669,0.229,0.242,0.236,0.213,0.236],[0.667,0.231,0.202,0.207,0.222,0.236],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.15.7.30","source":"results/19.15.7.30.json"} +,{"actual_version":"19.16.19.85","data_size":{"hits":14412723890,"job":1830081157,"mgbench":2959085311,"ontime":2702850997,"ssb":73372571368,"taxi":24214985281,"tpcds":18786294863,"tpch":17319012497,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":231,"job":22,"mgbench":56,"ontime":48,"ssb":1380,"taxi":772,"tpcds":269,"tpch":270,"uk":30},"machine":"c7a.4xlarge","release_date":"2020-04-27","result":[[0.074,0.015,0.012,0.018,0.012,0.014],[0.071,0.030,0.027,0.031,0.026,0.027],[0.056,0.011,0.011,0.011,0.010,0.010],[0.066,0.014,0.012,0.013,0.013,0.012],[0.055,0.022,0.024,0.023,0.023,0.025],[0.079,0.022,0.020,0.022,0.019,0.022],[0.035,0.004,0.004,0.004,0.005,0.004],[0.081,0.040,0.036,0.042,0.055,0.036],[0.087,0.049,0.047,0.048,0.049,0.045],[0.117,0.097,0.094,0.096,0.094,0.095],[0.557,0.542,0.566,0.562,0.561,0.559],[0.550,0.444,0.426,0.429,0.419,0.428],[0.040,0.005,0.004,0.005,0.004,0.004],[0.038,0.018,0.010,0.010,0.011,0.017],[1.148,1.069,1.062,1.046,1.057,1.058],[0.348,0.142,0.142,0.136,0.140,0.136],[0.047,0.023,0.022,0.023,0.021,0.021],[0.226,0.173,0.162,0.166,0.166,0.166],[6.471,2.031,2.033,2.037,2.046,2.040],[4.952,1.510,1.471,1.468,1.470,1.468],[4.802,1.488,1.493,1.486,1.485,1.477],[5.499,2.891,2.790,2.619,2.560,2.567],[6.296,2.078,2.056,2.058,2.057,2.038],[4.037,1.284,1.263,1.335,1.342,1.490],[0.064,0.043,0.050,0.042,0.040,0.037],[7.915,2.852,2.792,2.805,2.763,2.733],[2.439,1.337,1.323,1.313,1.315,1.320],[2.008,0.730,0.711,0.697,0.698,0.707],[0.030,0.011,0.012,0.012,0.011,0.011],[0.037,0.016,0.014,0.015,0.013,0.016],[0.055,0.029,0.031,0.030,0.036,0.029],[0.077,0.039,0.036,0.038,0.037,0.036],[0.170,0.149,0.145,0.145,0.146,0.144],[0.277,0.230,0.233,0.234,0.226,0.224],[0.034,0.019,0.017,0.016,0.020,0.015],[0.037,0.020,0.021,0.024,0.018,0.021],[0.369,0.320,0.327,0.512,0.322,0.319],[0.421,0.378,0.383,0.380,0.359,0.376],[0.150,0.120,0.126,0.124,0.122,0.121],[0.167,0.136,0.141,0.134,0.133,0.136],[0.462,0.408,0.408,0.406,0.388,0.397],[0.572,0.498,0.496,0.507,0.515,0.507],[0.557,0.518,0.473,0.488,0.497,0.503],[0.535,0.486,0.512,0.486,0.472,0.480],[1.348,1.280,1.218,1.224,1.231,1.194],[0.879,0.803,0.871,0.788,0.791,0.809],[2.858,2.843,null,null,null,null],[0.083,0.039,0.032,0.032,0.032,0.030],[1.413,0.448,0.436,0.434,0.438,0.468],[1.750,0.504,0.488,0.493,0.496,0.487],[4.068,1.343,1.329,1.322,1.331,1.332],[5.082,0.805,0.690,0.722,0.659,0.680],[0.283,0.240,0.227,0.220,0.214,0.234],[0.178,0.147,0.155,0.164,0.150,0.157],[0.268,0.226,0.214,0.209,0.225,0.223],[1.420,0.570,0.572,0.565,0.555,0.555],[1.056,0.741,0.746,0.745,0.738,0.762],[1.256,1.239,1.233,1.233,1.227,1.228],[0.536,0.442,0.470,0.451,0.454,0.458],[0.761,0.617,0.616,0.621,0.618,0.614],[4.015,3.677,3.778,3.814,3.733,3.802],[2.215,1.928,1.920,1.963,1.985,1.925],[2.223,1.982,1.948,1.962,1.941,1.972],[0.925,0.902,0.874,0.871,0.877,0.904],[0.122,0.075,0.089,0.081,0.072,0.070],[0.060,0.030,0.030,0.030,0.034,0.027],[0.072,0.021,0.030,0.020,0.022,0.023],[0.226,0.183,0.143,0.150,0.149,0.120],[0.049,0.013,0.011,0.011,0.012,0.012],[0.039,0.012,0.011,0.009,0.026,0.010],[0.017,0.004,0.005,0.004,0.004,0.004],[0.119,0.067,0.080,0.067,0.073,0.068],[0.138,0.101,0.101,0.104,0.102,0.101],[0.092,0.061,0.052,0.051,0.046,0.048],[0.172,0.138,0.138,0.138,0.137,0.136],[0.041,0.024,0.024,0.023,0.024,0.026],[0.091,0.064,0.063,0.062,0.062,0.063],[0.137,0.113,0.108,0.108,0.111,0.105],[0.036,0.022,0.022,0.021,0.021,0.022],[0.060,0.034,0.034,0.033,0.035,0.037],[0.200,0.169,0.172,0.170,0.168,0.166],[0.328,0.263,0.260,0.261,0.267,0.261],[0.556,0.498,0.484,0.482,0.463,0.472],[0.089,0.065,0.067,0.065,0.062,0.067],[0.534,0.442,0.424,0.424,0.412,0.418],[2.847,2.827,2.805,2.812,2.810,2.776],[8.452,2.104,2.079,2.127,2.122,2.127],[2.694,2.607,2.608,2.641,2.594,2.599],[12.668,6.613,6.647,6.639,6.665,6.566],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.068,21.004,21.268,21.107,21.695,21.506],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.236,1.103,1.101,1.105,1.099,1.119],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.777,21.804,20.800,20.296,20.267,21.037],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.135,0.065,0.065,0.065,0.065,0.065],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.265,0.110,0.107,0.101,0.101,0.097],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.696,0.246,0.242,0.245,0.246,0.241],[0.673,0.243,0.238,0.236,0.242,0.237],[0.648,0.228,0.241,0.236,0.240,0.205],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.782,0.309,0.321,0.333,0.323,0.277],[0.848,0.292,0.316,0.301,0.329,0.308],[0.766,0.317,0.321,0.316,0.311,0.316],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.16.19.85","source":"results/19.16.19.85.json"} +,{"actual_version":"20.1.16.120","data_size":{"hits":14331832840,"job":1830089086,"mgbench":2958935148,"ontime":2702850997,"ssb":73372811215,"taxi":24214959523,"tpcds":18797206446,"tpch":17318512472,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":242,"job":20,"mgbench":55,"ontime":48,"ssb":1381,"taxi":835,"tpcds":254,"tpch":272,"uk":32},"machine":"c7a.4xlarge","release_date":"2020-06-26","result":[[0.273,0.011,0.011,0.012,0.011,0.010],[0.075,0.033,0.025,0.023,0.024,0.026],[0.061,0.009,0.010,0.014,0.010,0.009],[0.070,0.015,0.016,0.011,0.012,0.013],[0.056,0.025,0.024,0.022,0.023,0.022],[0.081,0.017,0.017,0.018,0.019,0.019],[0.039,0.004,0.004,0.004,0.004,0.004],[0.069,0.022,0.024,0.027,0.023,0.023],[0.073,0.039,0.039,0.036,0.034,0.037],[0.210,0.100,0.098,0.079,0.093,0.091],[0.505,0.485,0.499,0.499,0.495,0.418],[0.529,0.394,0.391,0.378,0.386,0.393],[0.040,0.005,0.005,0.005,0.004,0.004],[0.038,0.012,0.013,0.010,0.017,0.010],[0.987,0.916,0.907,0.905,0.914,0.900],[0.354,0.146,0.141,0.138,0.135,0.137],[0.055,0.026,0.024,0.025,0.022,0.024],[0.230,0.174,0.161,0.176,0.169,0.172],[6.465,1.922,1.924,1.938,1.932,1.948],[4.741,1.424,1.410,1.421,1.413,1.425],[4.801,1.430,1.403,1.436,1.403,1.409],[5.453,2.329,2.311,2.344,2.340,2.350],[6.267,1.996,1.972,1.975,1.963,1.964],[4.093,1.312,1.288,1.307,1.284,1.304],[0.191,0.162,0.056,0.066,0.164,0.158],[7.911,2.549,2.536,2.561,2.540,2.603],[2.414,1.232,1.217,1.201,1.216,1.204],[2.007,0.692,0.684,0.661,0.666,0.653],[0.037,0.002,0.004,0.002,0.001,0.002],[0.042,0.019,0.015,0.016,0.012,0.017],[0.052,0.033,0.029,0.030,0.028,0.030],[0.084,0.033,0.032,0.037,0.030,0.029],[0.172,0.080,0.120,0.130,0.117,0.112],[0.252,0.210,0.205,0.211,0.206,0.195],[0.044,0.014,0.014,0.015,0.016,0.014],[0.042,0.013,0.012,0.013,0.012,0.012],[0.347,0.285,0.303,0.297,0.295,0.296],[0.396,0.347,0.346,0.341,0.340,0.346],[0.175,0.127,0.130,0.126,0.113,0.121],[0.175,0.268,0.132,0.136,0.228,0.128],[0.520,0.402,0.583,0.391,0.397,0.389],[0.557,0.531,0.501,0.492,0.493,0.495],[0.557,0.468,0.443,0.445,0.461,0.452],[0.517,0.461,0.456,0.443,0.468,0.431],[1.235,1.134,1.092,1.100,1.088,1.086],[0.862,0.774,0.758,0.755,0.687,0.705],[2.589,2.419,2.496,2.429,2.319,2.539],[0.085,0.044,0.071,0.042,0.068,0.057],[1.419,0.418,0.413,0.389,0.393,0.411],[1.745,0.477,0.463,0.466,0.458,0.461],[4.047,1.239,1.225,1.219,1.219,1.211],[4.400,0.711,0.625,0.623,0.600,0.628],[0.248,0.146,0.146,0.142,0.140,0.144],[0.174,0.120,0.119,0.112,0.118,0.114],[0.208,0.149,0.146,0.149,0.139,0.141],[1.412,0.501,0.494,0.491,0.496,0.488],[1.062,0.676,0.664,0.672,0.673,0.672],[1.213,1.158,1.130,1.159,1.136,1.141],[0.507,0.430,0.440,0.451,0.415,0.409],[0.747,0.582,0.575,0.569,0.579,0.592],[3.809,3.535,3.515,3.586,3.486,3.516],[2.094,1.751,1.744,1.756,1.772,1.780],[2.117,1.763,1.760,1.767,1.776,1.797],[0.886,0.773,0.769,0.771,0.781,0.772],[0.172,0.119,0.109,0.108,0.097,0.108],[0.067,0.041,0.031,0.032,0.048,0.037],[0.090,0.034,0.038,0.035,0.030,0.029],[0.320,0.214,0.213,0.214,0.229,0.206],[0.053,0.011,0.013,0.013,0.011,0.012],[0.039,0.013,0.009,0.010,0.011,0.025],[0.036,0.003,0.003,0.003,0.003,0.003],[0.133,0.073,0.069,0.079,0.058,0.076],[0.139,0.098,0.091,0.103,0.071,0.095],[0.080,0.051,0.047,0.046,0.037,0.046],[0.174,0.137,0.138,0.136,0.132,0.135],[0.049,0.030,0.025,0.025,0.025,0.026],[0.093,0.061,0.062,0.059,0.060,0.058],[0.148,0.101,0.102,0.108,0.102,0.099],[0.039,0.020,0.034,0.018,0.018,0.034],[0.062,0.047,0.043,0.034,0.045,0.034],[0.226,0.181,0.181,0.185,0.180,0.164],[0.302,0.267,0.257,0.257,0.251,0.232],[0.482,0.408,0.398,0.376,0.384,0.391],[0.096,0.061,0.062,0.070,0.074,0.070],[0.535,0.439,0.442,0.427,0.427,0.421],[2.590,2.547,2.501,2.539,2.499,2.503],[8.470,2.077,2.075,2.075,2.037,2.031],[2.527,2.441,2.443,2.463,2.455,2.482],[12.672,5.984,5.996,5.976,6.074,6.008],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.435,4.321,4.310,4.393,4.335,4.321],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.205,1.022,1.010,1.016,1.023,1.015],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.736,2.595,2.579,2.583,2.579,2.593],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.681,2.539,2.556,2.582,2.561,2.613],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.688,1.524,1.480,1.481,1.477,1.484],[1.336,1.263,1.258,1.309,1.266,1.244],[1.488,1.441,1.411,1.440,1.487,1.473],[65.005,64.869,65.150,65.339,65.342,66.005],[17.703,17.603,17.771,17.862,17.676,17.808],[2.413,2.352,2.290,2.308,2.288,2.319],[null,null,null,null,null,null],[38.718,38.546,38.449,38.098,38.598,39.254],[38.807,37.579,37.418,37.143,36.928,36.965],[43.304,43.508,43.393,43.546,43.551,43.270],[6.527,6.529,6.562,6.484,6.639,6.616],[3.597,3.585,3.529,3.439,3.603,3.491],[7.069,7.195,7.318,7.275,7.168,7.128],[13.274,13.226,12.966,12.983,12.912,13.016],[13.169,13.270,13.312,13.603,13.482,12.888],[12.921,12.836,12.854,12.732,12.592,12.498],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.620,4.557,4.567,4.439,4.596,4.603],[null,null,null,null,null,null],[0.383,0.263,0.255,0.260,0.252,0.259],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.384,6.261,6.285,6.289,6.285,6.337],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.143,0.661,0.650,0.665,0.655,0.650],[1.081,0.635,0.641,0.647,0.640,0.638],[1.047,0.645,0.655,0.643,0.643,0.617],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.809,3.395,3.430,3.413,3.393,3.400],[3.850,3.430,3.355,3.398,3.404,3.400],[3.784,3.296,3.290,3.279,3.290,3.305],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.1.16.120","source":"results/20.1.16.120.json"} +,{"actual_version":"19.14.13.4","data_size":{"hits":14403454231,"job":1830084078,"mgbench":2958703705,"ontime":2702850997,"ssb":73372870683,"taxi":24214986487,"tpcds":18794469816,"tpch":17319919332,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":258,"job":23,"mgbench":61,"ontime":52,"ssb":1496,"taxi":824,"tpcds":264,"tpch":286,"uk":34},"machine":"c7a.4xlarge","release_date":"2020-07-21","result":[[0.070,0.012,0.012,0.012,0.010,0.010],[0.059,0.026,0.024,0.025,0.025,0.025],[0.048,0.010,0.012,0.015,0.010,0.010],[0.058,0.012,0.013,0.011,0.012,0.012],[0.053,0.023,0.023,0.027,0.020,0.022],[0.067,0.019,0.020,0.019,0.021,0.022],[0.030,0.004,0.004,0.005,0.004,0.004],[0.072,0.032,0.034,0.043,0.033,0.034],[0.076,0.050,0.057,0.055,0.054,0.042],[0.173,0.100,0.093,0.093,0.097,0.096],[0.522,0.536,0.566,0.562,0.551,0.555],[0.571,0.466,0.466,0.441,0.462,0.413],[0.033,0.004,0.005,0.005,0.004,0.004],[0.033,0.009,0.011,0.010,0.010,0.020],[1.113,1.096,1.044,1.034,0.994,1.021],[0.240,0.133,0.140,0.134,0.132,0.131],[0.044,0.023,0.024,0.021,0.020,0.021],[0.206,0.166,0.162,0.160,0.156,0.171],[6.468,2.125,2.032,1.983,1.918,1.954],[4.812,1.526,1.445,1.463,1.436,1.411],[4.806,1.426,1.447,1.483,1.508,1.386],[5.464,2.436,2.533,2.445,2.540,2.537],[6.275,1.988,2.050,1.998,2.022,2.011],[4.029,1.326,1.336,1.283,1.266,1.199],[0.061,0.043,0.041,0.040,0.040,0.040],[7.923,2.680,2.707,2.751,2.791,2.769],[2.435,1.325,1.309,1.224,1.229,1.227],[2.011,0.666,0.675,0.659,0.641,0.644],[0.026,0.012,0.011,0.010,0.011,0.011],[0.029,0.017,0.014,0.014,0.013,0.016],[0.053,0.029,0.027,0.029,0.027,0.029],[0.056,0.035,0.034,0.036,0.032,0.032],[0.162,0.142,0.141,0.146,0.146,0.149],[0.257,0.223,0.220,0.223,0.227,0.219],[0.032,0.018,0.016,0.017,0.018,0.015],[0.028,0.014,0.017,0.015,0.014,0.013],[0.350,0.308,0.312,0.313,0.308,0.323],[0.397,0.362,0.352,0.363,0.360,0.355],[0.132,0.114,0.112,0.116,0.115,0.109],[0.147,0.127,0.128,0.125,0.126,0.131],[0.425,0.373,0.388,0.377,0.379,0.370],[0.528,0.480,0.488,0.478,0.453,0.467],[0.510,0.477,0.501,0.440,0.461,0.468],[0.502,0.467,0.503,0.497,0.504,0.505],[1.221,1.217,1.213,1.209,1.202,1.233],[0.928,0.808,0.867,0.825,0.783,0.800],[2.733,2.453,2.467,2.522,2.698,null],[0.076,0.038,0.032,0.032,0.032,0.031],[1.433,0.419,0.423,0.412,0.402,0.414],[1.747,0.464,0.458,0.453,0.456,0.455],[4.058,1.209,1.210,1.184,1.191,1.195],[4.873,0.716,0.653,0.647,0.625,0.649],[0.244,0.207,0.203,0.203,0.195,0.201],[0.158,0.128,0.145,0.139,0.143,0.147],[0.240,0.198,0.196,0.194,0.200,0.200],[1.421,0.516,0.503,0.492,0.500,0.493],[1.058,0.670,0.666,0.676,0.670,0.675],[1.130,1.095,1.096,1.093,1.109,1.095],[0.455,0.430,0.421,0.427,0.403,0.416],[0.635,0.566,0.582,0.561,0.564,0.596],[3.707,3.418,3.445,3.515,3.506,3.497],[2.093,1.732,1.737,1.739,1.775,1.751],[2.125,1.781,1.756,1.726,1.745,1.754],[0.865,0.805,0.810,0.795,0.804,0.819],[0.150,0.096,0.108,0.085,0.101,0.102],[0.064,0.045,0.037,0.039,0.037,0.033],[0.075,0.031,0.036,0.039,0.036,0.041],[0.286,0.211,0.200,0.176,0.196,0.236],[0.044,0.015,0.021,0.016,0.016,0.016],[0.035,0.012,0.012,0.015,0.012,0.014],[0.016,0.004,0.010,0.005,0.005,0.005],[0.101,0.070,0.064,0.062,0.072,0.075],[0.132,0.095,0.091,0.099,0.095,0.094],[0.082,0.058,0.048,0.049,0.047,0.047],[0.158,0.131,0.130,0.131,0.130,0.132],[0.039,0.023,0.023,0.022,0.023,0.024],[0.081,0.059,0.060,0.057,0.058,0.058],[0.119,0.107,0.102,0.100,0.101,0.098],[0.033,0.018,0.019,0.020,0.017,0.018],[0.055,0.032,0.033,0.035,0.030,0.033],[0.180,0.162,0.157,0.154,0.163,0.159],[0.258,0.253,0.245,0.242,0.252,0.243],[0.516,0.452,0.449,0.450,0.440,0.441],[0.081,0.054,0.064,0.062,0.064,0.060],[0.485,0.413,0.388,0.392,0.391,0.394],[2.514,2.540,2.512,2.458,2.480,2.476],[8.439,2.011,1.997,1.962,1.930,1.925],[2.433,2.365,2.356,2.396,2.421,2.434],[12.657,6.140,6.073,6.020,6.015,6.194],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[19.707,19.752,19.631,19.625,19.622,19.772],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.104,1.002,1.020,1.002,1.009,1.057],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.750,20.687,20.610,20.190,20.226,20.816],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.551,20.385,20.392,20.251,20.313,20.282],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.128,0.063,0.062,0.063,0.063,0.062],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.639,0.277,0.279,0.271,0.242,0.265],[0.517,0.270,0.265,0.240,0.261,0.259],[0.472,0.241,0.230,0.253,0.246,0.256],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.624,0.345,0.336,0.350,0.338,0.331],[0.616,0.352,0.330,0.347,0.331,0.335],[0.626,0.327,0.314,0.328,0.317,0.299],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.14.13.4","source":"results/19.14.13.4.json"} +,{"actual_version":"19.17.10.1","data_size":{"hits":14356312587,"job":1830084078,"mgbench":2957715147,"ontime":2702850997,"ssb":73372995931,"taxi":24214954215,"tpcds":18783558169,"tpch":17321116702,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":236,"job":25,"mgbench":56,"ontime":46,"ssb":1357,"taxi":759,"tpcds":275,"tpch":265,"uk":31},"machine":"c7a.4xlarge","release_date":"2020-07-22","result":[[0.058,0.015,0.018,0.011,0.011,0.011],[0.059,0.024,0.024,0.022,0.031,0.027],[0.046,0.011,0.010,0.011,0.009,0.010],[0.053,0.011,0.010,0.013,0.013,0.049],[0.041,0.024,0.024,0.019,0.022,0.020],[0.064,0.020,0.019,0.019,0.017,0.018],[0.026,0.004,0.004,0.004,0.004,0.004],[0.071,0.034,0.032,0.042,0.031,0.032],[0.069,0.042,0.040,0.039,0.039,0.043],[0.117,0.098,0.094,0.089,0.094,0.089],[0.519,0.535,0.530,0.505,0.505,0.514],[0.497,0.402,0.385,0.391,0.384,0.384],[0.033,0.005,0.007,0.006,0.005,0.004],[0.031,0.011,0.012,0.011,0.010,0.009],[0.973,0.913,0.913,0.902,0.902,0.912],[0.206,0.124,0.126,0.123,0.121,0.122],[0.036,0.020,0.021,0.022,0.021,0.020],[0.194,0.149,0.154,0.163,0.157,0.154],[6.444,1.764,1.748,1.746,1.746,1.762],[4.715,1.278,1.265,1.269,1.269,1.272],[4.773,1.324,1.562,1.501,1.358,1.295],[5.428,2.198,2.194,2.201,2.169,2.187],[6.242,1.809,1.793,1.771,1.776,1.788],[4.007,1.133,1.103,1.113,1.113,1.109],[0.106,0.043,0.046,0.226,0.164,0.150],[7.917,2.509,2.431,2.412,2.363,2.383],[2.412,1.169,1.154,1.144,1.146,1.144],[1.978,0.638,0.646,0.625,0.626,0.630],[0.005,0.002,0.002,0.002,0.002,0.002],[0.026,0.015,0.013,0.013,0.014,0.015],[0.043,0.027,0.026,0.029,0.026,0.027],[0.051,0.034,0.033,0.030,0.030,0.033],[0.154,0.130,0.130,0.131,0.131,0.132],[0.232,0.206,0.206,0.206,0.201,0.212],[0.029,0.019,0.015,0.019,0.020,0.013],[0.026,0.015,0.013,0.014,0.017,0.013],[0.327,0.313,0.294,0.293,0.287,0.282],[0.375,0.339,0.335,0.331,0.348,0.326],[0.142,0.124,0.117,0.117,0.117,0.122],[0.146,0.124,0.125,0.131,0.130,0.124],[0.567,0.482,0.417,0.368,0.385,0.381],[0.555,0.507,0.506,0.506,0.484,0.489],[0.493,0.460,0.461,0.454,0.453,0.457],[0.476,0.461,0.445,0.449,0.438,0.445],[1.198,1.146,1.116,1.087,1.101,1.113],[0.842,0.795,0.737,0.721,0.752,0.793],[2.595,2.620,null,null,null,null],[0.074,0.033,0.032,0.033,0.028,0.029],[1.397,0.380,0.360,0.353,0.363,0.352],[1.736,0.430,0.439,0.423,0.424,0.421],[4.040,1.207,1.200,1.196,1.189,1.192],[4.423,0.687,0.620,0.662,0.597,0.638],[0.236,0.195,0.195,0.192,0.192,0.192],[0.155,0.120,0.132,0.144,0.113,0.117],[0.232,0.197,0.190,0.189,0.193,0.195],[1.395,0.497,0.480,0.480,0.476,0.470],[1.061,0.642,0.649,0.638,0.636,0.647],[1.148,1.116,1.106,1.110,1.101,1.104],[0.469,0.414,0.405,0.413,0.406,0.405],[0.636,0.557,0.578,0.562,0.569,0.546],[3.729,3.456,3.495,3.537,3.524,3.520],[2.071,1.775,1.783,1.805,1.852,1.801],[2.084,1.823,1.797,1.814,1.815,1.826],[0.878,0.787,0.802,0.795,0.808,0.807],[0.135,0.092,0.095,0.098,0.107,0.095],[0.051,0.039,0.031,0.031,0.040,0.035],[0.076,0.028,0.032,0.027,0.028,0.028],[0.260,0.165,0.181,0.185,0.166,0.166],[0.045,0.016,0.015,0.014,0.012,0.012],[0.035,0.015,0.009,0.011,0.024,0.011],[0.016,0.004,0.004,0.004,0.004,0.004],[0.122,0.084,0.074,0.068,0.064,0.074],[0.123,0.093,0.097,0.099,0.102,0.094],[0.085,0.055,0.049,0.046,0.047,0.040],[0.154,0.124,0.122,0.125,0.123,0.122],[0.040,0.022,0.022,0.022,0.021,0.023],[0.083,0.057,0.058,0.055,0.057,0.056],[0.118,0.099,0.099,0.096,0.097,0.095],[0.032,0.019,0.017,0.017,0.020,0.019],[0.054,0.030,0.033,0.030,0.033,0.034],[0.211,0.179,0.179,0.177,0.170,0.173],[0.261,0.253,0.245,0.244,0.243,0.240],[0.487,0.412,0.420,0.413,0.405,0.400],[0.084,0.056,0.067,0.066,0.066,0.067],[0.502,0.426,0.405,0.392,0.396,0.394],[2.409,2.334,2.323,2.341,2.339,2.314],[8.452,1.874,1.859,1.856,1.853,1.870],[2.310,2.272,2.275,2.283,2.289,2.294],[12.666,5.739,5.721,5.752,5.728,5.809],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.725,20.655,20.782,20.825,20.830,20.715],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.050,0.968,0.978,0.968,0.977,0.966],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.498,21.458,21.356,21.084,21.339,21.649],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.311,21.632,21.097,21.814,22.134,21.408],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.217,1.062,1.057,1.059,1.053,1.057],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.531,2.198,2.213,2.202,2.213,2.213],[2.495,2.212,2.215,2.209,2.203,2.215],[2.518,2.206,2.225,2.217,2.217,2.213],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[15.897,15.582,15.602,15.613,15.582,15.592],[15.895,15.617,15.591,15.559,15.609,15.598],[15.933,15.596,15.622,15.587,15.615,15.610],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"19.17.10.1","source":"results/19.17.10.1.json"} +,{"actual_version":"20.4.9.110","data_size":{"hits":14414950657,"job":1830089086,"mgbench":2961923374,"ontime":2702850997,"ssb":73372344445,"taxi":24214965837,"tpcds":18811521719,"tpch":17317091631,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":220,"job":20,"mgbench":54,"ontime":45,"ssb":1380,"taxi":820,"tpcds":266,"tpch":276,"uk":31},"machine":"c7a.4xlarge","release_date":"2020-08-20","result":[[0.085,0.025,0.018,0.012,0.010,0.010],[0.075,0.025,0.025,0.023,0.023,0.023],[0.054,0.010,0.011,0.018,0.010,0.010],[0.063,0.012,0.011,0.013,0.014,0.011],[0.051,0.021,0.020,0.021,0.022,0.021],[0.079,0.017,0.020,0.016,0.017,0.016],[0.037,0.005,0.004,0.004,0.004,0.004],[0.072,0.024,0.023,0.024,0.024,0.023],[0.076,0.033,0.038,0.037,0.034,0.044],[0.143,0.115,0.102,0.107,0.094,0.094],[0.492,0.484,0.489,0.494,0.484,0.486],[0.532,0.439,0.404,0.392,0.405,0.425],[0.040,0.006,0.007,0.006,0.004,0.005],[0.038,0.011,0.016,0.011,0.016,0.011],[0.994,0.919,0.905,0.920,0.879,0.854],[0.323,0.129,0.128,0.125,0.124,0.124],[0.049,0.021,0.022,0.023,0.020,0.020],[0.221,0.164,0.156,0.153,0.153,0.155],[6.536,1.966,1.982,2.101,1.953,2.000],[5.009,1.391,1.376,1.386,1.394,1.401],[4.794,1.453,1.412,1.333,1.336,1.374],[5.476,2.311,2.246,2.296,2.280,2.317],[6.276,1.826,1.839,1.943,1.830,1.896],[4.030,1.112,1.091,1.099,1.106,1.092],[0.065,0.035,0.037,0.035,0.036,0.035],[7.899,2.541,2.539,2.523,2.486,2.543],[2.406,1.168,1.194,1.180,1.185,1.225],[2.005,0.655,0.692,0.681,0.674,0.610],[0.035,0.003,0.002,0.004,0.002,0.002],[0.040,0.020,0.015,0.015,0.017,0.015],[0.053,0.035,0.031,0.032,0.031,0.032],[0.069,0.039,0.041,0.037,0.039,0.035],[0.171,0.139,0.147,0.148,0.141,0.143],[0.255,0.217,0.214,0.213,0.211,0.218],[0.038,0.016,0.015,0.014,0.015,0.014],[0.037,0.013,0.013,0.013,0.013,0.013],[0.334,0.302,0.297,0.291,0.303,0.284],[0.389,0.340,0.327,0.328,0.329,0.334],[0.160,0.133,0.126,0.127,0.122,0.126],[0.178,0.145,0.237,0.142,0.135,0.123],[0.489,0.459,0.410,0.406,0.392,0.374],[0.595,0.572,0.542,0.543,0.526,0.535],[0.528,0.502,0.464,0.475,0.464,0.489],[0.524,0.489,0.472,0.471,0.480,0.440],[1.227,1.134,1.102,1.121,1.114,1.070],[0.915,null,null,null,null,null],[null,null,null,null,null,null],[null,0.086,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,4.110,1.309,1.292,1.237,1.283],[4.885,0.746,0.635,0.668,0.646,0.628],[0.239,0.159,0.141,0.142,0.144,0.140],[0.173,0.139,0.120,0.128,0.119,0.115],[0.232,0.161,0.150,0.151,0.145,0.147],[1.448,0.516,0.499,0.506,0.491,0.504],[1.073,0.647,0.659,0.651,0.657,0.651],[1.216,1.135,1.331,1.176,1.160,1.230],[0.547,0.421,0.437,0.457,0.509,0.538],[0.775,null,null,null,null,null],[null,null,null,null,null,4.112],[2.136,1.865,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.043,0.030,0.010,0.014,0.014,0.026],[0.035,0.005,0.024,0.018,0.005,0.007],[0.129,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.055,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.518,0.425,0.395,0.399,0.393,0.396],[2.520,2.487,2.484,2.486,2.536,2.499],[8.463,2.039,1.968,1.996,2.024,2.025],[2.496,2.424,2.439,2.448,2.408,2.371],[12.672,6.162,6.233,6.292,6.309,6.212],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.699,1.011,1.011,0.999,1.011,0.998],[null,null,null,null,null,null],[18.673,19.202,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,1.149,1.110,1.097],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,2.519,2.475,2.474,2.468,2.443],[6.872,null,0.039,0.019,0.020,0.019],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.297,6.118,6.157,6.103,6.221,6.141],[2.332,2.234,2.248,2.255,2.276,2.201],[null,null,null,null,null,null],[34.377,34.082,33.834,33.732,33.918,33.781],[32.391,32.872,32.180,32.722,32.584,32.406],[38.382,37.693,37.833,38.353,38.134,38.215],[6.208,6.066,6.191,6.154,6.170,6.267],[3.380,3.334,3.314,3.368,3.341,3.401],[6.753,6.709,6.779,6.753,6.722,6.767],[12.288,12.217,null,null,12.267,12.393],[12.885,null,null,null,null,null],[12.776,12.705,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.646,4.494,4.551,4.495,4.539,null],[null,null,null,null,null,null],[0.244,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,3.174,3.185],[3.189,3.164,3.172,3.171,3.153,3.153],[3.078,3.056,3.059,3.059,3.088,3.071],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.4.9.110","source":"results/20.4.9.110.json"} +,{"actual_version":"20.5.5.74","data_size":{"hits":14365765852,"job":1830089086,"mgbench":2959085311,"ontime":2702850997,"ssb":73373024481,"taxi":24214980928,"tpcds":18798993176,"tpch":17320073817,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":230,"job":22,"mgbench":53,"ontime":48,"ssb":1490,"taxi":813,"tpcds":258,"tpch":276,"uk":32},"machine":"c7a.4xlarge","release_date":"2020-08-20","result":[[0.102,0.010,0.009,0.009,0.010,0.009],[0.076,0.022,0.026,0.022,0.022,0.023],[0.056,0.009,0.010,0.009,0.011,0.011],[0.064,0.012,0.011,0.012,0.011,0.010],[0.052,0.020,0.023,0.024,0.020,0.021],[0.082,0.016,0.015,0.016,0.017,0.017],[0.032,0.005,0.005,0.005,0.005,0.005],[0.072,0.024,0.023,0.022,0.022,0.022],[0.066,0.032,0.035,0.034,0.033,0.035],[0.126,0.099,0.093,0.089,0.085,0.087],[0.498,0.490,0.440,0.481,0.442,0.472],[0.527,0.394,0.367,0.366,0.372,0.371],[0.041,0.009,0.015,0.005,0.005,0.004],[0.042,0.040,0.021,0.026,0.009,0.010],[0.962,0.856,0.872,0.873,0.877,0.860],[0.416,0.117,0.122,0.115,0.119,0.115],[0.048,0.019,0.023,0.022,0.021,0.020],[0.203,0.139,0.141,0.138,0.137,0.133],[6.466,1.780,1.772,1.764,1.786,1.764],[4.754,1.315,1.353,1.358,1.347,1.281],[4.806,1.293,1.291,1.285,1.287,1.290],[5.449,2.200,2.184,2.187,2.197,2.167],[6.271,1.859,1.810,1.842,1.824,1.843],[4.032,1.029,1.027,1.018,1.019,1.025],[0.079,0.038,0.035,0.035,0.035,0.037],[7.895,2.401,2.387,2.401,2.410,2.396],[2.517,1.239,1.437,1.268,1.266,1.422],[2.013,0.618,0.622,0.621,0.619,0.626],[0.032,0.002,0.010,0.005,0.001,0.002],[0.051,0.013,0.012,0.012,0.013,0.012],[0.060,0.040,0.033,0.030,0.031,0.029],[0.065,0.033,0.030,0.028,0.030,0.029],[0.170,0.136,0.133,0.133,0.140,0.119],[0.247,0.208,0.209,0.209,0.207,0.207],[0.034,0.016,0.015,0.014,0.015,0.014],[0.035,0.014,0.013,0.012,0.012,0.013],[0.312,0.281,0.274,0.274,0.288,0.275],[0.381,0.323,0.313,0.311,0.316,0.330],[0.158,0.122,0.125,0.119,0.116,0.120],[0.184,0.122,0.118,0.122,0.120,0.121],[0.447,0.384,0.361,0.369,0.368,0.363],[0.556,0.483,0.492,0.473,0.472,0.473],[0.526,0.453,0.441,0.445,0.440,0.434],[0.515,0.463,0.429,0.437,0.425,0.434],[1.259,1.077,1.085,1.063,1.061,1.070],[0.881,0.747,0.734,0.752,0.740,0.763],[2.673,2.477,null,null,null,null],[0.073,0.026,0.026,0.026,0.026,0.037],[1.459,0.376,0.368,0.366,0.370,0.366],[1.774,0.409,0.416,0.407,0.417,0.404],[4.045,1.186,1.161,1.171,1.157,1.160],[4.641,0.630,0.620,0.629,0.606,0.609],[0.220,0.128,0.139,0.130,0.139,0.135],[0.182,0.116,0.110,0.108,0.111,0.107],[0.257,0.134,0.133,0.132,0.128,0.130],[1.421,0.471,0.465,0.462,0.470,0.464],[1.072,0.612,0.603,0.600,0.603,0.602],[1.120,1.066,1.069,1.065,1.072,1.072],[0.478,0.388,0.386,0.382,0.374,0.380],[0.814,0.558,0.569,0.554,0.561,0.538],[3.800,3.564,3.569,3.537,3.627,3.528],[2.103,1.758,1.748,1.728,1.738,1.748],[2.121,1.737,1.735,1.719,1.740,1.761],[0.907,0.771,0.765,0.787,0.762,0.786],[0.159,0.065,0.068,0.066,0.057,0.062],[0.078,0.043,0.043,0.025,0.047,0.030],[0.082,0.024,0.038,0.025,0.032,0.017],[0.189,0.143,0.145,0.109,0.113,0.108],[0.062,0.016,0.017,0.015,0.009,0.008],[0.046,0.010,0.012,0.007,0.008,0.014],[0.028,0.003,0.004,0.004,0.003,0.003],[0.143,0.076,0.067,0.070,0.068,0.069],[0.157,0.101,0.100,0.101,0.097,0.097],[0.086,0.051,0.045,0.039,0.040,0.040],[0.151,0.118,0.120,0.116,0.116,0.116],[0.044,0.021,0.023,0.022,0.021,0.020],[0.099,0.059,0.057,0.058,0.055,0.057],[0.138,0.097,0.099,0.093,0.095,0.093],[0.099,0.030,0.033,0.027,0.027,0.042],[0.119,0.032,0.032,0.029,0.035,0.029],[0.215,0.162,0.161,0.155,0.154,0.155],[0.360,0.256,0.245,0.246,0.246,0.255],[0.444,0.364,0.353,0.353,0.362,0.348],[0.095,0.076,0.072,0.075,0.069,0.072],[0.510,0.408,0.394,0.394,0.407,0.404],[2.413,2.363,2.368,2.350,2.345,2.357],[8.452,1.827,1.826,1.830,1.828,1.840],[2.213,2.157,2.150,2.159,2.147,2.156],[12.666,5.413,5.421,5.426,5.412,5.419],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.690,0.931,0.921,0.922,0.928,0.939],[null,null,null,null,null,null],[17.516,17.507,17.573,17.401,17.683,17.486],[null,null,null,null,null,null],[34.858,34.922,34.822,35.143,35.015,34.703],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[10.554,10.370,10.308,10.354,10.498,10.363],[1.403,1.336,1.364,1.340,1.334,1.317],[0.789,0.535,0.551,0.544,0.546,0.535],[null,null,null,null,null,null],[0.766,0.714,0.721,0.735,0.721,0.711],[null,null,null,null,null,null],[0.432,0.327,0.324,0.321,0.305,0.311],[null,null,null,null,null,null],[37.192,null,null,null,null,37.338],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.468,4.508,4.418,4.250,4.365,4.345],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.251,1.016,1.021,1.000,1.013,1.027],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.006,12.582,12.701,12.635,12.518,12.512],[null,null,null,null,null,null],[2.909,2.638,2.650,2.614,2.646,2.810],[null,null,null,null,null,null],[0.978,0.859,0.832,0.846,0.844,0.846],[0.986,0.881,0.862,0.803,0.819,0.851],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.849,12.531,12.571,12.660,12.614,12.595],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.807,12.622,12.546,12.705,12.530,12.594],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.307,1.210,1.245,1.242,1.232,1.229],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.122,1.990,2.015,2.018,2.021,1.998],[null,null,null,null,null,null],[2.508,2.475,2.348,2.334,2.376,2.370],[7.047,6.935,6.880,6.975,6.833,7.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.165,3.858,3.891,3.874,3.871,3.894],[null,null,null,null,null,null],[2.536,2.453,2.376,2.391,2.511,2.434],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.413,2.392,2.370,2.345,2.317,2.385],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.958,1.889,1.919,1.834,1.868,1.850],[null,null,null,null,null,null],[null,null,null,null,null,null],[20.580,20.858,20.654,20.169,20.700,20.509],[2.437,2.125,2.151,2.142,2.130,2.151],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.049,0.025,0.022,0.022,0.022,0.022],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.164,2.099,2.113,2.117,2.100,2.082],[null,null,null,null,null,null],[1.200,1.102,1.119,1.101,1.127,1.100],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.295,0.227,0.218,0.215,0.217,0.218],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.436,3.231,3.284,3.236,3.216,3.218],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.442,0.360,0.361,0.360,0.358,0.358],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.239,3.115,3.159,3.090,3.103,3.125],[null,null,null,null,null,null],[1.552,1.469,1.491,1.483,1.496,1.536],[1.349,1.268,1.327,1.247,1.283,1.230],[1.516,1.450,1.407,1.455,1.461,1.427],[17.674,17.492,17.875,17.653,18.073,17.856],[6.098,5.865,6.034,5.992,5.884,5.996],[2.281,2.186,2.280,2.209,2.289,2.269],[null,null,null,null,null,null],[33.468,32.973,33.239,33.077,33.149,32.987],[31.849,31.532,31.438,31.612,31.818,31.906],[37.872,37.863,38.036,37.533,37.656,37.549],[6.281,6.267,6.270,6.245,6.418,6.350],[3.373,3.352,3.331,3.251,3.328,3.346],[6.852,6.967,6.734,6.832,6.657,6.546],[12.484,12.224,12.264,12.178,12.175,12.260],[12.939,12.917,12.746,12.792,13.030,12.841],[13.023,12.757,12.742,12.488,12.441,12.458],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[63.450,63.476,63.481,63.557,63.403,63.986],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.563,4.441,4.433,4.447,4.490,4.567],[5.344,5.389,5.260,5.284,5.292,5.301],[0.247,0.218,0.218,0.222,0.218,0.223],[0.242,0.240,0.217,0.216,0.225,0.223],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.666,5.328,5.244,5.263,5.325,5.221],[null,null,null,null,null,null],[5.595,5.173,5.206,5.280,5.266,5.128],[5.116,4.821,4.756,4.753,4.735,4.762],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.575,5.418,5.400,5.490,5.394,5.396],[4.345,3.793,3.705,3.727,3.749,3.787],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.655,12.277,12.312,12.303,12.307,12.245],[0.139,0.111,0.116,0.112,0.111,0.113],[9.108,8.698,8.702,8.632,8.639,8.701],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.471,0.452,0.450,0.448,0.453,0.452],[0.473,0.451,0.449,0.447,0.449,0.449],[0.475,0.454,0.448,0.447,0.449,0.454],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.238,3.227,3.217,3.232,3.223,3.255],[3.239,3.233,3.218,3.230,3.232,3.225],[3.151,3.121,3.134,3.114,3.134,3.118],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.547,1.494,1.480,1.411,1.482,1.508],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.5.5.74","source":"results/20.5.5.74.json"} +,{"actual_version":"20.7.4.11","data_size":{"hits":14382051195,"job":1830089086,"mgbench":2958309689,"ontime":2702850997,"ssb":73373326340,"taxi":24215001806,"tpcds":18816239725,"tpch":17315728445,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":269,"job":29,"mgbench":67,"ontime":61,"ssb":1771,"taxi":1020,"tpcds":292,"tpch":319,"uk":40},"machine":"c7a.4xlarge","release_date":"2020-10-09","result":[[0.076,0.011,0.011,0.010,0.010,0.011],[0.066,0.024,0.031,0.026,0.028,0.026],[0.054,0.012,0.010,0.011,0.013,0.010],[0.056,0.016,0.016,0.014,0.013,0.011],[0.046,0.027,0.022,0.025,0.026,0.026],[0.075,0.020,0.020,0.022,0.018,0.019],[0.029,0.006,0.005,0.008,0.006,0.006],[0.063,0.029,0.029,0.028,0.031,0.026],[0.077,0.047,0.044,0.043,0.039,0.043],[0.139,0.118,0.108,0.095,0.110,0.108],[0.623,0.613,0.608,0.477,0.505,0.559],[0.611,0.494,0.477,0.478,0.471,0.484],[0.034,0.013,0.018,0.034,0.013,0.006],[0.103,0.014,0.051,0.032,0.017,0.015],[1.160,1.098,1.102,1.084,1.091,1.038],[0.242,0.153,0.152,0.158,0.148,0.172],[0.054,0.031,0.026,0.034,0.026,0.025],[0.246,0.186,0.181,0.171,0.178,0.188],[6.488,2.260,2.155,2.062,2.252,2.401],[4.801,1.629,1.586,1.445,1.604,1.567],[4.810,1.465,1.511,1.642,1.604,1.491],[5.453,2.866,2.876,2.870,3.023,2.736],[6.276,2.283,2.311,2.379,2.246,2.330],[4.056,1.305,1.252,1.340,1.332,1.362],[0.075,0.047,0.048,0.053,0.047,0.044],[7.920,3.259,3.276,3.250,3.150,3.010],[2.434,1.385,1.287,1.269,1.259,1.287],[2.001,0.679,0.700,0.696,0.699,0.701],[0.019,0.002,0.002,0.002,0.003,0.002],[0.037,0.015,0.017,0.014,0.015,0.015],[0.052,0.044,0.035,0.032,0.035,0.030],[0.079,0.048,0.034,0.035,0.033,0.036],[0.174,0.147,0.134,0.148,0.142,0.132],[0.269,0.407,0.234,0.252,0.243,0.245],[0.035,0.020,0.019,0.018,0.018,0.017],[0.032,0.017,0.014,0.015,0.015,0.015],[0.345,0.321,0.305,0.326,0.321,0.329],[0.413,0.370,0.371,0.378,0.381,0.368],[0.169,0.144,0.158,0.147,0.150,0.147],[0.191,0.157,0.141,0.132,0.147,0.136],[0.477,0.427,0.447,0.421,0.430,0.456],[0.659,0.581,0.596,0.571,0.638,0.652],[0.624,0.583,0.570,0.578,0.601,0.570],[0.685,0.603,0.576,0.562,0.563,0.587],[1.609,1.408,1.353,1.260,1.235,1.198],[0.939,0.812,0.844,0.847,0.842,0.891],[3.360,3.025,2.864,3.000,2.964,2.873],[0.319,0.105,0.040,0.057,0.036,0.061],[1.492,0.489,0.480,0.468,0.497,0.473],[1.795,0.517,0.514,0.510,0.557,0.544],[4.080,1.618,1.616,1.589,1.614,1.618],[4.598,0.848,0.830,0.817,0.832,0.862],[0.312,0.175,0.173,0.169,0.166,0.187],[0.254,0.166,0.147,0.150,0.144,0.145],[0.277,0.192,0.183,0.184,0.179,0.185],[1.431,0.614,0.612,0.610,0.620,0.613],[1.071,0.849,0.858,0.839,0.860,0.839],[1.378,1.294,1.318,1.329,1.179,1.425],[0.562,0.496,0.546,0.529,0.568,0.578],[1.097,0.941,0.815,0.825,0.832,1.029],[5.168,5.011,4.734,4.550,4.516,4.513],[2.555,2.337,2.248,2.171,2.286,2.310],[2.474,2.272,2.302,2.353,2.270,2.259],[1.150,1.016,1.020,0.988,0.925,0.916],[0.218,0.171,0.139,0.141,0.110,0.111],[0.135,0.041,0.045,0.059,0.040,0.036],[0.110,0.035,0.041,0.077,0.040,0.065],[0.325,0.202,0.203,0.177,0.165,0.202],[0.051,0.020,0.023,0.025,0.033,0.015],[0.040,0.024,0.014,0.015,0.014,0.013],[0.031,0.012,0.018,0.011,0.008,0.023],[0.127,0.088,0.087,0.086,0.095,0.087],[0.159,0.119,0.110,0.129,0.118,0.115],[0.107,0.069,0.061,0.058,0.060,0.056],[0.216,0.175,0.182,0.171,0.168,0.174],[0.052,0.030,0.044,0.029,0.028,0.028],[0.110,0.085,0.082,0.084,0.083,0.082],[0.153,0.125,0.122,0.124,0.125,0.122],[0.049,0.033,0.028,0.033,0.029,0.032],[0.098,0.052,0.053,0.052,0.051,0.048],[0.217,0.194,0.191,0.194,0.187,0.192],[0.336,0.312,0.288,0.292,0.282,0.278],[0.615,0.507,0.514,0.513,0.515,0.519],[0.131,0.099,0.104,0.099,0.102,0.110],[0.627,0.536,0.541,0.544,0.532,0.541],[3.289,3.143,3.088,2.965,2.732,2.866],[8.459,1.307,1.292,1.297,1.319,1.287],[2.520,2.451,2.433,2.448,2.432,2.459],[12.663,6.337,6.317,6.346,6.339,6.345],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.646,0.959,0.956,0.951,0.950,0.962],[null,null,null,null,null,null],[18.461,18.246,18.495,18.483,18.192,18.217],[null,null,null,null,null,null],[36.050,36.031,36.609,36.212,36.602,36.456],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[10.955,10.950,11.007,11.109,11.035,12.325],[1.535,1.484,1.379,1.441,1.381,1.409],[0.707,0.589,0.619,0.624,0.627,0.612],[null,null,null,null,null,null],[0.852,0.855,0.868,0.792,0.819,0.801],[null,null,null,null,null,null],[0.434,0.345,0.379,0.370,0.366,0.353],[null,null,null,null,null,null],[36.660,null,36.368,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.100,4.175,4.154,4.166,4.666,4.776],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.481,1.283,1.208,1.071,1.109,1.078],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.171,13.058,13.044,13.012,13.229,13.120],[null,null,null,null,null,null],[2.974,2.749,2.724,2.737,2.762,2.778],[null,null,null,null,null,null],[0.913,0.862,0.802,0.832,0.841,0.830],[1.035,1.020,0.990,0.995,0.933,0.950],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.259,13.028,13.122,13.062,13.086,12.971],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.184,1.136,1.124,1.134,1.116,1.116],[13.250,13.118,13.338,13.089,13.079,12.971],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.310,1.264,1.266,1.281,1.261,1.245],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.211,2.108,2.127,2.112,2.141,2.134],[null,null,null,null,null,null],[2.526,2.367,2.382,2.492,2.435,2.408],[7.008,7.012,7.073,7.112,7.030,7.000],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.226,4.031,4.098,4.107,4.093,4.056],[null,null,null,null,null,null],[2.540,2.392,2.464,2.393,2.384,2.425],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.545,2.474,2.399,2.432,2.405,2.367],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.029,1.961,1.937,2.015,1.917,1.946],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.482,21.444,20.932,20.965,21.331,23.211],[2.535,2.372,2.375,2.279,2.232,2.206],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.035,0.015,0.020,0.022,0.016,0.019],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.168,2.088,2.125,2.140,2.135,2.157],[null,null,null,null,null,null],[1.227,1.149,1.129,1.172,1.108,1.124],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.323,0.245,0.249,0.244,0.245,0.245],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.369,3.274,3.270,3.248,3.261,3.243],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.466,0.387,0.396,0.397,0.394,0.392],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.288,3.232,3.246,3.272,3.256,3.169],[null,null,null,null,null,null],[1.576,1.517,1.469,1.568,1.496,1.491],[1.346,1.325,1.373,1.332,1.356,1.329],[1.533,1.527,1.553,1.544,1.560,1.453],[18.949,18.961,18.757,18.899,18.759,20.124],[6.545,6.229,6.337,6.352,6.266,6.332],[2.440,2.333,2.297,2.350,2.391,2.496],[null,null,null,null,null,null],[35.307,34.769,35.457,39.178,41.345,41.132],[37.138,34.442,34.618,33.291,33.710,33.757],[39.808,40.158,40.315,39.746,39.613,39.942],[6.560,6.371,6.403,6.447,6.336,6.481],[3.380,3.317,3.347,3.307,3.287,3.376],[6.884,6.911,7.024,6.987,7.018,7.429],[13.054,12.482,12.435,12.140,12.717,12.701],[13.032,12.360,12.098,12.234,12.190,12.147],[12.368,12.050,12.525,12.695,12.376,12.135],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[69.730,68.857,68.571,70.730,71.289,71.222],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.804,4.667,4.650,4.742,4.530,4.555],[5.716,5.502,5.708,5.550,5.592,5.527],[0.226,0.203,0.213,0.195,0.194,0.199],[0.228,0.209,0.212,0.207,0.201,0.202],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.029,5.707,5.670,5.707,5.490,5.586],[null,null,null,null,null,null],[5.891,5.598,5.709,5.772,5.632,5.647],[5.351,5.222,5.163,5.176,5.082,5.159],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.954,5.954,5.842,6.017,5.831,6.227],[4.308,3.980,4.028,3.929,4.079,4.011],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.251,13.035,13.229,13.218,12.991,12.949],[0.126,0.110,0.102,0.108,0.107,0.108],[9.421,9.241,9.173,9.160,9.194,9.185],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.412,0.392,0.402,0.403,0.398,0.406],[0.426,0.398,0.397,0.397,0.402,0.399],[0.424,0.416,0.411,0.399,0.392,0.398],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.046,3.018,3.005,3.014,3.014,2.998],[3.024,2.980,2.992,2.994,3.013,3.004],[2.919,2.901,2.906,2.898,2.906,2.921],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.634,1.577,1.599,1.542,1.566,1.541],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.7.4.11","source":"results/20.7.4.11.json"} +,{"actual_version":"20.3.21.2","data_size":{"hits":14377973192,"job":1830084078,"mgbench":2959117059,"ontime":2702850997,"ssb":73372758184,"taxi":24214978461,"tpcds":18792727214,"tpch":17319546747,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":237,"job":22,"mgbench":57,"ontime":46,"ssb":1378,"taxi":832,"tpcds":257,"tpch":276,"uk":31},"machine":"c7a.4xlarge","release_date":"2020-11-02","result":[[0.101,0.021,0.012,0.017,0.010,0.010],[0.078,0.024,0.024,0.024,0.023,0.025],[0.058,0.012,0.010,0.011,0.009,0.010],[0.072,0.011,0.011,0.013,0.012,0.012],[0.055,0.023,0.022,0.021,0.027,0.021],[0.081,0.017,0.016,0.019,0.017,0.019],[0.045,0.006,0.005,0.005,0.004,0.004],[0.075,0.028,0.025,0.023,0.023,0.024],[0.082,0.039,0.042,0.042,0.034,0.038],[0.140,0.105,0.104,0.090,0.094,0.088],[0.490,0.476,0.487,0.469,0.482,0.478],[0.520,0.414,0.384,0.402,0.373,0.375],[0.048,0.006,0.006,0.006,0.006,0.004],[0.047,0.014,0.011,0.011,0.011,0.012],[0.966,0.902,0.884,0.892,0.880,0.886],[0.260,0.138,0.147,0.147,0.128,0.133],[0.056,0.027,0.028,0.025,0.023,0.022],[0.214,0.155,0.152,0.152,0.159,0.154],[6.491,1.916,1.888,1.908,1.849,1.891],[4.744,1.387,1.387,1.283,1.372,1.366],[4.813,1.488,1.473,1.383,1.372,1.407],[5.472,2.546,2.766,2.703,2.580,2.538],[6.306,1.952,1.936,1.825,1.938,1.864],[4.035,1.222,1.218,1.204,1.202,1.202],[0.068,0.034,0.043,0.039,0.039,0.038],[7.916,2.580,2.752,2.724,2.427,2.414],[2.491,1.218,1.295,1.286,1.254,1.255],[2.023,0.675,0.624,0.623,0.632,0.630],[0.044,0.002,0.003,0.003,0.002,0.009],[0.047,0.019,0.017,0.018,0.017,0.013],[0.055,0.028,0.031,0.027,0.028,0.028],[0.062,0.036,0.033,0.037,0.032,0.032],[0.168,0.118,0.111,0.111,0.106,0.096],[0.246,0.204,0.207,0.172,0.213,0.203],[0.045,0.018,0.016,0.017,0.017,0.016],[0.046,0.014,0.015,0.014,0.014,0.014],[0.312,0.270,0.269,0.268,0.280,0.271],[0.353,0.332,0.331,0.324,0.322,0.324],[0.151,0.120,0.118,0.118,0.107,0.114],[0.164,0.130,0.132,0.126,0.122,0.126],[0.477,0.402,0.400,0.397,0.402,0.397],[0.560,0.509,0.494,0.511,0.541,0.535],[0.537,0.500,0.443,0.457,0.440,0.453],[0.547,0.490,0.499,0.500,0.482,0.487],[1.275,1.207,1.158,1.208,1.204,1.162],[0.872,0.825,0.837,0.836,0.769,0.781],[2.709,null,null,null,null,null],[0.079,0.035,0.031,0.030,0.030,0.029],[1.412,0.401,0.388,0.368,0.368,0.371],[1.761,0.446,0.434,0.443,0.433,0.442],[4.061,1.300,1.238,1.207,1.232,1.220],[4.621,0.678,0.660,0.651,0.629,0.625],[0.190,0.145,0.142,0.140,0.136,0.139],[0.150,0.119,0.113,0.119,0.111,0.112],[0.188,0.143,0.142,0.145,0.140,0.140],[1.429,0.523,0.503,0.515,0.509,0.528],[1.061,0.725,0.729,0.747,0.752,0.750],[1.252,1.304,1.284,1.273,1.296,1.291],[0.490,0.483,0.468,0.492,0.474,0.471],[0.696,0.601,0.613,0.639,0.666,0.650],[4.257,null,null,null,null,null],[2.329,1.841,1.760,1.765,1.801,1.820],[2.099,1.824,1.802,1.799,1.778,1.797],[0.849,0.801,0.755,0.765,0.768,0.767],[0.148,0.084,0.083,0.085,0.077,0.066],[0.051,0.027,0.050,0.036,0.035,0.027],[0.081,0.032,0.032,0.040,0.030,0.032],[0.263,0.172,0.164,0.158,0.169,0.165],[0.049,0.010,0.019,0.016,0.011,0.012],[0.038,0.009,0.011,0.012,0.009,0.015],[0.035,0.004,0.007,0.015,0.004,0.006],[0.139,0.088,0.068,0.066,0.066,0.063],[0.138,0.091,0.090,0.091,0.073,0.094],[0.077,0.052,0.047,0.044,0.045,0.043],[0.160,0.126,0.125,0.126,0.123,0.126],[0.047,0.024,0.025,0.025,0.025,0.024],[0.097,0.061,0.064,0.060,0.061,0.060],[0.133,0.094,0.098,0.097,0.099,0.099],[0.080,0.032,0.033,0.032,0.029,0.031],[0.075,0.030,0.031,0.031,0.032,0.047],[0.201,0.171,0.160,0.159,0.158,0.156],[0.274,0.246,0.256,0.213,0.234,0.229],[0.460,0.383,0.361,0.362,0.359,0.364],[0.089,0.067,0.068,0.057,0.067,0.068],[0.522,0.429,0.398,0.404,0.405,0.407],[2.387,2.343,2.371,2.337,2.359,2.368],[8.454,1.939,1.932,1.926,1.947,1.940],[2.329,2.261,2.251,2.268,2.268,2.258],[12.664,5.674,5.669,5.664,5.661,5.627],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.347,4.320,4.330,4.374,4.298,4.327],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.081,0.975,0.956,0.957,0.968,0.977],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.729,12.454,12.611,12.545,12.548,12.637],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.866,12.565,12.717,12.700,12.570,12.719],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.897,1.822,1.833,1.802,1.814,1.801],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.103,2.027,2.005,2.043,2.037,2.009],[null,null,null,null,null,null],[2.558,2.507,2.520,2.529,2.548,2.536],[6.958,6.915,6.948,6.950,6.915,7.029],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.553,2.529,2.544,2.554,2.561,2.535],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.451,2.452,2.421,2.492,2.475,2.418],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.884,1.820,1.817,1.823,1.804,1.857],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.426,1.930,1.908,2.000,1.958,1.926],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.050,0.021,0.020,0.021,0.020,0.020],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.848,2.809,2.810,2.818,2.813,2.800],[null,null,null,null,null,null],[1.202,1.111,1.077,1.076,1.098,1.104],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.285,0.242,0.229,0.228,0.240,0.224],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.878,1.794,1.836,1.797,1.804,1.805],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.404,0.345,0.338,0.339,0.338,0.334],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.146,3.059,3.086,3.156,3.120,3.021],[null,null,null,null,null,null],[1.498,1.432,1.407,1.448,1.435,1.447],[1.300,1.243,1.265,1.262,1.253,1.266],[1.522,1.461,1.505,1.539,1.420,1.473],[62.104,62.208,61.848,62.090,62.357,63.002],[17.413,17.363,17.613,17.356,17.233,17.351],[2.447,2.364,2.313,2.287,2.246,2.316],[null,null,null,null,null,null],[36.573,36.470,36.327,36.220,36.465,36.390],[35.326,35.911,35.732,35.745,35.796,35.703],[40.972,40.542,40.981,41.083,41.019,41.082],[6.366,6.165,6.434,6.280,6.442,6.284],[3.428,3.367,3.389,3.457,3.505,3.335],[6.823,6.746,6.676,6.703,6.830,6.811],[12.397,12.354,12.431,12.499,12.748,12.722],[12.958,12.776,12.793,12.818,12.850,12.938],[12.861,12.623,12.623,12.872,12.973,12.976],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.764,4.642,4.728,4.689,4.719,4.621],[null,null,null,null,null,null],[0.240,0.207,0.207,0.205,0.202,0.219],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.743,5.723,5.711,5.975,5.918,6.113],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.456,0.419,0.431,0.418,0.430,0.424],[0.454,0.420,0.420,0.425,0.424,0.425],[0.449,0.420,0.421,0.421,0.419,0.420],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.021,2.991,3.010,2.985,2.997,2.986],[3.028,2.979,2.994,2.976,2.994,2.988],[2.933,2.903,2.904,2.903,2.899,2.916],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.3.21.2","source":"results/20.3.21.2.json"} +,{"actual_version":"20.9.7.11","data_size":{"hits":14398077256,"job":1830089086,"mgbench":2958703705,"ontime":2702850997,"ssb":73372638932,"taxi":24214960345,"tpcds":18795109363,"tpch":17320361121,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":212,"job":22,"mgbench":53,"ontime":48,"ssb":1514,"taxi":899,"tpcds":242,"tpch":256,"uk":32},"machine":"c7a.4xlarge","release_date":"2020-12-07","result":[[0.101,0.008,0.016,0.010,0.008,0.035],[0.070,0.023,0.022,0.022,0.021,0.027],[0.056,0.010,0.009,0.009,0.009,0.010],[0.067,0.011,0.011,0.010,0.022,0.011],[0.053,0.024,0.023,0.019,0.022,0.019],[0.077,0.016,0.018,0.016,0.015,0.016],[0.036,0.005,0.005,0.005,0.005,0.005],[0.071,0.023,0.024,0.022,0.025,0.022],[0.074,0.037,0.037,0.036,0.032,0.041],[0.124,0.091,0.092,0.083,0.087,0.085],[0.492,0.502,0.464,0.467,0.468,0.474],[0.510,0.386,0.402,0.375,0.375,0.370],[0.044,0.005,0.005,0.005,0.011,0.005],[0.083,0.036,0.063,0.009,0.011,0.021],[0.951,0.847,0.852,0.848,0.856,0.850],[0.382,0.125,0.119,0.121,0.126,0.119],[0.046,0.025,0.022,0.023,0.018,0.021],[0.236,0.140,0.146,0.137,0.140,0.154],[6.528,1.767,1.772,1.769,1.878,1.932],[4.916,1.237,1.249,1.259,1.252,1.226],[4.829,1.253,1.248,1.231,1.236,1.234],[5.498,2.088,2.064,2.097,2.086,2.088],[6.324,1.862,1.881,1.910,1.808,1.841],[4.111,1.022,1.013,1.003,1.022,1.026],[0.067,0.036,0.029,0.037,0.034,0.033],[7.967,2.314,2.288,2.328,2.311,2.282],[2.448,1.107,1.112,1.103,1.109,1.122],[2.054,0.616,0.618,0.608,0.615,0.610],[0.026,0.002,0.003,0.002,0.001,0.001],[0.051,0.021,0.015,0.013,0.015,0.014],[0.053,0.030,0.028,0.027,0.031,0.029],[0.069,0.033,0.032,0.031,0.029,0.031],[0.174,0.132,0.135,0.133,0.132,0.139],[0.251,0.205,0.205,0.198,0.203,0.199],[0.037,0.021,0.017,0.017,0.016,0.017],[0.033,0.013,0.013,0.014,0.013,0.013],[0.314,0.269,0.259,0.281,0.295,0.275],[0.379,0.317,0.328,0.325,0.324,0.318],[0.154,0.121,0.125,0.116,0.121,0.118],[0.149,0.124,0.125,0.120,0.123,0.121],[0.443,0.389,0.367,0.361,0.362,0.366],[0.544,0.501,0.493,0.488,0.489,0.486],[0.531,0.427,0.438,0.433,0.433,0.437],[0.537,0.438,0.429,0.440,0.433,0.448],[1.260,1.082,1.060,1.087,1.086,1.082],[0.803,0.719,0.738,0.729,0.719,0.765],[2.691,2.507,null,null,null,null],[0.082,0.027,0.026,0.026,0.042,0.026],[1.430,0.352,0.345,0.352,0.363,0.351],[1.762,0.412,0.406,0.424,0.422,0.408],[4.073,1.188,1.172,1.165,1.170,1.161],[4.759,0.588,0.578,0.582,0.576,0.571],[0.241,0.135,0.136,0.130,0.135,0.132],[0.171,0.113,0.121,0.110,0.105,0.117],[0.305,0.139,0.130,0.133,0.130,0.134],[1.482,0.473,0.478,0.473,0.475,0.472],[1.071,0.604,0.607,0.601,0.600,0.603],[1.110,1.074,1.067,1.067,1.066,1.066],[0.438,0.394,0.379,0.384,0.380,0.375],[0.746,0.582,0.570,0.577,0.567,0.562],[3.960,3.739,3.600,3.476,3.715,3.469],[2.076,1.721,1.746,1.794,1.765,1.754],[2.075,1.726,1.724,1.732,1.750,1.755],[0.844,0.766,0.769,0.777,0.773,0.759],[0.172,0.105,0.074,0.099,0.089,0.104],[0.089,0.035,0.035,0.052,0.029,0.028],[0.100,0.043,0.038,0.040,0.039,0.027],[0.264,0.128,0.128,0.128,0.125,0.132],[0.062,0.015,0.024,0.012,0.023,0.031],[0.036,0.014,0.018,0.011,0.009,0.009],[0.029,0.017,0.008,0.007,0.011,0.011],[0.104,0.064,0.070,0.062,0.067,0.063],[0.152,0.086,0.087,0.096,0.086,0.085],[0.086,0.047,0.043,0.039,0.039,0.038],[0.158,0.123,0.125,0.125,0.123,0.122],[0.040,0.024,0.021,0.021,0.025,0.020],[0.085,0.058,0.057,0.060,0.069,0.055],[0.134,0.091,0.085,0.087,0.088,0.092],[0.035,0.024,0.024,0.024,0.041,0.021],[0.073,0.034,0.038,0.037,0.036,0.034],[0.165,0.134,0.135,0.134,0.137,0.134],[0.285,0.224,0.228,0.224,0.220,0.221],[0.429,0.378,0.366,0.363,0.358,0.374],[0.089,0.071,0.074,0.072,0.070,0.067],[0.479,0.408,0.403,0.393,0.401,0.405],[2.372,2.269,2.272,2.254,2.258,2.229],[8.473,1.135,1.140,1.130,1.140,1.137],[2.292,2.214,2.216,2.221,2.218,2.215],[12.699,5.683,5.682,5.660,5.663,5.650],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.685,0.863,0.862,0.870,0.862,0.870],[null,null,null,null,null,null],[18.088,18.092,18.003,17.996,18.033,17.877],[null,null,null,null,null,null],[34.735,34.841,35.155,34.970,35.282,35.028],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[10.557,10.570,10.302,10.293,10.419,10.363],[1.391,1.294,1.330,1.329,1.319,1.311],[0.707,0.522,0.524,0.520,0.529,0.543],[null,null,null,null,null,null],[0.758,0.744,0.726,0.745,0.731,0.735],[null,null,null,null,null,null],[0.467,0.382,0.362,0.352,0.357,0.360],[null,null,null,null,null,null],[null,33.587,34.407,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.900,3.849,4.020,3.965,3.949,3.812],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.163,1.010,0.995,0.996,1.025,1.003],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.021,12.797,12.904,12.611,12.786,12.823],[null,null,null,null,null,null],[2.866,2.603,2.734,2.612,2.618,2.572],[null,null,null,null,null,null],[0.882,0.794,0.827,0.778,0.801,0.796],[0.940,0.910,0.880,0.873,0.883,0.906],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.893,12.641,12.699,12.663,12.633,12.693],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.257,1.029,1.057,1.041,1.030,1.034],[12.803,12.653,12.701,12.679,12.660,12.658],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.409,1.275,1.255,1.350,1.314,1.282],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.129,2.000,2.015,1.979,2.018,2.014],[null,null,null,null,null,null],[2.423,2.370,2.305,2.333,2.286,2.299],[6.602,6.576,6.559,6.571,6.565,6.451],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.193,3.883,3.835,3.880,3.862,3.840],[null,null,null,null,null,null],[2.434,2.369,2.297,2.371,2.280,2.286],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.395,2.324,2.344,2.296,2.313,2.303],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.951,1.864,1.900,1.777,1.832,1.798],[null,null,null,null,null,null],[null,null,null,null,null,null],[16.213,16.118,16.017,16.142,15.969,15.917],[2.173,1.913,1.918,1.918,1.921,1.908],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.038,0.018,0.014,0.020,0.029,0.014],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.313,2.164,2.198,2.240,2.221,2.166],[null,null,null,null,null,null],[1.192,1.085,1.099,1.127,1.115,1.105],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.304,0.229,0.228,0.227,0.229,0.225],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.221,3.067,3.085,3.053,3.073,3.061],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.466,0.380,0.376,0.378,0.374,0.375],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.156,3.085,3.060,3.044,3.054,3.046],[null,null,null,null,null,null],[1.533,1.478,1.437,1.415,1.480,1.487],[1.352,1.286,1.276,1.230,1.249,1.286],[1.548,1.488,1.485,1.501,1.417,1.446],[18.850,18.050,17.852,18.655,18.431,18.228],[6.201,6.042,6.088,6.214,6.085,6.275],[2.382,2.302,2.270,2.300,2.348,2.307],[null,null,null,null,null,null],[32.975,32.673,32.714,32.547,32.756,32.855],[32.366,32.025,31.997,32.285,32.113,32.178],[34.003,33.569,33.564,33.753,33.634,33.672],[6.121,6.106,6.170,6.164,6.146,6.163],[3.273,3.209,3.214,3.224,3.225,3.129],[6.811,6.726,6.799,6.565,6.575,6.641],[11.536,11.208,11.265,11.206,11.224,11.254],[11.854,11.442,11.585,11.544,11.461,11.532],[11.817,11.633,11.534,11.612,11.517,11.537],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[66.089,66.262,66.205,66.431,66.132,66.106],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.404,4.235,4.274,4.291,4.269,4.309],[5.238,5.138,5.134,5.135,5.141,5.234],[0.265,0.249,0.227,0.245,0.236,0.226],[0.269,0.234,0.229,0.240,0.235,0.233],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.577,5.207,5.164,5.194,5.328,5.169],[null,null,null,null,null,null],[5.576,5.179,5.285,5.247,5.146,5.220],[5.085,4.800,4.723,4.874,4.755,4.746],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.455,5.287,5.286,5.271,5.307,5.321],[4.297,3.812,3.950,3.846,3.909,3.894],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.501,12.266,12.405,12.268,12.331,12.211],[0.186,0.147,0.144,0.143,0.152,0.149],[9.157,8.773,8.721,8.792,8.814,8.812],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.520,0.489,0.484,0.482,0.486,0.492],[0.533,0.484,0.493,0.486,0.480,0.489],[0.544,0.506,0.486,0.489,0.482,0.483],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.447,3.439,3.437,3.431,3.420,3.435],[3.467,3.444,3.428,3.441,3.429,3.445],[3.370,3.338,3.332,3.349,3.342,3.338],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.557,1.531,1.528,1.498,1.532,1.427],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.9.7.11","source":"results/20.9.7.11.json"} +,{"actual_version":"20.6.11.1","data_size":{"hits":14326119614,"job":1830089086,"mgbench":2958703705,"ontime":2702850997,"ssb":73372619938,"taxi":24214945766,"tpcds":18824672732,"tpch":17318061448,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":220,"job":23,"mgbench":54,"ontime":47,"ssb":1505,"taxi":848,"tpcds":250,"tpch":264,"uk":35},"machine":"c7a.4xlarge","release_date":"2020-12-09","result":[[0.087,0.010,0.009,0.009,0.009,0.010],[0.070,0.023,0.024,0.023,0.041,0.024],[0.053,0.010,0.010,0.010,0.011,0.010],[0.059,0.011,0.013,0.011,0.011,0.011],[0.045,0.023,0.019,0.021,0.021,0.020],[0.070,0.016,0.017,0.015,0.016,0.017],[0.027,0.004,0.005,0.005,0.004,0.004],[0.065,0.023,0.022,0.023,0.022,0.022],[0.066,0.035,0.036,0.037,0.040,0.036],[0.123,0.094,0.094,0.087,0.094,0.086],[0.503,0.451,0.495,0.512,0.451,0.498],[0.554,0.418,0.422,0.398,0.397,0.411],[0.151,0.023,0.018,0.022,0.009,0.004],[0.043,0.014,0.009,0.011,0.011,0.011],[0.988,0.927,0.911,0.934,0.889,0.919],[0.271,0.122,0.127,0.124,0.118,0.121],[0.047,0.026,0.028,0.036,0.022,0.021],[0.200,0.144,0.143,0.149,0.150,0.143],[6.468,1.862,1.863,1.862,1.890,1.881],[4.740,1.356,1.352,1.352,1.366,1.362],[4.794,1.387,1.402,1.427,1.375,1.372],[5.459,2.328,2.344,2.327,2.329,2.320],[6.263,1.934,1.926,1.936,1.926,1.930],[4.022,1.096,1.079,1.104,1.088,1.103],[0.073,0.037,0.037,0.038,0.035,0.036],[7.898,2.495,2.496,2.498,2.507,2.479],[2.414,1.203,1.192,1.213,1.198,1.198],[2.003,0.644,0.639,0.655,0.646,0.647],[0.028,0.002,0.005,0.005,0.002,0.002],[0.044,0.015,0.017,0.016,0.012,0.016],[0.057,0.038,0.035,0.028,0.027,0.030],[0.065,0.036,0.033,0.035,0.030,0.029],[0.175,0.141,0.135,0.139,0.142,0.138],[0.256,0.218,0.213,0.213,0.207,0.205],[0.036,0.016,0.016,0.015,0.015,0.014],[0.029,0.013,0.013,0.013,0.012,0.012],[0.322,0.289,0.290,0.282,0.281,0.290],[0.378,0.334,0.339,0.323,0.324,0.325],[0.159,0.129,0.125,0.124,0.127,0.124],[0.170,0.128,0.124,0.124,0.126,0.120],[0.444,0.395,0.365,0.384,0.381,0.375],[0.570,0.499,0.499,0.503,0.496,0.490],[0.512,0.455,0.449,0.445,0.453,0.443],[0.509,0.450,0.452,0.456,0.456,0.457],[1.297,1.115,1.119,1.096,1.133,1.097],[0.875,0.768,0.827,0.791,0.827,1.028],[2.911,2.748,2.513,2.829,2.599,2.646],[0.088,0.030,0.035,0.046,0.054,0.033],[1.463,0.491,0.425,0.428,0.433,0.430],[1.736,0.448,0.458,0.467,0.467,0.463],[4.043,1.220,1.191,1.205,1.201,1.201],[4.408,0.651,0.634,0.651,0.643,0.633],[0.242,0.148,0.150,0.146,0.154,0.140],[0.222,0.128,0.143,0.120,0.119,0.121],[0.226,0.147,0.142,0.148,0.137,0.143],[1.433,0.486,0.490,0.483,0.483,0.477],[1.060,0.651,0.654,0.642,0.650,0.647],[1.156,1.091,1.100,1.082,1.084,1.080],[0.435,0.412,0.395,0.402,0.401,0.399],[0.681,0.575,0.566,0.571,0.575,0.585],[3.985,3.672,3.715,3.539,3.546,3.540],[2.063,1.794,1.769,1.802,1.786,1.769],[2.075,1.779,1.746,1.788,1.804,1.784],[0.884,0.758,0.787,0.799,0.784,0.780],[0.163,0.101,0.132,0.121,0.095,0.096],[0.090,0.059,0.056,0.043,0.049,0.043],[0.091,0.089,0.064,0.039,0.030,0.042],[0.264,0.218,0.210,0.166,0.158,0.169],[0.055,0.011,0.017,0.018,0.020,0.019],[0.045,0.016,0.012,0.013,0.019,0.009],[0.029,0.006,0.007,0.019,0.025,0.006],[0.125,0.076,0.069,0.072,0.070,0.075],[0.138,0.104,0.100,0.097,0.099,0.102],[0.088,0.053,0.044,0.045,0.042,0.039],[0.165,0.129,0.131,0.136,0.127,0.127],[0.039,0.026,0.028,0.023,0.023,0.023],[0.086,0.061,0.061,0.059,0.060,0.058],[0.138,0.107,0.100,0.102,0.105,0.104],[0.103,0.033,0.019,0.030,0.020,0.027],[0.127,0.034,0.031,0.033,0.030,0.032],[0.231,0.169,0.168,0.163,0.164,0.165],[0.309,0.275,0.277,0.277,0.268,0.264],[0.464,0.382,0.374,0.373,0.387,0.371],[0.109,0.083,0.080,0.076,0.082,0.077],[0.543,0.447,0.419,0.419,0.415,0.419],[2.483,2.404,2.400,2.377,2.378,2.357],[8.452,1.918,1.922,1.916,1.908,1.910],[2.410,2.343,2.359,2.345,2.332,2.343],[12.665,5.698,5.703,5.746,5.749,5.741],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.673,0.957,0.943,0.944,0.954,0.961],[null,null,null,null,null,null],[17.699,17.709,17.708,17.741,17.493,17.493],[null,null,null,null,null,null],[35.199,35.351,35.304,35.612,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.088,10.844,10.295,10.532,10.431,10.490],[1.413,1.383,1.358,1.386,1.360,1.363],[0.650,0.556,0.547,0.558,0.563,0.557],[null,null,null,null,null,null],[0.786,0.749,0.734,0.758,0.758,0.770],[null,null,null,null,null,null],[0.411,0.336,0.330,0.337,0.335,0.325],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.433,4.432,4.492,4.444,4.405,4.510],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.245,1.067,1.098,1.100,1.082,1.083],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.158,13.094,13.010,13.039,13.173,12.930],[null,null,null,null,null,null],[2.907,2.727,2.795,2.729,2.700,2.782],[null,null,null,null,null,null],[0.973,0.883,0.887,0.860,0.919,0.855],[1.080,0.913,0.855,0.875,0.978,0.886],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.111,12.797,12.833,12.974,12.895,12.862],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.986,12.907,12.836,12.921,12.933,12.899],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.334,1.239,1.234,1.227,1.200,1.210],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.134,2.070,2.038,2.049,2.049,2.031],[null,null,null,null,null,null],[2.554,2.401,2.364,2.479,2.369,2.385],[6.805,6.804,6.833,6.777,6.751,6.912],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.129,3.956,3.935,3.924,3.881,3.863],[null,null,null,null,null,null],[2.527,2.474,2.398,2.387,2.414,2.447],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.381,2.364,2.349,2.318,2.341,2.291],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.966,1.902,1.902,1.850,1.872,1.845],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.033,20.594,20.280,20.148,20.552,20.690],[2.297,2.115,2.123,2.129,2.114,2.113],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.054,0.036,0.027,0.023,0.030,0.023],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.101,2.076,2.098,2.084,2.074,2.083],[null,null,null,null,null,null],[1.182,1.090,1.155,1.136,1.156,1.104],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.290,0.223,0.221,0.224,0.221,0.221],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.415,3.291,3.287,3.287,3.290,3.298],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.430,0.350,0.349,0.351,0.351,0.348],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.092,2.996,2.954,3.001,3.024,2.981],[null,null,null,null,null,null],[1.592,1.550,1.504,1.497,1.534,1.491],[1.347,1.279,1.272,1.261,1.299,1.295],[1.501,1.477,1.527,1.497,1.492,1.491],[18.160,18.069,18.683,17.939,18.044,18.168],[6.241,6.083,6.053,6.239,6.153,6.242],[2.388,2.271,2.349,2.311,2.244,2.250],[null,null,null,null,null,null],[34.164,33.438,33.836,33.570,33.801,33.487],[32.310,32.140,32.044,32.162,31.969,32.095],[38.162,37.551,37.908,37.713,37.882,37.613],[6.332,6.181,6.333,6.285,6.360,6.281],[3.350,3.376,3.333,3.343,3.376,3.200],[6.787,6.811,6.842,6.831,6.895,6.971],[12.689,12.429,12.389,12.577,12.532,12.388],[12.923,12.870,12.802,12.917,12.921,12.871],[13.066,12.829,12.821,12.883,12.772,12.810],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[64.116,63.686,63.831,64.749,63.884,63.648],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.651,4.491,4.457,4.574,4.482,4.491],[5.407,5.310,5.317,5.380,5.347,5.395],[0.251,0.232,0.227,0.230,0.225,0.224],[0.261,0.228,0.224,0.224,0.233,0.224],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.711,5.446,5.421,5.383,5.354,5.380],[null,null,null,null,null,null],[5.570,5.357,5.407,5.306,5.341,5.428],[5.182,4.904,4.944,4.922,4.949,4.886],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.702,5.622,5.610,5.548,5.599,5.557],[4.266,3.894,3.904,3.875,3.844,3.843],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.718,12.637,12.557,12.561,12.546,12.492],[0.157,0.125,0.115,0.114,0.115,0.115],[9.133,8.902,8.875,8.882,8.866,8.893],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.487,0.461,0.507,0.463,0.463,0.463],[0.493,0.461,0.467,0.460,0.472,0.461],[0.484,0.463,0.467,0.467,0.485,0.479],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.335,3.312,3.322,3.309,3.313,3.314],[3.357,3.309,3.311,3.305,3.314,3.310],[3.241,3.221,3.229,3.216,3.218,3.216],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.632,1.556,1.574,1.537,1.520,1.537],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.6.11.1","source":"results/20.6.11.1.json"} +,{"actual_version":"20.10.7.4","data_size":{"hits":14399595302,"job":1830194210,"mgbench":2959106271,"ontime":2704903445,"ssb":72904327623,"taxi":24216871319,"tpcds":18802940066,"tpch":17376977690,"uk":781266522},"kind":"versions-benchmark","load_time":{"hits":238,"job":22,"mgbench":60,"ontime":53,"ssb":1381,"taxi":910,"tpcds":288,"tpch":262,"uk":39},"machine":"c7a.4xlarge","release_date":"2020-12-24","result":[[0.065,0.009,0.008,0.010,0.008,0.008],[0.083,0.029,0.022,0.022,0.028,0.032],[0.051,0.030,0.015,0.009,0.021,0.039],[0.062,0.011,0.016,0.011,0.012,0.020],[0.047,0.035,0.021,0.023,0.023,0.032],[0.073,0.026,0.039,0.018,0.016,0.044],[0.031,0.006,0.006,0.006,0.007,0.007],[0.070,0.025,0.024,0.024,0.024,0.023],[0.063,0.037,0.036,0.035,0.042,0.036],[0.131,0.089,0.096,0.084,0.088,0.085],[0.498,0.506,0.515,0.489,0.483,0.491],[0.502,0.416,0.404,0.414,0.404,0.419],[0.046,0.008,0.020,0.016,0.011,0.097],[0.032,0.034,0.018,0.013,0.013,0.016],[0.974,0.891,0.884,0.887,0.884,0.891],[0.349,0.129,0.126,0.123,0.132,0.127],[0.041,0.021,0.020,0.020,0.020,0.019],[0.194,0.142,0.146,0.148,0.146,0.144],[6.389,1.960,1.945,1.889,1.882,1.867],[4.733,1.333,1.319,1.328,1.332,1.325],[4.735,1.368,1.358,1.352,1.353,1.349],[5.389,2.365,2.372,2.358,2.378,2.364],[6.227,1.967,2.140,2.048,2.032,1.924],[4.024,1.139,1.139,1.155,1.161,1.145],[0.068,0.041,0.035,0.037,0.037,0.033],[7.692,2.578,2.582,2.562,2.585,2.569],[2.318,1.257,1.231,1.239,1.243,1.252],[1.883,0.640,0.638,0.646,0.656,0.640],[0.021,0.002,0.002,0.002,0.002,0.004],[0.027,0.014,0.014,0.013,0.013,0.013],[0.050,0.030,0.030,0.026,0.027,0.029],[0.071,0.045,0.036,0.036,0.031,0.032],[0.161,0.135,0.131,0.138,0.127,0.135],[0.250,0.217,0.205,0.210,0.216,0.211],[0.030,0.018,0.016,0.016,0.016,0.015],[0.024,0.014,0.013,0.012,0.013,0.013],[0.306,0.281,0.270,0.267,0.275,0.283],[0.386,0.324,0.330,0.320,0.324,0.351],[0.161,0.135,0.138,0.137,0.137,0.127],[0.159,0.138,0.130,0.132,0.140,0.132],[0.447,0.386,0.378,0.380,0.383,0.375],[0.567,0.518,0.521,0.534,0.532,0.492],[0.557,0.456,0.449,0.471,0.446,0.459],[0.551,0.470,0.472,0.468,0.469,0.477],[1.330,1.172,1.168,1.163,1.155,1.150],[0.848,0.786,0.784,0.752,0.819,0.759],[3.014,2.683,2.730,2.757,2.642,2.632],[0.146,0.061,0.058,0.052,0.039,0.035],[1.462,0.396,0.379,0.379,0.367,0.393],[1.784,0.444,0.432,0.444,0.426,0.423],[4.080,1.207,1.174,1.175,1.185,1.180],[4.834,0.591,0.600,0.614,0.577,0.601],[0.228,0.154,0.157,0.146,0.168,0.166],[0.267,0.241,0.117,0.114,0.114,0.110],[0.273,0.150,0.144,0.145,0.145,0.141],[1.435,0.502,0.517,0.501,0.491,0.490],[1.080,0.626,0.634,0.633,0.632,0.634],[1.086,1.054,1.048,1.055,1.049,1.049],[0.467,0.416,0.407,0.402,0.400,0.407],[0.777,0.613,0.601,0.629,0.622,0.603],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,1.902,1.774,1.834],[0.839,0.749,0.754,0.732,0.735,0.750],[0.198,0.099,0.074,0.057,0.059,0.062],[0.058,0.038,0.029,0.036,0.042,0.035],[0.057,0.047,0.062,0.060,0.046,0.041],[0.207,0.107,0.124,0.108,0.101,0.101],[0.044,0.021,0.026,0.009,0.009,0.020],[0.036,0.018,0.008,0.011,0.008,0.015],[0.025,0.015,0.009,0.025,0.004,0.005],[0.176,0.062,0.066,0.068,0.063,0.067],[0.189,0.092,0.093,0.090,0.091,0.093],[0.087,0.045,0.043,0.041,0.041,0.041],[0.157,0.123,0.121,0.127,0.120,0.122],[0.059,0.035,0.032,0.042,0.032,0.032],[0.119,0.068,0.069,0.069,0.069,0.066],[0.140,0.099,0.096,0.133,0.106,0.099],[0.066,0.052,0.038,0.043,0.043,0.035],[0.112,0.079,0.068,0.067,0.065,0.065],[0.255,0.181,0.175,0.180,0.175,0.182],[0.272,0.224,0.218,0.220,0.215,0.216],[0.484,0.418,0.405,0.403,0.408,0.416],[0.094,0.064,0.074,0.064,0.064,0.073],[0.505,0.422,0.407,0.407,0.406,0.402],[2.804,2.671,2.643,2.627,2.623,2.639],[8.650,1.116,1.110,1.101,1.110,1.104],[2.209,2.113,2.127,2.124,2.126,2.148],[12.837,5.618,5.424,5.399,5.371,5.384],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.724,0.831,0.814,0.833,0.824,0.822],[null,null,null,null,null,null],[16.616,16.549,16.586,16.669,16.510,16.584],[null,null,null,null,null,null],[27.101,26.841,26.582,26.830,26.897,27.071],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.180,8.035,8.029,8.267,8.139,8.009],[0.506,0.402,0.426,0.396,0.409,0.389],[0.686,0.507,0.509,0.504,0.514,0.514],[null,null,null,null,null,null],[0.921,0.782,0.787,0.802,0.777,0.772],[null,null,null,null,null,null],[0.534,0.417,0.445,0.427,0.419,0.416],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.796,3.770,3.833,3.760,3.672,3.729],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.132,0.960,1.004,1.013,1.012,1.002],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.432,12.214,12.144,12.143,12.078,12.209],[null,null,null,null,null,null],[2.624,2.507,2.415,2.449,2.427,2.467],[null,null,null,null,null,null],[0.279,0.170,0.166,0.205,0.167,0.164],[0.252,0.194,0.197,0.227,0.193,0.196],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.454,12.170,12.127,12.129,12.058,12.073],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.134,0.969,0.986,0.979,0.960,0.966],[12.231,12.129,12.046,12.107,12.188,12.186],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.144,1.086,1.074,1.072,1.053,0.995],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.392,1.287,1.267,1.298,1.305,1.293],[null,null,null,null,null,null],[2.219,2.122,2.109,2.057,2.154,2.113],[6.725,6.652,6.623,6.639,6.645,6.625],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.717,3.543,3.539,3.536,3.551,3.548],[null,null,null,null,null,null],[2.234,2.144,2.130,2.189,2.129,2.156],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.189,2.211,2.127,2.178,2.115,2.065],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.454,0.388,0.366,0.377,0.371,0.390],[null,null,null,null,null,null],[null,null,null,null,null,null],[33.583,33.680,33.894,34.290,33.810,33.908],[1.253,1.045,1.036,1.040,1.058,1.037],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.037,0.025,0.025,0.019,0.015,0.015],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.768,1.700,1.691,1.668,1.661,1.652],[null,null,null,null,null,null],[1.200,1.076,1.080,1.115,1.148,1.097],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.207,0.134,0.135,0.134,0.131,0.130],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.642,2.520,2.496,2.520,2.484,2.520],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.309,0.205,0.196,0.197,0.202,0.200],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.725,0.605,0.618,0.606,0.621,0.616],[null,null,null,null,null,null],[1.555,1.497,1.509,1.477,1.485,1.473],[1.381,1.251,1.350,1.288,1.268,1.350],[1.551,1.484,1.461,1.539,1.487,1.497],[20.052,19.933,20.358,19.903,20.329,20.445],[6.631,6.620,6.583,7.039,6.605,6.610],[2.339,2.317,2.267,2.307,2.310,2.385],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.835,8.689,8.301,8.563,8.555,8.531],[5.408,5.367,5.298,5.084,5.447,5.487],[9.589,9.371,9.054,9.437,9.363,9.304],[null,null,null,null,null,null],[14.882,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[35.446,35.291,35.746,35.493,35.815,35.680],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.505,6.557,6.306,6.429,6.289,6.603],[7.515,7.473,7.574,7.400,7.398,7.445],[0.265,0.236,0.224,0.256,0.234,0.258],[0.258,0.258,0.236,0.236,0.238,0.232],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.071,7.630,7.777,7.741,7.942,7.955],[null,null,null,null,null,null],[8.150,7.683,7.702,7.640,7.597,7.624],[7.649,7.496,7.285,7.161,7.395,7.051],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.909,7.835,7.683,7.791,7.832,7.685],[5.902,5.409,5.396,5.492,5.483,5.605],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[10.414,9.878,9.717,9.917,10.144,10.374],[0.177,0.159,0.142,0.154,0.155,0.141],[9.345,9.214,9.090,9.072,9.278,9.163],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.527,0.492,0.500,0.497,0.496,0.532],[0.597,0.539,0.548,0.517,0.522,0.512],[0.602,0.497,0.493,0.480,0.482,0.496],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.485,3.462,3.433,3.424,3.333,3.334],[3.460,3.491,3.408,3.426,3.407,3.506],[3.388,3.365,3.359,3.334,3.313,3.258],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.837,2.795,2.860,2.890,2.830,2.812],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.10.7.4","source":"results/20.10.7.4.json"} +,{"actual_version":"20.11.6.6","data_size":{"hits":14384777323,"job":1830189202,"mgbench":2959106271,"ontime":2704903445,"ssb":72902268128,"taxi":24216896584,"tpcds":18808982358,"tpch":17376545025,"uk":781266522},"kind":"versions-benchmark","load_time":{"hits":251,"job":32,"mgbench":67,"ontime":61,"ssb":1554,"taxi":1009,"tpcds":289,"tpch":282,"uk":46},"machine":"c7a.4xlarge","release_date":"2020-12-24","result":[[0.077,0.009,0.012,0.010,0.008,0.010],[0.073,0.025,0.025,0.025,0.034,0.039],[0.051,0.073,0.010,0.010,0.012,0.011],[0.052,0.013,0.041,0.013,0.024,0.020],[0.043,0.025,0.033,0.027,0.024,0.022],[0.092,0.018,0.017,0.030,0.017,0.020],[0.033,0.007,0.006,0.007,0.013,0.007],[0.068,0.028,0.026,0.024,0.026,0.027],[0.062,0.057,0.042,0.043,0.042,0.043],[0.122,0.108,0.102,0.097,0.091,0.093],[0.555,0.591,0.586,0.583,0.562,0.568],[0.608,0.481,0.479,0.486,0.459,0.491],[0.054,0.015,0.019,0.009,0.009,0.016],[0.050,0.029,0.018,0.014,0.025,0.012],[1.089,1.004,1.005,1.044,1.102,1.116],[0.256,0.149,0.140,0.139,0.146,0.139],[0.043,0.026,0.024,0.021,0.020,0.023],[0.187,0.144,0.165,0.156,0.153,0.159],[6.385,2.296,2.260,2.191,2.272,2.167],[4.740,1.591,1.592,1.577,1.535,1.474],[4.733,1.622,1.623,1.611,1.673,1.756],[5.404,2.945,2.830,2.930,2.895,2.806],[6.249,2.459,2.432,2.511,2.555,2.411],[3.990,1.394,1.381,1.408,1.271,1.391],[0.061,0.039,0.043,0.042,0.046,0.044],[7.679,3.057,3.219,3.090,3.000,3.094],[2.307,1.570,1.598,1.607,1.555,1.623],[1.891,0.771,0.748,0.756,0.751,0.746],[0.021,0.005,0.002,0.006,0.002,0.002],[0.046,0.028,0.016,0.014,0.017,0.015],[0.053,0.039,0.032,0.034,0.032,0.032],[0.067,0.044,0.041,0.042,0.041,0.039],[0.185,0.159,0.164,0.164,0.168,0.168],[0.315,0.268,0.284,0.269,0.271,0.257],[0.027,0.018,0.018,0.017,0.017,0.017],[0.022,0.015,0.013,0.013,0.014,0.014],[0.361,0.324,0.323,0.342,0.352,0.343],[0.411,0.400,0.430,0.409,0.407,0.408],[0.184,0.170,0.155,0.154,0.151,0.151],[0.181,0.157,0.143,0.157,0.153,0.149],[0.496,0.436,0.412,0.431,0.438,0.436],[0.651,0.592,0.563,0.607,0.620,0.637],[0.606,0.562,0.517,0.527,0.515,0.526],[0.601,0.589,0.582,0.573,0.579,0.525],[1.573,1.308,1.336,1.313,1.344,1.358],[1.038,0.974,1.010,0.867,0.924,0.902],[3.399,2.830,3.149,2.866,2.936,2.806],[0.256,0.132,0.037,0.059,0.043,0.039],[1.438,0.420,0.398,0.449,0.428,0.462],[1.758,0.489,0.533,0.515,0.524,0.539],[4.069,1.349,1.402,1.396,1.301,1.392],[4.752,0.694,0.651,0.653,0.730,0.762],[0.245,0.195,0.218,0.237,0.210,0.206],[0.193,0.129,0.142,0.136,0.130,0.153],[0.264,0.186,0.177,0.180,0.172,0.170],[1.431,0.608,0.577,0.581,0.537,0.546],[1.077,0.778,0.725,0.751,0.798,0.804],[1.240,1.149,1.170,1.176,1.153,1.167],[0.512,0.500,0.490,0.505,0.452,0.410],[0.795,0.679,0.748,0.699,0.737,0.753],[5.091,4.461,4.710,4.530,3.928,4.203],[2.139,1.876,1.896,1.920,1.944,1.960],[2.128,2.070,2.072,1.992,2.135,2.053],[0.912,0.903,0.909,0.938,0.842,0.836],[0.141,0.112,0.094,0.085,0.084,0.090],[0.088,0.043,0.045,0.040,0.026,0.051],[0.092,0.044,0.040,0.035,0.037,0.048],[0.226,0.149,0.122,0.140,0.141,0.116],[0.045,0.013,0.014,0.019,0.012,0.010],[0.037,0.014,0.017,0.009,0.015,0.022],[0.033,0.005,0.020,0.005,0.011,0.019],[0.144,0.081,0.075,0.076,0.077,0.075],[0.170,0.101,0.106,0.099,0.101,0.107],[0.097,0.060,0.049,0.054,0.046,0.046],[0.171,0.139,0.153,0.132,0.136,0.134],[0.057,0.036,0.036,0.038,0.035,0.036],[0.114,0.077,0.078,0.079,0.074,0.077],[0.176,0.120,0.114,0.109,0.121,0.117],[0.062,0.042,0.041,0.043,0.040,0.043],[0.105,0.076,0.079,0.077,0.075,0.073],[0.227,0.201,0.193,0.191,0.213,0.219],[0.314,0.253,0.247,0.245,0.270,0.278],[0.576,0.507,0.512,0.505,0.507,0.517],[0.090,0.078,0.084,0.089,0.081,0.074],[0.567,0.487,0.473,0.492,0.486,0.474],[3.334,3.199,3.419,3.351,3.313,3.372],[8.655,1.311,1.329,1.309,1.334,1.308],[2.619,2.576,2.530,2.524,2.530,2.542],[12.808,6.636,6.388,6.358,5.798,5.916],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.714,0.948,0.946,0.951,0.874,0.898],[null,null,null,null,null,null],[17.420,17.127,17.844,16.664,16.312,16.514],[null,null,null,null,null,null],[26.093,26.206,26.340,null,null,26.113],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.054,8.039,8.131,8.111,7.957,7.987],[0.483,0.408,0.400,0.412,0.414,0.414],[0.648,0.527,0.513,0.533,0.529,0.530],[null,null,null,null,null,null],[0.831,0.768,0.766,0.819,0.807,0.780],[null,null,null,null,null,null],[0.518,0.442,0.443,0.414,0.428,0.427],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.760,3.722,3.725,3.690,3.646,3.737],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.199,1.066,1.073,1.065,1.057,1.080],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.274,12.039,12.117,12.161,12.164,12.149],[null,null,null,null,null,null],[2.681,2.594,2.520,2.413,2.488,2.425],[null,null,null,null,null,null],[0.249,0.203,0.169,0.173,0.172,0.178],[0.269,0.198,0.208,0.227,0.208,0.230],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.624,12.001,12.211,12.401,12.060,12.454],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.099,1.013,1.023,1.019,1.020,1.023],[12.187,12.555,12.045,12.192,12.367,12.065],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.134,1.093,1.047,1.103,1.171,1.107],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.457,1.359,1.430,1.324,1.293,1.304],[null,null,null,null,null,null],[2.177,2.115,2.119,2.040,2.077,2.037],[6.834,7.129,6.705,6.648,6.570,6.764],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.849,3.817,3.725,3.564,3.513,3.530],[null,null,null,null,null,null],[2.222,2.105,2.111,2.014,2.086,2.065],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.125,2.146,2.168,2.034,2.137,2.130],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.485,0.410,0.398,0.397,0.403,0.398],[null,null,null,null,null,null],[null,null,null,null,null,null],[33.818,33.419,33.874,32.897,33.917,33.353],[1.247,1.115,1.098,1.097,1.116,1.106],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.050,0.020,0.021,0.020,0.023,0.015],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.878,1.712,1.748,1.745,1.808,1.729],[null,null,null,null,null,null],[1.161,1.117,1.114,1.082,1.099,1.078],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.208,0.136,0.134,0.133,0.135,0.137],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.682,2.548,2.577,2.532,2.575,2.562],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.285,0.212,0.209,0.212,0.208,0.213],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.746,0.673,0.685,0.656,0.665,0.697],[null,null,null,null,null,null],[1.576,1.505,1.530,1.488,1.474,1.457],[1.361,1.289,1.318,1.262,1.342,1.260],[1.574,1.487,1.492,1.487,1.482,1.549],[20.949,21.599,21.498,22.227,21.557,22.198],[7.355,7.152,7.034,6.994,7.001,7.035],[2.438,2.432,2.415,2.473,2.414,2.420],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.700,8.500,8.376,8.303,8.897,8.586],[5.478,5.268,5.703,5.093,5.537,5.222],[9.299,9.374,9.084,9.071,9.265,9.029],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,15.060,15.078,14.651,null,15.322],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[38.497,38.064,37.362,37.616,38.170,37.565],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.442,6.378,6.390,6.242,6.334,6.375],[7.511,7.338,7.216,7.556,7.350,7.302],[0.276,0.237,0.248,0.233,0.240,0.247],[0.273,0.240,0.265,0.246,0.255,0.248],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.044,7.923,7.835,7.715,7.780,7.816],[null,null,null,null,null,null],[8.007,7.642,7.737,7.874,7.817,7.714],[7.561,7.343,7.371,7.383,7.325,7.245],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.795,7.621,7.711,7.600,7.667,7.839],[5.693,5.552,5.368,5.260,5.422,5.323],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[10.221,10.048,9.977,10.070,10.064,10.009],[0.173,0.141,0.169,0.144,0.144,0.144],[9.266,9.074,9.038,9.095,8.912,9.177],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.567,0.521,0.587,0.488,0.567,0.502],[0.561,0.541,0.510,0.498,0.500,0.494],[0.529,0.515,0.501,0.492,0.493,0.498],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.515,3.547,3.488,3.559,3.463,3.469],[3.524,3.453,3.469,3.442,3.499,3.526],[3.494,3.540,3.408,3.350,3.338,3.355],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.794,2.869,2.838,2.777,2.764,2.863],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.11.6.6","source":"results/20.11.6.6.json"} +,{"actual_version":"20.12.8.5","data_size":{"hits":14385191150,"job":1830194210,"mgbench":2958985736,"ontime":2704903445,"ssb":72903990687,"taxi":24216969469,"tpcds":18808232762,"tpch":17375370108,"uk":781266522},"kind":"versions-benchmark","load_time":{"hits":258,"job":29,"mgbench":70,"ontime":58,"ssb":1497,"taxi":990,"tpcds":288,"tpch":278,"uk":42},"machine":"c7a.4xlarge","release_date":"2021-03-02","result":[[0.066,0.011,0.018,0.012,0.019,0.010],[0.061,0.025,0.024,0.024,0.024,0.024],[0.040,0.009,0.010,0.009,0.011,0.011],[0.044,0.012,0.011,0.012,0.012,0.012],[0.040,0.024,0.027,0.025,0.024,0.027],[0.067,0.021,0.016,0.018,0.023,0.018],[0.029,0.007,0.007,0.011,0.010,0.008],[0.062,0.026,0.027,0.027,0.028,0.026],[0.067,0.040,0.040,0.040,0.040,0.038],[0.117,0.099,0.096,0.087,0.091,0.103],[0.544,0.543,0.525,0.540,0.473,0.485],[0.572,0.477,0.490,0.461,0.483,0.474],[0.032,0.011,0.022,0.009,0.011,0.009],[0.048,0.029,0.012,0.018,0.026,0.020],[1.138,1.032,1.028,1.034,1.044,1.114],[0.207,0.140,0.146,0.141,0.138,0.139],[0.034,0.024,0.022,0.021,0.020,0.019],[0.195,0.173,0.162,0.157,0.164,0.163],[6.416,2.118,2.145,2.320,2.326,2.331],[4.727,1.508,1.510,1.629,1.645,1.653],[4.746,1.548,1.553,1.565,1.581,1.671],[5.416,2.917,2.940,2.697,2.829,2.893],[6.238,2.354,2.147,2.151,2.166,2.184],[3.995,1.262,1.268,1.325,1.276,1.345],[0.059,0.037,0.038,0.039,0.034,0.037],[7.703,3.044,2.976,3.050,2.934,2.976],[2.321,1.459,1.489,1.412,1.476,1.467],[1.899,0.746,0.750,0.756,0.747,0.764],[0.006,0.002,0.002,0.002,0.003,0.002],[0.031,0.016,0.013,0.012,0.013,0.013],[0.056,0.034,0.036,0.032,0.036,0.031],[0.064,0.041,0.039,0.042,0.039,0.037],[0.166,0.147,0.145,0.147,0.139,0.147],[0.295,0.252,0.255,0.233,0.225,0.230],[0.029,0.018,0.019,0.018,0.019,0.017],[0.020,0.013,0.014,0.013,0.013,0.012],[0.344,0.314,0.321,0.332,0.318,0.291],[0.402,0.358,0.355,0.348,0.390,0.368],[0.183,0.145,0.167,0.161,0.144,0.144],[0.180,0.147,0.148,0.143,0.148,0.141],[0.458,0.427,0.426,0.464,0.467,0.452],[0.699,0.606,0.618,0.582,0.610,0.593],[0.520,0.470,0.487,0.470,0.490,0.480],[0.549,0.554,0.547,0.543,0.509,0.544],[1.410,1.279,1.253,1.219,1.292,1.228],[0.901,0.900,0.922,0.877,0.805,0.896],[3.347,3.016,3.122,3.002,2.812,2.859],[0.110,0.050,0.040,0.044,0.035,0.036],[1.463,0.418,0.436,0.445,0.460,0.411],[1.758,0.466,0.486,0.539,0.545,0.548],[4.067,1.366,1.355,1.347,1.350,1.268],[4.769,0.695,0.694,0.687,0.655,0.688],[0.244,0.180,0.176,0.174,0.174,0.156],[0.189,0.148,0.133,0.147,0.140,0.144],[0.224,0.173,0.172,0.167,0.158,0.171],[1.444,0.546,0.530,0.537,0.519,0.526],[1.065,0.718,0.717,0.721,0.722,0.729],[1.049,1.020,1.022,1.025,1.021,1.030],[0.480,0.419,0.413,0.437,0.439,0.424],[0.718,0.640,0.659,0.635,0.656,0.659],[4.408,4.105,4.069,4.058,4.136,4.187],[2.207,2.064,2.040,2.053,2.034,2.054],[2.121,1.864,1.886,1.854,1.969,2.058],[0.931,0.875,0.852,0.763,0.820,0.813],[0.154,0.080,0.128,0.079,0.077,0.094],[0.074,0.035,0.052,0.035,0.032,0.053],[0.060,0.026,0.025,0.028,0.036,0.053],[0.212,0.141,0.105,0.109,0.082,0.109],[0.038,0.011,0.012,0.010,0.010,0.010],[0.036,0.015,0.027,0.011,0.008,0.008],[0.018,0.007,0.016,0.012,0.014,0.011],[0.122,0.072,0.071,0.068,0.068,0.070],[0.159,0.099,0.101,0.096,0.110,0.099],[0.092,0.055,0.054,0.053,0.046,0.049],[0.166,0.136,0.136,0.134,0.135,0.135],[0.062,0.041,0.039,0.038,0.037,0.038],[0.120,0.082,0.079,0.090,0.082,0.082],[0.148,0.113,0.112,0.113,0.111,0.118],[0.057,0.043,0.043,0.039,0.042,0.040],[0.103,0.070,0.077,0.074,0.074,0.073],[0.246,0.213,0.215,0.205,0.231,0.209],[0.281,0.259,0.258,0.251,0.253,0.254],[0.570,0.482,0.481,0.480,0.497,0.504],[0.106,0.086,0.074,0.076,0.072,0.095],[0.579,0.501,0.490,0.505,0.484,0.486],[3.532,3.370,3.308,3.294,3.250,3.143],[8.641,1.365,1.331,1.333,1.368,1.270],[2.666,2.610,2.580,2.559,2.574,2.584],[12.796,6.535,6.565,6.575,6.398,6.614],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.693,0.972,0.974,0.977,0.979,0.974],[null,null,null,null,null,null],[18.082,18.393,16.838,16.226,16.465,16.355],[null,null,null,null,null,null],[25.860,26.161,26.263,26.466,26.602,26.213],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.105,8.060,8.126,7.975,7.997,8.064],[0.487,0.430,0.442,0.416,0.406,0.412],[0.592,0.546,0.544,0.505,0.512,0.506],[null,null,null,null,null,null],[0.840,0.782,0.803,0.781,0.797,0.800],[null,null,null,null,null,null],[0.498,0.435,0.429,0.431,0.444,0.426],[null,null,null,null,null,null],[32.329,32.147,32.421,31.972,32.206,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.767,3.742,3.842,3.843,3.840,3.825],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.137,1.071,1.078,1.073,1.102,1.083],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.486,12.404,12.782,12.538,12.455,12.434],[null,null,null,null,null,null],[2.623,2.472,2.551,2.462,2.444,2.459],[null,null,null,null,null,null],[0.303,0.200,0.204,0.187,0.175,0.170],[0.264,0.208,0.208,0.202,0.211,0.201],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.787,12.517,12.310,12.941,12.115,12.189],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.166,1.062,1.033,1.038,1.035,1.021],[12.181,12.210,12.190,12.291,12.218,12.179],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.155,1.060,1.162,1.047,1.082,1.038],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.387,1.289,1.311,1.294,1.315,1.325],[null,null,null,null,null,null],[2.165,2.053,2.103,2.028,2.046,2.074],[6.604,6.562,6.451,6.539,6.649,6.510],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.651,3.578,3.566,3.519,3.572,3.568],[null,null,null,null,null,null],[2.174,2.136,2.113,2.065,2.021,2.143],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.360,2.325,2.171,2.117,2.153,2.085],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.464,0.394,0.387,0.391,0.390,0.393],[null,null,null,null,null,null],[null,null,null,null,null,null],[14.341,14.000,13.893,14.085,13.935,14.069],[1.241,1.114,1.102,1.114,1.112,1.125],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.027,0.022,0.023,0.016,0.017,0.016],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.751,1.768,1.679,1.734,1.695,1.696],[null,null,null,null,null,null],[1.134,1.087,1.079,1.132,1.073,1.126],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.195,0.137,0.137,0.138,0.137,0.137],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.691,2.620,2.581,2.595,2.608,2.639],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.268,0.210,0.222,0.213,0.212,0.207],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.711,0.692,0.663,0.673,0.669,0.665],[null,null,null,null,null,null],[1.527,1.506,1.506,1.466,1.487,1.446],[1.349,1.246,1.307,1.327,1.324,1.244],[1.562,1.459,1.519,1.494,1.495,1.526],[22.197,21.674,21.645,21.659,21.372,22.277],[7.029,6.919,6.942,6.927,7.062,6.930],[2.407,2.363,2.358,2.339,2.280,2.285],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.590,8.656,8.505,8.405,8.654,8.571],[5.296,5.323,5.291,5.375,5.256,5.359],[9.094,9.598,9.546,9.427,9.358,9.128],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,15.986,16.267],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[41.885,40.531,40.074,39.710,39.869,39.873],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.511,6.475,6.716,6.768,6.799,6.551],[7.488,7.360,7.484,7.559,7.879,7.807],[0.358,0.262,0.256,0.262,0.244,0.240],[0.311,0.256,0.263,0.260,0.241,0.250],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.846,7.742,7.372,7.590,7.446,7.740],[null,null,null,null,null,null],[8.009,7.981,8.210,7.811,8.011,7.831],[7.375,7.240,7.284,7.279,7.336,7.226],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.889,7.992,7.827,7.728,7.827,7.584],[5.509,5.169,5.492,5.480,5.535,5.508],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[10.223,10.517,10.937,11.339,11.008,10.429],[0.582,0.289,0.329,0.402,0.323,0.285],[9.241,9.120,9.194,9.295,9.165,9.424],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.949,0.739,0.642,0.627,0.645,0.623],[0.956,0.669,0.607,0.618,0.630,0.604],[0.937,0.607,0.620,0.640,0.652,0.642],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.959,3.581,3.623,3.564,3.553,3.600],[3.810,3.565,3.540,3.459,3.509,3.511],[3.887,3.583,3.412,3.489,3.440,3.634],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.079,2.820,3.026,2.972,3.072,3.048],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.12.8.5","source":"results/20.12.8.5.json"} +,{"actual_version":"21.1.9.41","data_size":{"hits":14386374095,"job":1830189202,"mgbench":2959106271,"ontime":2704903445,"ssb":72903762796,"taxi":24217016529,"tpcds":18811126793,"tpch":17375795359,"uk":781266522},"kind":"versions-benchmark","load_time":{"hits":258,"job":30,"mgbench":67,"ontime":59,"ssb":1461,"taxi":978,"tpcds":285,"tpch":273,"uk":42},"machine":"c7a.4xlarge","release_date":"2021-04-13","result":[[0.075,0.012,0.012,0.009,0.010,0.010],[0.069,0.026,0.027,0.025,0.026,0.026],[0.041,0.011,0.010,0.009,0.009,0.010],[0.051,0.017,0.013,0.012,0.012,0.012],[0.049,0.029,0.022,0.023,0.024,0.023],[0.076,0.017,0.019,0.022,0.018,0.017],[0.031,0.006,0.007,0.007,0.007,0.011],[0.069,0.024,0.024,0.025,0.023,0.024],[0.073,0.042,0.037,0.037,0.037,0.039],[0.128,0.102,0.097,0.084,0.087,0.096],[0.529,0.522,0.499,0.526,0.501,0.521],[0.533,0.436,0.425,0.427,0.435,0.419],[0.034,0.008,0.010,0.020,0.017,0.008],[0.049,0.017,0.017,0.024,0.020,0.037],[1.056,0.962,0.974,0.986,0.962,0.974],[0.349,0.145,0.126,0.130,0.135,0.122],[0.036,0.020,0.019,0.018,0.018,0.018],[0.314,0.107,0.108,0.106,0.112,0.102],[6.435,2.062,2.065,2.059,2.084,2.046],[4.728,1.471,1.468,1.475,1.465,1.473],[4.735,1.612,1.609,1.505,1.492,1.489],[5.342,2.504,2.503,2.509,2.509,2.503],[6.225,2.118,2.111,2.133,2.142,2.170],[3.991,1.270,1.269,1.262,1.253,1.270],[0.064,0.042,0.044,0.037,0.038,0.036],[7.699,2.804,2.837,2.821,2.812,2.815],[1.838,0.967,0.990,0.981,0.973,0.972],[1.901,0.700,0.701,0.700,0.696,0.707],[0.006,0.002,0.003,0.002,0.002,0.001],[0.034,0.017,0.013,0.015,0.013,0.013],[0.048,0.030,0.032,0.031,0.027,0.030],[0.132,0.035,0.033,0.033,0.032,0.032],[0.161,0.137,0.145,0.137,0.135,0.135],[0.265,0.226,0.217,0.220,0.219,0.218],[0.025,0.017,0.016,0.017,0.017,0.016],[0.022,0.012,0.013,0.013,0.013,0.012],[0.326,0.283,0.294,0.301,0.291,0.298],[0.410,0.351,0.337,0.339,0.345,0.347],[0.172,0.148,0.144,0.138,0.141,0.140],[0.175,0.141,0.143,0.139,0.138,0.145],[0.455,0.410,0.390,0.391,0.398,0.398],[0.570,0.519,0.509,0.517,0.528,0.511],[0.546,0.480,0.492,0.481,0.468,0.477],[0.533,0.469,0.481,0.469,0.481,0.480],[1.375,1.221,1.249,1.202,1.252,1.209],[0.903,0.807,0.833,0.805,0.827,0.818],[3.117,2.735,2.745,2.650,2.746,2.758],[0.111,0.083,0.044,0.043,0.038,0.044],[1.491,0.417,0.408,0.413,0.431,0.416],[1.795,0.467,0.489,0.466,0.485,0.475],[4.078,1.245,1.237,1.246,1.284,1.391],[4.700,0.648,0.610,0.611,0.609,0.620],[0.294,0.153,0.158,0.165,0.165,0.159],[0.199,0.141,0.135,0.126,0.130,0.128],[0.307,0.160,0.163,0.169,0.170,0.167],[1.460,0.534,0.522,0.520,0.517,0.513],[1.108,0.714,0.709,0.674,0.686,0.685],[1.052,1.023,1.012,1.015,1.014,1.019],[0.521,0.422,0.422,0.416,0.430,0.437],[0.888,0.648,0.637,0.642,0.628,0.643],[4.461,4.147,4.149,4.110,3.993,4.089],[2.172,1.923,1.897,1.967,1.971,1.941],[2.210,1.964,1.960,1.958,1.990,1.896],[0.845,0.788,0.840,0.830,0.798,0.799],[0.177,0.110,0.119,0.080,0.095,0.073],[0.078,0.051,0.046,0.029,0.049,0.026],[0.089,0.029,0.024,0.024,0.025,0.023],[0.217,0.129,0.134,0.126,0.136,0.136],[0.057,0.015,0.021,0.011,0.015,0.011],[0.036,0.013,0.010,0.012,0.008,0.008],[0.020,0.006,0.009,0.004,0.004,0.004],[0.186,0.076,0.072,0.073,0.077,0.071],[0.234,0.101,0.104,0.115,0.102,0.099],[0.095,0.057,0.059,0.050,0.045,0.048],[0.186,0.137,0.135,0.138,0.137,0.139],[0.058,0.037,0.036,0.036,0.035,0.045],[0.123,0.080,0.078,0.082,0.076,0.076],[0.163,0.114,0.106,0.110,0.105,0.110],[0.058,0.041,0.038,0.039,0.042,0.040],[0.096,0.072,0.070,0.076,0.074,0.070],[0.251,0.201,0.201,0.199,0.196,0.194],[0.355,0.244,0.247,0.238,0.239,0.246],[0.540,0.468,0.456,0.469,0.451,0.473],[0.103,0.076,0.079,0.082,0.080,0.079],[0.578,0.497,0.470,0.477,0.474,0.466],[3.278,3.146,3.125,3.099,3.098,3.091],[8.646,1.289,1.290,1.286,1.264,1.281],[2.531,2.430,2.400,2.415,2.439,2.437],[12.812,6.154,6.257,6.273,5.880,5.943],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.726,0.895,0.891,0.886,0.899,0.875],[null,null,null,null,null,null],[16.399,16.158,16.451,16.362,16.585,16.271],[null,null,null,null,null,null],[27.514,28.612,26.793,26.887,27.508,28.704],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.587,8.456,8.483,8.473,8.533,8.475],[0.559,0.449,0.414,0.452,0.442,0.436],[0.767,0.532,0.534,0.516,0.550,0.524],[null,null,null,null,null,null],[0.818,0.798,0.796,0.814,0.808,0.817],[null,null,null,null,null,null],[0.556,0.461,0.435,0.444,0.439,0.420],[null,null,null,null,null,null],[null,null,null,34.151,33.336,32.704],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.755,3.780,3.736,3.674,3.631,3.757],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.263,1.067,1.063,1.091,1.045,1.057],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.404,12.308,12.356,12.405,12.404,12.331],[null,null,null,null,null,null],[5.643,5.404,5.458,5.536,5.538,5.544],[null,null,null,null,null,null],[0.281,0.217,0.174,0.176,0.189,0.173],[0.274,0.206,0.212,0.197,0.205,0.204],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.852,12.891,12.830,12.806,12.903,12.579],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.314,1.057,1.043,1.054,1.058,1.067],[12.549,12.303,12.270,12.200,12.191,12.280],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.133,1.107,1.058,1.055,1.107,1.084],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.503,1.321,1.306,1.329,1.321,1.320],[null,null,null,null,null,null],[3.968,3.839,3.899,3.778,4.006,3.927],[6.821,6.591,6.866,6.732,6.709,6.703],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.806,3.564,3.605,3.606,3.590,3.621],[null,null,null,null,null,null],[4.113,4.007,3.940,4.083,3.976,4.060],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.040,4.133,4.043,4.071,3.958,3.946],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.510,0.396,0.386,0.399,0.404,0.393],[null,null,null,null,null,null],[null,null,null,null,null,null],[14.090,14.204,14.059,13.729,14.054,15.174],[1.383,1.103,1.095,1.113,1.106,1.108],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.034,0.022,0.022,0.020,0.019,0.023],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.811,1.676,1.738,1.784,1.685,1.702],[null,null,null,null,null,null],[1.130,1.082,1.075,1.111,1.065,1.088],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.247,0.142,0.137,0.140,0.137,0.144],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.782,2.617,2.621,2.738,2.763,2.635],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.364,0.238,0.233,0.236,0.238,0.234],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.825,0.716,0.721,0.704,0.713,0.705],[null,null,null,null,null,null],[1.694,1.631,1.619,1.603,1.637,1.632],[1.479,1.414,1.357,1.350,1.401,1.378],[1.621,1.535,1.510,1.538,1.488,1.534],[21.143,21.623,22.596,21.382,20.931,20.797],[6.695,6.603,6.833,6.755,6.622,6.573],[2.415,2.324,2.358,2.339,2.359,2.355],[null,null,null,null,null,null],[34.221,34.087,33.782,34.528,34.081,34.010],[34.066,33.789,33.421,34.911,35.041,35.391],[37.122,34.950,35.143,34.960,35.154,35.084],[6.166,6.279,6.320,6.368,6.652,6.591],[3.561,3.535,3.397,3.556,3.498,3.564],[7.010,7.147,7.047,6.962,6.804,6.748],[11.783,11.375,11.515,11.378,11.435,11.417],[12.050,11.730,11.808,11.640,11.708,11.645],[12.091,11.613,11.666,11.695,11.856,11.910],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[32.946,32.587,34.281,34.616,34.420,34.210],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.410,4.340,4.384,4.532,4.442,4.258],[5.299,5.132,5.128,5.126,5.106,5.136],[0.329,0.239,0.246,0.235,0.246,0.240],[0.332,0.252,0.239,0.243,0.240,0.240],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.804,5.354,5.333,5.391,5.346,5.414],[null,null,null,null,null,null],[5.745,5.392,5.479,5.292,5.327,5.321],[5.187,4.799,4.839,4.822,4.889,4.893],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.476,5.408,5.496,5.349,5.420,5.484],[4.586,4.089,4.097,4.098,4.099,4.220],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.741,7.263,7.350,7.291,7.061,6.985],[0.784,0.335,0.257,0.308,0.307,0.294],[6.390,6.194,6.103,6.179,6.097,6.102],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.152,0.606,0.612,0.625,0.642,0.607],[1.163,0.612,0.608,0.598,0.607,0.595],[1.153,0.642,0.660,0.644,0.637,0.657],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.966,3.579,3.569,3.500,3.533,3.533],[3.990,3.485,3.473,3.468,3.501,3.540],[4.004,3.398,3.384,3.420,3.385,3.433],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.743,1.700,1.723,1.726,1.654,1.771],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.1.9.41","source":"results/21.1.9.41.json"} +,{"actual_version":"21.2.10.48","data_size":{"hits":14365964691,"job":1830171998,"mgbench":2959106271,"ontime":2704903445,"ssb":72906269044,"taxi":24216860417,"tpcds":18811293726,"tpch":17376721311,"uk":781266522},"kind":"versions-benchmark","load_time":{"hits":247,"job":27,"mgbench":61,"ontime":55,"ssb":1369,"taxi":907,"tpcds":291,"tpch":272,"uk":39},"machine":"c7a.4xlarge","release_date":"2021-04-17","result":[[0.076,0.012,0.013,0.015,0.012,0.013],[0.073,0.024,0.024,0.024,0.023,0.024],[0.049,0.012,0.012,0.011,0.011,0.010],[0.051,0.014,0.013,0.014,0.017,0.016],[0.042,0.026,0.033,0.029,0.028,0.021],[0.072,0.019,0.020,0.019,0.018,0.017],[0.032,0.008,0.010,0.009,0.007,0.007],[0.066,0.024,0.024,0.023,0.028,0.026],[0.062,0.035,0.036,0.041,0.036,0.037],[0.115,0.096,0.089,0.096,0.094,0.095],[0.518,0.514,0.501,0.503,0.484,0.484],[0.532,0.431,0.412,0.425,0.424,0.419],[0.031,0.008,0.020,0.013,0.008,0.011],[0.044,0.072,0.016,0.022,0.027,0.017],[0.956,0.907,0.892,0.894,0.891,0.899],[0.216,0.124,0.120,0.120,0.123,0.127],[0.041,0.021,0.020,0.018,0.024,0.019],[0.182,0.106,0.103,0.105,0.115,0.104],[6.399,1.935,1.920,1.949,1.953,1.940],[4.715,1.346,1.360,1.368,1.356,1.360],[4.741,1.392,1.388,1.389,1.392,1.388],[5.359,2.313,2.309,2.290,2.317,2.307],[6.227,1.982,1.960,1.968,1.965,1.954],[3.993,1.160,1.171,1.152,1.172,1.153],[0.061,0.039,0.034,0.036,0.036,0.036],[7.704,2.639,2.639,2.652,2.643,2.688],[1.841,0.904,0.914,0.908,0.907,0.906],[1.910,0.692,0.679,0.642,0.658,0.682],[0.010,0.002,0.003,0.002,0.002,0.002],[0.030,0.013,0.013,0.013,0.013,0.015],[0.046,0.032,0.029,0.031,0.027,0.031],[0.051,0.032,0.040,0.033,0.035,0.034],[0.166,0.140,0.134,0.138,0.134,0.133],[0.257,0.224,0.225,0.216,0.226,0.224],[0.033,0.016,0.016,0.016,0.016,0.016],[0.023,0.016,0.013,0.013,0.015,0.013],[0.320,0.275,0.268,0.292,0.285,0.271],[0.385,0.345,0.338,0.341,0.359,0.333],[0.168,0.143,0.143,0.142,0.141,0.136],[0.177,0.141,0.144,0.153,0.146,0.146],[0.449,0.393,0.407,0.382,0.377,0.379],[0.568,0.500,0.511,0.523,0.500,0.501],[0.542,0.472,0.463,0.462,0.464,0.484],[0.578,0.509,0.530,0.541,0.537,0.528],[1.388,1.290,1.306,1.273,1.169,1.213],[0.856,0.813,0.773,0.848,0.825,0.807],[3.058,2.726,3.028,2.849,2.742,2.956],[0.091,0.043,0.048,0.031,0.042,0.048],[1.448,0.377,0.381,0.380,0.381,0.399],[1.773,0.451,0.437,0.461,0.443,0.456],[4.064,1.266,1.262,1.268,1.299,1.269],[4.759,0.622,0.633,0.642,0.639,0.617],[0.215,0.154,0.149,0.160,0.148,0.155],[0.180,0.124,0.122,0.124,0.120,0.122],[0.201,0.142,0.147,0.149,0.148,0.137],[1.429,0.523,0.522,0.514,0.525,0.513],[1.070,0.655,0.659,0.663,0.657,0.661],[1.053,1.095,1.092,1.095,1.059,1.094],[0.476,0.435,0.427,0.429,0.435,0.451],[0.755,0.652,0.662,0.664,0.644,0.655],[4.573,4.084,4.153,4.151,4.155,4.220],[2.159,1.870,1.860,1.884,1.893,1.872],[2.154,1.874,1.857,1.901,1.877,1.859],[0.914,0.815,0.802,0.828,0.780,0.791],[0.129,0.141,0.083,0.107,0.099,0.074],[0.047,0.038,0.039,0.041,0.056,0.037],[0.069,0.036,0.035,0.036,0.023,0.030],[0.220,0.152,0.149,0.118,0.145,0.146],[0.042,0.016,0.019,0.039,0.022,0.011],[0.037,0.012,0.007,0.012,0.010,0.008],[0.013,0.004,0.005,0.006,0.006,0.004],[0.142,0.074,0.070,0.069,0.070,0.075],[0.174,0.100,0.101,0.098,0.096,0.093],[0.085,0.056,0.048,0.049,0.047,0.049],[0.155,0.131,0.125,0.124,0.128,0.127],[0.053,0.035,0.035,0.035,0.034,0.034],[0.113,0.069,0.070,0.068,0.069,0.078],[0.140,0.100,0.101,0.146,0.101,0.106],[0.065,0.042,0.042,0.062,0.038,0.038],[0.109,0.074,0.067,0.066,0.067,0.068],[0.226,0.183,0.183,0.177,0.181,0.201],[0.297,0.236,0.229,0.219,0.227,0.225],[0.485,0.428,0.416,0.410,0.417,0.416],[0.092,0.072,0.068,0.071,0.065,0.073],[0.502,0.428,0.422,0.425,0.408,0.419],[2.829,2.716,2.678,2.700,2.662,2.650],[8.648,1.123,1.132,1.131,1.117,1.127],[2.243,2.131,2.118,2.128,2.152,2.113],[12.803,5.399,5.390,5.413,5.416,5.393],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.727,0.835,0.824,0.836,0.833,0.830],[null,null,null,null,null,null],[17.344,17.119,17.040,17.321,17.036,17.254],[null,null,null,null,null,null],[27.213,28.139,28.289,28.420,29.118,29.277],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.645,8.460,8.536,8.296,8.570,8.425],[0.484,0.413,0.421,0.432,0.423,0.440],[0.648,0.498,0.517,0.522,0.514,0.515],[null,null,null,null,null,null],[0.836,0.827,0.806,0.793,0.833,0.816],[null,null,null,null,null,null],[0.522,0.436,0.432,0.452,0.424,0.417],[null,null,null,null,null,null],[null,null,null,null,34.365,33.921],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.617,3.817,3.718,3.613,3.610,3.502],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.037,0.998,0.980,1.007,1.005,0.996],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.708,12.431,12.499,12.378,12.519,12.390],[null,null,null,null,null,null],[5.644,5.316,5.454,5.431,5.512,5.625],[null,null,null,null,null,null],[0.241,0.159,0.158,0.163,0.162,0.153],[0.268,0.204,0.218,0.212,0.238,0.211],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.659,12.623,12.493,12.558,12.776,12.721],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.068,0.994,0.999,0.997,1.006,0.979],[12.752,12.581,12.717,12.609,12.653,12.418],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.219,1.142,1.158,1.142,1.154,1.117],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.418,1.333,1.349,1.352,1.357,1.386],[null,null,null,null,null,null],[3.836,3.672,3.784,3.633,3.716,3.797],[6.400,6.410,6.479,6.466,6.460,6.469],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.744,3.661,3.621,3.572,3.644,3.644],[null,null,null,null,null,null],[3.823,3.787,3.745,3.772,3.706,3.809],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.815,3.731,3.744,3.729,3.720,3.669],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.462,0.389,0.369,0.388,0.375,0.377],[null,null,null,null,null,null],[null,null,null,null,null,null],[14.441,15.197,14.556,14.393,14.085,14.371],[1.185,1.035,1.042,1.014,1.018,1.028],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.034,0.020,0.023,0.030,0.018,0.019],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.833,1.745,1.833,1.777,1.846,1.736],[null,null,null,null,null,null],[1.231,1.176,1.142,1.216,1.152,1.197],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.207,0.135,0.128,0.129,0.128,0.127],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.785,2.705,2.643,2.645,2.678,2.638],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.268,0.198,0.202,0.203,0.201,0.202],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.696,0.631,0.619,0.615,0.611,0.614],[null,null,null,null,null,null],[1.617,1.578,1.543,1.584,1.580,1.584],[1.352,1.324,1.385,1.330,1.321,1.353],[1.667,1.531,1.529,1.508,1.549,1.588],[21.542,20.913,21.029,20.865,21.686,21.840],[6.704,6.616,6.675,6.784,6.613,6.534],[2.582,2.421,2.468,2.354,2.380,2.383],[null,null,null,null,null,null],[33.837,33.778,34.049,34.823,34.596,34.300],[34.321,33.148,33.228,33.431,33.462,33.691],[35.805,34.755,35.054,35.759,35.250,34.801],[6.282,6.161,6.142,6.454,6.165,6.396],[3.460,3.336,3.409,3.388,3.404,3.416],[7.130,7.174,6.991,6.822,6.902,6.945],[11.782,11.502,11.557,11.545,11.719,11.948],[12.515,12.209,12.242,12.146,12.071,12.050],[12.209,12.010,11.971,11.688,11.799,11.873],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[30.582,30.645,30.415,30.603,30.599,30.413],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.338,4.328,4.295,4.343,4.356,4.383],[5.307,5.132,5.217,5.154,5.255,5.164],[0.341,0.254,0.249,0.250,0.259,0.243],[0.324,0.253,0.247,0.249,0.246,0.247],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.658,5.394,5.425,5.411,5.456,5.512],[null,null,null,null,null,null],[5.597,5.408,5.311,5.380,5.411,5.403],[5.121,4.995,4.903,4.975,4.972,4.853],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.499,5.476,5.458,5.450,5.451,5.501],[4.271,3.979,3.945,3.983,3.957,3.945],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.091,6.870,6.965,6.906,6.924,6.928],[0.599,0.264,0.293,0.297,0.303,0.274],[6.264,6.050,6.163,6.071,6.068,6.156],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.976,0.640,0.635,0.627,0.642,0.642],[0.962,0.635,0.609,0.626,0.610,0.636],[0.939,0.617,0.653,0.604,0.632,0.621],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.934,3.568,3.527,3.551,3.558,3.565],[3.875,3.532,3.560,3.570,3.542,3.557],[3.801,3.460,3.460,3.461,3.465,3.471],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.653,1.735,1.667,1.581,1.590,1.646],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.2.10.48","source":"results/21.2.10.48.json"} +,{"actual_version":"21.4.7.3","data_size":{"coffeeshop":44764332578,"hits":14423252264,"job":1830194210,"mgbench":2957795787,"ontime":2704903445,"ssb":72905188206,"taxi":24217093656,"tpcds":18803766610,"tpch":17375384051,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":794,"hits":237,"job":22,"mgbench":59,"ontime":52,"ssb":1375,"taxi":918,"tpcds":303,"tpch":262,"uk":36},"machine":"c7a.4xlarge","release_date":"2021-05-20","result":[[0.067,0.009,0.008,0.011,0.011,0.008],[0.060,0.023,0.023,0.023,0.023,0.025],[0.054,0.010,0.011,0.010,0.010,0.010],[0.044,0.013,0.011,0.013,0.013,0.011],[0.040,0.024,0.020,0.022,0.021,0.020],[0.074,0.016,0.016,0.015,0.017,0.017],[0.031,0.006,0.007,0.009,0.007,0.007],[0.064,0.024,0.023,0.023,0.024,0.023],[0.061,0.038,0.034,0.033,0.037,0.035],[0.123,0.093,0.087,0.082,0.083,0.087],[0.482,0.497,0.474,0.501,0.483,0.496],[0.519,0.427,0.421,0.416,0.409,0.439],[0.036,0.011,0.008,0.012,0.014,0.013],[0.059,0.012,0.018,0.013,0.014,0.015],[0.893,0.841,0.839,0.827,0.833,0.846],[0.531,0.191,0.205,0.189,0.194,0.194],[0.041,0.016,0.020,0.019,0.019,0.019],[0.455,0.235,0.245,0.242,0.239,0.248],[6.401,1.435,1.417,1.426,1.416,1.418],[4.718,1.229,1.229,1.210,1.218,1.224],[4.726,1.117,1.135,1.131,1.139,1.131],[5.505,1.951,1.932,1.945,1.950,1.955],[6.429,1.747,1.755,1.771,1.743,1.730],[4.238,1.166,1.150,1.156,1.159,1.146],[0.058,0.038,0.032,0.025,0.030,0.033],[7.686,2.169,2.166,2.171,2.180,2.174],[4.427,1.751,1.748,1.752,1.744,1.761],[4.394,1.116,1.139,1.123,1.107,1.117],[0.004,0.002,0.002,0.002,0.002,0.002],[0.029,0.016,0.016,0.013,0.013,0.014],[0.043,0.035,0.030,0.029,0.029,0.027],[0.068,0.031,0.034,0.032,0.031,0.033],[0.156,0.138,0.136,0.125,0.136,0.132],[0.243,0.218,0.211,0.203,0.210,0.206],[0.023,0.017,0.017,0.016,0.017,0.016],[0.020,0.014,0.014,0.014,0.013,0.014],[0.307,0.277,0.280,0.285,0.274,0.293],[0.376,0.333,0.326,0.330,0.350,0.336],[0.139,0.134,0.124,0.135,0.126,0.125],[0.150,0.123,0.125,0.125,0.126,0.127],[0.438,0.387,0.376,0.375,0.362,0.363],[0.566,0.513,0.496,0.479,0.505,0.498],[0.494,0.450,0.431,0.449,0.445,0.454],[0.498,0.495,0.472,0.467,0.470,0.473],[1.273,1.146,1.152,1.149,1.126,1.146],[0.787,0.728,0.755,0.770,0.744,0.742],[2.929,2.600,2.620,null,2.555,2.553],[0.083,0.055,0.036,0.032,0.034,0.033],[1.496,0.348,0.326,0.333,0.326,0.324],[1.822,0.395,0.411,0.393,0.398,0.387],[2.114,1.151,1.102,1.116,1.125,1.155],[4.818,0.551,0.559,0.501,0.558,0.525],[0.291,0.140,0.129,0.131,0.133,0.131],[0.194,0.107,0.108,0.103,0.107,0.112],[0.266,0.140,0.130,0.136,0.127,0.129],[1.465,0.451,0.442,0.465,0.457,0.442],[1.083,0.618,0.611,0.619,0.590,0.615],[1.067,1.035,1.035,1.026,1.027,1.031],[0.427,0.371,0.359,0.342,0.362,0.355],[0.723,0.550,0.522,0.558,0.534,0.551],[3.734,3.309,3.343,3.291,3.303,3.372],[2.206,1.773,1.820,1.809,1.770,1.797],[2.172,1.791,1.812,1.803,1.782,1.808],[0.823,0.762,0.769,0.757,0.736,0.720],[0.143,0.073,0.067,0.049,0.065,0.059],[0.059,0.060,0.032,0.038,0.033,0.023],[0.070,0.019,0.032,0.031,0.024,0.020],[0.183,0.079,0.082,0.089,0.081,0.082],[0.034,0.013,0.014,0.013,0.009,0.012],[0.029,0.011,0.010,0.009,0.012,0.016],[0.021,0.008,0.009,0.006,0.009,0.006],[0.148,0.067,0.064,0.066,0.066,0.066],[0.182,0.087,0.087,0.088,0.097,0.090],[0.078,0.042,0.043,0.039,0.044,0.041],[0.099,0.059,0.057,0.057,0.055,0.057],[0.063,0.034,0.033,0.033,0.033,0.033],[0.126,0.071,0.068,0.069,0.069,0.070],[0.147,0.097,0.096,0.096,0.094,0.094],[0.056,0.035,0.037,0.037,0.035,0.037],[0.091,0.062,0.062,0.063,0.063,0.064],[0.205,0.164,0.170,0.182,0.170,0.161],[0.253,0.214,0.213,0.218,0.209,0.214],[0.454,0.385,0.390,0.387,0.390,0.383],[0.081,0.066,0.076,0.069,0.068,0.069],[0.452,0.342,0.335,0.336,0.337,0.342],[2.579,2.445,2.425,2.400,2.383,2.409],[8.663,1.102,1.107,1.116,1.095,1.114],[1.757,1.091,1.079,1.086,1.085,1.068],[12.815,3.580,3.582,3.598,3.587,3.582],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.041,4.841,4.841,4.843,4.801,4.809],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.734,0.747,0.735,0.744,0.748,0.753],[null,null,null,null,null,null],[16.073,16.209,16.316,16.072,16.230,16.230],[null,null,null,null,null,null],[26.756,27.263,27.255,27.092,26.806,26.803],[null,null,null,null,null,null],[33.179,33.690,33.639,33.625,33.872,34.127],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.186,8.130,8.028,8.140,8.155,8.121],[0.483,0.393,0.395,0.391,0.407,0.391],[0.800,0.660,0.647,0.652,0.665,0.644],[null,null,null,null,null,null],[0.811,0.761,0.781,0.795,0.792,0.782],[0.275,0.202,0.208,0.215,0.207,0.214],[0.446,0.344,0.368,0.357,0.367,0.365],[null,null,null,null,null,null],[32.778,32.732,32.629,32.807,32.860,32.766],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.355,1.307,1.310,1.317,1.285,1.319],[3.667,3.623,3.617,3.507,3.665,3.620],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.197,0.480,0.511,0.482,0.474,0.493],[null,null,null,null,null,null],[1.072,0.975,0.956,0.951,0.936,0.950],[null,null,null,null,null,null],[52.247,51.992,52.039,51.594,52.641,52.249],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.825,0.742,0.736,0.708,0.743,0.748],[null,null,null,null,null,null],[11.687,11.275,11.297,11.226,11.316,11.329],[null,null,null,null,null,null],[2.661,2.516,2.372,2.430,2.456,2.436],[null,null,null,null,null,null],[0.234,0.152,0.148,0.150,0.147,0.144],[0.255,0.209,0.205,0.198,0.191,0.216],[10.331,9.759,9.915,9.781,9.770,9.799],[16.407,16.162,16.398,16.361,16.195,16.349],[5.293,4.996,4.925,4.911,4.854,4.855],[4.937,4.793,4.814,4.791,4.711,4.814],[11.318,11.334,11.230,11.210,11.200,11.243],[0.421,0.280,0.273,0.274,0.269,0.279],[null,null,null,null,null,null],[1.085,0.905,0.893,0.890,0.876,0.885],[11.371,11.190,11.315,11.305,11.397,11.199],[null,null,null,null,null,null],[1.390,1.240,1.260,1.265,1.217,1.239],[null,null,null,null,null,null],[0.894,0.372,0.359,0.368,0.364,0.360],[0.667,0.466,0.460,0.458,0.449,0.462],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.061,1.046,0.996,0.983,1.013,1.015],[null,null,null,null,null,null],[0.434,0.383,0.376,0.382,0.373,0.382],[0.431,0.375,0.366,0.378,0.375,0.372],[1.262,1.160,1.163,1.152,1.144,1.151],[null,null,null,null,null,null],[2.220,2.189,2.159,2.042,2.077,2.167],[6.449,6.332,6.306,6.418,6.234,6.329],[null,null,null,null,null,null],[0.544,0.501,0.485,0.455,0.491,0.495],[1.831,0.850,0.846,0.816,0.827,0.823],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.642,3.527,3.539,3.534,3.494,3.548],[null,null,null,null,null,null],[2.184,2.158,2.047,2.083,2.061,2.136],[null,null,null,null,null,null],[9.539,9.490,9.543,9.346,9.291,9.297],[2.174,2.143,2.114,2.149,2.052,2.063],[0.708,0.409,0.423,0.392,0.424,0.410],[null,null,null,null,null,null],[0.661,0.535,0.550,0.536,0.541,0.544],[2.437,2.336,2.309,2.314,2.327,2.321],[0.845,0.416,0.400,0.411,0.416,0.415],[1.425,1.282,1.269,1.266,1.251,1.251],[0.407,0.339,0.338,0.330,0.347,0.365],[null,null,null,null,null,null],[null,null,null,null,null,null],[18.689,18.309,19.410,18.449,18.615,18.886],[1.131,0.965,0.993,0.998,0.987,0.995],[null,null,null,null,null,null],[2.438,0.748,0.710,0.716,0.691,0.730],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.584,0.371,0.361,0.368,0.371,0.364],[null,null,null,null,null,null],[0.452,0.387,0.369,0.380,0.401,0.381],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.025,0.021,0.021,0.030,0.021,0.021],[1.397,0.413,0.403,0.411,0.409,0.409],[0.065,0.066,0.068,0.069,0.068,0.065],[null,null,null,null,null,null],[4.055,4.012,3.900,3.942,3.875,3.976],[null,null,null,null,null,null],[1.757,1.697,1.709,1.701,1.695,1.681],[0.200,0.125,0.132,0.134,0.131,0.126],[1.152,1.122,1.122,1.126,1.114,1.110],[1.500,1.314,1.326,1.362,1.295,1.305],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.639,2.522,2.550,2.524,2.516,2.528],[null,null,null,null,null,null],[0.188,0.125,0.127,0.125,0.130,0.124],[0.778,0.565,0.658,0.680,0.699,0.693],[null,null,null,null,null,null],[2.440,2.319,2.284,2.281,2.254,2.303],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.335,0.191,0.185,0.186,0.184,0.183],[4.246,4.046,4.034,3.998,4.068,4.039],[null,null,null,null,null,null],[0.650,0.570,0.574,0.585,0.575,0.577],[0.925,0.855,0.880,0.868,0.847,0.864],[1.051,0.960,0.951,0.913,0.917,0.940],[0.885,0.848,0.831,0.858,0.839,0.832],[1.005,0.940,0.940,0.971,0.906,0.862],[19.695,19.717,19.842,19.849,19.727,19.564],[5.654,5.569,5.592,5.587,5.596,5.579],[1.504,1.420,1.420,1.386,1.438,1.404],[null,null,null,null,null,null],[32.490,32.117,32.191,32.158,32.141,32.615],[32.093,31.420,31.642,31.544,31.415,31.285],[34.308,33.737,33.730,33.934,33.636,33.684],[3.690,3.664,3.694,3.682,3.662,3.686],[2.451,2.313,2.373,2.420,2.395,2.242],[3.909,3.860,3.877,3.949,3.845,3.835],[10.256,9.775,9.803,9.751,9.791,9.834],[10.049,10.074,10.004,10.104,10.059,10.010],[10.004,10.042,9.982,10.104,9.964,10.036],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[37.291,37.244,37.252,37.307,37.092,36.988],[58.127,57.757,58.138,58.016,57.806,58.318],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.782,3.670,3.684,3.773,3.767,3.803],[4.281,4.174,4.152,4.218,4.192,4.225],[0.872,0.925,0.874,0.873,0.850,0.867],[0.907,0.882,0.857,0.903,0.876,0.887],[4.831,4.691,4.609,4.677,4.720,4.688],[null,null,null,null,null,null],[4.298,3.755,3.911,3.846,3.754,3.827],[4.558,4.228,4.186,4.167,4.217,4.252],[4.271,3.786,3.778,3.833,3.836,3.773],[3.397,2.963,2.972,3.019,2.935,2.944],[4.108,4.070,4.019,4.114,4.104,4.073],[4.162,4.021,4.077,4.014,4.052,4.086],[4.165,4.097,4.080,4.088,4.075,4.107],[2.966,2.473,2.448,2.407,2.472,2.469],[2.111,1.998,2.012,2.032,2.009,1.985],[3.509,3.393,3.445,3.438,3.401,3.378],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.275,5.232,5.194,5.189,5.259,5.204],[0.806,0.793,0.766,0.814,0.782,0.797],[4.999,4.482,4.483,4.529,4.473,4.540],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.227,1.200,1.218,1.199,1.207,1.193],[1.230,1.187,1.205,1.205,1.193,1.171],[1.201,1.192,1.229,1.190,1.169,1.183],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.465,5.480,5.469,5.488,5.471,5.448],[5.446,5.440,5.443,5.470,5.450,5.429],[5.344,5.346,5.372,5.339,5.364,5.376],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.350,1.280,1.316,1.313,1.295,1.268],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.4.7.3","source":"results/21.4.7.3.json"} +,{"actual_version":"21.5.9.4","data_size":{"coffeeshop":44762537190,"hits":14360096218,"job":1830194210,"mgbench":2958144772,"ontime":2704903445,"ssb":72903101948,"taxi":24216764654,"tpcds":18801857610,"tpch":17376858943,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":839,"hits":220,"job":21,"mgbench":69,"ontime":58,"ssb":1429,"taxi":935,"tpcds":317,"tpch":254,"uk":36},"machine":"c7a.4xlarge","release_date":"2021-07-10","result":[[0.070,0.010,0.009,0.009,0.009,0.008],[0.064,0.030,0.024,0.024,0.023,0.025],[0.053,0.010,0.010,0.010,0.010,0.011],[0.050,0.014,0.015,0.011,0.011,0.011],[0.041,0.022,0.022,0.026,0.024,0.020],[0.076,0.020,0.016,0.017,0.016,0.018],[0.028,0.006,0.007,0.009,0.007,0.006],[0.062,0.023,0.024,0.023,0.027,0.022],[0.062,0.038,0.035,0.034,0.035,0.038],[0.125,0.097,0.097,0.092,0.085,0.081],[0.638,0.510,0.473,0.457,0.507,0.443],[0.515,0.421,0.427,0.438,0.429,0.437],[0.034,0.019,0.010,0.008,0.009,0.008],[0.056,0.023,0.018,0.014,0.023,0.014],[0.927,0.848,0.828,0.854,0.836,0.852],[0.542,0.195,0.197,0.191,0.199,0.200],[0.044,0.021,0.021,0.021,0.021,0.018],[0.426,0.260,0.243,0.240,0.255,0.244],[6.387,1.490,1.478,1.447,1.447,1.454],[4.711,1.340,1.282,1.318,1.309,1.301],[4.726,1.188,1.141,1.204,1.201,1.217],[5.497,2.103,2.192,2.304,2.089,2.097],[6.441,1.988,1.994,2.033,1.855,1.861],[4.244,1.212,1.221,1.190,1.227,1.267],[0.067,0.034,0.032,0.035,0.036,0.034],[7.692,2.374,2.503,2.477,2.274,2.234],[4.434,1.840,1.848,1.984,1.960,1.831],[4.393,1.138,1.149,1.171,1.207,1.180],[0.005,0.002,0.002,0.002,0.004,0.002],[0.045,0.018,0.018,0.015,0.017,0.015],[0.053,0.033,0.026,0.027,0.026,0.026],[0.113,0.030,0.032,0.032,0.033,0.034],[0.172,0.132,0.138,0.135,0.136,0.129],[0.235,0.205,0.200,0.203,0.203,0.202],[0.028,0.017,0.016,0.016,0.015,0.016],[0.026,0.020,0.014,0.014,0.014,0.014],[0.307,0.283,0.290,0.267,0.282,0.265],[0.395,0.346,0.325,0.351,0.337,0.345],[0.157,0.135,0.129,0.130,0.129,0.130],[0.182,0.141,0.131,0.130,0.136,0.121],[0.483,0.405,0.405,0.374,0.393,0.395],[0.611,0.502,0.517,0.525,0.520,0.544],[0.544,0.472,0.443,0.467,0.478,0.477],[0.599,0.535,0.506,0.502,0.545,0.537],[1.345,1.231,1.223,1.251,1.192,1.230],[0.866,0.792,0.795,0.851,0.812,0.794],[3.216,2.731,2.902,2.906,2.733,2.766],[0.087,0.070,0.038,0.034,0.032,0.035],[1.487,0.387,0.385,0.372,0.379,0.384],[1.740,0.396,0.409,0.416,0.408,0.420],[4.094,1.218,1.167,1.205,1.191,1.188],[4.574,0.615,0.615,0.615,0.605,0.595],[0.313,0.145,0.137,0.142,0.138,0.135],[0.215,0.111,0.103,0.113,0.104,0.104],[0.215,0.126,0.131,0.132,0.130,0.133],[1.420,0.514,0.515,0.510,0.476,0.485],[1.103,0.625,0.623,0.627,0.626,0.645],[1.091,1.027,1.078,1.058,1.059,1.059],[0.426,0.376,0.376,0.362,0.368,0.384],[0.744,0.573,0.577,0.575,0.598,0.585],[3.966,3.564,3.561,3.718,3.603,3.643],[2.240,1.973,1.926,1.933,1.917,1.802],[2.183,1.878,1.837,1.807,1.782,1.839],[0.806,0.770,0.797,0.765,0.754,0.782],[0.105,0.070,0.074,0.061,0.064,0.053],[0.077,0.054,0.034,0.027,0.053,0.045],[0.072,0.035,0.019,0.025,0.031,0.039],[0.204,0.133,0.139,0.122,0.112,0.104],[0.032,0.009,0.009,0.009,0.013,0.009],[0.033,0.009,0.011,0.009,0.007,0.015],[0.019,0.004,0.011,0.005,0.008,0.009],[0.160,0.068,0.071,0.067,0.077,0.063],[0.203,0.093,0.091,0.091,0.090,0.089],[0.079,0.051,0.047,0.044,0.044,0.041],[0.103,0.061,0.060,0.058,0.059,0.060],[0.062,0.034,0.035,0.032,0.034,0.036],[0.113,0.072,0.073,0.071,0.069,0.083],[0.137,0.096,0.093,0.095,0.097,0.095],[0.053,0.035,0.035,0.035,0.034,0.033],[0.091,0.062,0.062,0.063,0.064,0.064],[0.206,0.167,0.166,0.175,0.166,0.164],[0.312,0.230,0.218,0.219,0.216,0.214],[0.465,0.399,0.393,0.395,0.404,0.404],[0.108,0.100,0.073,0.066,0.075,0.068],[0.517,0.339,0.344,0.343,0.349,0.339],[2.600,2.430,2.406,2.390,2.429,2.424],[8.631,1.149,1.129,1.123,1.171,1.168],[1.745,1.142,1.105,1.102,1.094,1.068],[12.798,4.058,3.932,4.081,4.094,4.039],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.754,5.389,5.082,5.024,4.919,4.846],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.724,0.741,0.740,0.741,0.744,0.746],[null,null,null,null,null,null],[16.180,16.132,16.108,16.281,16.277,16.225],[null,null,null,null,null,null],[26.723,26.648,27.685,27.565,27.201,27.103],[null,null,null,null,null,null],[43.642,42.600,42.158,42.754,42.189,42.235],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.481,8.225,8.346,8.354,8.426,8.361],[0.710,0.656,0.634,0.652,0.614,0.625],[1.370,1.207,1.207,1.172,1.206,1.214],[null,null,null,null,null,null],[0.849,0.815,0.806,0.781,0.854,0.768],[0.283,0.192,0.214,0.208,0.243,0.210],[0.491,0.417,0.412,0.420,0.418,0.398],[null,null,null,null,null,null],[33.630,33.100,33.087,32.809,32.972,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.453,1.375,1.317,1.301,1.302,1.301],[3.956,3.777,3.811,3.743,3.705,3.758],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.244,0.570,0.558,0.560,0.574,0.573],[null,null,null,null,null,null],[1.167,1.037,1.014,0.989,0.980,0.986],[null,null,null,null,null,null],[51.134,50.824,50.250,50.683,50.629,50.186],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.166,1.142,1.118,1.131,1.081,1.109],[null,null,null,null,null,null],[11.528,11.335,11.385,11.315,11.262,11.347],[null,null,null,null,null,null],[2.686,2.524,2.487,2.587,2.498,2.558],[null,null,null,null,null,null],[0.279,0.172,0.150,0.164,0.154,0.159],[0.294,0.200,0.196,0.200,0.197,0.211],[8.526,8.187,8.117,8.149,8.244,8.366],[16.028,16.340,16.002,16.268,16.029,16.150],[5.367,5.037,4.966,4.909,4.940,4.916],[5.048,4.885,4.882,4.938,4.861,4.886],[11.310,11.348,11.310,11.400,11.345,11.255],[0.484,0.321,0.323,0.332,0.334,0.320],[null,null,null,null,null,null],[1.174,0.971,0.978,0.969,0.955,0.957],[11.438,11.208,11.304,11.358,11.318,11.296],[null,null,null,null,null,null],[1.546,1.375,1.356,1.350,1.356,1.355],[null,null,null,null,null,null],[0.909,0.403,0.412,0.403,0.413,0.416],[0.795,0.508,0.494,0.507,0.503,0.515],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.227,1.112,1.160,1.159,1.161,1.159],[null,null,null,null,null,null],[0.489,0.405,0.411,0.423,0.424,0.443],[0.473,0.427,0.416,0.422,0.417,0.429],[1.291,1.177,1.181,1.170,1.179,1.158],[null,null,null,null,null,null],[2.277,2.198,2.196,2.156,2.202,2.208],[6.530,6.485,6.411,6.560,6.593,6.597],[null,null,null,null,null,null],[0.752,0.630,0.713,0.706,0.661,0.681],[1.891,0.892,0.894,0.915,0.900,0.920],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.816,3.679,3.674,3.647,3.686,3.667],[null,null,null,null,null,null],[2.280,2.185,2.218,2.238,2.243,2.199],[null,null,null,null,null,null],[10.172,9.818,9.866,9.843,10.050,10.099],[2.283,2.247,2.258,2.246,2.199,2.259],[0.923,0.528,0.459,0.506,0.450,0.498],[null,null,null,null,null,null],[0.777,0.601,0.586,0.580,0.583,0.588],[2.587,2.386,2.336,2.345,2.363,2.343],[0.920,0.496,0.512,0.515,0.522,0.508],[1.601,1.369,1.344,1.322,1.325,1.322],[0.418,0.349,0.343,0.357,0.355,0.352],[null,null,null,null,null,null],[null,null,null,null,null,null],[18.843,19.205,18.931,18.995,18.785,18.924],[1.249,1.081,1.099,1.129,1.109,1.109],[null,null,null,null,null,null],[2.471,0.807,0.748,0.769,0.750,0.757],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.844,0.406,0.379,0.399,0.402,0.399],[null,null,null,null,null,null],[0.777,0.404,0.386,0.401,0.410,0.408],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.030,0.021,0.027,0.021,0.027,0.021],[1.609,0.457,0.470,0.461,0.456,0.461],[0.069,0.072,0.066,0.068,0.076,0.070],[null,null,null,null,null,null],[4.348,3.954,4.081,3.997,4.000,3.945],[null,null,null,null,null,null],[2.105,1.994,2.034,2.002,1.966,2.002],[0.202,0.141,0.140,0.143,0.139,0.143],[1.232,1.146,1.120,1.136,1.118,1.112],[1.478,1.355,1.418,1.373,1.401,1.419],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.845,2.712,2.697,2.709,2.688,2.690],[null,null,null,null,null,null],[0.216,0.141,0.141,0.136,0.141,0.143],[0.826,0.695,0.722,0.676,0.627,0.573],[null,null,null,null,null,null],[2.466,2.286,2.280,2.293,2.300,2.321],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.313,0.211,0.218,0.214,0.215,0.214],[4.266,4.113,4.116,4.133,4.115,4.140],[null,null,null,null,null,null],[0.701,0.596,0.607,0.605,0.615,0.613],[0.939,0.859,0.924,0.854,0.889,0.889],[1.018,0.937,0.947,0.954,0.963,0.964],[0.931,0.876,0.829,0.845,0.846,0.868],[1.025,0.992,0.928,0.953,0.983,0.907],[19.183,19.907,19.458,19.452,19.735,19.298],[5.653,5.643,5.641,5.576,5.573,5.749],[1.472,1.415,1.394,1.421,1.390,1.441],[null,null,null,null,null,null],[32.227,32.129,32.297,32.552,32.133,32.665],[31.874,31.395,31.341,31.196,31.365,31.468],[33.791,33.763,33.749,33.577,33.808,33.547],[3.728,3.647,3.827,3.729,3.783,3.712],[2.413,2.441,2.396,2.448,2.335,2.428],[3.766,3.960,3.848,3.832,3.918,3.828],[10.273,9.889,9.827,9.832,9.999,9.871],[10.367,10.123,10.123,10.156,10.193,10.118],[10.409,10.069,10.127,10.126,10.204,10.205],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[38.717,37.704,37.346,37.355,38.245,37.485],[59.240,59.037,59.254,59.146,59.555,59.043],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.861,3.775,3.805,3.823,3.809,3.780],[4.339,4.369,4.339,4.261,4.362,4.310],[0.928,0.888,0.904,0.870,0.882,0.915],[0.919,0.888,0.871,0.904,0.879,0.849],[4.770,4.573,4.668,4.784,4.696,4.728],[null,null,null,null,null,null],[4.137,3.789,3.853,3.790,3.827,3.849],[4.553,4.154,4.242,4.227,4.269,4.335],[4.164,3.847,3.858,3.860,4.024,3.836],[3.312,2.943,3.016,2.991,2.975,2.975],[4.129,4.147,4.047,4.064,4.108,4.119],[4.141,4.011,4.072,4.062,4.035,4.040],[4.161,4.019,4.056,4.045,4.125,4.013],[2.878,2.309,2.489,2.514,2.475,2.494],[2.340,2.075,2.039,2.004,2.053,2.053],[3.818,3.404,3.450,3.517,3.448,3.502],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.545,5.177,5.258,5.206,5.258,5.172],[0.811,0.793,0.764,0.776,0.796,0.772],[4.815,4.416,4.559,4.510,4.502,4.454],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.200,1.209,1.202,1.215,1.213,1.243],[1.207,1.197,1.191,1.190,1.198,1.183],[1.285,1.190,1.196,1.169,1.200,1.192],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.496,5.448,5.450,5.443,5.484,5.461],[5.476,5.460,5.465,5.455,5.464,5.468],[5.399,5.361,5.371,5.364,5.359,5.393],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.327,1.292,1.277,1.271,1.315,1.244],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.5.9.4","source":"results/21.5.9.4.json"} +,{"actual_version":"20.8.19.4","data_size":{"hits":14341101643,"job":1830089086,"mgbench":2958703705,"ontime":2702850997,"ssb":73373067612,"taxi":24214982349,"tpcds":18821745147,"tpch":17319725967,"uk":783406830},"kind":"versions-benchmark","load_time":{"hits":222,"job":26,"mgbench":53,"ontime":49,"ssb":1538,"taxi":940,"tpcds":256,"tpch":267,"uk":33},"machine":"c7a.4xlarge","release_date":"2021-07-11","result":[[0.123,0.012,0.010,0.009,0.009,0.012],[0.066,0.027,0.023,0.022,0.027,0.021],[0.055,0.009,0.011,0.009,0.014,0.010],[0.058,0.013,0.012,0.011,0.010,0.010],[0.050,0.022,0.021,0.027,0.022,0.023],[0.082,0.016,0.015,0.014,0.017,0.016],[0.037,0.005,0.005,0.006,0.005,0.005],[0.072,0.022,0.022,0.022,0.025,0.022],[0.076,0.038,0.034,0.034,0.035,0.037],[0.123,0.090,0.083,0.085,0.086,0.078],[0.516,0.468,0.486,0.459,0.416,0.468],[0.497,0.380,0.380,0.397,0.377,0.375],[0.047,0.013,0.006,0.013,0.016,0.005],[0.129,0.012,0.036,0.015,0.026,0.012],[0.919,0.864,0.867,0.850,0.864,0.867],[0.297,0.123,0.119,0.122,0.119,0.130],[0.045,0.024,0.024,0.023,0.023,0.019],[0.199,0.141,0.138,0.152,0.142,0.144],[6.471,1.688,1.673,1.677,1.684,1.701],[5.207,1.355,1.231,1.214,1.212,1.223],[4.797,1.225,1.232,1.218,1.214,1.236],[5.456,2.077,2.065,2.066,2.066,2.054],[6.272,1.795,1.783,1.790,1.801,1.781],[4.041,1.000,1.000,1.004,1.015,1.002],[0.071,0.031,0.032,0.033,0.035,0.034],[7.896,2.269,2.268,2.325,2.347,2.499],[2.769,1.118,1.089,1.119,1.111,1.108],[2.027,0.615,0.612,0.606,0.623,0.616],[0.024,0.005,0.002,0.006,0.002,0.002],[0.047,0.014,0.012,0.013,0.012,0.013],[0.056,0.038,0.027,0.028,0.027,0.029],[0.060,0.032,0.030,0.029,0.030,0.031],[0.156,0.132,0.121,0.133,0.113,0.098],[0.254,0.189,0.187,0.199,0.194,0.203],[0.035,0.016,0.016,0.017,0.018,0.016],[0.033,0.013,0.013,0.013,0.012,0.013],[0.308,0.285,0.287,0.280,0.273,0.264],[0.365,0.312,0.322,0.313,0.313,0.318],[0.149,0.116,0.106,0.108,0.118,0.115],[0.178,0.122,0.126,0.119,0.107,0.113],[0.422,0.363,0.367,0.365,0.355,0.365],[0.559,0.485,0.480,0.474,0.485,0.484],[0.522,0.446,0.426,0.422,0.422,0.420],[0.513,0.433,0.436,0.436,0.437,0.458],[1.247,1.080,1.075,1.094,1.088,1.091],[0.860,0.738,0.796,0.729,0.727,0.741],[2.698,2.481,3.166,2.451,2.330,2.355],[0.232,0.125,0.047,0.056,0.032,0.027],[1.429,0.374,0.398,0.356,0.347,0.352],[1.776,0.402,0.408,0.405,0.402,0.398],[4.070,1.198,1.175,1.185,1.180,1.181],[4.226,0.615,0.577,0.589,0.554,0.584],[0.273,0.138,0.134,0.136,0.132,0.146],[0.237,0.114,0.104,0.102,0.101,0.104],[0.229,0.131,0.131,0.125,0.157,0.126],[1.415,0.469,0.477,0.479,0.461,0.473],[1.058,0.598,0.604,0.611,0.598,0.612],[1.121,1.076,1.077,1.066,1.066,1.058],[0.455,0.376,0.389,0.386,0.384,0.384],[0.703,0.584,0.570,0.569,0.582,0.570],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.159,0.081,0.110,0.077,0.106,0.099],[0.048,0.076,0.033,0.026,0.033,0.035],[0.108,0.036,0.036,0.054,0.035,0.024],[0.237,0.159,0.152,0.132,0.149,0.124],[0.063,0.034,0.036,0.009,0.037,0.015],[0.040,0.026,0.018,0.015,0.013,0.010],[0.026,0.004,0.004,0.024,0.004,0.003],[0.297,0.084,0.191,0.091,0.080,0.090],[0.263,0.217,0.101,0.096,0.219,0.109],[0.085,0.054,0.040,0.063,0.036,0.041],[0.164,0.133,0.134,0.137,0.138,0.131],[0.065,0.032,0.023,0.025,0.023,0.022],[0.097,0.063,0.060,0.055,0.058,0.057],[0.139,0.090,0.090,0.088,0.086,0.088],[0.043,0.024,0.025,0.024,0.026,0.024],[0.077,0.041,0.039,0.036,0.039,0.038],[0.170,0.139,0.157,0.134,0.135,0.140],[0.271,0.229,0.228,0.227,0.223,0.225],[0.438,0.371,0.368,0.353,0.365,0.365],[0.083,0.075,0.075,0.078,0.073,0.076],[0.497,0.394,0.394,0.390,0.397,0.395],[2.423,2.300,2.299,2.244,2.268,2.246],[8.461,1.136,1.135,1.128,1.140,1.140],[2.296,2.236,2.220,2.211,2.211,2.209],[12.659,5.607,5.593,5.601,5.609,5.608],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.677,0.866,0.868,0.875,0.871,0.880],[null,null,null,null,null,null],[20.901,20.752,20.864,20.944,20.998,20.780],[null,null,null,null,null,null],[35.228,35.295,34.999,35.373,35.662,35.252],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[10.432,10.362,10.334,10.225,10.366,10.353],[1.335,1.265,1.280,1.302,1.312,1.253],[0.697,0.550,0.549,0.552,0.544,0.556],[null,null,null,null,null,null],[0.825,0.725,0.731,0.734,0.719,0.732],[null,null,null,null,null,null],[0.565,0.472,0.446,0.433,0.447,0.439],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.028,3.939,3.932,4.009,4.010,3.986],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.146,1.026,1.015,1.002,1.023,1.014],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.118,12.676,12.845,12.705,12.642,12.676],[null,null,null,null,null,null],[2.887,2.697,2.699,2.664,2.651,2.681],[null,null,null,null,null,null],[0.975,0.829,0.837,0.867,0.829,0.842],[0.972,0.949,0.883,0.880,0.822,0.828],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.849,12.540,12.566,12.643,12.565,12.551],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.160,1.026,1.022,1.029,1.029,1.030],[12.795,12.554,12.575,12.645,12.556,12.504],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.645,1.564,1.612,1.582,1.554,1.604],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.159,2.025,2.011,2.008,2.023,2.012],[null,null,null,null,null,null],[2.423,2.325,2.293,2.298,2.317,2.273],[6.706,6.618,6.682,6.698,6.653,6.724],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.135,3.876,3.800,3.806,3.776,3.760],[null,null,null,null,null,null],[2.457,2.415,2.329,2.378,2.281,2.296],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.334,2.310,2.345,2.371,2.366,2.388],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.002,1.882,1.871,1.879,1.900,1.883],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.063,21.111,20.665,20.793,20.944,21.370],[2.296,2.029,2.051,2.056,2.045,2.051],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.043,0.013,0.021,0.014,0.014,0.018],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.532,2.471,2.430,2.406,2.452,2.426],[null,null,null,null,null,null],[1.205,1.137,1.125,1.387,1.112,1.105],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.319,0.239,0.237,0.233,0.235,0.243],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.451,3.241,3.225,3.212,3.219,3.232],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.470,0.374,0.375,0.378,0.375,0.375],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.169,3.018,3.017,2.991,3.046,3.045],[null,null,null,null,null,null],[1.601,1.481,1.493,1.503,1.465,1.489],[1.346,1.252,1.200,1.312,1.189,1.227],[1.585,1.456,1.473,1.438,1.495,1.453],[19.805,19.147,19.149,19.382,19.329,19.254],[6.561,6.318,6.423,6.337,6.501,6.341],[2.355,2.269,2.366,2.240,2.294,2.223],[null,null,null,null,null,null],[34.277,33.859,33.589,33.846,33.668,33.868],[32.505,32.119,31.983,32.408,32.363,32.323],[38.619,38.330,37.782,38.092,38.025,37.898],[6.119,6.191,6.132,6.033,6.143,6.157],[3.372,3.144,3.154,3.202,3.200,3.169],[6.743,6.613,6.605,6.630,6.484,6.783],[11.602,11.246,11.235,11.215,11.290,11.428],[12.001,11.653,11.618,11.528,11.671,11.815],[11.832,11.662,11.689,11.691,11.681,11.577],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[69.753,69.809,69.499,69.607,69.688,69.679],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.386,4.193,4.160,4.260,4.315,4.289],[5.251,5.173,5.125,5.168,5.137,5.208],[0.222,0.176,0.173,0.183,0.175,0.173],[0.217,0.175,0.189,0.177,0.175,0.180],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.733,5.350,5.282,5.280,5.314,5.242],[null,null,null,null,null,null],[5.599,5.241,5.329,5.324,5.302,5.352],[5.145,4.846,4.780,4.758,4.846,4.814],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.668,5.587,5.568,5.602,5.581,5.539],[4.262,3.861,3.800,3.694,3.824,3.766],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.160,12.948,12.915,12.921,12.938,13.024],[0.132,0.098,0.097,0.094,0.094,0.095],[9.437,9.067,9.090,9.107,9.144,9.167],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.395,0.351,0.351,0.353,0.357,0.350],[0.387,0.349,0.357,0.355,0.354,0.363],[0.388,0.351,0.351,0.355,0.353,0.352],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.699,2.663,2.657,2.657,2.661,2.655],[2.689,2.649,2.655,2.667,2.657,2.659],[2.605,2.563,2.569,2.566,2.561,2.563],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.608,1.517,1.516,1.497,1.521,1.508],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"20.8.19.4","source":"results/20.8.19.4.json"} +,{"actual_version":"21.6.9.7","data_size":{"coffeeshop":44755933739,"hits":14419243396,"job":1830194210,"mgbench":2958227125,"ontime":2704903445,"ssb":72903635593,"taxi":24216970438,"tpcds":18808348450,"tpch":17375624168,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":905,"hits":229,"job":28,"mgbench":71,"ontime":65,"ssb":1560,"taxi":1016,"tpcds":299,"tpch":261,"uk":40},"machine":"c7a.4xlarge","release_date":"2021-09-03","result":[[0.059,0.011,0.009,0.009,0.009,0.010],[0.056,0.023,0.023,0.023,0.022,0.022],[0.043,0.014,0.009,0.009,0.010,0.008],[0.042,0.015,0.013,0.218,0.012,0.013],[0.046,0.024,0.022,0.037,0.022,0.024],[0.073,0.036,0.023,0.027,0.018,0.021],[0.029,0.007,0.008,0.014,0.010,0.006],[0.063,0.025,0.027,0.037,0.024,0.026],[0.064,0.034,0.035,0.040,0.034,0.039],[0.131,0.098,0.090,0.091,0.089,0.091],[0.583,0.582,0.507,0.563,0.464,0.544],[0.518,0.416,0.404,0.413,0.421,0.410],[0.046,0.008,0.008,0.023,0.008,0.008],[0.057,0.027,0.021,0.029,0.020,0.013],[0.942,0.914,0.899,0.901,0.905,0.910],[0.192,0.131,0.128,0.150,0.138,0.144],[0.039,0.024,0.021,0.036,0.024,0.019],[0.200,0.165,0.164,0.179,0.175,0.167],[6.416,1.982,1.953,2.010,2.013,1.971],[4.732,1.500,1.510,1.448,1.395,1.381],[4.758,1.446,1.480,1.557,1.592,1.593],[5.429,2.437,2.436,2.493,2.654,2.640],[6.230,2.171,2.205,2.222,2.228,2.113],[3.992,1.392,1.296,1.324,1.294,1.398],[0.069,0.047,0.044,0.043,0.051,0.042],[7.732,2.779,2.889,3.064,3.162,3.286],[2.336,1.423,1.394,1.453,1.443,1.436],[1.936,0.740,0.724,0.739,0.743,0.763],[0.008,0.002,0.002,0.002,0.002,0.005],[0.035,0.021,0.016,0.022,0.018,0.018],[0.040,0.029,0.032,0.029,0.030,0.032],[0.062,0.035,0.037,0.037,0.036,0.035],[0.174,0.158,0.169,0.173,0.166,0.164],[0.287,0.272,0.267,0.250,0.267,0.268],[0.029,0.020,0.018,0.019,0.019,0.020],[0.025,0.015,0.016,0.015,0.015,0.017],[0.353,0.313,0.329,0.363,0.335,0.331],[0.430,0.425,0.402,0.408,0.417,0.423],[0.168,0.162,0.167,0.162,0.167,0.162],[0.193,0.167,0.169,0.179,0.178,0.165],[0.578,0.482,0.470,0.476,0.478,0.495],[0.779,0.673,0.592,0.606,0.619,0.544],[0.630,0.537,0.511,0.551,0.567,0.558],[0.537,0.493,0.511,0.536,0.568,0.551],[1.503,1.340,1.346,1.371,1.419,1.187],[0.913,0.785,0.853,0.852,0.962,0.862],[3.497,2.905,2.876,2.971,3.100,3.228],[0.178,0.066,0.050,0.061,0.046,0.066],[1.473,0.463,0.466,0.448,0.467,0.467],[1.764,0.531,0.494,0.490,0.515,0.543],[4.102,1.377,1.444,1.418,1.350,1.327],[5.078,0.654,0.660,0.657,0.688,0.699],[0.256,0.170,0.158,0.156,0.160,0.161],[0.196,0.135,0.119,0.124,0.121,0.121],[0.240,0.161,0.155,0.149,0.157,0.153],[1.410,0.517,0.519,0.540,0.535,0.563],[1.075,0.770,0.781,0.704,0.741,0.692],[1.131,1.128,1.056,1.523,1.106,1.096],[0.500,0.463,0.461,0.455,0.481,0.473],[0.813,0.733,0.652,0.634,0.662,0.615],[4.328,4.039,4.063,3.892,4.203,4.018],[2.500,2.323,2.354,2.385,2.247,2.233],[2.232,2.232,2.175,2.144,2.205,2.222],[0.942,0.834,0.872,0.914,1.016,0.981],[0.114,0.062,0.076,0.075,0.055,0.055],[0.050,0.060,0.041,0.043,0.030,0.050],[0.065,0.041,0.050,0.023,0.029,0.023],[0.192,0.122,0.112,0.119,0.113,0.121],[0.041,0.008,0.009,0.015,0.010,0.010],[0.030,0.008,0.009,0.008,0.010,0.008],[0.023,0.014,0.009,0.014,0.009,0.005],[0.123,0.080,0.074,0.084,0.078,0.077],[0.154,0.105,0.108,0.104,0.102,0.102],[0.094,0.057,0.061,0.060,0.056,0.050],[0.102,0.067,0.063,0.078,0.068,0.076],[0.064,0.040,0.036,0.055,0.037,0.039],[0.117,0.088,0.089,0.093,0.090,0.084],[0.150,0.176,0.160,0.155,0.152,0.158],[0.075,0.046,0.043,0.049,0.052,0.044],[0.111,0.104,0.090,0.097,0.082,0.071],[0.266,0.207,0.199,0.216,0.250,0.329],[0.330,0.272,0.273,0.272,0.284,0.267],[0.601,0.542,0.513,0.525,0.530,0.530],[0.153,0.070,0.074,0.102,0.079,0.081],[0.554,0.404,0.414,0.429,0.420,0.410],[3.091,2.733,2.711,2.722,2.675,2.712],[8.638,1.354,1.336,1.329,1.341,1.315],[1.794,1.260,1.317,1.327,1.369,1.376],[12.799,4.852,4.810,4.775,4.114,4.114],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.032,5.666,5.796,5.809,5.694,5.786],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.719,0.939,0.910,1.013,0.982,0.966],[null,null,null,null,null,null],[18.378,17.843,16.852,16.800,17.348,15.996],[null,null,null,null,null,null],[26.151,26.342,26.127,26.289,26.944,26.503],[null,null,null,null,null,null],[41.712,41.590,42.409,42.128,42.714,42.294],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.227,8.294,8.247,8.080,8.158,8.233],[0.711,0.622,0.643,0.651,0.644,0.660],[1.105,1.009,1.032,0.999,1.008,1.007],[null,null,null,null,null,null],[0.875,0.825,0.833,0.842,0.849,0.799],[0.309,0.234,0.237,0.222,0.222,0.227],[0.487,0.412,0.421,0.417,0.436,0.433],[null,null,null,null,null,null],[32.855,32.159,32.530,32.101,32.449,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.485,1.479,1.408,1.401,1.390,1.383],[3.814,3.789,3.743,3.746,3.753,3.682],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.263,0.587,0.586,0.595,0.592,0.601],[null,null,null,null,null,null],[1.282,1.150,1.110,1.077,1.043,1.033],[null,null,null,null,null,null],[50.850,50.169,50.461,50.701,50.705,51.444],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.261,1.146,1.125,1.130,1.092,1.108],[null,null,null,null,null,null],[11.587,11.473,11.356,11.344,11.387,11.363],[null,null,null,null,null,null],[2.574,2.456,2.473,2.461,2.510,2.372],[null,null,null,null,null,null],[0.285,0.164,0.167,0.176,0.158,0.170],[0.262,0.215,0.198,0.211,0.201,0.212],[8.218,8.056,8.009,7.968,7.958,7.923],[15.445,15.580,15.563,15.378,15.773,15.685],[5.252,5.043,5.031,4.999,5.015,5.001],[5.120,4.973,5.004,4.951,4.981,4.941],[11.433,11.376,11.379,11.450,11.340,11.407],[0.455,0.342,0.333,0.336,0.347,0.342],[null,null,null,null,null,null],[1.192,1.085,1.087,1.198,1.023,1.017],[11.471,11.333,11.349,11.494,11.440,11.449],[null,null,null,null,null,null],[1.497,1.421,1.425,1.397,1.380,1.379],[null,null,null,null,null,null],[0.912,0.437,0.432,0.429,0.424,0.429],[0.820,0.555,0.525,0.552,0.550,0.565],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.047,1.067,1.030,1.008,1.000,1.032],[null,null,null,null,null,null],[0.489,0.430,0.417,0.430,0.428,0.427],[0.487,0.424,0.431,0.418,0.439,0.427],[1.300,1.213,1.199,1.224,1.201,1.208],[null,null,null,null,null,null],[2.202,2.098,2.068,2.184,2.083,2.146],[6.532,6.494,6.460,6.538,6.520,6.552],[null,null,null,null,null,null],[0.775,0.716,0.677,0.662,0.704,0.665],[1.896,0.957,0.939,0.950,0.954,0.968],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.835,3.667,3.667,3.724,3.689,3.703],[null,null,null,null,null,null],[2.228,2.191,2.178,2.124,2.134,2.098],[null,null,null,null,null,null],[9.687,9.396,9.334,9.479,9.366,9.366],[2.347,2.137,2.156,2.139,2.170,2.139],[0.910,0.479,0.462,0.501,0.515,0.497],[null,null,null,null,null,null],[0.799,0.625,0.634,0.632,0.619,0.622],[2.715,2.532,2.538,2.541,2.536,2.531],[0.912,0.517,0.526,0.516,0.533,0.529],[1.674,1.436,1.405,1.416,1.382,1.390],[0.414,0.359,0.366,0.361,0.361,0.378],[null,null,null,null,null,null],[null,null,null,null,null,null],[18.693,18.425,18.654,18.742,18.766,18.742],[1.303,1.077,1.080,1.118,1.127,1.115],[null,null,null,null,null,null],[2.495,0.804,0.825,0.823,0.853,0.802],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.839,0.414,0.413,0.424,0.407,0.415],[null,null,null,null,null,null],[0.762,0.449,0.434,0.432,0.417,0.431],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.028,0.020,0.020,0.020,0.019,0.023],[1.615,0.486,0.479,0.478,0.477,0.483],[0.055,0.058,0.050,0.060,0.052,0.053],[null,null,null,null,null,null],[4.494,4.135,4.078,4.016,4.157,4.072],[null,null,null,null,null,null],[1.791,1.749,1.721,1.706,1.718,1.697],[0.203,0.145,0.156,0.171,0.155,0.150],[1.179,1.155,1.103,1.139,1.090,1.090],[1.538,1.360,1.373,1.392,1.378,1.350],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.026,2.927,2.905,2.893,2.860,2.951],[null,null,null,null,null,null],[0.210,0.169,0.151,0.151,0.159,0.147],[0.798,0.739,0.753,0.729,0.644,0.726],[null,null,null,null,null,null],[2.608,2.435,2.373,2.383,2.350,2.372],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.299,0.235,0.224,0.236,0.223,0.236],[4.285,4.164,4.286,4.271,4.294,4.227],[null,null,null,null,null,null],[0.722,0.650,0.628,0.652,0.658,0.640],[0.956,0.930,0.879,0.888,0.904,0.897],[1.021,1.006,0.965,1.028,0.892,0.975],[0.937,0.879,0.874,0.894,0.890,0.884],[1.007,0.947,1.009,0.997,0.996,0.937],[19.460,19.904,19.519,20.219,19.561,20.163],[5.532,5.528,5.702,5.568,5.576,5.564],[1.478,1.432,1.464,1.456,1.452,1.427],[null,null,null,null,null,null],[32.888,32.929,33.179,32.725,32.837,33.239],[32.229,31.649,32.626,32.328,32.413,31.894],[34.518,34.655,34.247,34.248,34.137,34.247],[3.772,3.720,3.729,3.683,3.709,3.714],[2.461,2.398,2.459,2.340,2.392,2.412],[3.984,3.888,3.890,3.877,3.879,3.896],[10.289,9.956,9.977,9.959,9.945,9.944],[10.443,10.272,10.333,10.234,10.334,10.224],[10.385,10.138,10.165,10.158,10.194,10.231],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[37.076,36.813,37.088,37.153,36.909,36.830],[57.543,57.369,57.704,57.961,59.697,60.742],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.008,3.874,3.920,3.908,3.924,3.914],[4.423,4.426,4.516,4.423,4.392,4.439],[0.265,0.266,0.265,0.271,0.274,0.264],[0.283,0.264,0.261,0.256,0.252,0.255],[4.807,4.707,4.645,4.683,4.582,4.598],[null,null,null,null,null,null],[4.120,3.838,3.804,3.933,3.932,3.838],[4.546,4.316,4.280,4.282,4.221,4.219],[4.095,3.868,3.911,3.942,3.952,3.892],[3.323,3.021,3.064,3.014,2.999,3.042],[4.158,4.079,4.076,4.070,4.082,4.093],[4.092,4.090,4.113,4.035,4.008,4.036],[4.156,4.072,4.094,4.099,4.192,4.126],[2.777,2.530,2.577,2.576,2.578,2.579],[2.345,2.052,2.094,2.079,2.134,2.011],[3.714,3.486,3.533,3.513,3.517,3.476],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.513,5.397,5.457,5.381,5.393,5.365],[0.141,0.154,0.138,0.142,0.152,0.148],[4.884,4.586,4.590,4.579,4.714,4.652],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.531,0.521,0.564,0.518,0.521,0.522],[0.575,0.524,0.526,0.522,0.526,0.518],[0.527,0.512,0.513,0.517,0.516,0.516],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.962,3.957,3.959,3.950,3.945,3.934],[3.937,3.935,3.942,3.933,3.941,3.941],[3.846,3.853,3.848,3.846,3.847,3.845],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.372,1.328,1.297,1.313,1.311,1.305],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.6.9.7","source":"results/21.6.9.7.json"} +,{"actual_version":"21.7.11.3","data_size":{"coffeeshop":44759407826,"hits":14360695583,"job":1830194210,"mgbench":2958593443,"ontime":2704903445,"ssb":72904321722,"taxi":24217018296,"tpcds":18798067750,"tpch":17375459029,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":980,"hits":234,"job":23,"mgbench":69,"ontime":59,"ssb":1424,"taxi":944,"tpcds":298,"tpch":246,"uk":37},"machine":"c7a.4xlarge","release_date":"2021-09-24","result":[[0.074,0.010,0.011,0.011,0.009,0.009],[0.059,0.025,0.022,0.023,0.023,0.023],[0.052,0.011,0.009,0.009,0.009,0.008],[0.059,0.012,0.013,0.012,0.011,0.011],[0.046,0.024,0.023,0.023,0.020,0.022],[0.071,0.016,0.023,0.024,0.019,0.021],[0.030,0.009,0.007,0.006,0.007,0.007],[0.070,0.024,0.026,0.025,0.025,0.026],[0.064,0.041,0.035,0.040,0.034,0.033],[0.111,0.088,0.089,0.086,0.095,0.084],[0.570,0.515,0.518,0.502,0.508,0.526],[0.504,0.404,0.396,0.410,0.394,0.401],[0.031,0.021,0.008,0.009,0.009,0.016],[0.035,0.032,0.037,0.014,0.032,0.015],[0.905,0.839,0.820,0.819,0.831,0.822],[0.219,0.138,0.125,0.120,0.123,0.120],[0.037,0.026,0.018,0.026,0.019,0.020],[0.202,0.169,0.158,0.411,0.127,0.130],[6.398,1.779,1.820,1.822,1.844,1.884],[4.718,1.272,1.258,1.257,1.264,1.376],[4.761,1.334,1.368,1.285,1.297,1.368],[5.398,2.398,2.203,2.297,2.457,2.569],[6.222,1.822,1.922,2.080,2.112,2.104],[3.996,1.102,1.098,1.075,1.103,1.154],[0.061,0.041,0.035,0.036,0.038,0.036],[7.710,2.455,2.453,2.676,2.855,2.797],[2.304,1.168,1.197,1.152,1.189,1.215],[1.906,0.719,0.723,0.694,0.722,0.711],[0.016,0.002,0.002,0.002,0.004,0.002],[0.030,0.020,0.014,0.013,0.018,0.015],[0.062,0.036,0.031,0.029,0.027,0.030],[0.060,0.033,0.029,0.028,0.030,0.030],[0.156,0.144,0.135,0.133,0.136,0.137],[0.245,0.231,0.226,0.233,0.213,0.232],[0.026,0.016,0.017,0.015,0.015,0.017],[0.024,0.014,0.013,0.013,0.013,0.012],[0.306,0.284,0.276,0.279,0.285,0.281],[0.388,0.341,0.343,0.343,0.342,0.348],[0.148,0.129,0.132,0.125,0.130,0.131],[0.166,0.134,0.130,0.131,0.134,0.132],[0.458,0.381,0.360,0.372,0.371,0.398],[0.591,0.500,0.521,0.518,0.519,0.513],[0.514,0.460,0.453,0.450,0.471,0.494],[0.549,0.484,0.498,0.492,0.495,0.497],[1.306,1.211,1.216,1.273,1.209,1.222],[0.879,0.811,0.768,0.795,0.804,0.779],[3.203,3.005,2.863,2.978,2.837,2.888],[0.188,0.054,0.052,0.033,0.035,0.036],[1.454,0.371,0.362,0.364,0.372,0.376],[1.743,0.429,0.407,0.424,0.423,0.417],[4.062,1.209,1.231,1.233,1.176,1.208],[4.634,0.615,0.608,0.614,0.638,0.647],[0.213,0.164,0.139,0.145,0.142,0.133],[0.174,0.106,0.109,0.117,0.106,0.099],[0.185,0.136,0.124,0.127,0.130,0.133],[1.425,0.499,0.488,0.498,0.490,0.493],[1.076,0.635,0.628,0.621,0.617,0.637],[1.060,1.035,1.018,1.036,1.054,1.069],[0.410,0.374,0.378,0.368,0.362,0.373],[0.708,0.583,0.547,0.547,0.578,0.602],[4.079,3.513,3.521,3.608,3.617,3.577],[2.252,1.911,1.904,1.869,1.882,1.895],[2.152,1.941,1.915,1.943,1.983,1.930],[0.892,0.745,0.839,0.813,0.755,0.816],[0.144,0.077,0.089,0.074,0.080,0.101],[0.073,0.041,0.047,0.047,0.034,0.035],[0.079,0.050,0.044,0.026,0.029,0.030],[0.295,0.180,0.164,0.192,0.172,0.190],[0.040,0.011,0.010,0.011,0.009,0.010],[0.036,0.008,0.010,0.015,0.008,0.014],[0.020,0.004,0.004,0.004,0.006,0.004],[0.149,0.073,0.067,0.065,0.069,0.069],[0.174,0.092,0.090,0.105,0.088,0.089],[0.084,0.046,0.128,0.046,0.045,0.044],[0.098,0.060,0.061,0.067,0.061,0.060],[0.056,0.038,0.036,0.047,0.035,0.034],[0.120,0.090,0.072,0.071,0.069,0.072],[0.147,0.151,0.137,0.131,0.123,0.131],[0.070,0.043,0.051,0.044,0.040,0.046],[0.116,0.085,0.071,0.085,0.090,0.065],[0.222,0.171,0.170,0.169,0.169,0.177],[0.261,0.225,0.221,0.227,0.231,0.230],[0.479,0.418,0.403,0.393,0.398,0.402],[0.164,0.071,0.069,0.068,0.073,0.070],[0.463,0.354,0.330,0.332,0.341,0.335],[2.612,2.420,2.422,2.411,2.431,2.411],[8.674,1.201,1.173,1.222,1.165,1.190],[1.820,1.128,1.158,1.138,1.127,1.141],[12.815,4.030,3.894,3.927,4.187,4.292],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.946,5.493,5.336,5.477,5.254,5.066],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.706,0.783,0.779,0.787,0.759,0.772],[null,null,null,null,null,null],[16.147,16.004,15.780,15.899,16.081,15.957],[null,null,null,null,null,null],[25.954,26.675,26.221,28.722,27.060,27.175],[null,null,null,null,null,null],[42.630,42.423,43.107,42.656,43.182,42.021],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.074,8.169,8.172,8.143,8.123,8.147],[0.705,0.605,0.596,0.636,0.606,0.621],[1.065,1.015,1.001,0.991,0.971,0.975],[null,null,null,null,null,null],[0.827,0.798,0.822,0.813,0.800,0.803],[0.274,0.248,0.205,0.206,0.211,0.230],[0.530,0.415,0.414,0.405,0.415,0.427],[null,null,null,null,null,null],[33.195,33.143,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.397,1.351,1.303,1.313,1.289,1.290],[3.760,3.702,3.779,3.680,3.697,3.712],[89.565,87.971,88.924,87.641,87.943,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.240,0.610,0.573,0.587,0.572,0.573],[null,null,null,null,null,null],[1.232,1.104,1.117,1.072,1.050,1.050],[null,null,null,null,null,null],[52.623,52.026,50.413,51.314,51.083,50.500],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.178,1.132,1.150,1.108,1.146,1.083],[null,null,null,null,null,null],[11.598,11.402,11.487,11.515,11.342,11.355],[null,null,null,null,null,null],[2.590,2.385,2.414,2.520,2.437,2.461],[null,null,null,null,null,null],[0.256,0.149,0.148,0.173,0.145,0.146],[0.287,0.204,0.213,0.196,0.187,0.188],[8.188,7.837,7.780,7.784,7.766,7.685],[15.068,14.981,14.949,15.008,15.161,15.139],[5.462,5.101,5.089,5.034,5.019,4.994],[5.079,4.981,4.896,4.866,4.856,4.840],[11.380,11.269,11.425,11.339,11.368,11.234],[0.441,0.310,0.313,0.316,0.315,0.311],[null,null,null,null,null,null],[1.123,1.011,1.043,1.015,1.007,0.999],[11.363,11.412,11.420,11.376,11.497,11.407],[null,null,null,null,null,null],[1.472,1.324,1.337,1.326,1.321,1.314],[null,null,null,null,null,null],[0.906,0.409,0.404,0.412,0.409,0.408],[0.818,0.520,0.495,0.506,0.508,0.519],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.084,1.034,1.028,1.027,0.996,1.026],[null,null,null,null,null,null],[0.459,0.401,0.403,0.405,0.403,0.395],[0.469,0.403,0.403,0.400,0.408,0.414],[1.274,1.186,1.176,1.194,1.168,1.187],[null,null,null,null,null,null],[2.235,2.091,2.139,2.174,2.085,2.121],[6.544,6.471,6.494,6.457,6.644,6.491],[null,null,null,null,null,null],[0.771,0.628,0.654,0.639,0.670,0.701],[1.902,0.940,0.914,0.897,0.911,0.899],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.753,3.600,3.557,3.609,3.566,3.547],[null,null,null,null,null,null],[2.192,2.150,2.130,2.067,2.072,2.150],[null,null,null,null,null,null],[9.699,9.527,9.543,9.543,9.378,9.551],[2.214,2.140,2.070,2.097,2.117,2.167],[0.909,0.495,0.479,0.468,0.458,0.466],[null,null,null,null,null,null],[0.784,0.585,0.601,0.594,0.576,0.568],[2.522,2.361,2.351,2.348,2.345,2.341],[0.924,0.518,0.510,0.483,0.497,0.472],[1.602,1.353,1.321,1.314,1.346,1.323],[0.402,0.335,0.336,0.340,0.345,0.335],[null,null,null,null,null,null],[null,null,null,null,null,null],[18.909,18.414,18.437,18.433,18.228,18.703],[1.258,1.002,1.031,1.046,1.044,1.043],[null,null,null,null,null,null],[2.470,0.770,0.779,0.789,0.781,0.742],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.833,0.394,0.388,0.385,0.400,0.387],[null,null,null,null,null,null],[0.791,0.411,0.418,0.395,0.403,0.390],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.036,0.023,0.019,0.019,0.020,0.024],[1.608,0.459,0.446,0.441,0.446,0.449],[0.055,0.042,0.044,0.055,0.042,0.042],[null,null,null,null,null,null],[4.402,3.964,4.048,4.045,3.931,3.894],[null,null,null,null,null,null],[1.810,1.700,1.736,1.688,1.688,1.688],[0.208,0.143,0.135,0.165,0.140,0.140],[1.217,1.140,1.143,1.122,1.111,1.106],[1.464,1.321,1.349,1.368,1.340,1.363],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.874,2.748,2.725,2.731,2.722,2.709],[null,null,null,null,null,null],[0.213,0.143,0.135,0.135,0.137,0.136],[0.807,0.695,0.699,0.694,0.687,0.708],[null,null,null,null,null,null],[2.494,2.283,2.322,2.355,2.315,2.301],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.284,0.220,0.208,0.214,0.211,0.215],[4.247,4.105,4.078,4.061,4.151,4.068],[null,null,null,null,null,null],[0.650,0.583,0.570,0.566,0.572,0.589],[0.953,0.852,0.879,0.853,0.865,0.877],[1.012,1.007,0.972,0.938,0.947,0.959],[0.924,0.800,0.842,0.859,0.860,0.852],[1.094,0.960,0.955,0.920,0.949,0.906],[18.985,18.902,20.666,18.870,18.963,18.991],[5.528,5.512,5.488,5.490,5.599,5.538],[1.496,1.433,1.392,1.380,1.418,1.480],[null,null,null,null,null,null],[32.919,32.375,32.506,32.694,32.455,32.644],[31.830,31.674,31.750,31.510,31.553,31.974],[34.198,34.042,33.784,34.186,33.822,33.592],[3.712,3.675,3.678,3.684,3.724,3.627],[2.466,2.383,2.404,2.358,2.254,2.404],[3.914,3.900,3.862,3.831,3.810,3.915],[10.205,9.975,9.984,9.999,9.963,9.995],[10.439,10.340,10.283,10.302,10.257,10.324],[10.445,10.183,10.216,10.196,10.211,10.234],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[36.674,36.938,36.850,37.170,36.859,36.977],[57.710,57.528,57.384,57.483,57.615,57.441],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.828,3.778,3.742,3.826,3.812,3.873],[4.294,4.340,4.224,4.257,4.311,4.197],[0.221,0.205,0.205,0.203,0.204,0.203],[0.208,0.203,0.202,0.202,0.206,0.223],[4.694,4.559,4.608,4.513,4.568,4.648],[null,null,null,null,null,null],[4.151,3.784,3.825,3.810,3.832,3.884],[4.477,4.337,4.159,4.153,4.164,4.178],[4.087,3.828,3.895,3.833,3.869,3.800],[3.293,2.968,2.992,3.028,3.032,3.057],[4.039,4.047,4.051,4.060,4.039,4.051],[4.093,4.044,4.049,4.036,4.030,4.031],[4.091,4.006,4.029,3.989,4.068,4.035],[2.859,2.487,2.502,2.554,2.475,2.497],[2.300,2.084,2.090,2.034,2.015,2.031],[3.716,3.493,3.458,3.506,3.499,3.458],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.377,5.235,5.254,5.209,5.317,5.300],[0.116,0.110,0.110,0.115,0.117,0.121],[4.783,4.520,4.532,4.531,4.565,4.494],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.435,0.431,0.423,0.435,0.428,0.423],[0.443,0.427,0.440,0.424,0.426,0.431],[0.436,0.423,0.426,0.429,0.421,0.423],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.386,3.371,3.387,3.378,3.392,3.375],[3.401,3.376,3.378,3.375,3.372,3.374],[3.281,3.283,3.280,3.268,3.278,3.281],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.326,1.312,1.295,1.316,1.339,1.245],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.7.11.3","source":"results/21.7.11.3.json"} +,{"actual_version":"21.9.6.24","data_size":{"coffeeshop":44758805358,"hits":14386782586,"job":1830194210,"mgbench":2957862092,"ontime":2704903445,"ssb":72906334892,"taxi":24216966186,"tpcds":18788534353,"tpch":17376761191,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":811,"hits":218,"job":21,"mgbench":70,"ontime":54,"ssb":1386,"taxi":927,"tpcds":288,"tpch":251,"uk":43},"machine":"c7a.4xlarge","release_date":"2021-12-02","result":[[0.062,0.011,0.012,0.236,0.013,0.010],[0.063,0.023,0.024,0.024,0.023,0.024],[0.061,0.013,0.012,0.041,0.011,0.010],[0.059,0.014,0.015,0.026,0.013,0.011],[0.056,0.025,0.028,0.038,0.022,0.020],[0.094,0.018,0.023,0.032,0.018,0.025],[0.029,0.007,0.007,0.007,0.010,0.007],[0.068,0.034,0.031,0.029,0.028,0.029],[0.067,0.037,0.040,0.060,0.041,0.042],[0.131,0.102,0.103,0.102,0.092,0.093],[0.590,0.578,0.552,0.536,0.557,0.556],[0.537,0.384,0.370,0.405,0.392,0.383],[0.038,0.024,0.016,0.021,0.012,0.085],[0.037,0.039,0.043,0.018,0.017,0.021],[1.052,0.962,0.964,0.966,0.905,0.897],[0.219,0.138,0.125,0.144,0.126,0.135],[0.045,0.030,0.023,0.022,0.019,0.021],[0.932,0.180,0.179,0.195,0.179,0.184],[6.409,1.963,1.967,1.933,1.904,1.930],[4.810,1.357,1.355,1.389,1.403,1.413],[4.899,1.426,1.418,1.416,1.430,1.438],[5.541,2.399,2.390,2.405,2.421,2.406],[6.363,1.984,2.014,2.004,2.000,2.018],[4.153,1.192,1.215,1.204,1.219,1.204],[0.078,0.038,0.037,0.038,0.036,0.042],[7.897,2.724,2.772,2.732,2.715,2.707],[2.467,1.291,1.282,1.306,1.286,1.269],[2.075,0.714,0.686,0.706,0.700,0.711],[0.008,0.002,0.002,0.002,0.002,0.002],[0.052,0.017,0.022,0.021,0.015,0.022],[0.053,0.037,0.029,0.043,0.029,0.031],[0.057,0.037,0.035,0.035,0.036,0.033],[0.168,0.152,0.147,0.145,0.147,0.142],[0.265,0.233,0.234,0.229,0.232,0.221],[0.027,0.018,0.022,0.029,0.016,0.016],[0.036,0.015,0.015,0.014,0.013,0.013],[0.332,0.305,0.319,0.304,0.302,0.289],[0.403,0.348,0.334,0.337,0.340,0.338],[0.188,0.137,0.145,0.136,0.149,0.140],[0.220,0.152,0.141,0.139,0.139,0.149],[0.485,0.386,0.376,0.392,0.383,0.402],[0.626,0.518,0.499,0.525,0.518,0.529],[0.528,0.485,0.463,0.442,0.465,0.486],[0.493,0.416,0.411,0.458,0.442,0.443],[1.355,1.174,1.157,1.163,1.139,1.120],[0.946,0.775,0.763,0.810,0.807,0.774],[2.863,2.633,null,2.551,2.468,2.508],[0.133,0.040,0.049,0.033,0.045,0.054],[1.454,0.416,0.426,0.406,0.402,0.396],[1.780,0.462,0.464,0.465,0.460,0.486],[4.089,1.297,1.238,1.239,1.229,1.274],[4.697,0.674,0.692,0.691,0.696,0.689],[0.264,0.158,0.150,0.149,0.146,0.164],[0.160,0.120,0.116,0.115,0.113,0.115],[0.218,0.136,0.143,0.138,0.140,0.142],[1.432,0.571,0.567,0.573,0.552,0.572],[1.084,0.730,0.712,0.716,0.715,0.704],[1.206,1.165,1.155,1.214,1.028,1.021],[0.432,0.346,0.348,0.328,0.326,0.332],[0.590,0.470,0.460,0.464,0.454,0.463],[2.790,2.452,null,null,null,null],[2.343,1.956,1.915,1.861,1.935,1.961],[2.260,1.922,1.880,1.859,1.964,1.996],[0.879,0.763,0.768,0.747,0.748,0.757],[0.151,0.067,0.066,0.072,0.070,0.065],[0.086,0.028,0.029,0.030,0.031,0.027],[0.104,0.038,0.027,0.064,0.038,0.027],[0.280,0.176,0.150,0.171,0.165,0.157],[0.060,0.009,0.011,0.019,0.011,0.009],[0.051,0.014,0.009,0.009,0.012,0.009],[0.040,0.006,0.005,0.012,0.006,0.007],[0.118,0.070,0.074,0.079,0.071,0.071],[0.545,0.101,0.100,0.098,0.111,0.096],[0.172,0.052,0.048,0.056,0.046,0.043],[0.108,0.072,0.070,0.079,0.067,0.066],[0.162,0.039,0.044,0.035,0.035,0.038],[0.211,0.083,0.088,0.074,0.075,0.078],[0.270,0.152,0.141,0.142,0.140,0.143],[0.074,0.046,0.054,0.038,0.043,0.046],[0.125,0.091,0.073,0.093,0.072,0.072],[0.351,0.182,0.182,0.221,0.280,0.192],[0.750,0.242,0.250,0.239,0.240,0.240],[0.601,0.440,0.432,0.456,0.442,0.450],[0.584,0.076,0.074,0.071,0.082,0.077],[0.738,0.376,0.374,0.377,0.358,0.356],[2.878,2.674,2.651,2.634,2.618,2.637],[8.661,1.259,1.275,1.272,1.254,1.281],[1.849,1.257,1.267,1.254,1.253,1.256],[12.926,4.139,4.145,4.130,4.179,4.174],[4.323,3.524,3.579,3.634,3.627,3.612],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.784,3.590,3.653,3.648,3.652,3.649],[null,null,null,null,null,null],[5.866,5.675,5.623,5.676,5.648,5.617],[null,null,null,null,null,null],[3.762,3.530,3.507,3.507,3.515,3.606],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.749,0.868,0.856,0.656,0.619,0.622],[null,null,null,null,null,null],[17.460,17.326,17.604,17.498,17.412,17.739],[null,null,null,null,null,null],[28.070,28.110,28.917,28.270,28.350,28.990],[null,null,null,null,null,null],[36.362,36.269,35.340,35.263,35.131,35.198],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.793,8.599,8.595,8.494,8.593,8.503],[0.500,0.461,0.439,0.470,0.434,0.458],[1.216,0.548,0.540,0.557,0.558,0.528],[10.234,10.082,9.839,9.938,9.787,10.055],[0.858,0.813,0.806,0.885,0.887,0.799],[0.318,0.213,0.210,0.202,0.209,0.202],[0.466,0.393,0.381,0.414,0.386,0.399],[null,null,null,null,null,null],[32.876,32.386,32.110,31.888,32.296,32.739],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.731,1.509,1.359,1.368,1.346,1.336],[3.843,3.775,3.809,3.809,3.734,3.875],[90.134,87.829,90.797,89.659,89.029,89.321],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.290,0.615,0.603,0.631,0.596,0.564],[1.194,1.018,1.007,1.022,1.019,1.013],[1.229,1.154,1.135,1.126,1.112,1.100],[null,null,null,null,null,null],[51.182,51.578,51.850,51.631,51.524,52.875],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.919,0.840,0.837,0.802,0.806,0.779],[null,null,null,null,null,null],[11.711,11.555,11.545,11.572,11.501,11.563],[null,null,null,null,null,null],[2.701,2.545,2.510,2.542,2.643,2.557],[null,null,null,null,null,null],[0.230,0.164,0.162,0.186,0.164,0.169],[0.270,0.210,0.199,0.200,0.220,0.213],[6.837,6.369,6.301,6.447,6.651,6.626],[13.059,13.610,13.687,13.324,13.028,13.187],[5.471,5.061,5.167,5.037,5.038,5.042],[5.229,5.042,4.978,5.008,5.000,4.989],[11.509,11.592,11.480,11.564,11.593,11.889],[0.437,0.325,0.331,0.320,0.330,0.322],[null,null,null,null,null,null],[1.246,1.111,1.118,1.096,1.089,1.094],[11.494,11.395,11.489,11.576,11.463,11.449],[null,null,null,null,null,null],[1.577,1.395,1.444,1.420,1.389,1.407],[null,null,null,null,null,null],[0.936,0.431,0.421,0.426,0.421,0.424],[0.809,0.525,0.523,0.523,0.512,0.540],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.081,1.038,1.034,1.029,1.005,1.006],[5.527,5.316,5.245,5.373,5.354,5.338],[0.475,0.412,0.404,0.444,0.415,0.429],[0.484,0.416,0.408,0.414,0.405,0.408],[1.275,1.192,1.260,1.202,1.195,1.189],[null,null,null,null,null,null],[2.243,2.106,2.154,2.165,2.198,2.204],[6.613,6.550,6.552,6.637,6.617,6.627],[0.050,0.036,0.043,0.071,0.055,0.041],[0.617,0.540,0.541,0.517,0.530,0.518],[1.874,0.915,0.940,0.944,0.940,0.895],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.861,3.775,3.661,3.755,3.747,3.796],[6.577,6.521,6.451,6.432,6.558,6.449],[2.313,2.194,2.170,2.138,2.243,2.238],[2.285,2.202,2.238,2.278,2.160,2.197],[10.134,10.147,9.643,9.838,10.011,10.095],[2.315,2.195,2.288,2.230,2.175,2.214],[0.949,0.473,0.466,0.461,0.497,0.514],[null,null,null,null,null,null],[0.843,0.630,0.636,0.665,0.635,0.642],[2.419,2.279,2.274,2.296,2.287,2.277],[0.939,0.491,0.518,0.519,0.521,0.523],[1.703,1.472,1.410,1.498,1.422,1.429],[0.457,0.385,0.386,0.379,0.396,0.391],[2.271,2.193,2.188,2.226,2.191,2.232],[null,null,null,null,null,null],[21.754,21.619,21.459,21.043,21.237,20.842],[1.307,1.119,1.095,1.152,1.093,1.088],[null,null,null,null,null,null],[2.487,0.850,0.845,0.857,0.854,0.826],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.852,0.415,0.410,0.410,0.419,0.422],[null,null,null,null,null,null],[0.769,0.451,0.440,0.445,0.425,0.438],[42.739,42.373,41.927,41.395,40.437,40.516],[null,null,null,null,null,null],[0.026,0.020,0.019,0.028,0.019,0.021],[1.633,0.500,0.487,0.490,0.494,0.485],[0.048,0.057,0.045,0.051,0.047,0.042],[null,null,null,null,null,null],[4.458,4.089,4.207,4.297,4.191,4.387],[null,null,null,null,null,null],[1.891,1.814,1.780,1.753,1.754,1.737],[0.227,0.160,0.151,0.169,0.153,0.154],[1.275,1.198,1.171,1.181,1.199,1.162],[1.551,1.406,1.400,1.441,1.442,1.383],[null,null,null,null,null,null],[5.619,5.605,5.554,5.527,5.584,5.411],[2.908,2.884,2.857,2.867,2.887,2.883],[2.909,2.919,2.848,3.017,2.917,2.930],[0.237,0.174,0.145,0.142,0.143,0.149],[0.837,0.702,0.734,0.764,0.630,0.731],[null,null,null,null,null,null],[2.551,2.387,2.424,2.368,2.368,2.378],[null,null,null,null,null,null],[42.895,42.972,42.433,42.427,43.566,42.492],[0.288,0.213,0.217,0.235,0.216,0.227],[4.453,4.464,4.374,4.408,4.456,4.443],[null,null,null,null,null,null],[0.765,0.654,0.669,0.677,0.682,0.661],[0.955,0.908,0.951,0.921,0.879,0.870],[0.989,1.052,0.939,0.979,0.964,0.981],[0.999,0.861,0.884,0.849,0.854,0.851],[1.090,1.023,0.975,0.963,0.991,0.919],[19.093,19.167,19.287,19.067,19.078,18.995],[5.595,5.529,5.562,5.626,5.535,5.483],[1.585,1.510,1.469,1.438,1.464,1.509],[null,null,null,null,null,null],[33.587,32.827,33.059,32.975,33.199,33.339],[32.820,32.739,32.255,32.083,32.175,31.675],[34.490,34.000,34.911,34.327,34.613,35.068],[4.177,4.077,4.190,4.110,4.089,4.096],[2.491,2.540,2.348,2.425,2.462,2.364],[4.250,4.216,4.225,4.239,4.197,4.257],[10.531,10.190,10.214,10.351,10.331,10.280],[10.724,10.565,10.557,10.534,10.495,10.634],[10.683,10.443,10.417,10.495,10.448,10.506],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[32.642,32.354,32.411,32.572,32.534,32.430],[36.943,36.800,36.635,36.826,36.982,36.721],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.934,3.878,3.795,3.821,3.838,3.858],[4.455,4.394,4.323,4.425,4.361,4.348],[0.225,0.217,0.217,0.221,0.216,0.221],[0.247,0.226,0.222,0.213,0.212,0.212],[3.172,3.094,3.017,3.022,2.962,3.018],[null,null,null,null,null,null],[4.090,3.862,3.890,3.915,3.869,3.885],[4.595,4.229,4.240,4.254,4.325,4.183],[4.150,3.852,3.872,3.829,3.918,3.870],[3.307,3.018,3.060,3.059,3.054,3.053],[4.120,4.138,4.080,4.106,4.057,4.026],[4.116,4.086,4.050,4.132,4.086,4.084],[4.118,4.029,4.087,4.079,4.149,4.054],[2.842,2.550,2.625,2.576,2.534,2.596],[2.328,2.116,2.029,2.035,2.067,2.049],[3.882,3.660,3.544,3.612,3.574,3.588],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.568,5.412,5.414,5.471,5.435,5.365],[0.103,0.096,0.100,0.101,0.096,0.097],[4.911,4.653,4.705,4.594,4.659,4.588],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.452,0.446,0.452,0.452,0.441,0.440],[0.461,0.446,0.451,0.440,0.443,0.440],[0.452,0.445,0.454,0.455,0.445,0.447],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.533,3.526,3.524,3.513,3.517,3.521],[3.520,3.522,3.521,3.542,3.524,3.521],[3.460,3.444,3.440,3.420,3.418,3.432],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.397,1.324,1.315,1.344,1.287,1.337],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.9.6.24","source":"results/21.9.6.24.json"} +,{"actual_version":"21.10.5.3","data_size":{"coffeeshop":44757800178,"hits":14368874184,"job":1830194210,"mgbench":2953141446,"ontime":2704903445,"ssb":72904827152,"taxi":24216864091,"tpcds":18792035987,"tpch":17375467247,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":853,"hits":225,"job":28,"mgbench":71,"ontime":60,"ssb":1488,"taxi":1004,"tpcds":308,"tpch":254,"uk":38},"machine":"c7a.4xlarge","release_date":"2021-12-10","result":[[0.056,0.014,0.010,0.239,0.010,0.010],[0.064,0.023,0.023,0.027,0.024,0.022],[0.060,0.012,0.012,0.041,0.011,0.012],[0.059,0.018,0.013,0.022,0.012,0.011],[0.059,0.027,0.025,0.031,0.023,0.024],[0.079,0.024,0.022,0.037,0.020,0.019],[0.026,0.007,0.007,0.007,0.007,0.008],[0.072,0.031,0.030,0.028,0.028,0.028],[0.074,0.041,0.041,0.064,0.039,0.047],[0.132,0.113,0.101,0.097,0.082,0.085],[0.601,0.553,0.510,0.543,0.523,0.547],[0.549,0.399,0.392,0.391,0.360,0.374],[0.042,0.010,0.021,0.018,0.008,0.013],[0.040,0.029,0.029,0.028,0.018,0.017],[1.018,0.938,0.947,0.951,0.904,0.886],[0.200,0.135,0.129,0.119,0.133,0.132],[0.045,0.022,0.019,0.018,0.020,0.019],[0.894,0.173,0.167,0.178,0.171,0.182],[6.414,1.886,1.895,1.906,1.884,1.881],[4.777,1.356,1.357,1.366,1.364,1.387],[4.872,1.402,1.480,1.477,1.399,1.387],[5.540,2.484,2.440,2.423,2.471,2.442],[6.360,2.222,2.218,2.201,2.013,2.046],[4.108,1.318,1.301,1.306,1.248,1.206],[0.063,0.038,0.037,0.042,0.041,0.036],[7.871,2.812,2.829,2.804,2.969,2.955],[2.476,1.403,1.414,1.397,1.270,1.317],[2.074,0.668,0.652,0.693,0.729,0.699],[0.007,0.002,0.002,0.001,0.001,0.002],[0.057,0.016,0.017,0.019,0.015,0.016],[0.063,0.027,0.031,0.044,0.032,0.029],[0.059,0.040,0.034,0.032,0.036,0.030],[0.174,0.153,0.156,0.152,0.140,0.134],[0.268,0.233,0.229,0.233,0.223,0.225],[0.026,0.017,0.015,0.028,0.015,0.015],[0.028,0.014,0.013,0.012,0.013,0.013],[0.353,0.312,0.330,0.328,0.315,0.319],[0.432,0.369,0.345,0.346,0.332,0.335],[0.169,0.131,0.133,0.155,0.148,0.137],[0.203,0.140,0.138,0.145,0.141,0.141],[0.494,0.398,0.397,0.404,0.385,0.404],[0.674,0.569,0.556,0.560,0.600,0.568],[0.608,0.520,0.502,0.503,0.537,0.521],[0.528,0.470,0.464,0.449,0.462,0.485],[1.352,1.186,1.180,1.235,1.225,1.201],[0.927,0.809,0.828,0.794,0.774,0.792],[3.141,2.707,2.468,null,2.660,2.636],[0.159,0.067,0.053,0.040,0.034,0.030],[1.461,0.431,0.427,0.420,0.434,0.440],[1.760,0.496,0.477,0.464,0.478,0.500],[4.056,1.330,1.276,1.343,1.341,1.349],[4.575,0.726,0.699,0.716,0.686,0.658],[0.219,0.166,0.140,0.163,0.161,0.151],[0.227,0.129,0.132,0.116,0.121,0.123],[0.229,0.155,0.158,0.152,0.139,0.148],[1.416,0.550,0.554,0.569,0.561,0.560],[1.085,0.694,0.719,0.732,0.733,0.734],[1.130,1.069,1.077,1.238,1.063,1.074],[0.400,0.362,0.355,0.353,0.331,0.329],[0.599,0.483,0.469,0.467,0.446,0.428],[2.685,null,null,null,null,null],[2.244,1.997,1.929,2.061,2.106,2.182],[2.214,1.944,1.930,2.114,2.025,1.965],[0.890,0.772,0.729,0.793,0.748,0.758],[0.157,0.112,0.096,0.079,0.079,0.088],[0.082,0.036,0.036,0.031,0.034,0.037],[0.102,0.026,0.024,0.036,0.032,0.036],[0.285,0.189,0.203,0.198,0.179,0.184],[0.052,0.009,0.011,0.017,0.011,0.011],[0.041,0.008,0.009,0.009,0.011,0.009],[0.033,0.005,0.004,0.005,0.005,0.006],[0.137,0.083,0.082,0.084,0.077,0.076],[0.522,0.114,0.100,0.121,0.105,0.106],[0.165,0.053,0.054,0.060,0.045,0.043],[0.114,0.078,0.071,0.082,0.071,0.074],[0.153,0.038,0.035,0.034,0.039,0.052],[0.198,0.086,0.085,0.080,0.083,0.087],[0.261,0.186,0.152,0.139,0.136,0.248],[0.083,0.061,0.067,0.057,0.043,0.048],[0.156,0.073,0.081,0.098,0.078,0.075],[0.359,0.221,0.200,0.227,0.212,0.195],[0.751,0.251,0.254,0.265,0.259,0.249],[0.609,0.472,0.450,0.467,0.475,0.462],[0.547,0.103,0.082,0.077,0.077,0.076],[0.781,0.412,0.372,0.402,0.384,0.372],[2.932,2.754,2.826,2.824,2.814,2.765],[8.649,1.356,1.372,1.300,1.339,1.327],[1.853,1.250,1.241,1.263,1.251,1.244],[12.885,4.146,4.170,4.235,4.284,4.311],[4.332,3.884,3.919,3.931,3.888,3.861],[4.192,2.149,2.159,2.294,2.364,2.333],[5.014,4.956,4.979,4.810,4.743,4.741],[null,null,null,null,null,null],[4.155,3.887,3.885,3.869,3.855,3.863],[null,null,null,null,null,null],[6.188,5.556,5.759,5.420,5.402,5.435],[null,null,null,null,null,null],[3.592,3.395,3.375,3.371,3.401,3.413],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.712,0.807,0.834,0.628,0.586,0.583],[null,null,null,null,null,null],[16.360,16.269,16.474,16.516,16.495,16.516],[null,null,null,null,null,null],[27.159,26.869,26.873,26.963,27.636,27.359],[null,null,null,null,null,null],[36.034,36.309,36.164,36.145,35.973,36.300],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.506,8.375,8.975,8.452,8.473,8.329],[0.530,0.462,0.435,0.455,0.461,0.436],[1.252,0.509,0.515,0.524,0.524,0.539],[10.115,10.168,10.134,10.246,10.188,10.043],[0.902,0.891,0.858,0.846,0.818,0.824],[0.379,0.227,0.195,0.208,0.190,0.196],[0.453,0.393,0.365,0.360,0.375,0.379],[null,null,null,null,null,null],[32.925,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.543,1.434,1.339,1.345,1.335,1.349],[3.785,3.692,3.833,3.722,3.752,3.739],[88.399,91.118,90.258,91.048,95.019,91.747],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.242,0.621,0.621,0.672,0.612,0.601],[1.191,1.049,1.038,1.040,1.038,1.038],[1.239,1.177,1.161,1.144,1.131,1.138],[null,null,null,null,null,null],[52.625,53.210,53.341,52.814,53.871,53.457],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.885,0.833,0.878,0.839,0.850,0.832],[null,null,null,null,null,null],[11.919,11.860,11.793,11.807,11.813,11.787],[null,null,null,null,null,null],[2.699,2.591,2.610,2.560,2.577,2.664],[null,null,null,null,null,null],[0.230,0.170,0.170,0.187,0.167,0.165],[0.292,0.250,0.227,0.199,0.194,0.211],[6.750,6.651,6.527,6.536,6.492,6.562],[13.383,13.026,13.144,13.384,13.820,13.512],[5.586,5.228,5.218,5.471,5.509,5.375],[5.333,5.163,5.179,5.071,5.364,5.393],[12.065,11.752,12.120,12.274,11.890,11.947],[0.428,0.345,0.331,0.334,0.333,0.341],[null,null,null,null,null,null],[1.224,1.141,1.156,1.144,1.124,1.130],[11.923,11.834,12.214,11.966,11.912,11.781],[null,null,null,null,null,null],[1.558,1.455,1.450,1.414,1.396,1.416],[null,null,null,null,null,null],[0.916,0.420,0.435,0.427,0.443,0.441],[0.808,0.553,0.551,0.538,0.553,0.541],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.069,0.996,1.003,1.020,1.045,1.006],[6.043,5.879,5.899,5.812,5.933,5.941],[0.483,0.442,0.441,0.450,0.438,0.441],[0.493,0.449,0.430,0.425,0.444,0.446],[1.339,1.260,1.266,1.271,1.246,1.266],[null,null,null,null,null,null],[2.289,2.250,2.253,2.265,2.234,2.173],[6.743,6.639,6.709,6.682,6.745,6.690],[0.075,0.077,0.040,0.038,0.030,0.039],[0.629,0.514,0.527,0.519,0.546,0.522],[1.868,0.949,0.940,0.953,0.954,0.925],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.902,3.935,3.810,3.903,3.798,3.812],[6.617,6.566,6.472,6.455,6.444,6.511],[2.304,2.250,2.166,2.245,2.272,2.228],[2.203,2.101,2.101,2.227,2.168,2.143],[10.140,9.894,9.763,9.740,9.827,9.790],[2.270,2.150,2.348,2.279,2.265,2.236],[0.925,0.512,0.551,0.580,0.592,0.506],[null,null,null,null,null,null],[0.788,0.623,0.616,0.643,0.623,0.628],[2.368,2.410,2.215,2.229,2.213,2.218],[0.953,0.574,0.498,0.496,0.509,0.519],[1.611,1.417,1.409,1.431,1.571,1.427],[0.432,0.378,0.380,0.396,0.384,0.373],[2.170,2.261,2.174,2.164,2.153,2.114],[null,null,null,null,null,null],[22.039,21.916,22.187,21.500,21.491,21.439],[1.372,1.127,1.087,1.154,1.109,1.107],[null,null,null,null,null,null],[2.467,0.818,0.824,0.845,0.826,0.808],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.837,0.417,0.394,0.404,0.407,0.405],[null,null,null,null,null,null],[0.759,0.453,0.444,0.446,0.431,0.447],[40.562,40.753,40.564,40.514,40.826,40.589],[null,null,null,null,null,null],[0.019,0.019,0.019,0.029,0.019,0.019],[1.634,0.505,0.483,0.488,0.475,0.488],[0.048,0.060,0.044,0.048,0.051,0.042],[null,null,null,null,null,null],[4.395,4.189,4.245,4.202,4.143,4.236],[null,null,null,null,null,null],[1.760,1.710,1.627,1.712,1.697,1.658],[0.197,0.163,0.149,0.165,0.143,0.142],[1.203,1.187,1.199,1.162,1.171,1.175],[1.536,1.409,1.381,1.418,1.390,1.392],[null,null,null,null,null,null],[6.065,5.879,5.976,5.840,5.912,5.850],[2.968,2.887,2.878,2.870,2.890,2.875],[2.772,2.707,2.767,2.728,2.757,2.732],[0.210,0.148,0.145,0.145,0.145,0.147],[0.805,0.703,0.712,0.701,0.662,0.588],[null,null,null,null,null,null],[2.503,2.424,2.424,2.429,2.437,2.495],[null,null,null,null,null,null],[42.603,42.555,42.753,42.508,42.421,42.621],[0.281,0.236,0.227,0.226,0.232,0.231],[4.535,4.287,4.212,4.225,4.229,4.161],[null,null,null,null,null,null],[0.743,0.631,0.640,0.653,0.642,0.650],[0.937,0.814,0.921,0.930,0.944,0.883],[1.024,0.966,0.975,0.945,0.988,1.008],[0.965,0.871,0.901,0.884,0.907,0.912],[1.043,1.001,0.989,0.960,0.942,0.983],[19.383,19.676,19.549,19.466,19.287,19.560],[5.732,5.573,5.579,5.651,5.534,5.657],[1.508,1.444,1.461,1.471,1.486,1.435],[null,null,null,null,null,null],[32.953,33.054,32.458,32.884,32.817,32.786],[32.092,32.055,31.822,31.864,31.693,31.879],[34.594,34.253,34.606,36.862,37.175,37.653],[4.373,4.423,4.402,4.327,4.384,4.494],[2.656,2.556,2.640,2.645,2.531,2.579],[4.686,4.581,4.629,4.641,4.602,4.686],[11.407,11.173,11.127,11.137,11.258,11.098],[11.514,11.284,11.342,11.383,11.325,11.371],[11.641,11.475,11.376,11.385,11.323,11.418],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[35.679,35.717,35.591,35.871,35.712,35.903],[40.555,40.409,40.554,40.295,40.925,40.546],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.185,4.153,4.314,4.139,4.161,4.260],[4.858,4.889,4.870,4.754,4.781,4.910],[0.237,0.238,0.242,0.239,0.241,0.247],[0.239,0.244,0.238,0.238,0.236,0.240],[3.439,3.437,3.354,3.376,3.296,3.396],[null,null,null,null,null,null],[4.542,4.167,4.252,4.193,4.175,4.249],[4.883,4.649,4.747,4.675,4.699,4.689],[4.494,4.305,4.251,4.267,4.412,4.309],[3.560,3.414,3.394,3.376,3.355,3.363],[4.507,4.556,4.471,4.581,4.488,4.474],[4.559,4.493,4.563,4.426,4.463,4.439],[4.580,4.507,4.457,4.488,4.438,4.459],[3.028,2.676,2.770,2.808,2.794,2.794],[2.572,2.232,2.244,2.282,2.243,2.242],[4.034,3.828,3.805,3.829,3.849,3.860],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.098,5.973,5.767,5.926,5.936,5.923],[0.105,0.114,0.106,0.105,0.105,0.107],[5.297,5.102,5.151,5.124,5.046,5.062],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.501,0.502,0.506,0.503,0.507,0.499],[0.507,0.505,0.498,0.492,0.501,0.508],[0.496,0.497,0.495,0.500,0.498,0.504],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.951,4.002,3.976,3.950,3.986,3.956],[3.961,3.952,3.978,3.955,3.964,3.974],[3.861,3.840,3.859,3.832,3.838,3.839],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.528,1.432,1.445,1.430,1.439,1.390],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.10.5.3","source":"results/21.10.5.3.json"} +,{"actual_version":"21.11.11.1","data_size":{"coffeeshop":44756126790,"hits":14415770923,"job":1830194210,"mgbench":2959106271,"ontime":2704903445,"ssb":72901824924,"taxi":24216988157,"tpcds":18804275455,"tpch":17375311796,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":909,"hits":273,"job":26,"mgbench":74,"ontime":64,"ssb":1648,"taxi":1030,"tpcds":313,"tpch":260,"uk":50},"machine":"c7a.4xlarge","release_date":"2022-01-23","result":[[0.060,0.010,0.010,0.235,0.010,0.010],[0.075,0.024,0.024,0.024,0.024,0.024],[0.062,0.012,0.012,0.042,0.011,0.012],[0.060,0.014,0.012,0.021,0.012,0.013],[0.056,0.025,0.022,0.035,0.029,0.022],[0.081,0.032,0.021,0.042,0.030,0.022],[0.032,0.007,0.007,0.007,0.008,0.007],[0.068,0.031,0.030,0.031,0.029,0.030],[0.077,0.042,0.043,0.063,0.049,0.045],[0.137,0.121,0.104,0.107,0.101,0.100],[0.679,0.551,0.526,0.546,0.544,0.494],[0.560,0.365,0.408,0.396,0.390,0.391],[0.036,0.011,0.012,0.014,0.009,0.009],[0.067,0.033,0.020,0.017,0.020,0.016],[1.025,0.955,0.938,0.978,0.945,0.903],[0.224,0.129,0.121,0.122,0.123,0.121],[0.046,0.017,0.020,0.020,0.021,0.017],[0.905,0.192,0.184,0.204,0.201,0.214],[6.419,1.701,1.749,1.729,1.778,1.932],[4.804,1.249,1.259,1.254,1.350,1.331],[4.848,1.299,1.300,1.311,1.352,1.413],[5.527,2.527,2.280,2.325,2.301,2.370],[6.352,2.267,2.080,2.087,2.166,2.268],[4.114,1.226,1.257,1.230,1.254,1.224],[0.074,0.046,0.040,0.039,0.038,0.039],[7.850,2.800,2.708,2.635,2.728,2.751],[2.464,1.251,1.337,1.359,1.297,1.223],[2.027,0.658,0.652,0.662,0.652,0.686],[0.013,0.006,0.001,0.002,0.001,0.003],[0.046,0.015,0.018,0.014,0.016,0.014],[0.068,0.029,0.027,0.040,0.028,0.027],[0.057,0.031,0.031,0.032,0.032,0.029],[0.163,0.160,0.136,0.153,0.146,0.146],[0.272,0.235,0.225,0.241,0.240,0.249],[0.032,0.020,0.016,0.031,0.018,0.016],[0.034,0.013,0.013,0.013,0.013,0.013],[0.333,0.291,0.313,0.298,0.308,0.306],[0.400,0.364,0.375,0.378,0.395,0.378],[0.170,0.120,0.118,0.107,0.121,0.115],[0.194,0.136,0.134,0.135,0.130,0.140],[0.490,0.420,0.411,0.423,0.435,0.409],[0.637,0.565,0.551,0.573,0.574,0.572],[0.564,0.516,0.486,0.534,0.528,0.547],[0.536,0.434,0.449,0.464,0.465,0.489],[1.473,1.424,1.421,1.393,1.243,1.292],[1.059,0.925,0.934,0.956,0.924,0.959],[3.543,3.168,3.092,2.953,3.029,3.435],[0.113,0.041,0.045,0.065,0.063,0.051],[1.492,0.475,0.460,0.521,0.477,0.457],[1.768,0.544,0.513,0.550,0.546,0.531],[4.097,1.480,1.454,1.438,1.476,1.371],[3.495,0.655,0.695,0.655,0.645,0.681],[0.219,0.141,0.147,0.129,0.138,0.142],[0.169,0.130,0.110,0.107,0.111,0.110],[0.200,0.135,0.138,0.155,0.138,0.134],[1.439,0.664,0.603,0.629,0.669,0.651],[1.095,0.859,0.834,0.862,0.860,0.794],[1.247,1.084,1.127,1.304,1.118,1.079],[0.404,0.368,0.377,0.356,0.344,0.334],[0.714,0.552,0.492,0.538,0.526,0.542],[3.480,2.731,null,null,null,null],[2.670,2.380,2.213,2.299,2.215,2.089],[2.532,2.462,2.427,2.395,2.407,2.309],[1.018,0.835,0.993,0.826,0.832,0.868],[0.135,0.062,0.044,0.051,0.053,0.052],[0.086,0.030,0.027,0.032,0.025,0.023],[0.108,0.051,0.022,0.046,0.040,0.019],[0.201,0.119,0.110,0.116,0.109,0.086],[0.054,0.010,0.009,0.011,0.011,0.012],[0.054,0.015,0.008,0.013,0.009,0.016],[0.043,0.010,0.004,0.005,0.016,0.010],[0.124,0.075,0.077,0.090,0.084,0.078],[0.482,0.108,0.099,0.105,0.103,0.104],[0.164,0.053,0.046,0.060,0.043,0.047],[0.123,0.073,0.084,0.083,0.077,0.081],[0.155,0.038,0.041,0.037,0.043,0.040],[0.198,0.068,0.067,0.074,0.063,0.067],[0.235,0.091,0.090,0.093,0.105,0.097],[0.062,0.035,0.036,0.034,0.035,0.033],[0.112,0.066,0.083,0.096,0.070,0.066],[0.318,0.168,0.179,0.166,0.168,0.170],[0.723,0.260,0.251,0.271,0.243,0.248],[0.644,0.489,0.457,0.447,0.462,0.470],[0.515,0.114,0.088,0.090,0.095,0.110],[0.805,0.416,0.422,0.411,0.405,0.419],[3.253,3.077,2.956,2.964,3.019,2.923],[8.675,1.474,1.565,1.556,1.546,1.436],[1.842,1.567,1.573,1.585,1.527,1.497],[12.918,4.948,5.278,5.103,4.971,4.897],[4.564,4.316,4.438,4.553,4.443,4.428],[4.168,2.356,2.394,2.395,2.364,2.248],[6.059,5.943,5.931,5.803,5.853,5.866],[null,null,null,null,null,null],[4.804,4.451,4.542,4.578,4.453,4.289],[null,null,null,null,null,null],[6.952,6.605,6.691,6.800,6.811,6.750],[null,null,null,null,null,null],[4.437,4.166,4.244,4.407,4.412,4.203],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.691,1.009,0.958,0.737,0.629,0.609],[null,null,null,null,null,null],[13.669,13.955,13.518,14.108,14.130,13.842],[null,null,null,null,null,null],[21.455,21.650,21.414,21.206,21.602,21.702],[null,null,null,null,null,null],[36.262,35.344,36.134,35.840,36.217,36.208],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.558,7.370,7.414,7.473,7.389,7.588],[0.597,0.484,0.473,0.482,0.494,0.507],[1.082,0.543,0.560,0.555,0.533,0.569],[7.128,7.268,7.175,7.172,7.183,6.981],[0.859,0.846,0.928,0.958,0.851,0.868],[0.356,0.210,0.203,0.253,0.207,0.204],[0.461,0.385,0.393,0.410,0.398,0.406],[null,null,null,null,null,null],[28.342,27.726,28.207,27.543,27.154,27.373],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.790,1.670,1.540,1.557,1.642,1.660],[3.862,3.522,3.570,3.575,3.586,3.511],[86.855,86.349,86.844,87.033,87.789,87.230],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.262,0.657,0.655,0.668,0.650,0.619],[1.368,1.149,1.139,1.116,1.128,1.140],[1.152,1.058,1.106,1.084,1.082,1.079],[null,null,null,null,null,null],[50.809,49.609,48.876,48.216,49.164,48.854],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.967,0.871,0.881,0.882,0.877,0.873],[null,null,null,null,null,null],[12.216,12.181,12.084,12.078,12.033,12.133],[null,null,null,null,null,null],[2.282,2.218,2.225,2.179,2.158,2.109],[null,null,null,null,null,null],[0.245,0.196,0.188,0.215,0.182,0.193],[0.292,0.211,0.224,0.207,0.208,0.205],[7.237,6.969,6.890,6.935,7.081,7.241],[15.117,15.266,14.874,15.058,15.063,14.994],[6.470,6.067,5.987,5.948,5.941,5.655],[5.688,5.423,5.459,5.488,5.507,5.593],[12.382,12.211,12.236,12.161,11.993,12.011],[0.445,0.335,0.337,0.336,0.337,0.334],[null,null,null,null,null,null],[1.181,1.051,1.045,1.023,1.058,1.059],[12.009,12.124,12.698,12.077,12.063,12.126],[null,null,null,null,null,null],[1.685,1.510,1.476,1.505,1.483,1.525],[null,null,null,null,null,null],[0.925,0.449,0.448,0.494,0.494,0.448],[0.799,0.577,0.562,0.574,0.562,0.563],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.906,0.879,0.863,0.820,0.802,0.863],[6.132,6.075,6.400,6.416,6.248,6.150],[0.530,0.487,0.487,0.502,0.495,0.503],[0.579,0.492,0.475,0.482,0.505,0.495],[1.434,1.325,1.330,1.343,1.340,1.336],[null,null,null,null,null,null],[1.890,1.880,1.816,1.838,1.869,1.892],[6.535,6.546,6.838,6.633,6.521,6.470],[0.047,0.034,0.035,0.034,0.044,0.032],[0.700,0.588,0.563,0.610,0.581,0.566],[1.876,0.994,0.962,0.997,1.003,0.990],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.073,3.883,3.901,3.957,3.922,3.879],[6.636,6.818,6.806,6.602,6.742,6.671],[1.934,1.869,1.847,1.792,1.868,1.852],[2.140,2.030,2.032,2.024,2.071,2.069],[7.340,7.048,7.163,7.001,7.053,7.063],[1.895,1.832,1.835,1.823,1.780,1.850],[0.946,0.536,0.559,0.485,0.483,0.545],[null,null,null,null,null,null],[0.916,0.680,0.699,0.710,0.706,0.681],[2.405,2.270,2.238,2.228,2.235,2.223],[0.934,0.527,0.519,0.504,0.522,0.528],[1.726,1.519,1.475,1.516,1.468,1.458],[0.476,0.412,0.414,0.417,0.412,0.430],[2.105,2.012,2.022,1.996,2.094,2.144],[null,null,null,null,null,null],[23.273,22.084,21.264,21.120,21.383,20.996],[1.420,1.201,1.201,1.249,1.192,1.179],[null,null,null,null,null,null],[2.452,0.890,0.868,0.857,0.902,0.837],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.845,0.424,0.414,0.412,0.419,0.429],[null,null,null,null,null,null],[0.751,0.468,0.472,0.462,0.470,0.458],[36.709,36.977,35.808,36.060,36.174,36.512],[null,null,null,null,null,null],[0.027,0.021,0.020,0.029,0.020,0.020],[1.627,0.512,0.522,0.515,0.513,0.517],[0.061,0.061,0.047,0.067,0.044,0.046],[null,null,null,null,null,null],[4.690,4.679,4.532,4.559,4.522,4.552],[null,null,null,null,null,null],[1.557,1.498,1.458,1.456,1.415,1.450],[0.223,0.161,0.158,0.178,0.160,0.163],[0.918,0.855,0.870,0.854,0.868,0.859],[1.570,1.401,1.390,1.442,1.480,1.490],[null,null,null,null,null,null],[6.395,6.388,6.363,6.344,6.298,6.107],[3.230,3.153,3.153,3.107,3.107,3.122],[2.851,2.826,2.760,2.829,2.871,2.788],[0.254,0.168,0.158,0.167,0.163,0.160],[0.826,0.753,0.755,0.762,0.701,0.587],[null,null,null,null,null,null],[2.770,2.605,2.594,2.633,2.619,2.610],[null,null,null,null,null,null],[37.875,36.758,36.963,36.844,36.933,36.587],[0.308,0.230,0.235,0.231,0.232,0.233],[4.892,4.746,4.685,4.746,4.726,4.780],[null,null,null,null,null,null],[0.789,0.701,0.700,0.698,0.710,0.719],[0.980,0.895,0.975,0.969,0.940,0.935],[1.078,1.019,1.025,1.062,0.925,1.019],[0.987,0.892,0.916,0.946,0.897,0.966],[1.059,0.993,1.021,1.074,1.020,1.067],[20.942,21.059,20.654,20.437,20.688,20.553],[6.027,5.951,5.801,5.804,5.838,5.920],[1.537,1.452,1.455,1.465,1.435,1.444],[null,null,null,null,null,null],[34.598,34.408,34.496,34.430,34.499,34.289],[34.297,34.223,36.029,36.776,36.405,36.533],[39.426,39.167,38.985,39.340,39.299,38.806],[4.553,4.584,4.599,4.613,4.582,4.549],[2.805,2.740,2.735,2.699,2.566,2.646],[5.045,4.929,4.971,5.018,5.024,5.026],[11.746,11.626,11.587,11.584,11.551,11.537],[12.047,11.777,11.750,11.668,11.732,11.745],[11.887,11.719,11.737,11.803,11.743,11.794],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[37.222,37.190,37.132,37.464,37.504,37.522],[42.878,42.681,42.956,42.652,42.862,42.589],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.077,3.943,4.041,4.024,4.067,4.048],[4.764,4.634,4.649,4.691,4.732,4.707],[0.272,0.267,0.259,0.260,0.260,0.272],[0.270,0.265,0.261,0.267,0.264,0.264],[3.763,3.580,3.585,3.572,3.559,3.509],[null,null,null,null,null,null],[4.581,4.239,4.361,4.425,4.372,4.275],[5.028,4.717,4.786,4.702,4.810,4.718],[4.576,4.373,4.391,4.326,4.312,4.404],[3.633,3.338,3.415,3.373,3.379,3.331],[4.708,4.522,4.586,4.614,4.728,4.623],[4.596,4.588,4.571,4.594,4.625,4.575],[4.651,4.636,4.498,4.541,4.607,4.565],[3.120,2.816,2.800,2.885,2.694,2.799],[2.530,2.267,2.267,2.224,2.291,2.223],[4.161,3.885,3.833,3.913,3.879,3.940],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.231,5.882,5.989,6.028,5.891,5.872],[0.119,0.119,0.125,0.112,0.110,0.130],[5.400,5.125,5.243,5.139,5.081,5.132],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.537,0.524,0.529,0.526,0.527,0.527],[0.547,0.527,0.519,0.531,0.528,0.545],[0.538,0.520,0.528,0.532,0.523,0.531],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.253,4.251,4.231,4.413,4.355,4.312],[4.394,4.437,4.379,4.264,4.410,4.259],[4.220,4.219,4.203,4.180,4.118,4.184],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.535,1.434,1.358,1.417,1.467,1.396],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.11.11.1","source":"results/21.11.11.1.json"} +,{"actual_version":"21.12.4.1","data_size":{"coffeeshop":44754261705,"hits":14358464476,"job":1830194210,"mgbench":2966122764,"ontime":2704903445,"ssb":72903281390,"taxi":24217007522,"tpcds":18810059115,"tpch":17375491714,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":914,"hits":260,"job":28,"mgbench":76,"ontime":67,"ssb":1641,"taxi":1050,"tpcds":317,"tpch":268,"uk":44},"machine":"c7a.4xlarge","release_date":"2022-01-23","result":[[0.058,0.010,0.010,0.259,0.010,0.009],[0.070,0.025,0.024,0.026,0.025,0.026],[0.064,0.012,0.011,0.040,0.011,0.011],[0.061,0.012,0.012,0.019,0.015,0.014],[0.057,0.028,0.028,0.032,0.023,0.025],[0.098,0.024,0.020,0.033,0.038,0.026],[0.028,0.009,0.007,0.008,0.007,0.007],[0.068,0.031,0.029,0.033,0.030,0.029],[0.077,0.048,0.043,0.062,0.038,0.049],[0.138,0.098,0.092,0.096,0.092,0.092],[0.609,0.571,0.538,0.542,0.514,0.512],[0.519,0.360,0.368,0.370,0.366,0.372],[0.047,0.014,0.011,0.008,0.016,0.009],[0.065,0.018,0.017,0.024,0.016,0.016],[1.007,0.987,0.989,0.991,0.872,0.892],[0.211,0.125,0.113,0.111,0.123,0.112],[0.043,0.023,0.026,0.021,0.021,0.027],[0.928,0.196,0.193,0.200,0.204,0.188],[6.411,1.720,1.732,1.767,1.744,1.749],[4.813,1.348,1.328,1.232,1.238,1.244],[4.858,1.389,1.357,1.260,1.250,1.264],[5.518,2.446,2.302,2.283,2.364,2.449],[6.352,2.128,2.091,2.100,2.101,2.239],[4.125,1.306,1.341,1.238,1.221,1.238],[0.067,0.038,0.038,0.040,0.035,0.037],[7.848,2.536,2.557,2.596,2.747,2.811],[2.468,1.357,1.311,1.344,1.283,1.177],[2.057,0.705,0.740,0.728,0.721,0.714],[0.007,0.001,0.002,0.001,0.002,0.002],[0.051,0.015,0.013,0.016,0.015,0.019],[0.057,0.035,0.028,0.045,0.027,0.028],[0.062,0.034,0.032,0.032,0.035,0.035],[0.180,0.172,0.155,0.151,0.138,0.145],[0.278,0.235,0.233,0.229,0.236,0.232],[0.029,0.019,0.015,0.028,0.015,0.015],[0.028,0.015,0.011,0.011,0.011,0.013],[0.351,0.314,0.309,0.296,0.295,0.286],[0.398,0.362,0.342,0.340,0.337,0.355],[0.177,0.125,0.106,0.120,0.109,0.110],[0.162,0.126,0.132,0.123,0.138,0.132],[0.506,0.403,0.400,0.406,0.405,0.403],[0.691,0.536,0.514,0.525,0.552,0.557],[0.550,0.484,0.499,0.496,0.521,0.470],[0.545,0.451,0.455,0.421,0.454,0.438],[1.488,1.317,1.289,1.282,1.335,1.326],[0.955,0.895,0.932,0.980,0.906,0.897],[3.358,3.333,3.192,3.226,3.029,3.166],[0.128,0.099,0.054,0.056,0.067,0.050],[1.461,0.498,0.485,0.501,0.483,0.477],[1.761,0.532,0.488,0.523,0.562,0.527],[4.063,1.375,1.446,1.408,1.464,1.460],[3.204,0.650,0.618,0.657,0.651,0.632],[0.213,0.126,0.128,0.137,0.147,0.133],[0.184,0.119,0.103,0.119,0.119,0.116],[0.223,0.142,0.154,0.156,0.141,0.150],[1.456,0.612,0.572,0.586,0.605,0.604],[1.070,0.779,0.741,0.807,0.792,0.832],[1.330,1.121,1.227,1.415,1.237,1.218],[0.399,0.352,0.380,0.348,0.294,0.321],[0.630,0.484,0.480,0.486,0.509,0.490],[3.135,2.907,2.789,2.840,2.873,2.847],[2.572,2.388,2.213,2.133,2.226,2.209],[2.396,2.369,2.309,2.377,2.355,2.332],[1.044,0.848,0.908,0.820,0.833,0.886],[0.141,0.079,0.066,0.079,0.073,0.068],[0.079,0.047,0.055,0.034,0.035,0.050],[0.087,0.039,0.026,0.060,0.046,0.031],[0.226,0.145,0.125,0.148,0.133,0.123],[0.067,0.011,0.009,0.016,0.010,0.016],[0.045,0.012,0.007,0.011,0.008,0.008],[0.033,0.009,0.005,0.005,0.010,0.004],[0.117,0.086,0.079,0.095,0.081,0.081],[0.561,0.106,0.097,0.105,0.101,0.096],[0.175,0.056,0.054,0.056,0.044,0.043],[0.110,0.074,0.082,0.080,0.077,0.075],[0.169,0.043,0.036,0.038,0.036,0.036],[0.197,0.068,0.068,0.065,0.066,0.068],[0.253,0.098,0.101,0.093,0.110,0.091],[0.069,0.036,0.045,0.034,0.036,0.034],[0.103,0.065,0.073,0.082,0.066,0.062],[0.319,0.180,0.182,0.173,0.182,0.183],[0.707,0.286,0.249,0.237,0.261,0.264],[0.612,0.448,0.459,0.474,0.465,0.465],[0.559,0.092,0.081,0.080,0.083,0.082],[0.718,0.407,0.396,0.427,0.409,0.404],[3.170,3.026,2.986,2.986,2.942,3.013],[8.666,1.408,1.461,1.537,1.541,1.528],[1.865,1.463,1.500,1.462,1.504,1.468],[12.912,4.941,5.145,5.216,4.905,5.160],[4.441,4.347,4.418,4.446,4.458,4.522],[4.202,2.331,2.370,2.389,2.382,2.377],[5.908,5.919,5.954,5.813,5.836,6.024],[null,null,null,null,null,null],[4.692,4.478,4.540,4.531,4.505,4.423],[null,null,null,null,null,null],[6.923,6.638,6.675,6.818,6.815,6.849],[null,null,null,null,null,null],[4.295,4.181,4.317,4.318,4.403,4.331],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.699,0.963,0.987,0.711,0.651,0.685],[null,null,null,null,null,null],[14.276,14.683,14.177,14.871,14.857,14.376],[null,null,null,null,null,null],[22.967,22.686,22.883,22.545,22.723,22.817],[null,null,null,null,null,null],[37.334,37.518,36.552,36.546,37.073,36.733],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.832,7.638,7.724,7.773,7.947,7.746],[0.582,0.499,0.502,0.507,0.535,0.489],[1.357,0.543,0.542,0.549,0.532,0.542],[7.967,7.638,7.456,7.408,7.701,8.191],[0.923,0.871,0.879,0.939,0.870,0.814],[0.312,0.211,0.195,0.214,0.205,0.190],[0.463,0.384,0.383,0.378,0.386,0.386],[null,null,null,null,null,null],[29.691,28.833,28.277,28.853,28.169,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.827,1.700,1.551,1.536,1.629,1.630],[3.976,3.574,3.684,3.636,3.786,3.772],[87.236,88.669,91.145,89.687,90.581,90.962],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.261,0.743,0.746,0.724,0.677,0.618],[1.336,1.195,1.169,1.183,1.194,1.181],[1.241,1.105,1.112,1.077,1.049,1.060],[null,null,null,null,null,null],[51.650,51.566,50.852,50.268,50.495,51.359],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.933,0.882,0.982,0.902,0.884,0.876],[null,null,null,null,null,null],[12.872,12.826,12.783,12.934,12.689,13.725],[null,null,null,null,null,null],[2.900,2.766,2.798,2.709,2.810,2.817],[null,null,null,null,null,null],[0.284,0.206,0.197,0.219,0.230,0.201],[0.313,0.237,0.242,0.215,0.221,0.235],[7.623,7.456,7.295,7.290,7.337,7.307],[14.876,14.474,14.738,14.182,13.799,13.936],[6.087,5.676,5.638,5.603,5.548,5.646],[5.629,5.424,5.542,5.375,5.547,5.501],[12.848,12.796,12.799,13.377,12.652,12.731],[0.439,0.326,0.332,0.330,0.328,0.328],[null,null,null,null,null,null],[1.163,1.036,1.039,1.026,1.021,1.016],[12.699,12.688,12.593,13.431,12.767,12.641],[null,null,null,null,null,null],[1.660,1.562,1.491,1.508,1.517,1.512],[null,null,null,null,null,null],[0.927,0.459,0.461,0.457,0.457,0.453],[0.796,0.587,0.595,0.583,0.594,0.570],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.068,0.988,1.000,0.945,1.037,1.049],[6.688,6.449,6.301,6.305,6.305,6.310],[0.518,0.486,0.503,0.473,0.493,0.476],[0.548,0.476,0.462,0.469,0.478,0.481],[1.435,1.321,1.328,1.316,1.314,1.340],[null,null,null,null,null,null],[2.110,1.995,2.019,2.038,2.043,1.993],[6.796,6.798,6.725,6.576,6.771,6.651],[0.052,0.047,0.076,0.032,0.037,0.032],[0.655,0.587,0.579,0.576,0.580,0.573],[1.864,1.001,0.997,0.988,0.957,0.969],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.304,4.446,4.184,4.327,4.259,4.215],[6.686,6.443,6.510,6.490,6.490,6.551],[2.079,2.043,2.023,1.988,2.071,2.077],[2.119,2.008,2.060,2.039,2.055,2.040],[7.945,8.016,8.331,8.566,8.094,8.354],[2.139,2.114,2.084,2.068,2.044,2.080],[0.944,0.539,0.535,0.508,0.524,0.512],[null,null,null,null,null,null],[0.918,0.671,0.684,0.707,0.690,0.689],[2.389,2.215,2.214,2.229,2.233,2.223],[0.948,0.528,0.546,0.580,0.544,0.617],[1.737,1.510,1.483,1.489,1.434,1.445],[0.485,0.420,0.427,0.424,0.418,0.426],[2.121,2.033,2.053,2.004,2.029,2.027],[null,null,null,null,null,null],[21.302,21.227,20.787,21.843,21.659,21.124],[1.433,1.217,1.205,1.257,1.207,1.179],[null,null,null,null,null,null],[2.481,0.889,0.878,0.860,0.859,0.856],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.850,0.387,0.381,0.382,0.385,0.384],[null,null,null,null,null,null],[0.781,0.473,0.472,0.467,0.474,0.477],[37.658,37.980,37.791,37.941,38.353,38.337],[null,null,null,null,null,null],[0.027,0.021,0.022,0.029,0.021,0.020],[1.636,0.562,0.539,0.525,0.548,0.541],[0.055,0.060,0.050,0.059,0.046,0.045],[null,null,null,null,null,null],[4.796,4.644,4.608,4.586,4.722,4.662],[null,null,null,null,null,null],[1.674,1.621,1.598,1.686,1.709,1.691],[0.246,0.179,0.180,0.202,0.179,0.165],[0.979,0.952,0.990,0.936,0.947,0.962],[1.675,1.488,1.460,1.462,1.437,1.436],[null,null,null,null,null,null],[6.585,6.381,6.322,6.447,6.484,6.454],[3.177,3.106,3.099,3.150,3.147,3.145],[2.796,2.769,2.890,2.785,2.854,2.805],[0.257,0.165,0.163,0.162,0.157,0.154],[0.813,0.771,0.646,0.722,0.653,0.732],[null,null,null,null,null,null],[2.800,2.721,2.698,2.650,2.622,2.698],[null,null,null,null,null,null],[37.809,37.303,37.388,37.588,37.495,37.427],[0.297,0.240,0.236,0.237,0.233,0.240],[4.950,4.837,4.745,4.861,4.834,4.825],[null,null,null,null,null,null],[0.804,0.722,0.718,0.713,0.733,0.718],[0.982,0.931,0.941,0.876,0.932,1.012],[1.109,1.034,0.988,0.958,0.991,0.999],[0.982,0.950,0.952,0.933,0.906,0.874],[1.013,1.009,0.983,1.026,1.073,1.026],[20.537,23.622,21.034,20.531,20.605,20.638],[6.091,6.014,6.253,6.095,6.071,6.057],[1.522,1.474,1.504,1.478,1.469,1.446],[null,null,null,null,null,null],[34.371,33.957,33.895,34.093,34.243,34.579],[36.257,36.454,36.403,36.158,35.961,36.338],[38.866,38.856,39.123,38.655,38.864,38.714],[4.563,4.512,4.566,4.528,4.718,4.566],[2.810,2.708,2.809,2.716,2.792,2.685],[4.994,4.958,4.964,4.988,5.018,5.064],[11.844,11.605,11.708,11.649,11.669,11.638],[11.893,11.836,11.681,11.857,11.865,11.843],[12.410,11.797,11.912,12.154,11.921,11.910],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[38.829,38.571,38.166,38.345,38.578,38.400],[44.137,43.794,44.243,43.954,43.001,43.640],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.235,4.092,4.094,4.089,4.177,4.191],[4.765,4.711,4.653,4.654,4.618,4.668],[0.273,0.264,0.260,0.262,0.272,0.260],[0.268,0.273,0.269,0.266,0.262,0.260],[3.677,3.557,3.531,3.520,3.567,3.625],[null,null,null,null,null,null],[4.660,4.425,4.360,4.429,4.534,4.401],[5.031,4.890,4.895,4.842,4.856,4.983],[4.680,4.432,4.474,4.438,4.459,4.466],[3.662,3.468,3.486,3.442,3.506,3.544],[4.759,4.699,4.635,4.624,4.685,4.666],[4.652,4.747,4.770,4.632,4.601,4.717],[4.752,4.837,4.819,4.789,4.818,4.793],[3.074,2.892,2.881,2.800,2.833,2.712],[2.596,2.332,2.241,2.280,2.269,2.283],[4.086,3.940,3.853,3.855,3.955,3.915],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.325,6.090,6.143,6.181,6.050,6.050],[0.118,0.122,0.116,0.120,0.118,0.114],[5.522,5.257,5.202,5.226,5.256,5.316],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.549,0.545,0.549,0.569,0.546,0.547],[0.549,0.550,0.537,0.571,0.537,0.575],[0.536,0.535,0.546,0.536,0.535,0.531],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.317,4.330,4.318,4.330,4.313,4.360],[4.325,4.321,4.314,4.327,4.338,4.308],[4.184,4.195,4.192,4.187,4.176,4.190],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.463,1.378,1.405,1.476,1.369,1.351],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.12.4.1","source":"results/21.12.4.1.json"} +,{"actual_version":"21.3.20.1","data_size":{"hits":14323237934,"job":1830194210,"mgbench":2962784076,"ontime":2704903445,"ssb":72905367899,"taxi":24216920069,"tpcds":18799911586,"tpch":17376476463,"uk":781266522},"kind":"versions-benchmark","load_time":{"hits":249,"job":26,"mgbench":58,"ontime":51,"ssb":1341,"taxi":904,"tpcds":276,"tpch":270,"uk":39},"machine":"c7a.4xlarge","release_date":"2022-01-26","result":[[0.072,0.012,0.012,0.011,0.011,0.009],[0.065,0.025,0.024,0.024,0.024,0.026],[0.047,0.011,0.010,0.011,0.012,0.011],[0.053,0.014,0.018,0.012,0.012,0.012],[0.040,0.027,0.021,0.023,0.022,0.021],[0.070,0.017,0.018,0.018,0.017,0.017],[0.039,0.009,0.006,0.008,0.008,0.007],[0.060,0.025,0.025,0.022,0.022,0.024],[0.060,0.032,0.036,0.040,0.037,0.035],[0.111,0.089,0.089,0.089,0.084,0.084],[0.473,0.488,0.498,0.473,0.474,0.472],[0.525,0.421,0.424,0.423,0.439,0.415],[0.046,0.013,0.010,0.008,0.008,0.069],[0.041,0.023,0.022,0.013,0.016,0.013],[0.901,0.856,0.842,0.832,0.871,0.839],[0.200,0.121,0.122,0.123,0.130,0.125],[0.033,0.019,0.021,0.019,0.018,0.020],[0.178,0.137,0.146,0.138,0.140,0.138],[6.403,1.777,1.779,1.783,1.793,1.792],[4.723,1.274,1.268,1.281,1.266,1.274],[4.744,1.298,1.289,1.295,1.315,1.308],[5.400,2.238,2.239,2.230,2.224,2.236],[6.250,1.811,1.816,1.847,1.803,1.812],[4.003,1.075,1.074,1.079,1.090,1.091],[0.053,0.035,0.037,0.039,0.033,0.034],[7.705,2.456,2.433,2.459,2.428,2.463],[2.320,1.187,1.176,1.182,1.186,1.169],[1.905,0.632,0.602,0.620,0.613,0.603],[0.006,0.005,0.002,0.004,0.002,0.002],[0.024,0.012,0.013,0.013,0.012,0.013],[0.044,0.034,0.033,0.028,0.027,0.029],[0.052,0.035,0.032,0.032,0.030,0.030],[0.156,0.135,0.132,0.130,0.125,0.128],[0.234,0.190,0.207,0.213,0.200,0.206],[0.024,0.015,0.016,0.015,0.016,0.015],[0.020,0.012,0.012,0.012,0.013,0.013],[0.299,0.271,0.282,0.278,0.288,0.268],[0.366,0.314,0.324,0.335,0.323,0.324],[0.150,0.130,0.122,0.125,0.128,0.123],[0.162,0.129,0.125,0.125,0.126,0.125],[0.447,0.376,0.367,0.357,0.352,0.373],[0.535,0.491,0.487,0.490,0.487,0.490],[0.481,0.435,0.438,0.446,0.433,0.436],[0.542,0.486,0.479,0.470,0.472,0.495],[1.289,1.149,1.136,1.173,1.166,1.160],[0.844,0.771,0.758,0.767,0.746,0.789],[2.860,2.600,2.625,2.679,2.584,2.606],[0.111,0.048,0.059,0.045,0.030,0.035],[1.442,0.360,0.370,0.368,0.374,0.365],[1.734,0.413,0.413,0.409,0.413,0.417],[4.042,1.178,1.152,1.154,1.162,1.150],[4.422,0.604,0.590,0.580,0.594,0.595],[0.175,0.153,0.131,0.128,0.126,0.130],[0.199,0.105,0.103,0.105,0.106,0.107],[0.190,0.137,0.131,0.131,0.129,0.139],[1.430,0.494,0.478,0.485,0.479,0.481],[1.080,0.625,0.635,0.612,0.627,0.625],[1.059,1.014,1.003,1.011,0.999,0.997],[0.412,0.361,0.354,0.360,0.362,0.365],[0.636,0.560,0.544,0.551,0.543,0.552],[3.677,3.244,3.293,3.237,3.218,3.258],[2.073,1.728,1.738,1.722,1.747,1.752],[2.043,1.715,1.757,1.752,1.768,1.743],[0.776,0.740,0.784,0.739,0.744,0.742],[0.152,0.114,0.110,0.084,0.098,0.083],[0.054,0.040,0.036,0.038,0.032,0.033],[0.070,0.042,0.028,0.040,0.043,0.026],[0.274,0.172,0.146,0.165,0.162,0.161],[0.039,0.013,0.018,0.014,0.011,0.009],[0.029,0.010,0.009,0.014,0.009,0.008],[0.013,0.003,0.003,0.003,0.004,0.005],[0.132,0.068,0.067,0.069,0.074,0.066],[0.161,0.074,0.086,0.100,0.092,0.089],[0.077,0.053,0.045,0.045,0.041,0.043],[0.101,0.064,0.065,0.065,0.065,0.065],[0.053,0.038,0.043,0.032,0.032,0.033],[0.113,0.068,0.070,0.069,0.066,0.069],[0.143,0.101,0.096,0.095,0.097,0.095],[0.055,0.035,0.038,0.036,0.035,0.037],[0.091,0.062,0.061,0.086,0.063,0.063],[0.204,0.170,0.171,0.166,0.171,0.174],[0.245,0.221,0.219,0.212,0.209,0.212],[0.458,0.413,0.390,0.390,0.387,0.391],[0.088,0.074,0.069,0.072,0.065,0.069],[0.406,0.319,0.317,0.311,0.312,0.309],[2.579,2.450,2.410,2.407,2.399,2.385],[8.661,1.134,1.147,1.136,1.149,1.146],[1.775,1.192,1.177,1.159,1.160,1.154],[12.799,3.941,3.932,3.927,3.947,3.944],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.702,0.744,0.744,0.751,0.749,0.747],[null,null,null,null,null,null],[15.907,16.235,15.938,15.995,16.211,16.108],[null,null,null,null,null,null],[25.730,26.383,26.206,26.472,26.271,26.498],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.082,8.053,7.981,7.950,7.968,8.032],[0.679,0.610,0.598,0.598,0.592,0.617],[1.100,1.006,1.001,0.994,0.994,0.984],[null,null,null,null,null,null],[0.836,0.791,0.792,0.800,0.794,0.785],[null,null,null,null,null,null],[0.478,0.417,0.415,0.416,0.410,0.390],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.739,3.877,3.732,3.705,3.700,3.789],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.078,1.008,1.007,1.000,1.012,0.997],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[11.694,11.613,11.584,11.599,11.557,11.521],[null,null,null,null,null,null],[2.594,2.434,2.381,2.380,2.464,2.402],[null,null,null,null,null,null],[0.244,0.159,0.162,0.153,0.165,0.152],[0.255,0.197,0.202,0.214,0.194,0.207],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[11.733,11.461,11.580,11.544,11.591,11.475],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.028,0.969,0.969,0.977,0.971,0.972],[11.573,11.480,11.478,11.572,11.529,11.496],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.093,1.035,1.007,1.040,1.014,1.014],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.310,1.197,1.211,1.217,1.203,1.208],[null,null,null,null,null,null],[2.218,2.135,2.132,2.126,2.108,2.089],[6.555,6.545,6.537,6.466,6.462,6.418],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.716,3.537,3.604,3.496,3.554,3.510],[null,null,null,null,null,null],[2.236,2.083,2.090,2.082,2.058,2.135],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.203,2.168,2.191,2.103,2.191,2.114],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.447,0.373,0.350,0.353,0.351,0.358],[null,null,null,null,null,null],[null,null,null,null,null,null],[18.849,18.960,18.934,19.020,18.666,19.164],[1.213,1.087,1.091,1.063,1.075,1.065],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.030,0.027,0.027,0.019,0.017,0.016],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.762,1.753,1.721,1.691,1.712,1.753],[null,null,null,null,null,null],[1.167,1.102,1.107,1.073,1.121,1.121],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.213,0.141,0.143,0.137,0.148,0.134],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.498,2.414,2.395,2.363,2.390,2.400],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.284,0.216,0.216,0.220,0.211,0.214],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.669,0.597,0.588,0.601,0.598,0.595],[null,null,null,null,null,null],[1.026,0.967,0.953,0.963,0.911,0.867],[0.903,0.851,0.852,0.859,0.824,0.876],[1.033,0.961,0.912,0.931,0.928,0.957],[19.558,19.478,19.329,19.219,19.306,19.392],[5.719,5.618,5.610,5.597,5.673,5.626],[1.522,1.469,1.415,1.424,1.469,1.440],[null,null,null,null,null,null],[32.799,32.719,32.765,32.397,32.321,32.579],[32.095,31.699,31.543,31.860,31.960,31.896],[34.646,34.127,34.402,34.276,34.346,34.222],[3.744,3.690,3.695,3.738,3.703,3.771],[2.510,2.440,2.442,2.427,2.423,2.366],[3.852,3.860,3.933,3.926,3.874,3.843],[10.269,10.068,10.076,10.048,9.998,10.066],[10.402,10.294,10.307,10.307,10.317,10.299],[10.356,10.224,10.301,10.184,10.265,10.221],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[37.365,37.405,37.797,37.302,37.248,37.510],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.858,3.805,3.771,3.802,3.818,3.802],[4.462,4.351,4.442,4.407,4.379,4.400],[0.263,0.234,0.232,0.235,0.229,0.232],[0.256,0.229,0.238,0.230,0.233,0.233],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.278,4.006,3.929,3.998,3.938,3.985],[null,null,null,null,null,null],[4.263,4.027,4.089,3.993,4.003,4.014],[3.369,3.125,3.117,3.138,3.115,3.163],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.235,4.287,4.316,4.254,4.289,4.240],[2.969,2.635,2.434,2.638,2.623,2.536],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.567,5.238,5.347,5.319,5.239,5.281],[0.164,0.153,0.138,0.141,0.137,0.141],[4.859,4.568,4.623,4.596,4.639,4.569],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.527,0.488,0.495,0.487,0.492,0.482],[0.517,0.496,0.495,0.483,0.483,0.483],[0.511,0.484,0.484,0.484,0.487,0.478],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.418,3.394,3.404,3.395,3.391,3.397],[3.436,3.391,3.394,3.408,3.396,3.395],[3.340,3.308,3.308,3.303,3.307,3.300],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.381,1.361,1.307,1.284,1.320,1.326],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.3.20.1","source":"results/21.3.20.1.json"} +,{"actual_version":"21.8.15.7","data_size":{"coffeeshop":44766345096,"hits":14376595356,"job":1830194210,"mgbench":2958292098,"ontime":2704903445,"ssb":72904209596,"taxi":24216865164,"tpcds":18783912173,"tpch":17376595936,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":842,"hits":216,"job":26,"mgbench":69,"ontime":55,"ssb":1418,"taxi":940,"tpcds":302,"tpch":255,"uk":36},"machine":"c7a.4xlarge","release_date":"2022-02-25","result":[[0.076,0.011,0.009,0.258,0.009,0.008],[0.056,0.023,0.023,0.024,0.023,0.023],[0.047,0.010,0.011,0.035,0.010,0.010],[0.050,0.014,0.011,0.018,0.010,0.011],[0.041,0.021,0.021,0.032,0.022,0.020],[0.072,0.023,0.025,0.034,0.021,0.031],[0.029,0.010,0.008,0.008,0.009,0.008],[0.067,0.026,0.025,0.025,0.022,0.023],[0.062,0.036,0.036,0.055,0.032,0.033],[0.111,0.099,0.096,0.085,0.083,0.077],[0.535,0.541,0.519,0.463,0.519,0.532],[0.474,0.377,0.371,0.363,0.353,0.354],[0.035,0.010,0.011,0.015,0.012,0.008],[0.135,0.013,0.036,0.023,0.018,0.013],[0.916,0.854,0.844,0.874,0.830,0.827],[0.304,0.131,0.130,0.118,0.123,0.130],[0.036,0.028,0.019,0.027,0.022,0.033],[0.209,0.157,0.161,0.156,0.167,0.153],[6.396,1.803,1.835,1.825,1.819,1.819],[4.708,1.311,1.324,1.298,1.312,1.316],[4.738,1.322,1.322,1.325,1.341,1.335],[5.376,2.244,2.294,2.272,2.266,2.269],[6.208,1.896,1.912,1.925,1.918,1.930],[3.987,1.118,1.125,1.139,1.132,1.134],[0.063,0.042,0.033,0.038,0.034,0.035],[7.695,2.506,2.524,2.533,2.518,2.533],[2.290,1.226,1.212,1.233,1.230,1.198],[1.891,0.638,0.643,0.653,0.630,0.640],[0.010,0.002,0.004,0.002,0.002,0.002],[0.037,0.018,0.017,0.019,0.017,0.012],[0.040,0.028,0.027,0.037,0.032,0.029],[0.067,0.038,0.034,0.031,0.031,0.030],[0.155,0.130,0.120,0.130,0.134,0.136],[0.262,0.215,0.212,0.213,0.208,0.209],[0.028,0.017,0.018,0.025,0.015,0.015],[0.025,0.017,0.013,0.013,0.013,0.013],[0.314,0.278,0.282,0.292,0.288,0.282],[0.392,0.345,0.313,0.317,0.327,0.334],[0.156,0.135,0.132,0.140,0.133,0.122],[0.191,0.124,0.131,0.130,0.132,0.134],[0.461,0.380,0.373,0.361,0.362,0.369],[0.603,0.484,0.487,0.499,0.517,0.502],[0.551,0.448,0.427,0.450,0.446,0.467],[0.431,0.411,0.415,0.400,0.402,0.445],[1.308,1.113,1.111,1.135,1.119,1.105],[0.807,0.754,0.742,0.755,0.754,0.745],[2.748,2.609,null,2.627,2.455,2.425],[0.209,0.076,0.053,0.041,0.031,0.045],[1.426,0.384,0.368,0.369,0.367,0.393],[1.783,0.430,0.447,0.448,0.437,0.448],[4.067,1.204,1.216,1.226,1.200,1.194],[4.708,0.623,0.634,0.669,0.673,0.645],[0.271,0.153,0.138,0.142,0.142,0.148],[0.200,0.111,0.113,0.108,0.110,0.105],[0.238,0.137,0.140,0.135,0.135,0.138],[1.444,0.510,0.491,0.517,0.497,0.502],[1.089,0.654,0.646,0.643,0.651,0.638],[1.079,1.056,1.041,1.146,1.038,1.042],[0.373,0.314,0.319,0.302,0.301,0.295],[0.622,0.437,0.419,0.414,0.430,0.443],[2.669,null,null,null,null,null],[2.315,1.922,1.870,1.865,1.829,1.886],[2.190,1.885,1.921,1.841,1.879,1.836],[0.871,0.750,0.721,0.740,0.759,0.728],[0.117,0.077,0.081,0.072,0.083,0.056],[0.068,0.061,0.054,0.030,0.031,0.031],[0.075,0.039,0.027,0.025,0.024,0.023],[0.241,0.162,0.164,0.135,0.137,0.155],[0.037,0.012,0.012,0.010,0.009,0.011],[0.034,0.010,0.008,0.010,0.008,0.008],[0.017,0.004,0.008,0.008,0.008,0.005],[0.193,0.063,0.069,0.075,0.078,0.069],[0.184,0.097,0.094,0.104,0.090,0.088],[0.086,0.048,0.051,0.055,0.039,0.041],[0.101,0.070,0.066,0.076,0.066,0.066],[0.056,0.036,0.035,0.037,0.036,0.036],[0.117,0.081,0.074,0.075,0.072,0.079],[0.166,0.146,0.137,0.133,0.117,0.134],[0.063,0.057,0.047,0.043,0.047,0.046],[0.108,0.069,0.090,0.091,0.067,0.067],[0.231,0.182,0.173,0.200,0.177,0.182],[0.283,0.233,0.233,0.232,0.226,0.228],[0.470,0.405,0.399,0.406,0.404,0.401],[0.085,0.073,0.069,0.080,0.073,0.082],[0.438,0.351,0.349,0.346,0.337,0.344],[2.696,2.482,2.452,2.456,2.452,2.436],[8.653,1.189,1.175,1.194,1.189,1.180],[1.771,1.207,1.208,1.221,1.215,1.172],[12.809,3.907,3.899,3.880,3.886,3.884],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.369,5.058,5.106,5.121,5.121,5.119],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.714,0.774,0.763,0.575,0.560,0.570],[null,null,null,null,null,null],[16.248,16.493,16.397,16.505,16.482,16.639],[null,null,null,null,null,null],[27.295,27.537,27.891,27.431,27.380,27.120],[null,null,null,null,null,null],[43.214,42.904,43.038,43.088,43.646,43.810],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.422,8.277,8.251,8.222,8.151,8.183],[0.706,0.635,0.617,0.644,0.642,0.619],[1.221,1.051,1.038,1.050,1.032,1.033],[null,null,null,null,null,null],[0.867,0.804,0.830,0.820,0.809,0.796],[0.251,0.234,0.217,0.211,0.208,0.209],[0.543,0.440,0.434,0.427,0.433,0.432],[null,null,null,null,null,null],[33.589,32.100,32.373,32.585,32.360,32.766],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.500,1.356,1.270,1.247,1.261,1.234],[3.861,3.822,3.823,3.735,3.786,3.671],[91.333,90.550,91.735,91.338,91.635,92.307],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.252,0.663,0.681,0.675,0.629,0.605],[null,null,null,null,null,null],[1.319,1.150,1.131,1.085,1.086,1.086],[null,null,null,null,null,null],[53.389,52.753,52.891,53.487,53.177,53.357],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.181,1.149,1.096,1.107,1.107,1.099],[null,null,null,null,null,null],[11.763,11.553,11.671,11.664,11.543,11.558],[null,null,null,null,null,null],[2.684,2.518,2.440,2.595,2.524,2.439],[null,null,null,null,null,null],[0.235,0.178,0.178,0.192,0.159,0.148],[0.317,0.215,0.210,0.192,0.197,0.191],[8.409,8.011,8.100,8.122,8.072,8.081],[15.804,15.596,15.593,15.679,15.780,15.810],[5.497,5.056,5.005,4.984,4.977,4.974],[5.129,4.895,4.938,4.971,4.935,4.936],[11.609,11.554,11.506,11.649,11.499,11.568],[0.487,0.340,0.328,0.333,0.325,0.321],[null,null,null,null,null,null],[1.201,1.038,1.060,1.026,1.033,1.025],[11.624,11.480,11.535,11.686,11.598,11.597],[null,null,null,null,null,null],[1.524,1.399,1.376,1.344,1.375,1.375],[null,null,null,null,null,null],[0.920,0.422,0.418,0.411,0.414,0.408],[0.800,0.495,0.510,0.498,0.520,0.523],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.066,1.039,1.038,1.058,0.985,1.031],[null,null,null,null,null,null],[0.469,0.410,0.430,0.411,0.419,0.411],[0.468,0.407,0.411,0.401,0.416,0.412],[1.308,1.183,1.186,1.189,1.184,1.183],[null,null,null,null,null,null],[2.257,2.138,2.163,2.120,2.197,2.112],[6.654,6.567,6.426,6.490,6.522,6.668],[null,null,null,null,null,null],[0.755,0.667,0.692,0.663,0.681,0.699],[1.881,0.925,0.910,0.911,0.879,0.906],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.871,3.702,3.697,3.805,3.704,3.708],[null,null,null,null,null,null],[2.251,2.190,2.086,2.224,2.201,2.180],[null,null,null,null,null,null],[10.108,9.783,9.704,9.799,9.875,9.927],[2.246,2.170,2.168,2.188,2.185,2.139],[0.918,0.447,0.459,0.468,0.470,0.471],[null,null,null,null,null,null],[0.836,0.608,0.590,0.627,0.596,0.602],[2.264,2.093,2.078,2.131,2.081,2.056],[0.910,0.465,0.493,0.472,0.493,0.494],[1.620,1.385,1.369,1.340,1.349,1.354],[0.430,0.353,0.375,0.367,0.365,0.369],[null,null,null,null,null,null],[null,null,null,null,null,null],[21.024,20.998,21.559,21.293,21.175,21.307],[1.272,1.055,1.044,1.085,1.044,1.047],[null,null,null,null,null,null],[2.434,0.781,0.743,0.756,0.756,0.768],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.848,0.380,0.388,0.388,0.388,0.399],[null,null,null,null,null,null],[0.775,0.422,0.410,0.407,0.400,0.412],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.027,0.021,0.018,0.026,0.019,0.018],[1.617,0.460,0.452,0.459,0.461,0.464],[0.049,0.052,0.046,0.052,0.042,0.047],[null,null,null,null,null,null],[4.366,3.994,4.100,4.060,4.019,4.097],[null,null,null,null,null,null],[1.867,1.806,1.752,1.733,1.691,1.770],[0.207,0.142,0.148,0.157,0.146,0.135],[1.263,1.118,1.171,1.101,1.164,1.157],[1.491,1.359,1.384,1.348,1.360,1.336],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.965,2.822,2.811,2.802,2.802,2.806],[null,null,null,null,null,null],[0.210,0.145,0.139,0.144,0.143,0.138],[0.789,0.736,0.696,0.665,0.673,0.657],[null,null,null,null,null,null],[2.506,2.358,2.374,2.371,2.359,2.364],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.545,0.228,0.218,0.217,0.225,0.220],[4.358,4.186,4.184,4.199,4.160,4.204],[null,null,null,null,null,null],[0.757,0.603,0.627,0.629,0.628,0.629],[0.951,0.879,0.842,0.961,0.889,0.875],[1.048,0.951,0.919,0.995,0.982,0.958],[0.899,0.872,0.882,0.884,0.855,0.810],[0.987,0.940,0.948,0.948,0.964,0.993],[19.872,19.662,19.761,19.745,19.764,19.773],[5.911,5.847,5.853,5.842,5.898,5.798],[1.500,1.411,1.467,1.463,1.442,1.479],[null,null,null,null,null,null],[33.220,32.845,32.723,32.876,33.140,32.953],[32.502,31.933,32.607,32.269,32.293,31.974],[34.950,34.330,34.286,34.485,34.721,34.386],[3.750,3.746,3.746,3.767,3.699,3.787],[2.433,2.504,2.407,2.232,2.283,2.402],[3.913,3.793,3.927,3.937,3.870,3.814],[10.393,10.054,10.039,9.977,10.071,10.114],[10.612,10.364,10.338,10.392,10.351,10.413],[10.515,10.227,10.336,10.250,10.218,10.314],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[40.371,40.108,40.173,40.219,40.267,40.411],[60.987,60.767,60.602,60.660,60.697,60.674],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.941,3.876,3.957,3.900,3.933,3.911],[4.440,4.354,4.498,4.482,4.467,4.418],[0.216,0.211,0.212,0.212,0.220,0.209],[0.224,0.208,0.208,0.211,0.208,0.209],[4.745,4.714,4.680,4.683,4.608,4.617],[null,null,null,null,null,null],[4.203,3.881,3.954,3.873,3.975,3.903],[4.593,4.251,4.314,4.277,4.299,4.281],[4.243,3.889,3.952,3.911,3.888,3.946],[3.456,3.082,3.010,3.069,3.152,3.085],[4.157,4.128,4.130,4.184,4.025,4.224],[4.178,4.114,4.107,4.159,4.041,4.117],[4.193,4.192,4.123,4.101,4.148,4.190],[2.896,2.546,2.554,2.518,2.554,2.494],[2.494,2.060,2.074,2.025,2.036,2.095],[3.859,3.411,3.509,3.615,3.498,3.535],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.586,5.321,5.365,5.291,5.372,5.396],[0.113,0.125,0.109,0.113,0.110,0.109],[4.955,4.541,4.618,4.655,4.660,4.611],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.447,0.435,0.437,0.442,0.439,0.451],[0.445,0.455,0.436,0.444,0.434,0.444],[0.437,0.433,0.433,0.435,0.434,0.432],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.475,3.462,3.461,3.476,3.477,3.469],[3.485,3.465,3.470,3.471,3.480,3.462],[3.385,3.362,3.367,3.360,3.362,3.373],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.392,1.377,1.313,1.323,1.279,1.294],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"21.8.15.7","source":"results/21.8.15.7.json"} +,{"actual_version":"22.1.4.1","data_size":{"coffeeshop":44753185072,"hits":14417460754,"job":1830194210,"mgbench":2958722518,"ontime":2704903445,"ssb":72902702910,"taxi":24216986276,"tpcds":18815204708,"tpch":17375470814,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":811,"hits":226,"job":23,"mgbench":65,"ontime":57,"ssb":1408,"taxi":887,"tpcds":312,"tpch":253,"uk":34},"machine":"c7a.4xlarge","release_date":"2022-02-25","result":[[0.067,0.012,0.011,0.254,0.011,0.011],[0.066,0.024,0.022,0.022,0.024,0.022],[0.048,0.013,0.012,0.039,0.013,0.013],[0.048,0.043,0.028,0.050,0.029,0.038],[0.047,0.029,0.025,0.033,0.022,0.026],[0.081,0.031,0.035,0.039,0.029,0.024],[0.031,0.011,0.007,0.014,0.010,0.010],[0.066,0.031,0.029,0.033,0.029,0.029],[0.074,0.041,0.040,0.058,0.036,0.038],[0.144,0.097,0.083,0.097,0.087,0.088],[0.543,0.525,0.528,0.526,0.497,0.447],[0.460,0.345,0.328,0.358,0.336,0.339],[0.063,0.022,0.022,0.026,0.014,0.026],[0.067,0.038,0.038,0.026,0.018,0.026],[0.854,0.837,0.822,0.855,0.789,0.798],[0.188,0.122,0.110,0.108,0.113,0.104],[0.042,0.022,0.022,0.020,0.018,0.019],[0.196,0.161,0.155,0.158,0.167,0.171],[6.401,1.455,1.495,1.509,1.451,1.447],[4.748,1.033,1.032,1.075,1.042,1.025],[4.754,1.069,1.090,1.071,1.075,1.072],[5.391,1.869,1.871,1.886,1.933,1.974],[6.245,1.775,1.755,1.771,1.898,1.908],[4.004,1.045,1.058,1.112,1.038,1.062],[0.068,0.041,0.039,0.040,0.039,0.038],[7.699,2.354,2.395,2.252,2.225,2.200],[2.322,1.144,1.173,1.160,1.065,1.072],[1.916,0.609,0.607,0.662,0.640,0.660],[0.007,0.002,0.002,0.002,0.002,0.001],[0.032,0.017,0.016,0.014,0.015,0.017],[0.084,0.029,0.027,0.038,0.027,0.026],[0.063,0.035,0.034,0.032,0.035,0.032],[0.167,0.137,0.128,0.138,0.131,0.138],[0.254,0.215,0.193,0.211,0.224,0.216],[0.033,0.020,0.019,0.030,0.019,0.017],[0.032,0.015,0.014,0.014,0.015,0.014],[0.335,0.294,0.302,0.294,0.301,0.299],[0.398,0.348,0.338,0.337,0.343,0.345],[0.180,0.104,0.102,0.103,0.104,0.104],[0.156,0.119,0.122,0.120,0.121,0.131],[0.476,0.351,0.342,0.405,0.383,0.368],[0.633,0.513,0.524,0.551,0.574,0.560],[0.581,0.465,0.468,0.469,0.491,0.521],[0.454,0.384,0.387,0.363,0.401,0.414],[1.396,1.202,1.200,1.250,1.199,1.210],[0.873,0.792,0.806,0.833,0.796,0.792],[3.272,3.375,2.952,3.038,3.028,2.703],[0.120,0.084,0.061,0.072,0.071,0.061],[1.463,0.442,0.423,0.427,0.400,0.397],[1.778,0.460,0.448,0.441,0.442,0.451],[4.128,1.194,1.225,1.192,1.211,1.193],[3.513,0.624,0.563,0.597,0.594,0.593],[0.211,0.117,0.124,0.116,0.123,0.121],[0.172,0.097,0.100,0.092,0.097,0.105],[0.186,0.125,0.114,0.117,0.117,0.115],[1.447,0.509,0.532,0.540,0.533,0.536],[1.102,0.691,0.662,0.678,0.656,0.645],[1.113,1.090,1.063,1.210,1.070,1.068],[0.333,0.309,0.305,0.286,0.273,0.278],[0.546,0.421,0.427,0.431,0.439,0.450],[2.805,null,null,null,null,null],[null,2.088,1.952,1.996,2.001,2.118],[2.325,1.964,1.909,1.962,2.046,1.923],[0.873,0.804,0.786,0.753,0.788,0.752],[0.114,0.059,0.056,0.050,0.054,0.054],[0.081,0.065,0.043,0.042,0.028,0.027],[0.104,0.032,0.040,0.050,0.023,0.025],[0.189,0.123,0.109,0.112,0.110,0.094],[0.031,0.011,0.016,0.014,0.011,0.012],[0.031,0.013,0.021,0.011,0.010,0.014],[0.018,0.009,0.010,0.011,0.010,0.009],[0.131,0.079,0.078,0.083,0.074,0.078],[0.164,0.096,0.099,0.102,0.102,0.100],[0.110,0.065,0.052,0.060,0.043,0.049],[0.126,0.067,0.066,0.075,0.065,0.065],[0.053,0.036,0.036,0.037,0.036,0.039],[0.095,0.065,0.064,0.059,0.063,0.075],[0.123,0.091,0.086,0.091,0.088,0.093],[0.052,0.037,0.036,0.035,0.033,0.034],[0.089,0.063,0.063,0.079,0.062,0.063],[0.189,0.156,0.157,0.154,0.157,0.156],[0.278,0.230,0.226,0.231,0.221,0.225],[0.467,0.423,0.419,0.420,0.425,0.432],[0.137,0.095,0.089,0.078,0.085,0.095],[0.474,0.353,0.339,0.361,0.349,0.334],[2.522,2.325,2.325,2.307,2.309,2.329],[8.692,1.155,1.159,1.184,1.174,1.175],[1.795,1.110,1.107,1.110,1.111,1.107],[12.852,4.018,4.074,3.998,3.847,3.758],[4.320,3.471,3.391,3.423,3.420,3.465],[4.096,1.878,1.844,1.880,1.867,1.861],[4.545,4.494,4.534,4.559,4.670,4.590],[null,null,null,null,null,null],[3.638,3.396,3.360,3.411,3.352,3.306],[null,null,null,null,null,null],[5.273,5.151,5.247,5.230,5.167,5.128],[null,null,null,null,null,null],[3.273,3.202,3.185,3.316,3.343,3.226],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.700,0.779,0.771,0.572,0.545,0.548],[null,null,null,null,null,null],[13.743,13.464,13.554,13.668,13.675,13.774],[null,null,null,null,null,null],[22.752,22.865,22.953,23.036,23.052,23.197],[0.167,0.105,0.108,0.102,0.102,0.095],[34.555,34.005,34.467,34.387,33.969,34.121],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.938,7.762,7.746,7.795,7.714,7.730],[0.549,0.467,0.471,0.479,0.438,0.456],[0.650,0.529,0.532,0.537,0.519,0.538],[7.458,7.155,7.092,7.098,7.326,7.384],[1.041,0.901,0.917,0.941,0.871,0.874],[0.282,0.196,0.201,0.208,0.228,0.208],[0.458,0.381,0.369,0.378,0.387,0.385],[null,null,null,null,null,null],[28.387,28.408,28.056,28.275,27.932,28.009],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.610,1.328,1.221,1.240,1.230,1.205],[3.691,3.584,3.523,3.591,3.647,3.554],[88.883,90.617,91.369,90.374,91.653,91.328],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.368,0.674,0.692,0.630,0.573,0.567],[1.123,1.082,1.014,1.005,1.009,1.012],[1.085,1.009,0.995,0.975,0.962,0.958],[null,null,null,null,null,null],[47.583,47.557,48.929,47.740,48.377,47.970],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.918,0.792,0.863,0.823,0.818,0.805],[null,null,null,null,null,null],[12.993,12.791,12.683,12.781,12.735,12.741],[null,null,null,null,null,null],[2.814,2.698,2.765,2.724,2.709,2.721],[null,null,null,null,null,null],[0.273,0.186,0.181,0.185,0.196,0.165],[0.344,0.202,0.200,0.199,0.216,0.197],[6.766,6.595,6.482,6.349,6.403,6.323],[12.757,12.964,12.903,13.063,13.141,13.007],[5.868,5.401,5.377,5.385,5.392,5.351],[5.484,5.301,5.296,5.306,5.340,5.280],[12.853,12.638,12.690,12.675,12.721,12.665],[0.413,0.315,0.322,0.337,0.323,0.329],[null,null,null,null,null,null],[1.058,0.940,0.970,0.955,0.938,0.934],[12.877,12.744,12.701,12.800,12.732,12.814],[null,null,null,null,null,null],[1.542,1.400,1.408,1.381,1.383,1.392],[null,null,null,null,null,null],[0.934,0.431,0.445,0.439,0.448,0.440],[0.783,0.511,0.511,0.525,0.538,0.531],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.108,1.033,0.992,1.028,1.011,1.013],[6.181,6.039,6.101,5.992,6.128,6.100],[0.496,0.454,0.440,0.427,0.443,0.442],[0.531,0.447,0.433,0.431,0.443,0.430],[1.432,1.305,1.322,1.324,1.311,1.304],[null,null,null,null,null,null],[2.150,2.084,2.099,2.028,2.116,2.138],[6.389,6.352,6.438,6.365,6.307,6.259],[0.088,0.038,0.033,0.040,0.040,0.045],[0.594,0.531,0.494,0.524,0.510,0.525],[1.920,0.942,0.930,0.939,0.941,0.926],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.217,4.225,4.248,4.324,4.233,4.229],[6.611,6.514,6.517,6.502,6.437,6.370],[2.207,2.121,2.121,2.056,2.142,2.180],[2.308,2.191,2.099,2.206,2.257,2.211],[7.743,7.554,7.645,7.584,7.644,7.513],[2.127,2.108,2.085,2.089,2.107,2.186],[0.949,0.525,0.502,0.531,0.486,0.545],[null,null,null,null,null,null],[0.814,0.634,0.650,0.670,0.639,0.620],[2.212,2.039,2.042,2.031,2.000,2.019],[0.961,0.567,0.539,0.553,0.517,0.542],[1.593,1.407,1.384,1.357,1.351,1.364],[0.428,0.380,0.379,0.376,0.379,0.388],[2.272,2.144,2.190,2.133,2.211,2.219],[null,null,null,null,null,null],[21.056,21.395,21.023,20.822,20.781,20.792],[1.339,1.107,1.080,1.147,1.086,1.112],[null,null,null,null,null,null],[2.468,0.814,0.832,0.827,0.804,0.822],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.859,0.362,0.361,0.366,0.372,0.370],[null,null,null,null,null,null],[0.786,0.432,0.436,0.419,0.421,0.420],[34.088,34.112,34.506,34.169,34.250,34.536],[null,null,null,null,null,null],[0.027,0.021,0.022,0.031,0.020,0.020],[1.648,0.488,0.479,0.494,0.495,0.491],[0.053,0.069,0.045,0.065,0.045,0.055],[null,null,null,null,null,null],[4.782,4.611,4.586,4.692,4.651,4.581],[null,null,null,null,null,null],[1.880,1.743,1.743,1.748,1.694,1.722],[0.235,0.154,0.146,0.179,0.149,0.152],[0.992,0.891,0.891,0.879,0.876,0.892],[1.581,1.478,1.461,1.486,1.485,1.431],[null,null,null,null,null,null],[6.274,5.968,6.061,6.060,6.146,6.055],[2.932,2.843,2.839,2.859,2.848,2.826],[2.944,2.878,2.842,2.927,2.788,2.806],[0.257,0.149,0.149,0.161,0.150,0.149],[0.806,0.775,0.683,0.769,0.762,0.703],[null,null,null,null,null,null],[2.672,2.605,2.575,2.624,2.593,2.606],[null,null,null,null,null,null],[36.561,36.605,36.550,36.304,36.859,36.207],[0.310,0.224,0.217,0.217,0.218,0.214],[4.945,4.771,4.807,4.848,4.775,4.818],[null,null,null,null,null,null],[0.698,0.630,0.638,0.652,0.641,0.650],[1.067,1.009,0.991,1.024,1.017,0.977],[1.108,1.130,1.127,1.071,1.111,1.100],[1.021,0.922,1.060,0.995,0.920,0.958],[1.059,1.093,1.111,1.035,1.188,1.035],[19.852,19.960,19.647,19.824,20.018,20.149],[6.108,5.978,6.027,6.060,6.055,6.090],[1.602,1.580,1.588,1.592,1.574,1.639],[null,null,null,null,null,null],[33.519,33.277,33.124,33.214,33.309,33.546],[32.804,32.703,32.350,32.405,32.686,32.251],[34.993,34.617,34.896,34.568,34.950,34.860],[4.136,4.205,4.181,4.232,4.143,4.203],[2.553,2.539,2.513,2.590,2.423,2.504],[4.684,4.597,4.465,4.616,4.604,4.589],[10.699,10.419,10.435,10.381,10.480,10.425],[10.832,10.593,10.578,10.580,10.534,10.572],[10.826,10.684,10.569,10.569,10.659,10.650],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[36.222,35.658,35.827,35.620,35.974,35.868],[40.617,40.599,40.781,40.772,40.764,40.721],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.988,3.872,3.885,3.904,3.904,3.880],[4.529,4.462,4.441,4.494,4.427,4.508],[0.253,0.235,0.244,0.242,0.243,0.235],[0.256,0.235,0.236,0.234,0.235,0.239],[3.395,3.339,3.298,3.349,3.270,3.301],[null,null,null,null,null,null],[4.442,4.213,4.272,4.191,4.159,4.171],[4.760,4.623,4.564,4.569,4.569,4.595],[4.447,4.178,4.134,4.130,4.152,4.207],[3.533,3.263,3.273,3.374,3.351,3.344],[4.368,4.379,4.339,4.335,4.409,4.330],[4.384,4.388,4.334,4.338,4.271,4.363],[4.415,4.331,4.475,4.351,4.362,4.379],[3.006,2.738,2.698,2.733,2.705,2.756],[2.487,2.226,2.198,2.339,2.269,2.215],[3.919,3.689,3.703,3.634,3.728,3.596],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.896,5.585,5.666,5.546,5.593,5.623],[0.132,0.106,0.112,0.113,0.103,0.107],[5.249,4.929,4.866,4.864,4.955,4.854],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.488,0.513,0.490,0.502,0.506,0.497],[0.507,0.499,0.503,0.493,0.494,0.508],[0.498,0.488,0.486,0.497,0.484,0.487],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.968,3.940,3.943,3.937,3.964,3.953],[3.959,3.943,3.974,3.955,3.941,3.947],[3.861,3.838,3.855,3.860,3.857,3.856],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.458,1.363,1.386,1.369,1.336,1.375],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.1.4.30","source":"results/22.1.4.30.json"} +,{"actual_version":"22.2.3.1","data_size":{"coffeeshop":44756237054,"hits":14326545626,"job":1830194210,"mgbench":2958328502,"ontime":2704903445,"ssb":72904241992,"taxi":24216742334,"tpcds":18810339888,"tpch":17374020860,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":842,"hits":223,"job":28,"mgbench":64,"ontime":57,"ssb":1456,"taxi":902,"tpcds":312,"tpch":258,"uk":37},"machine":"c7a.4xlarge","release_date":"2022-02-25","result":[[0.080,0.013,0.011,0.260,0.011,0.012],[0.069,0.024,0.024,0.024,0.023,0.022],[0.055,0.014,0.015,0.044,0.012,0.013],[0.074,0.045,0.031,0.055,0.034,0.027],[0.050,0.025,0.027,0.036,0.026,0.024],[0.087,0.034,0.027,0.031,0.035,0.043],[0.033,0.015,0.012,0.009,0.011,0.009],[0.070,0.032,0.032,0.037,0.033,0.031],[0.079,0.043,0.048,0.058,0.048,0.046],[0.164,0.094,0.091,0.089,0.088,0.091],[0.589,0.538,0.443,0.517,0.517,0.510],[0.427,0.329,0.335,0.340,0.329,0.337],[0.046,0.016,0.014,0.019,0.024,0.019],[0.092,0.059,0.024,0.030,0.025,0.025],[0.947,0.905,0.916,0.908,0.867,0.854],[0.180,0.110,0.109,0.109,0.109,0.106],[0.045,0.028,0.025,0.020,0.024,0.022],[0.189,0.157,0.158,0.158,0.158,0.157],[6.389,1.470,1.482,1.476,1.466,1.479],[4.711,1.042,1.038,1.039,1.050,1.064],[4.725,1.096,1.072,1.100,1.087,1.088],[5.377,1.911,1.881,1.900,1.879,1.899],[6.208,1.740,1.778,1.763,1.768,1.773],[3.986,1.026,1.039,1.019,1.047,1.050],[0.056,0.036,0.035,0.035,0.037,0.038],[7.675,2.143,2.146,2.159,2.125,2.139],[2.296,1.052,1.059,1.057,1.082,1.052],[1.897,0.576,0.595,0.591,0.592,0.586],[0.012,0.002,0.002,0.002,0.002,0.002],[0.046,0.019,0.018,0.017,0.018,0.015],[0.057,0.025,0.028,0.036,0.025,0.027],[0.064,0.029,0.032,0.027,0.035,0.028],[0.160,0.130,0.082,0.128,0.120,0.131],[0.252,0.197,0.205,0.207,0.195,0.210],[0.011,0.003,0.004,0.014,0.002,0.002],[0.031,0.015,0.014,0.013,0.013,0.013],[0.312,0.272,0.282,0.290,0.286,0.278],[0.358,0.307,0.311,0.310,0.307,0.316],[0.143,0.265,0.122,0.109,0.106,0.108],[0.180,0.116,0.116,0.118,0.113,0.121],[0.473,0.347,0.357,0.354,0.369,0.376],[0.572,0.454,0.458,0.490,0.516,0.491],[0.551,0.425,0.426,0.427,0.450,0.471],[0.455,0.386,0.373,0.385,0.381,0.408],[1.352,1.157,1.165,1.185,1.192,1.232],[0.846,0.781,0.794,0.862,0.779,0.759],[3.072,3.061,2.784,2.733,2.721,2.818],[0.146,0.052,0.072,0.053,0.032,0.041],[1.548,0.421,0.418,0.422,0.421,0.419],[1.766,0.405,0.407,0.416,0.418,0.412],[4.069,1.176,1.183,1.206,1.182,1.165],[3.205,0.566,0.563,0.567,0.563,0.580],[0.176,0.113,0.119,0.112,0.119,0.115],[0.170,0.095,0.092,0.102,0.092,0.097],[0.170,0.112,0.113,0.112,0.112,0.112],[1.421,0.506,0.503,0.498,0.488,0.500],[1.091,0.643,0.633,0.649,0.646,0.644],[1.074,1.045,1.043,1.180,1.037,1.032],[0.345,0.292,0.291,0.278,0.268,0.260],[0.521,0.407,0.425,0.407,0.417,0.418],[2.674,null,null,null,null,null],[2.293,1.855,1.844,1.796,1.829,1.842],[2.307,1.834,1.845,1.824,1.835,1.847],[0.931,0.743,0.766,0.720,0.761,0.742],[0.154,0.074,0.079,0.093,0.071,0.086],[0.064,0.033,0.049,0.039,0.039,0.056],[0.096,0.038,0.030,0.034,0.029,0.032],[0.259,0.221,0.194,0.165,0.187,0.191],[0.045,0.010,0.010,0.013,0.010,0.010],[0.035,0.013,0.009,0.019,0.010,0.014],[0.016,0.004,0.004,0.004,0.003,0.004],[0.120,0.096,0.073,0.081,0.074,0.072],[0.160,0.099,0.094,0.094,0.098,0.098],[0.106,0.060,0.048,0.055,0.047,0.044],[0.103,0.066,0.063,0.073,0.063,0.064],[0.064,0.044,0.036,0.037,0.037,0.037],[0.105,0.067,0.060,0.062,0.061,0.063],[0.120,0.087,0.091,0.086,0.086,0.086],[0.051,0.039,0.037,0.034,0.037,0.035],[0.104,0.061,0.062,0.084,0.064,0.062],[0.196,0.158,0.162,0.156,0.156,0.157],[0.336,0.220,0.215,0.220,0.214,0.214],[0.467,0.402,0.389,0.386,0.400,0.399],[0.109,0.093,0.103,0.088,0.077,0.078],[0.478,0.348,0.351,0.347,0.352,0.347],[2.483,2.357,2.312,2.294,2.295,2.301],[8.667,1.183,1.169,1.189,1.158,1.178],[1.774,1.098,1.116,1.115,1.105,1.116],[12.826,3.789,3.779,3.773,3.809,3.790],[4.318,3.318,3.313,3.304,3.394,3.323],[4.102,1.817,1.825,1.814,1.824,1.816],[4.387,4.303,4.258,4.294,4.277,4.299],[null,null,null,null,null,null],[3.440,3.312,3.289,3.304,3.297,3.314],[null,null,null,null,null,null],[5.277,5.169,5.139,5.169,5.179,5.162],[null,null,null,null,null,null],[3.283,3.172,3.151,3.190,3.179,3.187],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.730,0.774,0.759,0.576,0.554,0.556],[null,null,null,null,null,null],[13.711,13.654,13.948,13.733,13.713,13.828],[null,null,null,null,null,null],[23.174,22.998,22.842,23.367,23.201,22.876],[0.192,0.104,0.094,0.094,0.097,0.100],[34.369,34.558,33.807,33.921,33.856,34.137],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.798,7.744,7.769,7.754,7.783,7.708],[0.567,0.469,0.460,0.445,0.457,0.470],[0.674,0.530,0.546,0.530,0.525,0.530],[7.321,7.241,7.047,7.180,7.158,7.215],[1.076,0.903,0.906,0.929,0.894,0.879],[0.298,0.195,0.202,0.213,0.238,0.205],[0.465,0.378,0.374,0.369,0.379,0.385],[null,null,null,null,null,null],[27.886,28.171,28.142,28.061,28.459,28.390],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.585,1.454,1.243,1.255,1.251,1.221],[3.705,3.572,3.599,3.511,3.555,3.483],[89.030,88.905,88.987,90.567,90.675,89.804],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.341,0.685,0.663,0.649,0.588,0.575],[1.167,1.022,1.017,1.005,1.023,1.012],[1.054,0.986,1.002,0.975,0.949,0.956],[null,null,null,null,null,null],[47.308,47.371,47.701,48.012,47.483,47.611],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.870,0.788,0.827,0.811,0.804,0.780],[null,null,null,null,null,null],[13.027,12.673,12.878,12.588,12.588,12.649],[null,null,null,null,null,null],[2.901,2.716,2.834,2.683,2.728,2.783],[null,null,null,null,null,null],[0.245,0.183,0.178,0.197,0.180,0.176],[0.279,0.204,0.204,0.203,0.214,0.200],[6.667,6.379,6.303,6.291,6.349,6.305],[12.764,12.889,12.860,12.957,12.972,13.069],[5.780,5.392,5.364,5.407,5.398,5.363],[5.498,5.328,5.292,5.302,5.267,5.327],[12.830,12.550,12.546,12.590,12.574,12.755],[0.419,0.329,0.317,0.319,0.328,0.320],[null,null,null,null,null,null],[1.066,0.957,0.976,0.945,0.941,0.933],[12.702,12.585,12.672,12.632,12.590,12.631],[null,null,null,null,null,null],[1.582,1.429,1.412,1.398,1.381,1.377],[null,null,null,null,null,null],[0.940,0.432,0.427,0.449,0.430,0.442],[0.813,0.532,0.529,0.526,0.532,0.540],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.119,1.037,1.102,1.057,1.071,1.053],[6.236,6.187,6.178,6.162,6.147,6.048],[0.500,0.466,0.456,0.445,0.471,0.463],[0.533,0.453,0.459,0.451,0.462,0.465],[1.405,1.334,1.326,1.324,1.351,1.326],[null,null,null,null,null,null],[2.163,2.112,2.124,2.165,2.135,2.138],[6.333,6.334,6.310,6.363,6.365,6.397],[0.072,0.059,0.045,0.053,0.051,0.052],[0.618,0.525,0.554,0.567,0.563,0.530],[1.872,0.942,0.915,0.940,0.915,0.912],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.317,4.121,4.180,4.214,4.113,4.103],[6.575,6.519,6.455,6.495,6.481,6.474],[2.173,2.133,2.067,2.141,2.187,2.126],[2.204,2.067,2.058,2.151,2.151,2.098],[7.778,7.533,7.663,7.618,7.595,7.715],[2.087,2.063,2.132,2.149,2.139,2.146],[0.955,0.493,0.486,0.526,0.528,0.551],[null,null,null,null,null,null],[0.822,0.660,0.642,0.652,0.644,0.660],[2.196,2.061,2.038,2.055,2.043,2.016],[0.989,0.522,0.545,0.569,0.556,0.515],[1.574,1.439,1.377,1.368,1.363,1.374],[0.434,0.382,0.382,0.385,0.375,0.387],[2.218,2.107,2.081,2.103,2.114,2.147],[null,null,null,null,null,null],[20.829,20.664,20.583,20.682,20.909,20.810],[1.305,1.131,1.108,1.154,1.106,1.114],[null,null,null,null,null,null],[2.466,0.827,0.828,0.814,0.821,0.800],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.860,0.367,0.365,0.361,0.370,0.365],[null,null,null,null,null,null],[0.770,0.447,0.434,0.424,0.452,0.448],[34.152,34.235,34.364,34.061,34.495,34.401],[null,null,null,null,null,null],[0.040,0.034,0.035,0.043,0.034,0.038],[1.660,0.578,0.520,0.506,0.494,0.492],[0.075,0.083,0.065,0.072,0.062,0.064],[null,null,null,null,null,null],[4.766,4.605,4.620,4.559,4.710,4.547],[null,null,null,null,null,null],[1.796,1.724,1.735,1.682,1.675,1.677],[0.241,0.186,0.175,0.188,0.173,0.173],[0.979,0.903,0.900,0.914,0.908,0.925],[1.590,1.456,1.447,1.515,1.459,1.453],[null,null,null,null,null,null],[6.311,6.083,5.983,6.187,6.139,6.164],[2.906,2.866,2.861,2.832,2.869,2.834],[2.911,2.876,2.772,2.826,2.828,2.841],[0.261,0.159,0.149,0.156,0.150,0.159],[0.848,0.750,0.748,0.740,0.668,0.737],[null,null,null,null,null,null],[2.783,2.636,2.638,2.613,2.629,2.592],[null,null,null,null,null,null],[36.410,36.766,36.703,36.609,36.364,36.630],[0.319,0.215,0.220,0.217,0.226,0.221],[4.910,4.796,4.784,4.813,4.785,4.810],[null,null,null,null,null,null],[0.710,0.649,0.644,0.637,0.665,0.646],[1.062,0.990,1.042,1.023,1.004,0.961],[1.135,1.103,1.103,1.109,1.086,1.092],[1.036,1.031,0.935,1.016,1.005,0.970],[1.104,1.108,1.091,1.078,1.070,1.061],[20.326,20.198,20.451,20.177,20.175,20.207],[6.185,6.202,6.084,6.185,6.154,6.089],[1.613,1.557,1.576,1.535,1.571,1.556],[null,null,null,null,null,null],[33.754,33.318,33.308,33.313,33.376,33.498],[32.979,32.586,32.494,32.590,32.582,32.816],[35.460,34.773,34.730,34.881,35.088,34.963],[4.251,4.193,4.330,4.284,4.262,4.274],[2.676,2.474,2.606,2.589,2.641,2.587],[4.628,4.641,4.622,4.622,4.517,4.678],[10.700,10.487,10.512,10.371,10.498,10.408],[10.898,10.669,10.566,10.603,10.641,10.692],[10.842,10.651,10.606,10.705,10.665,10.665],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[35.120,35.094,35.011,34.817,34.852,34.765],[39.491,39.659,39.620,39.586,39.746,39.969],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.944,3.883,3.828,3.934,3.956,3.823],[4.552,4.490,4.463,4.435,4.360,4.392],[0.275,0.268,0.267,0.279,0.273,0.276],[0.280,0.264,0.268,0.284,0.264,0.262],[3.416,3.352,3.322,3.299,3.317,3.302],[null,null,null,null,null,null],[4.470,4.164,4.189,4.161,4.261,4.169],[4.780,4.528,4.493,4.562,4.502,4.514],[4.470,4.173,4.245,4.281,4.137,4.186],[3.587,3.303,3.271,3.320,3.316,3.371],[4.392,4.352,4.396,4.370,4.365,4.362],[4.449,4.340,4.357,4.344,4.392,4.400],[4.522,4.320,4.347,4.337,4.270,4.366],[2.957,2.708,2.702,2.761,2.728,2.558],[2.549,2.219,2.239,2.221,2.209,2.215],[3.935,3.681,3.673,3.677,3.629,3.735],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.840,5.735,5.628,5.622,5.628,5.662],[0.129,0.119,0.118,0.118,0.116,0.131],[5.155,4.884,4.975,4.909,4.838,4.909],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.565,0.555,0.559,0.562,0.568,0.552],[0.582,0.560,0.569,0.564,0.567,0.551],[0.558,0.552,0.550,0.558,0.550,0.550],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.459,4.469,4.441,4.475,4.448,4.456],[4.465,4.460,4.457,4.453,4.428,4.419],[4.313,4.357,4.341,4.318,4.333,4.345],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.436,1.393,1.379,1.377,1.399,1.347],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.2.3.5","source":"results/22.2.3.5.json"} +,{"actual_version":"22.4.6.53","data_size":{"coffeeshop":44766373064,"hits":14383334352,"job":1830189202,"mgbench":2958585794,"ontime":2704903445,"ssb":72902275689,"taxi":24216917293,"tpcds":18818368331,"tpch":17375699255,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":818,"hits":237,"job":27,"mgbench":78,"ontime":68,"ssb":1488,"taxi":698,"tpcds":307,"tpch":269,"uk":40},"machine":"c7a.4xlarge","release_date":"2022-07-07","result":[[0.083,0.010,0.008,0.292,0.009,0.009],[0.084,0.030,0.029,0.028,0.028,0.027],[0.058,0.009,0.011,0.038,0.012,0.010],[0.059,0.012,0.012,0.012,0.011,0.011],[0.078,0.032,0.030,0.040,0.031,0.029],[0.096,0.021,0.022,0.032,0.021,0.021],[0.033,0.007,0.007,0.008,0.007,0.007],[0.064,0.026,0.026,0.024,0.024,0.024],[0.121,0.059,0.060,0.083,0.059,0.057],[0.153,0.091,0.087,0.091,0.084,0.086],[0.751,0.606,0.597,0.587,0.580,0.596],[0.796,0.606,0.594,0.576,0.540,0.541],[0.035,0.023,0.018,0.008,0.013,0.008],[0.066,0.015,0.014,0.012,0.045,0.017],[2.081,1.694,1.665,1.638,1.583,1.632],[0.983,0.154,0.151,0.151,0.155,0.153],[0.062,0.023,0.021,0.021,0.021,0.022],[0.541,0.255,0.258,0.255,0.255,0.250],[6.748,2.330,2.363,2.364,2.396,2.441],[4.818,1.795,1.726,1.699,1.711,1.726],[5.120,1.866,1.791,1.790,1.799,1.804],[6.758,3.157,3.178,3.194,3.283,3.278],[6.898,2.749,2.756,2.759,2.832,2.857],[4.592,1.804,1.768,1.714,1.728,1.738],[0.095,0.042,0.038,0.036,0.041,0.036],[8.149,3.459,3.489,3.529,3.604,3.605],[4.007,1.757,1.755,1.659,1.690,1.692],[3.076,0.931,0.929,0.933,0.935,0.901],[0.012,0.004,0.002,0.002,0.002,0.002],[0.043,0.013,0.012,0.009,0.010,0.010],[0.097,0.032,0.030,0.042,0.029,0.030],[0.191,0.039,0.039,0.039,0.038,0.038],[0.233,0.090,0.089,0.090,0.090,0.088],[0.448,0.224,0.230,0.222,0.226,0.222],[0.012,0.002,0.001,0.014,0.002,0.002],[0.035,0.012,0.010,0.010,0.011,0.010],[0.629,0.442,0.438,0.438,0.447,0.455],[0.716,0.495,0.493,0.489,0.492,0.493],[0.282,0.122,0.118,0.117,0.119,0.116],[0.301,0.144,0.138,0.136,0.142,0.142],[0.819,0.541,0.523,0.497,0.497,0.500],[1.099,0.759,0.769,0.766,0.802,0.788],[1.072,0.739,0.754,0.759,0.765,0.757],[0.889,0.709,0.660,0.669,0.680,0.656],[2.573,2.310,2.255,2.214,2.222,2.247],[1.885,1.580,1.546,1.500,1.463,1.526],[4.862,4.462,4.450,4.394,4.465,4.500],[0.212,0.100,0.041,0.044,0.043,0.044],[2.295,0.793,0.783,0.739,0.727,0.710],[2.378,0.714,0.668,0.690,0.698,0.683],[4.703,1.878,1.861,1.869,1.853,1.832],[4.268,0.954,0.926,0.912,0.909,0.849],[0.678,0.170,0.170,0.169,0.169,0.170],[0.382,0.149,0.145,0.149,0.146,0.145],[0.682,0.172,0.171,0.170,0.169,0.174],[2.217,0.651,0.640,0.630,0.624,0.621],[2.302,1.032,1.059,1.057,1.054,1.015],[0.827,0.810,0.885,1.011,0.886,0.801],[0.855,0.450,0.483,0.442,0.445,0.434],[1.489,0.595,0.554,0.532,0.548,0.542],[4.322,3.865,3.708,3.772,3.839,3.790],[4.945,3.480,3.434,3.374,3.471,3.452],[4.888,3.459,3.396,3.438,3.507,3.443],[1.209,1.035,1.059,1.035,1.057,1.047],[0.120,0.060,0.080,0.056,0.055,0.055],[0.058,0.059,0.033,0.029,0.032,0.033],[0.073,0.043,0.027,0.029,0.032,0.023],[0.253,0.171,0.158,0.160,0.144,0.169],[0.047,0.016,0.012,0.015,0.013,0.011],[0.042,0.018,0.011,0.013,0.010,0.009],[0.016,0.016,0.016,0.015,0.007,0.005],[0.661,0.064,0.062,0.070,0.061,0.063],[0.777,0.084,0.083,0.081,0.083,0.082],[0.189,0.052,0.053,0.060,0.051,0.048],[0.385,0.099,0.100,0.109,0.097,0.098],[0.113,0.036,0.035,0.034,0.035,0.034],[0.265,0.080,0.081,0.081,0.079,0.079],[0.377,0.131,0.133,0.128,0.128,0.127],[0.067,0.037,0.036,0.036,0.035,0.038],[0.114,0.064,0.065,0.098,0.064,0.063],[0.405,0.225,0.222,0.218,0.222,0.215],[0.848,0.271,0.261,0.261,0.259,0.263],[0.862,0.585,0.581,0.588,0.587,0.584],[0.240,0.067,0.065,0.066,0.066,0.068],[1.247,0.536,0.533,0.543,0.529,0.527],[5.065,4.204,4.273,4.303,4.302,4.304],[8.695,2.290,2.268,2.297,2.293,2.391],[4.169,2.210,2.177,2.159,2.155,2.219],[13.396,7.109,7.248,7.301,7.294,7.296],[null,null,null,null,null,null],[6.285,4.062,3.919,4.084,3.909,3.852],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.604,2.439,2.457,1.508,1.504,1.760],[null,null,null,null,null,null],[22.614,23.163,23.755,23.668,18.971,14.802],[null,null,null,null,null,null],[27.921,27.815,27.803,27.628,27.777,27.964],[0.481,0.139,0.132,0.126,0.122,0.124],[59.092,62.214,54.164,57.902,56.464,68.934],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.860,8.385,8.365,8.541,8.358,8.298],[5.155,4.925,5.236,4.985,5.286,4.987],[2.093,0.845,0.828,0.858,0.832,0.852],[16.102,16.246,15.588,16.269,15.578,15.508],[1.125,1.120,1.065,1.059,1.058,1.057],[0.352,0.189,0.179,0.185,0.187,0.181],[1.091,0.996,1.003,1.012,1.015,1.002],[null,null,null,null,null,null],[35.148,33.232,32.884,32.835,33.315,33.585],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[34.346,39.329,37.027,37.345,39.103,39.303],[4.703,4.421,4.469,4.498,4.322,4.546],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.032,0.840,0.847,0.871,0.837,0.851],[25.021,24.470,24.640,24.745,24.581,25.007],[2.047,1.411,1.413,1.403,1.408,1.411],[null,null,null,null,null,null],[75.992,76.212,75.283,77.324,80.058,77.876],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.087,7.131,7.161,7.046,7.228,7.492],[null,null,null,null,null,null],[14.466,13.591,13.579,13.491,13.565,13.516],[null,null,null,null,null,null],[3.130,3.025,3.034,3.096,3.036,2.906],[null,null,null,null,null,null],[5.163,5.076,4.987,5.105,4.976,5.107],[1.983,1.869,1.958,1.915,2.001,1.977],[41.134,43.567,38.784,43.676,41.743,43.429],[67.634,72.939,74.644,77.617,73.594,74.168],[7.354,6.611,6.588,6.461,6.475,6.619],[7.356,6.475,6.574,6.542,6.524,6.466],[14.903,13.932,13.850,13.768,13.756,13.748],[1.251,0.452,0.438,0.439,0.461,0.449],[null,null,null,null,null,null],[2.194,1.372,1.360,1.376,1.377,1.365],[14.807,13.886,14.015,13.822,13.937,13.948],[null,null,null,null,null,null],[3.471,3.170,3.113,3.127,3.219,3.179],[null,null,null,null,null,null],[1.866,0.642,0.646,0.644,0.649,0.646],[2.596,3.165,3.050,2.615,2.615,3.095],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.170,1.113,1.087,1.095,1.100,1.085],[8.698,7.898,8.204,7.759,8.697,8.043],[10.294,10.364,10.246,10.363,10.274,10.300],[10.148,10.129,10.129,10.225,10.228,10.315],[7.597,5.512,7.763,7.604,7.775,7.695],[null,null,null,null,null,null],[2.325,2.270,2.318,2.318,2.328,2.275],[7.707,7.748,7.643,7.651,7.724,7.683],[0.061,0.100,0.041,0.037,0.048,0.040],[3.933,4.187,4.095,4.116,3.975,4.023],[3.514,3.723,4.094,4.246,3.463,3.680],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.755,8.611,9.146,8.717,9.184,9.314],[12.617,11.926,12.602,13.093,12.519,12.477],[2.337,2.407,2.321,2.270,2.274,2.389],[2.323,2.243,2.297,2.279,2.270,2.290],[8.884,8.670,8.739,8.588,8.732,8.642],[2.328,2.333,2.374,2.275,2.311,2.301],[1.880,0.654,0.650,0.628,0.629,0.628],[null,null,null,null,null,null],[23.943,18.952,21.505,24.091,23.086,23.538],[52.697,52.652,49.880,45.803,52.328,50.048],[1.844,0.767,0.753,0.733,0.768,0.761],[13.314,16.347,16.122,16.238,17.150,15.794],[3.870,3.838,3.886,3.969,4.004,3.844],[2.326,2.473,2.224,2.255,2.224,2.230],[null,null,null,null,null,null],[24.911,25.158,24.185,24.531,24.900,25.002],[41.212,46.031,45.138,42.971,38.231,45.287],[null,null,null,null,null,null],[3.004,1.325,1.256,1.310,1.271,1.302],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.663,0.840,0.926,0.935,0.981,0.833],[null,null,null,null,null,null],[1.627,0.852,0.779,0.809,0.844,0.810],[53.094,54.134,55.813,53.892,54.535,53.426],[null,null,null,null,null,null],[0.041,0.035,0.034,0.044,0.035,0.035],[2.381,0.741,0.731,0.728,0.735,0.724],[0.048,0.050,0.038,0.055,0.038,0.044],[null,null,null,null,null,null],[7.643,6.117,6.114,6.102,6.090,6.111],[null,null,null,null,null,null],[1.778,1.713,1.709,1.699,1.715,1.695],[2.391,2.411,1.757,2.426,1.759,2.394],[1.001,0.922,0.929,0.909,0.931,0.941],[2.368,2.144,2.283,2.236,2.217,2.221],[null,null,null,null,null,null],[8.050,7.442,7.852,8.030,7.443,7.427],[51.115,47.475,49.031,51.196,50.888,52.974],[3.165,3.075,3.468,3.126,3.050,3.029],[0.748,0.718,0.622,0.751,0.709,0.718],[1.091,0.988,0.995,0.937,0.914,0.829],[null,null,null,null,null,null],[4.336,3.816,3.808,3.851,3.868,3.829],[null,null,null,null,null,null],[84.420,84.238,84.529,84.089,85.000,83.437],[1.263,1.351,0.945,1.316,1.273,1.286],[8.211,10.015,8.356,6.850,7.517,8.369],[null,null,null,null,null,null],[7.556,7.616,7.681,7.747,7.309,7.351],[1.132,1.064,1.036,1.026,0.993,0.997],[1.146,1.096,1.108,1.180,1.113,1.119],[1.067,1.014,1.041,1.021,1.008,1.012],[1.205,1.164,1.197,1.127,1.096,1.085],[20.003,19.434,19.632,19.376,18.973,18.826],[6.114,6.178,5.993,6.050,6.056,6.096],[1.661,1.663,1.617,1.677,1.645,1.611],[null,null,null,null,null,null],[35.362,34.408,34.538,34.525,34.466,34.452],[35.474,33.022,33.374,33.529,33.151,33.389],[40.142,37.054,37.726,35.681,39.386,36.480],[4.525,4.434,4.518,4.504,4.560,4.493],[2.835,2.802,2.848,2.808,2.833,2.814],[4.985,4.912,5.017,4.936,4.939,5.063],[13.095,12.695,12.633,12.670,12.690,12.605],[13.159,12.832,12.784,12.857,12.841,12.839],[13.127,12.853,12.750,12.898,12.839,12.836],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[38.417,37.849,38.226,38.049,38.029,38.252],[42.859,41.910,42.497,42.757,43.264,43.836],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.052,5.845,5.855,5.808,5.849,5.855],[6.503,6.295,6.480,6.387,6.368,6.411],[0.049,0.041,0.046,0.041,0.041,0.055],[0.048,0.046,0.042,0.041,0.041,0.041],[3.526,3.339,3.303,3.536,3.270,3.281],[null,null,null,null,null,null],[4.674,4.361,4.366,4.389,4.360,4.247],[4.927,4.669,4.542,4.620,4.718,4.685],[4.881,4.296,4.232,4.264,4.242,4.197],[3.754,3.354,3.490,3.472,3.449,3.489],[4.549,4.538,4.458,4.495,4.585,4.508],[4.591,4.514,4.491,4.560,4.531,4.490],[4.619,4.446,4.442,4.560,4.477,4.447],[3.291,2.846,2.856,2.930,3.131,2.867],[2.701,2.303,2.328,2.368,2.272,2.364],[4.352,4.407,4.142,3.988,4.055,3.957],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.754,6.230,6.248,6.290,6.305,6.220],[0.056,0.044,0.033,0.034,0.033,0.034],[5.253,4.951,4.925,4.889,4.909,4.960],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.066,0.052,0.052,0.053,0.052,0.076],[0.061,0.052,0.052,0.054,0.052,0.052],[0.061,0.059,0.052,0.052,0.053,0.053],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.107,0.106,0.117,0.111,0.101,0.119],[0.105,0.099,0.105,0.103,0.098,0.101],[0.107,0.115,0.117,0.099,0.098,0.098],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.561,1.446,1.466,1.422,1.400,1.445],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.4.6.53","source":"results/22.4.6.53.json"} +,{"actual_version":"22.5.4.19","data_size":{"coffeeshop":44754190691,"hits":14327052343,"job":1830189202,"mgbench":2959106271,"ontime":2704903445,"ssb":72902224812,"taxi":24216953798,"tpcds":18810869444,"tpch":17375868258,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":823,"hits":240,"job":23,"mgbench":72,"ontime":68,"ssb":1506,"taxi":703,"tpcds":291,"tpch":285,"uk":35},"machine":"c7a.4xlarge","release_date":"2022-08-10","result":[[0.076,0.009,0.009,0.278,0.008,0.008],[0.081,0.029,0.028,0.027,0.027,0.027],[0.050,0.010,0.009,0.047,0.009,0.008],[0.059,0.013,0.013,0.014,0.012,0.011],[0.073,0.030,0.030,0.042,0.031,0.030],[0.096,0.022,0.023,0.031,0.022,0.021],[0.031,0.007,0.007,0.008,0.007,0.007],[0.066,0.027,0.025,0.025,0.025,0.025],[0.104,0.059,0.061,0.078,0.060,0.058],[0.151,0.097,0.089,0.091,0.090,0.091],[0.737,0.604,0.588,0.586,0.592,0.581],[0.800,0.642,0.626,0.621,0.591,0.587],[0.038,0.027,0.018,0.022,0.009,0.008],[0.109,0.033,0.028,0.040,0.012,0.033],[2.058,1.599,1.632,1.587,1.558,1.566],[0.987,0.145,0.147,0.149,0.143,0.144],[0.060,0.020,0.021,0.019,0.019,0.022],[0.549,0.247,0.248,0.253,0.258,0.256],[6.710,2.486,2.372,2.407,2.386,2.484],[4.859,1.705,1.725,1.729,1.761,1.804],[5.100,1.800,1.827,1.817,1.818,1.859],[6.776,3.299,3.305,3.159,3.165,3.201],[6.824,2.865,2.824,2.745,2.755,2.869],[4.495,1.702,1.703,1.740,1.746,1.743],[0.089,0.038,0.038,0.036,0.036,0.037],[8.131,3.609,3.612,3.481,3.479,3.605],[3.880,1.677,1.662,1.696,1.736,1.739],[2.926,0.901,0.891,0.894,0.901,0.892],[0.009,0.002,0.001,0.002,0.001,0.001],[0.029,0.011,0.011,0.009,0.010,0.009],[0.094,0.026,0.027,0.038,0.026,0.026],[0.213,0.037,0.037,0.037,0.036,0.037],[0.249,0.090,0.091,0.089,0.090,0.090],[0.486,0.238,0.238,0.239,0.231,0.231],[0.010,0.001,0.001,0.014,0.002,0.002],[0.026,0.010,0.010,0.010,0.010,0.010],[0.681,0.448,0.447,0.445,0.432,0.434],[0.777,0.489,0.497,0.508,0.509,0.505],[0.309,0.119,0.113,0.114,0.114,0.113],[0.332,0.143,0.142,0.141,0.143,0.144],[0.858,0.537,0.519,0.491,0.488,0.502],[1.237,0.776,0.804,0.761,0.769,0.797],[1.102,0.772,0.750,0.716,0.736,0.730],[0.920,0.744,0.700,0.686,0.706,0.688],[2.744,2.254,2.225,2.218,2.174,2.316],[1.986,1.533,1.525,1.503,1.513,1.494],[4.951,4.436,4.416,4.393,4.255,4.362],[0.240,0.065,0.059,0.050,0.041,0.040],[2.244,0.644,0.676,0.670,0.621,0.598],[2.657,0.657,0.675,0.696,0.684,0.678],[5.067,1.819,1.821,1.843,1.835,1.882],[3.947,0.782,0.757,0.743,0.718,0.719],[0.688,0.170,0.171,0.170,0.170,0.170],[0.406,0.154,0.149,0.150,0.149,0.153],[0.722,0.185,0.166,0.172,0.168,0.174],[2.308,0.646,0.641,0.656,0.648,0.645],[2.315,1.049,1.053,1.043,1.075,1.007],[0.842,0.828,0.816,0.948,0.812,0.829],[0.977,0.452,0.442,0.425,0.412,0.412],[1.610,0.577,0.567,0.572,0.563,0.594],[4.468,3.927,3.851,3.800,3.733,3.813],[5.011,3.536,3.505,3.389,3.556,3.516],[5.019,3.542,3.532,3.462,3.506,3.415],[1.112,1.014,0.994,0.999,1.010,1.011],[0.127,0.080,0.069,0.066,0.072,0.068],[0.057,0.032,0.039,0.033,0.029,0.026],[0.095,0.045,0.030,0.033,0.024,0.026],[0.294,0.191,0.208,0.162,0.172,0.180],[0.041,0.014,0.012,0.011,0.009,0.013],[0.036,0.013,0.016,0.011,0.016,0.009],[0.013,0.003,0.006,0.005,0.007,0.003],[0.660,0.064,0.069,0.074,0.061,0.060],[0.788,0.089,0.084,0.082,0.081,0.081],[0.191,0.055,0.051,0.063,0.050,0.051],[0.383,0.097,0.096,0.105,0.098,0.098],[0.108,0.035,0.035,0.035,0.035,0.034],[0.269,0.082,0.080,0.081,0.079,0.079],[0.379,0.126,0.127,0.126,0.126,0.127],[0.067,0.037,0.037,0.035,0.037,0.037],[0.115,0.069,0.066,0.098,0.066,0.063],[0.410,0.229,0.228,0.225,0.225,0.227],[0.846,0.263,0.259,0.262,0.261,0.261],[0.860,0.590,0.588,0.583,0.571,0.574],[0.241,0.068,0.067,0.065,0.065,0.065],[1.236,0.546,0.556,0.550,0.528,0.529],[5.190,4.310,4.293,4.265,4.102,4.075],[8.705,2.347,2.296,2.289,2.285,2.270],[4.063,2.239,2.140,2.170,2.180,2.174],[13.148,7.290,7.287,7.294,7.224,7.027],[75.204,77.147,79.089,77.988,77.087,75.072],[6.354,4.032,4.119,4.074,4.102,4.125],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.024,1.397,1.395,0.898,0.866,0.857],[null,null,null,null,null,null],[14.620,14.495,14.552,14.615,14.703,14.651],[null,null,null,null,null,null],[30.558,30.174,30.524,30.345,30.246,30.428],[0.475,0.149,0.126,0.118,0.124,0.129],[55.818,64.231,60.407,53.128,61.698,57.857],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.188,8.894,8.696,8.643,9.042,8.682],[7.812,8.044,8.196,8.473,8.001,8.479],[1.995,0.821,0.835,0.822,0.834,0.823],[16.167,16.077,15.973,15.653,15.953,15.787],[1.102,1.090,1.015,1.023,1.035,1.015],[0.374,0.180,0.183,0.194,0.174,0.183],[1.346,1.265,1.253,1.225,1.237,1.238],[null,null,null,null,null,null],[35.295,33.279,32.714,32.947,32.971,33.008],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[36.560,37.068,33.996,36.448,34.210,35.846],[4.384,4.301,4.492,4.409,4.439,4.495],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.031,0.828,0.846,0.855,0.822,0.837],[25.147,24.882,14.681,24.673,23.752,23.962],[2.049,1.434,1.430,1.418,1.418,1.430],[null,null,null,null,null,null],[77.369,76.382,78.127,76.625,77.466,77.326],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.069,8.902,8.637,8.590,8.578,8.179],[null,null,null,null,null,null],[14.986,13.897,14.078,13.913,13.915,14.040],[null,null,null,null,null,null],[3.182,3.009,3.008,3.082,3.236,3.130],[null,null,null,null,null,null],[5.270,5.217,5.133,5.139,5.230,5.170],[1.778,1.887,1.832,1.762,1.950,1.958],[38.093,41.043,39.992,41.494,40.756,37.619],[81.907,75.975,76.425,79.000,75.947,80.327],[7.419,6.501,6.315,6.377,6.449,6.445],[7.288,6.424,6.392,6.372,6.558,6.325],[15.061,14.014,13.908,13.808,13.908,13.911],[1.127,0.454,0.424,0.427,0.457,0.444],[null,null,null,null,null,null],[2.179,1.392,1.383,1.385,1.386,1.389],[14.755,13.777,13.885,13.594,13.720,14.026],[null,null,null,null,null,null],[3.252,2.845,2.828,2.935,2.948,3.059],[null,null,null,null,null,null],[1.698,0.644,0.650,0.644,0.647,0.638],[2.542,3.261,2.678,2.922,2.945,2.693],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.155,1.102,1.121,1.090,1.081,1.064],[8.192,7.848,8.522,8.519,7.774,8.226],[10.235,10.303,10.303,10.284,10.188,10.095],[10.239,10.220,10.081,10.225,10.210,10.190],[7.921,7.746,7.788,7.880,7.956,5.217],[null,null,null,null,null,null],[2.336,2.281,2.276,2.405,2.368,2.363],[7.554,7.730,7.615,7.753,7.625,7.543],[0.060,0.040,0.039,0.043,0.060,0.050],[4.090,3.994,3.752,4.070,4.033,4.000],[3.831,4.208,3.605,4.133,4.195,4.222],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.696,9.378,9.314,9.237,9.619,10.041],[12.415,11.190,11.772,11.671,11.824,11.930],[2.332,2.314,2.364,2.344,2.306,2.354],[2.348,2.228,2.205,2.331,2.224,2.286],[8.511,8.413,8.325,8.363,8.408,8.315],[2.363,2.317,2.333,2.260,2.279,2.213],[1.771,0.627,0.640,0.625,0.622,0.617],[null,null,null,null,null,null],[15.798,13.677,15.370,15.932,14.888,16.264],[42.749,43.451,40.585,43.156,43.802,45.640],[1.732,0.749,0.788,0.809,0.794,0.779],[16.620,13.754,17.245,17.016,16.108,16.350],[3.839,3.978,4.037,3.911,3.959,3.845],[2.354,2.248,2.291,2.324,2.260,2.332],[null,null,null,null,null,null],[25.357,25.618,25.552,33.632,25.376,25.206],[42.838,40.459,44.747,39.766,44.742,43.227],[null,null,null,null,null,null],[3.026,1.288,1.293,1.313,1.299,1.286],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.629,0.986,0.982,0.981,0.965,0.913],[null,null,null,null,null,null],[1.691,0.805,0.793,0.832,0.794,0.751],[52.412,52.735,52.909,52.931,53.224,52.050],[null,null,null,null,null,null],[0.044,0.036,0.036,0.048,0.038,0.043],[2.391,0.762,0.789,0.755,0.747,0.748],[0.045,0.050,0.041,0.051,0.051,0.041],[null,null,null,null,null,null],[7.666,6.130,6.171,6.168,6.103,6.118],[null,null,null,null,null,null],[1.782,1.738,1.710,1.716,1.710,1.741],[1.626,1.560,1.647,1.634,1.378,1.546],[0.984,0.908,0.887,0.881,0.874,0.898],[2.417,2.247,2.220,2.260,2.279,2.239],[null,null,null,null,null,null],[8.019,8.144,8.638,8.559,7.749,8.744],[39.722,42.434,43.655,42.246,41.340,42.864],[3.111,3.078,3.531,3.127,3.399,3.062],[0.576,0.424,0.473,0.538,0.483,0.548],[1.051,0.952,0.977,0.905,0.914,0.866],[null,null,null,null,null,null],[4.360,3.880,3.872,3.883,3.907,3.877],[null,null,null,null,null,null],[88.459,87.701,86.192,85.959,86.509,85.205],[1.026,0.798,0.977,0.739,0.952,0.759],[7.376,7.588,7.398,7.691,7.703,8.058],[null,null,null,null,null,null],[7.664,7.437,7.263,7.680,7.602,7.689],[1.130,1.045,0.992,1.016,0.996,0.949],[1.148,1.127,1.123,1.084,1.111,1.066],[1.049,1.030,1.015,0.986,0.970,1.016],[1.165,1.121,1.078,1.106,1.104,1.057],[18.393,19.662,18.417,19.652,18.180,18.060],[5.887,6.140,5.754,5.765,5.783,5.775],[1.676,1.571,1.550,1.556,1.596,1.567],[null,null,null,null,null,null],[34.205,33.991,33.983,34.325,34.049,33.838],[33.319,33.285,33.285,33.084,33.120,33.416],[36.170,35.501,35.448,35.625,34.995,35.597],[4.484,4.423,4.440,4.454,4.499,4.419],[2.872,2.861,2.942,2.815,2.942,2.801],[4.774,4.812,4.867,4.844,4.835,4.846],[12.891,12.630,12.498,13.157,12.600,12.586],[13.484,12.712,12.828,13.233,12.749,12.942],[13.457,12.777,13.010,13.157,12.813,13.053],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[36.862,36.690,36.323,36.603,37.471,37.720],[41.941,40.961,41.189,41.790,41.156,41.003],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.845,6.818,6.744,6.880,6.812,6.741],[7.337,7.286,7.218,7.391,7.259,7.238],[0.058,0.040,0.046,0.042,0.040,0.060],[0.067,0.042,0.041,0.044,0.040,0.041],[3.500,3.227,3.318,3.249,3.275,3.277],[null,null,null,null,null,null],[4.623,4.291,4.298,4.252,4.319,4.243],[4.903,4.577,4.568,4.503,4.597,4.613],[4.544,4.381,4.273,4.326,4.343,4.282],[3.742,3.426,3.365,3.402,3.435,3.353],[4.707,4.593,4.512,4.571,4.436,4.458],[4.617,4.478,4.516,4.476,4.537,4.348],[4.536,4.381,4.397,4.459,4.421,4.443],[3.204,2.836,2.822,3.005,2.853,2.901],[2.659,2.315,2.323,2.389,2.342,2.258],[4.342,3.981,3.906,3.939,4.008,4.062],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.568,6.115,6.119,6.207,6.369,6.183],[0.038,0.035,0.033,0.033,0.033,0.038],[5.172,4.847,4.858,4.876,4.937,4.919],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.060,0.055,0.058,0.066,0.055,0.057],[0.057,0.053,0.052,0.063,0.053,0.053],[0.059,0.054,0.063,0.054,0.054,0.064],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.118,0.102,0.117,0.107,0.103,0.107],[0.122,0.105,0.106,0.103,0.105,0.102],[0.107,0.102,0.103,0.105,0.102,0.103],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.528,1.410,1.486,1.574,1.521,1.526],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.5.4.19","source":"results/22.5.4.19.json"} +,{"actual_version":"22.6.9.11","data_size":{"coffeeshop":44769416402,"hits":14365103497,"job":1830189202,"mgbench":2959106271,"ontime":2704903445,"ssb":72905277922,"taxi":24216946285,"tpcds":18819366233,"tpch":17375145587,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":793,"hits":218,"job":30,"mgbench":70,"ontime":59,"ssb":1406,"taxi":526,"tpcds":270,"tpch":261,"uk":35},"machine":"c7a.4xlarge","release_date":"2022-10-06","result":[[0.083,0.009,0.008,0.318,0.008,0.008],[0.085,0.028,0.028,0.028,0.028,0.028],[0.060,0.010,0.010,0.043,0.009,0.010],[0.068,0.012,0.012,0.012,0.010,0.011],[0.079,0.033,0.031,0.040,0.029,0.027],[0.098,0.022,0.021,0.034,0.021,0.021],[0.035,0.007,0.007,0.006,0.007,0.006],[0.065,0.023,0.022,0.023,0.023,0.023],[0.108,0.060,0.055,0.078,0.057,0.056],[0.146,0.085,0.087,0.083,0.088,0.083],[0.701,0.574,0.571,0.517,0.572,0.569],[0.759,0.566,0.574,0.548,0.600,0.554],[0.038,0.007,0.007,0.014,0.013,0.018],[0.070,0.036,0.023,0.018,0.025,0.016],[1.673,1.298,1.337,1.297,1.237,1.255],[0.861,0.133,0.132,0.132,0.136,0.131],[0.066,0.024,0.020,0.018,0.018,0.018],[0.580,0.225,0.226,0.229,0.222,0.221],[6.389,2.407,2.368,2.385,2.369,2.377],[4.700,1.711,1.694,1.708,1.704,1.700],[4.718,1.803,1.810,1.801,1.797,1.811],[5.636,3.151,3.148,3.149,3.130,3.164],[6.195,2.729,2.721,2.719,2.746,2.730],[3.974,1.765,1.776,1.769,1.774,1.783],[0.090,0.039,0.037,0.039,0.038,0.037],[7.665,3.488,3.476,3.470,3.471,3.475],[3.310,1.668,1.669,1.683,1.677,1.669],[2.315,0.871,0.871,0.859,0.862,0.863],[0.013,0.001,0.003,0.002,0.001,0.001],[0.029,0.010,0.010,0.009,0.009,0.010],[0.090,0.027,0.026,0.038,0.026,0.026],[0.169,0.036,0.036,0.035,0.035,0.035],[0.211,0.087,0.089,0.085,0.087,0.087],[0.412,0.218,0.211,0.219,0.218,0.218],[0.011,0.002,0.001,0.016,0.002,0.001],[0.027,0.010,0.010,0.010,0.010,0.010],[0.591,0.422,0.422,0.415,0.415,0.416],[0.675,0.489,0.479,0.473,0.481,0.473],[0.242,0.111,0.110,0.111,0.108,0.108],[0.276,0.142,0.134,0.134,0.138,0.133],[0.749,0.526,0.494,0.493,0.476,0.482],[1.014,0.757,0.771,0.745,0.728,0.746],[0.979,0.721,0.708,0.708,0.746,0.706],[0.824,0.657,0.651,0.663,0.607,0.626],[2.438,2.110,2.063,2.185,2.124,2.081],[1.769,1.486,1.467,1.436,1.416,1.408],[4.553,4.262,4.158,4.234,4.207,4.239],[0.184,0.047,0.049,0.038,0.037,0.041],[1.705,0.660,0.657,0.653,0.660,0.652],[1.824,0.633,0.625,0.644,0.629,0.643],[4.069,1.812,1.781,1.803,1.777,1.771],[3.099,0.808,0.846,0.781,0.813,0.774],[0.499,0.167,0.171,0.163,0.164,0.164],[0.335,0.143,0.141,0.141,0.141,0.140],[0.501,0.169,0.171,0.166,0.164,0.166],[1.594,0.610,0.627,0.625,0.609,0.599],[1.755,0.972,0.964,0.961,0.985,0.988],[0.825,0.796,0.792,0.957,0.800,0.809],[0.788,0.441,0.444,0.405,0.384,0.383],[1.165,0.540,0.533,0.544,0.524,0.525],[4.017,3.579,3.577,3.502,3.500,3.599],[4.272,3.313,3.256,3.268,3.264,3.210],[4.255,3.285,3.351,3.328,3.332,3.324],[1.129,1.047,0.962,0.975,0.988,0.988],[0.139,0.075,0.066,0.074,0.060,0.063],[0.056,0.025,0.027,0.028,0.024,0.031],[0.080,0.036,0.030,0.024,0.021,0.021],[0.274,0.176,0.166,0.173,0.153,0.146],[0.048,0.017,0.010,0.012,0.010,0.011],[0.043,0.009,0.012,0.014,0.013,0.008],[0.021,0.006,0.019,0.005,0.009,0.004],[0.787,0.064,0.059,0.067,0.058,0.063],[0.935,0.081,0.079,0.083,0.082,0.079],[0.218,0.051,0.050,0.060,0.048,0.048],[0.507,0.097,0.096,0.104,0.096,0.100],[0.135,0.033,0.032,0.033,0.032,0.032],[0.282,0.077,0.075,0.075,0.075,0.075],[0.363,0.121,0.122,0.121,0.122,0.122],[0.072,0.034,0.033,0.034,0.033,0.033],[0.120,0.061,0.062,0.096,0.061,0.060],[0.413,0.216,0.217,0.217,0.214,0.213],[0.852,0.242,0.242,0.241,0.241,0.241],[0.817,0.553,0.553,0.556,0.557,0.567],[0.298,0.059,0.057,0.056,0.056,0.055],[1.321,0.519,0.516,0.516,0.498,0.494],[5.365,4.095,4.120,4.102,4.101,4.063],[8.694,2.062,2.094,2.117,2.106,2.127],[4.053,2.093,2.086,2.094,2.089,2.090],[12.818,6.806,6.774,6.786,6.841,6.795],[null,null,null,null,null,null],[5.149,3.857,3.790,3.753,3.829,3.997],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.772,2.158,2.213,1.554,1.525,1.428],[null,null,null,null,null,null],[22.927,22.775,22.654,19.373,14.317,14.770],[null,null,null,null,null,null],[29.989,30.039,29.809,29.676,29.994,30.019],[0.368,0.120,0.111,0.114,0.115,0.108],[67.049,55.881,62.308,64.582,54.381,56.641],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.785,8.347,8.373,8.327,8.349,8.511],[7.711,7.474,7.690,8.011,7.771,7.597],[1.889,0.786,0.796,0.800,0.788,0.783],[15.612,15.592,15.214,15.034,15.176,15.546],[1.034,0.973,0.977,1.011,1.028,0.981],[0.366,0.174,0.170,0.183,0.164,0.163],[1.083,1.011,0.999,1.015,1.017,1.022],[null,null,null,null,null,null],[33.641,32.366,32.802,32.179,32.597,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[27.631,27.622,27.693,27.488,27.833,24.609],[4.463,4.310,4.274,4.394,4.418,4.478],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.554,0.793,0.796,0.830,0.778,0.770],[23.380,23.837,23.239,23.050,23.214,23.115],[1.725,1.306,1.295,1.299,1.296,1.297],[null,null,null,null,null,null],[76.690,73.997,75.769,76.672,77.578,72.959],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.947,9.598,10.211,9.745,9.861,10.086],[null,null,null,null,null,null],[13.557,13.216,13.131,13.049,13.045,13.067],[null,null,null,null,null,null],[3.022,2.849,2.830,2.970,2.887,2.804],[null,null,null,null,null,null],[4.926,4.593,4.844,4.857,4.888,4.660],[2.011,1.958,2.048,2.007,2.104,2.018],[34.893,32.666,32.272,31.686,34.133,32.075],[61.709,60.714,63.237,53.765,59.857,57.807],[6.773,6.192,6.125,6.008,6.095,6.029],[6.670,6.246,6.071,5.988,5.981,6.072],[13.716,12.990,13.222,13.196,13.217,13.033],[0.889,0.409,0.416,0.394,0.413,0.408],[null,null,null,null,null,null],[1.730,1.257,1.250,1.263,1.245,1.249],[13.847,13.336,12.761,13.068,13.077,12.969],[null,null,null,null,null,null],[2.867,2.644,2.669,2.602,2.600,2.639],[null,null,null,null,null,null],[1.368,0.615,0.618,0.608,0.614,0.605],[2.046,2.611,2.513,2.049,1.816,2.596],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.073,1.025,1.002,0.984,0.990,0.980],[7.603,8.277,7.662,7.495,7.475,8.453],[9.428,9.536,9.644,9.570,9.560,9.593],[9.611,9.656,9.684,9.806,9.475,9.522],[7.169,5.279,7.326,5.181,7.245,7.315],[null,null,null,null,null,null],[2.237,2.196,2.250,2.229,2.280,2.216],[7.200,7.209,7.073,7.082,7.377,6.988],[0.078,0.054,0.046,0.056,0.060,0.039],[4.582,4.572,4.626,4.639,4.667,4.697],[3.236,2.924,2.327,3.501,3.386,2.893],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.358,9.155,8.972,9.458,9.168,9.261],[11.703,10.544,10.696,10.294,10.261,10.111],[2.272,2.219,2.197,2.215,2.252,2.154],[2.496,2.344,2.414,2.386,2.382,2.579],[8.542,8.287,8.301,8.271,8.221,8.328],[2.225,2.230,2.245,2.273,2.198,2.237],[1.333,0.610,0.616,0.600,0.595,0.607],[null,null,null,null,null,null],[22.566,17.563,18.099,21.516,22.374,20.253],[37.927,24.056,32.166,32.095,35.147,37.419],[1.382,0.717,0.724,0.718,0.692,0.688],[14.550,14.717,12.244,13.252,14.648,15.358],[3.185,3.194,3.024,3.291,3.342,3.183],[2.429,2.605,2.366,2.375,2.373,2.354],[null,null,null,null,null,null],[24.067,23.136,23.527,23.991,26.403,23.930],[39.566,39.522,39.753,45.493,39.673,44.187],[null,null,null,null,null,null],[2.486,1.232,1.247,1.224,1.212,1.183],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.282,0.736,0.744,0.753,0.759,0.836],[null,null,null,null,null,null],[1.310,0.761,0.731,0.746,0.744,0.735],[52.195,52.121,52.017,54.707,52.952,55.038],[null,null,null,null,null,null],[0.041,0.035,0.042,0.046,0.042,0.035],[1.790,0.757,0.743,0.732,0.732,0.724],[0.051,0.052,0.038,0.061,0.038,0.038],[null,null,null,null,null,null],[6.921,5.876,5.950,5.914,5.929,5.890],[null,null,null,null,null,null],[1.716,1.667,1.661,1.642,1.657,1.647],[2.073,2.311,1.884,2.310,2.296,1.889],[0.990,0.919,0.894,0.896,0.884,0.885],[2.188,2.039,2.079,2.240,2.095,2.025],[null,null,null,null,null,null],[7.194,7.166,7.156,7.957,7.149,7.730],[41.533,35.550,41.224,39.876,37.679,37.489],[3.132,2.974,3.015,2.936,2.999,3.038],[0.515,0.481,0.534,0.513,0.521,0.404],[1.059,1.049,1.082,0.974,0.933,0.940],[null,null,null,null,null,null],[3.946,3.607,3.571,3.648,3.595,3.607],[null,null,null,null,null,null],[79.915,79.246,79.487,79.451,78.642,79.076],[0.949,0.913,0.940,0.927,0.941,0.931],[7.804,7.388,8.996,6.535,7.075,7.353],[null,null,null,null,null,null],[6.813,6.797,6.907,6.979,6.810,6.671],[1.080,0.955,0.991,0.965,0.928,0.968],[1.150,1.058,1.064,1.071,1.053,1.168],[1.010,0.940,0.952,0.952,0.910,0.976],[1.198,1.112,1.075,1.074,0.967,1.097],[17.651,17.375,17.447,17.399,17.235,17.419],[5.438,5.332,5.365,5.287,7.037,5.266],[1.627,1.505,1.542,1.537,1.494,1.521],[null,null,null,null,null,null],[35.752,32.642,32.066,32.374,32.991,33.196],[32.013,32.065,32.065,32.065,31.885,31.987],[34.826,34.527,34.865,34.203,34.230,34.446],[4.130,4.082,4.010,4.168,4.169,4.186],[2.780,2.673,2.634,2.640,2.678,2.665],[4.683,4.520,4.507,4.502,4.381,4.471],[11.854,11.498,11.528,11.443,11.500,11.520],[11.746,11.441,11.470,11.448,13.398,11.592],[11.879,11.729,11.831,11.651,11.738,11.670],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[32.816,33.030,32.585,33.299,33.232,32.868],[37.652,37.144,37.710,42.957,37.566,37.505],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.229,6.016,6.227,6.080,6.043,6.067],[6.716,6.689,6.519,6.653,6.660,6.584],[0.046,0.039,0.042,0.044,0.041,0.040],[0.046,0.042,0.067,0.040,0.041,0.042],[3.267,3.162,3.171,3.177,3.141,3.036],[null,null,null,null,null,null],[4.406,4.135,4.066,4.172,4.115,4.105],[4.767,4.428,4.383,4.400,4.438,4.427],[4.338,4.041,4.083,4.103,4.063,4.157],[3.588,3.285,3.318,3.287,3.255,3.231],[4.479,4.390,4.311,4.343,4.390,4.325],[4.470,4.506,4.453,4.342,4.352,4.403],[4.447,4.363,4.404,4.253,4.273,4.260],[3.049,2.772,2.797,2.782,2.907,2.715],[2.466,2.240,2.251,2.234,2.216,2.239],[4.181,3.916,3.741,4.210,3.828,3.815],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.224,5.946,5.945,5.999,5.969,5.987],[0.042,0.032,0.033,0.032,0.033,0.033],[5.030,4.887,4.745,5.077,4.745,4.759],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.061,0.053,0.058,0.054,0.055,0.057],[0.066,0.068,0.053,0.055,0.055,0.057],[0.067,0.054,0.059,0.054,0.054,0.066],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.126,0.120,0.113,0.111,0.123,0.104],[0.109,0.104,0.103,0.103,0.103,0.103],[0.110,0.103,0.103,0.102,0.102,0.102],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.487,1.384,1.386,1.422,1.379,1.407],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.6.9.11","source":"results/22.6.9.11.json"} +,{"actual_version":"22.7.7.24","data_size":{"coffeeshop":44765985662,"hits":14351425599,"job":1830189202,"mgbench":2958328502,"ontime":2704903445,"ssb":72905859097,"taxi":24217170715,"tpcds":18793431006,"tpch":17375464929,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":767,"hits":207,"job":25,"mgbench":65,"ontime":58,"ssb":1361,"taxi":479,"tpcds":274,"tpch":264,"uk":34},"machine":"c7a.4xlarge","release_date":"2022-10-26","result":[[0.068,0.011,0.008,0.246,0.008,0.008],[0.075,0.026,0.026,0.026,0.026,0.026],[0.045,0.016,0.009,0.034,0.012,0.009],[0.053,0.012,0.012,0.011,0.011,0.011],[0.070,0.030,0.028,0.038,0.028,0.028],[0.088,0.022,0.021,0.031,0.021,0.020],[0.029,0.007,0.007,0.007,0.007,0.007],[0.062,0.025,0.023,0.023,0.022,0.023],[0.095,0.055,0.050,0.066,0.052,0.052],[0.126,0.081,0.078,0.081,0.081,0.077],[0.641,0.524,0.546,0.546,0.543,0.513],[0.671,0.509,0.535,0.493,0.474,0.482],[0.038,0.008,0.008,0.008,0.012,0.008],[0.085,0.011,0.034,0.011,0.035,0.015],[1.477,1.272,1.249,1.239,1.190,1.190],[0.713,0.134,0.127,0.125,0.126,0.129],[0.080,0.019,0.018,0.019,0.020,0.019],[0.462,0.212,0.211,0.210,0.212,0.219],[6.395,2.231,2.220,2.229,2.226,2.212],[4.692,1.618,1.618,1.617,1.615,1.640],[4.719,1.700,1.702,1.698,1.703,1.704],[5.367,2.953,2.944,2.931,2.950,2.946],[6.196,2.541,2.551,2.555,2.524,2.547],[3.963,1.643,1.650,1.646,1.645,1.646],[0.073,0.033,0.034,0.034,0.033,0.033],[7.672,3.246,3.249,3.252,3.243,3.249],[2.767,1.566,1.569,1.564,1.566,1.561],[2.025,0.807,0.809,0.805,0.808,0.797],[0.007,0.001,0.001,0.002,0.002,0.001],[0.024,0.009,0.011,0.009,0.008,0.008],[0.082,0.024,0.025,0.037,0.025,0.025],[0.169,0.034,0.034,0.034,0.034,0.036],[0.200,0.082,0.082,0.082,0.080,0.081],[0.390,0.206,0.205,0.207,0.206,0.206],[0.007,0.002,0.002,0.015,0.001,0.002],[0.022,0.009,0.010,0.009,0.009,0.009],[0.513,0.407,0.413,0.401,0.400,0.399],[0.581,0.462,0.465,0.460,0.458,0.462],[0.226,0.103,0.103,0.104,0.102,0.103],[0.245,0.128,0.127,0.128,0.127,0.127],[0.683,0.483,0.454,0.467,0.464,0.454],[0.915,0.724,0.713,0.721,0.721,0.716],[0.869,0.665,0.680,0.670,0.668,0.672],[0.673,0.570,0.546,0.536,0.560,0.563],[2.202,1.975,1.984,2.022,1.955,1.980],[1.565,1.379,1.356,1.407,1.425,1.340],[4.056,3.995,3.861,3.827,3.839,3.872],[0.193,0.100,0.041,0.037,0.036,0.035],[1.777,0.694,0.682,0.696,0.670,0.672],[1.795,0.613,0.609,0.617,0.642,0.607],[4.045,1.739,1.694,1.716,1.690,1.707],[2.893,0.790,0.794,0.781,0.781,0.781],[0.474,0.159,0.157,0.157,0.156,0.157],[0.330,0.133,0.133,0.131,0.128,0.129],[0.461,0.156,0.159,0.158,0.156,0.157],[1.661,0.582,0.569,0.577,0.569,0.570],[1.581,0.955,0.950,0.946,0.953,0.949],[0.815,0.789,0.803,0.957,0.795,0.784],[0.677,0.404,0.389,0.363,0.348,0.350],[0.938,0.486,0.467,0.481,0.464,0.453],[3.351,3.195,3.050,3.176,3.185,3.428],[3.823,3.301,3.264,3.240,3.281,3.277],[3.848,3.248,3.226,3.315,3.258,3.156],[1.082,0.977,0.984,0.988,0.968,0.943],[0.105,0.056,0.055,0.050,0.052,0.059],[0.061,0.028,0.020,0.022,0.021,0.028],[0.060,0.028,0.021,0.020,0.019,0.021],[0.154,0.119,0.102,0.103,0.110,0.117],[0.040,0.013,0.017,0.010,0.008,0.008],[0.033,0.015,0.012,0.007,0.008,0.010],[0.016,0.006,0.005,0.005,0.008,0.004],[0.609,0.063,0.062,0.065,0.057,0.058],[0.729,0.081,0.076,0.077,0.076,0.080],[0.180,0.050,0.047,0.057,0.046,0.046],[0.378,0.086,0.086,0.095,0.086,0.086],[0.109,0.032,0.032,0.033,0.030,0.030],[0.240,0.075,0.075,0.074,0.074,0.073],[0.316,0.120,0.118,0.119,0.118,0.118],[0.059,0.033,0.033,0.032,0.034,0.033],[0.106,0.060,0.059,0.086,0.060,0.059],[0.364,0.207,0.205,0.206,0.205,0.204],[0.736,0.238,0.237,0.242,0.238,0.236],[0.749,0.528,0.529,0.528,0.525,0.531],[0.223,0.056,0.055,0.056,0.055,0.056],[1.134,0.481,0.481,0.485,0.468,0.470],[4.713,3.792,3.782,3.783,3.786,3.788],[8.688,2.156,2.162,2.202,2.189,2.207],[3.309,1.929,1.937,1.925,1.927,1.926],[12.839,6.552,6.564,6.552,6.563,6.562],[5.982,5.624,5.647,5.615,5.568,5.600],[4.079,3.567,3.704,3.814,3.531,4.041],[8.185,8.448,7.965,7.659,9.138,7.844],[null,null,null,null,null,null],[6.054,5.667,5.644,5.660,5.608,5.595],[null,null,null,null,null,null],[9.065,8.695,8.780,8.764,8.709,8.707],[null,null,null,null,null,null],[6.046,5.783,5.725,5.768,5.723,5.670],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.709,1.315,1.314,0.837,0.807,0.804],[null,null,null,null,null,null],[13.080,12.975,13.159,13.017,13.094,13.035],[null,null,null,null,null,null],[22.710,22.640,22.812,22.864,22.733,22.678],[0.339,0.110,0.110,0.110,0.113,0.107],[38.434,38.109,34.772,34.542,38.032,34.843],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.927,7.696,7.593,7.602,7.626,7.715],[0.791,0.646,0.630,0.644,0.655,0.627],[1.795,0.763,0.759,0.768,0.755,0.758],[8.053,7.806,7.989,7.971,7.878,7.726],[0.902,0.862,0.841,0.939,0.881,0.863],[0.291,0.164,0.155,0.166,0.164,0.162],[0.561,0.536,0.479,0.479,0.492,0.489],[null,null,null,null,null,null],[31.726,30.649,30.523,30.275,30.177,30.406],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.441,1.331,1.155,1.216,1.174,1.147],[3.866,3.749,3.763,3.823,3.772,3.737],[97.819,98.013,98.633,98.077,96.649,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.205,0.782,0.800,0.853,0.828,0.834],[1.604,1.397,1.367,1.354,1.351,1.334],[1.723,1.293,1.294,1.271,1.262,1.267],[null,null,null,null,null,null],[54.364,52.312,52.643,51.227,50.816,52.243],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.387,1.326,1.326,1.288,1.295,1.256],[null,null,null,null,null,null],[13.293,13.140,13.282,13.132,13.061,12.964],[null,null,null,null,null,null],[2.681,2.593,2.641,2.667,2.551,2.676],[null,null,null,null,null,null],[0.331,0.223,0.251,0.249,0.231,0.238],[0.376,0.300,0.266,0.280,0.275,0.269],[10.482,9.923,9.864,9.933,9.870,10.029],[19.693,19.275,19.414,19.365,19.496,19.403],[6.280,6.079,5.992,5.997,5.996,5.997],[6.109,5.982,5.940,6.033,6.095,6.034],[13.155,12.972,13.057,12.967,13.057,13.014],[0.517,0.394,0.399,0.396,0.396,0.391],[null,null,null,null,null,null],[1.468,1.254,1.254,1.272,1.247,1.248],[13.132,12.887,13.001,12.959,12.967,12.981],[null,null,null,null,null,null],[2.050,1.913,1.938,1.863,1.876,1.936],[null,null,null,null,null,null],[1.090,0.612,0.620,0.622,0.613,0.620],[0.905,0.805,0.793,0.787,0.797,0.795],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.070,1.045,1.042,1.018,1.022,1.053],[3.944,3.795,3.832,3.825,3.832,3.817],[0.677,0.615,0.628,0.611,0.623,0.628],[0.662,0.640,0.617,0.617,0.629,0.633],[1.613,1.508,1.507,1.531,1.532,1.541],[null,null,null,null,null,null],[2.138,2.094,2.096,2.056,2.079,2.146],[6.571,6.251,6.343,6.253,6.281,6.124],[0.099,0.057,0.046,0.054,0.074,0.044],[0.955,0.806,0.815,0.795,0.820,0.815],[1.775,1.326,1.346,1.343,1.303,1.304],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.895,4.848,4.979,4.915,4.834,4.945],[3.956,3.853,3.848,3.812,3.943,3.994],[2.117,2.080,2.094,2.152,2.043,1.991],[2.338,2.287,2.585,2.332,2.263,2.289],[7.211,7.051,7.066,7.088,7.157,7.163],[2.102,2.130,1.985,2.164,2.092,2.085],[1.022,0.635,0.629,0.622,0.606,0.631],[null,null,null,null,null,null],[0.966,0.832,0.838,0.866,0.825,0.841],[2.109,2.064,2.062,2.039,2.060,2.049],[0.995,0.654,0.659,0.661,0.654,0.655],[2.379,2.224,2.218,2.206,2.207,2.190],[0.619,0.548,0.563,0.536,0.540,0.550],[2.352,2.283,2.308,2.248,2.222,2.360],[null,null,null,null,null,null],[47.062,46.979,46.955,47.113,46.938,47.182],[1.789,1.589,1.558,1.579,1.532,1.558],[null,null,null,null,null,null],[2.412,1.151,1.149,1.147,1.136,1.109],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.828,0.552,0.551,0.551,0.544,0.550],[null,null,null,null,null,null],[0.744,0.647,0.645,0.638,0.639,0.640],[37.541,37.137,36.022,36.461,36.470,36.071],[null,null,null,null,null,null],[0.047,0.034,0.048,0.044,0.034,0.035],[1.621,0.723,0.712,0.713,0.710,0.713],[0.042,0.049,0.040,0.057,0.044,0.038],[null,null,null,null,null,null],[5.322,5.066,5.062,5.089,5.095,5.079],[null,null,null,null,null,null],[1.632,1.591,1.613,1.594,1.572,1.604],[0.254,0.172,0.167,0.189,0.172,0.160],[0.925,0.864,0.851,0.825,0.839,0.844],[1.664,1.516,1.595,1.573,1.527,1.510],[null,null,null,null,null,null],[4.030,3.780,3.779,3.865,3.828,3.854],[4.989,4.928,4.935,4.892,4.892,4.928],[2.899,2.796,2.796,2.873,2.850,2.873],[0.304,0.223,0.194,0.196,0.195,0.198],[0.942,0.862,0.787,0.730,0.717,0.748],[null,null,null,null,null,null],[3.114,2.941,2.980,2.974,2.984,3.082],[null,null,null,null,null,null],[36.408,36.503,36.508,36.646,36.423,36.546],[0.451,0.351,0.345,0.353,0.349,0.346],[4.300,4.079,4.260,4.076,4.027,5.896],[null,null,null,null,null,null],[1.081,0.994,0.968,0.963,0.960,0.962],[1.007,0.968,1.087,0.942,0.935,0.940],[1.101,1.065,1.059,1.094,1.020,1.013],[0.917,1.075,0.880,0.885,0.924,0.973],[1.067,1.015,1.064,1.024,1.078,1.031],[18.062,17.818,18.134,18.005,18.091,18.263],[5.716,5.643,5.650,5.658,5.692,5.647],[1.568,1.632,1.460,1.530,1.523,1.644],[null,null,null,null,null,null],[33.118,35.361,34.950,38.923,32.799,33.555],[32.396,32.427,32.223,32.168,32.646,33.945],[34.936,34.774,34.750,34.725,34.646,34.751],[3.943,3.890,3.788,4.035,3.955,3.900],[2.540,2.434,2.511,2.494,2.470,2.519],[4.260,4.328,4.273,4.298,4.492,4.309],[10.413,10.441,10.066,10.089,9.968,10.183],[10.337,10.067,10.112,10.262,9.987,10.069],[10.490,10.479,10.203,10.391,10.345,10.437],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[34.707,34.919,34.865,35.008,34.986,34.705],[39.604,39.390,39.147,39.770,39.488,39.593],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.811,3.760,3.760,3.786,3.949,3.819],[4.413,4.251,4.253,4.396,4.350,4.500],[0.047,0.040,0.043,0.062,0.040,0.040],[0.047,0.040,0.055,0.040,0.041,0.043],[3.189,3.354,3.238,3.185,3.169,3.291],[null,null,null,null,null,null],[4.348,4.003,4.178,3.967,4.058,4.036],[4.600,4.473,4.265,4.423,4.384,4.323],[4.272,4.036,3.962,4.074,4.025,4.015],[3.369,3.198,3.378,3.176,3.403,3.226],[4.520,4.225,4.165,4.380,4.285,4.237],[4.402,4.184,4.291,4.348,4.183,4.352],[4.408,4.230,4.170,4.222,4.210,4.394],[2.861,2.590,2.713,2.544,2.515,2.642],[2.361,2.173,2.162,2.155,2.118,2.119],[3.768,3.518,3.679,3.564,3.528,3.827],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.235,5.865,5.901,5.862,5.884,6.095],[0.052,0.036,0.034,0.036,0.044,0.033],[5.039,4.776,4.833,4.546,4.637,4.753],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.068,0.056,0.055,0.055,0.065,0.060],[0.061,0.054,0.054,0.054,0.054,0.059],[0.087,0.054,0.054,0.055,0.070,0.054],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.111,0.106,0.106,0.106,0.114,0.114],[0.108,0.106,0.107,0.118,0.106,0.106],[0.107,0.105,0.126,0.106,0.105,0.107],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.449,1.303,1.344,1.382,1.365,1.294],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.7.7.24","source":"results/22.7.7.24.json"} +,{"actual_version":"22.9.7.34","data_size":{"coffeeshop":44754533550,"hits":14420920121,"job":1830189202,"mgbench":2956962746,"ontime":2704903445,"ssb":72901918139,"taxi":24216924141,"tpcds":18812492342,"tpch":17375859823,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":784,"hits":231,"job":23,"mgbench":71,"ontime":58,"ssb":1377,"taxi":518,"tpcds":289,"tpch":278,"uk":31},"machine":"c7a.4xlarge","release_date":"2022-12-16","result":[[0.061,0.007,0.007,0.235,0.007,0.007],[0.063,0.026,0.026,0.026,0.027,0.026],[0.043,0.018,0.009,0.035,0.008,0.008],[0.046,0.010,0.010,0.010,0.011,0.010],[0.066,0.031,0.028,0.036,0.030,0.028],[0.083,0.021,0.021,0.028,0.020,0.021],[0.025,0.006,0.007,0.008,0.006,0.006],[0.049,0.025,0.024,0.022,0.022,0.024],[0.083,0.048,0.049,0.065,0.049,0.050],[0.119,0.082,0.080,0.083,0.085,0.082],[0.637,0.574,0.554,0.547,0.504,0.556],[0.622,0.494,0.424,0.448,0.407,0.406],[0.035,0.018,0.009,0.007,0.021,0.007],[0.064,0.040,0.034,0.030,0.011,0.011],[1.498,1.289,1.266,1.247,1.208,1.205],[0.752,0.131,0.130,0.130,0.133,0.130],[0.058,0.017,0.017,0.017,0.018,0.017],[0.042,0.014,0.014,0.013,0.013,0.013],[6.389,2.224,2.216,2.201,2.200,2.210],[4.694,1.636,1.639,1.642,1.635,1.640],[4.706,1.735,1.734,1.739,1.730,1.728],[5.363,2.954,2.945,2.961,2.952,2.962],[6.202,2.574,2.570,2.590,2.573,2.574],[3.963,1.736,1.729,1.740,1.737,1.739],[0.064,0.034,0.033,0.034,0.034,0.034],[7.666,3.345,3.327,3.326,3.331,3.337],[2.867,1.607,1.606,1.605,1.612,1.614],[2.095,0.844,0.837,0.832,0.827,0.836],[0.005,0.002,0.001,0.001,0.001,0.001],[0.028,0.009,0.009,0.008,0.009,0.008],[0.063,0.025,0.025,0.034,0.024,0.024],[0.141,0.034,0.034,0.033,0.033,0.034],[0.166,0.079,0.080,0.080,0.079,0.079],[0.316,0.219,0.218,0.217,0.217,0.218],[0.003,0.001,0.001,0.012,0.001,0.001],[0.029,0.010,0.010,0.009,0.010,0.010],[0.466,0.406,0.403,0.400,0.401,0.404],[0.515,0.455,0.457,0.455,0.454,0.454],[0.191,0.112,0.113,0.112,0.111,0.111],[0.213,0.136,0.138,0.136,0.137,0.135],[0.633,0.506,0.476,0.462,0.470,0.463],[0.779,0.682,0.684,0.687,0.692,0.703],[0.799,0.675,0.671,0.691,0.664,0.675],[0.608,0.527,0.479,0.476,0.509,0.483],[2.103,1.905,1.858,1.857,1.853,1.911],[1.390,1.442,1.322,1.320,1.294,1.324],[3.863,3.737,3.650,3.825,3.734,3.668],[0.147,0.051,0.037,0.053,0.038,0.036],[1.434,0.681,0.681,0.688,0.696,0.700],[1.743,0.626,0.627,0.633,0.625,0.626],[4.071,1.698,1.680,1.662,1.687,1.680],[3.250,0.822,0.812,0.816,0.823,0.811],[0.346,0.163,0.164,0.163,0.163,0.164],[0.269,0.142,0.141,0.140,0.139,0.139],[0.345,0.165,0.165,0.166,0.166,0.164],[1.416,0.611,0.592,0.590,0.585,0.584],[1.371,0.939,0.934,0.939,0.933,0.937],[0.812,0.799,0.800,0.906,0.804,0.790],[0.556,0.366,0.360,0.344,0.334,0.337],[0.746,0.459,0.440,0.427,0.430,0.429],[2.868,2.592,2.689,2.684,2.608,2.610],[3.367,3.011,3.021,3.035,3.001,3.079],[3.339,3.041,3.029,2.982,2.992,2.999],[0.886,0.872,0.845,0.832,0.823,0.821],[0.061,0.043,0.036,0.035,0.034,0.040],[0.045,0.018,0.018,0.019,0.018,0.018],[0.049,0.034,0.018,0.019,0.017,0.021],[0.102,0.075,0.078,0.067,0.073,0.073],[0.040,0.008,0.007,0.008,0.008,0.007],[0.031,0.007,0.007,0.010,0.008,0.007],[0.020,0.004,0.004,0.004,0.008,0.004],[0.616,0.059,0.057,0.064,0.057,0.056],[0.740,0.078,0.080,0.079,0.078,0.079],[0.172,0.048,0.046,0.054,0.046,0.045],[0.383,0.085,0.085,0.091,0.085,0.086],[0.108,0.033,0.032,0.032,0.032,0.033],[0.237,0.072,0.072,0.070,0.072,0.071],[0.313,0.117,0.116,0.117,0.116,0.115],[0.058,0.033,0.032,0.032,0.032,0.033],[0.099,0.059,0.060,0.081,0.059,0.059],[0.364,0.207,0.209,0.208,0.209,0.208],[0.731,0.229,0.226,0.235,0.226,0.229],[0.753,0.538,0.534,0.533,0.534,0.534],[0.219,0.055,0.054,0.057,0.056,0.054],[1.142,0.485,0.483,0.477,0.469,0.468],[4.871,3.939,3.939,3.944,3.934,3.942],[8.678,2.074,1.954,2.044,2.051,2.106],[3.193,1.827,1.827,1.830,1.827,1.838],[12.853,6.693,6.665,6.683,6.692,6.682],[6.032,5.625,5.831,5.644,5.589,5.624],[4.127,3.736,3.660,3.742,3.549,3.606],[8.860,8.687,8.767,7.713,8.253,7.886],[null,null,null,null,null,null],[5.979,5.643,5.637,5.626,5.625,5.677],[null,null,null,null,null,null],[8.978,8.696,8.722,8.685,8.653,8.679],[null,null,null,null,null,null],[6.011,5.728,5.721,5.825,5.771,5.755],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.745,1.250,1.250,0.769,0.743,0.741],[null,null,null,null,null,null],[16.428,16.389,16.405,16.362,16.314,16.413],[null,null,null,null,null,null],[27.964,27.858,27.969,28.022,28.146,28.077],[0.348,0.185,0.101,0.108,0.102,0.104],[40.326,36.691,37.330,37.099,37.330,40.244],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.974,8.566,8.661,8.592,8.530,8.596],[0.781,0.711,0.663,0.675,0.674,0.654],[1.801,0.745,0.745,0.734,0.740,0.724],[9.957,9.755,9.777,9.876,9.888,10.011],[0.872,0.806,0.798,0.841,0.790,0.794],[0.336,0.177,0.128,0.141,0.128,0.141],[0.566,0.481,0.464,0.453,0.465,0.465],[null,null,null,null,null,null],[35.727,34.121,34.005,33.925,34.174,34.128],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.422,1.300,1.147,1.156,1.138,1.148],[4.173,4.084,4.095,3.927,4.121,4.197],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.176,0.738,0.726,0.736,0.738,0.722],[1.414,1.332,1.310,1.310,1.314,1.348],[2.594,1.090,1.087,1.092,1.088,1.090],[null,null,null,null,null,null],[59.533,58.032,58.712,61.943,60.639,58.289],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.368,1.330,1.327,1.303,1.289,1.271],[null,null,null,null,null,null],[13.041,12.461,12.586,12.568,12.411,12.620],[null,null,null,null,null,null],[3.023,2.930,2.885,2.935,2.933,2.964],[null,null,null,null,null,null],[0.302,0.233,0.224,0.246,0.238,0.244],[0.389,0.318,0.290,0.284,0.282,0.301],[10.084,9.679,9.776,9.648,9.768,9.702],[19.010,18.728,18.946,18.754,18.759,18.784],[5.982,5.859,5.816,5.808,5.770,5.768],[5.877,5.769,5.768,5.678,5.791,5.750],[12.644,12.422,12.437,12.420,12.690,12.556],[0.493,0.379,0.386,0.380,0.376,0.374],[null,null,null,null,null,null],[1.388,1.179,1.192,1.177,1.179,1.165],[12.764,12.306,12.424,12.379,12.461,12.463],[null,null,null,null,null,null],[2.083,1.988,1.950,1.947,1.933,1.959],[null,null,null,null,null,null],[0.989,0.632,0.634,0.636,0.633,0.634],[0.900,0.780,0.783,0.778,0.779,0.769],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.255,1.213,1.184,1.198,1.231,1.184],[3.882,3.825,3.830,3.795,3.810,3.787],[0.659,0.626,0.607,0.610,0.606,0.604],[0.650,0.598,0.611,0.597,0.604,0.605],[1.491,1.417,1.397,1.539,1.511,1.422],[null,null,null,null,null,null],[2.420,2.305,2.264,2.428,2.387,2.357],[6.613,6.605,6.590,6.546,6.709,6.564],[0.102,0.043,0.041,0.048,0.040,0.041],[0.904,0.821,0.811,0.825,0.811,0.809],[1.760,1.296,1.294,1.309,1.307,1.298],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.929,4.815,4.819,4.907,4.925,4.849],[3.910,3.731,3.786,3.693,3.595,3.621],[2.444,2.429,2.320,2.348,2.306,2.364],[2.356,2.328,2.345,2.311,2.373,2.346],[9.966,9.781,9.778,9.894,9.736,9.890],[2.442,2.378,2.405,2.319,2.356,2.399],[1.173,0.632,0.633,0.636,0.636,0.624],[null,null,null,null,null,null],[0.943,0.840,0.832,0.851,0.825,0.820],[2.137,2.075,2.062,2.062,2.066,2.054],[1.049,0.671,0.670,0.674,0.665,0.671],[2.309,2.197,2.143,2.160,2.177,2.162],[0.608,0.533,0.524,0.521,0.526,0.522],[2.424,2.373,2.322,2.273,2.351,2.344],[null,null,null,null,null,null],[25.665,27.172,24.695,26.854,24.627,30.276],[1.789,1.537,1.521,1.548,1.513,1.502],[null,null,null,null,null,null],[2.411,1.149,1.141,1.106,1.114,1.132],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.820,0.592,0.578,0.585,0.578,0.581],[null,null,null,null,null,null],[0.745,0.637,0.628,0.624,0.634,0.635],[42.617,42.574,42.135,43.643,42.491,42.979],[null,null,null,null,null,null],[0.033,0.032,0.032,0.039,0.031,0.032],[1.603,0.694,0.702,0.709,0.688,0.689],[0.039,0.052,0.037,0.052,0.038,0.063],[null,null,null,null,null,null],[5.069,4.765,4.813,4.783,4.792,4.773],[null,null,null,null,null,null],[1.883,1.830,1.853,1.818,1.815,1.849],[0.256,0.163,0.157,0.183,0.169,0.154],[1.116,1.037,1.022,1.031,1.045,1.040],[1.557,1.451,1.448,1.468,1.438,1.468],[null,null,null,null,null,null],[3.944,3.839,3.850,3.821,3.801,3.884],[4.850,4.795,4.771,4.765,4.783,4.769],[2.973,2.893,2.896,3.418,2.880,2.928],[0.279,0.206,0.203,0.189,0.199,0.197],[0.917,0.836,0.806,0.801,0.840,0.843],[null,null,null,null,null,null],[2.883,2.885,2.835,2.931,2.806,2.808],[null,null,null,null,null,null],[43.894,44.042,44.462,43.876,44.164,44.448],[0.463,0.333,0.336,0.334,0.332,0.332],[4.233,3.989,4.016,3.961,4.020,3.985],[null,null,null,null,null,null],[1.046,0.945,0.942,0.957,0.946,0.947],[0.952,0.892,0.850,0.835,0.876,0.855],[1.014,0.997,0.973,0.975,0.944,1.005],[0.842,0.797,0.846,0.900,0.848,0.824],[1.023,0.996,0.990,0.890,0.903,0.970],[17.995,17.784,17.692,17.903,18.111,17.898],[5.541,5.383,5.500,5.546,5.473,5.315],[1.452,1.384,1.373,1.474,1.328,1.389],[null,null,null,null,null,null],[35.863,33.294,32.634,34.581,32.785,33.142],[32.055,32.665,32.548,32.064,31.885,32.360],[37.948,34.762,35.005,35.358,35.238,34.715],[3.875,3.817,4.006,3.884,3.809,3.824],[2.479,2.510,2.434,2.318,2.462,2.388],[4.357,4.275,4.207,4.207,4.276,4.209],[10.225,10.120,10.060,9.911,9.935,9.994],[10.322,9.901,9.975,9.926,9.852,9.844],[10.438,10.084,10.262,10.086,10.204,10.477],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[34.453,33.518,33.940,33.772,33.460,33.477],[38.035,38.128,38.333,38.238,38.519,38.032],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.928,3.799,3.861,3.772,3.988,3.961],[4.498,4.417,4.692,4.401,4.320,4.329],[0.049,0.035,0.033,0.033,0.032,0.032],[0.035,0.032,0.032,0.032,0.031,0.031],[3.128,3.001,2.965,3.057,3.177,3.071],[null,null,null,null,null,null],[4.128,3.990,3.902,3.997,3.860,3.894],[4.643,4.265,4.276,4.453,4.223,4.178],[4.328,3.874,3.999,4.075,3.886,3.971],[3.445,3.056,3.222,3.136,3.222,3.110],[4.316,4.142,4.199,4.151,4.108,4.065],[4.358,4.138,4.086,4.141,4.084,4.187],[4.310,4.104,4.123,4.289,4.030,4.124],[2.906,2.541,2.477,2.537,2.619,2.634],[2.273,2.154,2.055,1.984,2.165,1.986],[3.671,3.411,3.427,3.392,3.509,3.422],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.045,6.019,5.892,5.906,5.703,5.753],[0.041,0.026,0.026,0.026,0.026,0.026],[4.856,4.494,4.501,4.528,4.640,4.464],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.076,0.042,0.041,0.072,0.042,0.042],[0.056,0.042,0.042,0.041,0.055,0.043],[0.051,0.047,0.042,0.043,0.043,0.043],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.079,0.079,0.106,0.095,0.079,0.079],[0.079,0.078,0.079,0.103,0.078,0.079],[0.079,0.079,0.079,0.079,0.080,0.079],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.342,1.328,1.273,1.329,1.279,1.421],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.9.7.34","source":"results/22.9.7.34.json"} +,{"actual_version":"22.10.7.13","data_size":{"coffeeshop":44756788211,"hits":14374747259,"job":1830189202,"mgbench":2959106271,"ontime":2704903445,"ssb":72903384129,"taxi":24216864794,"tpcds":18818636012,"tpch":17376040777,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":822,"hits":243,"job":24,"mgbench":72,"ontime":62,"ssb":1438,"taxi":565,"tpcds":290,"tpch":287,"uk":33},"machine":"c7a.4xlarge","release_date":"2023-01-26","result":[[0.075,0.010,0.008,0.323,0.008,0.008],[0.056,0.028,0.022,0.022,0.026,0.024],[0.046,0.019,0.010,0.062,0.009,0.010],[0.046,0.012,0.012,0.014,0.015,0.013],[0.048,0.025,0.024,0.048,0.022,0.024],[0.067,0.016,0.017,0.033,0.016,0.017],[0.030,0.006,0.007,0.006,0.007,0.006],[0.057,0.031,0.029,0.029,0.028,0.027],[0.073,0.045,0.042,0.062,0.038,0.041],[0.089,0.066,0.058,0.056,0.057,0.055],[0.512,0.465,0.445,0.427,0.428,0.428],[0.330,0.308,0.326,0.315,0.293,0.281],[0.037,0.012,0.012,0.023,0.015,0.014],[0.062,0.022,0.013,0.014,0.012,0.013],[0.858,0.745,0.730,0.797,0.704,0.751],[0.439,0.100,0.099,0.108,0.101,0.100],[0.043,0.020,0.018,0.018,0.016,0.016],[0.046,0.017,0.016,0.017,0.016,0.016],[6.409,1.521,1.514,1.538,1.540,1.504],[4.699,1.148,1.142,1.185,1.148,1.132],[4.715,1.182,1.188,1.168,1.172,1.163],[5.373,1.909,1.896,1.872,1.876,1.873],[6.214,1.605,1.590,1.588,1.599,1.577],[3.968,1.006,1.001,1.010,1.012,1.003],[0.053,0.034,0.028,0.028,0.031,0.031],[7.682,2.144,2.132,2.165,2.162,2.144],[2.268,1.001,1.000,0.991,1.003,1.005],[1.859,0.541,0.538,0.556,0.532,0.545],[0.003,0.001,0.002,0.001,0.001,0.001],[0.025,0.008,0.009,0.009,0.008,0.008],[0.053,0.020,0.018,0.037,0.018,0.019],[0.105,0.025,0.024,0.022,0.023,0.023],[0.135,0.070,0.065,0.064,0.064,0.067],[0.243,0.150,0.151,0.146,0.150,0.146],[0.003,0.001,0.001,0.022,0.001,0.001],[0.020,0.009,0.009,0.009,0.009,0.009],[0.319,0.244,0.266,0.245,0.251,0.245],[0.361,0.279,0.281,0.275,0.285,0.293],[0.163,0.092,0.086,0.085,0.086,0.087],[0.177,0.103,0.103,0.105,0.102,0.103],[0.438,0.299,0.288,0.285,0.287,0.295],[0.554,0.398,0.404,0.395,0.413,0.404],[0.510,0.445,0.399,0.400,0.413,0.402],[0.338,0.319,0.320,0.315,0.308,0.311],[1.138,1.162,1.109,1.095,1.101,1.089],[0.837,0.738,0.727,0.719,0.743,0.744],[2.473,2.071,2.110,2.094,2.092,2.093],[0.130,0.023,0.028,0.023,0.022,0.027],[1.416,0.393,0.359,0.360,0.385,0.387],[1.760,0.418,0.385,0.407,0.389,0.391],[4.035,1.109,1.094,1.107,1.096,1.094],[3.108,0.443,0.443,0.433,0.436,0.460],[0.288,0.112,0.114,0.110,0.112,0.115],[0.190,0.090,0.090,0.086,0.090,0.087],[0.290,0.109,0.111,0.113,0.109,0.108],[1.411,0.397,0.389,0.409,0.397,0.392],[1.052,0.598,0.581,0.585,0.577,0.603],[0.921,0.913,0.902,1.011,0.907,0.911],[0.440,0.270,0.258,0.257,0.247,0.259],[0.624,0.318,0.324,0.316,0.325,0.317],[2.010,1.743,1.746,1.801,1.749,1.764],[2.117,1.795,1.780,1.777,1.799,1.789],[2.121,1.776,1.776,1.795,1.766,1.793],[0.629,0.555,0.540,0.548,0.603,0.593],[0.085,0.060,0.058,0.060,0.054,0.058],[0.043,0.026,0.029,0.038,0.026,0.030],[0.068,0.030,0.030,0.029,0.024,0.024],[0.179,0.126,0.142,0.151,0.121,0.106],[0.039,0.011,0.012,0.010,0.010,0.009],[0.032,0.009,0.012,0.009,0.013,0.009],[0.015,0.005,0.007,0.007,0.008,0.005],[0.364,0.049,0.043,0.061,0.045,0.045],[0.431,0.057,0.059,0.057,0.061,0.058],[0.110,0.036,0.034,0.051,0.033,0.034],[0.223,0.060,0.056,0.073,0.055,0.055],[0.074,0.030,0.029,0.029,0.029,0.029],[0.168,0.069,0.069,0.069,0.067,0.066],[0.212,0.091,0.090,0.092,0.090,0.091],[0.060,0.032,0.032,0.033,0.032,0.033],[0.104,0.058,0.058,0.079,0.055,0.058],[0.251,0.159,0.155,0.153,0.157,0.158],[0.457,0.182,0.177,0.178,0.175,0.177],[0.464,0.322,0.316,0.332,0.317,0.323],[0.138,0.040,0.039,0.042,0.042,0.043],[0.671,0.298,0.290,0.303,0.280,0.280],[2.810,2.293,2.269,2.271,2.283,2.266],[8.660,1.205,1.219,1.240,1.200,1.211],[1.851,1.072,1.059,1.074,1.083,1.073],[12.830,3.991,3.974,3.978,3.952,3.956],[4.293,3.338,3.363,3.352,3.335,3.340],[4.088,1.842,1.843,1.853,1.841,1.840],[4.887,4.777,4.967,4.500,4.750,4.651],[null,null,null,null,null,null],[3.532,3.313,3.321,3.339,3.312,3.307],[null,null,null,null,null,null],[5.275,5.038,5.179,5.086,5.048,5.041],[null,null,null,null,null,null],[3.406,3.236,3.236,3.229,3.250,3.235],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.745,0.708,0.709,0.528,0.460,0.460],[null,null,null,null,null,null],[15.955,16.116,15.889,15.951,15.841,15.973],[null,null,null,null,null,null],[26.347,25.993,26.090,26.193,26.358,26.485],[0.221,0.080,0.079,0.073,0.074,0.078],[37.819,39.603,40.987,36.973,37.480,37.500],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.329,7.995,8.035,8.553,8.034,7.995],[0.491,0.406,0.409,0.413,0.409,0.413],[1.085,0.477,0.459,0.498,0.471,0.478],[8.769,8.711,8.672,8.636,8.634,8.752],[0.893,0.798,0.804,0.806,0.753,0.815],[0.294,0.121,0.111,0.124,0.119,0.110],[0.412,0.335,0.336,0.331,0.330,0.341],[null,null,null,null,null,null],[30.637,30.103,30.213,29.956,30.254,30.024],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.095,0.853,0.746,0.783,0.718,0.720],[4.218,4.196,4.157,4.097,4.035,3.992],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.180,0.506,0.509,0.571,0.514,0.511],[1.032,0.965,0.953,0.984,0.983,0.920],[1.228,1.000,0.982,0.977,0.978,1.030],[null,null,null,null,null,null],[58.019,58.463,58.853,59.079,59.674,62.991],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.804,0.776,0.784,0.754,0.743,0.717],[null,null,null,null,null,null],[12.185,11.716,11.868,11.685,11.535,11.658],[null,null,null,null,null,null],[3.117,2.985,2.896,2.948,2.958,2.993],[null,null,null,null,null,null],[0.326,0.147,0.150,0.190,0.148,0.153],[0.338,0.210,0.197,0.204,0.198,0.201],[5.661,5.514,5.545,5.497,5.493,5.607],[10.817,10.567,10.556,10.492,10.495,10.401],[4.980,4.914,5.079,4.921,4.857,4.960],[4.925,4.927,4.777,4.875,4.827,4.816],[11.665,11.442,11.690,11.636,11.585,11.505],[0.423,0.247,0.247,0.244,0.247,0.240],[null,null,null,null,null,null],[1.253,1.016,1.018,1.033,1.021,1.010],[11.664,11.656,11.488,11.412,11.498,11.655],[null,null,null,null,null,null],[1.456,1.282,1.256,1.269,1.292,1.239],[null,null,null,null,null,null],[0.923,0.392,0.390,0.389,0.390,0.401],[0.766,0.499,0.479,0.473,0.469,0.488],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.256,1.217,1.206,1.190,1.221,1.202],[4.489,4.347,4.400,4.374,4.328,4.321],[0.441,0.409,0.395,0.400,0.406,0.411],[0.443,0.403,0.399,0.399,0.396,0.403],[1.226,1.165,1.151,1.181,1.143,1.154],[null,null,null,null,null,null],[2.470,2.481,2.374,2.390,2.251,2.380],[6.695,6.535,6.412,6.569,6.516,6.813],[0.122,0.079,0.051,0.051,0.055,0.046],[0.601,0.454,0.488,0.506,0.517,0.475],[1.752,0.824,0.781,0.787,0.800,0.797],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.017,3.966,4.042,4.214,4.087,4.013],[3.583,3.478,3.476,3.498,3.446,3.519],[2.446,2.441,2.440,2.366,2.373,2.448],[2.474,2.544,2.414,2.376,2.373,2.431],[9.970,9.686,9.725,9.721,9.679,9.747],[2.504,2.505,2.399,2.411,2.416,2.411],[0.922,0.409,0.419,0.401,0.413,0.419],[null,null,null,null,null,null],[0.727,0.537,0.529,0.584,0.528,0.538],[1.427,1.379,1.354,1.395,1.361,1.358],[0.906,0.436,0.431,0.436,0.425,0.427],[1.459,1.345,1.289,1.323,1.246,1.288],[0.409,0.337,0.338,0.337,0.350,0.336],[2.607,2.464,2.335,2.354,2.372,2.387],[null,null,null,null,null,null],[25.747,23.891,23.950,24.119,23.580,25.892],[1.307,1.018,0.949,1.016,0.956,0.958],[null,null,null,null,null,null],[2.412,0.724,0.732,0.722,0.714,0.729],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.823,0.348,0.347,0.339,0.347,0.346],[null,null,null,null,null,null],[0.756,0.386,0.388,0.385,0.381,0.397],[42.592,42.691,45.091,42.377,42.468,42.295],[null,null,null,null,null,null],[0.038,0.032,0.032,0.061,0.036,0.042],[1.621,0.445,0.436,0.438,0.429,0.431],[0.046,0.056,0.042,0.073,0.043,0.049],[null,null,null,null,null,null],[4.382,3.777,3.789,3.819,3.816,3.796],[null,null,null,null,null,null],[1.878,1.853,1.828,1.873,1.877,1.847],[0.211,0.150,0.151,0.184,0.138,0.149],[1.126,1.054,1.040,1.031,1.046,1.028],[1.388,1.383,1.231,1.264,1.250,1.238],[null,null,null,null,null,null],[4.512,4.399,4.373,4.415,4.415,4.413],[2.830,2.768,2.744,2.732,2.789,2.752],[3.044,2.973,3.426,2.898,2.961,2.956],[0.273,0.130,0.127,0.129,0.127,0.126],[0.897,0.827,0.817,0.806,0.773,0.873],[null,null,null,null,null,null],[2.535,2.301,2.304,2.314,2.280,2.307],[null,null,null,null,null,null],[41.664,41.572,41.292,41.788,41.718,42.142],[0.363,0.197,0.194,0.206,0.194,0.194],[3.597,3.513,3.475,3.520,3.585,3.509],[null,null,null,null,null,null],[0.648,0.562,0.570,0.570,0.570,0.561],[0.963,1.010,0.916,0.901,0.847,0.861],[1.042,0.948,0.919,0.904,1.011,0.974],[0.901,0.891,0.847,0.848,0.862,0.834],[0.982,0.948,0.940,1.082,0.969,1.011],[18.307,18.483,18.324,18.600,18.138,18.099],[5.664,5.650,5.640,5.509,5.579,5.512],[1.504,1.396,1.439,1.454,1.455,1.441],[null,null,null,null,null,null],[33.919,35.555,33.378,37.018,33.725,34.049],[34.866,38.697,35.607,34.671,38.324,33.776],[37.406,36.667,40.673,37.259,36.681,38.392],[4.089,3.919,4.019,4.235,4.060,4.082],[2.655,2.524,2.501,2.410,2.455,2.657],[4.408,4.362,4.502,4.358,4.246,4.514],[10.977,10.418,10.612,10.466,10.534,10.400],[10.650,10.383,10.264,10.327,10.532,10.654],[10.757,10.782,10.803,10.662,10.673,10.473],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[40.509,40.294,40.166,40.437,40.491,40.526],[45.123,44.985,43.651,45.119,45.389,45.130],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.036,3.987,3.961,4.046,3.999,4.117],[4.600,4.563,4.490,4.511,4.588,4.701],[0.039,0.035,0.051,0.035,0.035,0.034],[0.035,0.034,0.038,0.034,0.048,0.034],[3.227,3.265,3.147,3.212,3.237,3.286],[null,null,null,null,null,null],[4.300,4.192,4.021,3.958,4.172,4.018],[4.782,4.510,4.606,4.393,4.533,4.421],[4.438,4.114,4.313,4.238,4.122,4.208],[3.608,3.210,3.211,3.233,3.369,3.185],[4.420,4.439,4.408,4.273,4.346,4.240],[4.330,4.436,4.221,4.169,4.392,4.355],[4.330,4.148,4.194,4.230,4.299,4.178],[2.872,2.610,2.548,2.607,2.646,2.475],[2.355,2.186,2.108,2.147,2.125,2.337],[3.939,3.667,3.572,3.569,3.618,3.638],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.762,5.651,5.315,5.333,5.314,5.239],[0.040,0.029,0.033,0.028,0.029,0.037],[4.626,4.322,4.523,4.337,4.322,4.454],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.054,0.047,0.054,0.044,0.047,0.049],[0.054,0.055,0.044,0.047,0.067,0.044],[0.051,0.059,0.044,0.081,0.046,0.045],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.093,0.091,0.084,0.103,0.084,0.086],[0.084,0.083,0.084,0.087,0.084,0.085],[0.084,0.096,0.090,0.087,0.089,0.083],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.449,1.302,1.536,1.335,1.404,1.373],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.10.7.13","source":"results/22.10.7.13.json"} +,{"actual_version":"22.11.6.44","data_size":{"coffeeshop":44758109551,"hits":14376598745,"job":1830189202,"mgbench":2959106271,"ontime":2704903445,"ssb":72902052085,"taxi":24216692398,"tpcds":18810862676,"tpch":17374940506,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":842,"hits":234,"job":25,"mgbench":73,"ontime":67,"ssb":1507,"taxi":583,"tpcds":291,"tpch":279,"uk":36},"machine":"c7a.4xlarge","release_date":"2023-02-23","result":[[0.059,0.009,0.009,0.302,0.009,0.009],[0.058,0.025,0.022,0.023,0.023,0.023],[0.048,0.018,0.010,0.063,0.010,0.010],[0.041,0.012,0.011,0.012,0.013,0.011],[0.043,0.025,0.029,0.051,0.027,0.028],[0.066,0.018,0.017,0.034,0.015,0.017],[0.026,0.007,0.006,0.007,0.006,0.006],[0.057,0.031,0.029,0.029,0.029,0.031],[0.069,0.046,0.037,0.059,0.037,0.038],[0.089,0.063,0.059,0.064,0.063,0.065],[0.505,0.462,0.451,0.451,0.447,0.448],[0.315,0.304,0.333,0.313,0.279,0.293],[0.043,0.007,0.013,0.014,0.010,0.015],[0.050,0.029,0.016,0.015,0.012,0.011],[0.944,0.808,0.784,0.848,0.754,0.759],[0.394,0.079,0.082,0.076,0.078,0.077],[0.036,0.015,0.015,0.012,0.013,0.013],[0.037,0.014,0.015,0.013,0.012,0.013],[6.389,1.686,1.692,1.691,1.677,1.685],[4.701,1.256,1.257,1.267,1.292,1.280],[4.715,1.305,1.298,1.305,1.317,1.309],[5.369,2.120,2.167,2.138,2.161,2.155],[6.210,1.876,1.880,1.916,1.824,1.839],[3.960,1.145,1.151,1.140,1.143,1.172],[0.056,0.035,0.035,0.037,0.033,0.035],[7.665,2.448,2.431,2.438,2.448,2.451],[2.286,1.153,1.132,1.155,1.146,1.152],[1.861,0.604,0.612,0.615,0.606,0.612],[0.004,0.001,0.002,0.001,0.002,0.002],[0.024,0.011,0.008,0.008,0.009,0.008],[0.049,0.020,0.019,0.037,0.019,0.019],[0.094,0.028,0.024,0.024,0.024,0.023],[0.123,0.060,0.061,0.060,0.063,0.060],[0.236,0.140,0.146,0.145,0.151,0.151],[0.002,0.001,0.001,0.023,0.002,0.001],[0.021,0.009,0.011,0.009,0.009,0.010],[0.320,0.246,0.253,0.262,0.251,0.249],[0.345,0.282,0.288,0.280,0.278,0.282],[0.152,0.095,0.093,0.092,0.093,0.092],[0.172,0.111,0.117,0.111,0.111,0.108],[0.425,0.305,0.302,0.300,0.306,0.302],[0.552,0.415,0.424,0.410,0.416,0.414],[0.539,0.449,0.412,0.410,0.438,0.428],[0.340,0.331,0.333,0.317,0.318,0.312],[1.199,1.190,1.149,1.174,1.126,1.153],[0.857,0.770,0.767,0.763,0.755,0.757],[2.503,2.130,2.107,2.121,2.130,2.110],[0.093,0.023,0.028,0.029,0.026,0.022],[1.407,0.460,0.444,0.407,0.433,0.414],[1.732,0.432,0.403,0.420,0.417,0.409],[4.034,1.164,1.145,1.174,1.160,1.152],[3.230,0.515,0.490,0.501,0.514,0.507],[0.259,0.124,0.125,0.124,0.112,0.121],[0.200,0.098,0.100,0.092,0.103,0.099],[0.270,0.124,0.115,0.128,0.124,0.122],[1.404,0.421,0.419,0.429,0.385,0.424],[1.040,0.581,0.616,0.617,0.616,0.594],[0.940,0.923,0.919,1.027,0.918,0.920],[0.445,0.299,0.295,0.298,0.281,0.283],[0.610,0.356,0.359,0.355,0.342,0.356],[2.183,1.771,1.847,1.796,1.889,1.963],[2.184,1.849,1.840,1.850,1.924,1.958],[2.196,1.873,1.928,1.905,1.928,1.973],[0.675,0.621,0.599,0.614,0.692,0.705],[0.084,0.059,0.065,0.055,0.057,0.060],[0.053,0.027,0.041,0.032,0.028,0.031],[0.062,0.026,0.022,0.035,0.024,0.026],[0.146,0.142,0.141,0.139,0.124,0.132],[0.038,0.009,0.012,0.013,0.010,0.013],[0.027,0.007,0.009,0.008,0.010,0.009],[0.013,0.005,0.006,0.004,0.005,0.006],[0.330,0.052,0.048,0.067,0.048,0.046],[0.393,0.068,0.067,0.069,0.066,0.069],[0.109,0.041,0.045,0.060,0.039,0.039],[0.217,0.062,0.061,0.077,0.060,0.061],[0.072,0.030,0.031,0.031,0.030,0.030],[0.155,0.069,0.068,0.069,0.068,0.069],[0.200,0.096,0.093,0.093,0.093,0.094],[0.058,0.036,0.035,0.033,0.038,0.039],[0.094,0.066,0.069,0.089,0.065,0.066],[0.281,0.190,0.172,0.186,0.191,0.190],[0.450,0.194,0.178,0.175,0.180,0.175],[0.465,0.344,0.340,0.332,0.334,0.340],[0.130,0.043,0.042,0.045,0.044,0.042],[0.651,0.319,0.314,0.330,0.307,0.309],[3.401,2.966,2.951,2.969,2.929,2.686],[8.638,1.212,1.245,1.246,1.345,1.293],[1.737,1.079,1.081,1.117,1.087,1.102],[12.813,4.115,4.208,4.230,4.212,4.182],[4.276,3.766,3.716,3.789,3.652,3.718],[4.078,2.112,2.107,2.060,2.006,2.061],[5.794,5.079,5.322,4.975,5.322,5.259],[null,null,null,null,null,null],[3.833,3.713,3.733,3.820,3.720,3.834],[null,null,null,null,null,null],[5.985,5.495,5.591,5.599,5.547,5.611],[null,null,null,null,null,null],[3.775,3.608,3.584,3.698,3.688,3.657],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.664,0.782,0.761,0.596,0.506,0.500],[null,null,null,null,null,null],[16.748,15.996,15.941,16.486,17.267,16.437],[null,null,null,null,null,null],[28.148,28.477,26.729,25.973,26.205,26.078],[0.184,0.063,0.063,0.065,0.071,0.069],[39.049,37.897,37.197,40.155,37.408,39.030],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.326,8.117,8.162,8.133,8.053,8.105],[0.457,0.404,0.403,0.420,0.398,0.406],[0.960,0.459,0.464,0.470,0.467,0.469],[8.647,8.612,8.718,8.680,8.601,8.609],[0.864,0.798,0.809,0.811,0.792,0.770],[0.230,0.137,0.126,0.131,0.113,0.119],[0.424,0.335,0.345,0.342,0.340,0.341],[null,null,null,null,null,null],[31.005,30.285,29.993,30.202,30.034,30.217],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.919,0.819,0.734,0.747,0.726,0.730],[4.212,4.156,4.127,4.113,4.062,4.244],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.179,0.514,0.522,0.547,0.523,0.517],[1.078,0.980,0.949,0.931,0.907,0.919],[1.225,1.003,1.021,1.019,1.007,0.999],[null,null,null,null,null,null],[62.919,59.673,59.426,59.203,59.300,63.707],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.859,0.748,0.805,0.796,0.719,0.743],[null,null,null,null,null,null],[11.678,11.440,11.570,11.645,11.438,11.647],[null,null,null,null,null,null],[3.114,3.029,2.921,2.998,2.986,3.021],[null,null,null,null,null,null],[0.281,0.155,0.158,0.196,0.163,0.151],[0.317,0.210,0.229,0.204,0.206,0.230],[6.025,5.701,5.672,5.677,5.675,5.724],[10.977,10.881,10.864,10.859,10.808,10.831],[5.112,4.996,4.953,4.992,5.025,5.034],[5.041,5.138,5.143,4.902,4.970,5.062],[11.577,11.501,11.517,11.459,11.402,11.539],[0.352,0.250,0.249,0.245,0.243,0.256],[null,null,null,null,null,null],[1.147,1.054,1.048,1.067,1.037,1.035],[11.810,11.372,11.613,11.502,11.581,11.546],[null,null,null,null,null,null],[1.433,1.294,1.301,1.307,1.285,1.287],[null,null,null,null,null,null],[0.901,0.400,0.393,0.405,0.401,0.401],[0.744,0.482,0.481,0.489,0.475,0.473],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.290,1.253,1.208,1.224,1.250,1.242],[4.425,4.234,4.300,4.331,4.283,4.262],[0.457,0.429,0.413,0.411,0.410,0.416],[0.450,0.420,0.424,0.416,0.422,0.409],[1.244,1.154,1.172,1.199,1.164,1.165],[null,null,null,null,null,null],[2.520,2.498,2.419,2.368,2.479,2.430],[6.654,6.548,6.741,6.747,6.690,6.665],[0.075,0.052,0.054,0.046,0.042,0.085],[0.597,0.470,0.490,0.482,0.470,0.543],[1.764,0.828,0.832,0.807,0.790,0.792],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.745,3.683,3.664,3.854,3.662,3.678],[3.614,3.383,3.585,3.441,3.419,3.492],[2.487,2.451,2.487,2.415,2.341,2.361],[2.449,2.410,2.434,2.455,2.374,2.415],[9.854,9.765,9.782,9.702,9.735,9.682],[2.464,2.381,2.443,2.474,2.458,2.371],[0.922,0.411,0.413,0.420,0.424,0.412],[null,null,null,null,null,null],[0.688,0.559,0.532,0.585,0.538,0.530],[1.446,1.379,1.401,1.396,1.406,1.381],[0.939,0.430,0.436,0.431,0.436,0.427],[1.472,1.371,1.318,1.298,1.289,1.259],[0.400,0.337,0.337,0.341,0.342,0.337],[2.450,2.375,2.385,2.383,2.640,2.468],[null,null,null,null,null,null],[24.818,24.774,24.813,24.125,24.678,31.408],[1.353,1.025,0.953,1.047,0.956,0.949],[null,null,null,null,null,null],[2.420,0.737,0.734,0.719,0.696,0.732],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.814,0.345,0.347,0.345,0.346,0.352],[null,null,null,null,null,null],[0.843,0.395,0.383,0.403,0.400,0.398],[42.578,42.767,45.279,43.594,43.021,45.434],[null,null,null,null,null,null],[0.034,0.033,0.033,0.047,0.039,0.053],[1.642,0.449,0.445,0.454,0.449,0.439],[0.051,0.066,0.052,0.077,0.041,0.042],[null,null,null,null,null,null],[4.335,3.810,3.824,3.838,3.896,3.835],[null,null,null,null,null,null],[1.888,1.863,1.853,1.896,1.843,1.868],[0.225,0.150,0.140,0.192,0.150,0.146],[1.089,1.014,1.025,0.993,1.018,0.990],[1.372,1.280,1.359,1.281,1.253,1.219],[null,null,null,null,null,null],[4.428,4.255,4.276,4.321,4.293,4.270],[2.758,2.713,2.681,2.680,2.698,2.691],[3.049,2.956,2.989,3.429,2.979,2.962],[0.249,0.169,0.128,0.131,0.129,0.130],[0.862,0.759,0.712,0.832,0.797,0.821],[null,null,null,null,null,null],[2.411,2.346,2.339,2.482,2.370,2.332],[null,null,null,null,null,null],[41.715,41.320,41.739,41.486,41.421,42.120],[0.301,0.204,0.208,0.203,0.199,0.199],[3.530,3.497,3.420,3.480,3.420,3.496],[null,null,null,null,null,null],[0.660,0.584,0.585,0.590,0.580,0.583],[0.964,0.919,0.895,0.965,0.865,0.864],[0.988,1.000,1.012,0.897,0.940,1.119],[0.898,0.837,0.880,0.837,0.847,0.890],[0.999,0.998,1.004,0.990,1.030,0.957],[17.944,17.748,17.821,17.947,18.497,17.913],[5.658,5.773,5.689,5.659,5.512,5.416],[1.485,1.478,1.524,1.453,1.501,1.489],[null,null,null,null,null,null],[35.639,34.630,34.728,34.688,34.877,36.678],[33.955,35.301,33.524,33.585,38.215,35.945],[38.891,40.638,41.709,35.994,36.991,35.678],[3.907,3.965,3.775,4.068,3.821,3.937],[2.446,2.412,2.392,2.543,2.362,2.385],[4.275,4.381,4.251,4.242,4.209,4.451],[10.359,10.112,10.038,10.161,9.951,10.236],[10.263,10.143,10.033,10.305,10.152,10.210],[10.951,10.304,10.407,10.623,10.358,10.313],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[37.458,36.876,36.930,38.165,41.414,40.356],[45.571,46.339,45.553,46.220,46.671,45.635],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.369,4.307,4.149,4.186,4.362,4.292],[4.898,4.783,4.974,5.043,4.781,4.845],[0.036,0.036,0.035,0.035,0.038,0.035],[0.036,0.035,0.036,0.041,0.037,0.056],[3.448,3.369,3.360,3.360,3.340,3.299],[null,null,null,null,null,null],[4.593,4.348,4.243,4.186,4.217,4.154],[4.977,4.694,4.639,4.706,4.771,4.831],[4.494,4.233,4.330,4.220,4.238,4.424],[3.749,3.574,3.564,3.381,3.508,3.356],[4.553,4.618,4.482,4.456,4.644,4.788],[4.571,4.547,4.638,4.611,4.485,4.383],[4.749,4.493,4.656,4.652,4.646,4.477],[3.049,2.744,2.781,2.749,2.759,2.989],[2.426,2.177,2.407,2.188,2.218,2.400],[4.017,3.778,3.803,3.831,3.902,3.904],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.866,5.781,5.601,5.876,5.760,5.603],[0.038,0.030,0.032,0.029,0.030,0.036],[5.071,4.753,4.839,4.721,4.970,4.830],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.066,0.049,0.055,0.059,0.050,0.050],[0.057,0.052,0.047,0.048,0.060,0.047],[0.061,0.050,0.076,0.054,0.051,0.048],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.111,0.096,0.092,0.092,0.089,0.088],[0.092,0.090,0.089,0.088,0.088,0.089],[0.096,0.089,0.089,0.090,0.090,0.089],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.532,1.508,1.499,1.511,1.470,1.415],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.11.6.44","source":"results/22.11.6.44.json"} +,{"actual_version":"22.3.20.29","data_size":{"coffeeshop":44754466088,"hits":14379625463,"job":1830189202,"mgbench":2958722518,"ontime":2704903445,"ssb":72907434983,"taxi":24216948471,"tpcds":18809434313,"tpch":17374528972,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":800,"hits":211,"job":27,"mgbench":65,"ontime":56,"ssb":1453,"taxi":662,"tpcds":279,"tpch":260,"uk":34},"machine":"c7a.4xlarge","release_date":"2023-03-31","result":[[0.083,0.014,0.012,0.309,0.012,0.011],[0.072,0.024,0.026,0.025,0.023,0.023],[0.060,0.015,0.014,0.043,0.014,0.012],[0.082,0.038,0.041,0.033,0.041,0.024],[0.052,0.029,0.025,0.071,0.023,0.027],[0.081,0.026,0.025,0.033,0.023,0.023],[0.037,0.013,0.010,0.014,0.010,0.008],[0.074,0.032,0.033,0.029,0.032,0.028],[0.080,0.046,0.049,0.060,0.044,0.044],[0.125,0.091,0.083,0.087,0.093,0.090],[0.587,0.518,0.500,0.510,0.525,0.510],[0.432,0.317,0.315,0.341,0.326,0.325],[0.066,0.022,0.017,0.017,0.029,0.011],[0.083,0.054,0.032,0.024,0.027,0.021],[0.879,0.850,0.844,0.864,0.809,0.807],[0.211,0.111,0.108,0.107,0.106,0.109],[0.045,0.026,0.021,0.020,0.020,0.021],[0.198,0.158,0.156,0.155,0.155,0.154],[6.394,1.403,1.421,1.414,1.406,1.402],[4.714,1.021,1.028,1.022,1.027,1.012],[4.729,1.045,1.043,1.039,1.050,1.058],[5.364,1.827,1.831,1.845,1.831,1.841],[6.223,1.699,1.698,1.705,1.707,1.714],[3.995,1.007,1.007,0.998,1.004,1.011],[0.060,0.039,0.033,0.034,0.036,0.036],[7.680,2.062,2.071,2.077,2.079,2.068],[2.294,1.007,1.006,1.004,1.015,1.013],[1.901,0.571,0.572,0.565,0.568,0.562],[0.016,0.002,0.002,0.002,0.002,0.002],[0.044,0.017,0.016,0.015,0.016,0.016],[0.057,0.029,0.028,0.040,0.027,0.026],[0.069,0.033,0.033,0.030,0.031,0.033],[0.168,0.137,0.142,0.140,0.145,0.139],[0.256,0.219,0.212,0.213,0.215,0.214],[0.013,0.002,0.002,0.015,0.002,0.002],[0.030,0.016,0.016,0.015,0.016,0.014],[0.325,0.280,0.281,0.290,0.283,0.278],[0.359,0.315,0.324,0.326,0.318,0.313],[0.143,0.107,0.105,0.100,0.104,0.101],[0.149,0.208,0.118,0.135,0.122,0.119],[0.467,0.341,0.340,0.360,0.356,0.349],[0.571,0.479,0.473,0.482,0.498,0.498],[0.548,0.427,0.426,0.406,0.442,0.444],[0.441,0.365,0.362,0.368,0.364,0.368],[1.306,1.148,1.102,1.125,1.100,1.119],[0.839,0.750,0.749,0.787,0.774,0.757],[2.967,2.918,2.703,2.759,2.629,2.774],[0.079,0.071,0.037,0.056,0.036,0.049],[1.512,0.381,0.363,0.361,0.362,0.378],[1.762,0.456,0.406,0.433,0.437,0.404],[4.103,1.180,1.180,1.190,1.175,1.186],[3.227,0.546,0.538,0.534,0.524,0.521],[0.208,0.118,0.113,0.116,0.114,0.115],[0.142,0.095,0.097,0.094,0.099,0.094],[0.170,0.113,0.110,0.110,0.113,0.111],[1.420,0.497,0.508,0.507,0.493,0.510],[1.068,0.623,0.620,0.612,0.622,0.615],[1.084,1.033,1.043,1.195,1.037,1.038],[0.338,0.287,0.295,0.274,0.263,0.262],[0.515,0.409,0.396,0.395,0.408,0.411],[2.609,null,null,null,null,null],[2.353,1.914,1.893,1.872,1.853,1.843],[2.223,1.908,1.820,1.832,1.849,1.854],[0.855,0.748,0.742,0.709,0.720,0.734],[0.142,0.070,0.081,0.061,0.062,0.074],[0.098,0.071,0.061,0.041,0.030,0.035],[0.088,0.031,0.037,0.029,0.025,0.029],[0.259,0.158,0.174,0.161,0.156,0.132],[0.044,0.014,0.010,0.013,0.014,0.011],[0.045,0.009,0.013,0.012,0.013,0.010],[0.030,0.006,0.006,0.008,0.005,0.006],[0.140,0.074,0.074,0.079,0.075,0.077],[0.182,0.091,0.091,0.093,0.094,0.093],[0.098,0.052,0.049,0.056,0.046,0.044],[0.104,0.063,0.061,0.070,0.063,0.063],[0.066,0.041,0.042,0.039,0.039,0.038],[0.116,0.068,0.065,0.063,0.063,0.064],[0.140,0.091,0.090,0.091,0.090,0.089],[0.067,0.038,0.037,0.038,0.037,0.036],[0.109,0.071,0.063,0.097,0.064,0.065],[0.209,0.159,0.158,0.164,0.156,0.157],[0.251,0.209,0.211,0.223,0.210,0.205],[0.472,0.395,0.394,0.401,0.398,0.402],[0.147,0.075,0.075,0.080,0.078,0.078],[0.447,0.349,0.338,0.343,0.333,0.338],[2.446,2.324,2.296,2.311,2.265,2.271],[8.667,1.157,1.150,1.172,1.152,1.155],[1.783,1.098,1.107,1.092,1.098,1.090],[12.834,3.740,3.723,3.727,3.715,3.725],[4.317,3.216,3.218,3.211,3.221,3.226],[4.102,1.794,1.793,1.793,1.790,1.792],[4.279,4.172,4.176,4.271,4.279,4.261],[null,null,null,null,null,null],[3.445,3.223,3.224,3.220,3.234,3.228],[null,null,null,null,null,null],[5.165,5.011,5.007,5.007,5.016,5.004],[null,null,null,null,null,null],[3.217,3.109,3.106,3.120,3.104,3.100],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.723,0.757,0.759,0.568,0.532,0.544],[null,null,null,null,null,null],[13.607,13.654,13.735,13.641,13.682,13.645],[null,null,null,null,null,null],[23.151,23.153,23.397,23.204,23.215,23.290],[0.195,0.101,0.099,0.096,0.093,0.092],[34.966,34.963,35.711,34.072,34.262,34.163],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.891,7.783,7.810,7.779,7.769,7.709],[0.533,0.466,0.454,0.450,0.448,0.438],[0.678,0.526,0.512,0.532,0.528,0.529],[7.265,7.284,7.315,7.547,7.382,7.365],[1.026,0.925,0.901,0.921,0.873,0.859],[0.323,0.204,0.192,0.195,0.195,0.208],[0.450,0.378,0.371,0.376,0.378,0.380],[null,null,null,null,null,null],[27.979,27.938,27.957,27.784,28.095,28.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.537,1.288,1.191,1.196,1.172,1.183],[3.698,3.637,3.499,3.501,3.609,3.549],[95.163,94.107,94.838,97.428,96.621,91.750],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.345,0.684,0.666,0.606,0.597,0.580],[1.149,1.048,0.989,1.011,1.014,0.990],[1.079,0.980,0.976,0.979,0.963,0.955],[null,null,null,null,null,null],[47.426,47.814,47.497,47.792,51.792,52.778],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.871,0.786,0.818,0.789,0.791,0.795],[null,null,null,null,null,null],[13.086,12.727,12.698,12.869,12.670,12.576],[null,null,null,null,null,null],[2.825,2.702,2.590,2.706,2.832,2.728],[null,null,null,null,null,null],[0.262,0.174,0.168,0.192,0.184,0.174],[0.307,0.225,0.221,0.206,0.213,0.201],[6.485,6.100,6.109,6.213,6.103,6.168],[12.662,12.622,12.386,12.442,12.494,12.536],[5.824,5.359,5.385,5.377,5.290,5.310],[5.479,5.272,5.300,5.267,5.286,5.304],[12.814,12.728,12.692,12.559,12.567,12.729],[0.429,0.326,0.322,0.325,0.308,0.328],[null,null,null,null,null,null],[1.061,0.955,0.971,0.951,0.941,0.951],[12.666,12.636,12.660,12.576,12.559,12.623],[null,null,null,null,null,null],[1.580,1.431,1.444,1.400,1.398,1.375],[null,null,null,null,null,null],[0.949,0.468,0.443,0.479,0.475,0.456],[0.803,0.532,0.521,0.518,0.510,0.519],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.153,1.094,1.052,1.062,1.064,1.060],[6.232,6.032,6.047,6.042,6.021,6.133],[0.489,0.435,0.422,0.415,0.423,0.423],[0.482,0.420,0.424,0.418,0.429,0.425],[1.379,1.303,1.297,1.303,1.289,1.279],[null,null,null,null,null,null],[2.190,2.088,2.099,2.090,2.102,2.142],[6.387,6.284,6.318,6.389,6.385,6.392],[0.080,0.055,0.056,0.053,0.064,0.053],[0.621,0.510,0.523,0.539,0.547,0.543],[1.874,0.927,0.912,0.911,0.936,0.907],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.243,4.278,4.167,4.262,4.211,4.150],[6.527,6.523,6.674,6.431,6.883,6.945],[2.156,2.097,2.115,2.181,2.094,2.081],[2.174,2.089,2.150,2.431,2.164,2.213],[7.632,7.442,7.427,7.392,7.417,7.374],[2.127,2.100,2.119,2.173,2.065,2.152],[0.989,0.510,0.518,0.524,0.536,0.575],[null,null,null,null,null,null],[0.808,0.623,0.635,0.649,0.633,0.620],[2.083,1.999,1.954,1.965,1.966,1.963],[0.971,0.542,0.533,0.560,0.527,0.536],[1.602,1.448,1.403,1.341,1.363,1.368],[0.448,0.383,0.375,0.373,0.387,0.384],[2.233,2.124,2.116,2.206,2.120,2.132],[null,null,null,null,null,null],[20.910,26.849,21.169,20.943,20.774,28.864],[1.336,1.108,1.077,1.134,1.115,1.070],[null,null,null,null,null,null],[2.493,0.818,0.807,0.783,0.801,0.806],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.874,0.370,0.365,0.363,0.368,0.370],[null,null,null,null,null,null],[0.767,0.432,0.426,0.443,0.422,0.446],[36.700,36.467,33.868,33.974,33.885,36.456],[null,null,null,null,null,null],[0.044,0.033,0.033,0.042,0.038,0.044],[1.690,0.517,0.529,0.510,0.524,0.511],[0.049,0.052,0.050,0.052,0.040,0.039],[null,null,null,null,null,null],[4.843,4.588,4.500,4.551,4.552,4.504],[null,null,null,null,null,null],[1.829,1.718,1.757,1.707,1.724,1.724],[0.255,0.152,0.160,0.185,0.158,0.149],[0.969,0.915,0.895,0.906,0.912,0.911],[1.622,1.448,1.457,1.469,1.475,1.454],[null,null,null,null,null,null],[6.316,6.099,6.099,6.105,6.093,6.130],[2.947,2.876,2.872,2.935,2.896,2.858],[2.882,3.233,2.822,2.851,2.895,2.840],[0.299,0.158,0.158,0.155,0.161,0.158],[0.892,0.764,0.624,0.727,0.697,0.738],[null,null,null,null,null,null],[2.751,2.557,2.586,2.565,2.604,2.603],[null,null,null,null,null,null],[36.545,36.366,36.256,36.273,36.405,36.430],[0.299,0.224,0.235,0.220,0.231,0.219],[4.856,4.731,4.747,4.779,4.807,4.792],[null,null,null,null,null,null],[0.679,0.618,0.617,0.623,0.616,0.612],[1.079,0.982,0.947,1.008,0.985,0.957],[1.117,1.143,1.068,1.087,1.073,1.061],[1.028,0.953,0.970,0.938,0.955,0.951],[1.103,1.077,1.046,1.072,1.073,1.000],[19.883,19.977,19.981,20.049,19.909,19.852],[6.071,8.915,6.014,6.052,6.113,6.013],[1.688,1.544,1.577,1.522,1.611,1.563],[null,null,null,null,null,null],[33.542,33.166,33.071,33.753,33.233,33.133],[32.960,32.616,32.508,32.624,32.373,32.558],[35.212,36.161,35.621,34.924,34.934,34.871],[4.237,4.174,4.325,4.182,4.227,4.269],[2.722,2.570,2.586,2.535,2.616,2.579],[4.660,4.455,4.622,4.608,4.603,4.703],[10.729,10.445,10.402,10.392,10.332,10.349],[10.739,10.542,10.559,10.522,10.516,10.525],[10.778,10.618,10.525,10.538,10.623,10.510],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[35.200,34.840,34.983,35.130,34.906,34.764],[40.587,39.182,38.999,38.779,39.125,39.103],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.906,3.884,3.935,3.877,3.830,3.891],[4.529,4.399,4.419,4.417,4.451,4.433],[0.058,0.040,0.040,0.041,0.045,0.039],[0.049,0.044,0.044,0.038,0.038,0.038],[3.490,3.367,3.361,3.472,3.549,3.328],[null,null,null,null,null,null],[4.459,4.167,4.189,4.146,4.140,4.121],[4.823,4.489,4.524,4.538,4.552,4.566],[4.485,4.128,4.110,4.084,4.154,4.186],[3.578,3.275,3.296,3.332,3.329,3.296],[4.483,4.363,4.398,4.289,4.352,4.424],[4.423,4.345,4.378,4.265,4.411,4.359],[4.532,4.397,4.348,4.417,4.365,4.425],[3.142,2.644,2.662,2.537,2.627,2.731],[2.473,2.204,2.236,2.201,2.218,2.288],[3.867,3.573,3.977,3.651,3.631,3.701],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.887,5.559,5.570,5.603,5.554,5.516],[0.052,0.038,0.044,0.040,0.034,0.035],[5.126,4.900,4.978,4.811,4.839,4.952],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.078,0.064,0.055,0.055,0.058,0.054],[0.072,0.055,0.053,0.068,0.055,0.071],[0.059,0.054,0.059,0.064,0.092,0.075],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.129,0.100,0.111,0.105,0.113,0.100],[0.105,0.102,0.100,0.108,0.097,0.099],[0.115,0.099,0.113,0.100,0.100,0.103],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.486,1.369,1.383,1.407,1.376,1.377],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.3.20.29","source":"results/22.3.20.29.json"} +,{"actual_version":"22.12.6.22","data_size":{"coffeeshop":44754491805,"hits":14351258179,"job":1830189202,"mgbench":2958722518,"ontime":2704903445,"ssb":72904434729,"taxi":24216906591,"tpcds":18812035933,"tpch":17375742796,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":796,"hits":232,"job":25,"mgbench":70,"ontime":61,"ssb":1426,"taxi":531,"tpcds":305,"tpch":277,"uk":31},"machine":"c7a.4xlarge","release_date":"2023-03-31","result":[[0.073,0.012,0.008,0.365,0.008,0.009],[0.058,0.021,0.021,0.022,0.020,0.020],[0.056,0.021,0.009,0.058,0.009,0.009],[0.053,0.010,0.012,0.012,0.011,0.010],[0.050,0.023,0.022,0.046,0.025,0.023],[0.074,0.015,0.015,0.033,0.015,0.014],[0.030,0.006,0.007,0.006,0.006,0.007],[0.073,0.026,0.026,0.027,0.025,0.026],[0.072,0.033,0.037,0.060,0.043,0.036],[0.081,0.055,0.060,0.052,0.052,0.055],[0.485,0.416,0.411,0.409,0.399,0.411],[0.346,0.223,0.266,0.239,0.214,0.224],[0.034,0.008,0.010,0.009,0.009,0.011],[0.041,0.011,0.014,0.013,0.011,0.012],[0.852,0.684,0.675,0.737,0.640,0.655],[0.597,0.072,0.072,0.069,0.069,0.072],[0.045,0.012,0.014,0.012,0.012,0.012],[0.048,0.013,0.013,0.014,0.013,0.013],[6.414,1.368,1.374,1.429,1.392,1.375],[4.705,1.031,1.047,1.043,1.044,1.028],[4.716,1.087,1.050,1.093,1.080,1.116],[5.385,1.719,1.719,1.748,1.728,1.710],[6.221,1.472,1.469,1.477,1.489,1.489],[3.969,0.947,0.935,0.936,0.913,0.930],[0.059,0.030,0.025,0.028,0.031,0.025],[7.683,2.026,2.039,2.044,1.975,1.975],[2.385,0.942,0.913,0.912,0.944,0.955],[2.048,0.519,0.514,0.521,0.511,0.508],[0.004,0.001,0.002,0.001,0.001,0.001],[0.028,0.010,0.008,0.008,0.008,0.007],[0.060,0.019,0.018,0.035,0.016,0.017],[0.140,0.022,0.022,0.025,0.020,0.022],[0.164,0.057,0.055,0.057,0.055,0.053],[0.304,0.139,0.137,0.132,0.136,0.135],[0.002,0.001,0.001,0.022,0.002,0.002],[0.023,0.008,0.009,0.009,0.009,0.009],[0.346,0.230,0.232,0.238,0.228,0.230],[0.393,0.257,0.258,0.256,0.256,0.261],[0.203,0.080,0.080,0.081,0.092,0.083],[0.220,0.098,0.100,0.096,0.096,0.104],[0.481,0.276,0.277,0.277,0.274,0.273],[0.648,0.387,0.375,0.380,0.396,0.378],[0.588,0.385,0.379,0.380,0.392,0.381],[0.369,0.249,0.248,0.250,0.248,0.243],[1.237,0.998,0.997,0.984,0.978,0.970],[0.809,0.650,0.630,0.643,0.636,0.629],[2.569,2.056,2.039,2.061,2.058,2.053],[0.138,0.031,0.023,0.021,0.026,0.021],[1.481,0.371,0.327,0.327,0.329,0.342],[1.763,0.351,0.351,0.375,0.358,0.351],[4.036,1.028,1.019,1.042,1.005,1.013],[3.031,0.411,0.433,0.415,0.409,0.402],[0.485,0.097,0.101,0.098,0.101,0.099],[0.290,0.085,0.081,0.085,0.081,0.081],[0.472,0.102,0.101,0.102,0.100,0.096],[1.559,0.361,0.363,0.384,0.380,0.355],[1.393,0.540,0.541,0.546,0.530,0.547],[0.936,0.944,0.931,1.021,0.914,0.928],[0.533,0.255,0.249,0.247,0.233,0.217],[0.937,0.295,0.296,0.297,0.294,0.303],[2.085,1.644,1.656,1.657,1.677,1.675],[2.504,1.731,1.708,1.696,1.721,1.706],[2.540,1.750,1.706,1.694,1.724,1.736],[0.589,0.524,0.575,0.571,0.540,0.547],[0.111,0.056,0.048,0.048,0.052,0.050],[0.052,0.030,0.036,0.025,0.021,0.026],[0.069,0.022,0.026,0.033,0.023,0.025],[0.183,0.128,0.120,0.126,0.117,0.105],[0.047,0.010,0.014,0.010,0.008,0.009],[0.039,0.007,0.007,0.008,0.009,0.007],[0.015,0.004,0.004,0.004,0.004,0.004],[0.414,0.044,0.043,0.057,0.039,0.041],[0.495,0.059,0.056,0.053,0.057,0.052],[0.125,0.033,0.033,0.046,0.030,0.032],[0.243,0.061,0.051,0.068,0.053,0.051],[0.081,0.029,0.028,0.027,0.029,0.028],[0.189,0.062,0.063,0.063,0.062,0.063],[0.250,0.091,0.083,0.085,0.083,0.082],[0.065,0.029,0.031,0.031,0.031,0.030],[0.105,0.056,0.055,0.077,0.055,0.058],[0.266,0.145,0.148,0.147,0.146,0.147],[0.562,0.168,0.162,0.163,0.172,0.163],[0.447,0.291,0.298,0.296,0.288,0.287],[0.156,0.039,0.041,0.038,0.039,0.041],[0.729,0.264,0.266,0.279,0.261,0.273],[2.692,2.046,2.051,2.058,2.047,2.045],[8.679,1.076,1.086,1.095,1.122,1.107],[2.343,0.970,0.971,0.953,0.953,0.967],[12.838,3.546,3.520,3.529,3.525,3.528],[4.290,3.021,3.024,3.030,3.042,3.013],[4.091,1.678,1.687,1.716,1.692,1.702],[4.674,4.356,4.454,4.281,4.420,4.555],[null,null,null,null,null,null],[3.529,3.224,3.205,3.309,3.244,3.209],[null,null,null,null,null,null],[5.249,4.914,4.914,4.799,4.843,4.757],[null,null,null,null,null,null],[3.313,3.058,3.055,3.051,3.032,3.127],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.720,0.665,0.656,0.499,0.429,0.425],[null,null,null,null,null,null],[16.330,16.120,16.256,16.238,16.136,16.363],[null,null,null,null,null,null],[27.695,27.138,27.100,27.240,27.369,27.245],[0.304,0.062,0.061,0.056,0.056,0.057],[39.937,41.201,41.339,37.804,40.133,37.636],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.520,8.184,8.094,8.218,8.086,8.098],[0.519,0.407,0.397,0.394,0.407,0.420],[1.308,0.449,0.442,0.467,0.433,0.454],[9.018,8.963,9.145,8.862,8.765,8.802],[0.873,0.782,0.772,0.806,0.750,0.774],[0.301,0.110,0.104,0.128,0.111,0.111],[0.420,0.322,0.327,0.328,0.329,0.305],[null,null,null,null,null,null],[31.264,30.407,29.829,30.232,29.903,30.321],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.890,0.731,0.668,0.667,0.648,0.639],[4.155,4.055,4.158,4.110,4.108,4.083],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.183,0.475,0.473,0.497,0.468,0.474],[1.011,0.881,0.851,0.833,0.843,0.846],[1.402,0.922,0.932,0.914,0.925,0.902],[null,null,null,null,null,null],[59.616,57.799,57.498,57.315,62.474,62.337],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.820,0.732,0.738,0.732,0.715,0.690],[null,null,null,null,null,null],[11.470,11.286,11.181,11.132,11.282,11.340],[null,null,null,null,null,null],[3.043,2.967,2.963,2.962,2.879,2.983],[null,null,null,null,null,null],[0.252,0.135,0.134,0.187,0.136,0.136],[0.316,0.184,0.180,0.180,0.193,0.179],[6.343,5.501,5.522,5.530,5.526,5.480],[10.855,10.276,10.661,10.573,10.712,10.375],[5.050,4.773,4.781,4.682,4.838,4.706],[5.023,4.730,4.703,4.821,4.647,4.708],[11.445,11.079,11.269,11.225,11.267,11.393],[0.591,0.247,0.246,0.244,0.247,0.242],[null,null,null,null,null,null],[1.444,0.993,1.007,1.005,1.019,1.007],[11.704,11.501,11.441,11.342,11.469,11.292],[null,null,null,null,null,null],[1.710,1.265,1.254,1.228,1.220,1.248],[null,null,null,null,null,null],[1.216,0.400,0.396,0.383,0.389,0.394],[0.930,0.465,0.488,0.484,0.468,0.453],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.258,1.246,1.196,1.225,1.145,1.206],[4.266,4.084,4.159,4.104,4.111,4.119],[0.457,0.429,0.407,0.425,0.425,0.406],[0.455,0.411,0.409,0.416,0.411,0.415],[1.242,1.207,1.137,1.198,1.141,1.147],[null,null,null,null,null,null],[2.545,2.437,2.399,2.362,2.466,2.433],[6.545,6.557,6.646,6.611,6.647,6.776],[0.086,0.059,0.119,0.086,0.043,0.063],[0.603,0.495,0.455,0.479,0.486,0.476],[1.776,0.818,0.789,0.808,0.772,0.761],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.761,3.629,3.751,3.879,3.728,3.735],[3.677,3.311,3.375,3.409,3.397,3.652],[2.465,2.441,2.414,2.461,2.470,2.444],[2.401,2.336,2.364,2.351,2.418,2.398],[10.094,9.823,9.882,9.902,9.931,9.787],[2.467,2.435,2.426,2.367,2.511,2.517],[1.288,0.393,0.407,0.417,0.413,0.419],[null,null,null,null,null,null],[1.012,0.520,0.515,0.556,0.512,0.508],[1.414,1.307,1.305,1.318,1.308,1.289],[1.274,0.438,0.446,0.438,0.436,0.431],[1.619,1.311,1.241,1.254,1.220,1.284],[0.409,0.322,0.327,0.330,0.323,0.318],[2.442,2.355,2.356,2.368,2.334,2.358],[null,null,null,null,null,null],[24.544,24.075,24.250,24.111,24.090,28.412],[1.362,0.947,0.897,0.958,0.877,0.873],[null,null,null,null,null,null],[2.437,0.677,0.674,0.681,0.666,0.646],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.909,0.335,0.329,0.334,0.340,0.338],[null,null,null,null,null,null],[0.844,0.392,0.377,0.364,0.370,0.370],[44.431,44.155,42.040,42.036,41.993,41.731],[null,null,null,null,null,null],[0.047,0.035,0.032,0.047,0.035,0.032],[1.632,0.410,0.411,0.406,0.409,0.408],[0.046,0.054,0.037,0.079,0.041,0.038],[null,null,null,null,null,null],[4.419,3.699,3.644,3.660,3.702,3.651],[null,null,null,null,null,null],[1.881,1.833,1.829,1.829,1.831,1.820],[0.242,0.143,0.132,0.176,0.132,0.137],[1.099,1.029,1.044,0.983,0.969,0.974],[1.420,1.221,1.203,1.227,1.192,1.219],[null,null,null,null,null,null],[4.151,4.050,4.026,4.027,4.020,4.019],[2.771,2.486,2.486,2.495,2.489,2.504],[2.970,2.969,2.872,2.883,2.884,2.877],[0.243,0.128,0.119,0.117,0.122,0.127],[0.975,0.753,0.779,0.722,0.810,0.758],[null,null,null,null,null,null],[2.446,2.424,2.276,2.279,2.366,2.270],[null,null,null,null,null,null],[41.078,40.926,41.420,41.370,41.158,40.893],[0.545,0.189,0.192,0.188,0.185,0.185],[3.608,3.625,3.289,3.527,3.281,3.345],[null,null,null,null,null,null],[0.604,0.517,0.522,0.522,0.518,0.517],[0.955,0.898,0.878,0.918,0.866,0.820],[1.001,0.894,0.948,1.070,1.008,0.916],[0.856,0.877,0.990,0.836,0.864,0.862],[1.014,1.015,1.010,0.953,0.945,0.982],[18.005,17.702,17.780,17.882,17.807,18.026],[5.439,5.380,5.556,5.630,5.498,6.266],[1.518,1.437,1.393,1.432,1.388,1.415],[null,null,null,null,null,null],[36.697,35.373,33.032,33.040,34.847,37.197],[32.945,37.868,32.388,32.450,32.626,37.960],[35.577,40.096,38.627,35.869,41.308,38.963],[3.830,3.791,3.899,3.820,3.819,3.989],[2.424,2.417,2.221,2.449,2.277,2.374],[4.303,4.228,4.266,4.357,4.227,4.293],[10.185,9.879,9.852,9.785,9.905,9.837],[10.209,9.805,9.794,9.888,9.928,9.872],[10.345,10.023,9.968,10.048,9.953,10.027],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[35.745,35.550,35.737,35.572,35.986,35.650],[40.611,40.171,40.516,40.232,40.331,40.399],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.949,3.928,3.793,3.852,3.851,3.858],[4.501,4.557,4.424,4.361,4.401,4.352],[0.050,0.036,0.032,0.031,0.031,0.031],[0.039,0.031,0.031,0.031,0.039,0.031],[3.146,3.184,3.046,3.064,3.117,3.274],[null,null,null,null,null,null],[4.339,3.908,3.898,3.910,3.893,3.876],[4.811,4.359,4.253,4.271,4.404,4.286],[4.269,3.898,3.923,3.870,4.071,3.855],[3.485,3.135,3.065,3.065,3.051,3.117],[4.151,4.199,4.223,4.174,4.214,4.102],[4.218,4.201,4.152,4.142,4.143,4.116],[4.301,4.158,4.190,4.135,4.193,4.119],[2.976,2.620,2.488,2.510,2.467,2.726],[2.477,2.043,2.069,1.898,2.008,2.036],[3.849,3.448,3.469,3.597,3.465,3.367],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.562,5.054,5.075,5.061,5.322,5.236],[0.032,0.027,0.029,0.031,0.041,0.026],[4.777,4.378,4.352,4.227,4.410,4.269],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.055,0.058,0.054,0.044,0.043,0.044],[0.051,0.060,0.041,0.042,0.042,0.043],[0.056,0.042,0.042,0.047,0.043,0.045],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.084,0.079,0.079,0.080,0.079,0.078],[0.078,0.077,0.086,0.078,0.077,0.091],[0.079,0.091,0.079,0.078,0.078,0.081],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.401,1.312,1.255,1.456,1.279,1.310],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.12.6.22","source":"results/22.12.6.22.json"} +,{"actual_version":"23.1.7.30","data_size":{"coffeeshop":44756576609,"hits":14344347526,"job":1830189202,"mgbench":2958722518,"ontime":2704903445,"ssb":72904624622,"taxi":24216757300,"tpcds":18816752312,"tpch":17376312462,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":773,"hits":225,"job":28,"mgbench":68,"ontime":57,"ssb":1434,"taxi":513,"tpcds":304,"tpch":273,"uk":32},"machine":"c7a.4xlarge","release_date":"2023-04-22","result":[[0.065,0.009,0.008,0.008,0.008,0.008],[0.053,0.020,0.020,0.025,0.020,0.020],[0.048,0.249,0.009,0.009,0.009,0.010],[0.048,0.012,0.010,0.011,0.010,0.011],[0.046,0.024,0.022,0.024,0.028,0.023],[0.077,0.016,0.015,0.017,0.016,0.015],[0.029,0.006,0.006,0.006,0.007,0.006],[0.067,0.027,0.027,0.027,0.028,0.027],[0.070,0.040,0.039,0.039,0.035,0.034],[0.080,0.053,0.052,0.053,0.050,0.051],[0.466,0.400,0.410,0.393,0.386,0.402],[0.318,0.211,0.208,0.209,0.209,0.207],[0.030,0.012,0.010,0.011,0.009,0.008],[0.042,0.025,0.018,0.012,0.010,0.010],[0.814,0.674,0.681,0.672,0.685,0.674],[0.488,0.077,0.066,0.065,0.067,0.066],[0.056,0.014,0.014,0.013,0.011,0.011],[0.037,0.012,0.011,0.012,0.012,0.013],[6.389,1.399,1.394,1.402,1.423,1.397],[4.695,1.060,1.047,1.058,1.053,1.062],[4.707,1.096,1.089,1.091,1.084,1.094],[5.370,1.764,1.756,1.771,1.760,1.774],[6.196,1.526,1.519,1.524,1.512,1.513],[3.966,0.946,0.948,0.931,0.951,0.951],[0.058,0.034,0.029,0.031,0.026,0.031],[7.660,2.043,2.022,2.038,2.036,2.038],[2.259,0.964,0.950,0.951,0.946,0.954],[1.861,0.504,0.511,0.508,0.519,0.501],[0.003,0.001,0.001,0.001,0.001,0.001],[0.023,0.008,0.008,0.008,0.007,0.009],[0.056,0.016,0.016,0.015,0.019,0.017],[0.113,0.020,0.021,0.022,0.019,0.021],[0.148,0.061,0.054,0.056,0.056,0.051],[0.270,0.132,0.134,0.128,0.126,0.127],[0.002,0.001,0.001,0.001,0.001,0.001],[0.020,0.011,0.008,0.009,0.008,0.008],[0.326,0.227,0.222,0.224,0.218,0.224],[0.369,0.274,0.260,0.259,0.266,0.260],[0.180,0.084,0.086,0.086,0.085,0.085],[0.199,0.104,0.100,0.100,0.100,0.100],[0.435,0.289,0.271,0.279,0.271,0.279],[0.570,0.373,0.371,0.381,0.371,0.375],[0.519,0.392,0.396,0.371,0.388,0.386],[0.355,0.248,0.246,0.244,0.240,0.242],[1.172,0.989,0.970,0.966,0.978,0.964],[0.766,0.648,0.621,0.632,0.652,0.641],[2.498,2.074,2.030,2.064,2.062,2.035],[0.127,0.021,0.034,0.024,0.023,0.022],[1.413,0.380,0.406,0.369,0.370,0.377],[1.741,0.347,0.363,0.368,0.379,0.352],[4.014,0.986,0.973,0.978,0.989,0.976],[2.867,0.439,0.442,0.455,0.431,0.432],[0.400,0.103,0.104,0.103,0.102,0.104],[0.238,0.086,0.088,0.083,0.082,0.081],[0.369,0.102,0.105,0.101,0.102,0.108],[1.403,0.334,0.344,0.358,0.365,0.343],[1.208,0.542,0.546,0.542,0.534,0.543],[0.909,0.906,0.906,0.910,0.903,0.894],[0.440,0.256,0.254,0.266,0.244,0.247],[0.849,0.379,0.339,0.333,0.340,0.341],[2.363,2.052,2.019,2.046,2.081,2.075],[2.341,1.697,1.681,1.689,1.692,1.702],[2.362,1.696,1.696,1.670,1.688,1.694],[0.577,0.548,0.474,0.561,0.517,0.567],[0.087,0.057,0.053,0.062,0.057,0.050],[0.038,0.026,0.029,0.028,0.026,0.023],[0.054,0.027,0.019,0.021,0.029,0.021],[0.172,0.123,0.145,0.124,0.142,0.128],[0.039,0.008,0.009,0.008,0.010,0.008],[0.032,0.009,0.007,0.010,0.009,0.015],[0.022,0.004,0.008,0.004,0.008,0.004],[0.359,0.042,0.040,0.038,0.038,0.042],[0.423,0.058,0.053,0.051,0.058,0.053],[0.109,0.035,0.038,0.031,0.031,0.032],[0.219,0.052,0.053,0.053,0.052,0.052],[0.075,0.030,0.029,0.028,0.028,0.028],[0.165,0.062,0.062,0.061,0.063,0.067],[0.222,0.084,0.082,0.084,0.082,0.082],[0.061,0.031,0.031,0.032,0.032,0.031],[0.097,0.057,0.054,0.157,0.056,0.054],[0.257,0.149,0.149,0.147,0.148,0.151],[0.500,0.164,0.170,0.163,0.169,0.169],[0.442,0.298,0.296,0.297,0.296,0.293],[0.140,0.042,0.044,0.043,0.042,0.044],[0.678,0.266,0.266,0.264,0.274,0.264],[2.710,2.197,2.190,2.223,2.198,2.197],[8.636,1.071,1.050,1.075,1.031,1.046],[2.022,1.013,1.008,1.025,1.015,1.009],[12.802,3.538,3.526,3.519,3.516,3.516],[4.292,3.156,3.139,3.141,3.134,3.147],[4.072,1.704,1.769,1.738,1.705,1.710],[4.687,4.535,4.507,4.585,4.447,4.712],[null,null,null,null,null,null],[3.396,3.099,3.193,3.101,3.106,3.114],[null,null,null,null,null,null],[5.089,4.828,4.804,4.863,4.829,4.836],[null,null,null,null,null,null],[3.302,3.033,3.042,3.121,3.066,3.037],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.766,0.653,0.644,0.687,0.639,0.642],[null,null,null,null,null,null],[16.303,16.297,16.338,16.153,16.283,17.946],[null,null,null,null,null,null],[27.705,27.735,27.684,27.566,27.789,27.979],[0.260,0.053,0.057,0.056,0.060,0.055],[40.964,40.647,37.512,37.256,37.205,36.707],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.520,8.350,8.246,8.294,8.242,8.214],[0.489,0.403,0.392,0.402,0.394,0.389],[1.203,0.453,0.456,0.444,0.452,0.454],[9.062,8.994,9.068,8.940,8.960,8.936],[0.810,0.794,0.750,0.882,0.748,0.755],[0.249,0.140,0.111,0.110,0.116,0.112],[0.404,0.308,0.330,0.313,0.328,0.322],[null,null,null,null,null,null],[32.041,30.722,30.841,31.215,30.837,31.497],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.899,0.740,0.740,0.767,0.752,0.731],[4.173,4.095,4.120,4.155,3.996,4.172],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.193,0.478,0.456,0.462,0.465,0.461],[0.996,0.887,0.880,0.878,0.874,0.903],[1.276,0.921,0.923,0.918,0.912,0.916],[null,null,null,null,null,null],[58.814,58.890,61.651,58.460,63.483,58.196],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.815,0.717,0.771,0.768,0.701,0.692],[null,null,null,null,null,null],[11.467,11.330,11.283,11.280,11.280,11.328],[null,null,null,null,null,null],[3.187,3.106,3.196,3.032,3.001,3.086],[null,null,null,null,null,null],[0.252,0.139,0.137,0.169,0.138,0.136],[0.297,0.196,0.179,0.191,0.187,0.182],[5.591,5.089,5.098,5.084,5.094,5.075],[10.435,10.200,10.463,10.285,10.215,10.268],[5.024,4.699,4.773,4.966,4.753,4.818],[5.071,4.842,4.769,4.732,4.864,4.788],[11.412,11.252,11.135,11.071,11.205,11.372],[0.450,0.226,0.226,0.222,0.227,0.224],[null,null,null,null,null,null],[1.280,0.951,0.941,0.947,0.946,0.954],[11.379,11.059,11.238,11.184,11.369,11.093],[null,null,null,null,null,null],[1.565,1.203,1.159,1.183,1.148,1.141],[null,null,null,null,null,null],[0.932,0.359,0.365,0.362,0.363,0.363],[0.778,0.431,0.441,0.441,0.441,0.449],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.287,1.206,1.247,1.242,1.204,1.226],[4.438,4.287,4.251,4.277,4.286,4.326],[0.428,0.377,0.376,0.377,0.386,0.380],[0.432,0.381,0.388,0.379,0.378,0.373],[1.229,1.141,1.114,1.163,1.120,1.097],[null,null,null,null,null,null],[2.448,2.470,2.325,2.446,2.500,2.457],[6.628,6.621,6.571,6.560,6.527,6.585],[0.133,0.048,0.043,0.043,0.046,0.043],[0.582,0.521,0.508,0.492,0.489,0.484],[1.771,0.738,0.772,0.754,0.758,0.719],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.725,3.562,3.523,3.729,3.660,3.545],[3.508,3.242,3.333,3.278,3.425,3.386],[2.498,2.457,2.470,2.335,2.387,2.316],[2.376,2.313,2.326,2.268,2.278,2.267],[10.070,9.953,9.784,9.844,9.775,9.866],[2.431,2.341,2.232,2.504,2.285,2.416],[1.018,0.373,0.387,0.381,0.379,0.379],[null,null,null,null,null,null],[0.851,0.501,0.494,0.558,0.496,0.502],[1.617,1.548,1.584,1.570,1.569,1.554],[0.941,0.400,0.392,0.402,0.403,0.397],[1.485,1.253,1.246,1.226,1.202,1.204],[0.391,0.326,0.318,0.318,0.317,0.315],[2.365,2.272,2.288,2.294,2.277,2.519],[null,null,null,null,null,null],[31.767,24.314,32.081,30.774,27.242,27.120],[1.323,0.896,0.897,0.897,0.898,0.904],[null,null,null,null,null,null],[2.424,0.674,0.657,0.629,0.644,0.637],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.841,0.379,0.363,0.378,0.374,0.382],[null,null,null,null,null,null],[0.757,0.355,0.347,0.361,0.364,0.356],[42.254,42.248,44.543,42.706,42.647,45.310],[null,null,null,null,null,null],[0.054,0.039,0.038,0.043,0.038,0.049],[1.654,0.418,0.402,0.399,0.398,0.393],[0.051,0.052,0.050,0.062,0.045,0.045],[null,null,null,null,null,null],[4.323,3.703,3.705,3.670,3.714,3.657],[null,null,null,null,null,null],[1.916,1.877,1.850,1.845,1.848,1.836],[0.251,0.148,0.138,0.188,0.146,0.134],[1.117,1.041,1.021,1.067,1.036,1.061],[1.390,1.264,1.238,1.233,1.244,1.223],[null,null,null,null,null,null],[4.411,4.268,4.305,4.339,4.319,4.278],[2.681,2.487,2.476,2.482,2.472,2.481],[2.900,2.769,2.751,2.785,2.753,3.290],[0.233,0.120,0.119,0.117,0.121,0.133],[0.888,0.831,0.814,0.713,0.815,0.797],[null,null,null,null,null,null],[2.389,2.358,2.301,2.313,2.318,2.296],[null,null,null,null,null,null],[41.295,41.134,40.737,40.843,41.131,40.652],[0.477,0.183,0.182,0.179,0.184,0.192],[3.607,3.478,4.832,3.388,3.493,3.351],[null,null,null,null,null,null],[0.613,0.530,0.531,0.533,0.534,0.530],[0.971,0.860,0.863,0.856,0.872,0.866],[1.027,0.984,0.939,0.931,0.956,0.899],[0.877,0.846,0.993,0.820,0.861,0.844],[1.070,1.064,1.044,0.960,0.964,0.990],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.168,6.465,6.037,5.979,5.884,5.929],[4.131,4.445,4.494,4.205,4.329,4.387],[6.562,6.687,6.147,6.610,6.226,6.635],[13.332,null,null,null,null,null],[13.763,13.123,13.235,13.198,13.507,12.940],[13.735,13.266,13.528,13.682,13.507,13.495],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[41.605,40.146,40.096,40.312,40.504,40.572],[45.226,45.510,45.161,45.637,45.532,46.469],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.790,6.010,6.361,6.541,6.144,6.328],[7.142,7.013,6.862,6.824,6.856,7.483],[0.061,0.037,0.039,0.038,0.038,0.044],[0.036,0.038,0.042,0.041,0.103,0.043],[5.179,4.943,5.037,4.880,4.958,4.854],[null,null,null,null,null,null],[7.095,6.539,6.603,6.627,6.794,6.586],[7.429,7.071,7.127,6.787,6.789,6.998],[6.985,6.981,6.683,6.714,6.746,6.631],[5.862,5.608,5.531,5.672,5.544,5.756],[6.756,6.592,7.202,6.517,6.708,6.764],[7.109,6.802,6.991,6.861,6.581,6.919],[6.814,6.989,6.624,6.737,6.640,7.018],[4.662,4.038,3.974,3.978,4.144,3.917],[4.137,3.549,3.580,3.667,3.729,3.528],[5.465,5.455,5.245,5.116,5.493,5.070],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.755,12.062,11.985,11.877,12.386,11.974],[0.065,0.032,0.049,0.032,0.036,0.084],[11.754,11.727,11.717,11.192,11.565,11.798],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.072,0.053,0.052,0.067,0.052,0.049],[0.050,0.050,0.051,0.217,0.064,0.056],[0.163,0.057,0.053,0.054,0.050,0.049],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.119,0.100,0.096,0.207,0.101,0.101],[0.108,0.100,0.098,0.097,0.250,0.104],[0.203,0.102,0.101,0.103,0.380,0.103],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.760,2.704,2.622,2.681,2.523,2.652],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.1.7.30","source":"results/23.1.7.30.json"} +,{"actual_version":"23.2.7.32","data_size":{"coffeeshop":44764516054,"hits":14357826790,"job":1830189202,"mgbench":2958722518,"ontime":2704903445,"ssb":72907441079,"taxi":24217117240,"tpcds":18792719207,"tpch":17375411559,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":802,"hits":230,"job":21,"mgbench":73,"ontime":67,"ssb":1469,"taxi":572,"tpcds":277,"tpch":278,"uk":36},"machine":"c7a.4xlarge","release_date":"2023-06-09","result":[[0.071,0.011,0.010,0.009,0.008,0.009],[0.056,0.023,0.022,0.022,0.022,0.022],[0.048,0.244,0.011,0.010,0.010,0.010],[0.043,0.015,0.013,0.012,0.011,0.012],[0.048,0.026,0.026,0.026,0.025,0.024],[0.076,0.018,0.015,0.015,0.016,0.017],[0.030,0.007,0.006,0.006,0.007,0.006],[0.064,0.028,0.027,0.027,0.027,0.029],[0.074,0.037,0.036,0.036,0.036,0.037],[0.080,0.058,0.057,0.063,0.053,0.052],[0.487,0.432,0.429,0.431,0.410,0.413],[0.338,0.233,0.231,0.227,0.228,0.236],[0.033,0.010,0.010,0.011,0.016,0.009],[0.051,0.020,0.015,0.012,0.013,0.016],[0.833,0.722,0.722,0.724,0.726,0.725],[0.528,0.075,0.077,0.075,0.106,0.076],[0.044,0.013,0.013,0.019,0.012,0.012],[0.037,0.014,0.013,0.013,0.013,0.012],[6.398,1.504,1.523,1.528,1.528,1.503],[4.699,1.156,1.127,1.195,1.200,1.238],[4.730,1.171,1.167,1.200,1.165,1.161],[5.362,1.934,1.897,1.944,1.931,1.915],[6.206,1.642,1.635,1.643,1.658,1.695],[3.968,1.058,1.060,1.066,1.041,1.029],[0.059,0.032,0.032,0.027,0.026,0.030],[7.673,2.192,2.203,2.226,2.215,2.185],[2.274,1.033,1.024,1.011,1.018,1.024],[1.876,0.566,0.553,0.545,0.563,0.542],[0.005,0.001,0.001,0.001,0.001,0.001],[0.020,0.010,0.007,0.008,0.007,0.007],[0.053,0.019,0.016,0.017,0.019,0.019],[0.110,0.026,0.022,0.021,0.023,0.022],[0.152,0.055,0.066,0.057,0.055,0.057],[0.280,0.136,0.139,0.134,0.134,0.144],[0.004,0.001,0.003,0.001,0.001,0.001],[0.017,0.008,0.008,0.009,0.009,0.008],[0.320,0.233,0.232,0.234,0.241,0.233],[0.364,0.279,0.290,0.275,0.277,0.291],[0.180,0.092,0.089,0.091,0.099,0.095],[0.194,0.108,0.110,0.104,0.112,0.104],[0.472,0.303,0.284,0.286,0.296,0.283],[0.589,0.396,0.401,0.389,0.392,0.400],[0.527,0.403,0.389,0.398,0.430,0.402],[0.345,0.261,0.247,0.256,0.254,0.256],[1.180,0.984,0.966,0.992,1.007,0.996],[0.787,0.635,0.654,0.636,0.644,0.631],[2.541,2.036,2.069,2.068,2.060,2.141],[0.136,0.028,0.029,0.021,0.023,0.025],[1.426,0.358,0.357,0.389,0.390,0.386],[1.737,0.445,0.410,0.405,0.398,0.407],[4.016,1.075,1.076,1.088,1.062,1.053],[3.040,0.458,0.431,0.417,0.434,0.424],[0.342,0.110,0.111,0.112,0.113,0.113],[0.228,0.090,0.095,0.088,0.087,0.088],[0.410,0.112,0.111,0.113,0.114,0.110],[1.418,0.382,0.370,0.377,0.369,0.375],[1.209,0.574,0.589,0.580,0.586,0.571],[0.915,0.900,0.892,0.892,0.889,0.893],[0.472,0.264,0.275,0.261,0.266,0.253],[0.735,0.354,0.351,0.364,0.348,0.349],[2.426,2.102,2.104,2.093,2.104,2.104],[2.374,1.800,1.766,1.743,1.726,1.728],[2.308,1.773,1.741,1.737,1.748,1.740],[0.605,0.522,0.546,0.549,0.535,0.571],[0.102,0.065,0.069,0.060,0.068,0.054],[0.046,0.032,0.026,0.035,0.026,0.030],[0.087,0.029,0.025,0.039,0.026,0.026],[0.203,0.161,0.167,0.142,0.154,0.177],[0.037,0.009,0.009,0.013,0.011,0.010],[0.034,0.008,0.008,0.008,0.008,0.007],[0.016,0.007,0.006,0.005,0.004,0.007],[0.369,0.041,0.039,0.039,0.040,0.047],[0.444,0.058,0.057,0.063,0.059,0.064],[0.111,0.045,0.040,0.033,0.033,0.033],[0.230,0.066,0.063,0.063,0.061,0.062],[0.075,0.032,0.030,0.029,0.029,0.031],[0.167,0.053,0.054,0.053,0.053,0.054],[0.236,0.077,0.076,0.075,0.075,0.075],[0.057,0.030,0.029,0.029,0.029,0.029],[0.110,0.055,0.056,0.150,0.052,0.052],[0.246,0.142,0.141,0.145,0.142,0.141],[0.486,0.183,0.179,0.173,0.172,0.171],[0.485,0.312,0.302,0.308,0.313,0.311],[0.142,0.042,0.045,0.042,0.044,0.041],[0.669,0.283,0.283,0.288,0.283,0.290],[2.881,2.343,2.331,2.369,2.407,2.469],[8.659,1.163,1.136,1.157,1.174,1.173],[2.099,1.185,1.176,1.166,1.180,1.201],[12.843,3.749,3.755,3.763,3.778,3.788],[4.285,3.315,3.287,3.339,3.303,3.313],[4.081,1.821,1.825,1.809,1.821,1.812],[4.910,4.885,5.008,4.854,4.844,4.834],[null,null,null,null,null,null],[3.579,3.397,3.304,3.302,3.301,3.330],[null,null,null,null,null,null],[5.429,5.156,5.210,5.246,5.233,5.082],[null,null,null,null,null,null],[3.410,3.180,3.161,3.148,3.175,3.208],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.730,0.697,0.689,0.733,0.678,0.690],[null,null,null,null,null,null],[16.287,16.092,16.257,16.144,16.253,16.147],[null,null,null,null,null,null],[27.321,27.004,27.272,27.046,27.156,27.295],[0.227,0.060,0.060,0.061,0.059,0.061],[40.156,37.184,37.606,37.127,37.176,40.283],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.313,8.090,8.144,8.065,8.269,8.119],[0.495,0.384,0.389,0.400,0.405,0.411],[1.136,0.475,0.475,0.469,0.476,0.483],[9.057,8.976,8.863,9.118,9.031,9.024],[0.793,0.799,0.752,0.827,0.752,0.751],[0.267,0.120,0.144,0.123,0.124,0.125],[0.412,0.332,0.333,0.331,0.330,0.333],[null,null,null,null,null,null],[31.456,30.726,30.912,30.492,30.751,31.150],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.878,0.780,0.779,0.826,0.781,0.803],[4.138,4.143,4.139,4.072,4.163,4.097],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.231,0.526,0.515,0.515,0.521,0.527],[1.139,1.033,1.035,1.009,1.038,1.016],[1.319,1.016,0.988,0.985,0.985,0.988],[null,null,null,null,null,null],[58.603,62.644,58.860,60.630,59.255,59.774],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.850,0.766,0.796,0.770,0.775,0.722],[null,null,null,null,null,null],[11.499,11.332,11.213,11.124,11.308,11.274],[null,null,null,null,null,null],[3.153,3.031,2.993,3.200,3.017,2.954],[null,null,null,null,null,null],[0.262,0.147,0.152,0.190,0.150,0.161],[0.351,0.205,0.194,0.199,0.193,0.193],[5.874,5.533,5.620,5.701,5.577,5.654],[11.185,10.837,10.938,10.976,11.047,10.969],[5.205,4.852,4.814,4.920,4.897,4.869],[5.076,4.756,4.859,4.821,4.798,4.871],[11.449,11.201,11.327,11.400,11.306,11.298],[0.552,0.272,0.276,0.261,0.263,0.257],[null,null,null,null,null,null],[1.299,0.998,1.020,1.030,1.071,1.033],[11.593,11.904,11.740,11.728,11.650,12.015],[null,null,null,null,null,null],[1.778,1.304,1.296,1.297,1.254,1.304],[null,null,null,null,null,null],[0.994,0.409,0.400,0.403,0.400,0.397],[0.765,0.494,0.488,0.476,0.490,0.495],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.309,1.231,1.236,1.186,1.236,1.249],[4.344,4.167,4.170,4.233,4.274,4.161],[0.496,0.422,0.432,0.435,0.443,0.448],[0.486,0.425,0.434,0.437,0.449,0.438],[1.279,1.166,1.181,1.255,1.257,1.194],[null,null,null,null,null,null],[2.580,2.595,2.612,2.635,2.531,2.481],[6.700,6.892,6.729,6.604,6.601,6.633],[0.117,0.062,0.051,0.051,0.082,0.055],[0.588,0.521,0.515,0.501,0.499,0.510],[1.777,0.831,0.813,0.764,0.788,0.779],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.774,3.750,3.643,3.790,3.618,3.611],[3.544,3.312,3.320,3.343,3.474,3.368],[2.516,2.501,2.473,2.586,2.397,2.319],[2.631,2.333,2.358,2.327,2.329,2.291],[10.409,10.279,10.262,10.311,10.226,10.199],[2.476,2.451,2.356,2.488,2.303,2.451],[1.034,0.404,0.423,0.432,0.425,0.413],[null,null,null,null,null,null],[0.941,0.543,0.538,0.588,0.527,0.547],[1.701,1.648,1.645,1.653,1.658,1.649],[1.050,0.433,0.437,0.424,0.434,0.429],[1.545,1.379,1.281,1.289,1.299,1.302],[0.423,0.357,0.347,0.343,0.343,0.348],[2.552,2.268,2.310,2.298,2.296,2.296],[null,null,null,null,null,null],[26.423,24.614,28.011,24.717,33.676,25.815],[1.366,1.003,1.002,0.994,0.990,0.971],[null,null,null,null,null,null],[2.422,0.716,0.712,0.703,0.709,0.708],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.836,0.398,0.407,0.402,0.411,0.405],[null,null,null,null,null,null],[0.755,0.376,0.400,0.393,0.398,0.374],[46.746,45.193,43.352,43.485,44.535,46.577],[null,null,null,null,null,null],[0.040,0.039,0.039,0.039,0.040,0.039],[1.636,0.434,0.438,0.447,0.440,0.432],[0.056,0.056,0.059,0.073,0.047,0.052],[null,null,null,null,null,null],[4.309,3.805,3.816,3.823,3.789,3.808],[null,null,null,null,null,null],[1.909,1.845,1.918,1.893,1.867,1.880],[0.247,0.146,0.148,0.198,0.151,0.146],[1.133,1.051,1.039,1.042,1.052,1.059],[1.389,1.258,1.216,1.216,1.265,1.255],[null,null,null,null,null,null],[4.332,4.206,4.185,4.134,4.144,4.124],[2.759,2.616,2.585,2.580,2.600,2.560],[2.880,2.758,2.790,2.756,2.845,3.241],[0.244,0.136,0.131,0.129,0.130,0.141],[0.883,0.875,0.829,0.813,0.802,0.847],[null,null,null,null,null,null],[2.466,2.308,2.423,2.333,2.314,2.347],[null,null,null,null,null,null],[41.918,41.236,41.329,41.794,41.629,41.705],[0.458,0.195,0.193,0.202,0.196,0.193],[3.621,4.999,3.320,3.390,3.389,3.368],[null,null,null,null,null,null],[0.643,0.570,0.569,0.571,0.585,0.589],[0.971,0.910,0.896,0.872,0.907,0.868],[1.150,0.995,1.026,0.962,0.996,0.976],[0.937,0.901,0.879,0.860,0.881,0.885],[1.030,0.975,0.980,0.954,1.036,1.014],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.515,6.104,6.151,6.393,6.561,6.365],[4.484,4.434,4.199,4.617,4.394,4.576],[6.466,6.433,6.387,6.330,6.618,6.788],[null,13.823,null,null,13.221,null],[null,13.440,null,13.166,null,13.378],[null,13.707,13.979,null,14.533,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[43.012,43.188,44.462,50.533,41.688,44.630],[48.973,49.448,51.898,51.452,51.750,51.927],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.112,7.282,7.078,7.110,6.966,7.139],[7.682,7.996,7.732,7.788,7.698,7.636],[0.047,0.045,0.048,0.053,0.250,0.068],[0.341,0.048,0.046,0.046,0.044,0.044],[5.513,5.649,5.437,5.358,5.557,5.447],[null,null,null,null,null,null],[7.724,7.412,7.329,7.315,7.446,7.257],[8.741,8.139,7.841,8.184,8.015,8.034],[8.148,7.302,7.276,7.185,7.761,7.537],[6.576,6.438,6.450,6.284,6.328,6.480],[8.383,7.882,7.656,7.854,7.884,7.937],[7.976,7.454,7.418,7.675,8.111,7.710],[7.990,8.064,7.697,7.953,7.678,7.800],[5.130,4.549,4.541,4.433,4.665,4.779],[4.517,4.137,3.961,4.194,4.428,4.179],[6.350,5.725,5.909,5.987,5.940,5.925],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[14.315,14.507,14.707,14.298,14.462,14.232],[0.047,0.037,0.166,0.051,0.039,0.038],[14.551,13.588,13.551,13.771,14.097,13.921],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.416,0.064,0.069,0.062,0.079,0.177],[0.064,0.061,0.061,0.161,0.295,0.064],[0.277,0.064,0.071,0.061,0.073,0.277],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.118,0.119,0.223,0.122,0.120,0.260],[0.121,0.117,0.247,0.288,0.119,0.126],[0.174,0.115,0.118,0.175,0.222,0.115],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.356,3.129,3.126,3.120,3.155,3.188],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.2.7.32","source":"results/23.2.7.32.json"} +,{"actual_version":"23.4.6.25","data_size":{"coffeeshop":44755619736,"hits":14379071615,"job":1830189202,"mgbench":2959106271,"ontime":2704903445,"ssb":72901447363,"taxi":24216607610,"tpcds":18812823958,"tpch":17375517376,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":763,"hits":230,"job":26,"mgbench":65,"ontime":58,"ssb":1415,"taxi":528,"tpcds":287,"tpch":286,"uk":32},"machine":"c7a.4xlarge","release_date":"2023-07-12","result":[[0.078,0.009,0.008,0.008,0.009,0.008],[0.054,0.021,0.020,0.020,0.020,0.021],[0.052,0.256,0.010,0.010,0.010,0.010],[0.043,0.012,0.013,0.012,0.014,0.011],[0.052,0.026,0.026,0.026,0.024,0.023],[0.071,0.017,0.018,0.015,0.015,0.015],[0.030,0.007,0.006,0.007,0.007,0.007],[0.056,0.028,0.031,0.026,0.026,0.026],[0.077,0.040,0.038,0.032,0.034,0.037],[0.079,0.054,0.054,0.052,0.050,0.051],[0.473,0.409,0.401,0.399,0.402,0.348],[0.308,0.222,0.218,0.216,0.217,0.217],[0.032,0.007,0.009,0.012,0.007,0.007],[0.056,0.012,0.012,0.013,0.012,0.015],[0.808,0.700,0.684,0.686,0.684,0.683],[0.418,0.084,0.073,0.074,0.079,0.072],[0.039,0.014,0.015,0.018,0.013,0.012],[0.047,0.012,0.013,0.012,0.013,0.015],[6.393,1.433,1.433,1.450,1.436,1.421],[4.696,1.081,1.074,1.069,1.087,1.060],[4.712,1.118,1.126,1.130,1.115,1.125],[5.363,1.820,1.797,1.795,1.806,1.801],[6.194,1.572,1.571,1.581,1.553,1.559],[3.965,0.971,0.965,0.980,0.985,0.968],[0.067,0.032,0.032,0.027,0.038,0.032],[7.661,2.082,2.099,2.068,2.064,2.075],[2.272,0.988,0.978,0.982,0.976,0.964],[1.865,0.516,0.540,0.513,0.526,0.513],[0.002,0.002,0.003,0.002,0.002,0.002],[0.027,0.009,0.007,0.007,0.007,0.007],[0.054,0.017,0.016,0.017,0.017,0.017],[0.109,0.023,0.021,0.022,0.022,0.021],[0.131,0.054,0.054,0.056,0.052,0.051],[0.245,0.132,0.139,0.131,0.126,0.131],[0.003,0.002,0.002,0.002,0.003,0.002],[0.023,0.010,0.009,0.008,0.008,0.009],[0.314,0.220,0.225,0.228,0.224,0.221],[0.361,0.269,0.260,0.272,0.268,0.274],[0.164,0.085,0.087,0.084,0.084,0.101],[0.178,0.106,0.106,0.101,0.103,0.101],[0.438,0.279,0.280,0.279,0.280,0.278],[0.547,0.388,0.388,0.380,0.380,0.386],[0.525,0.388,0.400,0.394,0.393,0.411],[0.357,0.250,0.244,0.252,0.250,0.246],[1.200,1.021,1.018,1.029,1.014,1.014],[0.811,0.668,0.675,0.665,0.679,0.671],[2.509,2.089,2.082,2.086,2.083,2.085],[0.119,0.020,0.021,0.022,0.021,0.020],[1.420,0.319,0.327,0.319,0.318,0.314],[1.722,0.353,0.360,0.353,0.355,0.356],[4.020,1.006,0.978,0.997,0.979,0.991],[3.090,0.414,0.393,0.395,0.394,0.447],[0.273,0.104,0.108,0.108,0.103,0.111],[0.204,0.085,0.091,0.088,0.085,0.084],[0.281,0.108,0.107,0.104,0.102,0.103],[1.397,0.358,0.350,0.348,0.343,0.372],[1.050,0.530,0.539,0.537,0.549,0.539],[0.904,0.890,0.892,0.887,0.889,0.889],[0.441,0.247,0.251,0.245,0.241,0.244],[0.637,0.343,0.338,0.344,0.344,0.340],[2.329,2.052,2.102,2.065,2.062,2.060],[1.937,1.724,1.693,1.710,1.745,1.703],[1.999,1.727,1.722,1.727,1.695,1.713],[0.569,0.483,0.501,0.482,0.511,0.476],[0.077,0.050,0.056,0.048,0.050,0.049],[0.056,0.023,0.034,0.021,0.023,0.025],[0.058,0.020,0.019,0.022,0.020,0.021],[0.135,0.111,0.110,0.102,0.107,0.099],[0.039,0.008,0.010,0.008,0.008,0.008],[0.031,0.010,0.007,0.007,0.007,0.007],[0.020,0.004,0.004,0.007,0.004,0.005],[0.372,0.042,0.039,0.039,0.044,0.038],[0.447,0.056,0.056,0.055,0.054,0.056],[0.120,0.034,0.033,0.032,0.032,0.033],[0.246,0.057,0.058,0.058,0.058,0.057],[0.080,0.027,0.028,0.028,0.028,0.028],[0.157,0.052,0.052,0.050,0.052,0.052],[0.211,0.074,0.072,0.071,0.072,0.071],[0.056,0.028,0.030,0.028,0.030,0.028],[0.101,0.051,0.053,0.156,0.053,0.051],[0.240,0.134,0.134,0.135,0.136,0.134],[0.448,0.180,0.178,0.176,0.166,0.184],[0.473,0.298,0.301,0.295,0.292,0.300],[0.153,0.044,0.040,0.041,0.041,0.042],[0.665,0.273,0.271,0.271,0.269,0.267],[2.734,2.216,2.227,2.219,2.215,2.224],[8.609,1.089,1.064,1.069,1.093,1.079],[1.879,1.099,1.086,1.077,1.091,1.084],[12.786,3.570,3.568,3.542,3.523,3.522],[4.292,3.168,3.172,3.166,3.184,3.179],[4.078,1.795,1.810,1.874,1.802,1.801],[5.436,4.669,4.896,4.801,4.839,4.772],[null,null,null,null,null,null],[3.383,3.170,3.170,3.163,3.172,3.174],[null,null,null,null,null,null],[5.269,5.030,5.065,5.087,5.035,5.007],[null,null,null,null,null,null],[3.291,3.130,3.122,3.123,3.126,3.124],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.696,0.655,0.649,0.681,0.643,0.642],[null,null,null,null,null,null],[16.284,16.366,16.749,16.077,16.418,16.175],[null,null,null,null,null,null],[27.378,27.090,27.174,27.199,27.478,27.649],[0.201,0.064,0.058,0.061,0.057,0.056],[40.301,37.299,36.995,37.005,36.693,37.210],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.426,8.107,8.089,8.076,8.153,8.247],[0.486,0.422,0.402,0.396,0.379,0.414],[1.016,0.446,0.447,0.437,0.461,0.454],[8.764,8.719,8.603,8.596,8.608,8.645],[0.789,0.835,0.762,0.796,0.755,0.733],[0.296,0.148,0.121,0.122,0.125,0.121],[0.407,0.323,0.329,0.325,0.325,0.319],[null,null,null,null,null,null],[31.376,30.291,30.603,31.185,31.264,31.090],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.039,0.853,0.795,0.787,0.745,0.745],[4.121,4.269,4.153,4.115,4.113,4.184],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.188,0.468,0.471,0.477,0.477,0.471],[0.993,0.874,0.866,0.854,0.868,0.860],[1.112,0.915,0.905,1.001,1.958,0.905],[null,null,null,null,null,null],[60.748,58.108,58.026,58.286,66.556,59.973],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.795,0.758,0.758,0.789,0.703,0.702],[null,null,null,null,null,null],[11.315,11.088,11.074,11.150,11.211,11.121],[null,null,null,null,null,null],[3.151,2.915,2.966,3.067,3.052,2.879],[null,null,null,null,null,null],[0.297,0.142,0.141,0.169,0.141,0.138],[0.307,0.200,0.188,0.191,0.189,0.185],[5.702,5.257,5.460,5.461,5.445,5.485],[10.916,10.535,10.673,10.639,10.732,10.548],[4.978,4.848,4.802,4.770,4.808,4.831],[4.904,4.867,4.673,4.753,4.796,4.783],[11.143,11.102,11.026,11.044,11.268,10.882],[0.341,0.223,0.232,0.240,0.226,0.227],[null,null,null,null,null,null],[1.081,0.940,0.937,0.949,0.940,0.930],[11.284,11.131,11.024,11.276,11.139,10.998],[null,null,null,null,null,null],[1.383,1.207,1.185,1.184,1.170,1.202],[null,null,null,null,null,null],[0.912,0.371,0.376,0.377,0.377,0.378],[0.764,0.443,0.435,0.439,0.448,0.423],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.291,1.216,1.248,1.249,1.255,1.249],[4.263,4.141,4.144,4.150,4.170,4.144],[0.429,0.381,0.398,0.395,0.390,0.387],[0.434,0.391,0.399,0.389,0.397,0.385],[1.206,1.113,1.114,1.164,1.134,1.104],[null,null,null,null,null,null],[2.442,2.428,2.322,2.481,2.350,2.389],[6.644,6.666,6.686,6.479,6.607,6.613],[0.105,0.089,0.047,0.052,0.042,0.039],[0.579,0.468,0.511,0.498,0.481,0.500],[1.777,0.746,0.775,0.740,0.762,0.731],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.528,3.500,3.454,3.702,3.433,3.436],[3.449,3.300,3.349,3.403,3.421,3.321],[2.519,2.454,2.472,2.407,2.411,2.475],[2.356,2.499,2.248,2.192,2.257,2.266],[10.213,9.869,9.951,9.935,10.072,9.976],[2.493,2.444,2.433,2.441,2.470,2.414],[0.927,0.409,0.398,0.397,0.393,0.397],[null,null,null,null,null,null],[0.694,0.509,0.499,0.558,0.513,0.505],[1.639,1.567,1.565,1.579,1.559,1.562],[0.915,0.413,0.411,0.411,0.409,0.411],[1.367,1.278,1.224,1.227,1.203,1.209],[0.391,0.319,0.317,0.313,0.315,0.315],[2.302,2.212,2.253,2.216,2.216,2.264],[null,null,null,null,null,null],[25.413,25.277,29.799,28.343,29.128,25.470],[1.251,0.901,0.907,0.905,0.906,0.911],[null,null,null,null,null,null],[2.425,0.664,0.698,0.675,0.682,0.652],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.830,0.334,0.326,0.327,0.326,0.320],[null,null,null,null,null,null],[0.736,0.358,0.364,0.365,0.360,0.369],[42.241,45.685,42.576,43.797,42.903,42.949],[null,null,null,null,null,null],[0.035,0.032,0.034,0.033,0.036,0.032],[1.627,0.418,0.419,0.421,0.419,0.418],[0.057,0.048,0.047,0.055,0.043,0.049],[null,null,null,null,null,null],[4.324,3.682,3.693,3.694,3.702,3.654],[null,null,null,null,null,null],[1.908,1.843,1.854,1.887,1.872,1.881],[0.226,0.138,0.141,0.178,0.141,0.140],[1.116,1.035,1.065,1.049,1.017,1.021],[1.351,1.259,1.232,1.219,1.242,1.227],[null,null,null,null,null,null],[4.307,4.178,4.183,4.183,4.174,4.179],[2.591,2.590,2.584,2.521,2.494,2.498],[2.815,2.742,2.834,2.760,2.788,2.716],[0.241,0.119,0.119,0.125,0.121,0.120],[0.906,0.781,0.851,0.835,0.871,0.859],[null,null,null,null,null,null],[2.357,2.296,2.264,2.300,2.357,2.265],[null,null,null,null,null,null],[41.106,41.038,41.183,41.231,40.632,40.830],[0.316,0.183,0.186,0.185,0.183,0.183],[3.569,3.412,3.384,3.472,3.394,4.251],[null,null,null,null,null,null],[0.594,0.529,0.534,0.529,0.538,0.531],[0.962,0.914,0.891,0.887,0.944,0.865],[1.088,1.071,0.908,1.116,0.980,0.915],[0.921,0.866,0.850,0.852,0.853,0.809],[1.119,0.989,0.996,0.979,0.952,0.922],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.164,5.797,6.595,5.862,5.982,5.960],[4.335,4.255,4.293,4.319,4.243,4.576],[6.500,6.101,6.162,6.340,6.283,6.398],[13.089,null,13.060,13.231,13.094,13.118],[13.387,null,13.286,12.860,13.026,13.133],[13.593,13.195,null,13.117,13.152,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[42.384,41.307,42.129,41.502,41.940,41.461],[50.963,46.450,48.167,47.019,47.362,53.633],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.500,6.505,6.208,6.170,6.509,6.217],[6.893,7.110,6.851,6.829,6.763,6.751],[0.042,0.039,0.038,0.215,0.037,0.039],[0.167,0.042,0.038,0.040,0.036,0.037],[4.787,4.884,5.264,4.798,4.898,5.502],[null,null,null,null,null,null],[6.724,6.456,6.619,6.507,6.743,6.714],[7.298,6.876,7.080,7.140,6.785,6.854],[7.058,6.791,6.514,6.548,6.539,6.516],[6.138,5.768,5.513,5.352,5.583,5.435],[7.234,6.786,6.859,7.078,6.758,6.596],[6.574,7.076,6.967,6.731,6.839,6.881],[7.042,6.680,6.607,6.582,6.831,6.927],[4.502,3.979,4.204,3.893,3.879,3.930],[3.789,3.495,3.337,3.573,3.805,3.558],[5.568,5.086,4.867,5.152,5.737,5.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.641,12.205,12.493,12.099,13.014,12.250],[0.244,0.035,0.136,0.035,0.054,0.149],[12.097,12.064,11.794,11.831,11.633,11.949],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.064,0.066,0.056,0.061,0.052,0.157],[0.057,0.066,0.257,0.054,0.059,0.052],[0.060,0.069,0.057,0.053,0.147,0.061],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.328,0.099,0.099,0.100,0.340,0.105],[0.212,0.103,0.101,0.212,0.188,0.102],[0.103,0.099,0.096,0.098,0.258,0.104],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.794,2.757,2.667,2.726,2.500,2.702],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.4.6.25","source":"results/23.4.6.25.json"} +,{"actual_version":"22.8.21.38","data_size":{"coffeeshop":44771614853,"hits":14343452100,"job":1830189202,"mgbench":2958722518,"ontime":2704903445,"ssb":72905043653,"taxi":24217295803,"tpcds":18782813840,"tpch":17374965764,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":772,"hits":207,"job":22,"mgbench":66,"ontime":57,"ssb":1377,"taxi":485,"tpcds":276,"tpch":260,"uk":33},"machine":"c7a.4xlarge","release_date":"2023-08-28","result":[[0.062,0.008,0.006,0.007,0.006,0.007],[0.072,0.028,0.026,0.025,0.025,0.025],[0.049,0.232,0.008,0.008,0.009,0.009],[0.054,0.010,0.010,0.010,0.010,0.011],[0.071,0.028,0.028,0.029,0.028,0.027],[0.090,0.020,0.020,0.020,0.020,0.020],[0.026,0.006,0.006,0.006,0.006,0.008],[0.057,0.023,0.021,0.021,0.021,0.021],[0.100,0.049,0.050,0.049,0.049,0.050],[0.135,0.088,0.082,0.083,0.081,0.079],[0.650,0.554,0.549,0.506,0.551,0.542],[0.712,0.512,0.519,0.527,0.492,0.481],[0.036,0.021,0.017,0.007,0.007,0.008],[0.068,0.012,0.011,0.028,0.011,0.044],[1.474,1.248,1.223,1.226,1.225,1.226],[0.839,0.125,0.125,0.124,0.123,0.124],[0.051,0.039,0.016,0.017,0.017,0.018],[0.042,0.014,0.014,0.015,0.013,0.014],[6.413,2.312,2.317,2.311,2.310,2.313],[4.705,1.705,1.707,1.706,1.694,1.715],[4.729,1.779,1.785,1.774,1.773,1.793],[5.379,3.041,3.037,3.038,3.036,3.048],[6.210,2.568,2.570,2.562,2.557,2.557],[3.968,1.667,1.664,1.661,1.679,1.658],[0.071,0.033,0.033,0.032,0.033,0.032],[7.677,3.367,3.375,3.383,3.364,3.360],[3.438,1.610,1.583,1.605,1.585,1.591],[2.722,0.816,0.820,0.812,0.813,0.815],[0.004,0.003,0.001,0.001,0.001,0.001],[0.022,0.009,0.008,0.008,0.008,0.008],[0.090,0.025,0.025,0.025,0.024,0.025],[0.225,0.036,0.033,0.032,0.032,0.032],[0.254,0.081,0.081,0.079,0.081,0.080],[0.484,0.214,0.212,0.212,0.212,0.212],[0.001,0.001,0.002,0.001,0.001,0.001],[0.020,0.010,0.009,0.009,0.009,0.009],[0.552,0.417,0.411,0.410,0.410,0.404],[0.639,0.485,0.484,0.483,0.486,0.481],[0.286,0.108,0.107,0.106,0.105,0.107],[0.297,0.130,0.131,0.130,0.132,0.130],[0.772,0.497,0.487,0.480,0.464,0.478],[1.000,0.680,0.685,0.678,0.674,0.683],[0.978,0.679,0.678,0.686,0.681,0.670],[0.771,0.588,0.606,0.588,0.571,0.607],[2.263,2.004,1.952,1.981,1.940,1.963],[1.667,1.384,1.381,1.377,1.308,1.345],[3.898,3.774,3.681,3.684,3.755,3.722],[0.257,0.035,0.057,0.038,0.034,0.039],[2.422,0.586,0.595,0.581,0.579,0.582],[2.511,0.599,0.600,0.601,0.598,0.599],[4.080,1.712,1.663,1.703,1.690,1.695],[3.828,0.700,0.697,0.709,0.703,0.692],[0.646,0.161,0.164,0.163,0.163,0.162],[0.409,0.134,0.134,0.134,0.135,0.135],[0.665,0.169,0.163,0.162,0.162,0.161],[2.465,0.577,0.572,0.575,0.594,0.577],[2.257,0.958,0.956,0.962,0.955,0.963],[0.828,0.818,0.821,0.814,0.802,0.799],[0.826,0.440,0.418,0.419,0.428,0.424],[1.384,0.601,0.579,0.583,0.565,0.572],[4.305,3.971,4.066,3.982,4.100,4.116],[4.174,3.082,3.024,2.957,3.034,3.068],[4.174,2.998,3.027,2.989,2.969,2.999],[1.086,0.980,0.967,0.959,0.969,0.976],[0.135,0.050,0.056,0.053,0.053,0.054],[0.043,0.031,0.040,0.026,0.022,0.025],[0.080,0.050,0.032,0.018,0.028,0.020],[0.184,0.135,0.126,0.136,0.120,0.139],[0.035,0.009,0.010,0.010,0.008,0.014],[0.035,0.009,0.011,0.011,0.007,0.007],[0.014,0.003,0.003,0.004,0.005,0.003],[0.688,0.057,0.057,0.057,0.062,0.058],[0.818,0.079,0.076,0.075,0.076,0.080],[0.180,0.048,0.046,0.046,0.047,0.047],[0.383,0.090,0.089,0.089,0.089,0.089],[0.109,0.032,0.031,0.031,0.030,0.032],[0.270,0.078,0.077,0.077,0.076,0.075],[0.381,0.123,0.122,0.122,0.122,0.123],[0.064,0.034,0.033,0.034,0.033,0.033],[0.105,0.059,0.061,0.130,0.061,0.059],[0.397,0.217,0.214,0.213,0.214,0.213],[0.853,0.254,0.250,0.248,0.247,0.248],[0.786,0.528,0.523,0.528,0.524,0.527],[0.234,0.063,0.062,0.060,0.060,0.060],[1.199,0.484,0.481,0.480,0.481,0.479],[4.775,3.823,3.813,3.805,3.804,3.809],[8.695,2.159,2.088,2.156,2.140,2.055],[3.708,1.977,1.977,1.982,1.979,1.980],[12.942,6.843,6.837,6.838,6.839,6.843],[6.261,5.613,5.678,5.601,5.638,5.652],[4.421,3.765,3.739,3.612,3.718,3.698],[8.962,8.369,8.148,8.294,8.481,8.141],[null,null,null,null,null,null],[6.181,5.658,5.652,5.617,5.640,5.736],[null,null,null,null,null,null],[9.211,8.765,8.678,8.682,8.680,8.653],[null,null,null,null,null,null],[6.181,5.764,5.796,5.817,5.784,5.774],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.319,1.316,1.318,1.331,1.305,1.305],[null,null,null,null,null,null],[12.740,12.559,12.712,12.663,12.691,12.661],[null,null,null,null,null,null],[21.958,21.975,21.878,22.101,21.899,21.953],[0.428,0.109,0.106,0.104,0.107,0.115],[34.674,34.486,34.211,34.814,37.958,38.142],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.671,7.361,7.301,7.275,7.248,7.297],[0.789,0.704,0.672,0.645,0.646,0.673],[1.965,0.742,0.735,0.722,0.729,0.738],[7.746,7.813,7.633,7.675,8.031,7.800],[0.849,0.816,0.858,0.862,0.749,0.794],[0.317,0.182,0.173,0.175,0.190,0.169],[0.575,0.467,0.460,0.449,0.465,0.469],[null,null,null,null,null,null],[null,31.855,null,null,30.907,30.908],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.627,1.370,1.354,1.343,1.327,1.315],[3.689,3.629,3.637,3.665,3.632,3.629],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.226,0.872,0.836,0.852,0.818,0.848],[1.564,1.355,1.342,1.368,1.340,1.325],[1.849,1.293,1.292,1.290,1.289,1.291],[null,null,null,null,null,null],[52.435,52.182,49.624,53.783,48.789,54.383],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.369,1.272,1.267,1.239,1.267,1.217],[null,null,null,null,null,null],[12.620,12.432,12.407,12.419,12.307,12.594],[null,null,null,null,null,null],[2.609,2.449,2.437,2.492,2.373,2.431],[null,null,null,null,null,null],[0.338,0.228,0.218,0.237,0.215,0.220],[0.413,0.266,0.272,0.260,0.256,0.250],[10.830,10.380,10.455,10.332,10.336,10.333],[20.247,19.810,20.020,19.974,19.782,19.836],[6.140,5.786,5.751,5.856,5.884,5.828],[6.074,5.875,5.834,5.782,5.770,5.797],[12.502,12.250,12.414,12.305,12.526,12.400],[0.604,0.393,0.387,0.385,0.386,0.389],[null,null,null,null,null,null],[1.814,1.268,1.254,1.258,1.258,1.247],[12.594,12.366,12.441,12.463,12.489,12.644],[null,null,null,null,null,null],[2.330,1.898,1.885,1.883,1.890,1.904],[null,null,null,null,null,null],[1.522,0.607,0.600,0.603,0.601,0.606],[1.105,0.789,0.785,0.767,0.779,0.778],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.046,0.996,0.988,0.960,0.952,0.910],[3.800,3.571,3.560,3.629,3.606,3.554],[0.651,0.604,0.586,0.594,0.583,0.584],[0.635,0.596,0.590,0.589,0.594,0.589],[1.618,1.499,1.478,1.505,1.480,1.465],[null,null,null,null,null,null],[1.975,1.927,1.888,1.840,1.909,1.941],[6.286,6.135,6.146,6.108,6.169,6.270],[0.057,0.050,0.045,0.036,0.043,0.037],[0.971,0.840,0.881,0.851,0.842,0.832],[1.781,1.344,1.314,1.332,1.340,1.303],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.963,4.745,4.792,4.889,4.736,4.776],[3.857,3.597,3.761,3.604,3.605,3.666],[1.949,2.004,1.946,1.963,1.910,1.848],[2.281,2.254,2.221,2.264,2.260,2.292],[7.187,7.009,7.005,7.006,6.961,6.992],[1.984,1.950,1.921,1.955,1.880,1.863],[1.458,0.603,0.600,0.597,0.611,0.632],[null,null,null,null,null,null],[1.159,0.838,0.836,0.854,0.824,0.830],[2.513,2.437,2.446,2.457,2.475,2.428],[1.541,0.641,0.637,0.633,0.643,0.644],[2.457,2.231,2.196,2.200,2.197,2.206],[0.633,0.549,0.543,0.542,0.547,0.544],[2.307,2.348,2.194,2.204,2.255,2.241],[null,null,null,null,null,null],[52.803,45.920,47.462,47.303,45.259,47.320],[1.904,1.509,1.515,1.521,1.506,1.536],[null,null,null,null,null,null],[2.421,1.145,1.143,1.104,1.111,1.085],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.195,0.543,0.536,0.537,0.541,0.544],[null,null,null,null,null,null],[0.999,0.624,0.626,0.613,0.607,0.622],[38.709,37.267,35.966,35.490,35.403,38.185],[null,null,null,null,null,null],[0.038,0.034,0.035,0.032,0.034,0.035],[1.980,0.698,0.715,0.703,0.707,0.696],[0.039,0.040,0.049,0.046,0.036,0.037],[null,null,null,null,null,null],[5.214,4.773,4.823,4.769,4.797,4.794],[null,null,null,null,null,null],[1.583,1.485,1.518,1.547,1.524,1.493],[0.237,0.158,0.153,0.181,0.146,0.148],[0.874,0.804,0.789,0.813,0.811,0.805],[1.635,1.410,1.447,1.422,1.509,1.418],[null,null,null,null,null,null],[3.788,3.551,3.539,3.575,3.529,3.563],[5.069,4.923,4.915,4.921,4.899,4.914],[2.892,2.775,2.801,2.800,2.857,2.878],[0.334,0.200,0.197,0.191,0.191,0.201],[0.933,0.815,0.812,0.796,0.701,0.661],[null,null,null,null,null,null],[3.122,2.825,2.960,2.883,2.861,2.889],[null,null,null,null,null,null],[36.071,35.661,35.963,36.242,35.928,35.953],[0.646,0.343,0.344,0.347,0.339,0.342],[4.316,4.032,3.935,4.085,3.936,3.937],[null,null,null,null,null,null],[1.096,0.995,1.005,0.989,0.985,0.990],[0.957,0.907,0.828,0.867,0.862,0.845],[0.933,0.984,0.929,0.894,0.998,0.949],[0.882,0.822,0.833,0.847,0.858,0.965],[1.066,0.962,0.905,0.973,1.033,0.968],[17.968,18.235,17.976,17.845,18.544,17.847],[5.559,5.549,5.582,5.329,5.457,5.398],[1.480,1.422,1.417,1.387,1.388,1.394],[null,null,null,null,null,null],[33.499,32.710,32.575,36.618,33.005,33.165],[32.736,32.207,32.669,37.571,31.892,32.438],[35.220,34.294,34.578,34.415,36.692,35.554],[3.910,3.736,3.948,3.826,3.829,3.808],[2.444,2.340,2.332,2.348,2.368,2.349],[4.201,4.286,4.287,4.187,4.177,4.146],[10.142,9.866,9.868,9.948,9.828,9.923],[10.102,9.910,9.691,9.853,9.811,9.777],[10.346,10.022,9.888,10.183,10.030,9.911],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[33.244,33.469,33.471,33.462,33.963,33.477],[38.244,37.964,38.158,38.212,38.275,38.010],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.641,3.569,3.530,3.532,3.581,3.529],[4.156,4.203,4.025,4.036,4.086,4.057],[0.061,0.039,0.047,0.039,0.063,0.041],[0.048,0.039,0.040,0.039,0.041,0.038],[3.282,3.015,3.088,3.041,2.988,3.046],[null,null,null,null,null,null],[4.367,3.826,3.696,3.902,3.770,3.972],[4.560,4.118,4.245,4.072,4.140,4.179],[4.315,3.858,3.856,3.840,3.789,3.761],[3.314,2.958,2.957,3.140,2.979,3.129],[4.107,3.928,4.158,4.026,3.978,4.186],[4.013,3.895,4.075,3.971,4.092,3.974],[4.104,3.967,4.040,3.969,4.238,4.024],[2.824,2.472,2.420,2.667,2.603,2.426],[2.582,2.014,1.974,2.156,1.955,2.016],[3.898,3.318,3.732,3.491,3.352,3.896],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.008,5.769,5.596,5.668,5.603,5.557],[0.045,0.031,0.054,0.032,0.031,0.031],[4.856,4.394,4.618,4.385,4.485,4.505],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.054,0.052,0.052,0.051,0.063,0.051],[0.052,0.051,0.051,0.051,0.051,0.053],[0.052,0.051,0.051,0.052,0.057,0.055],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.104,0.101,0.101,0.102,0.102,0.102],[0.105,0.101,0.108,0.101,0.102,0.101],[0.123,0.101,0.101,0.100,0.100,0.102],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.354,1.457,1.255,1.246,1.200,1.212],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"22.8.21.38","source":"results/22.8.21.38.json"} +,{"actual_version":"23.5.5.92","data_size":{"coffeeshop":44743361141,"hits":14316554728,"job":1828729323,"mgbench":2953294592,"ontime":2698599357,"ssb":72843944963,"taxi":24167909570,"tpcds":18807047952,"tpch":17363740359,"uk":780398952},"kind":"versions-benchmark","load_time":{"coffeeshop":791,"hits":238,"job":24,"mgbench":69,"ontime":60,"ssb":1543,"taxi":553,"tpcds":278,"tpch":289,"uk":34},"machine":"c7a.4xlarge","release_date":"2023-08-28","result":[[0.086,0.011,0.009,0.359,0.011,0.010],[0.054,0.022,0.021,0.022,0.021,0.022],[0.052,0.021,0.011,0.056,0.010,0.010],[0.045,0.017,0.014,0.027,0.014,0.011],[0.048,0.024,0.020,0.042,0.021,0.023],[0.069,0.016,0.017,0.034,0.015,0.015],[0.023,0.008,0.007,0.008,0.007,0.007],[0.073,0.023,0.022,0.023,0.024,0.022],[0.093,0.038,0.038,0.060,0.037,0.037],[0.096,0.059,0.057,0.056,0.058,0.064],[0.542,0.476,0.457,0.459,0.453,0.454],[0.412,0.282,0.309,0.245,0.252,0.228],[0.033,0.011,0.009,0.009,0.008,0.015],[0.059,0.023,0.019,0.014,0.015,0.014],[1.008,0.872,0.868,0.941,0.846,0.829],[0.492,0.078,0.075,0.088,0.089,0.086],[0.047,0.015,0.013,0.014,0.014,0.013],[0.036,0.012,0.012,0.013,0.014,0.012],[6.379,1.622,1.612,1.629,1.744,1.838],[4.685,1.293,1.164,1.230,1.239,1.328],[4.701,1.437,1.446,1.325,1.261,1.245],[5.362,2.327,2.150,2.216,2.022,2.071],[6.206,1.851,1.873,1.937,1.727,1.803],[3.963,1.144,1.194,1.204,1.234,1.230],[0.075,0.033,0.033,0.033,0.025,0.026],[7.652,2.356,2.320,2.427,2.359,2.251],[2.283,1.057,1.115,1.076,1.133,1.182],[1.876,0.594,0.609,0.612,0.589,0.592],[0.003,0.003,0.002,0.002,0.002,0.002],[0.029,0.011,0.009,0.009,0.009,0.008],[0.062,0.020,0.024,0.039,0.019,0.021],[0.155,0.025,0.024,0.024,0.023,0.027],[0.183,0.058,0.059,0.056,0.065,0.063],[0.368,0.158,0.165,0.158,0.150,0.154],[0.006,0.004,0.003,0.027,0.004,0.002],[0.023,0.012,0.011,0.010,0.010,0.010],[0.436,0.283,0.269,0.261,0.275,0.269],[0.465,0.269,0.281,0.316,0.319,0.309],[0.227,0.096,0.099,0.097,0.100,0.102],[0.255,0.123,0.129,0.131,0.122,0.138],[0.600,0.328,0.338,0.344,0.331,0.318],[0.787,0.447,0.460,0.469,0.437,0.425],[0.656,0.437,0.420,0.414,0.447,0.465],[0.458,0.289,0.262,0.268,0.275,0.273],[1.567,1.211,1.136,1.154,1.167,1.179],[1.129,0.762,0.778,0.757,0.814,0.729],[3.273,2.385,2.346,2.277,2.289,2.411],[0.173,0.029,0.031,0.030,0.029,0.024],[1.711,0.382,0.378,0.409,0.403,0.390],[1.955,0.440,0.461,0.446,0.461,0.449],[4.056,1.150,1.190,1.174,1.242,1.212],[2.343,0.505,0.501,0.510,0.510,0.436],[0.503,0.139,0.138,0.128,0.136,0.140],[0.321,0.109,0.103,0.111,0.113,0.112],[0.486,0.125,0.113,0.116,0.115,0.124],[1.738,0.425,0.426,0.449,0.437,0.453],[1.715,0.653,0.705,0.659,0.675,0.694],[1.072,1.113,1.086,1.264,1.099,1.168],[0.621,0.309,0.314,0.325,0.274,0.286],[1.084,0.378,0.358,0.359,0.375,0.341],[2.661,1.940,1.874,1.801,1.828,1.834],[3.219,1.883,1.934,1.839,1.890,1.919],[3.143,1.856,1.796,1.794,1.802,1.844],[0.659,0.495,0.548,0.538,0.640,0.641],[0.132,0.059,0.060,0.059,0.061,0.067],[0.063,0.028,0.026,0.024,0.034,0.028],[0.103,0.022,0.025,0.025,0.031,0.023],[0.259,0.174,0.147,0.151,0.169,0.142],[0.038,0.009,0.015,0.011,0.009,0.013],[0.035,0.012,0.013,0.010,0.007,0.012],[0.017,0.005,0.004,0.005,0.006,0.005],[0.412,0.054,0.057,0.061,0.053,0.053],[0.484,0.074,0.068,0.069,0.068,0.060],[0.125,0.046,0.041,0.063,0.044,0.043],[0.253,0.062,0.066,0.076,0.060,0.060],[0.086,0.032,0.035,0.028,0.033,0.031],[0.182,0.069,0.061,0.059,0.054,0.062],[0.232,0.081,0.085,0.088,0.084,0.087],[0.068,0.038,0.037,0.035,0.033,0.036],[0.119,0.081,0.068,0.087,0.069,0.066],[0.296,0.183,0.175,0.177,0.159,0.162],[0.541,0.230,0.210,0.198,0.201,0.194],[0.531,0.370,0.371,0.385,0.393,0.370],[0.155,0.047,0.046,0.046,0.048,0.045],[0.694,0.314,0.304,0.322,0.296,0.302],[3.157,2.750,2.765,2.758,2.825,2.910],[8.633,1.272,1.196,1.232,1.246,1.309],[2.844,1.343,1.356,1.349,1.326,1.356],[12.790,4.426,4.466,4.513,4.370,4.494],[4.365,4.134,4.230,4.229,4.072,4.250],[4.079,2.409,2.703,2.525,2.529,2.406],[6.283,5.971,5.952,5.849,6.254,6.332],[null,null,null,null,null,null],[4.494,4.210,4.126,4.290,4.220,4.232],[null,null,null,null,null,null],[7.046,6.436,6.409,6.188,6.209,6.060],[null,null,null,null,null,null],[3.842,3.590,3.385,3.393,3.387,3.467],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.675,0.704,0.702,0.510,0.440,0.439],[null,null,null,null,null,null],[16.849,16.827,16.810,17.090,16.734,17.059],[null,null,null,null,null,null],[28.232,28.104,28.180,28.040,28.790,29.027],[0.214,0.059,0.057,0.057,0.058,0.061],[39.235,38.498,38.872,38.588,38.518,42.856],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.007,8.593,8.525,8.578,8.490,8.630],[0.654,0.409,0.436,0.411,0.427,0.425],[1.329,0.500,0.461,0.473,0.470,0.471],[9.309,8.974,8.899,9.328,8.569,8.484],[0.795,0.748,0.816,0.813,0.829,0.748],[0.248,0.122,0.114,0.136,0.175,0.110],[0.530,0.361,0.343,0.339,0.334,0.323],[null,null,null,null,null,null],[32.456,32.859,33.066,31.934,32.065,32.324],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.074,0.763,0.676,0.693,0.686,0.683],[4.248,4.143,4.176,4.252,4.065,4.192],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.537,0.505,0.517,0.533,0.507,0.508],[1.485,0.950,0.956,0.950,0.966,0.941],[1.490,1.031,1.046,1.003,0.969,0.955],[null,null,null,null,null,null],[62.876,59.514,62.110,61.213,59.675,63.501],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.089,0.765,0.784,0.775,0.796,0.715],[null,null,null,null,null,null],[13.033,11.910,11.625,11.758,11.874,11.696],[null,null,null,null,null,null],[3.207,3.035,3.294,3.396,3.293,2.915],[null,null,null,null,null,null],[0.291,0.149,0.156,0.200,0.152,0.160],[0.379,0.207,0.204,0.204,0.200,0.207],[7.301,5.805,5.926,5.883,5.997,5.952],[13.469,11.962,11.797,11.430,11.212,10.645],[5.832,4.867,4.946,4.809,4.986,5.021],[5.855,4.923,4.884,4.811,4.852,4.998],[12.303,11.441,11.432,11.425,11.917,12.178],[0.923,0.243,0.235,0.243,0.243,0.243],[null,null,null,null,null,null],[1.585,1.002,0.963,0.949,0.959,0.974],[12.400,11.558,11.513,11.350,11.526,11.579],[null,null,null,null,null,null],[1.935,1.165,1.179,1.173,1.195,1.194],[null,null,null,null,null,null],[1.294,0.385,0.386,0.382,0.384,0.386],[1.277,0.452,0.453,0.463,0.454,0.439],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.351,1.109,1.268,1.357,1.251,1.302],[4.675,4.404,4.228,4.218,4.187,4.244],[0.521,0.441,0.423,0.417,0.419,0.416],[0.517,0.416,0.430,0.413,0.434,0.422],[1.580,1.129,1.153,1.172,1.126,1.136],[null,null,null,null,null,null],[2.493,2.477,2.379,2.354,2.402,2.399],[6.576,6.470,6.850,6.597,6.714,6.590],[0.062,0.039,0.040,0.037,0.047,0.084],[0.718,0.501,0.482,0.511,0.491,0.462],[2.098,0.758,0.790,0.792,0.779,0.777],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.207,3.402,3.548,3.613,3.538,3.430],[3.605,3.242,3.157,3.193,3.282,3.202],[2.415,2.439,2.409,2.421,2.398,2.448],[2.356,2.494,2.315,2.273,2.235,2.285],[10.321,9.989,10.013,10.047,9.964,10.027],[2.436,2.480,2.391,2.389,2.482,2.503],[1.284,0.440,0.448,0.445,0.429,0.410],[null,null,null,null,null,null],[1.218,0.529,0.563,0.589,0.502,0.505],[1.784,1.381,1.406,1.405,1.370,1.339],[1.261,0.451,0.428,0.417,0.427,0.413],[2.175,1.253,1.237,1.227,1.223,1.196],[0.538,0.315,0.317,0.315,0.316,0.313],[2.425,2.260,2.478,2.304,2.232,2.340],[null,null,null,null,null,null],[28.307,24.885,25.300,28.774,25.723,32.232],[2.090,1.022,0.951,1.034,0.931,0.939],[null,null,null,null,null,null],[2.450,0.688,0.681,0.658,0.701,0.672],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.224,0.342,0.342,0.339,0.339,0.334],[null,null,null,null,null,null],[1.302,0.378,0.373,0.365,0.375,0.379],[43.194,45.593,43.116,44.043,43.487,45.632],[null,null,null,null,null,null],[0.036,0.042,0.047,0.048,0.040,0.033],[1.730,0.434,0.424,0.434,0.433,0.433],[0.048,0.065,0.043,0.063,0.044,0.050],[null,null,null,null,null,null],[5.681,3.769,3.781,3.813,3.808,3.790],[null,null,null,null,null,null],[2.033,1.871,1.902,1.865,1.882,1.904],[0.267,0.151,0.140,0.182,0.131,0.141],[1.168,1.115,1.111,1.111,1.089,1.093],[1.635,1.258,1.266,1.269,1.262,1.230],[null,null,null,null,null,null],[4.634,4.509,4.442,4.477,4.475,4.381],[2.969,2.500,2.507,2.486,2.509,2.506],[2.927,2.850,2.821,2.815,2.802,2.822],[0.312,0.122,0.124,0.124,0.126,0.124],[0.970,0.775,0.823,0.846,0.811,0.706],[null,null,null,null,null,null],[3.065,2.333,2.352,2.369,2.356,2.368],[null,null,null,null,null,null],[41.979,41.144,42.025,42.316,41.312,41.250],[0.648,0.190,0.195,0.185,0.202,0.199],[3.644,3.228,3.073,3.199,3.085,3.175],[null,null,null,null,null,null],[0.901,0.525,0.528,0.535,0.534,0.520],[0.965,0.913,0.904,0.917,0.909,1.009],[1.038,0.928,1.047,0.953,1.123,0.962],[0.942,0.867,0.855,0.992,0.827,0.858],[1.068,0.987,1.103,0.999,0.964,0.977],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.989,6.089,6.340,6.081,5.843,6.083],[4.405,4.350,4.514,4.214,4.295,4.247],[6.372,6.279,6.102,6.525,6.330,6.706],[13.436,13.216,13.124,13.216,13.251,13.515],[13.397,null,12.904,null,13.287,13.576],[14.209,13.281,13.517,13.494,13.838,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[28.110,27.971,28.402,28.331,28.901,30.452],[31.361,31.417,30.700,31.218,30.604,31.130],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.305,6.368,6.267,6.157,6.139,6.278],[6.856,6.935,6.749,7.095,6.890,6.963],[0.045,0.140,0.055,0.118,0.042,0.041],[0.049,0.069,0.038,0.038,0.038,0.147],[5.180,4.977,4.809,4.657,5.179,5.221],[null,null,null,null,null,null],[7.317,6.541,6.728,6.699,6.606,7.066],[7.722,6.948,7.022,7.053,7.054,6.914],[7.232,6.676,6.747,6.735,6.534,6.701],[6.285,5.927,5.655,5.786,5.460,5.820],[6.956,6.777,6.737,6.655,6.840,6.752],[7.379,7.153,7.304,6.754,6.912,6.715],[6.739,6.881,6.661,6.918,7.130,6.986],[4.488,4.095,4.184,4.409,3.753,3.876],[4.139,3.553,3.581,3.556,3.483,3.570],[5.643,5.377,4.942,5.197,5.300,5.389],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[12.891,12.457,12.368,12.838,12.435,12.030],[0.044,0.034,0.034,0.035,0.169,0.031],[12.231,11.606,11.636,12.360,12.324,11.975],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.063,0.058,0.069,0.220,0.062,0.114],[0.080,0.067,0.050,0.053,0.050,0.051],[0.058,0.052,0.053,0.052,0.053,0.051],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.106,0.112,0.300,0.113,0.104,0.116],[0.115,0.105,0.179,0.098,0.154,0.103],[0.108,0.101,0.137,0.146,0.107,0.101],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.968,2.862,2.743,2.784,2.789,2.801],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.5.5.92","source":"results/23.5.5.92.json"} +,{"actual_version":"23.6.3.87","data_size":{"coffeeshop":44736471207,"hits":14351158109,"job":1828729323,"mgbench":2957073273,"ontime":2698599357,"ssb":72842772057,"taxi":24168015076,"tpcds":18798725889,"tpch":17363469353,"uk":780398952},"kind":"versions-benchmark","load_time":{"coffeeshop":778,"hits":261,"job":21,"mgbench":71,"ontime":60,"ssb":1528,"taxi":554,"tpcds":282,"tpch":273,"uk":34},"machine":"c7a.4xlarge","release_date":"2023-08-28","result":[[0.082,0.010,0.010,0.324,0.009,0.009],[0.050,0.022,0.016,0.017,0.022,0.016],[0.049,0.018,0.011,0.057,0.011,0.010],[0.041,0.014,0.013,0.026,0.012,0.013],[0.048,0.021,0.021,0.043,0.021,0.023],[0.071,0.020,0.017,0.032,0.015,0.016],[0.021,0.007,0.006,0.006,0.006,0.006],[0.072,0.023,0.022,0.023,0.019,0.022],[0.081,0.043,0.038,0.060,0.036,0.035],[0.090,0.060,0.060,0.057,0.055,0.053],[0.516,0.472,0.445,0.442,0.452,0.450],[0.374,0.235,0.267,0.242,0.225,0.224],[0.036,0.009,0.009,0.013,0.008,0.010],[0.054,0.016,0.012,0.012,0.013,0.021],[0.711,0.614,0.609,0.664,0.561,0.561],[0.519,0.117,0.082,0.108,0.074,0.081],[0.046,0.017,0.017,0.014,0.013,0.012],[0.044,0.011,0.012,0.012,0.012,0.012],[6.381,1.523,1.703,1.814,1.772,1.684],[4.698,1.265,1.311,1.287,1.280,1.256],[4.712,1.432,1.463,1.315,1.375,1.332],[5.370,2.182,2.033,2.190,2.243,2.312],[6.204,1.898,1.908,1.916,1.814,1.883],[3.964,1.107,1.179,1.159,1.196,1.155],[0.084,0.035,0.036,0.035,0.034,0.030],[7.657,2.523,2.400,2.588,2.670,2.232],[2.286,1.082,1.100,1.099,1.122,1.148],[1.879,0.594,0.617,0.618,0.611,0.608],[0.003,0.002,0.002,0.002,0.002,0.002],[0.025,0.010,0.011,0.011,0.010,0.010],[0.056,0.025,0.018,0.038,0.020,0.019],[0.147,0.024,0.024,0.023,0.026,0.025],[0.181,0.066,0.062,0.061,0.060,0.058],[0.356,0.173,0.166,0.160,0.157,0.167],[0.004,0.002,0.003,0.023,0.002,0.003],[0.022,0.012,0.011,0.012,0.010,0.010],[0.431,0.284,0.249,0.261,0.249,0.262],[0.459,0.288,0.288,0.305,0.282,0.275],[0.220,0.097,0.102,0.094,0.102,0.098],[0.229,0.109,0.116,0.116,0.122,0.122],[0.563,0.310,0.309,0.311,0.313,0.328],[0.717,0.441,0.406,0.406,0.419,0.432],[0.664,0.451,0.466,0.458,0.447,0.420],[0.417,0.290,0.283,0.265,0.275,0.275],[1.473,1.134,1.128,1.130,1.185,1.127],[1.083,0.794,0.736,0.696,0.732,0.728],[3.142,2.254,2.381,2.334,2.406,2.339],[0.158,0.038,0.026,0.026,0.030,0.030],[1.721,0.379,0.355,0.411,0.406,0.421],[1.941,0.479,0.451,0.478,0.494,0.463],[4.082,1.166,1.192,1.118,1.217,1.177],[2.336,0.503,0.446,0.446,0.509,0.440],[0.492,0.134,0.121,0.133,0.128,0.134],[0.282,0.101,0.105,0.104,0.098,0.103],[0.483,0.122,0.128,0.118,0.118,0.119],[1.775,0.423,0.405,0.445,0.467,0.461],[1.608,0.642,0.663,0.687,0.682,0.701],[1.082,1.084,1.072,1.183,1.070,1.094],[0.584,0.276,0.286,0.268,0.274,0.279],[1.080,0.358,0.359,0.352,0.331,0.333],[2.559,1.907,1.845,2.002,2.036,2.103],[3.170,2.039,1.979,2.012,2.094,1.973],[3.229,1.993,1.859,1.889,1.910,1.897],[0.634,0.562,0.550,0.603,0.635,0.588],[0.118,0.047,0.053,0.042,0.049,0.044],[0.054,0.038,0.024,0.021,0.033,0.023],[0.082,0.040,0.024,0.027,0.024,0.023],[0.192,0.120,0.106,0.108,0.089,0.095],[0.038,0.009,0.010,0.009,0.008,0.008],[0.037,0.015,0.013,0.009,0.008,0.007],[0.016,0.006,0.007,0.007,0.006,0.005],[0.380,0.049,0.045,0.058,0.047,0.044],[0.441,0.069,0.069,0.072,0.071,0.070],[0.127,0.044,0.047,0.064,0.037,0.041],[0.233,0.064,0.064,0.077,0.060,0.065],[0.079,0.034,0.034,0.032,0.033,0.030],[0.177,0.059,0.065,0.056,0.056,0.062],[0.226,0.085,0.086,0.081,0.088,0.082],[0.061,0.034,0.037,0.036,0.034,0.033],[0.106,0.058,0.060,0.062,0.057,0.061],[0.272,0.151,0.157,0.163,0.158,0.160],[0.513,0.194,0.188,0.191,0.204,0.201],[0.484,0.355,0.366,0.315,0.309,0.313],[0.138,0.045,0.061,0.046,0.044,0.046],[0.638,0.292,0.296,0.317,0.305,0.286],[3.097,2.644,2.669,2.575,2.684,2.786],[8.653,1.248,1.257,1.257,1.280,1.292],[2.559,1.341,1.373,1.276,1.232,1.261],[12.820,4.258,4.412,4.275,4.262,4.151],[4.281,4.161,4.177,4.072,4.201,4.235],[4.080,2.397,2.401,2.513,2.400,2.425],[5.786,6.124,6.559,5.715,6.141,6.583],[null,null,null,null,null,null],[4.500,4.226,4.151,4.264,4.209,4.156],[null,null,null,null,null,null],[6.996,6.526,6.636,6.559,6.696,6.478],[null,null,null,null,null,null],[4.316,3.805,3.784,3.783,3.780,3.793],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.702,0.767,0.748,0.525,0.485,0.483],[null,null,null,null,null,null],[19.758,17.164,17.153,17.189,17.165,17.022],[null,null,null,null,null,null],[28.366,28.401,28.688,28.583,28.579,29.141],[0.253,0.062,0.060,0.060,0.062,0.058],[41.584,42.146,38.587,38.687,39.337,41.601],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.134,8.666,8.585,8.511,8.642,8.582],[0.639,0.411,0.409,0.379,0.422,0.418],[1.187,0.478,0.460,0.462,0.462,0.461],[9.201,9.313,9.004,9.028,9.005,8.831],[0.817,0.750,0.793,0.751,0.764,0.729],[0.219,0.103,0.105,0.183,0.104,0.107],[0.515,0.346,0.329,0.322,0.318,0.323],[null,null,null,null,null,null],[32.274,31.640,32.267,32.765,32.056,32.214],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.065,0.759,0.676,0.661,0.670,0.665],[4.283,4.256,4.339,4.255,4.292,4.158],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.612,0.463,0.488,0.500,0.478,0.472],[1.460,0.949,0.943,0.922,0.922,0.943],[1.503,1.038,1.053,1.016,1.002,1.024],[null,null,null,null,null,null],[65.968,59.761,60.621,61.151,59.456,62.145],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.100,0.752,0.747,0.725,0.714,0.695],[null,null,null,null,null,null],[12.489,11.906,11.959,11.659,11.684,11.776],[null,null,null,null,null,null],[3.144,3.036,3.046,3.122,3.116,3.175],[null,null,null,null,null,null],[0.405,0.155,0.150,0.192,0.156,0.154],[0.322,0.200,0.210,0.201,0.204,0.211],[6.742,5.353,5.534,5.655,5.622,5.771],[12.638,11.709,11.700,11.506,11.367,11.180],[6.163,5.151,4.959,4.858,4.854,4.823],[5.743,5.018,4.861,4.955,4.912,4.827],[12.651,11.495,11.414,11.707,11.340,11.758],[0.925,0.281,0.254,0.263,0.265,0.264],[null,null,null,null,null,null],[1.668,1.002,0.956,1.004,1.030,1.008],[12.481,11.546,11.747,11.545,11.414,11.690],[null,null,null,null,null,null],[1.936,1.176,1.183,1.145,1.163,1.173],[null,null,null,null,null,null],[1.267,0.381,0.373,0.370,0.373,0.376],[1.332,0.455,0.453,0.451,0.443,0.481],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.362,1.279,1.352,1.242,1.304,1.265],[4.606,4.391,4.330,4.415,4.407,4.317],[0.493,0.413,0.393,0.395,0.380,0.386],[0.483,0.401,0.403,0.392,0.380,0.386],[1.541,1.125,1.233,1.134,1.135,1.158],[null,null,null,null,null,null],[2.507,2.594,2.449,2.441,2.488,2.466],[6.564,6.471,6.843,6.771,6.907,6.907],[0.056,0.050,0.060,0.037,0.047,0.073],[0.685,0.497,0.534,0.485,0.475,0.465],[2.232,0.783,0.785,0.744,0.759,0.770],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.285,3.515,3.502,3.577,3.558,3.445],[3.597,3.172,3.202,3.172,3.239,3.145],[2.401,2.476,2.352,2.392,2.473,2.458],[2.477,2.230,2.262,2.458,2.268,2.252],[10.307,9.919,10.028,9.986,9.989,9.961],[2.424,2.394,2.414,2.402,2.347,2.415],[1.377,0.403,0.389,0.393,0.395,0.387],[null,null,null,null,null,null],[1.175,0.507,0.520,0.504,0.506,0.511],[1.753,1.337,1.325,1.336,1.371,1.390],[1.314,0.445,0.426,0.433,0.434,0.446],[2.275,1.346,1.338,1.326,1.301,1.271],[0.527,0.307,0.319,0.319,0.326,0.325],[2.356,2.216,2.207,2.261,2.294,2.319],[null,null,null,null,null,null],[24.963,30.109,25.424,24.701,24.435,24.348],[1.812,0.994,0.922,1.017,0.953,0.935],[null,null,null,null,null,null],[2.515,0.682,0.656,0.677,0.643,0.663],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.240,0.325,0.324,0.318,0.317,0.336],[null,null,null,null,null,null],[1.280,0.382,0.381,0.357,0.383,0.381],[45.942,44.225,43.725,47.027,44.859,43.573],[null,null,null,null,null,null],[0.054,0.038,0.034,0.048,0.048,0.045],[1.710,0.413,0.400,0.415,0.412,0.408],[0.047,0.063,0.049,0.044,0.043,0.043],[null,null,null,null,null,null],[5.656,3.824,3.816,3.774,3.896,3.888],[null,null,null,null,null,null],[1.992,1.958,1.966,1.907,1.936,1.961],[0.250,0.138,0.142,0.133,0.132,0.136],[1.213,1.092,1.132,1.121,1.150,1.126],[1.616,1.265,1.242,1.275,1.256,1.198],[null,null,null,null,null,null],[4.504,4.402,4.384,4.379,4.441,4.362],[3.081,2.619,2.510,2.540,2.524,2.581],[2.996,2.762,2.771,2.766,2.760,3.268],[0.290,0.148,0.129,0.120,0.131,0.133],[0.971,0.958,0.851,0.835,0.812,0.827],[null,null,null,null,null,null],[3.132,2.322,2.347,2.477,2.317,2.335],[null,null,null,null,null,null],[42.401,40.425,40.568,41.898,41.158,40.982],[0.687,0.189,0.196,0.186,0.181,0.187],[3.807,3.078,3.195,3.141,3.193,3.090],[null,null,null,null,null,null],[0.906,0.538,0.542,0.566,0.557,0.540],[0.949,0.918,0.900,0.905,0.868,0.871],[1.020,1.024,0.978,0.979,0.995,1.017],[0.880,0.860,0.891,0.865,0.831,0.854],[1.051,1.007,0.959,0.985,0.955,1.073],[16.798,16.746,16.607,16.749,16.931,16.878],[4.978,5.153,5.040,5.048,5.130,4.969],[1.530,1.582,1.493,1.427,1.408,1.561],[null,null,null,null,null,null],[32.876,32.170,32.198,32.195,32.655,32.941],[32.269,31.810,31.697,31.675,32.776,34.055],[39.293,35.754,36.565,34.371,37.057,36.342],[3.903,3.981,3.874,3.841,3.998,3.891],[2.462,2.306,2.514,2.400,2.404,2.404],[4.285,4.227,4.534,4.173,4.219,4.299],[10.288,9.895,9.791,9.797,9.798,9.886],[10.241,9.843,9.797,9.981,9.787,10.158],[10.404,9.977,9.972,9.961,10.073,10.209],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[22.302,22.704,22.014,22.198,22.305,22.132],[24.438,24.225,24.397,24.411,24.408,25.562],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.144,3.871,4.049,3.907,3.889,3.972],[4.471,4.334,4.497,4.336,4.362,4.444],[0.050,0.042,0.038,0.057,0.036,0.037],[0.053,0.041,0.042,0.036,0.039,0.044],[3.185,3.250,3.129,3.206,3.089,3.103],[null,null,null,null,null,null],[4.444,3.932,4.047,3.907,3.931,4.068],[4.759,4.242,4.379,4.213,4.198,4.327],[4.612,3.942,4.107,3.894,3.975,4.035],[3.520,3.079,3.194,3.076,3.086,3.084],[4.162,4.143,4.107,4.229,4.066,4.261],[4.148,4.198,4.129,4.274,4.109,4.155],[4.171,4.086,4.092,4.266,4.112,4.321],[2.958,2.551,2.516,2.403,2.557,2.926],[2.454,2.172,2.004,2.065,2.139,2.051],[4.230,3.471,3.679,3.463,3.438,3.441],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[5.287,4.752,4.808,4.871,4.777,4.850],[0.033,0.050,0.031,0.031,0.031,0.031],[4.537,4.226,4.227,4.033,4.189,4.068],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.053,0.051,0.048,0.049,0.050,0.051],[0.049,0.049,0.049,0.050,0.058,0.054],[0.055,0.049,0.049,0.050,0.054,0.049],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.105,0.125,0.095,0.099,0.099,0.096],[0.097,0.102,0.124,0.095,0.095,0.099],[0.100,0.098,0.097,0.103,0.099,0.111],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.378,1.337,1.342,1.532,1.309,1.250],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.6.3.87","source":"results/23.6.3.87.json"} +,{"actual_version":"23.7.6.111","data_size":{"coffeeshop":44641871661,"hits":14264801696,"job":1828094510,"mgbench":2958853827,"ontime":2699155844,"ssb":73313223339,"taxi":24167909521,"tpcds":18803822879,"tpch":17238269267,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":792,"hits":209,"job":24,"mgbench":70,"ontime":60,"ssb":1520,"taxi":557,"tpcds":279,"tpch":278,"uk":35},"machine":"c7a.4xlarge","release_date":"2023-10-31","result":[[0.088,0.011,0.010,0.368,0.009,0.009],[0.039,0.007,0.009,0.007,0.007,0.007],[0.087,0.027,0.014,0.060,0.013,0.013],[0.035,0.011,0.010,0.023,0.011,0.011],[0.047,0.031,0.023,0.044,0.023,0.028],[0.069,0.017,0.017,0.032,0.016,0.017],[0.022,0.008,0.006,0.006,0.006,0.007],[0.047,0.015,0.015,0.015,0.013,0.013],[0.079,0.035,0.031,0.052,0.033,0.031],[0.086,0.055,0.053,0.055,0.053,0.059],[0.464,0.404,0.407,0.389,0.389,0.344],[0.350,0.232,0.266,0.236,0.217,0.217],[0.040,0.010,0.013,0.007,0.024,0.012],[0.039,0.012,0.022,0.014,0.015,0.013],[0.705,0.614,0.604,0.662,0.575,0.543],[0.558,0.114,0.119,0.119,0.112,0.105],[0.051,0.017,0.015,0.034,0.016,0.016],[0.041,0.012,0.011,0.012,0.011,0.011],[6.401,1.390,1.438,1.455,1.436,1.505],[4.720,1.277,1.269,1.278,1.261,1.227],[4.726,1.201,1.261,1.250,1.233,1.254],[5.305,2.117,1.966,1.990,1.848,1.950],[6.208,1.675,1.666,1.746,1.800,1.621],[3.931,0.974,1.033,1.030,1.082,1.070],[0.084,0.027,0.031,0.028,0.027,0.027],[7.824,2.276,2.251,2.196,2.229,2.294],[1.994,0.727,0.790,0.815,0.793,0.799],[1.920,0.618,0.602,0.620,0.625,0.617],[0.002,0.002,0.003,0.002,0.003,0.002],[0.034,0.011,0.011,0.008,0.009,0.010],[0.063,0.021,0.018,0.038,0.018,0.020],[0.144,0.025,0.026,0.025,0.026,0.026],[0.183,0.065,0.066,0.066,0.065,0.062],[0.359,0.151,0.148,0.152,0.149,0.154],[0.006,0.003,0.002,0.028,0.003,0.003],[0.030,0.011,0.010,0.010,0.010,0.010],[0.455,0.262,0.261,0.257,0.258,0.255],[0.489,0.307,0.283,0.273,0.274,0.282],[0.215,0.085,0.081,0.084,0.081,0.084],[0.242,0.114,0.109,0.109,0.107,0.108],[0.580,0.329,0.327,0.320,0.293,0.289],[0.720,0.423,0.410,0.441,0.463,0.474],[0.630,0.402,0.421,0.436,0.412,0.436],[0.399,0.250,0.264,0.264,0.255,0.248],[1.421,1.045,1.076,1.107,1.034,1.070],[1.020,0.677,0.722,0.735,0.734,0.698],[3.116,2.206,2.286,2.338,2.222,2.282],[0.176,0.034,0.028,0.025,0.032,0.028],[1.620,0.390,0.373,0.378,0.407,0.459],[1.753,0.445,0.451,0.474,0.424,0.454],[3.952,1.095,1.055,1.070,1.049,1.082],[2.252,0.454,0.460,0.484,0.489,0.483],[0.478,0.125,0.132,0.126,0.118,0.117],[0.282,0.101,0.103,0.100,0.118,0.089],[0.460,0.123,0.123,0.117,0.122,0.140],[1.598,0.405,0.414,0.419,0.400,0.401],[1.571,0.652,0.650,0.614,0.622,0.661],[1.072,1.162,1.014,1.125,1.037,1.032],[0.598,0.329,0.272,0.324,0.286,0.270],[1.035,0.380,0.355,0.329,0.311,0.315],[2.458,1.751,1.797,1.887,1.835,1.856],[3.033,1.891,1.911,1.879,1.969,1.983],[3.538,2.234,1.782,1.894,1.844,1.958],[0.710,0.646,0.646,0.610,0.648,0.615],[0.133,0.072,0.083,0.062,0.056,0.054],[0.056,0.035,0.034,0.036,0.030,0.032],[0.098,0.028,0.025,0.023,0.026,0.027],[0.236,0.149,0.147,0.128,0.136,0.125],[0.038,0.010,0.007,0.011,0.008,0.011],[0.038,0.009,0.007,0.008,0.007,0.008],[0.021,0.007,0.005,0.008,0.005,0.005],[0.391,0.053,0.048,0.068,0.047,0.061],[0.459,0.074,0.067,0.062,0.069,0.061],[0.122,0.047,0.044,0.065,0.041,0.037],[0.270,0.079,0.072,0.078,0.062,0.061],[0.086,0.032,0.035,0.034,0.032,0.036],[0.189,0.073,0.076,0.073,0.077,0.076],[0.246,0.101,0.105,0.102,0.100,0.095],[0.065,0.036,0.035,0.036,0.033,0.034],[0.106,0.066,0.063,0.065,0.060,0.059],[0.292,0.176,0.171,0.172,0.173,0.173],[0.485,0.172,0.169,0.166,0.177,0.193],[0.434,0.302,0.307,0.292,0.306,0.290],[0.162,0.044,0.044,0.043,0.043,0.046],[0.699,0.299,0.305,0.317,0.305,0.302],[2.826,2.308,2.309,2.360,2.438,2.396],[8.618,1.179,1.194,1.249,1.202,1.254],[2.345,1.248,1.298,1.341,1.190,1.117],[12.777,4.244,4.391,4.036,3.865,4.038],[4.274,3.972,4.130,4.057,4.039,3.985],[4.068,2.401,2.368,2.525,2.484,2.379],[5.969,5.542,6.099,5.591,5.703,6.213],[null,null,null,null,null,null],[4.312,4.128,4.147,4.189,4.092,4.127],[null,null,null,null,null,null],[7.009,6.638,6.669,6.643,6.373,6.705],[null,null,null,null,null,null],[4.410,4.129,4.134,3.984,4.165,4.174],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.784,0.832,0.877,0.608,0.586,0.565],[null,null,null,null,null,null],[19.925,18.662,17.362,16.758,16.699,16.885],[null,null,null,null,null,null],[28.010,28.023,28.266,28.249,28.246,28.261],[0.252,0.079,0.075,0.080,0.075,0.078],[36.896,35.370,36.265,36.063,35.698,35.149],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.837,8.518,8.420,8.415,8.375,8.413],[0.604,0.433,0.416,0.411,0.435,0.412],[1.278,0.515,0.515,0.528,0.502,0.512],[8.766,8.689,8.834,8.777,8.641,8.906],[0.847,0.786,0.806,0.744,0.838,0.790],[0.259,0.109,0.112,0.181,0.116,0.116],[0.535,0.315,0.337,0.317,0.330,0.335],[null,null,null,null,null,null],[32.061,30.274,30.217,31.817,31.112,31.805],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.084,0.768,0.673,0.680,0.672,0.661],[4.334,4.285,4.284,4.033,4.003,4.190],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.576,0.475,0.483,0.499,0.470,0.472],[1.437,0.936,0.953,0.883,0.891,0.902],[1.451,0.980,0.989,2.235,0.950,0.940],[null,null,null,null,null,null],[58.270,57.681,56.944,57.388,57.750,57.291],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.062,0.702,0.719,0.704,0.691,0.679],[null,null,null,null,null,null],[12.555,11.407,11.427,11.282,11.206,11.233],[null,null,null,null,null,null],[3.030,2.874,2.994,3.037,2.989,2.945],[null,null,null,null,null,null],[0.304,0.151,0.154,0.158,0.164,0.155],[0.333,0.218,0.194,0.206,0.198,0.195],[6.289,4.998,5.055,4.974,4.945,4.818],[10.987,10.127,9.926,9.817,9.892,10.331],[6.149,5.271,5.345,5.577,5.484,5.323],[6.397,5.497,5.588,5.665,5.599,5.638],[13.983,12.651,12.113,11.530,11.481,11.666],[0.827,0.235,0.224,0.222,0.241,0.258],[null,null,null,null,null,null],[1.525,0.955,0.971,0.939,0.934,0.969],[12.616,11.595,11.506,11.567,11.868,11.448],[null,null,null,null,null,null],[1.849,1.271,1.268,1.241,1.226,1.276],[null,null,null,null,null,null],[1.231,0.385,0.387,0.401,0.394,0.407],[1.339,0.494,0.457,0.483,0.475,0.454],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.356,1.283,1.249,1.256,1.263,1.288],[4.748,4.437,4.453,4.450,4.479,4.450],[0.521,0.447,0.425,0.432,0.431,0.427],[0.553,0.435,0.436,0.431,0.411,0.426],[1.555,1.157,1.215,1.164,1.193,1.163],[null,null,null,null,null,null],[2.454,2.463,2.454,2.410,2.316,2.506],[6.688,6.444,6.515,6.202,6.517,6.496],[0.084,0.045,0.051,0.042,0.040,0.047],[0.693,0.489,0.471,0.507,0.543,0.493],[2.149,0.785,0.785,0.752,0.772,0.759],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.312,3.483,3.495,3.575,3.610,3.603],[3.729,3.285,3.198,3.342,3.194,3.134],[2.387,2.363,2.350,2.417,2.348,2.368],[1.947,1.896,1.885,1.894,1.908,1.839],[10.098,9.846,10.005,10.396,9.879,9.891],[2.411,2.352,2.344,2.411,2.351,2.340],[1.158,0.383,0.397,0.379,0.390,0.382],[null,null,null,null,null,null],[1.087,0.494,0.512,0.495,0.489,0.497],[1.719,1.294,1.323,1.266,1.291,1.283],[1.224,0.404,0.395,0.404,0.407,0.434],[2.228,1.229,1.211,1.193,1.191,1.197],[0.521,0.306,0.306,0.320,0.302,0.302],[2.015,2.464,1.924,1.922,1.953,1.858],[null,null,null,null,null,null],[25.389,24.509,26.284,29.784,26.736,25.467],[1.736,0.983,0.911,0.985,0.928,0.927],[null,null,null,null,null,null],[2.518,0.696,0.655,0.666,0.732,0.667],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.132,0.320,0.315,0.327,0.320,0.322],[null,null,null,null,null,null],[1.205,0.345,0.379,0.390,0.390,0.377],[41.606,41.252,42.294,41.361,40.986,40.925],[null,null,null,null,null,null],[0.046,0.042,0.039,0.062,0.037,0.062],[1.627,0.414,0.401,0.405,0.398,0.396],[0.068,0.068,0.051,0.046,0.046,0.049],[null,null,null,null,null,null],[5.540,3.760,3.694,3.682,3.711,3.656],[null,null,null,null,null,null],[1.949,1.840,1.868,1.840,1.865,1.844],[0.228,0.144,0.136,0.135,0.128,0.126],[1.126,1.023,1.017,1.001,1.074,1.035],[1.537,1.252,1.235,1.283,1.234,1.248],[null,null,null,null,null,null],[4.512,4.305,4.269,4.305,4.264,4.246],[3.002,2.526,2.512,2.491,2.497,2.521],[2.812,3.019,2.679,2.564,2.734,2.675],[0.327,0.127,0.122,0.132,0.127,0.125],[0.852,0.751,0.771,0.775,0.802,0.779],[null,null,null,null,null,null],[3.241,2.497,2.430,2.376,2.416,2.374],[null,null,null,null,null,null],[41.495,41.673,41.593,41.079,40.163,39.957],[0.657,0.196,0.187,0.187,0.190,0.195],[3.744,3.231,3.223,3.350,3.194,3.245],[null,null,null,null,null,null],[0.859,0.566,0.553,0.546,0.552,0.560],[0.886,0.812,0.819,0.835,0.899,0.798],[0.567,0.555,0.532,0.487,0.485,0.512],[0.284,0.205,0.224,0.176,0.202,0.207],[0.578,0.519,0.546,0.525,0.548,0.535],[1.506,1.481,1.630,1.458,1.432,1.484],[1.462,1.465,1.407,1.446,1.564,1.489],[1.491,1.601,1.417,1.415,1.442,1.523],[null,null,null,null,null,null],[1.680,1.266,1.276,1.382,1.269,1.273],[1.292,1.034,0.876,0.865,0.855,0.919],[3.022,2.618,2.636,2.562,2.530,2.672],[2.547,2.391,2.303,2.436,2.693,2.492],[1.032,0.808,0.762,0.813,0.775,0.777],[3.160,2.897,2.878,2.830,2.906,3.075],[0.694,0.264,0.238,0.258,0.267,0.252],[0.607,0.204,0.193,0.194,0.180,0.163],[0.717,0.349,0.363,0.342,0.321,0.319],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.749,2.726,2.593,2.582,2.606,2.559],[4.139,3.974,3.971,3.909,3.943,3.997],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.104,0.741,0.734,0.755,0.741,0.764],[1.637,1.336,1.299,1.349,1.337,1.327],[0.044,0.038,0.037,0.038,0.036,0.039],[0.039,0.036,0.039,0.040,0.037,0.037],[1.785,1.714,1.664,1.659,1.675,1.683],[null,null,null,null,null,null],[0.943,0.476,0.434,0.431,0.458,0.430],[2.985,2.690,2.609,2.709,2.591,2.578],[1.053,0.549,0.568,0.564,0.559,0.569],[3.404,3.012,2.983,2.982,2.996,3.004],[2.753,2.680,2.719,2.758,2.847,2.748],[2.832,2.745,2.769,2.722,2.762,2.704],[3.535,3.382,3.493,3.288,3.450,3.373],[2.001,1.541,1.527,1.496,1.493,1.554],[1.467,1.057,1.016,1.071,1.006,1.021],[2.773,2.136,2.121,2.102,2.121,2.097],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.485,2.905,2.984,3.091,2.961,2.965],[0.044,0.034,0.038,0.043,0.034,0.051],[1.574,1.054,1.190,1.085,1.053,1.038],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.065,0.050,0.051,0.054,0.054,0.053],[0.050,0.049,0.049,0.049,0.049,0.049],[0.049,0.049,0.049,0.050,0.053,0.051],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.099,0.099,0.101,0.098,0.098,0.101],[0.098,0.098,0.100,0.099,0.099,0.097],[0.098,0.102,0.098,0.098,0.100,0.097],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.422,1.463,1.271,1.345,1.331,1.465],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.7.6.111","source":"results/23.7.6.111.json"} +,{"actual_version":"23.9.6.20","data_size":{"coffeeshop":44642163855,"hits":14245082700,"job":1828094510,"mgbench":2953714350,"ontime":2699155844,"ssb":73312042715,"taxi":24167635194,"tpcds":18802928444,"tpch":17237168439,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":753,"hits":218,"job":23,"mgbench":67,"ontime":58,"ssb":1456,"taxi":531,"tpcds":293,"tpch":277,"uk":37},"machine":"c7a.4xlarge","release_date":"2023-11-25","result":[[0.088,0.010,0.010,0.367,0.009,0.008],[0.050,0.018,0.015,0.015,0.017,0.015],[0.048,0.022,0.010,0.066,0.010,0.010],[0.039,0.011,0.011,0.025,0.013,0.011],[0.052,0.021,0.022,0.048,0.020,0.019],[0.065,0.016,0.017,0.037,0.017,0.016],[0.023,0.006,0.006,0.006,0.006,0.006],[0.047,0.014,0.013,0.013,0.013,0.013],[0.080,0.034,0.032,0.061,0.031,0.030],[0.090,0.056,0.053,0.050,0.053,0.050],[0.465,0.398,0.381,0.386,0.377,0.371],[0.355,0.210,0.255,0.224,0.203,0.204],[0.032,0.007,0.007,0.007,0.010,0.007],[0.038,0.012,0.014,0.012,0.013,0.014],[0.668,0.541,0.545,0.646,0.514,0.518],[0.553,0.113,0.111,0.111,0.108,0.110],[0.048,0.016,0.015,0.013,0.015,0.014],[0.037,0.011,0.012,0.012,0.012,0.012],[6.406,1.298,1.320,1.327,1.308,1.306],[4.699,0.995,1.017,1.002,1.012,1.004],[4.721,1.022,1.032,1.034,1.033,1.044],[5.301,1.631,1.620,1.636,1.638,1.632],[6.201,1.383,1.381,1.401,1.392,1.400],[3.922,0.832,0.834,0.833,0.822,0.819],[0.064,0.022,0.026,0.022,0.022,0.021],[7.826,1.841,1.845,1.871,1.846,1.844],[1.963,0.665,0.655,0.667,0.660,0.669],[1.908,0.476,0.478,0.477,0.490,0.478],[0.002,0.002,0.002,0.002,0.002,0.002],[0.023,0.015,0.007,0.011,0.007,0.007],[0.064,0.016,0.019,0.040,0.015,0.015],[0.157,0.022,0.021,0.024,0.020,0.024],[0.188,0.064,0.052,0.054,0.055,0.052],[0.339,0.130,0.128,0.128,0.128,0.128],[0.005,0.002,0.002,0.031,0.003,0.004],[0.019,0.009,0.009,0.008,0.008,0.009],[0.406,0.237,0.223,0.225,0.227,0.227],[0.469,0.261,0.267,0.274,0.264,0.262],[0.221,0.082,0.076,0.077,0.076,0.083],[0.233,0.098,0.098,0.098,0.093,0.095],[0.533,0.271,0.267,0.276,0.268,0.271],[0.701,0.382,0.371,0.378,0.370,0.377],[0.615,0.407,0.388,0.408,0.386,0.404],[0.396,0.237,0.229,0.226,0.224,0.220],[1.372,1.001,1.005,1.019,0.987,0.990],[1.005,0.653,0.672,0.657,0.647,0.664],[2.869,2.003,2.004,2.006,2.008,2.011],[0.168,0.022,0.026,0.037,0.021,0.026],[1.740,0.316,0.337,0.320,0.315,0.316],[1.897,0.351,0.359,0.364,0.362,0.352],[3.934,0.953,0.949,0.954,0.942,0.954],[2.306,0.396,0.385,0.395,0.404,0.388],[0.500,0.118,0.105,0.105,0.105,0.104],[0.301,0.085,0.100,0.085,0.096,0.085],[0.486,0.104,0.106,0.107,0.103,0.109],[1.697,0.347,0.351,0.368,0.335,0.362],[1.661,0.541,0.531,0.531,0.543,0.532],[0.918,0.901,0.890,1.004,0.890,0.888],[0.581,0.258,0.237,0.257,0.219,0.230],[1.020,0.293,0.289,0.287,0.291,0.288],[2.247,1.543,1.531,1.544,1.514,1.541],[2.914,1.598,1.549,1.552,1.539,1.539],[2.954,1.575,1.550,1.532,1.535,1.558],[0.603,0.518,0.457,0.484,0.450,0.495],[0.140,0.061,0.052,0.057,0.055,0.052],[0.074,0.031,0.028,0.026,0.027,0.029],[0.101,0.032,0.031,0.026,0.023,0.021],[0.273,0.147,0.142,0.138,0.139,0.143],[0.030,0.008,0.008,0.008,0.009,0.007],[0.027,0.007,0.006,0.007,0.008,0.006],[0.015,0.004,0.004,0.004,0.004,0.004],[0.392,0.051,0.040,0.061,0.038,0.037],[0.467,0.056,0.058,0.059,0.061,0.056],[0.117,0.035,0.037,0.055,0.033,0.034],[0.240,0.056,0.056,0.072,0.056,0.054],[0.082,0.030,0.030,0.031,0.029,0.030],[0.182,0.069,0.078,0.067,0.067,0.067],[0.242,0.095,0.091,0.088,0.089,0.086],[0.064,0.033,0.031,0.031,0.031,0.032],[0.107,0.055,0.058,0.056,0.057,0.056],[0.269,0.153,0.149,0.149,0.151,0.149],[0.491,0.169,0.165,0.164,0.157,0.157],[0.405,0.260,0.254,0.262,0.263,0.255],[0.151,0.043,0.041,0.039,0.039,0.038],[0.700,0.288,0.296,0.333,0.301,0.287],[2.654,2.174,2.168,2.167,2.171,2.168],[8.573,1.019,1.032,1.050,1.009,1.007],[2.287,1.004,1.018,0.997,1.028,1.005],[12.803,3.408,3.411,3.417,3.440,3.424],[4.289,3.293,3.259,3.270,3.242,3.267],[4.066,1.826,1.844,1.842,1.937,1.831],[5.323,5.003,4.846,4.472,5.020,4.967],[null,null,null,null,null,null],[3.636,3.225,3.229,3.233,3.218,3.205],[null,null,null,null,null,null],[5.514,5.222,5.195,5.360,5.206,5.321],[null,null,null,null,null,null],[3.503,3.188,3.289,3.198,3.181,3.188],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.799,0.677,0.671,0.496,0.444,0.443],[null,null,null,null,null,null],[16.021,15.120,14.349,14.950,15.400,15.485],[null,null,null,null,null,null],[26.933,27.888,27.744,27.426,27.004,26.516],[0.274,0.068,0.068,0.068,0.071,0.072],[36.576,42.163,33.994,34.675,33.558,41.713],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.728,7.642,6.642,8.154,8.180,7.467],[0.726,0.409,0.525,0.367,0.396,0.422],[1.230,0.509,0.438,0.532,0.507,0.441],[8.474,7.995,7.917,7.996,8.355,8.057],[0.799,0.710,0.737,0.766,0.648,0.738],[0.486,0.138,0.105,0.119,0.097,0.097],[0.529,0.339,0.343,0.344,0.259,0.337],[null,null,null,null,null,null],[29.593,30.061,29.606,29.004,29.143,29.652],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.993,0.746,0.651,0.666,0.648,0.657],[4.004,4.155,4.034,3.676,3.543,3.394],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.692,0.470,0.463,0.493,0.469,0.474],[1.449,0.857,0.863,0.869,0.870,0.883],[1.477,0.991,1.046,2.363,0.932,0.945],[null,null,null,null,null,null],[53.973,60.227,56.647,54.935,57.470,54.331],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.077,0.731,0.743,0.724,0.733,0.687],[null,null,null,null,null,null],[14.068,12.936,12.560,14.493,13.236,7.944],[null,null,null,null,null,null],[3.517,2.905,2.879,2.949,2.839,2.931],[null,null,null,null,null,null],[0.315,0.137,0.135,0.154,0.141,0.139],[0.324,0.188,0.180,0.177,0.181,0.185],[6.241,4.840,4.811,4.819,4.813,4.829],[11.062,9.753,9.743,9.662,9.730,9.713],[6.274,4.227,5.141,4.393,4.899,4.523],[6.262,4.522,5.223,5.144,5.190,4.208],[14.780,12.036,12.559,12.543,13.012,12.675],[0.969,0.453,0.228,0.235,0.233,0.414],[null,null,null,null,null,null],[1.596,0.970,0.959,0.968,0.961,0.964],[13.355,10.813,13.027,11.302,12.620,11.092],[null,null,null,null,null,null],[2.297,1.454,1.164,1.150,1.196,1.213],[null,null,null,null,null,null],[1.236,0.354,0.360,0.359,0.351,0.356],[1.429,0.450,0.458,0.442,0.430,0.447],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.360,1.241,1.022,1.098,0.911,0.985],[4.547,4.294,4.346,4.390,4.339,4.336],[0.488,0.385,0.373,0.367,0.380,0.383],[0.487,0.381,0.380,0.377,0.378,0.384],[1.555,1.121,1.116,1.146,1.121,1.130],[null,null,null,null,null,null],[2.267,2.293,1.959,2.080,2.209,2.359],[7.050,5.683,5.647,6.346,5.844,5.847],[0.044,0.051,0.047,0.049,0.072,0.154],[0.743,0.477,0.500,0.461,0.505,0.478],[2.304,0.767,0.760,0.748,0.708,0.764],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.156,3.700,3.788,3.785,3.218,3.737],[3.727,3.048,2.766,3.093,2.754,3.168],[2.353,2.306,2.086,2.488,2.254,2.148],[1.655,1.668,1.417,1.579,1.561,1.733],[9.895,9.617,9.837,9.449,9.735,9.856],[2.033,2.391,2.501,1.895,2.223,2.124],[1.270,0.345,0.341,0.343,0.340,0.340],[null,null,null,null,null,null],[1.123,0.485,0.478,0.488,0.488,0.476],[1.791,1.286,1.278,1.294,1.291,1.292],[1.267,0.391,0.353,0.393,0.369,0.397],[2.305,1.212,1.218,1.190,1.193,1.190],[0.534,0.325,0.298,0.307,0.309,0.299],[1.974,2.271,1.731,1.732,1.697,1.384],[null,null,null,null,null,null],[31.570,29.823,33.087,32.422,28.179,28.195],[1.778,0.988,0.909,1.009,0.914,0.921],[null,null,null,null,null,null],[2.672,0.677,0.647,0.677,0.649,0.627],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.218,0.325,0.314,0.313,0.313,0.311],[null,null,null,null,null,null],[1.335,0.362,0.365,0.360,0.353,0.362],[43.706,41.008,43.940,43.743,40.859,40.691],[null,null,null,null,null,null],[0.066,0.038,0.045,0.050,0.034,0.045],[1.770,0.392,0.411,0.384,0.396,0.379],[0.050,0.064,0.042,0.042,0.042,0.045],[null,null,null,null,null,null],[4.650,2.956,2.564,2.315,2.250,2.517],[null,null,null,null,null,null],[1.912,1.636,1.681,1.600,1.536,1.486],[0.357,0.173,0.142,0.134,0.151,0.131],[1.084,1.037,0.906,1.061,1.011,0.950],[1.531,1.311,1.124,1.216,1.276,0.837],[null,null,null,null,null,null],[4.631,4.348,4.333,4.328,4.383,4.319],[3.000,2.468,2.464,2.452,2.460,2.450],[3.279,2.273,1.933,2.263,2.044,2.204],[0.400,0.130,0.119,0.115,0.122,0.117],[0.899,0.781,0.866,0.750,0.790,0.791],[null,null,null,null,null,null],[3.527,2.503,2.512,1.518,2.536,2.498],[null,null,null,null,null,null],[39.118,38.021,38.037,37.891,37.742,38.776],[0.706,0.185,0.240,0.200,0.185,0.181],[4.147,2.300,2.982,3.427,3.178,3.342],[null,null,null,null,null,null],[0.889,0.538,0.523,0.524,0.534,0.548],[0.914,0.851,0.793,0.853,0.847,0.809],[0.600,0.558,0.569,0.483,0.497,0.330],[0.319,0.219,0.216,0.246,0.250,0.238],[0.568,0.530,0.496,0.587,0.401,0.496],[1.433,1.493,1.409,1.053,0.760,1.390],[0.843,1.467,1.407,1.333,1.341,1.255],[1.009,1.532,0.962,1.406,1.103,1.377],[null,null,null,null,null,null],[1.498,0.798,1.314,1.281,1.284,1.319],[1.364,0.885,0.577,0.889,0.850,0.934],[2.986,2.468,2.566,2.640,2.532,2.732],[2.186,2.542,2.390,2.488,2.278,2.355],[0.877,0.464,0.763,0.508,0.451,0.389],[2.943,2.790,2.366,2.374,2.733,2.718],[0.786,0.291,0.271,0.278,0.285,0.229],[0.745,0.213,0.225,0.221,0.210,0.208],[0.843,0.412,0.327,0.368,0.381,0.260],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.666,2.477,2.627,2.527,2.575,2.427],[4.242,3.938,3.718,3.831,3.930,3.893],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.045,0.751,0.424,0.815,0.780,0.800],[1.511,1.297,1.349,1.475,1.373,1.331],[0.035,0.034,0.034,0.035,0.091,0.035],[0.061,0.034,0.034,0.036,0.035,0.034],[1.735,1.622,1.398,1.665,1.212,1.185],[null,null,null,null,null,null],[1.000,0.501,0.467,0.459,0.476,0.439],[3.341,2.904,2.808,2.487,1.905,2.420],[1.172,0.655,0.612,0.589,0.595,0.595],[3.632,2.427,2.934,2.719,3.140,3.155],[3.029,3.243,2.871,3.093,2.996,2.844],[2.946,3.158,3.148,3.018,2.945,3.232],[3.605,3.013,3.599,2.475,3.171,2.867],[2.071,1.657,1.486,1.519,1.539,1.498],[1.562,0.948,1.098,1.038,0.738,1.049],[2.727,2.234,2.203,1.877,2.022,2.089],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.139,2.432,2.516,2.736,2.200,2.937],[0.032,0.030,0.034,0.031,0.030,0.050],[1.741,1.146,0.996,0.772,0.555,1.091],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.048,0.097,0.046,0.051,0.057,0.045],[0.048,0.045,0.045,0.050,0.049,0.046],[0.047,0.047,0.049,0.047,0.045,0.045],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.087,0.088,0.097,0.095,0.088,0.086],[0.089,0.088,0.088,0.087,0.087,0.087],[0.089,0.088,0.087,0.087,0.087,0.087],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.404,1.341,1.212,1.081,0.934,1.170],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.9.6.20","source":"results/23.9.6.20.json"} +,{"actual_version":"23.10.6.60","data_size":{"coffeeshop":44638595238,"hits":14232642713,"job":1828094510,"mgbench":2954107754,"ontime":2699155844,"ssb":73313772874,"taxi":24223907640,"tpcds":18785875583,"tpch":17235976165,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":807,"hits":244,"job":24,"mgbench":84,"ontime":65,"ssb":1636,"taxi":605,"tpcds":282,"tpch":313,"uk":34},"machine":"c7a.4xlarge","release_date":"2024-01-05","result":[[0.084,0.011,0.011,0.344,0.012,0.010],[0.052,0.024,0.022,0.017,0.022,0.017],[0.050,0.019,0.012,0.073,0.012,0.011],[0.035,0.013,0.012,0.028,0.012,0.012],[0.056,0.025,0.024,0.054,0.025,0.026],[0.070,0.020,0.019,0.042,0.022,0.018],[0.023,0.007,0.007,0.007,0.007,0.007],[0.050,0.016,0.016,0.015,0.016,0.014],[0.074,0.039,0.038,0.061,0.037,0.035],[0.098,0.060,0.059,0.061,0.063,0.059],[0.498,0.381,0.363,0.438,0.423,0.363],[0.397,0.239,0.291,0.259,0.236,0.236],[0.035,0.008,0.012,0.011,0.007,0.008],[0.043,0.018,0.013,0.017,0.014,0.021],[0.769,0.671,0.645,0.753,0.612,0.621],[0.556,0.124,0.122,0.121,0.123,0.124],[0.050,0.022,0.014,0.016,0.016,0.014],[0.040,0.011,0.013,0.011,0.011,0.011],[6.386,1.576,1.571,1.583,1.550,1.560],[4.719,1.213,1.214,1.191,1.204,1.185],[4.710,1.240,1.249,1.234,1.236,1.233],[5.294,2.002,1.986,1.989,1.954,1.959],[6.193,1.668,1.691,1.694,1.680,1.680],[3.925,0.998,0.986,1.018,1.011,0.994],[0.066,0.028,0.027,0.028,0.028,0.026],[7.809,2.258,2.239,2.253,2.243,2.210],[2.097,0.808,0.778,0.787,0.783,0.797],[1.907,0.573,0.574,0.573,0.575,0.588],[0.003,0.002,0.002,0.002,0.002,0.002],[0.029,0.011,0.009,0.008,0.008,0.007],[0.060,0.019,0.018,0.042,0.019,0.017],[0.164,0.025,0.024,0.025,0.024,0.024],[0.205,0.060,0.060,0.076,0.061,0.068],[0.367,0.161,0.149,0.148,0.149,0.147],[0.004,0.002,0.002,0.033,0.003,0.003],[0.017,0.010,0.010,0.010,0.010,0.010],[0.443,0.264,0.260,0.254,0.262,0.255],[0.507,0.299,0.297,0.308,0.294,0.308],[0.239,0.092,0.089,0.090,0.086,0.087],[0.257,0.110,0.113,0.110,0.110,0.110],[0.580,0.309,0.305,0.300,0.303,0.306],[0.795,0.433,0.418,0.421,0.427,0.431],[0.650,0.451,0.421,0.435,0.431,0.433],[0.433,0.263,0.259,0.254,0.251,0.256],[1.525,1.108,1.094,1.086,1.097,1.101],[1.078,0.733,0.741,0.731,0.751,0.727],[3.179,2.199,2.213,2.252,2.224,2.241],[0.182,0.033,0.035,0.035,0.025,0.031],[1.931,0.399,0.399,0.401,0.400,0.417],[2.129,0.446,0.448,0.492,0.466,0.455],[3.951,1.119,1.098,1.118,1.115,1.095],[2.452,0.472,0.491,0.509,0.489,0.472],[0.553,0.140,0.125,0.126,0.123,0.138],[0.326,0.099,0.106,0.100,0.114,0.102],[0.548,0.122,0.123,0.124,0.133,0.134],[1.924,0.409,0.426,0.439,0.427,0.411],[1.817,0.653,0.661,0.658,0.649,0.650],[1.046,1.019,1.026,1.133,1.027,1.029],[0.599,0.268,0.266,0.280,0.259,0.262],[1.116,0.342,0.333,0.334,0.333,0.339],[2.477,1.674,1.900,1.793,1.747,1.732],[3.232,1.762,1.777,1.745,1.729,1.749],[3.257,1.789,1.801,1.766,1.764,1.742],[0.692,0.538,0.573,0.587,0.576,0.572],[0.078,0.035,0.030,0.031,0.031,0.030],[0.043,0.034,0.026,0.023,0.021,0.022],[0.073,0.020,0.017,0.020,0.016,0.016],[0.113,0.059,0.061,0.056,0.052,0.056],[0.024,0.014,0.007,0.008,0.010,0.007],[0.023,0.007,0.008,0.008,0.007,0.006],[0.012,0.004,0.004,0.005,0.004,0.004],[0.367,0.051,0.049,0.065,0.049,0.045],[0.425,0.068,0.068,0.066,0.066,0.063],[0.113,0.046,0.041,0.065,0.039,0.040],[0.222,0.065,0.066,0.086,0.065,0.066],[0.079,0.035,0.033,0.033,0.035,0.034],[0.186,0.078,0.079,0.079,0.078,0.078],[0.247,0.108,0.102,0.107,0.102,0.104],[0.063,0.037,0.037,0.036,0.037,0.036],[0.108,0.065,0.065,0.068,0.065,0.065],[0.288,0.189,0.180,0.179,0.179,0.179],[0.498,0.193,0.190,0.188,0.191,0.193],[0.445,0.322,0.342,0.306,0.311,0.307],[0.141,0.050,0.048,0.045,0.048,0.046],[0.682,0.351,0.344,0.371,0.334,0.339],[3.240,2.698,2.688,2.672,2.685,2.695],[9.788,1.305,1.322,1.361,1.307,1.305],[2.638,1.326,1.331,1.320,1.322,1.356],[14.199,4.248,4.274,4.264,4.261,4.251],[4.408,4.002,3.960,4.016,4.001,3.988],[4.069,2.377,2.262,2.443,2.256,2.252],[6.376,5.779,6.143,5.397,6.065,6.353],[null,null,null,null,null,null],[4.330,3.917,3.930,3.964,3.944,3.937],[null,null,null,null,null,null],[6.743,6.511,6.532,6.368,6.351,6.455],[null,null,null,null,null,null],[4.203,3.859,3.851,3.880,4.036,3.858],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.768,0.812,0.802,0.597,0.539,0.538],[null,null,null,null,null,null],[17.257,16.923,16.387,17.329,16.921,16.778],[null,null,null,null,null,null],[28.950,28.441,29.800,28.221,27.381,27.255],[0.274,0.080,0.082,0.085,0.080,0.081],[22.982,23.519,23.554,22.337,22.705,21.905],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.290,7.588,8.218,8.194,8.379,8.251],[0.781,0.444,0.508,0.449,0.565,0.449],[1.186,0.556,0.564,0.583,0.491,0.575],[9.231,9.022,8.655,8.484,8.466,8.536],[0.837,0.702,0.785,0.778,0.815,0.741],[0.339,0.110,0.129,0.134,0.113,0.139],[0.493,0.276,0.358,0.372,0.284,0.373],[null,null,null,null,null,null],[31.470,30.033,30.555,30.437,30.927,30.926],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.129,0.860,0.766,0.771,0.764,0.760],[4.324,4.067,4.024,4.398,4.260,4.302],[50.420,50.888,54.332,52.178,52.837,52.796],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.943,0.486,0.483,0.518,0.498,0.477],[1.475,0.955,0.958,0.965,0.942,0.924],[1.591,1.077,1.094,1.073,1.086,1.066],[null,null,null,null,null,null],[30.646,31.006,30.469,29.967,29.550,31.571],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.188,0.738,0.753,0.739,0.743,0.781],[null,null,null,null,null,null],[13.669,13.218,14.779,12.927,15.877,13.693],[null,null,null,null,null,null],[3.521,3.091,2.925,2.933,2.727,2.943],[null,null,null,null,null,null],[0.302,0.165,0.159,0.184,0.168,0.160],[0.334,0.197,0.194,0.203,0.192,0.188],[6.819,5.367,5.277,5.218,5.307,5.223],[12.209,10.879,10.804,10.954,11.014,11.098],[6.229,5.855,5.189,4.916,5.484,4.887],[5.875,5.290,5.183,4.537,4.124,4.850],[14.168,12.654,12.137,12.362,14.407,12.561],[1.072,0.272,0.277,0.272,0.276,0.272],[null,null,null,null,null,null],[1.809,1.131,1.130,1.142,1.123,1.147],[13.555,12.386,13.778,12.704,13.144,12.805],[null,null,null,null,null,null],[2.160,1.321,1.280,1.296,1.304,1.342],[null,null,null,null,null,null],[1.301,0.416,0.408,0.416,0.412,0.411],[1.508,0.497,0.495,0.485,0.499,0.484],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.369,1.143,1.165,0.993,1.079,1.046],[4.736,4.505,4.524,4.503,4.500,4.526],[0.562,0.465,0.440,0.465,0.453,0.459],[0.566,0.461,0.457,0.463,0.436,0.459],[1.662,1.220,1.201,1.238,1.210,1.207],[null,null,null,null,null,null],[2.570,2.493,2.241,2.223,2.393,2.276],[6.094,7.052,6.802,6.555,5.714,6.683],[0.093,0.051,0.038,0.050,0.050,0.048],[0.761,0.518,0.505,0.525,0.548,0.493],[2.364,0.847,0.823,0.851,0.821,0.831],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.207,3.415,3.421,3.399,2.522,3.431],[3.361,2.809,2.766,2.828,2.801,2.801],[2.550,2.343,2.419,2.156,2.033,2.481],[2.142,1.684,1.840,1.627,1.725,1.952],[10.360,10.188,10.031,9.778,9.669,10.093],[2.378,2.341,1.934,2.285,2.357,2.358],[1.422,0.419,0.399,0.408,0.443,0.422],[null,null,null,null,null,null],[1.191,0.525,0.520,0.531,0.525,0.525],[1.839,1.372,1.401,1.376,1.361,1.388],[1.299,0.418,0.413,0.421,0.420,0.423],[2.358,1.289,1.257,1.242,1.254,1.235],[0.539,0.327,0.326,0.324,0.323,0.322],[2.002,2.332,1.948,1.823,1.611,1.627],[null,null,null,null,null,null],[33.848,32.867,25.178,25.151,30.870,24.887],[1.942,1.048,0.973,1.069,0.980,1.010],[null,null,null,null,null,null],[2.752,0.701,0.684,0.669,0.677,0.703],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.302,0.342,0.341,0.338,0.348,0.344],[null,null,null,null,null,null],[1.337,0.378,0.369,0.376,0.375,0.370],[25.767,24.620,25.052,24.607,24.899,25.578],[null,null,null,null,null,null],[0.038,0.049,0.040,0.070,0.030,0.029],[1.882,0.462,0.433,0.431,0.420,0.428],[0.051,0.069,0.049,0.069,0.042,0.041],[null,null,null,null,null,null],[4.699,2.992,2.723,2.605,2.970,3.023],[null,null,null,null,null,null],[1.961,1.632,1.638,1.656,1.368,1.542],[0.353,0.154,0.173,0.150,0.134,0.134],[1.144,1.089,0.973,0.969,1.031,0.993],[1.551,1.280,0.996,1.309,1.246,0.879],[null,null,null,null,null,null],[4.648,4.331,4.409,4.323,4.335,4.332],[3.119,2.595,2.556,2.549,2.608,2.557],[2.396,2.231,2.172,2.252,2.083,2.134],[0.368,0.128,0.125,0.141,0.119,0.128],[0.842,0.827,0.911,0.786,0.770,0.778],[null,null,null,null,null,null],[3.410,2.534,2.341,2.539,2.204,2.169],[null,null,null,null,null,null],[39.962,38.386,38.609,37.929,37.377,38.603],[0.752,0.199,0.209,0.199,0.206,0.215],[3.631,3.273,3.410,3.328,3.006,3.004],[null,null,null,null,null,null],[0.943,0.574,0.581,0.593,0.582,0.582],[0.895,0.820,0.754,0.788,0.753,0.751],[0.525,0.430,0.525,0.577,0.470,0.487],[0.292,0.258,0.257,0.215,0.279,0.228],[0.643,0.592,0.569,0.469,0.579,0.521],[1.383,1.479,1.256,1.298,1.492,1.417],[1.196,1.367,1.258,1.053,1.193,1.193],[1.473,1.463,1.019,1.373,1.215,1.088],[null,null,null,null,null,null],[1.687,1.363,1.296,1.162,1.234,1.180],[1.063,0.904,0.957,0.504,0.854,0.882],[3.015,2.591,2.498,2.575,2.496,2.468],[2.104,2.363,2.329,2.257,2.016,2.457],[0.987,0.963,0.802,0.801,0.765,0.744],[2.929,2.878,2.629,2.806,2.745,2.879],[0.842,0.209,0.308,0.327,0.262,0.218],[0.748,0.252,0.201,0.231,0.238,0.200],[0.744,0.399,0.314,0.324,0.392,0.301],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.186,1.950,1.821,2.064,1.880,2.026],[2.912,2.827,2.744,2.786,2.907,2.877],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.977,0.774,0.697,0.840,0.846,0.757],[1.502,1.304,1.337,1.368,1.265,1.427],[0.061,0.036,0.036,0.035,0.035,0.036],[0.039,0.036,0.036,0.035,0.037,0.035],[1.796,1.671,1.772,1.654,1.580,1.675],[null,null,null,null,null,null],[1.079,0.547,0.382,0.386,0.413,0.346],[2.992,2.319,2.428,2.420,2.385,2.666],[1.029,0.583,0.452,0.633,0.490,0.599],[3.632,3.094,2.737,2.986,2.459,2.942],[2.506,2.664,2.712,2.489,2.642,2.069],[2.594,2.791,2.469,2.725,2.416,1.946],[3.451,3.138,3.264,2.973,3.081,2.577],[2.160,1.745,1.529,1.514,1.438,1.558],[1.528,1.021,1.138,1.077,0.980,1.000],[2.805,2.213,2.041,1.888,2.332,2.083],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.942,2.574,3.159,2.713,3.022,2.541],[0.056,0.030,0.049,0.032,0.128,0.032],[1.716,1.261,1.038,1.008,1.057,0.911],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.085,0.048,0.047,0.046,0.045,0.046],[0.045,0.045,0.047,0.047,0.069,0.046],[0.057,0.046,0.047,0.045,0.045,0.046],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.088,0.089,0.087,0.087,0.086,0.095],[0.086,0.091,0.092,0.088,0.099,0.089],[0.086,0.086,0.085,0.085,0.085,0.085],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.397,1.228,1.241,1.180,1.055,1.393],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.10.6.60","source":"results/23.10.6.60.json"} +,{"actual_version":"23.11.5.29","data_size":{"coffeeshop":44640960178,"hits":14250531486,"job":1828094510,"mgbench":2949596903,"ontime":2699155844,"ssb":73312214598,"taxi":24223213678,"tpcds":18797339583,"tpch":17236327010,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":768,"hits":239,"job":23,"mgbench":83,"ontime":61,"ssb":1509,"taxi":530,"tpcds":262,"tpch":310,"uk":41},"machine":"c7a.4xlarge","release_date":"2024-02-02","result":[[0.083,0.010,0.011,0.339,0.009,0.009],[0.049,0.017,0.015,0.021,0.016,0.017],[0.050,0.019,0.011,0.067,0.011,0.011],[0.037,0.012,0.011,0.025,0.011,0.012],[0.051,0.022,0.022,0.052,0.021,0.020],[0.071,0.021,0.018,0.037,0.016,0.017],[0.024,0.007,0.009,0.007,0.006,0.007],[0.049,0.016,0.014,0.014,0.018,0.013],[0.076,0.032,0.037,0.057,0.033,0.031],[0.100,0.059,0.053,0.055,0.060,0.062],[0.470,0.410,0.344,0.407,0.402,0.406],[0.354,0.235,0.279,0.253,0.230,0.230],[0.038,0.007,0.008,0.007,0.014,0.008],[0.040,0.013,0.014,0.019,0.020,0.013],[0.734,0.615,0.623,0.706,0.588,0.579],[0.514,0.101,0.105,0.098,0.102,0.101],[0.064,0.013,0.012,0.014,0.013,0.013],[0.039,0.011,0.011,0.010,0.013,0.010],[6.387,1.377,1.367,1.425,1.390,1.379],[4.696,1.036,1.044,1.027,1.019,1.041],[4.717,1.073,1.056,1.078,1.069,1.074],[5.285,1.800,1.813,1.798,1.801,1.764],[6.183,1.540,1.542,1.548,1.513,1.521],[3.927,0.903,0.901,0.911,0.907,0.924],[0.064,0.023,0.027,0.024,0.026,0.024],[7.817,1.963,1.989,2.011,1.964,1.982],[1.893,0.720,0.710,0.708,0.724,0.705],[1.902,0.525,0.527,0.535,0.519,0.523],[0.002,0.002,0.002,0.002,0.003,0.002],[0.031,0.008,0.008,0.007,0.009,0.007],[0.060,0.019,0.016,0.042,0.017,0.016],[0.148,0.024,0.022,0.022,0.022,0.022],[0.176,0.056,0.057,0.057,0.056,0.062],[0.336,0.143,0.136,0.147,0.137,0.141],[0.005,0.002,0.003,0.033,0.002,0.002],[0.022,0.009,0.011,0.010,0.009,0.009],[0.415,0.240,0.262,0.253,0.248,0.248],[0.478,0.283,0.282,0.299,0.287,0.282],[0.216,0.091,0.082,0.082,0.090,0.081],[0.230,0.101,0.100,0.107,0.102,0.101],[0.543,0.304,0.301,0.296,0.297,0.294],[0.712,0.423,0.401,0.402,0.411,0.412],[0.612,0.444,0.410,0.428,0.418,0.413],[0.402,0.257,0.247,0.253,0.247,0.244],[1.447,1.075,1.064,1.056,1.066,1.064],[1.007,0.711,0.712,0.707,0.703,0.714],[3.048,2.127,2.251,2.136,2.165,2.192],[0.162,0.025,0.022,0.022,0.023,0.024],[1.651,0.374,0.378,0.357,0.367,0.360],[1.786,0.408,0.424,0.417,0.419,0.423],[3.941,1.069,1.039,1.057,1.042,1.026],[2.134,0.435,0.447,0.444,0.447,0.438],[0.470,0.120,0.120,0.119,0.119,0.125],[0.290,0.099,0.099,0.094,0.094,0.095],[0.456,0.123,0.119,0.116,0.117,0.117],[1.612,0.421,0.394,0.419,0.391,0.379],[1.592,0.608,0.596,0.599,0.598,0.587],[1.036,1.010,1.017,1.112,1.008,1.012],[0.550,0.263,0.271,0.268,0.257,0.245],[0.980,0.325,0.321,0.337,0.323,0.324],[2.401,1.684,1.684,1.723,1.694,1.792],[3.000,1.758,1.715,1.678,1.694,1.712],[2.962,1.760,1.700,1.710,1.701,1.677],[0.652,0.538,0.492,0.540,0.519,0.615],[0.076,0.036,0.029,0.030,0.032,0.027],[0.043,0.033,0.027,0.027,0.019,0.022],[0.066,0.017,0.017,0.018,0.017,0.013],[0.096,0.052,0.049,0.048,0.051,0.057],[0.022,0.008,0.008,0.011,0.008,0.007],[0.021,0.008,0.007,0.009,0.008,0.006],[0.015,0.004,0.004,0.004,0.004,0.004],[0.385,0.044,0.042,0.067,0.043,0.048],[0.454,0.064,0.059,0.064,0.061,0.057],[0.121,0.038,0.036,0.057,0.035,0.036],[0.252,0.061,0.060,0.078,0.065,0.059],[0.084,0.032,0.033,0.032,0.031,0.031],[0.178,0.065,0.067,0.067,0.065,0.067],[0.234,0.088,0.089,0.091,0.087,0.086],[0.064,0.032,0.033,0.032,0.033,0.032],[0.108,0.063,0.059,0.057,0.058,0.059],[0.265,0.158,0.155,0.159,0.157,0.157],[0.488,0.179,0.178,0.177,0.180,0.173],[0.432,0.301,0.289,0.283,0.286,0.299],[0.152,0.048,0.045,0.046,0.047,0.044],[0.711,0.326,0.329,0.357,0.316,0.314],[3.014,2.551,2.494,2.457,2.491,2.484],[8.607,1.148,1.144,1.163,1.166,1.164],[2.286,1.188,1.225,1.191,1.160,1.164],[12.869,3.917,3.906,3.901,3.935,3.966],[4.287,3.689,3.683,3.693,3.705,3.669],[4.065,2.073,2.067,2.078,2.078,2.088],[5.059,4.904,4.855,4.930,4.880,4.862],[null,null,null,null,null,null],[3.881,3.600,3.599,3.628,3.591,3.620],[null,null,null,null,null,null],[6.106,5.860,5.946,5.913,5.819,5.840],[null,null,null,null,null,null],[3.809,3.536,3.526,3.541,3.538,3.570],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.763,0.734,0.730,0.537,0.492,0.487],[null,null,null,null,null,null],[17.507,16.501,16.576,16.609,16.579,15.584],[null,null,null,null,null,null],[29.037,29.204,29.610,30.073,27.668,28.592],[0.302,0.096,0.086,0.076,0.077,0.086],[22.718,20.350,21.335,18.056,24.704,19.185],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.463,7.540,7.321,8.324,6.296,6.743],[0.666,0.427,0.445,0.423,0.425,0.540],[1.451,0.538,0.476,0.542,0.464,0.525],[9.518,9.516,9.731,9.226,9.593,9.232],[0.831,0.779,0.818,0.476,0.401,0.784],[0.266,0.114,0.106,0.124,0.108,0.135],[0.509,0.351,0.335,0.272,0.333,0.356],[null,null,null,null,null,null],[32.879,30.266,30.690,32.507,32.276,29.892],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.031,0.812,0.716,0.715,0.718,0.716],[4.126,3.649,4.002,4.010,3.748,4.128],[52.724,54.297,52.810,55.582,53.599,53.899],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.725,0.455,0.455,0.503,0.460,0.480],[1.389,0.900,0.898,0.885,0.877,0.875],[1.363,0.949,0.914,0.911,0.909,0.916],[null,null,null,null,null,null],[32.183,31.521,32.334,32.791,33.269,31.907],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.103,0.777,0.826,0.722,0.747,0.729],[null,null,null,null,null,null],[14.735,11.745,13.813,13.118,13.911,13.909],[null,null,null,null,null,null],[3.339,2.770,3.002,3.072,2.707,3.074],[null,null,null,null,null,null],[0.335,0.154,0.163,0.164,0.156,0.143],[0.322,0.193,0.184,0.184,0.181,0.186],[6.437,5.198,5.176,5.221,5.293,5.346],[11.713,10.541,10.768,10.846,10.434,10.519],[6.019,5.298,5.361,4.490,4.515,5.183],[5.979,5.288,4.230,5.177,4.200,5.245],[14.537,12.342,12.970,13.585,12.533,12.594],[0.854,0.395,0.244,0.246,0.583,0.242],[null,null,null,null,null,null],[1.510,1.005,1.001,1.007,0.996,0.996],[14.239,12.993,12.725,8.222,14.098,8.135],[null,null,null,null,null,null],[2.247,1.593,1.214,1.203,1.237,1.190],[null,null,null,null,null,null],[1.056,0.370,0.371,0.370,0.371,0.372],[1.264,0.445,0.427,0.437,0.444,0.453],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.374,1.212,1.310,1.029,1.166,1.131],[4.297,4.084,4.160,4.135,4.144,4.133],[0.513,0.436,0.420,0.407,0.413,0.411],[0.516,0.415,0.415,0.421,0.431,0.415],[1.566,1.171,1.161,1.142,1.199,1.164],[null,null,null,null,null,null],[2.605,2.562,2.466,2.262,2.227,2.305],[5.909,6.040,6.458,6.312,6.352,6.245],[0.153,0.123,0.043,0.044,0.338,0.083],[0.820,0.531,0.530,0.499,0.519,0.526],[2.034,0.788,0.787,0.800,0.804,0.785],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.487,3.346,3.654,3.385,3.767,3.414],[2.684,1.941,2.245,2.337,2.206,2.242],[2.231,2.606,2.531,2.573,2.586,2.387],[2.132,1.818,1.838,1.595,1.603,1.615],[11.066,10.797,11.049,11.175,11.111,10.594],[2.584,2.499,2.246,2.495,2.233,2.625],[1.215,0.401,0.383,0.399,0.397,0.406],[null,null,null,null,null,null],[1.093,0.497,0.497,0.502,0.503,0.493],[1.694,1.293,1.305,1.293,1.288,1.308],[1.162,0.398,0.402,0.418,0.405,0.410],[2.144,1.246,1.187,1.167,1.175,1.182],[0.511,0.342,0.308,0.323,0.307,0.319],[2.123,1.819,1.785,1.754,1.805,1.975],[null,null,null,null,null,null],[28.922,25.672,25.526,25.830,25.852,25.910],[1.703,0.981,0.912,1.016,0.924,0.923],[null,null,null,null,null,null],[2.410,0.638,0.655,0.630,0.626,0.610],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.094,0.319,0.320,0.315,0.321,0.314],[null,null,null,null,null,null],[1.136,0.356,0.344,0.344,0.347,0.361],[28.264,27.894,27.983,28.105,27.789,27.831],[null,null,null,null,null,null],[0.042,0.046,0.032,0.057,0.031,0.031],[1.656,0.383,0.393,0.392,0.395,0.390],[0.046,0.063,0.042,0.075,0.045,0.067],[null,null,null,null,null,null],[4.380,2.480,3.057,2.252,2.437,2.856],[null,null,null,null,null,null],[1.912,1.650,1.754,1.900,1.787,1.589],[0.368,0.148,0.137,0.130,0.134,0.151],[1.093,1.200,1.150,1.051,1.178,0.952],[1.439,1.182,1.264,1.245,1.065,0.797],[null,null,null,null,null,null],[4.393,4.144,4.095,4.110,4.123,4.130],[2.867,2.413,2.385,2.422,2.402,2.385],[2.507,2.493,2.256,2.369,2.157,2.221],[0.353,0.126,0.131,0.115,0.131,0.121],[0.894,0.678,0.774,0.536,0.724,0.806],[null,null,null,null,null,null],[3.184,2.546,2.586,2.496,2.544,1.505],[null,null,null,null,null,null],[41.205,40.322,41.379,39.202,39.735,39.727],[0.617,0.192,0.200,0.186,0.217,0.179],[3.994,3.227,3.350,2.453,3.300,3.294],[null,null,null,null,null,null],[0.896,0.530,0.530,0.535,0.529,0.532],[0.890,0.803,0.705,0.797,0.793,0.378],[0.579,0.611,0.505,0.510,0.527,0.594],[0.224,0.240,0.245,0.239,0.144,0.243],[0.623,0.482,0.571,0.478,0.562,0.409],[1.323,1.357,1.433,1.385,1.353,1.332],[0.977,1.545,1.362,1.514,1.385,1.073],[1.462,1.522,0.943,1.177,1.179,1.415],[null,null,null,null,null,null],[1.758,1.270,1.281,1.227,1.353,0.894],[1.060,0.933,0.839,0.871,0.744,0.858],[2.848,2.474,2.513,2.616,2.339,2.502],[2.457,2.248,2.354,2.109,2.442,2.355],[0.923,0.784,0.951,0.817,0.798,0.747],[2.563,2.411,2.735,2.317,2.977,2.414],[0.807,0.300,0.317,0.270,0.289,0.214],[0.714,0.204,0.216,0.250,0.234,0.205],[0.771,0.417,0.379,0.292,0.322,0.365],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.083,1.904,2.036,1.980,1.934,1.769],[2.936,2.868,2.777,2.781,2.638,2.984],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.993,0.709,0.372,0.693,0.780,0.738],[1.549,1.337,1.412,1.331,1.404,1.354],[0.037,0.042,0.035,0.034,0.036,0.035],[0.042,0.035,0.035,0.046,0.034,0.141],[1.708,1.672,1.319,1.618,1.331,1.616],[null,null,null,null,null,null],[0.998,0.434,0.381,0.391,0.333,0.389],[3.200,2.771,2.321,2.884,1.771,2.341],[1.011,0.495,0.402,0.459,0.497,0.482],[3.208,3.112,2.215,2.867,2.225,3.299],[2.910,2.474,2.693,2.733,2.729,2.676],[2.733,2.753,2.932,2.381,2.418,2.709],[3.024,2.933,3.212,2.710,3.077,3.393],[2.103,1.566,1.126,1.550,1.631,1.289],[1.478,1.053,1.102,0.638,1.027,1.002],[2.688,2.170,2.170,2.072,2.358,2.016],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.836,2.838,2.839,3.203,3.309,2.509],[0.035,0.045,0.029,0.030,0.041,0.032],[1.268,1.149,1.126,1.032,0.824,0.586],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.045,0.066,0.045,0.045,0.064,0.046],[0.051,0.045,0.049,0.055,0.045,0.048],[0.054,0.047,0.046,0.045,0.049,0.048],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.090,0.087,0.103,0.089,0.086,0.086],[0.086,0.088,0.086,0.086,0.089,0.087],[0.090,0.087,0.088,0.087,0.088,0.086],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.321,1.281,0.976,1.229,1.332,1.105],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.11.5.29","source":"results/23.11.5.29.json"} +,{"actual_version":"23.3.22.3","data_size":{"coffeeshop":44756215004,"hits":14355275786,"job":1830189202,"mgbench":2959106271,"ontime":2704903445,"ssb":72901471884,"taxi":24216945711,"tpcds":18810898925,"tpch":17375814709,"uk":781266522},"kind":"versions-benchmark","load_time":{"coffeeshop":769,"hits":223,"job":30,"mgbench":64,"ontime":58,"ssb":1681,"taxi":513,"tpcds":268,"tpch":271,"uk":35},"machine":"c7a.4xlarge","release_date":"2024-03-26","result":[[0.062,0.009,0.009,0.008,0.008,0.008],[0.053,0.022,0.020,0.025,0.025,0.020],[0.045,0.219,0.010,0.009,0.010,0.009],[0.040,0.011,0.011,0.012,0.013,0.013],[0.052,0.027,0.028,0.028,0.026,0.026],[0.067,0.015,0.016,0.015,0.016,0.016],[0.027,0.006,0.006,0.006,0.006,0.007],[0.058,0.029,0.030,0.029,0.028,0.029],[0.066,0.034,0.042,0.035,0.034,0.034],[0.079,0.053,0.051,0.052,0.051,0.055],[0.470,0.422,0.410,0.407,0.406,0.350],[0.312,0.231,0.219,0.215,0.222,0.219],[0.030,0.012,0.008,0.013,0.013,0.013],[0.054,0.022,0.017,0.015,0.014,0.014],[0.879,0.756,0.725,0.682,0.730,0.730],[0.390,0.076,0.070,0.074,0.088,0.076],[0.033,0.013,0.013,0.012,0.012,0.013],[0.038,0.012,0.012,0.012,0.012,0.013],[6.386,1.486,1.509,1.495,1.465,1.538],[4.697,1.200,1.202,1.192,1.189,1.202],[4.702,1.285,1.288,1.267,1.297,1.278],[5.359,2.063,1.903,1.898,1.846,1.992],[6.205,1.729,1.724,1.746,1.742,1.747],[3.964,1.103,1.099,1.110,1.109,1.079],[0.063,0.029,0.028,0.030,0.032,0.028],[7.656,2.404,2.400,2.378,2.396,2.391],[2.272,1.155,1.146,1.130,1.147,1.142],[1.861,0.616,0.601,0.617,0.608,0.620],[0.003,0.002,0.002,0.002,0.002,0.002],[0.025,0.009,0.009,0.008,0.008,0.009],[0.055,0.018,0.019,0.017,0.020,0.018],[0.105,0.025,0.025,0.023,0.025,0.023],[0.133,0.062,0.064,0.065,0.060,0.062],[0.259,0.151,0.150,0.150,0.146,0.149],[0.005,0.002,0.002,0.002,0.002,0.003],[0.020,0.011,0.009,0.010,0.010,0.011],[0.343,0.256,0.253,0.257,0.259,0.267],[0.406,0.302,0.301,0.319,0.299,0.275],[0.174,0.097,0.107,0.097,0.099,0.101],[0.188,0.118,0.123,0.116,0.122,0.125],[0.492,0.328,0.337,0.334,0.347,0.324],[0.586,0.453,0.469,0.446,0.458,0.455],[0.563,0.488,0.453,0.470,0.466,0.483],[0.384,0.295,0.291,0.302,0.295,0.289],[1.311,1.141,1.126,1.138,1.132,1.053],[0.845,0.728,0.718,0.710,0.733,0.733],[2.869,2.336,2.336,2.365,2.388,2.448],[0.110,0.026,0.023,0.027,0.023,0.026],[1.395,0.401,0.393,0.417,0.392,0.348],[1.723,0.435,0.447,0.434,0.444,0.480],[4.013,1.205,1.211,1.209,1.202,1.185],[3.002,0.495,0.525,0.482,0.501,0.479],[0.296,0.123,0.124,0.122,0.124,0.124],[0.208,0.104,0.101,0.104,0.102,0.101],[0.288,0.126,0.126,0.125,0.126,0.122],[1.402,0.416,0.424,0.433,0.445,0.436],[1.044,0.655,0.664,0.653,0.657,0.649],[1.040,1.023,0.981,0.941,0.989,0.989],[0.455,0.295,0.292,0.291,0.310,0.302],[0.699,0.396,0.395,0.398,0.394,0.395],[2.783,2.384,2.523,2.272,2.285,2.330],[2.180,1.899,1.870,1.902,1.863,1.822],[2.159,1.861,1.868,1.873,1.886,1.858],[0.630,0.537,0.593,0.563,0.578,0.621],[0.090,0.059,0.050,0.058,0.050,0.054],[0.049,0.030,0.025,0.023,0.024,0.023],[0.075,0.020,0.026,0.030,0.023,0.023],[0.149,0.123,0.110,0.100,0.117,0.125],[0.042,0.010,0.012,0.013,0.007,0.009],[0.030,0.011,0.007,0.007,0.008,0.009],[0.016,0.004,0.004,0.005,0.005,0.007],[0.329,0.047,0.042,0.049,0.042,0.041],[0.389,0.066,0.061,0.060,0.066,0.060],[0.103,0.037,0.034,0.034,0.035,0.035],[0.220,0.069,0.062,0.068,0.067,0.066],[0.073,0.033,0.034,0.031,0.031,0.030],[0.145,0.054,0.056,0.054,0.055,0.055],[0.201,0.078,0.077,0.077,0.079,0.075],[0.055,0.032,0.031,0.031,0.030,0.032],[0.093,0.055,0.056,0.138,0.056,0.055],[0.238,0.146,0.148,0.146,0.146,0.147],[0.431,0.186,0.187,0.184,0.175,0.178],[0.459,0.309,0.305,0.325,0.311,0.316],[0.134,0.044,0.042,0.043,0.044,0.042],[0.638,0.294,0.296,0.297,0.303,0.298],[2.882,2.415,2.392,2.397,2.432,2.423],[8.634,1.147,1.126,1.124,1.154,1.131],[1.777,1.140,1.127,1.147,1.126,1.128],[12.805,3.863,3.860,3.773,3.774,3.794],[4.279,3.324,3.360,3.420,3.374,3.351],[4.080,1.876,1.845,1.851,1.890,1.922],[5.026,4.865,4.782,4.957,4.879,4.577],[null,null,null,null,null,null],[3.547,3.345,3.316,3.276,3.332,3.257],[null,null,null,null,null,null],[5.349,5.132,5.164,5.199,5.580,5.625],[null,null,null,null,null,null],[3.762,3.502,3.539,3.539,3.507,3.449],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.728,0.725,0.733,0.751,0.735,0.731],[null,null,null,null,null,null],[17.291,17.359,17.438,17.273,17.376,17.326],[null,null,null,null,null,null],[28.969,28.962,28.890,28.962,28.807,28.881],[0.205,0.064,0.065,0.062,0.061,0.065],[39.435,38.659,38.186,41.687,38.891,39.138],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.634,8.486,8.567,8.525,8.461,8.385],[0.522,0.430,0.438,0.423,0.421,0.406],[1.003,0.490,0.491,0.495,0.490,0.483],[8.917,8.796,8.833,9.094,8.949,9.498],[0.830,0.811,0.819,0.864,0.759,0.815],[0.269,0.163,0.141,0.129,0.137,0.130],[0.424,0.348,0.331,0.328,0.349,0.352],[null,null,null,null,null,null],[33.193,33.802,32.334,32.718,33.014,32.407],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.887,0.827,0.823,0.836,0.746,0.813],[4.334,4.276,4.202,4.076,4.201,4.198],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.168,0.527,0.507,0.510,0.476,0.470],[1.080,0.979,0.980,1.035,0.998,1.023],[1.219,1.027,1.031,1.004,1.007,0.961],[null,null,null,null,null,null],[60.436,60.384,66.846,65.716,61.397,60.629],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.848,0.760,0.815,0.790,0.766,0.742],[null,null,null,null,null,null],[11.917,11.634,11.744,11.766,11.661,11.627],[null,null,null,null,null,null],[3.323,3.141,3.109,3.251,3.312,3.159],[null,null,null,null,null,null],[0.216,0.158,0.154,0.187,0.150,0.152],[0.305,0.229,0.229,0.227,0.226,0.217],[5.909,5.647,5.689,5.700,5.735,6.278],[11.968,11.603,11.463,11.407,11.347,11.286],[5.294,5.018,5.088,5.250,5.132,4.919],[4.967,4.879,4.863,4.980,4.965,4.843],[11.856,11.562,11.629,11.432,11.559,11.474],[0.462,0.236,0.237,0.251,0.263,0.268],[null,null,null,null,null,null],[1.054,0.983,0.963,0.975,0.968,0.969],[11.530,11.447,11.520,11.272,11.577,12.276],[null,null,null,null,null,null],[1.470,1.385,1.336,1.358,1.308,1.339],[null,null,null,null,null,null],[0.905,0.412,0.420,0.397,0.413,0.419],[0.764,0.507,0.517,0.495,0.507,0.455],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.369,1.307,1.310,1.241,1.307,1.287],[4.819,4.635,4.659,4.675,4.639,4.513],[0.475,0.444,0.444,0.449,0.447,0.438],[0.486,0.440,0.448,0.437,0.449,0.416],[1.245,1.187,1.229,1.267,1.212,1.217],[null,null,null,null,null,null],[2.563,2.562,2.547,2.617,2.512,2.536],[6.966,7.015,6.963,7.045,7.202,7.070],[0.128,0.046,0.039,0.045,0.038,0.043],[0.649,0.554,0.516,0.541,0.511,0.524],[1.779,0.843,0.821,0.864,0.818,0.760],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.807,3.821,3.776,3.955,3.815,3.637],[3.532,3.394,3.351,3.450,3.394,3.493],[2.461,2.478,2.430,2.437,2.540,2.422],[2.354,2.234,2.292,2.254,2.302,2.223],[10.488,10.353,10.347,10.414,10.361,10.392],[2.494,2.433,2.437,2.544,2.447,2.401],[0.913,0.402,0.396,0.413,0.406,0.405],[null,null,null,null,null,null],[0.695,0.520,0.545,0.591,0.521,0.524],[1.715,1.642,1.675,1.646,1.667,1.654],[0.909,0.419,0.417,0.412,0.433,0.421],[1.395,1.307,1.244,1.247,1.234,1.222],[0.410,0.331,0.330,0.329,0.342,0.325],[2.344,2.268,2.279,2.224,2.220,2.289],[null,null,null,null,null,null],[25.202,28.499,28.783,26.315,25.078,25.207],[1.275,0.946,0.930,0.931,0.930,0.920],[null,null,null,null,null,null],[2.410,0.663,0.698,0.714,0.672,0.646],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.818,0.323,0.321,0.323,0.321,0.324],[null,null,null,null,null,null],[0.745,0.374,0.386,0.373,0.372,0.354],[43.768,44.211,43.535,44.298,43.468,43.414],[null,null,null,null,null,null],[0.047,0.042,0.037,0.035,0.033,0.033],[1.650,0.410,0.410,0.417,0.406,0.403],[0.061,0.051,0.045,0.059,0.049,0.049],[null,null,null,null,null,null],[4.392,3.747,3.732,3.676,3.729,3.736],[null,null,null,null,null,null],[1.900,1.907,1.903,1.843,1.886,1.873],[0.237,0.149,0.146,0.188,0.141,0.137],[1.127,1.048,1.061,1.099,1.086,1.043],[1.379,1.261,1.218,1.377,1.242,1.242],[null,null,null,null,null,null],[4.401,4.281,4.274,4.268,4.264,4.231],[2.572,2.483,2.487,2.504,2.466,2.464],[2.820,2.733,2.764,2.740,2.830,2.762],[0.271,0.122,0.122,0.118,0.123,0.131],[1.038,0.846,0.862,0.871,0.862,0.818],[null,null,null,null,null,null],[2.358,2.307,2.294,2.339,2.298,2.408],[null,null,null,null,null,null],[41.952,41.805,42.013,41.976,41.925,43.085],[0.278,0.186,0.183,0.191,0.191,0.188],[3.604,3.452,4.980,3.440,3.424,3.471],[null,null,null,null,null,null],[0.630,0.562,0.556,0.559,0.556,0.552],[0.965,0.918,0.874,0.922,0.856,0.894],[1.025,1.091,0.985,1.008,0.989,1.028],[0.862,0.853,0.861,0.894,1.004,0.888],[1.059,0.985,0.943,1.015,0.988,1.019],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.064,5.940,5.953,6.646,6.095,6.349],[4.558,4.349,4.648,4.596,4.317,4.461],[6.728,6.677,6.614,6.817,6.195,6.476],[13.725,13.108,13.449,13.395,13.384,13.568],[null,13.791,13.816,null,null,null],[14.324,14.221,13.853,14.039,13.853,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[42.449,46.858,44.886,43.460,44.642,46.770],[47.292,44.852,44.483,45.393,45.190,45.108],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[6.729,6.510,6.220,6.353,6.327,7.014],[7.379,7.289,6.963,7.197,7.330,7.450],[0.045,0.042,0.323,0.041,0.039,0.044],[0.267,0.040,0.042,0.040,0.041,0.041],[5.331,4.949,5.549,4.833,5.565,4.721],[null,null,null,null,null,null],[7.076,6.724,7.005,7.202,6.757,6.824],[7.641,7.453,7.625,7.578,7.746,7.241],[7.302,7.205,7.406,7.080,7.176,6.918],[5.973,6.000,5.931,6.033,5.929,6.315],[7.409,7.408,7.138,7.257,7.284,7.188],[7.642,7.856,7.417,7.318,7.530,7.273],[7.414,7.160,7.125,7.533,7.125,7.056],[4.674,4.487,4.303,4.250,4.184,4.332],[3.868,3.737,3.751,3.790,3.744,3.956],[5.737,5.587,5.475,5.241,5.442,5.263],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[13.478,13.157,12.949,13.117,13.250,13.238],[0.047,0.036,0.036,0.162,0.100,0.033],[13.210,12.733,12.289,12.654,12.398,12.916],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.244,0.053,0.056,0.052,0.056,0.133],[0.054,0.055,0.054,0.222,0.050,0.065],[0.204,0.134,0.051,0.052,0.050,0.055],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.106,0.121,0.112,0.159,0.236,0.108],[0.117,0.131,0.106,0.137,0.186,0.225],[0.294,0.205,0.108,0.103,0.342,0.213],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.959,3.060,3.028,2.876,2.824,2.977],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.3.22.3","source":"results/23.3.22.3.json"} +,{"actual_version":"23.12.6.19","data_size":{"coffeeshop":44639452437,"hits":14314342847,"job":1828094510,"mgbench":2962008627,"ontime":2699155844,"ssb":73313245981,"taxi":24223487809,"tpcds":18798412279,"tpch":17237727086,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":809,"hits":240,"job":27,"mgbench":65,"ontime":67,"ssb":1566,"taxi":606,"tpcds":276,"tpch":274,"uk":39},"machine":"c7a.4xlarge","release_date":"2024-03-26","result":[[0.076,0.010,0.010,0.330,0.010,0.009],[0.051,0.016,0.017,0.018,0.016,0.015],[0.049,0.021,0.011,0.070,0.011,0.013],[0.044,0.011,0.010,0.026,0.011,0.011],[0.048,0.030,0.022,0.051,0.020,0.020],[0.068,0.017,0.018,0.039,0.021,0.018],[0.023,0.010,0.006,0.007,0.007,0.006],[0.047,0.013,0.013,0.014,0.014,0.018],[0.078,0.034,0.035,0.056,0.034,0.030],[0.090,0.057,0.059,0.057,0.054,0.057],[0.453,0.408,0.404,0.386,0.395,0.339],[0.370,0.231,0.272,0.258,0.228,0.222],[0.032,0.008,0.010,0.007,0.010,0.007],[0.033,0.014,0.015,0.020,0.013,0.012],[0.699,0.597,0.595,0.707,0.578,0.569],[0.498,0.102,0.111,0.102,0.104,0.103],[0.062,0.013,0.015,0.012,0.012,0.013],[0.040,0.010,0.012,0.011,0.016,0.011],[6.397,1.266,1.308,1.306,1.264,1.241],[4.695,0.952,0.953,0.950,0.947,0.952],[4.711,0.976,0.983,0.965,0.980,0.986],[5.292,1.604,1.603,1.600,1.618,1.606],[6.197,1.393,1.384,1.381,1.369,1.383],[3.928,0.833,0.836,0.826,0.840,0.834],[0.065,0.022,0.020,0.023,0.021,0.025],[7.815,1.782,1.785,1.833,1.777,1.794],[1.823,0.668,0.649,0.654,0.651,0.654],[1.905,0.493,0.494,0.481,0.493,0.477],[0.002,0.003,0.002,0.002,0.002,0.002],[0.024,0.008,0.009,0.009,0.009,0.008],[0.049,0.016,0.017,0.040,0.016,0.016],[0.125,0.025,0.022,0.024,0.023,0.022],[0.152,0.054,0.056,0.056,0.055,0.055],[0.283,0.133,0.122,0.124,0.120,0.124],[0.004,0.002,0.002,0.031,0.002,0.002],[0.022,0.010,0.009,0.008,0.009,0.010],[0.362,0.238,0.237,0.237,0.244,0.244],[0.402,0.272,0.274,0.281,0.269,0.272],[0.184,0.077,0.079,0.081,0.096,0.082],[0.191,0.097,0.102,0.097,0.100,0.096],[0.470,0.276,0.279,0.281,0.276,0.279],[0.606,0.394,0.381,0.387,0.399,0.402],[0.567,0.426,0.410,0.415,0.437,0.424],[0.377,0.256,0.265,0.246,0.257,0.249],[1.290,1.010,1.047,1.095,1.102,1.078],[0.938,0.666,0.656,0.680,0.663,0.662],[2.797,2.026,2.033,2.097,2.194,2.217],[0.148,0.028,0.025,0.023,0.033,0.023],[1.489,0.351,0.366,0.352,0.388,0.374],[1.797,0.389,0.428,0.439,0.421,0.426],[4.002,0.985,1.017,1.011,0.996,1.011],[2.179,0.483,0.465,0.472,0.469,0.460],[0.380,0.107,0.107,0.116,0.115,0.116],[0.245,0.088,0.087,0.087,0.089,0.086],[0.389,0.113,0.109,0.108,0.117,0.112],[1.464,0.430,0.420,0.435,0.400,0.431],[1.458,0.641,0.644,0.640,0.636,0.640],[0.953,0.932,0.936,1.037,0.933,0.929],[0.506,0.254,0.269,0.281,0.246,0.263],[0.892,0.331,0.335,0.335,0.334,0.340],[2.264,1.683,1.582,1.668,1.735,1.834],[2.765,1.740,1.709,1.667,1.699,1.748],[2.963,1.880,1.834,1.819,1.821,1.702],[0.633,0.575,0.557,0.543,0.558,0.625],[0.094,0.041,0.045,0.040,0.043,0.051],[0.036,0.036,0.024,0.026,0.022,0.022],[0.069,0.020,0.021,0.021,0.020,0.022],[0.164,0.096,0.091,0.094,0.088,0.078],[0.027,0.008,0.010,0.012,0.012,0.007],[0.023,0.006,0.009,0.006,0.006,0.006],[0.016,0.005,0.008,0.005,0.005,0.005],[0.364,0.044,0.045,0.063,0.046,0.041],[0.431,0.064,0.058,0.058,0.061,0.059],[0.112,0.043,0.036,0.061,0.034,0.035],[0.228,0.065,0.065,0.085,0.076,0.064],[0.076,0.037,0.030,0.032,0.033,0.031],[0.172,0.064,0.065,0.064,0.069,0.067],[0.233,0.093,0.087,0.100,0.087,0.085],[0.064,0.035,0.029,0.034,0.031,0.030],[0.102,0.055,0.063,0.055,0.055,0.055],[0.263,0.147,0.155,0.151,0.155,0.156],[0.481,0.185,0.179,0.181,0.184,0.179],[0.399,0.281,0.274,0.286,0.291,0.277],[0.143,0.046,0.042,0.040,0.038,0.040],[0.670,0.324,0.320,0.336,0.316,0.285],[2.768,2.272,2.218,2.299,2.285,2.204],[8.648,1.138,1.188,1.186,1.125,1.090],[2.273,1.147,1.138,1.160,1.166,1.149],[12.858,2.730,2.738,2.735,2.746,2.726],[4.288,3.345,3.333,3.368,3.339,3.336],[4.057,1.904,1.903,1.893,1.898,1.920],[4.611,4.430,4.412,4.410,4.405,4.402],[null,null,null,null,null,null],[3.629,3.315,3.325,3.336,3.309,3.336],[null,null,null,null,null,null],[5.771,5.499,5.483,5.505,5.507,5.483],[null,null,null,null,null,null],[3.547,3.256,3.270,3.266,3.251,3.255],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.727,0.714,0.718,0.523,0.468,0.465],[null,null,null,null,null,null],[17.311,16.446,16.791,16.948,16.825,16.871],[null,null,null,null,null,null],[28.720,30.723,31.580,30.288,30.078,29.280],[0.238,0.070,0.071,0.072,0.070,0.071],[21.844,20.289,21.168,22.488,21.646,19.960],[null,null,null,null,null,null],[null,null,null,null,null,null],[7.887,8.060,7.950,8.448,7.906,8.293],[0.598,0.406,0.485,0.385,0.390,0.473],[1.124,0.525,0.523,0.488,0.512,0.449],[9.249,8.976,9.286,8.982,8.916,9.054],[0.763,0.532,0.788,0.759,0.793,0.499],[0.288,0.156,0.119,0.124,0.104,0.106],[0.560,0.322,0.327,0.267,0.345,0.265],[null,null,null,null,null,null],[31.154,29.450,29.697,31.465,30.249,31.584],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.045,1.038,0.691,0.701,0.668,0.672],[3.491,3.497,3.274,3.189,3.282,3.527],[49.037,48.516,48.637,49.072,50.512,48.301],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.416,0.449,0.432,0.466,0.450,0.439],[1.267,0.795,0.806,0.817,0.802,0.801],[1.435,1.008,0.996,1.005,0.977,0.974],[null,null,null,null,null,null],[30.608,30.892,29.998,30.160,30.385,30.537],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.038,0.701,0.757,0.752,0.738,0.700],[null,null,null,null,null,null],[13.541,13.138,13.161,12.527,12.631,13.868],[null,null,null,null,null,null],[3.211,2.925,2.859,2.679,2.767,2.688],[null,null,null,null,null,null],[0.362,0.145,0.144,0.158,0.147,0.146],[0.298,0.167,0.171,0.163,0.156,0.172],[6.217,5.079,5.061,5.088,5.043,5.008],[11.315,10.247,10.072,10.444,10.255,10.116],[5.610,4.904,4.971,4.333,4.340,3.907],[4.925,4.237,5.078,5.010,4.480,5.060],[13.413,11.947,11.588,13.210,11.548,12.177],[0.858,0.341,0.238,0.239,0.442,0.239],[null,null,null,null,null,null],[1.540,0.985,0.983,0.979,0.974,0.971],[12.451,11.360,12.201,12.881,12.465,11.618],[null,null,null,null,null,null],[2.376,1.236,1.160,1.176,1.228,1.182],[null,null,null,null,null,null],[1.146,0.381,0.386,0.383,0.381,0.383],[1.236,0.452,0.433,0.448,0.455,0.447],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.366,1.117,1.149,1.210,1.166,1.151],[4.385,4.208,4.193,4.268,4.274,4.265],[0.512,0.412,0.388,0.388,0.394,0.403],[0.508,0.398,0.398,0.400,0.408,0.403],[1.572,1.149,0.765,1.144,0.883,1.136],[null,null,null,null,null,null],[2.436,2.118,2.291,2.513,2.107,2.209],[4.800,4.982,5.059,4.985,4.751,4.914],[0.130,0.044,0.036,0.104,0.047,0.039],[0.699,0.456,0.457,0.482,0.442,0.457],[1.967,0.785,0.777,0.754,0.787,0.771],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.529,2.279,3.836,3.614,3.798,3.624],[2.824,2.167,2.284,2.250,2.255,2.252],[2.364,2.323,2.271,2.224,2.264,2.129],[1.749,1.599,1.797,1.666,1.616,1.828],[11.147,10.960,10.859,10.789,10.810,10.957],[2.335,2.434,2.266,2.128,2.405,2.095],[1.219,0.422,0.413,0.413,0.421,0.426],[null,null,null,null,null,null],[1.095,0.520,0.506,0.527,0.494,0.501],[1.619,1.263,1.259,1.248,1.245,1.252],[1.196,0.437,0.426,0.442,0.428,0.425],[2.154,1.294,1.255,1.225,1.229,1.242],[0.526,0.326,0.336,0.322,0.339,0.340],[1.957,1.848,1.767,1.564,1.743,1.757],[null,null,null,null,null,null],[28.330,26.992,30.036,24.804,27.079,25.153],[1.761,1.011,0.927,1.043,0.939,0.932],[null,null,null,null,null,null],[2.418,0.689,0.682,0.689,0.667,0.664],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.110,0.340,0.339,0.336,0.339,0.334],[null,null,null,null,null,null],[1.129,0.363,0.360,0.353,0.374,0.373],[27.131,27.259,26.954,26.841,26.743,27.631],[null,null,null,null,null,null],[0.053,0.031,0.030,0.051,0.047,0.031],[1.635,0.417,0.448,0.416,0.421,0.411],[0.047,0.070,0.042,0.067,0.047,0.043],[null,null,null,null,null,null],[4.465,3.033,3.048,2.758,2.621,2.896],[null,null,null,null,null,null],[1.991,1.645,1.781,1.547,1.735,1.733],[0.299,0.150,0.129,0.148,0.159,0.138],[1.209,1.053,1.190,1.143,1.107,1.031],[1.617,1.214,1.263,1.310,1.244,0.978],[null,null,null,null,null,null],[4.485,4.359,4.320,4.282,4.319,4.300],[3.021,2.597,2.581,2.561,2.585,2.553],[2.314,2.137,2.151,2.156,2.169,2.236],[0.277,0.127,0.125,0.120,0.145,0.123],[0.625,0.483,0.560,0.557,0.531,0.561],[null,null,null,null,null,null],[3.277,2.645,2.581,2.194,1.529,2.190],[null,null,null,null,null,null],[42.172,40.619,40.710,40.601,40.726,40.854],[0.638,0.210,0.207,0.193,0.191,0.239],[3.985,3.347,3.074,3.402,3.442,3.445],[null,null,null,null,null,null],[0.922,0.619,0.567,0.564,0.559,0.555],[0.904,0.811,0.438,0.818,0.736,0.733],[0.479,0.492,0.569,0.527,0.481,0.395],[0.208,0.226,0.221,0.164,0.255,0.243],[0.690,0.525,0.556,0.533,0.462,0.468],[1.435,1.483,1.446,1.018,0.973,1.375],[1.138,1.379,1.463,1.139,1.106,1.146],[1.500,1.054,1.517,1.119,1.045,1.323],[null,null,null,null,null,null],[1.737,1.287,0.971,1.250,1.214,1.316],[1.351,0.824,0.832,0.477,0.470,0.962],[3.011,2.679,2.576,2.598,2.263,3.130],[2.001,1.549,1.500,1.938,1.996,1.612],[0.618,0.411,0.798,0.765,0.761,0.744],[2.368,2.281,2.285,2.261,2.288,2.233],[0.757,0.301,0.201,0.289,0.190,0.233],[0.662,0.254,0.227,0.204,0.214,0.203],[0.853,0.311,0.397,0.381,0.381,0.334],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.141,1.826,1.690,2.054,1.990,1.868],[2.969,2.780,2.787,2.698,2.853,2.720],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.999,0.670,0.882,0.757,0.785,0.868],[1.483,1.429,1.383,0.870,1.340,1.286],[0.050,0.035,0.034,0.035,0.034,0.036],[0.037,0.036,0.035,0.035,0.051,0.035],[1.727,1.216,1.246,1.517,1.688,1.465],[null,null,null,null,null,null],[0.843,0.399,0.352,0.458,0.371,0.371],[3.150,1.804,2.718,2.656,2.364,2.692],[0.951,0.453,0.527,0.574,0.528,0.575],[3.555,2.770,2.545,3.246,3.161,3.040],[2.527,2.549,2.892,2.678,2.335,2.814],[1.819,2.239,2.690,2.490,2.706,1.697],[2.925,3.229,2.797,3.246,2.921,3.196],[2.166,1.547,1.496,1.658,1.436,1.501],[1.170,1.055,0.974,1.088,1.013,1.016],[2.599,1.994,2.074,2.132,1.981,1.873],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.626,2.900,3.125,2.723,2.472,3.236],[0.076,0.030,0.041,0.031,0.030,0.030],[1.611,1.113,0.736,1.054,1.002,1.105],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.051,0.058,0.047,0.063,0.048,0.046],[0.046,0.046,0.045,0.046,0.060,0.060],[0.046,0.049,0.045,0.047,0.050,0.046],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.086,0.088,0.088,0.087,0.088,0.087],[0.086,0.085,0.087,0.091,0.099,0.088],[0.086,0.087,0.086,0.087,0.086,0.089],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.395,1.320,0.960,1.196,1.293,0.872],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.12.6.19","source":"results/23.12.6.19.json"} +,{"actual_version":"24.1.8.22","data_size":{"coffeeshop":44646241584,"hits":14337624243,"job":1828094510,"mgbench":2956669727,"ontime":2699155844,"ssb":73312393609,"taxi":24223736452,"tpcds":18780109045,"tpch":17235281386,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":742,"hits":198,"job":25,"mgbench":73,"ontime":58,"ssb":1416,"taxi":539,"tpcds":223,"tpch":254,"uk":38},"machine":"c7a.4xlarge","release_date":"2024-03-26","result":[[0.090,0.009,0.009,0.356,0.009,0.010],[0.049,0.016,0.017,0.021,0.018,0.019],[0.054,0.020,0.011,0.065,0.010,0.010],[0.045,0.011,0.011,0.026,0.010,0.011],[0.052,0.021,0.021,0.049,0.021,0.020],[0.081,0.021,0.016,0.041,0.016,0.015],[0.026,0.007,0.006,0.007,0.007,0.006],[0.051,0.014,0.014,0.013,0.014,0.012],[0.081,0.033,0.032,0.061,0.029,0.036],[0.096,0.051,0.054,0.049,0.050,0.047],[0.461,0.378,0.326,0.317,0.368,0.373],[0.377,0.211,0.263,0.229,0.206,0.210],[0.032,0.008,0.008,0.008,0.009,0.008],[0.034,0.018,0.013,0.013,0.013,0.012],[0.674,0.544,0.519,0.665,0.494,0.498],[0.700,0.113,0.105,0.104,0.103,0.105],[0.050,0.014,0.014,0.014,0.013,0.019],[0.050,0.011,0.011,0.012,0.012,0.012],[6.467,1.155,1.146,1.169,1.149,1.142],[4.726,0.865,0.859,0.876,0.870,0.864],[4.760,0.889,0.916,0.892,0.920,0.899],[5.338,1.485,1.478,1.496,1.493,1.487],[6.242,1.252,1.269,1.252,1.242,1.261],[3.957,0.770,0.757,0.757,0.764,0.770],[0.068,0.021,0.021,0.023,0.021,0.029],[7.880,1.652,1.646,1.660,1.665,1.650],[2.274,0.606,0.603,0.605,0.618,0.601],[2.173,0.455,0.447,0.447,0.441,0.441],[0.002,0.002,0.002,0.002,0.002,0.002],[0.034,0.009,0.008,0.008,0.008,0.007],[0.054,0.016,0.018,0.043,0.015,0.016],[0.160,0.021,0.020,0.022,0.021,0.020],[0.180,0.060,0.060,0.065,0.067,0.053],[0.314,0.118,0.116,0.117,0.129,0.116],[0.006,0.002,0.002,0.036,0.002,0.002],[0.026,0.009,0.010,0.009,0.010,0.009],[0.372,0.227,0.223,0.223,0.227,0.224],[0.417,0.259,0.260,0.262,0.259,0.257],[0.202,0.075,0.079,0.076,0.076,0.075],[0.220,0.092,0.091,0.099,0.092,0.091],[0.475,0.264,0.262,0.271,0.268,0.268],[0.669,0.382,0.376,0.373,0.376,0.371],[0.606,0.408,0.393,0.390,0.407,0.379],[0.396,0.241,0.220,0.225,0.223,0.221],[1.302,0.955,0.956,0.969,0.959,0.970],[0.920,0.666,0.631,0.639,0.636,0.639],[2.734,1.939,1.961,1.987,1.946,1.981],[0.156,0.032,0.023,0.028,0.020,0.025],[1.905,0.323,0.321,0.347,0.315,0.315],[2.126,0.337,0.351,0.357,0.344,0.357],[4.044,0.924,0.888,0.930,0.912,0.899],[2.619,0.424,0.412,0.409,0.400,0.405],[0.516,0.097,0.097,0.096,0.096,0.094],[0.301,0.073,0.072,0.072,0.071,0.071],[0.519,0.102,0.100,0.098,0.097,0.092],[1.928,0.361,0.357,0.371,0.352,0.351],[1.714,0.541,0.546,0.542,0.550,0.537],[0.063,0.020,0.022,0.041,0.019,0.020],[0.559,0.220,0.219,0.230,0.206,0.204],[1.060,0.302,0.274,0.278,0.276,0.273],[2.249,1.502,1.512,1.580,1.603,1.537],[3.172,1.627,1.589,1.597,1.613,1.604],[3.098,1.614,1.595,1.596,1.584,1.596],[0.655,0.505,0.513,0.499,0.518,0.481],[0.109,0.039,0.034,0.046,0.048,0.041],[0.051,0.027,0.027,0.028,0.022,0.029],[0.066,0.020,0.019,0.019,0.018,0.019],[0.152,0.080,0.076,0.070,0.071,0.067],[0.025,0.007,0.009,0.009,0.007,0.007],[0.027,0.007,0.009,0.007,0.007,0.010],[0.016,0.005,0.006,0.006,0.005,0.006],[0.414,0.042,0.042,0.058,0.039,0.044],[0.482,0.058,0.052,0.061,0.054,0.053],[0.119,0.035,0.039,0.055,0.033,0.031],[0.257,0.061,0.060,0.083,0.061,0.067],[0.083,0.030,0.030,0.029,0.030,0.029],[0.198,0.065,0.060,0.066,0.060,0.060],[0.264,0.083,0.082,0.081,0.080,0.081],[0.066,0.031,0.031,0.032,0.030,0.030],[0.112,0.055,0.058,0.054,0.054,0.054],[0.273,0.136,0.138,0.135,0.137,0.135],[0.577,0.171,0.160,0.161,0.157,0.158],[0.405,0.260,0.247,0.251,0.248,0.257],[0.153,0.042,0.042,0.041,0.037,0.038],[0.707,0.289,0.282,0.314,0.273,0.270],[2.598,1.995,1.970,1.969,1.969,1.986],[8.692,1.013,1.013,1.028,0.993,1.039],[2.692,1.074,1.071,1.078,1.066,1.073],[12.897,2.559,2.544,2.537,2.539,2.536],[4.307,3.157,3.137,3.215,3.142,3.138],[4.071,1.793,1.785,1.785,1.783,1.790],[4.387,4.121,4.102,4.118,4.108,4.110],[null,null,null,null,null,null],[3.643,3.119,3.106,3.137,3.111,3.107],[null,null,null,null,null,null],[5.567,5.056,5.070,5.077,5.052,5.072],[null,null,null,null,null,null],[3.529,3.043,3.047,3.040,3.053,3.036],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.643,0.674,0.680,0.505,0.435,0.439],[null,null,null,null,null,null],[17.309,16.012,16.690,16.758,16.744,16.020],[null,null,null,null,null,null],[28.192,28.390,28.385,27.958,29.047,27.687],[0.303,0.059,0.064,0.063,0.061,0.060],[20.833,20.248,19.334,20.019,19.084,19.883],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.030,7.705,7.583,7.664,7.414,8.032],[0.638,0.379,0.365,0.409,0.388,0.389],[1.248,0.516,0.501,0.520,0.507,0.508],[8.842,8.488,8.556,8.915,9.058,8.968],[0.802,0.730,0.730,0.682,0.704,0.787],[0.289,0.100,0.099,0.118,0.097,0.099],[0.522,0.332,0.275,0.341,0.254,0.334],[null,null,null,null,null,null],[31.809,31.959,31.234,30.471,31.057,30.192],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.076,1.030,0.631,0.632,0.629,0.619],[3.464,3.431,3.488,3.447,3.626,3.580],[47.798,48.381,49.019,48.416,49.432,48.007],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.662,0.417,0.407,0.459,0.415,0.421],[1.282,0.761,0.758,0.752,0.755,0.779],[1.514,0.956,0.964,0.958,0.965,0.971],[null,null,null,null,null,null],[29.957,30.250,30.076,30.384,30.260,30.311],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.028,0.726,0.750,0.707,0.686,0.701],[null,null,null,null,null,null],[13.244,11.760,12.277,12.459,12.162,11.187],[null,null,null,null,null,null],[3.358,2.936,2.896,2.614,2.955,3.045],[null,null,null,null,null,null],[0.323,0.139,0.137,0.156,0.134,0.135],[0.343,0.165,0.169,0.156,0.163,0.162],[6.647,5.415,5.368,5.396,5.262,5.329],[11.721,10.546,10.507,10.477,10.245,10.539],[5.848,3.796,5.278,5.146,4.898,4.821],[5.655,3.807,5.267,4.809,4.456,4.481],[13.094,12.064,12.234,12.260,11.484,12.114],[0.791,0.578,0.227,0.240,0.231,0.226],[null,null,null,null,null,null],[1.689,0.930,0.908,0.914,0.914,0.929],[13.709,12.324,13.237,11.285,12.398,13.170],[null,null,null,null,null,null],[2.307,1.157,1.164,1.186,1.169,1.142],[null,null,null,null,null,null],[1.376,0.357,0.377,0.362,0.367,0.359],[1.479,0.429,0.425,0.425,0.423,0.424],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.402,1.330,1.229,1.210,1.249,1.246],[4.138,3.930,3.999,4.016,3.992,3.992],[0.512,0.423,0.391,0.393,0.397,0.392],[0.542,0.412,0.415,0.403,0.404,0.404],[1.527,1.122,1.135,1.084,1.096,1.131],[null,null,null,null,null,null],[2.362,2.348,2.405,2.282,2.329,2.331],[4.906,5.137,4.980,5.040,4.849,4.991],[0.145,0.097,0.046,0.097,0.046,0.043],[0.725,0.438,0.455,0.506,0.472,0.457],[2.280,0.745,0.724,0.721,0.740,0.746],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.935,3.083,3.604,3.175,3.043,3.178],[2.753,1.795,2.200,2.199,2.181,2.189],[2.340,2.362,2.359,2.328,2.405,2.317],[1.855,1.664,1.715,1.746,1.714,1.706],[10.755,10.616,10.683,10.467,10.637,10.375],[2.332,2.308,2.257,2.344,2.440,2.163],[1.505,0.389,0.386,0.399,0.389,0.392],[null,null,null,null,null,null],[1.181,0.476,0.482,0.468,0.469,0.468],[1.693,1.199,1.219,1.224,1.203,1.226],[1.494,0.408,0.406,0.409,0.420,0.406],[2.245,1.158,1.152,1.186,1.187,1.186],[0.546,0.314,0.296,0.295,0.298,0.317],[1.999,1.916,1.525,1.655,1.973,1.787],[null,null,null,null,null,null],[25.873,25.174,26.648,29.081,26.754,29.902],[1.750,0.953,0.854,0.952,0.853,0.867],[null,null,null,null,null,null],[2.684,0.660,0.658,0.624,0.658,0.657],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.421,0.330,0.329,0.314,0.328,0.331],[null,null,null,null,null,null],[1.339,0.353,0.340,0.352,0.351,0.353],[26.904,26.461,26.811,26.933,26.859,26.961],[null,null,null,null,null,null],[0.060,0.031,0.031,0.068,0.060,0.058],[2.032,0.391,0.382,0.390,0.386,0.387],[0.044,0.070,0.048,0.044,0.041,0.044],[null,null,null,null,null,null],[4.759,2.694,2.654,2.883,2.167,2.684],[null,null,null,null,null,null],[2.006,1.858,1.964,1.799,1.721,1.705],[0.262,0.135,0.153,0.154,0.132,0.126],[1.230,1.038,1.108,1.081,1.093,1.002],[1.604,1.309,1.193,0.835,1.289,1.212],[null,null,null,null,null,null],[4.250,4.010,4.039,3.977,3.971,4.063],[2.992,2.431,2.429,2.413,2.432,2.424],[2.352,2.089,2.394,2.268,2.173,1.975],[0.314,0.116,0.119,0.113,0.115,0.116],[0.632,0.471,0.443,0.535,0.562,0.544],[null,null,null,null,null,null],[3.292,2.492,1.512,1.494,2.493,2.466],[null,null,null,null,null,null],[41.655,40.263,40.383,40.946,40.237,40.615],[0.814,0.185,0.178,0.184,0.180,0.185],[3.587,2.360,3.197,3.285,2.950,3.249],[null,null,null,null,null,null],[0.828,0.527,0.523,0.525,0.516,0.520],[0.883,0.808,0.782,0.781,0.771,0.700],[0.520,0.624,0.570,0.564,0.583,0.559],[0.224,0.243,0.269,0.210,0.148,0.228],[0.636,0.554,0.571,0.573,0.584,0.495],[1.491,1.368,1.432,1.488,1.039,0.778],[0.877,1.328,1.121,1.344,1.012,1.212],[1.172,1.423,1.439,1.420,1.063,1.356],[null,null,null,null,null,null],[1.534,1.275,1.311,1.293,1.228,1.339],[1.509,0.902,0.869,0.834,0.835,0.886],[3.151,2.580,2.517,2.558,2.573,2.443],[1.974,2.209,1.567,1.919,1.943,1.629],[0.811,0.845,0.766,0.726,0.807,0.728],[1.928,2.237,1.834,2.314,2.230,2.108],[0.931,0.294,0.285,0.286,0.327,0.278],[0.788,0.225,0.174,0.231,0.259,0.200],[0.948,0.293,0.322,0.379,0.317,0.313],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.207,1.639,2.014,1.633,1.879,1.925],[3.109,2.771,2.615,2.501,2.912,2.778],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.015,0.770,0.753,0.753,0.750,0.720],[1.530,1.212,1.305,1.296,1.320,1.308],[0.046,0.034,0.035,0.037,0.034,0.034],[0.034,0.035,0.035,0.035,0.035,0.036],[1.725,1.223,1.586,1.194,1.609,1.385],[null,null,null,null,null,null],[1.055,0.365,0.390,0.395,0.350,0.351],[2.876,2.580,2.736,2.542,2.312,2.487],[1.139,0.487,0.536,0.432,0.533,0.480],[3.281,3.087,3.150,2.284,2.683,2.506],[2.355,2.791,2.240,2.465,2.461,2.532],[2.564,2.561,2.673,2.568,2.307,2.363],[2.688,2.798,2.841,3.218,3.122,3.359],[2.271,1.504,1.539,1.516,1.508,1.600],[1.622,1.009,0.986,1.014,0.975,1.040],[2.597,2.092,2.059,2.066,2.050,2.386],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.250,2.747,3.156,2.625,2.713,3.099],[0.077,0.031,0.031,0.042,0.041,0.032],[1.904,0.953,1.101,1.119,1.012,0.993],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.046,0.044,0.111,0.045,0.044,0.044],[0.044,0.050,0.047,0.044,0.045,0.045],[0.045,0.116,0.045,0.058,0.046,0.045],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.085,0.085,0.084,0.084,0.104,0.084],[0.084,0.085,0.097,0.086,0.084,0.083],[0.084,0.084,0.084,0.083,0.084,0.084],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.405,1.216,0.938,1.248,1.267,1.296],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.1.8.22","source":"results/24.1.8.22.json"} +,{"actual_version":"24.2.3.70","data_size":{"coffeeshop":44645264965,"hits":14283522891,"job":1828094510,"mgbench":2957954463,"ontime":2699155844,"ssb":73313335306,"taxi":24223527141,"tpcds":18811489543,"tpch":17234158071,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":759,"hits":205,"job":27,"mgbench":72,"ontime":59,"ssb":1477,"taxi":525,"tpcds":255,"tpch":273,"uk":36},"machine":"c7a.4xlarge","release_date":"2024-05-01","result":[[0.077,0.010,0.010,0.327,0.009,0.013],[0.049,0.016,0.020,0.015,0.015,0.015],[0.052,0.019,0.011,0.065,0.010,0.011],[0.040,0.011,0.011,0.025,0.011,0.012],[0.049,0.026,0.021,0.047,0.021,0.020],[0.072,0.016,0.021,0.039,0.017,0.016],[0.023,0.007,0.007,0.006,0.006,0.006],[0.047,0.014,0.014,0.012,0.013,0.013],[0.084,0.036,0.031,0.057,0.030,0.030],[0.089,0.050,0.053,0.056,0.051,0.054],[0.441,0.385,0.363,0.307,0.370,0.363],[0.366,0.205,0.263,0.225,0.206,0.214],[0.030,0.017,0.008,0.008,0.007,0.009],[0.036,0.013,0.013,0.015,0.013,0.012],[0.659,0.540,0.534,0.647,0.511,0.526],[0.581,0.104,0.103,0.102,0.099,0.106],[0.047,0.013,0.013,0.012,0.014,0.014],[0.042,0.011,0.013,0.011,0.010,0.012],[6.412,1.144,1.159,1.183,1.151,1.146],[4.718,0.859,0.866,0.857,0.862,0.852],[4.732,0.903,0.893,0.886,0.885,0.889],[5.290,1.539,1.497,1.501,1.505,1.498],[6.194,1.267,1.259,1.259,1.255,1.269],[3.933,0.750,0.757,0.763,0.747,0.766],[0.071,0.022,0.021,0.021,0.023,0.021],[7.820,1.721,1.745,1.739,1.726,1.713],[1.932,0.613,0.626,0.618,0.629,0.613],[1.911,0.454,0.451,0.448,0.446,0.445],[0.003,0.003,0.002,0.002,0.002,0.002],[0.034,0.012,0.008,0.008,0.008,0.008],[0.064,0.016,0.016,0.040,0.017,0.016],[0.148,0.020,0.021,0.021,0.021,0.021],[0.171,0.054,0.052,0.054,0.066,0.054],[0.324,0.127,0.124,0.122,0.122,0.126],[0.007,0.002,0.002,0.031,0.003,0.002],[0.027,0.011,0.010,0.010,0.009,0.009],[0.384,0.222,0.225,0.220,0.243,0.225],[0.429,0.264,0.262,0.259,0.261,0.272],[0.206,0.081,0.077,0.080,0.078,0.075],[0.221,0.097,0.094,0.096,0.094,0.093],[0.493,0.264,0.266,0.257,0.264,0.275],[0.670,0.378,0.362,0.363,0.375,0.363],[0.600,0.383,0.414,0.383,0.372,0.385],[0.384,0.233,0.223,0.219,0.217,0.225],[1.328,0.953,0.945,0.956,0.965,0.943],[0.945,0.646,0.629,0.630,0.637,0.644],[2.805,1.943,1.976,2.004,1.974,2.031],[0.152,0.020,0.021,0.023,0.020,0.020],[1.788,0.323,0.318,0.319,0.350,0.337],[1.893,0.379,0.353,0.370,0.352,0.381],[3.959,0.964,0.956,0.949,0.962,0.957],[2.362,0.412,0.411,0.421,0.419,0.407],[0.477,0.100,0.101,0.107,0.102,0.097],[0.287,0.077,0.078,0.075,0.075,0.076],[0.498,0.103,0.101,0.101,0.105,0.100],[1.750,0.354,0.365,0.372,0.348,0.360],[1.629,0.552,0.554,0.549,0.560,0.583],[0.065,0.025,0.022,0.042,0.023,0.023],[0.527,0.230,0.228,0.241,0.220,0.222],[1.006,0.298,0.298,0.293,0.298,0.312],[2.187,1.619,1.532,1.590,1.524,1.579],[2.922,1.586,1.573,1.604,1.553,1.608],[3.124,1.805,1.756,1.757,1.742,1.603],[0.637,0.500,0.558,0.505,0.504,0.577],[0.117,0.049,0.048,0.055,0.049,0.046],[0.052,0.024,0.023,0.032,0.026,0.028],[0.076,0.025,0.023,0.023,0.024,0.021],[0.192,0.101,0.096,0.103,0.098,0.096],[0.028,0.006,0.010,0.008,0.009,0.010],[0.022,0.010,0.009,0.008,0.008,0.006],[0.014,0.005,0.005,0.005,0.004,0.004],[0.367,0.042,0.042,0.065,0.040,0.043],[0.423,0.058,0.054,0.057,0.056,0.056],[0.107,0.035,0.033,0.054,0.033,0.032],[0.226,0.060,0.062,0.083,0.060,0.062],[0.075,0.033,0.031,0.030,0.030,0.030],[0.173,0.062,0.063,0.063,0.061,0.062],[0.229,0.082,0.080,0.081,0.081,0.081],[0.059,0.032,0.031,0.030,0.031,0.030],[0.101,0.057,0.055,0.056,0.055,0.055],[0.255,0.138,0.140,0.137,0.137,0.140],[0.488,0.164,0.177,0.162,0.164,0.157],[0.380,0.251,0.248,0.250,0.248,0.251],[0.136,0.045,0.039,0.039,0.038,0.038],[0.651,0.298,0.298,0.321,0.284,0.283],[2.496,1.969,1.985,1.964,1.953,1.989],[8.640,0.991,1.021,1.058,1.008,1.013],[2.356,1.080,1.070,1.079,1.079,1.059],[12.895,2.567,2.560,2.580,2.571,2.572],[4.316,3.186,3.209,3.246,3.199,3.225],[4.071,1.815,1.833,1.835,1.847,1.841],[4.421,4.145,4.182,4.244,4.186,4.230],[null,null,null,null,null,null],[3.583,3.231,3.221,3.209,3.231,3.264],[null,null,null,null,null,null],[5.788,5.391,5.393,5.344,5.369,5.330],[null,null,null,null,null,null],[3.440,3.179,3.190,3.220,3.179,3.124],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.668,0.677,0.680,0.515,0.453,0.465],[null,null,null,null,null,null],[18.912,18.563,18.034,17.593,17.722,18.271],[null,null,null,null,null,null],[28.036,28.551,28.501,28.166,30.041,27.436],[0.402,0.068,0.066,0.067,0.069,0.066],[20.547,20.815,21.044,21.188,21.377,20.133],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.158,8.586,8.652,8.646,8.293,8.310],[0.650,0.392,0.422,0.462,0.422,0.417],[1.192,0.542,0.457,0.474,0.528,0.525],[10.038,9.520,9.256,9.432,8.993,9.061],[0.481,0.515,0.774,0.487,0.813,0.732],[0.242,0.101,0.099,0.121,0.102,0.147],[0.491,0.326,0.269,0.349,0.336,0.348],[null,null,null,null,null,null],[33.466,32.530,33.065,32.349,31.799,32.070],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.999,0.751,0.662,0.638,0.639,0.644],[3.483,3.413,3.387,3.435,3.498,3.481],[48.162,48.225,50.483,49.802,50.246,50.413],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.559,0.439,0.429,0.462,0.426,0.434],[1.271,0.807,0.780,0.813,0.783,0.804],[1.432,0.958,0.961,0.951,0.960,0.969],[null,null,null,null,null,null],[30.716,31.422,31.163,30.261,30.327,29.897],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.005,0.738,0.741,0.722,0.763,0.692],[null,null,null,null,null,null],[13.279,11.598,9.107,13.091,12.994,12.216],[null,null,null,null,null,null],[3.350,2.789,2.583,2.772,3.048,2.945],[null,null,null,null,null,null],[0.322,0.146,0.143,0.162,0.148,0.151],[0.283,0.183,0.166,0.159,0.155,0.155],[6.160,4.835,4.803,4.800,4.871,4.912],[11.144,9.847,9.793,10.143,9.963,10.020],[6.330,4.335,4.894,4.549,5.001,5.147],[6.097,5.060,5.115,4.626,5.428,4.138],[14.100,12.285,11.346,12.018,12.647,12.164],[1.309,0.229,0.243,0.236,0.237,0.232],[null,null,null,null,null,null],[1.600,0.941,0.933,0.941,0.937,0.933],[13.434,8.871,11.840,11.917,10.885,11.461],[null,null,null,null,null,null],[1.900,1.154,1.152,1.177,1.179,1.133],[null,null,null,null,null,null],[1.284,0.375,0.374,0.378,0.377,0.374],[1.390,0.441,0.433,0.450,0.422,0.441],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.375,1.150,1.010,1.114,1.229,1.111],[4.952,4.616,4.587,4.627,4.511,4.480],[0.506,0.416,0.414,0.399,0.423,0.405],[0.533,0.405,0.398,0.411,0.408,0.405],[1.550,1.102,0.764,1.113,1.130,0.766],[null,null,null,null,null,null],[2.454,2.270,2.495,2.199,2.305,2.310],[5.101,5.123,5.133,5.171,5.046,5.102],[0.207,0.073,0.051,0.035,0.044,0.037],[0.739,0.453,0.454,0.473,0.502,0.500],[2.171,0.757,0.770,0.756,0.753,0.774],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.619,3.717,2.393,3.365,3.166,3.136],[2.774,2.197,2.253,2.166,2.150,2.173],[2.344,2.369,2.449,1.995,2.495,2.255],[1.946,1.594,1.595,1.629,1.816,1.722],[10.905,10.598,10.259,10.506,12.156,10.589],[2.041,2.221,2.154,2.076,2.255,2.438],[1.341,0.406,0.408,0.394,0.399,0.407],[null,null,null,null,null,null],[1.162,0.481,0.485,0.483,0.484,0.475],[1.688,1.252,1.221,1.243,1.247,1.245],[1.295,0.425,0.419,0.417,0.422,0.424],[2.196,1.193,1.202,1.200,1.204,1.227],[0.534,0.302,0.308,0.306,0.338,0.303],[1.968,1.829,1.484,1.555,1.776,1.751],[null,null,null,null,null,null],[32.973,26.409,26.024,29.500,26.240,25.885],[1.826,0.971,0.900,1.012,0.885,0.898],[null,null,null,null,null,null],[2.432,0.646,0.652,0.650,0.670,0.652],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.228,0.331,0.325,0.326,0.329,0.323],[null,null,null,null,null,null],[1.277,0.363,0.378,0.367,0.349,0.363],[27.014,27.717,26.463,26.739,27.706,28.611],[null,null,null,null,null,null],[0.032,0.033,0.042,0.051,0.032,0.032],[1.705,0.386,0.381,0.392,0.390,0.389],[0.046,0.066,0.043,0.041,0.041,0.045],[null,null,null,null,null,null],[4.738,2.970,3.085,2.153,3.020,2.558],[null,null,null,null,null,null],[1.911,1.911,1.690,1.732,1.801,1.528],[0.272,0.121,0.138,0.124,0.128,0.141],[1.256,1.103,1.162,1.110,1.253,1.097],[1.578,1.296,1.323,1.214,1.227,1.322],[null,null,null,null,null,null],[4.839,4.660,4.623,4.520,4.430,4.488],[2.990,2.498,2.472,2.443,2.524,2.452],[2.296,2.067,2.051,2.190,2.574,2.329],[0.305,0.120,0.115,0.120,0.120,0.129],[0.600,0.563,0.550,0.538,0.568,0.530],[null,null,null,null,null,null],[2.901,2.502,2.157,2.152,2.504,1.571],[null,null,null,null,null,null],[41.928,40.178,40.096,40.869,40.351,40.186],[0.719,0.206,0.198,0.187,0.193,0.187],[3.553,3.382,2.404,2.401,3.027,3.231],[null,null,null,null,null,null],[0.900,0.541,0.528,0.531,0.530,0.526],[0.860,0.778,0.701,0.753,0.629,0.833],[0.664,0.568,0.393,0.570,0.477,0.479],[0.296,0.226,0.246,0.234,0.240,0.216],[0.655,0.519,0.598,0.336,0.572,0.408],[1.369,1.432,1.078,1.385,1.434,1.440],[1.101,1.183,1.440,1.128,1.298,1.433],[1.437,1.356,1.286,1.012,1.367,1.472],[null,null,null,null,null,null],[1.733,1.197,1.243,0.928,1.268,1.254],[1.374,0.906,0.864,0.976,0.851,0.817],[2.954,2.545,2.516,2.550,2.582,2.778],[2.015,1.982,1.975,1.859,1.884,1.851],[0.849,0.798,0.377,0.821,0.758,0.772],[2.267,2.278,2.173,2.157,2.253,2.144],[0.815,0.281,0.322,0.283,0.267,0.266],[0.682,0.163,0.197,0.214,0.223,0.243],[0.793,0.318,0.231,0.291,0.301,0.218],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.102,1.912,1.956,1.943,1.880,1.979],[2.960,2.692,2.851,2.876,2.717,2.869],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.853,0.740,0.739,0.820,0.733,0.787],[1.432,0.960,1.007,1.369,0.946,1.323],[0.093,0.035,0.035,0.036,0.034,0.035],[0.036,0.040,0.034,0.036,0.035,0.035],[1.622,1.570,1.514,1.291,1.462,1.570],[null,null,null,null,null,null],[0.918,0.393,0.355,0.371,0.345,0.368],[3.116,2.649,2.665,2.247,2.368,2.619],[1.039,0.623,0.515,0.525,0.493,0.526],[3.596,3.112,2.949,2.906,2.210,3.259],[2.788,2.196,2.636,2.380,2.231,2.695],[2.665,2.271,2.544,2.543,2.726,2.261],[2.859,2.229,1.957,3.313,3.224,2.988],[2.052,1.494,1.500,1.507,1.371,1.502],[1.415,1.030,1.049,0.665,1.059,0.988],[2.168,2.040,1.969,2.025,2.064,2.047],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.602,2.716,2.889,2.823,2.771,2.991],[0.046,0.030,0.029,0.029,0.033,0.031],[1.716,1.092,1.073,1.089,1.057,0.701],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.045,0.045,0.057,0.044,0.045,0.044],[0.051,0.045,0.058,0.045,0.044,0.044],[0.047,0.045,0.045,0.045,0.046,0.045],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.085,0.086,0.085,0.085,0.086,0.086],[0.085,0.085,0.086,0.085,0.084,0.085],[0.087,0.085,0.084,0.086,0.089,0.091],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.378,1.205,0.949,1.204,1.352,1.327],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.2.3.70","source":"results/24.2.3.70.json"} +,{"actual_version":"23.8.16.40","data_size":{"coffeeshop":44636762665,"hits":14245024485,"job":1828094510,"mgbench":2954107204,"ontime":2699155844,"ssb":73312369997,"taxi":24168060073,"tpcds":18812045890,"tpch":17233443235,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":795,"hits":215,"job":23,"mgbench":70,"ontime":63,"ssb":1500,"taxi":568,"tpcds":277,"tpch":284,"uk":34},"machine":"c7a.4xlarge","release_date":"2024-08-02","result":[[0.073,0.010,0.009,0.279,0.009,0.009],[0.045,0.019,0.016,0.017,0.015,0.015],[0.039,0.018,0.013,0.069,0.010,0.010],[0.034,0.010,0.011,0.026,0.011,0.012],[0.049,0.022,0.024,0.049,0.021,0.020],[0.063,0.017,0.016,0.037,0.017,0.018],[0.021,0.006,0.006,0.006,0.006,0.007],[0.040,0.013,0.014,0.014,0.013,0.012],[0.067,0.031,0.030,0.058,0.034,0.030],[0.086,0.056,0.054,0.053,0.053,0.051],[0.455,0.394,0.397,0.391,0.388,0.382],[0.350,0.222,0.265,0.241,0.215,0.230],[0.032,0.007,0.007,0.007,0.007,0.007],[0.036,0.021,0.017,0.025,0.016,0.012],[0.698,0.579,0.589,0.676,0.550,0.545],[0.469,0.104,0.106,0.106,0.105,0.107],[0.045,0.020,0.017,0.014,0.014,0.016],[0.034,0.011,0.011,0.010,0.012,0.013],[6.417,1.373,1.377,1.408,1.388,1.397],[4.697,1.064,1.052,1.072,1.052,1.056],[4.721,1.088,1.104,1.089,1.093,1.086],[5.297,1.750,1.724,1.713,1.718,1.730],[6.184,1.472,1.464,1.478,1.455,1.483],[3.927,0.861,0.885,0.888,0.875,0.889],[0.060,0.022,0.023,0.021,0.022,0.024],[7.818,1.962,1.954,1.978,1.973,1.962],[1.817,0.697,0.696,0.694,0.699,0.698],[1.899,0.510,0.508,0.513,0.508,0.523],[0.003,0.002,0.002,0.002,0.002,0.003],[0.020,0.009,0.009,0.007,0.008,0.008],[0.052,0.017,0.016,0.042,0.018,0.017],[0.136,0.023,0.023,0.021,0.023,0.022],[0.172,0.054,0.054,0.061,0.061,0.056],[0.318,0.137,0.137,0.132,0.135,0.135],[0.003,0.003,0.002,0.031,0.003,0.002],[0.016,0.010,0.009,0.010,0.009,0.009],[0.387,0.232,0.241,0.232,0.231,0.234],[0.435,0.278,0.267,0.268,0.265,0.284],[0.199,0.078,0.076,0.076,0.079,0.080],[0.211,0.107,0.098,0.096,0.097,0.100],[0.527,0.291,0.297,0.288,0.285,0.290],[0.672,0.403,0.416,0.395,0.405,0.402],[0.612,0.409,0.411,0.394,0.396,0.421],[0.375,0.239,0.235,0.238,0.234,0.236],[1.386,1.041,1.031,1.032,1.042,1.027],[0.983,0.675,0.694,0.697,0.670,0.668],[2.925,2.092,2.110,2.127,2.120,2.131],[0.147,0.022,0.021,0.028,0.023,0.021],[1.578,0.357,0.358,0.342,0.340,0.338],[1.749,0.383,0.378,0.404,0.388,0.390],[3.930,1.033,1.011,1.024,1.006,1.007],[2.031,0.419,0.411,0.410,0.406,0.410],[0.448,0.114,0.111,0.115,0.112,0.122],[0.268,0.086,0.085,0.085,0.086,0.085],[0.441,0.116,0.107,0.108,0.105,0.105],[1.578,0.376,0.364,0.393,0.379,0.371],[1.512,0.559,0.571,0.559,0.574,0.558],[1.041,1.031,1.023,1.133,1.004,1.011],[0.516,0.244,0.260,0.270,0.231,0.243],[0.925,0.309,0.308,0.308,0.315,0.315],[2.314,1.722,1.732,1.687,1.714,1.708],[2.913,1.767,1.758,1.747,1.745,1.743],[2.954,1.759,1.751,1.721,1.727,1.739],[0.622,0.480,0.551,0.513,0.569,0.533],[0.115,0.059,0.056,0.057,0.057,0.059],[0.056,0.025,0.027,0.028,0.024,0.033],[0.091,0.023,0.025,0.026,0.026,0.025],[0.246,0.153,0.146,0.148,0.168,0.139],[0.031,0.011,0.007,0.007,0.011,0.007],[0.023,0.007,0.006,0.007,0.008,0.007],[0.013,0.005,0.005,0.004,0.004,0.011],[0.315,0.045,0.044,0.062,0.047,0.044],[0.366,0.064,0.059,0.058,0.058,0.064],[0.109,0.042,0.040,0.057,0.037,0.032],[0.211,0.060,0.060,0.081,0.059,0.060],[0.075,0.032,0.032,0.031,0.032,0.033],[0.170,0.076,0.094,0.072,0.077,0.084],[0.212,0.095,0.093,0.096,0.092,0.094],[0.059,0.036,0.033,0.034,0.035,0.036],[0.097,0.059,0.060,0.059,0.059,0.060],[0.253,0.157,0.161,0.159,0.162,0.157],[0.435,0.177,0.179,0.166,0.188,0.176],[0.390,0.272,0.270,0.272,0.270,0.267],[0.132,0.044,0.043,0.045,0.043,0.042],[0.617,0.302,0.308,0.333,0.300,0.306],[2.691,2.291,2.274,2.264,2.241,2.246],[8.639,1.078,1.088,1.100,1.094,1.104],[2.108,1.121,1.124,1.124,1.096,1.133],[12.807,3.667,3.666,3.652,3.672,3.665],[4.281,3.499,3.503,3.509,3.503,3.517],[4.059,1.981,1.966,1.960,1.970,1.959],[5.110,5.406,5.179,4.652,5.011,5.236],[null,null,null,null,null,null],[3.780,3.448,3.481,3.530,3.484,3.507],[null,null,null,null,null,null],[5.894,5.593,5.598,5.591,5.593,5.573],[null,null,null,null,null,null],[3.648,3.399,3.522,3.431,3.441,3.454],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.689,0.719,0.718,0.530,0.471,0.475],[null,null,null,null,null,null],[17.027,17.061,17.111,17.025,17.046,17.100],[null,null,null,null,null,null],[28.597,28.377,28.468,28.515,28.414,28.591],[0.239,0.079,0.078,0.075,0.079,0.078],[41.536,35.448,35.704,35.841,35.222,40.657],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.809,8.474,8.471,8.566,8.403,8.395],[0.601,0.419,0.419,0.397,0.413,0.398],[0.987,0.501,0.492,0.518,0.496,0.494],[8.992,8.861,8.895,9.026,8.921,9.056],[0.777,0.782,0.754,0.916,0.818,0.730],[0.225,0.101,0.149,0.115,0.099,0.110],[0.483,0.334,0.325,0.302,0.338,0.328],[null,null,null,null,null,null],[32.331,31.258,30.458,30.815,31.038,30.882],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.014,0.796,0.702,0.702,0.690,0.686],[4.097,4.079,3.946,3.984,3.983,4.084],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.488,0.488,0.494,0.521,0.486,0.498],[1.418,0.919,0.927,0.927,0.926,0.933],[1.446,2.136,0.958,0.978,0.977,0.970],[null,null,null,null,null,null],[66.227,61.050,57.861,57.490,57.864,58.514],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.012,0.758,0.751,0.770,0.734,0.731],[null,null,null,null,null,null],[12.512,11.619,11.508,11.605,11.285,11.310],[null,null,null,null,null,null],[3.076,3.044,3.076,2.942,2.907,2.998],[null,null,null,null,null,null],[0.293,0.144,0.146,0.168,0.150,0.152],[0.302,0.201,0.207,0.198,0.193,0.194],[5.976,4.764,4.722,4.731,4.762,4.780],[10.409,9.657,9.417,9.445,9.287,9.335],[5.732,4.864,5.032,4.938,4.953,4.961],[5.735,4.949,4.935,4.931,4.976,4.827],[12.343,11.462,11.210,11.158,11.245,11.312],[0.827,0.239,0.240,0.245,0.244,0.252],[null,null,null,null,null,null],[1.571,0.995,0.986,0.995,1.002,1.002],[12.509,11.458,11.574,11.602,11.242,11.288],[null,null,null,null,null,null],[1.867,1.226,1.185,1.212,1.193,1.177],[null,null,null,null,null,null],[1.199,0.379,0.377,0.379,0.388,0.380],[1.299,0.448,0.434,0.440,0.428,0.435],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.345,1.299,1.318,1.240,1.246,1.279],[4.987,4.665,4.639,4.619,4.604,4.613],[0.529,0.434,0.430,0.406,0.420,0.425],[0.536,0.431,0.433,0.415,0.410,0.420],[1.528,1.197,1.182,1.163,1.153,1.145],[null,null,null,null,null,null],[2.521,2.475,2.394,2.538,2.294,2.484],[6.571,6.469,6.458,6.457,6.667,6.535],[0.082,0.039,0.048,0.036,0.041,0.049],[0.685,0.469,0.481,0.522,0.466,0.488],[2.058,0.780,0.774,0.755,0.770,0.738],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.284,3.599,3.540,3.517,3.561,3.463],[3.651,3.263,3.214,3.232,3.264,3.260],[2.387,2.396,2.470,2.323,2.438,2.377],[2.628,1.989,1.904,1.928,1.972,1.999],[10.312,9.940,10.026,10.016,10.096,10.137],[2.427,2.444,2.356,2.373,2.326,2.395],[1.140,0.406,0.397,0.402,0.409,0.406],[null,null,null,null,null,null],[1.101,0.526,0.516,0.512,0.512,0.516],[1.741,1.348,1.357,1.333,1.342,1.357],[1.167,0.416,0.414,0.415,0.427,0.416],[2.206,1.276,1.223,1.214,1.235,1.217],[0.507,0.317,0.354,0.320,0.319,0.325],[2.074,1.977,1.943,1.927,1.990,1.953],[null,null,null,null,null,null],[28.518,25.758,28.058,25.077,25.175,27.719],[1.829,1.062,1.027,1.093,1.017,0.998],[null,null,null,null,null,null],[2.455,0.703,0.727,0.690,0.697,0.719],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.150,0.363,0.353,0.355,0.361,0.357],[null,null,null,null,null,null],[1.200,0.392,0.389,0.391,0.372,0.387],[43.848,43.686,45.057,43.236,43.502,43.748],[null,null,null,null,null,null],[0.042,0.037,0.041,0.056,0.038,0.037],[1.655,0.440,0.443,0.440,0.452,0.445],[0.057,0.076,0.052,0.052,0.049,0.057],[null,null,null,null,null,null],[5.602,3.823,3.825,3.910,4.014,3.859],[null,null,null,null,null,null],[2.053,1.953,1.988,1.989,1.962,1.972],[0.241,0.150,0.134,0.132,0.132,0.135],[1.181,1.055,1.110,1.121,1.127,1.096],[1.582,1.369,1.256,1.295,1.256,1.253],[null,null,null,null,null,null],[5.059,4.797,4.764,4.776,4.828,4.826],[3.101,2.643,2.642,2.620,2.597,2.625],[2.867,2.665,2.635,2.855,2.670,2.714],[0.301,0.127,0.125,0.141,0.130,0.135],[0.921,0.737,0.819,0.810,0.813,0.730],[null,null,null,null,null,null],[3.167,2.385,2.372,2.411,2.381,2.377],[null,null,null,null,null,null],[41.836,41.504,41.556,41.901,41.790,41.893],[0.624,0.191,0.194,0.194,0.193,0.194],[3.774,3.197,3.251,3.211,3.171,3.223],[null,null,null,null,null,null],[0.885,0.579,0.597,0.573,0.585,0.586],[0.855,0.797,0.776,0.862,0.796,0.771],[0.566,0.498,0.485,0.527,0.486,0.425],[0.281,0.220,0.201,0.196,0.206,0.225],[0.583,0.504,0.573,0.516,0.498,0.524],[1.491,1.506,1.476,1.484,1.496,1.533],[1.705,1.473,1.436,1.504,1.600,1.447],[1.541,1.614,1.437,1.442,1.511,1.459],[null,null,null,null,null,null],[1.703,1.309,1.272,1.292,1.268,1.282],[1.299,0.870,0.933,0.874,0.929,0.888],[2.905,2.548,2.563,2.530,2.542,2.532],[2.677,2.336,2.632,2.451,2.499,2.497],[0.906,0.797,0.932,0.805,0.834,0.815],[3.180,2.954,2.940,3.146,2.825,3.103],[0.656,0.262,0.277,0.306,0.273,0.262],[0.606,0.195,0.214,0.190,0.214,0.207],[0.700,0.359,0.354,0.345,0.351,0.343],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.781,2.678,2.620,2.648,2.775,2.613],[4.259,4.173,4.074,4.188,4.203,4.138],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.972,0.785,0.771,0.790,0.773,0.788],[1.550,1.510,1.352,1.365,1.361,1.357],[0.038,0.038,0.043,0.037,0.039,0.038],[0.039,0.042,0.037,0.037,0.038,0.038],[1.763,1.796,1.700,1.681,1.655,1.671],[null,null,null,null,null,null],[0.882,0.482,0.499,0.452,0.479,0.465],[3.042,2.564,2.610,2.650,2.702,2.651],[1.036,0.610,0.577,0.569,0.525,0.524],[3.434,3.107,3.078,3.070,3.076,3.003],[2.940,2.808,2.855,2.829,2.831,2.977],[2.871,2.911,2.807,2.752,2.793,2.851],[3.724,3.640,3.487,3.645,3.501,3.509],[2.032,1.537,1.427,1.558,1.533,1.551],[1.521,1.070,1.020,1.026,1.001,1.063],[2.585,2.190,2.142,2.157,2.205,2.180],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.579,3.070,3.222,3.025,3.043,3.078],[0.034,0.033,0.038,0.037,0.034,0.035],[1.601,1.059,1.060,1.078,1.055,1.099],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.055,0.051,0.053,0.051,0.051,0.051],[0.052,0.051,0.051,0.050,0.050,0.051],[0.051,0.051,0.054,0.065,0.053,0.050],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.102,0.100,0.106,0.099,0.099,0.101],[0.105,0.100,0.099,0.099,0.099,0.102],[0.099,0.106,0.098,0.100,0.100,0.099],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.356,1.384,1.302,1.497,1.324,1.291],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"23.8.16.40","source":"results/23.8.16.40.json"} +,{"actual_version":"24.4.4.113","data_size":{"coffeeshop":44650713163,"hits":14237555557,"job":1828094510,"mgbench":2953725996,"ontime":2699155844,"ssb":73313678651,"taxi":24223450798,"tpcds":18808273857,"tpch":17234752263,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":778,"hits":200,"job":33,"mgbench":70,"ontime":59,"ssb":1493,"taxi":558,"tpcds":283,"tpch":265,"uk":41},"machine":"c7a.4xlarge","release_date":"2024-08-02","result":[[0.084,0.010,0.010,0.313,0.008,0.009],[0.051,0.016,0.016,0.016,0.015,0.014],[0.047,0.020,0.014,0.064,0.011,0.011],[0.040,0.012,0.010,0.025,0.011,0.011],[0.046,0.021,0.021,0.049,0.019,0.019],[0.069,0.018,0.019,0.044,0.017,0.016],[0.022,0.007,0.007,0.010,0.007,0.007],[0.050,0.013,0.014,0.013,0.014,0.015],[0.074,0.033,0.030,0.055,0.029,0.029],[0.091,0.054,0.055,0.052,0.051,0.051],[0.438,0.348,0.375,0.371,0.371,0.367],[0.379,0.239,0.279,0.247,0.227,0.228],[0.040,0.007,0.007,0.007,0.015,0.009],[0.047,0.014,0.014,0.012,0.013,0.013],[0.688,0.589,0.569,0.679,0.545,0.546],[0.562,0.124,0.121,0.121,0.117,0.116],[0.047,0.029,0.012,0.014,0.015,0.013],[0.037,0.011,0.012,0.012,0.011,0.013],[6.492,1.338,1.307,1.334,1.309,1.314],[4.793,1.001,0.979,0.992,0.999,0.991],[4.791,1.030,1.020,1.031,1.024,1.026],[5.363,1.726,1.735,1.730,1.713,1.743],[6.255,1.469,1.478,1.456,1.456,1.454],[3.982,0.939,0.945,0.946,0.935,0.964],[0.070,0.027,0.024,0.024,0.026,0.023],[7.906,1.903,1.900,1.907,1.907,1.888],[1.952,0.700,0.696,0.695,0.702,0.698],[1.929,0.519,0.508,0.528,0.517,0.513],[0.003,0.002,0.002,0.002,0.003,0.003],[0.025,0.008,0.009,0.008,0.009,0.008],[0.060,0.016,0.017,0.042,0.022,0.018],[0.160,0.021,0.023,0.022,0.022,0.024],[0.191,0.055,0.056,0.055,0.054,0.056],[0.357,0.133,0.133,0.132,0.135,0.132],[0.005,0.003,0.003,0.034,0.002,0.002],[0.021,0.010,0.011,0.009,0.009,0.010],[0.401,0.230,0.230,0.231,0.233,0.229],[0.464,0.272,0.269,0.268,0.284,0.270],[0.241,0.100,0.101,0.101,0.106,0.102],[0.257,0.121,0.121,0.119,0.120,0.121],[0.562,0.296,0.293,0.290,0.301,0.293],[0.787,0.454,0.432,0.434,0.439,0.431],[0.680,0.454,0.425,0.425,0.428,0.448],[0.432,0.253,0.245,0.242,0.248,0.252],[1.373,0.984,0.959,0.981,0.975,0.978],[0.975,0.633,0.631,0.622,0.629,0.637],[2.977,2.005,2.056,2.070,2.064,2.090],[0.162,0.023,0.023,0.023,0.020,0.021],[1.852,0.373,0.338,0.348,0.339,0.338],[2.097,0.386,0.388,0.404,0.386,0.384],[3.938,1.027,1.024,1.045,1.030,1.032],[2.318,0.441,0.408,0.404,0.407,0.457],[0.543,0.128,0.126,0.127,0.128,0.126],[0.303,0.090,0.089,0.087,0.088,0.087],[0.543,0.129,0.128,0.125,0.127,0.124],[1.859,0.378,0.376,0.413,0.377,0.397],[1.759,0.570,0.562,0.565,0.567,0.581],[0.066,0.025,0.024,0.042,0.023,0.023],[0.593,0.266,0.252,0.271,0.240,0.243],[1.133,0.327,0.331,0.318,0.323,0.327],[2.245,1.545,1.638,1.614,1.575,1.668],[3.159,1.687,1.624,1.672,1.642,1.646],[3.115,1.670,1.638,1.645,1.644,1.642],[0.361,0.217,0.214,0.219,0.201,0.212],[0.074,0.029,0.033,0.032,0.029,0.028],[0.040,0.028,0.024,0.024,0.020,0.022],[0.048,0.018,0.016,0.017,0.014,0.018],[0.113,0.060,0.057,0.050,0.053,0.052],[0.025,0.008,0.007,0.006,0.006,0.007],[0.022,0.007,0.007,0.008,0.008,0.006],[0.012,0.004,0.004,0.004,0.004,0.004],[0.397,0.043,0.047,0.065,0.042,0.042],[0.351,0.063,0.063,0.060,0.060,0.062],[0.105,0.036,0.040,0.056,0.036,0.037],[0.235,0.065,0.067,0.088,0.063,0.063],[0.081,0.031,0.031,0.030,0.031,0.030],[0.179,0.065,0.065,0.066,0.065,0.065],[0.206,0.088,0.089,0.085,0.086,0.085],[0.062,0.031,0.031,0.031,0.031,0.032],[0.102,0.057,0.056,0.056,0.054,0.055],[0.257,0.148,0.156,0.151,0.150,0.147],[0.502,0.180,0.176,0.166,0.165,0.172],[0.398,0.288,0.266,0.276,0.272,0.268],[0.147,0.040,0.038,0.038,0.038,0.039],[0.637,0.305,0.301,0.334,0.306,0.297],[2.762,2.208,2.194,2.192,2.190,2.196],[8.652,1.104,1.099,1.102,1.073,1.131],[2.427,1.161,1.155,1.164,1.155,1.167],[12.894,2.772,2.755,2.783,2.773,2.788],[4.279,3.011,3.012,3.007,2.999,3.003],[4.072,1.786,1.812,1.797,1.783,1.796],[3.926,3.719,3.724,3.796,3.778,3.759],[null,null,null,null,null,null],[3.395,3.002,3.014,3.053,3.023,3.018],[null,null,null,null,null,null],[4.893,4.565,4.588,4.578,4.568,4.570],[null,null,null,null,null,null],[3.289,2.978,2.966,2.973,2.958,2.958],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.723,0.730,0.722,0.540,0.487,0.487],[null,null,null,null,null,null],[17.066,16.573,16.854,16.290,16.835,16.873],[null,null,null,null,null,null],[28.209,27.860,28.200,28.194,28.526,28.347],[0.264,0.087,0.082,0.080,0.079,0.079],[19.618,20.716,20.589,20.010,20.437,20.108],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.008,7.532,7.963,8.161,8.266,8.358],[0.518,0.332,0.326,0.425,0.347,0.349],[1.217,0.531,0.468,0.540,0.531,0.528],[9.069,8.821,9.156,9.412,9.101,9.044],[0.828,0.691,0.774,0.702,0.689,0.393],[0.241,0.102,0.101,0.118,0.101,0.099],[0.484,0.331,0.324,0.255,0.254,0.334],[null,null,null,null,null,null],[3.126,1.998,2.060,2.006,1.992,2.023],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.040,0.725,0.593,0.577,0.590,0.587],[3.874,3.743,3.884,3.868,3.879,3.570],[54.714,55.470,56.916,55.380,55.337,55.491],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.533,0.389,0.383,0.417,0.386,0.385],[1.034,0.555,0.569,0.569,0.568,0.570],[1.465,0.973,0.984,0.974,0.963,0.968],[null,null,null,null,null,null],[32.392,32.301,32.017,32.268,32.741,32.723],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.872,0.561,0.558,0.587,0.546,0.551],[null,null,null,null,null,null],[13.061,12.462,12.224,12.049,11.564,11.650],[null,null,null,null,null,null],[3.452,3.126,2.805,3.226,2.889,3.190],[null,null,null,null,null,null],[0.280,0.116,0.109,0.127,0.104,0.111],[0.273,0.153,0.140,0.138,0.153,0.139],[5.973,4.612,4.625,4.618,4.640,4.652],[6.460,5.106,5.071,5.169,5.105,5.133],[5.799,4.430,4.363,5.164,5.378,4.925],[5.434,3.167,4.593,4.792,3.890,4.761],[14.254,13.383,12.772,12.332,10.107,12.005],[1.327,0.215,0.215,0.212,0.221,0.217],[null,null,null,null,null,null],[1.678,1.029,1.040,1.022,1.032,1.037],[14.244,8.854,12.139,12.236,9.454,11.377],[null,null,null,null,null,null],[1.880,0.988,1.011,0.993,0.988,0.977],[null,null,null,null,null,null],[1.231,0.300,0.305,0.300,0.300,0.306],[1.335,0.365,0.376,0.376,0.366,0.372],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.390,1.163,1.136,1.254,1.217,1.125],[1.199,0.619,0.639,0.636,0.629,0.625],[0.785,0.643,0.634,0.636,0.643,0.645],[0.747,0.621,0.621,0.646,0.628,0.649],[1.542,1.146,1.160,1.157,1.142,1.148],[null,null,null,null,null,null],[2.386,2.111,1.997,2.333,2.357,2.317],[5.190,5.316,5.590,5.303,5.392,5.278],[0.038,0.049,0.136,0.055,0.029,0.028],[0.599,0.365,0.377,0.379,0.386,0.333],[2.023,0.631,0.654,0.619,0.629,0.631],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.957,3.012,3.109,3.504,3.124,2.186],[2.731,2.218,2.137,2.153,2.131,2.177],[2.491,2.336,2.439,1.888,2.177,2.400],[1.581,1.447,1.295,1.424,1.232,1.484],[11.314,10.894,11.055,11.218,10.937,11.133],[2.318,2.335,2.393,2.268,2.251,2.356],[1.262,0.315,0.342,0.336,0.348,0.335],[null,null,null,null,null,null],[1.044,0.395,0.388,0.374,0.386,0.392],[1.574,1.126,1.126,1.136,1.130,1.160],[1.199,0.343,0.339,0.351,0.349,0.351],[1.958,0.989,0.985,0.958,0.958,0.958],[0.421,0.221,0.222,0.224,0.222,0.223],[1.719,1.485,1.597,1.476,1.384,1.454],[null,null,null,null,null,null],[25.165,24.630,24.940,30.125,24.856,25.280],[1.666,0.845,0.743,0.839,0.762,0.754],[null,null,null,null,null,null],[2.407,0.609,0.597,0.594,0.569,0.572],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.194,0.300,0.291,0.292,0.293,0.290],[null,null,null,null,null,null],[1.250,0.332,0.329,0.321,0.310,0.325],[28.404,28.060,28.256,28.038,27.988,28.007],[null,null,null,null,null,null],[0.012,0.026,0.022,0.029,0.012,0.009],[1.718,0.336,0.332,0.331,0.332,0.331],[0.022,0.042,0.016,0.017,0.022,0.015],[null,null,null,null,null,null],[4.910,2.450,2.839,2.251,3.021,2.025],[null,null,null,null,null,null],[2.080,1.826,1.713,1.507,1.682,1.629],[0.240,0.110,0.099,0.105,0.099,0.100],[1.228,1.180,1.147,1.022,1.123,1.059],[1.385,0.855,1.197,1.112,1.192,1.182],[null,null,null,null,null,null],[1.214,0.622,0.623,0.625,0.613,0.628],[2.469,1.982,2.004,1.992,1.978,1.979],[1.947,1.627,1.973,1.864,1.781,1.878],[0.296,0.098,0.095,0.090,0.096,0.098],[0.533,0.454,0.375,0.446,0.410,0.376],[null,null,null,null,null,null],[3.055,2.269,2.228,2.285,2.224,2.214],[null,null,null,null,null,null],[16.926,16.308,16.462,16.440,16.659,16.697],[0.659,0.155,0.157,0.160,0.175,0.158],[3.907,3.245,3.310,3.359,2.955,3.305],[null,null,null,null,null,null],[0.761,0.386,0.382,0.389,0.390,0.385],[0.868,0.793,0.825,0.444,0.749,0.813],[0.515,0.433,0.478,0.538,0.516,0.344],[0.284,0.239,0.233,0.127,0.241,0.194],[0.560,0.548,0.535,0.539,0.507,0.559],[1.386,1.305,1.464,1.166,0.707,1.405],[1.363,1.109,1.463,1.372,1.441,1.088],[1.521,1.184,1.196,1.045,1.336,1.430],[null,null,null,null,null,null],[1.829,1.255,1.276,0.849,1.290,1.210],[1.401,0.504,0.790,0.848,0.967,0.873],[2.916,2.433,2.327,2.378,2.532,2.322],[1.767,1.722,1.783,1.744,1.651,1.849],[0.499,0.756,0.828,0.836,0.736,0.773],[2.029,2.010,2.020,1.997,2.311,1.956],[0.756,0.302,0.286,0.282,0.270,0.269],[0.630,0.234,0.203,0.206,0.205,0.139],[0.791,0.307,0.380,0.354,0.294,0.307],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.110,1.879,1.895,1.902,1.848,1.860],[2.933,2.670,2.658,2.542,2.645,2.721],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.873,0.759,0.755,0.800,0.706,0.753],[1.330,1.283,1.277,1.200,1.227,1.193],[0.007,0.006,0.006,0.005,0.005,0.005],[0.006,0.008,0.012,0.006,0.005,0.006],[1.603,1.232,1.476,1.157,1.191,1.494],[null,null,null,null,null,null],[0.868,0.362,0.317,0.320,0.340,0.343],[2.816,2.634,2.386,2.547,2.739,2.755],[0.967,0.481,0.466,0.487,0.444,0.492],[3.540,3.070,2.707,2.836,3.078,2.405],[2.500,2.234,2.642,2.308,2.588,2.157],[2.696,2.491,1.558,2.278,2.586,2.200],[3.114,2.869,3.043,2.745,2.964,2.849],[2.131,1.236,1.299,1.270,1.203,1.064],[1.274,1.036,0.994,1.040,0.942,1.018],[2.149,1.842,1.867,1.865,1.842,1.884],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.269,3.047,3.056,3.253,3.094,2.601],[0.059,0.007,0.008,0.006,0.007,0.007],[1.522,1.160,1.120,0.978,0.682,1.001],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.061,0.006,0.006,0.006,0.006,0.006],[0.006,0.018,0.006,0.006,0.019,0.006],[0.006,0.006,0.005,0.007,0.006,0.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.007,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.008],[0.006,0.006,0.006,0.006,0.006,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.391,1.216,0.843,1.327,0.976,0.978],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.4.4.113","source":"results/24.4.4.113.json"} +,{"actual_version":"24.5.8.10","data_size":{"coffeeshop":44638920832,"hits":14249057759,"job":1828094510,"mgbench":2960194516,"ontime":2699155844,"ssb":73313734826,"taxi":24223702523,"tpcds":18798762599,"tpch":17231923450,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":843,"hits":236,"job":16,"mgbench":79,"ontime":69,"ssb":1627,"taxi":627,"tpcds":272,"tpch":306,"uk":35},"machine":"c7a.4xlarge","release_date":"2024-09-06","result":[[0.068,0.011,0.009,0.293,0.010,0.010],[0.044,0.018,0.016,0.025,0.019,0.018],[0.042,0.019,0.012,0.072,0.012,0.012],[0.038,0.012,0.013,0.027,0.012,0.012],[0.046,0.029,0.029,0.050,0.023,0.023],[0.065,0.017,0.022,0.040,0.018,0.020],[0.022,0.008,0.007,0.007,0.007,0.007],[0.045,0.016,0.016,0.015,0.015,0.015],[0.072,0.037,0.034,0.061,0.033,0.033],[0.096,0.059,0.058,0.059,0.060,0.056],[0.481,0.426,0.375,0.421,0.419,0.402],[0.387,0.264,0.294,0.274,0.254,0.252],[0.028,0.019,0.007,0.007,0.007,0.007],[0.042,0.020,0.027,0.024,0.022,0.016],[0.747,0.650,0.636,0.765,0.616,0.617],[0.506,0.133,0.144,0.133,0.129,0.137],[0.047,0.015,0.017,0.014,0.015,0.013],[0.044,0.013,0.013,0.012,0.013,0.012],[6.469,1.439,1.423,1.431,1.426,1.446],[4.766,1.108,1.101,1.091,1.106,1.115],[4.798,1.137,1.130,1.139,1.139,1.149],[5.366,1.916,1.912,1.914,1.920,1.912],[6.263,1.616,1.649,1.600,1.612,1.615],[3.981,1.043,1.049,1.046,1.037,1.033],[0.067,0.026,0.025,0.025,0.025,0.026],[7.914,2.146,2.119,2.120,2.117,2.124],[1.868,0.762,0.761,0.762,0.762,0.769],[1.943,0.572,0.565,0.582,0.563,0.586],[0.002,0.002,0.002,0.002,0.002,0.002],[0.024,0.010,0.008,0.009,0.009,0.009],[0.054,0.018,0.017,0.044,0.022,0.017],[0.136,0.030,0.025,0.026,0.028,0.024],[0.170,0.063,0.061,0.064,0.063,0.059],[0.322,0.149,0.146,0.146,0.145,0.147],[0.004,0.003,0.003,0.035,0.003,0.004],[0.022,0.014,0.011,0.011,0.010,0.011],[0.412,0.255,0.271,0.253,0.252,0.251],[0.477,0.300,0.292,0.290,0.290,0.296],[0.232,0.112,0.113,0.119,0.112,0.117],[0.251,0.132,0.131,0.131,0.132,0.131],[0.554,0.326,0.316,0.319,0.318,0.321],[0.766,0.474,0.465,0.466,0.458,0.470],[0.699,0.483,0.475,0.475,0.456,0.460],[0.446,0.276,0.270,0.265,0.273,0.263],[1.453,1.077,1.054,1.116,1.065,1.052],[0.977,0.702,0.687,0.693,0.683,0.696],[3.059,2.153,2.173,2.204,2.171,2.212],[0.142,0.037,0.025,0.025,0.022,0.023],[1.574,0.391,0.407,0.385,0.421,0.397],[1.740,0.422,0.426,0.452,0.427,0.437],[3.949,1.114,1.095,1.124,1.112,1.099],[2.059,0.482,0.509,0.463,0.468,0.511],[0.465,0.144,0.146,0.143,0.143,0.139],[0.268,0.098,0.099,0.099,0.101,0.097],[0.455,0.141,0.138,0.143,0.145,0.143],[1.556,0.421,0.425,0.451,0.422,0.427],[1.565,0.637,0.643,0.635,0.645,0.645],[0.060,0.028,0.028,0.044,0.026,0.026],[0.548,0.276,0.276,0.307,0.277,0.260],[0.991,0.369,0.361,0.357,0.355,0.352],[2.289,1.520,1.633,1.855,1.718,1.688],[3.056,1.829,1.762,1.779,1.749,1.789],[3.043,1.796,1.797,1.794,1.785,1.769],[0.359,0.233,0.224,0.220,0.240,0.223],[0.116,0.043,0.030,0.031,0.034,0.031],[0.044,0.025,0.031,0.024,0.022,0.038],[0.046,0.017,0.018,0.016,0.021,0.020],[0.098,0.060,0.052,0.051,0.050,0.051],[0.023,0.011,0.007,0.010,0.009,0.010],[0.018,0.008,0.007,0.009,0.010,0.008],[0.013,0.005,0.005,0.005,0.005,0.005],[0.364,0.052,0.046,0.075,0.047,0.046],[0.318,0.072,0.075,0.069,0.067,0.069],[0.107,0.043,0.041,0.062,0.041,0.037],[0.233,0.076,0.074,0.097,0.071,0.073],[0.081,0.034,0.034,0.035,0.034,0.033],[0.170,0.075,0.073,0.074,0.072,0.070],[0.191,0.095,0.096,0.097,0.096,0.094],[0.058,0.034,0.036,0.037,0.035,0.035],[0.097,0.063,0.071,0.063,0.064,0.062],[0.259,0.166,0.163,0.167,0.163,0.161],[0.448,0.187,0.183,0.184,0.188,0.181],[0.408,0.301,0.301,0.313,0.298,0.304],[0.138,0.046,0.044,0.043,0.043,0.042],[0.628,0.347,0.338,0.362,0.329,0.334],[2.963,2.411,2.406,2.393,2.410,2.407],[8.660,1.220,1.175,1.230,1.192,1.196],[2.282,1.294,1.279,1.293,1.272,1.281],[12.895,3.030,3.063,3.056,3.028,3.029],[4.273,3.347,3.349,3.343,3.316,3.334],[4.066,2.020,1.990,2.000,1.993,1.982],[4.325,4.075,4.142,4.141,4.134,4.135],[null,null,null,null,null,null],[3.542,3.282,3.265,3.308,3.262,3.265],[null,null,null,null,null,null],[5.273,4.951,4.989,5.028,4.995,4.979],[null,null,null,null,null,null],[3.494,3.233,3.232,3.245,3.223,3.205],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.704,0.786,0.788,0.584,0.517,0.523],[null,null,null,null,null,null],[16.979,17.067,16.269,14.740,16.614,16.742],[null,null,null,null,null,null],[28.304,28.356,27.849,28.067,27.561,28.357],[0.231,0.117,0.102,0.099,0.098,0.099],[20.672,20.808,19.262,21.686,21.640,20.001],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.599,8.730,7.601,7.691,7.463,8.495],[0.539,0.348,0.387,0.381,0.419,0.401],[1.160,0.582,0.576,0.523,0.514,0.569],[8.860,8.618,8.744,8.604,8.797,8.650],[0.809,0.740,0.756,0.849,0.744,0.574],[0.230,0.112,0.131,0.133,0.109,0.108],[0.489,0.368,0.376,0.365,0.369,0.366],[null,null,null,null,null,null],[3.081,2.215,2.196,2.176,2.177,2.215],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.071,0.805,0.643,0.647,0.653,0.653],[4.047,4.039,3.995,4.016,4.028,3.978],[55.266,55.587,56.275,55.668,55.472,55.910],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.250,0.444,0.449,0.474,0.454,0.443],[1.050,0.621,0.625,0.622,0.619,0.635],[1.446,1.040,1.033,1.037,1.041,1.035],[null,null,null,null,null,null],[31.950,32.251,31.806,32.188,32.181,32.119],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.896,0.609,0.629,0.611,0.613,0.596],[null,null,null,null,null,null],[14.497,12.400,12.622,12.868,12.960,13.562],[null,null,null,null,null,null],[3.439,3.249,3.224,3.259,3.110,3.158],[null,null,null,null,null,null],[0.320,0.130,0.117,0.151,0.124,0.134],[0.268,0.169,0.165,0.166,0.163,0.157],[6.585,5.433,5.525,5.438,5.456,5.480],[6.978,5.945,6.067,5.997,5.905,5.987],[5.770,4.447,5.457,5.280,5.145,5.150],[5.137,4.729,3.959,5.402,5.385,5.457],[14.419,13.357,8.420,13.669,11.243,12.341],[0.786,0.637,0.237,0.234,0.233,0.230],[null,null,null,null,null,null],[1.636,1.124,1.119,1.104,1.116,1.100],[14.191,12.855,13.830,11.256,12.447,11.530],[null,null,null,null,null,null],[2.102,1.141,1.128,1.072,1.148,1.110],[null,null,null,null,null,null],[0.981,0.350,0.337,0.335,0.336,0.341],[1.141,0.413,0.416,0.408,0.407,0.401],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.385,1.308,1.138,1.196,1.038,1.061],[1.152,0.695,0.685,0.670,0.683,0.673],[0.864,0.734,0.685,0.680,0.701,0.690],[0.798,0.687,0.719,0.681,0.697,0.694],[1.585,1.219,1.226,1.232,1.227,1.216],[null,null,null,null,null,null],[2.447,2.542,2.361,2.447,2.467,2.398],[5.393,5.753,5.649,5.717,5.708,5.675],[0.045,0.120,0.027,0.035,0.017,0.030],[0.649,0.402,0.389,0.408,0.400,0.391],[1.821,0.709,0.698,0.684,0.653,0.707],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.564,3.368,3.357,3.908,3.377,3.940],[2.799,2.319,2.297,2.357,2.305,2.278],[2.516,2.540,2.565,2.530,2.439,2.289],[1.659,1.638,1.871,1.660,1.709,1.613],[11.113,10.690,10.641,10.709,10.714,10.889],[2.539,2.405,2.420,2.379,2.391,2.403],[1.089,0.367,0.354,0.369,0.365,0.394],[null,null,null,null,null,null],[0.978,0.425,0.439,0.434,0.435,0.430],[1.592,1.200,1.221,1.196,1.210,1.196],[1.071,0.381,0.386,0.380,0.391,0.390],[1.883,1.071,1.071,1.075,1.083,1.077],[0.419,0.245,0.249,0.246,0.246,0.277],[1.787,1.695,1.676,1.662,1.546,1.659],[null,null,null,null,null,null],[48.738,48.635,50.204,50.645,49.433,57.340],[1.571,0.931,0.828,0.956,0.828,0.851],[null,null,null,null,null,null],[2.384,0.632,0.625,0.637,0.630,0.659],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.050,0.332,0.327,0.329,0.320,0.323],[null,null,null,null,null,null],[1.060,0.364,0.361,0.345,0.360,0.371],[27.648,27.340,27.004,27.006,27.048,27.083],[null,null,null,null,null,null],[0.031,0.027,0.009,0.030,0.014,0.040],[1.587,0.384,0.388,0.375,0.373,0.369],[0.020,0.042,0.016,0.022,0.025,0.018],[null,null,null,null,null,null],[4.748,3.267,2.962,3.285,2.267,2.910],[null,null,null,null,null,null],[2.029,1.740,1.724,1.677,1.840,1.624],[0.243,0.120,0.127,0.119,0.111,0.126],[1.176,1.083,1.176,1.063,0.994,1.080],[1.570,1.294,1.275,0.932,1.218,1.193],[null,null,null,null,null,null],[1.163,0.690,0.691,0.683,0.689,0.676],[2.574,2.176,2.180,2.170,2.180,2.156],[2.083,1.925,2.034,1.811,2.001,1.870],[0.294,0.111,0.115,0.122,0.120,0.104],[0.506,0.504,0.502,0.471,0.466,0.490],[null,null,null,null,null,null],[3.105,2.055,2.867,2.446,2.743,2.403],[null,null,null,null,null,null],[16.947,16.644,16.771,16.755,17.071,17.049],[0.571,0.177,0.185,0.179,0.180,0.178],[3.665,2.536,3.454,3.191,3.436,3.486],[null,null,null,null,null,null],[0.757,0.429,0.434,0.436,0.435,0.435],[0.906,0.838,0.746,0.475,0.432,0.720],[0.522,0.603,0.539,0.411,0.597,0.304],[0.335,0.244,0.245,0.278,0.214,0.230],[0.532,0.597,0.506,0.489,0.435,0.485],[1.560,1.550,0.696,1.127,1.377,1.458],[1.223,1.478,1.456,0.800,1.458,1.514],[1.467,1.457,1.473,1.191,1.468,1.169],[null,null,null,null,null,null],[1.671,1.363,1.374,1.352,1.302,1.231],[1.299,0.898,0.914,0.979,0.873,0.892],[2.860,2.407,2.515,2.503,2.550,2.447],[2.038,1.773,1.855,1.802,1.906,1.829],[1.001,0.798,0.817,0.513,0.784,0.791],[1.847,2.564,2.094,2.185,2.057,2.136],[0.667,0.362,0.306,0.214,0.301,0.301],[0.549,0.275,0.218,0.220,0.188,0.168],[0.705,0.425,0.360,0.265,0.418,0.335],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[10.234,10.165,11.004,10.717,11.830,10.912],[11.197,11.221,11.987,10.747,11.604,12.013],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.883,0.809,0.771,0.801,0.849,0.833],[1.582,1.457,1.438,1.034,1.525,1.454],[0.063,0.006,0.023,0.006,0.007,0.006],[0.006,0.006,0.005,0.005,0.005,0.008],[1.781,1.307,1.264,1.594,1.303,1.588],[null,null,null,null,null,null],[0.833,0.417,0.446,0.393,0.345,0.396],[3.344,2.788,2.904,2.719,2.553,2.593],[0.946,0.547,0.597,0.601,0.538,0.532],[3.650,3.114,3.295,2.606,2.944,2.600],[2.546,2.808,2.788,2.597,2.626,1.754],[2.597,2.725,2.706,2.896,2.802,2.465],[3.512,2.955,2.348,3.389,2.884,2.927],[1.882,1.117,1.523,1.534,1.523,1.445],[1.496,1.133,0.616,0.661,1.121,1.080],[2.316,1.982,1.960,1.905,1.885,1.972],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.019,4.121,4.301,3.907,4.243,4.109],[0.006,0.013,0.006,0.015,0.101,0.006],[1.940,1.555,1.452,1.443,1.481,1.521],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.065,0.006,0.006,0.006,0.022,0.007],[0.006,0.006,0.006,0.013,0.007,0.006],[0.007,0.018,0.006,0.006,0.006,0.019],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.007,0.010,0.007,0.006,0.006,0.006],[0.006,0.009,0.006,0.007,0.006,0.006],[0.007,0.007,0.007,0.007,0.006,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.482,1.355,0.929,1.310,0.659,1.102],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.5.8.10","source":"results/24.5.8.10.json"} +,{"actual_version":"24.6.6.6","data_size":{"coffeeshop":44648955392,"hits":14265472667,"job":1828094510,"mgbench":2954107754,"ontime":2699155844,"ssb":73313490999,"taxi":24223834213,"tpcds":18795486985,"tpch":17232992826,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":926,"hits":223,"job":20,"mgbench":71,"ontime":61,"ssb":1461,"taxi":533,"tpcds":297,"tpch":289,"uk":30},"machine":"c7a.4xlarge","release_date":"2024-09-06","result":[[0.084,0.010,0.009,0.370,0.009,0.008],[0.051,0.015,0.015,0.017,0.014,0.015],[0.045,0.019,0.011,0.067,0.016,0.011],[0.038,0.011,0.011,0.029,0.012,0.011],[0.052,0.021,0.019,0.047,0.021,0.020],[0.070,0.015,0.016,0.039,0.018,0.015],[0.027,0.007,0.006,0.007,0.006,0.007],[0.046,0.013,0.014,0.013,0.014,0.013],[0.072,0.028,0.028,0.056,0.027,0.027],[0.089,0.055,0.050,0.049,0.049,0.053],[0.441,0.369,0.304,0.366,0.358,0.373],[0.365,0.217,0.269,0.250,0.215,0.218],[0.037,0.007,0.007,0.015,0.007,0.007],[0.038,0.022,0.018,0.013,0.014,0.013],[0.675,0.538,0.549,0.635,0.531,0.516],[0.545,0.112,0.107,0.119,0.108,0.106],[0.049,0.012,0.015,0.014,0.012,0.012],[0.051,0.011,0.011,0.012,0.012,0.012],[6.461,1.226,1.221,1.245,1.212,1.220],[4.772,0.904,0.923,0.910,0.909,0.907],[4.807,0.944,0.942,0.936,0.941,0.942],[5.385,1.600,1.585,1.587,1.586,1.596],[6.255,1.343,1.336,1.376,1.336,1.358],[3.973,0.790,0.797,0.782,0.781,0.795],[0.067,0.022,0.027,0.022,0.021,0.020],[7.884,1.816,1.805,1.826,1.802,1.807],[1.855,0.649,0.649,0.644,0.654,0.646],[1.938,0.487,0.475,0.483,0.477,0.491],[0.003,0.002,0.002,0.002,0.002,0.002],[0.031,0.008,0.008,0.007,0.008,0.008],[0.057,0.015,0.017,0.040,0.017,0.016],[0.144,0.022,0.021,0.020,0.020,0.020],[0.170,0.056,0.051,0.051,0.051,0.054],[0.316,0.128,0.124,0.123,0.124,0.130],[0.004,0.002,0.002,0.032,0.003,0.002],[0.025,0.011,0.009,0.010,0.009,0.009],[0.388,0.241,0.228,0.223,0.222,0.222],[0.443,0.264,0.267,0.261,0.258,0.258],[0.196,0.065,0.067,0.065,0.065,0.065],[0.209,0.081,0.082,0.081,0.080,0.083],[0.517,0.280,0.275,0.291,0.275,0.283],[0.697,0.405,0.394,0.378,0.383,0.390],[0.623,0.408,0.404,0.441,0.414,0.407],[0.406,0.248,0.238,0.250,0.232,0.238],[1.320,0.962,0.964,0.964,0.948,0.957],[0.934,0.650,0.618,0.626,0.621,0.618],[2.828,1.954,1.989,2.031,1.990,1.988],[0.145,0.022,0.020,0.026,0.021,0.021],[1.593,0.314,0.341,0.314,0.309,0.339],[1.773,0.356,0.345,0.369,0.349,0.381],[3.950,0.938,0.936,0.947,0.917,0.931],[2.152,0.388,0.395,0.388,0.381,0.420],[0.438,0.107,0.110,0.104,0.105,0.103],[0.262,0.083,0.083,0.083,0.086,0.080],[0.437,0.107,0.102,0.102,0.101,0.106],[1.560,0.340,0.342,0.368,0.345,0.360],[1.513,0.528,0.539,0.522,0.536,0.531],[0.063,0.023,0.023,0.043,0.022,0.022],[0.533,0.243,0.235,0.253,0.225,0.262],[0.956,0.311,0.306,0.311,0.318,0.312],[2.192,1.612,1.595,1.621,1.574,1.571],[2.880,1.669,1.578,1.577,1.580,1.589],[2.886,1.623,1.568,1.576,1.602,1.573],[0.325,0.186,0.208,0.196,0.210,0.187],[0.124,0.066,0.067,0.074,0.086,0.071],[0.055,0.032,0.028,0.027,0.035,0.029],[0.083,0.032,0.027,0.026,0.026,0.028],[0.261,0.123,0.157,0.146,0.146,0.128],[0.034,0.021,0.011,0.007,0.007,0.007],[0.032,0.009,0.013,0.007,0.008,0.008],[0.017,0.006,0.004,0.007,0.005,0.004],[0.412,0.039,0.041,0.057,0.037,0.038],[0.359,0.057,0.056,0.055,0.054,0.053],[0.108,0.035,0.034,0.053,0.033,0.033],[0.254,0.059,0.060,0.079,0.064,0.065],[0.086,0.031,0.030,0.030,0.031,0.030],[0.187,0.063,0.063,0.067,0.064,0.062],[0.207,0.083,0.081,0.081,0.087,0.081],[0.063,0.032,0.031,0.031,0.031,0.030],[0.099,0.057,0.055,0.054,0.061,0.054],[0.260,0.143,0.141,0.141,0.143,0.141],[0.485,0.158,0.154,0.150,0.161,0.152],[0.392,0.258,0.255,0.263,0.254,0.256],[0.152,0.039,0.034,0.035,0.035,0.034],[0.639,0.287,0.285,0.313,0.284,0.279],[2.789,2.043,2.043,2.048,2.039,2.031],[8.686,0.997,1.020,1.018,1.014,0.994],[2.282,1.078,1.084,1.078,1.092,1.078],[12.878,2.572,2.584,2.597,2.564,2.584],[4.267,2.809,2.803,2.825,2.789,2.785],[4.067,1.688,1.677,1.678,1.685,1.683],[3.565,3.336,3.330,3.351,3.332,3.324],[null,null,null,null,null,null],[3.303,2.733,2.735,2.761,2.723,2.733],[null,null,null,null,null,null],[4.327,4.033,3.998,4.027,4.009,4.003],[null,null,null,null,null,null],[2.990,2.680,2.680,2.676,2.692,2.684],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.716,0.680,0.671,0.497,0.439,0.440],[null,null,null,null,null,null],[16.132,15.487,15.850,16.054,15.720,15.839],[null,null,null,null,null,null],[27.130,26.634,26.993,27.201,27.505,25.711],[0.226,0.068,0.067,0.068,0.067,0.067],[20.761,20.342,17.735,20.744,19.774,20.494],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.463,7.990,7.853,7.726,8.181,8.265],[0.502,0.331,0.316,0.404,0.309,0.336],[1.246,0.513,0.505,0.526,0.496,0.482],[8.399,8.124,8.395,8.400,8.200,8.107],[0.761,0.752,0.760,0.769,0.517,0.472],[0.228,0.117,0.098,0.119,0.100,0.096],[0.466,0.324,0.255,0.322,0.326,0.331],[null,null,null,null,null,null],[2.984,1.962,1.981,1.965,1.985,1.958],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.956,0.673,0.545,0.540,0.539,0.535],[3.850,3.768,3.782,3.693,3.836,3.829],[52.170,52.651,52.522,52.596,53.002,52.713],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.642,0.375,0.382,0.412,0.368,0.367],[0.972,0.517,0.509,0.514,0.517,0.514],[1.328,0.903,0.897,0.904,0.908,0.920],[null,null,null,null,null,null],[30.111,29.799,30.023,30.172,30.309,30.154],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.874,0.509,0.531,0.544,0.547,0.501],[null,null,null,null,null,null],[13.801,10.836,12.637,13.337,11.821,12.954],[null,null,null,null,null,null],[3.039,3.023,2.869,2.955,2.749,3.133],[null,null,null,null,null,null],[0.254,0.101,0.104,0.129,0.100,0.103],[0.251,0.147,0.142,0.135,0.132,0.132],[6.127,5.089,4.966,4.996,4.983,5.259],[6.499,5.422,5.350,5.373,5.408,5.471],[6.031,4.191,4.742,5.020,4.279,4.414],[5.629,4.749,5.212,4.385,4.764,3.869],[13.747,8.302,8.794,12.457,11.180,13.188],[0.792,0.420,0.197,0.197,0.196,0.198],[null,null,null,null,null,null],[1.469,0.917,0.918,0.914,0.918,0.916],[12.503,11.989,12.675,12.927,12.035,11.740],[null,null,null,null,null,null],[1.682,0.960,0.972,0.950,0.931,0.947],[null,null,null,null,null,null],[1.014,0.278,0.283,0.283,0.275,0.282],[1.149,0.353,0.347,0.349,0.342,0.343],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.274,1.240,1.214,0.999,1.005,1.131],[1.090,0.564,0.604,0.587,0.569,0.567],[0.764,0.648,0.633,0.650,0.628,0.620],[0.734,0.634,0.618,0.648,0.613,0.617],[1.494,0.742,1.122,0.865,1.113,0.740],[null,null,null,null,null,null],[2.332,2.332,2.368,2.169,2.342,2.310],[5.272,5.250,5.422,5.395,5.377,5.263],[0.039,0.038,0.046,0.031,0.024,0.029],[0.598,0.345,0.369,0.378,0.349,0.337],[1.831,0.603,0.597,0.599,0.604,0.609],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.353,3.084,3.659,3.151,3.616,3.171],[2.722,2.110,2.082,2.145,2.105,2.112],[2.342,2.335,2.324,2.155,2.094,2.346],[1.537,1.196,1.508,1.498,1.251,1.377],[10.537,9.985,10.282,10.260,10.086,9.978],[2.127,2.335,2.365,2.349,2.124,2.172],[1.186,0.313,0.310,0.315,0.306,0.322],[null,null,null,null,null,null],[0.944,0.355,0.343,0.346,0.346,0.349],[1.458,1.048,1.039,1.046,1.058,1.034],[1.093,0.319,0.330,0.326,0.330,0.352],[1.842,0.926,0.914,0.946,0.918,0.948],[0.420,0.219,0.204,0.202,0.203,0.207],[1.634,1.542,1.311,1.546,1.565,1.426],[null,null,null,null,null,null],[23.908,23.543,23.417,23.858,23.586,23.357],[1.505,0.768,0.684,0.805,0.694,0.682],[null,null,null,null,null,null],[2.381,0.571,0.568,0.539,0.540,0.553],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.071,0.280,0.271,0.274,0.271,0.269],[null,null,null,null,null,null],[1.054,0.305,0.305,0.308,0.304,0.304],[26.113,25.861,25.989,25.851,25.859,25.583],[null,null,null,null,null,null],[0.014,0.021,0.011,0.028,0.016,0.008],[1.621,0.323,0.317,0.309,0.307,0.324],[0.015,0.037,0.016,0.015,0.015,0.015],[null,null,null,null,null,null],[4.592,2.905,2.635,2.991,2.227,2.412],[null,null,null,null,null,null],[1.738,1.746,1.572,1.685,1.480,1.525],[0.229,0.100,0.090,0.095,0.095,0.099],[1.111,1.023,1.073,0.937,1.001,0.871],[1.486,1.188,1.195,1.211,1.014,1.083],[null,null,null,null,null,null],[1.104,0.591,0.592,0.567,0.594,0.545],[2.287,1.827,1.831,1.837,1.830,1.827],[1.886,1.808,1.988,1.384,2.138,1.901],[0.245,0.085,0.083,0.097,0.091,0.103],[0.568,0.466,0.447,0.431,0.466,0.411],[null,null,null,null,null,null],[3.330,2.215,2.291,2.529,2.627,2.518],[null,null,null,null,null,null],[16.728,16.051,16.168,16.151,16.126,16.341],[0.587,0.155,0.146,0.147,0.152,0.149],[3.782,3.318,3.245,3.273,3.329,3.256],[null,null,null,null,null,null],[0.695,0.358,0.361,0.360,0.360,0.357],[0.867,0.615,0.515,0.745,0.802,0.310],[0.495,0.489,0.459,0.483,0.468,0.524],[0.309,0.132,0.250,0.132,0.215,0.195],[0.590,0.551,0.529,0.483,0.480,0.408],[1.438,1.396,1.457,1.206,1.261,1.155],[1.004,1.003,1.292,1.459,1.291,1.392],[1.420,1.026,1.198,1.383,1.342,1.367],[null,null,null,null,null,null],[1.629,1.338,1.260,1.160,1.291,1.331],[1.361,0.819,0.859,0.477,0.909,0.839],[2.813,2.328,2.334,2.262,2.363,2.592],[1.818,1.819,1.753,1.460,1.764,1.765],[0.842,0.363,0.768,0.802,0.372,0.855],[2.115,1.967,1.954,1.970,2.423,1.975],[0.756,0.277,0.326,0.269,0.263,0.279],[0.586,0.200,0.243,0.143,0.228,0.204],[0.767,0.388,0.354,0.365,0.277,0.384],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.015,1.837,1.868,1.783,1.636,1.718],[2.790,2.503,2.490,2.459,2.439,2.422],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.807,0.631,0.727,0.354,0.744,0.784],[1.305,1.274,1.216,1.208,1.260,1.221],[0.009,0.005,0.005,0.005,0.016,0.005],[0.008,0.006,0.012,0.005,0.005,0.006],[1.604,1.440,1.469,1.466,1.586,1.141],[null,null,null,null,null,null],[0.787,0.345,0.355,0.379,0.343,0.308],[2.712,2.592,2.605,2.539,2.299,2.617],[0.902,0.507,0.489,0.451,0.468,0.484],[3.426,3.144,2.162,2.741,2.793,2.932],[2.264,2.246,2.502,1.956,2.091,2.600],[2.441,2.478,1.555,2.154,2.628,1.463],[3.388,3.026,3.022,2.824,2.517,3.048],[1.547,1.457,1.469,1.405,1.413,1.399],[1.493,0.928,0.955,0.985,0.991,0.990],[2.269,1.860,1.747,1.740,1.735,2.072],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.626,3.190,3.066,2.883,2.758,2.794],[0.014,0.009,0.110,0.009,0.007,0.115],[1.565,0.989,0.961,1.074,0.949,1.035],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.007,0.011,0.005,0.006,0.005,0.006],[0.005,0.005,0.005,0.005,0.006,0.005],[0.007,0.006,0.006,0.006,0.005,0.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.006,0.006,0.005],[0.006,0.006,0.007,0.024,0.006,0.006],[0.006,0.005,0.005,0.005,0.005,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.356,1.175,0.877,0.851,1.215,1.113],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.6.6.6","source":"results/24.6.6.6.json"} +,{"actual_version":"24.7.6.8","data_size":{"coffeeshop":44632765287,"hits":14260278091,"job":1828094510,"mgbench":2954107754,"ontime":2699155844,"ssb":73314489678,"taxi":24223708214,"tpcds":18786480594,"tpch":17232594057,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":840,"hits":222,"job":22,"mgbench":74,"ontime":61,"ssb":1506,"taxi":560,"tpcds":294,"tpch":301,"uk":31},"machine":"c7a.4xlarge","release_date":"2024-09-06","result":[[0.088,0.009,0.008,0.342,0.010,0.009],[0.051,0.015,0.016,0.014,0.015,0.014],[0.045,0.018,0.010,0.064,0.010,0.010],[0.041,0.011,0.010,0.024,0.011,0.012],[0.050,0.020,0.025,0.046,0.019,0.020],[0.070,0.019,0.015,0.036,0.015,0.016],[0.024,0.006,0.006,0.007,0.006,0.006],[0.051,0.013,0.013,0.013,0.014,0.013],[0.078,0.030,0.036,0.054,0.029,0.030],[0.092,0.057,0.057,0.058,0.052,0.051],[0.452,0.382,0.371,0.372,0.313,0.367],[0.364,0.230,0.285,0.248,0.224,0.217],[0.030,0.008,0.007,0.007,0.007,0.007],[0.030,0.014,0.015,0.013,0.012,0.013],[0.716,0.596,0.605,0.694,0.563,0.577],[0.569,0.114,0.113,0.115,0.115,0.114],[0.047,0.012,0.012,0.012,0.013,0.013],[0.042,0.011,0.011,0.011,0.011,0.011],[6.458,1.354,1.363,1.393,1.367,1.325],[4.767,1.026,1.010,1.034,1.013,1.009],[4.788,1.037,1.025,1.039,1.015,1.017],[5.360,1.740,1.694,1.675,1.685,1.690],[6.253,1.456,1.470,1.447,1.450,1.444],[3.984,0.849,0.843,0.856,0.854,0.849],[0.063,0.023,0.020,0.021,0.021,0.021],[7.895,1.915,1.910,1.958,1.961,1.909],[1.903,0.681,0.685,0.686,0.683,0.689],[1.930,0.508,0.519,0.506,0.506,0.517],[0.002,0.002,0.002,0.002,0.002,0.002],[0.025,0.008,0.008,0.008,0.007,0.008],[0.058,0.016,0.017,0.040,0.016,0.016],[0.156,0.021,0.021,0.022,0.021,0.021],[0.184,0.056,0.060,0.056,0.055,0.057],[0.333,0.131,0.138,0.135,0.130,0.130],[0.003,0.002,0.002,0.031,0.002,0.002],[0.023,0.009,0.009,0.010,0.009,0.009],[0.401,0.235,0.232,0.248,0.238,0.232],[0.447,0.279,0.269,0.268,0.267,0.275],[0.201,0.068,0.068,0.069,0.069,0.070],[0.221,0.088,0.087,0.086,0.087,0.086],[0.518,0.288,0.280,0.278,0.286,0.279],[0.708,0.416,0.386,0.386,0.384,0.385],[0.615,0.404,0.385,0.381,0.401,0.392],[0.403,0.241,0.240,0.233,0.247,0.236],[1.335,0.949,0.949,0.938,0.950,0.951],[0.940,0.630,0.622,0.631,0.619,0.635],[2.888,1.994,1.958,1.963,1.974,1.982],[0.155,0.022,0.020,0.021,0.020,0.020],[1.695,0.354,0.390,0.378,0.372,0.380],[1.813,0.379,0.383,0.385,0.378,0.383],[3.954,0.992,0.993,0.985,0.975,0.969],[2.241,0.439,0.427,0.417,0.472,0.428],[0.480,0.110,0.111,0.108,0.110,0.107],[0.280,0.098,0.085,0.088,0.088,0.092],[0.466,0.116,0.105,0.111,0.107,0.109],[1.661,0.368,0.364,0.396,0.370,0.365],[1.651,0.586,0.590,0.587,0.585,0.581],[0.062,0.023,0.023,0.040,0.024,0.025],[0.528,0.246,0.256,0.260,0.241,0.248],[1.001,0.319,0.318,0.320,0.324,0.314],[2.227,1.452,1.549,1.552,1.552,1.554],[3.001,1.636,1.571,1.566,1.572,1.571],[2.968,1.633,1.580,1.620,1.582,1.594],[0.304,0.225,0.202,0.234,0.209,0.200],[0.054,0.028,0.024,0.024,0.027,0.024],[0.038,0.020,0.019,0.021,0.020,0.019],[0.044,0.015,0.015,0.015,0.015,0.014],[0.097,0.049,0.044,0.042,0.043,0.043],[0.024,0.006,0.006,0.006,0.006,0.006],[0.020,0.006,0.006,0.006,0.006,0.006],[0.014,0.004,0.004,0.004,0.004,0.004],[0.421,0.041,0.041,0.056,0.037,0.039],[0.362,0.056,0.057,0.058,0.055,0.055],[0.110,0.035,0.034,0.056,0.034,0.033],[0.246,0.065,0.065,0.083,0.064,0.072],[0.083,0.031,0.029,0.030,0.030,0.029],[0.181,0.064,0.066,0.065,0.065,0.064],[0.211,0.098,0.086,0.086,0.086,0.087],[0.062,0.032,0.034,0.032,0.031,0.031],[0.108,0.056,0.056,0.055,0.055,0.055],[0.262,0.148,0.149,0.147,0.150,0.149],[0.498,0.167,0.163,0.165,0.164,0.166],[0.399,0.273,0.273,0.269,0.277,0.275],[0.146,0.033,0.033,0.033,0.035,0.033],[0.631,0.307,0.305,0.330,0.294,0.295],[2.839,2.136,2.138,2.168,2.150,2.152],[8.661,1.068,1.074,1.115,1.109,1.074],[2.443,1.141,1.146,1.139,1.156,1.143],[12.876,2.821,2.798,2.750,2.781,2.770],[4.278,2.942,2.907,2.920,2.933,2.945],[4.069,1.804,1.806,1.798,1.795,1.799],[3.798,3.564,3.560,3.587,3.573,3.587],[null,null,null,null,null,null],[3.302,2.956,2.917,2.921,2.852,2.883],[null,null,null,null,null,null],[4.679,4.284,4.264,4.299,4.315,4.278],[null,null,null,null,null,null],[3.192,2.881,2.905,2.910,2.907,2.899],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.724,0.722,0.719,0.553,0.481,0.481],[null,null,null,null,null,null],[17.585,17.353,16.890,17.298,16.868,17.203],[null,null,null,null,null,null],[28.482,28.371,28.109,28.719,27.899,28.184],[0.266,0.086,0.073,0.072,0.074,0.074],[21.514,21.138,21.264,20.621,21.619,20.830],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.048,7.576,7.594,7.501,7.658,7.781],[0.551,0.341,0.352,0.337,0.348,0.334],[1.244,0.510,0.512,0.533,0.510,0.509],[9.403,9.109,8.576,9.298,8.801,9.550],[0.750,0.378,0.704,0.707,0.698,0.698],[0.210,0.095,0.100,0.115,0.113,0.096],[0.466,0.327,0.322,0.329,0.323,0.271],[null,null,null,null,null,null],[3.057,1.926,2.006,1.955,1.943,1.948],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.973,0.708,0.569,0.571,0.570,0.578],[3.875,3.825,3.829,3.600,3.884,3.913],[57.070,57.025,57.966,57.239,57.550,57.457],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.227,0.398,0.392,0.426,0.396,0.399],[0.937,0.547,0.554,0.549,0.543,0.552],[1.411,0.991,0.976,0.990,0.995,0.995],[null,null,null,null,null,null],[33.397,33.300,33.150,34.135,34.101,33.314],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.826,0.527,0.555,0.525,0.532,0.506],[null,null,null,null,null,null],[12.643,11.972,11.730,12.328,9.317,11.979],[null,null,null,null,null,null],[3.153,2.991,3.129,3.018,3.157,3.180],[null,null,null,null,null,null],[0.198,0.101,0.094,0.119,0.099,0.093],[0.243,0.140,0.142,0.141,0.135,0.141],[6.696,5.321,5.272,5.326,5.377,5.263],[6.705,5.759,5.681,5.665,5.658,5.704],[5.240,4.685,4.282,4.710,3.692,3.709],[5.287,4.384,4.636,3.708,4.378,4.340],[13.217,12.526,12.479,11.458,12.080,12.442],[0.862,0.212,0.212,0.212,0.217,0.214],[null,null,null,null,null,null],[1.474,0.981,0.979,0.985,0.983,0.984],[12.756,11.244,12.932,11.749,12.078,11.383],[null,null,null,null,null,null],[1.605,0.947,0.990,0.992,0.978,1.023],[null,null,null,null,null,null],[1.057,0.302,0.301,0.301,0.302,0.305],[1.035,0.366,0.366,0.365,0.363,0.366],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.382,1.196,1.178,1.246,1.184,1.291],[1.121,0.592,0.617,0.611,0.591,0.607],[0.762,0.634,0.611,0.621,0.615,0.609],[0.738,0.613,0.618,0.627,0.628,0.612],[1.509,1.108,0.745,1.128,1.128,1.140],[null,null,null,null,null,null],[2.473,2.352,2.442,2.324,2.391,2.550],[5.329,5.345,5.402,5.425,5.439,5.344],[0.034,0.016,0.027,0.015,0.026,0.019],[0.555,0.365,0.358,0.327,0.334,0.352],[1.740,0.643,0.611,0.614,0.645,0.624],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.774,3.618,3.170,3.659,3.221,2.298],[2.560,2.144,2.130,2.163,2.143,2.101],[2.471,2.476,2.345,2.418,2.509,2.521],[1.717,1.656,1.259,1.719,1.473,1.789],[11.667,11.824,11.815,11.267,11.157,11.906],[2.488,2.458,2.300,2.408,2.480,2.324],[1.050,0.349,0.324,0.315,0.323,0.325],[null,null,null,null,null,null],[0.918,0.379,0.374,0.378,0.370,0.379],[1.464,1.103,1.099,1.100,1.100,1.121],[1.098,0.336,0.335,0.341,0.349,0.345],[1.651,0.957,0.977,0.971,0.989,0.978],[0.423,0.224,0.213,0.223,0.239,0.214],[1.781,1.638,1.605,1.681,1.407,1.585],[null,null,null,null,null,null],[27.030,22.627,22.762,26.834,24.929,23.004],[1.604,0.806,0.722,0.838,0.729,0.730],[null,null,null,null,null,null],[2.362,0.607,0.582,0.583,0.572,0.592],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.064,0.304,0.298,0.301,0.293,0.295],[null,null,null,null,null,null],[0.977,0.310,0.317,0.315,0.315,0.313],[29.235,28.909,29.185,30.066,29.048,28.827],[null,null,null,null,null,null],[0.009,0.008,0.008,0.027,0.008,0.009],[1.569,0.328,0.324,0.322,0.323,0.327],[0.015,0.037,0.014,0.014,0.014,0.014],[null,null,null,null,null,null],[4.152,2.616,2.992,2.628,2.626,2.631],[null,null,null,null,null,null],[2.087,1.623,1.794,1.924,1.699,1.538],[0.184,0.100,0.102,0.089,0.093,0.102],[1.256,1.140,1.132,1.163,1.129,1.157],[1.518,1.145,1.157,1.228,1.141,1.194],[null,null,null,null,null,null],[1.136,0.597,0.586,0.595,0.606,0.612],[2.338,1.932,1.961,1.944,1.938,1.965],[2.019,1.848,1.765,1.721,1.934,1.854],[0.242,0.094,0.097,0.092,0.088,0.090],[0.542,0.455,0.449,0.411,0.462,0.434],[null,null,null,null,null,null],[3.131,1.571,2.245,2.570,2.549,2.189],[null,null,null,null,null,null],[17.169,16.558,16.163,16.360,16.152,16.781],[0.558,0.155,0.151,0.152,0.156,0.153],[3.387,2.953,2.944,2.945,3.290,2.976],[null,null,null,null,null,null],[0.717,0.377,0.376,0.379,0.396,0.377],[0.865,0.695,0.618,0.797,0.794,0.704],[0.606,0.449,0.449,0.539,0.412,0.521],[0.290,0.232,0.211,0.224,0.239,0.220],[0.596,0.545,0.543,0.513,0.456,0.520],[1.447,1.351,1.469,1.386,1.096,1.454],[1.501,1.431,1.427,1.454,1.464,1.367],[1.518,1.436,1.435,1.386,1.441,1.415],[null,null,null,null,null,null],[1.742,1.236,1.239,1.237,1.238,1.237],[1.394,0.861,0.846,0.487,0.895,0.850],[2.815,2.330,2.334,2.315,2.217,2.330],[1.861,1.858,1.727,1.288,1.578,1.726],[0.873,0.754,0.787,0.760,0.762,0.637],[2.105,2.000,2.050,2.025,1.979,1.993],[0.755,0.278,0.200,0.255,0.277,0.249],[0.640,0.211,0.155,0.229,0.205,0.226],[0.804,0.280,0.391,0.306,0.373,0.354],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.045,1.855,1.850,1.927,1.856,1.590],[2.884,2.621,2.603,2.594,2.461,2.646],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.862,0.719,0.727,0.728,0.727,0.678],[1.337,1.216,1.217,1.197,1.185,1.203],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[1.611,1.132,1.506,1.508,1.460,1.119],[null,null,null,null,null,null],[0.861,0.310,0.321,0.340,0.336,0.343],[2.795,2.239,2.291,2.227,2.294,2.662],[1.025,0.481,0.491,0.483,0.461,0.453],[3.288,2.738,2.838,2.797,2.488,2.936],[2.299,2.153,2.242,2.178,2.210,2.200],[2.308,2.587,2.222,2.178,2.444,2.251],[2.932,3.047,3.115,2.822,3.159,2.829],[1.936,1.388,1.377,1.446,1.416,1.389],[1.546,0.965,0.947,0.974,0.956,0.947],[2.334,1.690,1.832,1.725,1.831,1.740],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.668,2.804,3.162,2.709,2.722,2.624],[0.006,0.006,0.006,0.006,0.007,0.006],[1.628,0.969,0.987,0.962,1.059,1.080],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.005,0.005,0.005],[0.006,0.006,0.005,0.005,0.006,0.005],[0.006,0.005,0.006,0.005,0.005,0.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.005,0.005,0.005],[0.006,0.006,0.006,0.005,0.006,0.005],[0.006,0.005,0.006,0.006,0.005,0.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.349,0.979,0.912,0.950,1.256,1.054],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.7.6.8","source":"results/24.7.6.8.json"} +,{"actual_version":"24.9.3.128","data_size":{"coffeeshop":44638557715,"hits":14265270695,"job":1828094510,"mgbench":2954107754,"ontime":2699155844,"ssb":73314512342,"taxi":24223525449,"tpcds":18791231889,"tpch":17238023603,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":820,"hits":224,"job":19,"mgbench":68,"ontime":55,"ssb":1432,"taxi":529,"tpcds":294,"tpch":328,"uk":30},"machine":"c7a.4xlarge","release_date":"2024-11-18","result":[[0.087,0.009,0.009,0.313,0.008,0.008],[0.040,0.016,0.014,0.018,0.014,0.016],[0.045,0.015,0.011,0.067,0.010,0.010],[0.047,0.011,0.011,0.026,0.012,0.012],[0.047,0.020,0.020,0.047,0.022,0.022],[0.073,0.015,0.016,0.034,0.015,0.016],[0.026,0.007,0.007,0.007,0.007,0.007],[0.048,0.013,0.014,0.013,0.013,0.014],[0.077,0.031,0.030,0.063,0.030,0.028],[0.091,0.051,0.052,0.051,0.048,0.048],[0.434,0.360,0.358,0.354,0.347,0.332],[0.367,0.213,0.261,0.239,0.212,0.210],[0.030,0.007,0.007,0.007,0.007,0.007],[0.034,0.013,0.013,0.015,0.013,0.012],[0.674,0.557,0.548,0.664,0.527,0.542],[0.601,0.111,0.115,0.112,0.111,0.110],[0.052,0.013,0.012,0.012,0.012,0.012],[0.047,0.012,0.012,0.012,0.013,0.013],[6.479,1.133,1.133,1.173,1.138,1.130],[4.775,0.884,0.886,0.888,0.890,0.918],[4.797,0.818,0.803,0.816,0.808,0.824],[5.570,1.623,1.618,1.633,1.610,1.625],[6.521,1.373,1.407,1.370,1.366,1.362],[4.256,0.838,0.825,0.837,0.827,0.835],[0.066,0.024,0.020,0.021,0.023,0.023],[7.944,1.790,1.782,1.803,1.775,1.795],[3.457,1.192,1.207,1.201,1.192,1.184],[3.211,0.708,0.718,0.719,0.712,0.722],[0.002,0.002,0.002,0.002,0.002,0.002],[0.025,0.008,0.008,0.008,0.008,0.008],[0.057,0.016,0.015,0.039,0.016,0.015],[0.152,0.021,0.021,0.021,0.020,0.024],[0.174,0.052,0.051,0.052,0.055,0.052],[0.333,0.122,0.125,0.126,0.121,0.121],[0.003,0.002,0.003,0.031,0.002,0.003],[0.021,0.009,0.010,0.009,0.009,0.009],[0.398,0.222,0.229,0.224,0.223,0.224],[0.436,0.260,0.256,0.276,0.260,0.258],[0.201,0.065,0.067,0.067,0.064,0.064],[0.216,0.081,0.084,0.084,0.083,0.082],[0.519,0.283,0.279,0.287,0.289,0.290],[0.733,0.429,0.410,0.416,0.409,0.414],[0.637,0.423,0.404,0.409,0.416,0.384],[0.402,0.231,0.231,0.236,0.227,0.234],[1.389,0.976,0.968,0.977,0.960,0.971],[0.952,0.642,0.622,0.636,0.622,0.630],[2.995,2.021,2.023,2.047,2.035,2.024],[0.151,0.021,0.019,0.021,0.019,0.020],[1.810,0.322,0.353,0.348,0.350,0.363],[1.819,0.330,0.332,0.351,0.357,0.327],[4.025,1.037,1.032,1.049,1.032,1.028],[2.360,0.416,0.392,0.428,0.419,0.426],[0.500,0.100,0.098,0.101,0.106,0.103],[0.293,0.080,0.081,0.080,0.085,0.080],[0.501,0.101,0.109,0.102,0.103,0.103],[1.798,0.341,0.354,0.367,0.338,0.339],[1.656,0.538,0.527,0.534,0.523,0.536],[0.060,0.022,0.021,0.040,0.021,0.021],[0.546,0.255,0.246,0.252,0.231,0.225],[1.052,0.305,0.307,0.302,0.312,0.304],[2.187,1.447,1.505,1.552,1.534,1.523],[3.075,1.652,1.571,1.587,1.591,1.590],[3.087,1.618,1.589,1.584,1.579,1.585],[0.301,0.196,0.202,0.184,0.192,0.187],[0.057,0.028,0.026,0.026,0.025,0.027],[0.037,0.021,0.021,0.020,0.016,0.018],[0.043,0.015,0.014,0.016,0.015,0.014],[0.099,0.052,0.047,0.045,0.047,0.043],[0.022,0.007,0.006,0.006,0.007,0.006],[0.020,0.006,0.006,0.006,0.007,0.006],[0.010,0.004,0.005,0.004,0.004,0.004],[0.400,0.040,0.037,0.057,0.042,0.037],[0.345,0.058,0.054,0.058,0.055,0.060],[0.102,0.035,0.037,0.053,0.038,0.033],[0.232,0.062,0.060,0.079,0.061,0.061],[0.080,0.031,0.030,0.033,0.030,0.029],[0.181,0.063,0.063,0.062,0.064,0.062],[0.209,0.091,0.084,0.082,0.081,0.081],[0.060,0.032,0.031,0.033,0.030,0.031],[0.099,0.055,0.054,0.063,0.054,0.054],[0.259,0.141,0.163,0.152,0.159,0.141],[0.486,0.156,0.155,0.154,0.155,0.156],[0.386,0.257,0.265,0.256,0.256,0.253],[0.140,0.035,0.033,0.034,0.034,0.032],[0.611,0.288,0.287,0.314,0.281,0.282],[2.642,2.025,2.021,2.021,2.019,2.025],[8.685,1.021,1.044,1.046,1.037,1.020],[2.359,1.084,1.073,1.068,1.077,1.072],[12.892,2.588,2.565,2.603,2.598,2.594],[4.283,2.932,2.936,2.964,2.908,2.956],[4.073,1.731,1.709,1.725,1.719,1.724],[3.869,3.532,3.585,3.593,3.666,3.588],[null,null,null,null,null,null],[3.317,2.916,2.932,2.934,2.918,2.916],[null,null,null,null,null,null],[4.870,4.394,4.363,4.417,4.366,4.294],[null,null,null,null,null,null],[3.186,2.816,2.811,2.810,2.850,2.816],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.775,0.681,0.681,0.500,0.451,0.447],[null,null,null,null,null,null],[19.270,19.347,19.117,19.354,18.875,18.711],[null,null,null,null,null,null],[31.473,28.182,31.877,31.568,32.185,31.023],[0.255,0.078,0.068,0.071,0.071,0.072],[21.404,21.649,21.315,21.700,20.888,21.865],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.566,9.497,9.142,8.595,9.389,8.728],[0.514,0.331,0.312,0.314,0.302,0.332],[1.729,0.668,0.667,0.683,0.667,0.667],[10.362,10.053,9.784,10.441,10.162,10.059],[0.763,0.401,0.742,0.750,0.475,0.720],[0.210,0.118,0.105,0.125,0.099,0.099],[0.487,0.339,0.332,0.335,0.260,0.250],[null,null,null,null,null,null],[3.171,1.978,2.011,2.005,1.946,2.020],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.939,0.680,0.560,0.564,0.560,0.554],[3.482,3.579,3.573,3.442,3.557,3.458],[53.459,53.864,54.703,55.604,55.415,54.919],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.525,0.409,0.384,0.400,0.358,0.370],[0.965,0.482,0.476,0.482,0.468,0.479],[1.417,0.940,0.921,0.928,0.945,0.936],[null,null,null,null,null,null],[33.218,32.866,32.531,33.463,32.899,32.820],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.901,0.560,0.566,0.570,0.570,0.573],[null,null,null,null,null,null],[13.357,13.426,11.915,9.388,9.315,13.318],[null,null,null,null,null,null],[3.286,3.241,2.962,3.155,3.247,2.966],[null,null,null,null,null,null],[0.220,0.103,0.100,0.116,0.100,0.096],[0.265,0.144,0.137,0.136,0.136,0.139],[6.496,5.214,4.978,5.073,5.042,4.987],[6.561,5.456,5.422,5.559,5.413,5.392],[5.403,4.717,5.142,5.000,4.713,4.638],[5.154,4.438,4.920,5.270,4.049,5.170],[14.468,12.950,11.823,12.031,13.279,12.253],[0.826,0.196,0.193,0.198,0.193,0.196],[null,null,null,null,null,null],[1.551,0.920,0.917,0.933,0.925,0.934],[13.668,9.691,12.748,12.956,12.039,9.289],[null,null,null,null,null,null],[1.641,0.937,0.905,0.893,0.947,0.944],[null,null,null,null,null,null],[1.148,0.273,0.277,0.278,0.273,0.276],[1.245,0.340,0.342,0.332,0.346,0.340],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.510,1.288,1.272,1.371,1.333,1.338],[1.161,0.598,0.593,0.581,0.583,0.588],[0.772,0.639,0.617,0.637,0.613,0.630],[0.738,0.615,0.628,0.613,0.618,0.617],[1.501,1.137,1.131,1.141,1.121,1.147],[null,null,null,null,null,null],[2.470,2.313,2.343,2.479,2.598,2.477],[4.951,5.042,4.739,4.966,4.532,4.901],[0.033,0.027,0.025,0.027,0.016,0.014],[0.541,0.357,0.371,0.384,0.333,0.408],[1.945,0.586,0.601,0.582,0.612,0.603],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.633,3.175,2.276,3.661,3.673,3.619],[2.615,2.157,2.137,2.128,2.138,2.121],[2.480,2.520,2.512,2.518,2.433,2.336],[1.690,1.812,1.595,1.704,1.624,1.802],[11.996,11.665,11.645,11.669,11.462,11.722],[2.486,2.515,2.545,2.106,2.572,2.381],[1.206,0.327,0.313,0.305,0.311,0.299],[null,null,null,null,null,null],[0.987,0.381,0.378,0.384,0.369,0.376],[1.520,1.077,1.073,1.059,1.052,1.070],[1.193,0.311,0.310,0.316,0.309,0.315],[1.859,0.926,0.926,0.917,0.913,0.911],[0.435,0.228,0.216,0.213,0.221,0.225],[1.894,1.720,1.782,1.584,1.367,1.802],[null,null,null,null,null,null],[24.509,23.784,25.250,27.085,24.382,25.355],[1.548,0.820,0.713,0.823,0.722,0.718],[null,null,null,null,null,null],[2.449,0.551,0.527,0.554,0.523,0.549],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.225,0.283,0.293,0.283,0.286,0.292],[null,null,null,null,null,null],[1.162,0.299,0.291,0.303,0.302,0.299],[30.266,30.620,30.138,29.264,28.846,28.909],[null,null,null,null,null,null],[0.009,0.009,0.008,0.027,0.009,0.009],[1.641,0.310,0.304,0.307,0.302,0.303],[0.016,0.037,0.015,0.015,0.014,0.014],[null,null,null,null,null,null],[4.398,2.136,2.882,2.894,2.930,2.118],[null,null,null,null,null,null],[2.300,2.171,2.080,2.179,2.116,2.020],[0.195,0.101,0.112,0.096,0.106,0.099],[1.308,1.097,1.225,1.178,1.221,1.221],[1.489,1.146,1.174,1.151,1.145,1.142],[null,null,null,null,null,null],[1.182,0.590,0.579,0.598,0.579,0.581],[2.290,1.799,1.794,1.787,1.795,1.802],[2.115,1.988,2.023,1.824,1.795,1.597],[0.227,0.093,0.081,0.084,0.085,0.082],[0.577,0.531,0.512,0.478,0.499,0.516],[null,null,null,null,null,null],[3.326,2.482,2.545,2.502,2.495,2.518],[null,null,null,null,null,null],[17.337,16.985,16.683,16.697,16.732,16.987],[0.673,0.146,0.145,0.150,0.148,0.143],[3.798,3.208,3.228,3.265,3.267,3.206],[null,null,null,null,null,null],[0.725,0.372,0.378,0.373,0.381,0.375],[0.850,0.798,0.695,0.789,0.711,0.796],[0.581,0.486,0.496,0.506,0.466,0.390],[0.288,0.243,0.219,0.227,0.215,0.218],[0.600,0.531,0.526,0.436,0.521,0.561],[1.516,1.422,1.460,1.452,1.439,1.417],[1.436,1.349,1.437,1.435,1.428,1.392],[1.524,1.452,1.400,1.427,1.395,1.345],[null,null,null,null,null,null],[1.739,1.228,1.217,1.205,1.222,1.189],[1.368,0.850,0.851,0.840,0.874,0.808],[2.720,2.137,1.804,2.176,2.160,2.111],[1.732,1.626,1.608,1.541,1.623,1.671],[0.877,0.761,0.768,0.745,0.744,0.769],[1.979,1.865,1.824,2.120,1.882,1.805],[0.769,0.184,0.274,0.280,0.266,0.271],[0.662,0.230,0.225,0.218,0.198,0.222],[0.814,0.364,0.348,0.304,0.376,0.360],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.151,1.700,1.980,1.946,1.955,1.999],[2.936,2.715,2.697,2.747,2.759,2.764],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.864,0.708,0.690,0.347,0.733,0.354],[1.276,1.187,1.186,1.175,1.181,1.182],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[1.640,1.492,1.455,0.781,1.539,1.476],[null,null,null,null,null,null],[0.831,0.369,0.311,0.348,0.323,0.341],[3.157,2.678,2.323,2.685,2.337,2.344],[1.008,0.484,0.428,0.432,0.503,0.509],[3.659,3.249,2.222,2.779,3.200,2.839],[2.701,2.534,2.308,2.564,2.483,2.636],[2.371,1.650,2.554,2.554,2.200,2.625],[2.991,2.408,3.264,3.206,2.882,2.888],[1.953,1.526,1.271,1.502,1.443,1.364],[1.501,1.041,1.000,0.969,0.966,0.975],[2.307,1.804,1.783,1.815,1.735,1.704],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.720,3.235,3.209,3.224,2.800,3.194],[0.006,0.006,0.006,0.006,0.006,0.006],[1.644,0.933,0.969,1.071,0.971,1.067],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.006,0.005,0.006],[0.006,0.005,0.006,0.006,0.006,0.005],[0.006,0.006,0.005,0.005,0.006,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.422,1.132,1.290,1.354,1.287,1.321],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.9.3.128","source":"results/24.9.3.128.json"} +,{"actual_version":"24.10.4.191","data_size":{"coffeeshop":44632370584,"hits":14283490413,"job":1828094510,"mgbench":2953725996,"ontime":2699155844,"ssb":73313583808,"taxi":24223897790,"tpcds":18791368276,"tpch":17233623594,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":811,"hits":240,"job":23,"mgbench":66,"ontime":62,"ssb":1425,"taxi":533,"tpcds":307,"tpch":285,"uk":30},"machine":"c7a.4xlarge","release_date":"2025-01-14","result":[[0.078,0.010,0.009,0.312,0.009,0.008],[0.036,0.014,0.015,0.015,0.013,0.014],[0.046,0.017,0.012,0.065,0.009,0.011],[0.039,0.010,0.011,0.025,0.010,0.011],[0.045,0.026,0.023,0.046,0.019,0.019],[0.069,0.015,0.016,0.037,0.015,0.015],[0.021,0.006,0.006,0.007,0.007,0.006],[0.046,0.013,0.013,0.013,0.013,0.012],[0.074,0.028,0.028,0.050,0.029,0.028],[0.087,0.055,0.050,0.049,0.050,0.048],[0.423,0.354,0.337,0.359,0.347,0.351],[0.347,0.211,0.255,0.230,0.211,0.206],[0.026,0.007,0.007,0.008,0.008,0.008],[0.028,0.014,0.013,0.012,0.013,0.013],[0.666,0.555,0.542,0.658,0.515,0.521],[0.520,0.112,0.110,0.108,0.106,0.107],[0.042,0.012,0.012,0.012,0.017,0.013],[0.039,0.012,0.011,0.011,0.013,0.011],[6.439,1.203,1.222,1.232,1.218,1.203],[4.750,0.910,0.892,0.896,0.902,0.899],[4.760,0.923,0.928,0.949,0.932,0.942],[5.345,1.588,1.587,1.584,1.595,1.575],[6.247,1.348,1.340,1.331,1.348,1.350],[3.976,0.790,0.793,0.793,0.789,0.784],[0.064,0.021,0.023,0.020,0.020,0.022],[7.868,1.770,1.800,1.794,1.783,1.770],[1.865,0.655,0.636,0.639,0.658,0.636],[1.911,0.470,0.483,0.475,0.477,0.468],[0.002,0.002,0.002,0.002,0.002,0.002],[0.024,0.008,0.007,0.008,0.008,0.007],[0.055,0.017,0.016,0.041,0.018,0.016],[0.139,0.023,0.023,0.020,0.020,0.021],[0.164,0.058,0.053,0.051,0.052,0.052],[0.298,0.151,0.133,0.144,0.125,0.120],[0.004,0.002,0.003,0.033,0.002,0.002],[0.021,0.009,0.009,0.009,0.009,0.009],[0.383,0.223,0.230,0.222,0.225,0.223],[0.425,0.266,0.259,0.258,0.257,0.259],[0.189,0.067,0.066,0.068,0.064,0.064],[0.201,0.082,0.082,0.084,0.082,0.083],[0.491,0.280,0.277,0.289,0.274,0.276],[0.681,0.396,0.391,0.383,0.391,0.393],[0.583,0.389,0.383,0.379,0.393,0.379],[0.378,0.223,0.222,0.221,0.229,0.226],[1.314,0.954,0.944,0.946,0.942,0.933],[0.897,0.624,0.603,0.614,0.597,0.599],[2.849,2.008,1.993,1.999,2.007,2.000],[0.142,0.019,0.019,0.019,0.019,0.022],[1.662,0.312,0.312,0.356,0.345,0.343],[1.855,0.357,0.355,0.367,0.377,0.357],[3.969,0.914,0.927,0.949,0.916,0.925],[2.190,0.388,0.414,0.435,0.388,0.397],[0.437,0.105,0.102,0.103,0.100,0.101],[0.261,0.083,0.081,0.083,0.084,0.078],[0.451,0.101,0.100,0.105,0.107,0.106],[1.666,0.338,0.341,0.361,0.366,0.347],[1.594,0.539,0.547,0.534,0.546,0.537],[0.058,0.021,0.024,0.039,0.022,0.021],[0.524,0.252,0.234,0.263,0.231,0.227],[0.975,0.304,0.304,0.303,0.300,0.303],[2.143,1.505,1.511,1.541,1.537,1.536],[2.964,1.612,1.587,1.548,1.580,1.567],[2.928,1.620,1.563,1.557,1.561,1.580],[0.286,0.182,0.189,0.188,0.176,0.182],[0.112,0.065,0.055,0.062,0.057,0.059],[0.050,0.028,0.030,0.025,0.031,0.028],[0.078,0.025,0.023,0.023,0.023,0.025],[0.235,0.143,0.143,0.110,0.122,0.104],[0.029,0.007,0.007,0.007,0.007,0.007],[0.025,0.006,0.007,0.006,0.006,0.006],[0.015,0.005,0.005,0.005,0.005,0.005],[0.381,0.037,0.039,0.054,0.035,0.037],[0.332,0.053,0.055,0.054,0.052,0.054],[0.101,0.033,0.032,0.053,0.032,0.032],[0.225,0.064,0.063,0.079,0.062,0.061],[0.083,0.031,0.029,0.032,0.030,0.030],[0.176,0.063,0.063,0.062,0.062,0.062],[0.206,0.089,0.080,0.085,0.081,0.082],[0.056,0.031,0.031,0.033,0.031,0.031],[0.101,0.053,0.055,0.063,0.055,0.054],[0.248,0.138,0.141,0.140,0.159,0.139],[0.461,0.153,0.150,0.151,0.156,0.155],[0.376,0.258,0.258,0.259,0.264,0.256],[0.135,0.036,0.037,0.032,0.033,0.038],[0.592,0.288,0.283,0.308,0.279,0.275],[2.659,2.014,2.023,2.020,2.018,2.022],[8.683,1.036,1.010,1.031,0.987,1.017],[2.291,1.073,1.074,1.073,1.084,1.071],[12.884,2.564,2.564,2.542,2.546,2.565],[4.278,2.913,2.929,2.921,2.916,2.889],[4.064,1.684,1.688,1.685,1.695,1.678],[3.694,3.490,3.498,3.494,3.471,3.481],[null,null,null,null,null,null],[3.291,2.870,2.867,2.873,2.853,2.849],[null,null,null,null,null,null],[4.618,4.235,4.224,4.262,4.235,4.227],[null,null,null,null,null,null],[3.128,2.814,2.804,2.839,2.830,2.820],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.712,0.677,0.673,0.496,0.449,0.442],[null,null,null,null,null,null],[18.362,18.421,18.336,18.185,16.998,18.518],[null,null,null,null,null,null],[30.588,30.629,31.724,29.898,30.631,30.333],[0.242,0.069,0.076,0.067,0.071,0.071],[21.195,22.211,22.077,21.569,22.385,20.922],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.916,8.306,8.286,8.237,8.459,8.156],[0.516,0.321,0.308,0.290,0.312,0.332],[1.068,0.447,0.457,0.407,0.461,0.464],[9.549,9.635,9.261,9.274,9.655,9.479],[0.757,0.408,0.625,0.728,0.378,0.713],[0.212,0.120,0.099,0.115,0.096,0.101],[0.486,0.319,0.321,0.250,0.300,0.255],[null,null,null,null,null,null],[2.959,1.893,1.927,1.882,1.935,1.905],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.923,0.681,0.563,0.552,0.554,0.554],[3.445,3.389,3.478,3.482,3.532,3.501],[54.941,54.793,55.464,55.373,55.555,55.931],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.444,0.396,0.385,0.401,0.357,0.353],[0.944,0.493,0.483,0.486,0.474,0.478],[1.382,0.939,0.923,0.921,0.929,0.912],[null,null,null,null,null,null],[33.452,32.780,32.687,32.968,32.976,32.905],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.870,0.568,0.556,0.538,0.500,0.538],[null,null,null,null,null,null],[13.379,11.794,12.111,12.781,12.293,12.164],[null,null,null,null,null,null],[3.198,2.799,3.003,3.091,2.882,3.067],[null,null,null,null,null,null],[0.218,0.102,0.102,0.117,0.099,0.101],[0.245,0.135,0.138,0.139,0.136,0.133],[6.313,4.924,4.912,4.907,4.939,4.916],[6.515,5.383,5.344,5.344,5.386,5.384],[5.687,4.240,4.197,4.832,4.560,4.611],[5.571,4.875,4.841,4.238,4.531,4.611],[12.796,12.787,12.481,11.485,9.207,13.063],[0.821,0.193,0.195,0.195,0.191,0.190],[null,null,null,null,null,null],[1.520,0.919,0.919,0.925,0.926,0.952],[13.226,12.930,12.506,12.154,12.495,8.905],[null,null,null,null,null,null],[1.582,0.923,0.879,0.934,0.914,0.910],[null,null,null,null,null,null],[1.105,0.275,0.273,0.266,0.269,0.273],[1.106,0.342,0.335,0.344,0.324,0.338],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.480,1.326,1.338,1.304,1.380,1.316],[1.104,0.591,0.596,0.597,0.582,0.575],[0.751,0.641,0.611,0.608,0.606,0.648],[0.734,0.608,0.614,0.613,0.611,0.607],[1.471,1.122,1.089,1.110,1.117,1.113],[null,null,null,null,null,null],[2.449,2.460,2.475,2.490,2.404,2.514],[4.706,4.834,4.904,4.811,4.835,4.771],[0.032,0.026,0.016,0.014,0.018,0.015],[0.531,0.343,0.337,0.382,0.363,0.352],[1.831,0.570,0.588,0.571,0.598,0.592],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.782,3.625,3.574,3.649,3.083,3.136],[2.568,2.111,2.098,2.115,2.111,2.112],[2.430,2.393,2.436,2.363,2.353,2.340],[1.759,1.684,1.658,1.747,1.786,1.651],[11.369,11.255,11.193,11.462,11.350,11.385],[2.443,2.475,2.266,2.494,2.537,2.465],[1.134,0.295,0.300,0.294,0.290,0.297],[null,null,null,null,null,null],[0.955,0.370,0.376,0.371,0.372,0.372],[1.518,1.087,1.064,1.062,1.080,1.061],[1.145,0.313,0.309,0.299,0.299,0.303],[1.776,0.904,0.914,0.928,0.913,0.915],[0.406,0.211,0.218,0.214,0.214,0.210],[1.854,1.941,1.735,1.518,1.715,1.762],[null,null,null,null,null,null],[24.240,23.218,23.564,26.705,22.998,24.168],[1.498,0.779,0.695,0.794,0.700,0.690],[null,null,null,null,null,null],[2.377,0.546,0.547,0.533,0.532,0.542],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.140,0.280,0.283,0.277,0.274,0.279],[null,null,null,null,null,null],[1.104,0.298,0.297,0.301,0.295,0.283],[29.054,28.741,28.628,29.033,28.824,28.973],[null,null,null,null,null,null],[0.008,0.009,0.009,0.027,0.008,0.008],[1.574,0.297,0.298,0.296,0.303,0.296],[0.014,0.036,0.014,0.014,0.014,0.014],[null,null,null,null,null,null],[4.629,2.093,2.585,2.909,2.449,2.261],[null,null,null,null,null,null],[2.245,1.993,1.954,2.037,1.898,1.958],[0.185,0.096,0.103,0.096,0.095,0.094],[1.283,1.241,1.207,1.187,1.203,1.130],[1.479,1.154,1.155,1.202,1.093,1.158],[null,null,null,null,null,null],[1.122,0.600,0.607,0.568,0.585,0.586],[2.282,1.803,1.786,1.780,1.810,1.810],[2.091,2.000,1.937,1.954,1.642,1.990],[0.215,0.084,0.079,0.090,0.083,0.078],[0.579,0.631,0.474,0.485,0.622,0.493],[null,null,null,null,null,null],[2.892,2.511,2.186,2.199,2.194,2.165],[null,null,null,null,null,null],[16.975,16.757,16.525,16.609,16.746,16.534],[0.597,0.150,0.145,0.145,0.143,0.143],[3.386,3.207,2.900,2.289,2.903,3.216],[null,null,null,null,null,null],[0.700,0.378,0.377,0.387,0.377,0.378],[0.853,0.767,0.711,0.778,0.786,0.786],[0.559,0.507,0.478,0.436,0.388,0.426],[0.289,0.234,0.239,0.234,0.232,0.210],[0.603,0.542,0.517,0.370,0.570,0.547],[1.454,1.393,1.452,1.502,1.438,1.470],[1.539,1.463,1.444,1.119,1.447,1.421],[1.443,1.419,1.393,1.388,1.041,1.202],[null,null,null,null,null,null],[1.712,1.194,1.213,1.144,1.199,1.201],[1.383,0.899,0.857,0.839,0.474,0.880],[2.619,2.129,2.061,2.182,2.070,2.150],[1.699,1.622,1.629,1.544,1.481,1.668],[0.856,0.764,0.801,0.759,0.741,0.742],[1.943,2.110,1.841,1.861,1.838,1.862],[0.638,0.189,0.275,0.279,0.185,0.268],[0.605,0.190,0.226,0.227,0.204,0.207],[0.751,0.381,0.371,0.368,0.357,0.296],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.126,1.978,1.958,1.889,1.917,2.035],[2.925,2.322,2.801,2.770,2.461,2.669],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.832,0.686,0.744,0.714,0.725,0.711],[1.291,1.200,1.152,1.178,1.170,0.785],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[1.582,1.443,1.177,1.535,1.212,1.480],[null,null,null,null,null,null],[0.887,0.332,0.348,0.311,0.351,0.316],[3.190,2.327,2.366,2.664,2.433,2.731],[0.980,0.485,0.494,0.517,0.479,0.506],[3.657,2.890,3.013,2.377,3.163,2.873],[2.732,2.560,2.184,2.331,2.640,2.627],[2.346,2.150,2.496,2.232,2.608,2.620],[3.311,3.283,2.910,2.798,3.180,3.248],[1.874,1.381,1.373,1.358,1.298,0.998],[1.483,0.968,0.972,0.949,0.927,0.968],[2.294,1.790,1.767,1.798,1.717,1.743],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.337,2.768,2.855,2.748,3.127,3.094],[0.006,0.006,0.006,0.006,0.006,0.005],[1.565,1.034,0.973,1.070,1.032,0.977],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.005,0.006,0.005],[0.006,0.006,0.006,0.006,0.006,0.005],[0.005,0.006,0.006,0.006,0.006,0.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.005,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.399,1.206,1.163,1.285,1.241,1.291],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.10.4.191","source":"results/24.10.4.191.json"} +,{"actual_version":"24.3.18.7","data_size":{"coffeeshop":44643871647,"hits":14268149614,"job":1827596451,"mgbench":2957720599,"ontime":2699155844,"ssb":73311002785,"taxi":24223399633,"tpcds":18819234606,"tpch":17235934679,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":745,"hits":195,"job":28,"mgbench":72,"ontime":57,"ssb":1390,"taxi":531,"tpcds":245,"tpch":262,"uk":34},"machine":"c7a.4xlarge","release_date":"2025-02-19","result":[[0.079,0.010,0.010,0.318,0.010,0.009],[0.044,0.015,0.017,0.014,0.016,0.018],[0.046,0.019,0.012,0.066,0.012,0.011],[0.041,0.012,0.011,0.025,0.015,0.011],[0.045,0.021,0.022,0.047,0.021,0.021],[0.070,0.017,0.016,0.038,0.017,0.016],[0.024,0.008,0.008,0.007,0.006,0.007],[0.050,0.013,0.014,0.013,0.013,0.014],[0.074,0.032,0.033,0.054,0.029,0.030],[0.092,0.056,0.050,0.050,0.055,0.056],[0.439,0.384,0.359,0.369,0.366,0.365],[0.347,0.216,0.260,0.239,0.212,0.211],[0.025,0.008,0.007,0.007,0.010,0.007],[0.040,0.012,0.015,0.013,0.015,0.013],[0.681,0.553,0.550,0.654,0.518,0.520],[0.574,0.121,0.122,0.123,0.120,0.119],[0.043,0.014,0.014,0.013,0.014,0.014],[0.050,0.015,0.013,0.013,0.013,0.013],[6.545,1.158,1.195,1.186,1.173,1.172],[4.868,0.948,0.953,0.956,0.960,0.965],[4.795,0.871,0.879,0.867,0.883,0.878],[5.569,1.682,1.668,1.680,1.683,1.662],[6.524,1.431,1.425,1.414,1.412,1.420],[4.269,0.929,0.926,0.914,0.930,0.943],[0.068,0.026,0.022,0.026,0.025,0.022],[7.925,1.820,1.822,1.841,1.822,1.826],[3.460,1.240,1.235,1.210,1.235,1.234],[3.213,0.749,0.746,0.739,0.749,0.736],[0.002,0.002,0.002,0.002,0.002,0.002],[0.019,0.008,0.008,0.009,0.009,0.008],[0.053,0.015,0.017,0.041,0.016,0.016],[0.145,0.021,0.022,0.021,0.021,0.020],[0.177,0.052,0.054,0.051,0.053,0.056],[0.330,0.125,0.127,0.125,0.127,0.124],[0.003,0.002,0.002,0.033,0.003,0.002],[0.017,0.009,0.013,0.009,0.010,0.009],[0.396,0.228,0.223,0.230,0.236,0.227],[0.443,0.260,0.259,0.264,0.259,0.260],[0.227,0.099,0.100,0.098,0.100,0.099],[0.245,0.119,0.116,0.113,0.117,0.117],[0.518,0.300,0.290,0.284,0.283,0.279],[0.745,0.439,0.415,0.418,0.416,0.416],[0.665,0.438,0.444,0.439,0.456,0.437],[0.405,0.239,0.228,0.236,0.226,0.224],[1.313,0.939,0.938,0.950,0.938,0.957],[0.928,0.620,0.604,0.618,0.608,0.648],[2.901,2.020,1.974,2.001,1.992,2.005],[0.167,0.020,0.020,0.019,0.022,0.024],[1.725,0.312,0.343,0.309,0.308,0.334],[1.753,0.359,0.320,0.342,0.351,0.331],[4.044,1.118,1.096,1.141,1.122,1.125],[2.251,0.430,0.392,0.387,0.403,0.390],[0.512,0.122,0.125,0.124,0.123,0.120],[0.285,0.085,0.085,0.083,0.084,0.085],[0.513,0.122,0.122,0.119,0.123,0.121],[1.775,0.381,0.371,0.421,0.388,0.437],[1.608,0.551,0.549,0.541,0.549,0.545],[0.062,0.025,0.025,0.041,0.022,0.021],[0.548,0.246,0.240,0.258,0.248,0.238],[1.045,0.322,0.304,0.324,0.311,0.310],[2.171,1.602,1.546,1.621,1.563,1.589],[3.076,1.651,1.609,1.600,1.609,1.631],[3.066,1.635,1.586,1.621,1.612,1.627],[0.298,0.184,0.200,0.193,0.185,0.195],[0.118,0.040,0.038,0.036,0.034,0.040],[0.039,0.025,0.025,0.021,0.023,0.023],[0.047,0.020,0.017,0.016,0.015,0.019],[0.111,0.050,0.054,0.050,0.050,0.050],[0.026,0.007,0.008,0.010,0.008,0.007],[0.024,0.008,0.011,0.007,0.007,0.008],[0.010,0.004,0.004,0.004,0.004,0.005],[0.391,0.044,0.043,0.062,0.045,0.040],[0.341,0.059,0.075,0.063,0.061,0.059],[0.106,0.039,0.035,0.055,0.034,0.037],[0.222,0.062,0.062,0.082,0.061,0.060],[0.078,0.032,0.030,0.030,0.029,0.030],[0.176,0.064,0.062,0.061,0.063,0.062],[0.203,0.082,0.082,0.082,0.092,0.081],[0.062,0.031,0.033,0.030,0.031,0.032],[0.096,0.056,0.055,0.054,0.055,0.054],[0.248,0.142,0.142,0.143,0.142,0.144],[0.481,0.168,0.160,0.160,0.163,0.159],[0.380,0.258,0.256,0.254,0.257,0.255],[0.140,0.040,0.040,0.037,0.037,0.036],[0.626,0.301,0.296,0.318,0.288,0.287],[2.613,2.064,2.052,2.049,2.059,2.074],[8.652,1.028,1.014,1.053,1.054,1.015],[2.369,1.086,1.092,1.100,1.092,1.080],[12.899,2.497,2.496,2.502,2.498,2.487],[4.287,2.833,2.858,2.825,2.810,2.802],[4.054,1.650,1.649,1.668,1.651,1.644],[3.666,3.434,3.431,3.436,3.426,3.420],[null,null,null,null,null,null],[3.319,2.790,2.788,2.796,2.778,2.774],[null,null,null,null,null,null],[4.583,4.190,4.183,4.192,4.190,4.188],[null,null,null,null,null,null],[3.075,2.732,2.728,2.733,2.722,2.748],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.649,0.673,0.673,0.501,0.440,0.441],[null,null,null,null,null,null],[17.374,17.362,17.698,17.103,17.091,17.270],[null,null,null,null,null,null],[27.838,28.484,28.469,28.441,28.725,27.026],[0.227,0.076,0.076,0.079,0.082,0.078],[20.863,21.102,20.427,21.165,19.656,19.537],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.891,8.135,8.183,8.187,8.110,7.679],[0.520,0.310,0.335,0.319,0.373,0.347],[1.627,0.741,0.733,0.753,0.728,0.728],[9.257,9.215,9.232,9.261,9.285,8.879],[0.681,0.688,0.767,0.756,0.652,0.474],[0.304,0.096,0.093,0.112,0.094,0.097],[0.484,0.338,0.342,0.253,0.337,0.312],[null,null,null,null,null,null],[29.102,26.707,27.300,28.561,27.987,26.734],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.984,0.877,0.605,0.598,0.599,0.592],[3.891,3.803,3.957,3.794,3.862,3.978],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.728,0.367,0.369,0.438,0.362,0.365],[1.078,0.521,0.524,0.534,0.519,0.523],[1.467,0.950,0.969,0.969,0.947,0.950],[null,null,null,null,null,null],[44.694,44.338,45.686,45.033,44.757,44.606],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.858,0.536,0.534,0.527,0.524,0.510],[null,null,null,null,null,null],[13.907,11.588,12.554,11.502,12.451,11.870],[null,null,null,null,null,null],[3.566,3.147,3.034,3.043,3.158,3.111],[null,null,null,null,null,null],[0.285,0.093,0.095,0.125,0.099,0.100],[0.267,0.181,0.141,0.152,0.147,0.142],[5.598,4.203,4.178,4.162,4.137,4.167],[5.912,4.601,4.531,4.561,4.597,4.573],[5.643,4.658,4.804,4.710,4.641,4.969],[5.630,3.836,4.624,5.065,3.730,4.287],[13.713,11.374,12.805,11.922,9.189,11.336],[1.179,0.202,0.199,0.201,0.194,0.200],[null,null,null,null,null,null],[1.730,0.974,1.001,0.971,0.975,0.994],[11.540,11.608,12.833,12.569,12.794,12.338],[null,null,null,null,null,null],[1.947,0.982,0.996,0.968,0.926,0.966],[null,null,null,null,null,null],[1.268,0.287,0.285,0.285,0.301,0.284],[1.431,0.354,0.355,0.356,0.366,0.358],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.390,1.193,1.218,1.172,1.229,1.102],[1.219,0.604,0.601,0.594,0.593,0.601],[0.752,0.639,0.617,0.611,0.626,0.611],[0.735,0.613,0.616,0.606,0.643,0.632],[1.475,1.113,1.104,1.063,1.109,1.098],[null,null,null,null,null,null],[2.335,2.414,2.448,2.175,2.362,2.289],[5.225,5.661,5.539,5.496,5.074,5.275],[0.494,0.097,0.091,0.106,0.097,0.105],[0.567,0.358,0.388,0.328,0.327,0.344],[2.295,0.619,0.609,0.617,0.616,0.603],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.949,2.962,3.049,3.039,3.060,3.060],[2.780,2.113,2.133,2.057,2.100,2.075],[2.412,2.311,2.255,2.449,2.459,2.401],[1.568,1.150,1.277,1.200,1.422,1.761],[11.847,11.367,11.357,11.478,11.246,11.009],[2.324,2.238,2.072,2.377,2.451,2.482],[1.320,0.334,0.321,0.331,0.312,0.316],[null,null,null,null,null,null],[1.039,0.356,0.358,0.358,0.353,0.349],[1.658,1.145,1.163,1.150,1.164,1.160],[1.301,0.329,0.328,0.318,0.333,0.326],[2.026,0.918,0.924,0.898,0.937,0.924],[0.434,0.203,0.208,0.211,0.226,0.204],[1.625,1.680,1.367,1.381,1.347,1.448],[null,null,null,null,null,null],[24.868,24.431,24.577,24.681,23.929,25.061],[1.646,0.790,0.713,0.818,0.723,0.709],[null,null,null,null,null,null],[2.618,0.566,0.536,0.546,0.565,0.553],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.298,0.271,0.274,0.276,0.271,0.272],[null,null,null,null,null,null],[1.399,0.313,0.308,0.301,0.314,0.320],[40.738,40.784,40.851,40.876,40.783,40.635],[null,null,null,null,null,null],[0.411,0.063,0.068,0.074,0.065,0.059],[1.806,0.323,0.313,0.313,0.317,0.326],[0.039,0.051,0.028,0.031,0.023,0.025],[null,null,null,null,null,null],[4.993,2.467,2.344,2.580,2.573,2.989],[null,null,null,null,null,null],[2.009,1.746,1.535,1.674,1.738,1.583],[0.237,0.118,0.092,0.111,0.096,0.089],[1.150,1.172,1.074,1.139,1.073,1.102],[1.436,1.145,1.157,1.104,0.817,1.090],[null,null,null,null,null,null],[1.200,0.632,0.609,0.590,0.619,0.601],[2.469,1.896,1.875,1.917,1.903,1.878],[1.864,1.796,1.573,1.773,1.707,1.412],[0.302,0.097,0.091,0.089,0.090,0.088],[0.520,0.448,0.466,0.383,0.453,0.389],[null,null,null,null,null,null],[3.124,2.579,2.228,2.481,2.222,2.200],[null,null,null,null,null,null],[17.112,16.407,16.735,16.593,16.534,16.748],[0.749,0.157,0.146,0.152,0.151,0.153],[3.502,2.980,2.867,3.294,2.874,2.889],[null,null,null,null,null,null],[0.715,0.369,0.366,0.364,0.366,0.361],[0.849,0.704,0.893,0.422,0.694,0.662],[0.630,0.523,0.490,0.509,0.416,0.470],[0.267,0.220,0.212,0.222,0.212,0.254],[0.526,0.364,0.528,0.554,0.402,0.458],[1.356,1.418,1.411,1.261,1.085,0.672],[1.477,1.396,1.277,1.315,1.130,1.374],[1.172,1.424,1.353,1.488,1.489,1.334],[null,null,null,null,null,null],[1.355,1.252,1.199,1.241,1.302,1.259],[1.280,0.868,0.823,0.833,0.816,0.750],[2.925,2.405,3.010,2.387,2.385,2.065],[1.828,1.813,1.772,1.926,1.719,1.677],[0.975,0.746,0.805,0.757,0.822,0.398],[2.095,1.767,2.005,2.047,2.064,1.997],[0.674,0.278,0.293,0.274,0.281,0.284],[0.613,0.229,0.159,0.185,0.194,0.203],[0.798,0.312,0.375,0.373,0.231,0.323],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.172,1.883,1.766,1.880,1.602,1.875],[2.754,2.613,2.502,2.536,2.555,2.738],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.768,0.699,0.672,0.744,0.396,0.335],[1.276,1.175,1.233,1.206,1.205,1.172],[0.973,0.966,0.857,0.513,0.783,0.781],[0.510,0.790,0.342,0.733,0.765,0.715],[1.556,1.482,1.500,1.544,1.489,0.762],[null,null,null,null,null,null],[0.879,0.323,0.396,0.384,0.315,0.317],[2.753,2.158,2.196,2.673,2.706,2.313],[0.955,0.412,0.638,0.474,0.459,0.444],[3.141,3.144,2.983,2.633,2.650,3.187],[2.601,2.372,2.346,2.314,2.239,2.156],[1.772,2.164,2.572,1.976,2.325,2.507],[3.256,3.153,2.750,2.768,2.658,2.723],[1.928,1.299,1.344,1.374,1.372,1.405],[1.511,1.053,1.063,0.591,0.950,0.950],[2.294,1.663,1.721,1.569,1.936,1.802],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.283,2.616,2.773,2.420,2.478,3.100],[0.962,0.418,0.398,0.316,0.342,0.395],[1.574,1.060,0.959,0.906,0.962,0.944],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.524,1.004,0.942,0.958,1.014,0.914],[1.520,0.876,0.972,1.015,0.947,1.032],[1.537,1.070,1.025,1.017,0.693,1.035],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.775,1.162,1.186,1.176,1.202,1.172],[1.378,0.877,0.841,0.486,0.863,0.905],[1.957,1.480,1.433,1.466,1.460,1.309],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.227,0.989,1.276,1.242,0.874,0.922],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.3.18.7","source":"results/24.3.18.7.json"} +,{"actual_version":"24.8.14.39","data_size":{"coffeeshop":44637800515,"hits":14264670619,"job":1828094510,"mgbench":2957327737,"ontime":2699155844,"ssb":73313687585,"taxi":24223637199,"tpcds":18792015704,"tpch":17233712526,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":892,"hits":230,"job":21,"mgbench":70,"ontime":60,"ssb":1390,"taxi":528,"tpcds":277,"tpch":271,"uk":29},"machine":"c7a.4xlarge","release_date":"2025-02-19","result":[[0.079,0.009,0.009,0.356,0.009,0.008],[0.043,0.018,0.018,0.018,0.013,0.016],[0.050,0.017,0.010,0.067,0.011,0.010],[0.045,0.010,0.011,0.024,0.011,0.010],[0.049,0.021,0.019,0.053,0.020,0.020],[0.069,0.015,0.017,0.036,0.016,0.016],[0.026,0.007,0.007,0.007,0.006,0.006],[0.048,0.013,0.013,0.014,0.012,0.013],[0.074,0.030,0.029,0.057,0.028,0.028],[0.090,0.073,0.053,0.051,0.050,0.049],[0.429,0.357,0.359,0.373,0.363,0.360],[0.351,0.221,0.260,0.238,0.211,0.214],[0.034,0.007,0.007,0.007,0.007,0.008],[0.041,0.013,0.013,0.013,0.014,0.012],[0.670,0.555,0.540,0.657,0.530,0.533],[0.552,0.109,0.108,0.112,0.107,0.110],[0.047,0.013,0.012,0.013,0.013,0.013],[0.038,0.011,0.011,0.012,0.011,0.011],[6.440,1.131,1.133,1.156,1.143,1.135],[4.742,0.897,0.898,0.887,0.875,0.887],[4.761,0.809,0.815,0.816,0.808,0.816],[5.519,1.642,1.619,1.616,1.628,1.622],[6.448,1.392,1.385,1.403,1.392,1.392],[4.248,0.829,0.832,0.847,0.827,0.850],[0.066,0.024,0.021,0.021,0.020,0.021],[7.854,1.775,1.778,1.798,1.771,1.771],[3.416,1.208,1.202,1.198,1.191,1.188],[3.167,0.716,0.714,0.725,0.717,0.713],[0.002,0.002,0.002,0.002,0.002,0.002],[0.026,0.008,0.008,0.007,0.008,0.007],[0.057,0.018,0.016,0.039,0.016,0.015],[0.140,0.023,0.020,0.023,0.022,0.021],[0.170,0.052,0.053,0.052,0.051,0.052],[0.322,0.126,0.134,0.128,0.129,0.124],[0.005,0.003,0.002,0.032,0.002,0.002],[0.023,0.009,0.009,0.009,0.009,0.009],[0.390,0.228,0.230,0.224,0.226,0.228],[0.445,0.266,0.261,0.260,0.273,0.262],[0.193,0.066,0.064,0.068,0.066,0.066],[0.210,0.083,0.083,0.081,0.082,0.081],[0.513,0.288,0.300,0.283,0.283,0.280],[0.696,0.392,0.406,0.392,0.388,0.401],[0.627,0.390,0.397,0.384,0.387,0.380],[0.382,0.231,0.229,0.227,0.225,0.226],[1.330,0.959,0.940,0.936,0.937,0.938],[0.933,0.648,0.610,0.625,0.614,0.607],[2.892,2.019,2.012,2.040,2.047,2.040],[0.138,0.019,0.019,0.019,0.019,0.020],[1.549,0.320,0.340,0.326,0.315,0.314],[1.566,0.359,0.349,0.337,0.333,0.351],[4.023,1.037,1.018,1.035,1.012,1.029],[2.114,0.401,0.383,0.383,0.403,0.403],[0.434,0.101,0.100,0.107,0.104,0.102],[0.270,0.081,0.084,0.083,0.080,0.080],[0.429,0.101,0.099,0.101,0.101,0.101],[1.529,0.350,0.339,0.365,0.341,0.355],[1.511,0.524,0.532,0.525,0.534,0.529],[0.060,0.021,0.021,0.040,0.022,0.021],[0.523,0.261,0.243,0.263,0.228,0.232],[0.963,0.310,0.318,0.312,0.323,0.306],[2.159,1.502,1.521,1.529,1.506,1.565],[2.901,1.620,1.578,1.591,1.574,1.585],[2.914,1.634,1.578,1.578,1.605,1.600],[0.296,0.183,0.193,0.190,0.203,0.207],[0.114,0.052,0.058,0.052,0.054,0.059],[0.060,0.028,0.028,0.025,0.028,0.027],[0.089,0.020,0.024,0.022,0.021,0.021],[0.208,0.111,0.120,0.111,0.104,0.103],[0.045,0.008,0.007,0.007,0.008,0.007],[0.041,0.007,0.007,0.007,0.007,0.007],[0.012,0.004,0.005,0.005,0.004,0.004],[0.447,0.039,0.036,0.054,0.035,0.037],[0.371,0.056,0.052,0.057,0.056,0.056],[0.111,0.035,0.034,0.054,0.032,0.047],[0.279,0.062,0.061,0.077,0.062,0.059],[0.092,0.030,0.031,0.031,0.031,0.031],[0.193,0.066,0.064,0.066,0.062,0.063],[0.217,0.081,0.083,0.086,0.083,0.080],[0.069,0.032,0.031,0.030,0.031,0.031],[0.114,0.054,0.056,0.054,0.055,0.054],[0.273,0.150,0.141,0.139,0.147,0.141],[0.489,0.156,0.156,0.159,0.151,0.150],[0.392,0.256,0.266,0.255,0.258,0.256],[0.161,0.035,0.032,0.031,0.032,0.032],[0.654,0.285,0.296,0.312,0.285,0.277],[2.754,1.998,2.005,2.020,2.014,2.008],[8.661,1.024,1.021,1.029,1.047,0.997],[2.300,1.087,1.080,1.082,1.085,1.072],[12.889,2.584,2.562,2.562,2.578,2.547],[4.273,2.838,2.844,2.856,2.846,2.836],[4.061,1.695,1.684,1.689,1.686,1.683],[3.678,3.446,3.453,3.463,3.464,3.458],[null,null,null,null,null,null],[3.301,2.820,2.804,2.809,2.798,2.791],[null,null,null,null,null,null],[4.491,4.190,4.181,4.228,4.188,4.230],[null,null,null,null,null,null],[3.042,2.742,2.761,2.741,2.743,2.744],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.725,0.678,0.677,0.497,0.443,0.444],[null,null,null,null,null,null],[18.758,17.998,17.884,18.327,18.465,18.005],[null,null,null,null,null,null],[30.561,30.715,30.958,29.984,29.750,29.252],[0.247,0.072,0.067,0.067,0.071,0.069],[21.254,21.486,21.807,21.386,20.116,20.680],[null,null,null,null,null,null],[null,null,null,null,null,null],[8.830,8.329,7.984,8.550,8.243,8.273],[0.480,0.284,0.292,0.292,0.288,0.302],[1.571,0.665,0.655,0.683,0.645,0.663],[10.165,9.950,9.767,10.050,9.831,9.866],[0.659,0.647,0.383,0.697,0.675,0.696],[0.220,0.100,0.097,0.115,0.094,0.096],[0.458,0.324,0.319,0.244,0.244,0.314],[null,null,null,null,null,null],[2.932,1.929,1.948,1.919,1.906,1.959],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.902,0.671,0.546,0.547,0.546,0.549],[4.049,3.909,4.092,4.062,3.972,4.107],[58.180,58.389,58.559,59.383,58.890,58.681],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.287,0.383,0.362,0.398,0.373,0.369],[0.968,0.536,0.536,0.537,0.551,0.535],[1.359,0.961,0.954,0.958,0.948,0.976],[null,null,null,null,null,null],[34.416,34.075,34.249,34.500,34.311,33.984],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.802,0.509,0.481,0.498,0.503,0.493],[null,null,null,null,null,null],[12.941,13.155,12.970,12.846,13.106,12.582],[null,null,null,null,null,null],[3.342,3.199,3.146,3.202,3.013,3.291],[null,null,null,null,null,null],[0.218,0.103,0.101,0.120,0.100,0.095],[0.271,0.147,0.139,0.131,0.146,0.137],[6.375,4.997,4.969,4.999,4.962,5.084],[6.419,5.377,5.348,5.370,5.370,5.378],[5.432,4.679,5.004,4.990,4.719,4.984],[5.358,4.699,4.641,4.625,4.988,4.970],[13.910,12.703,12.675,13.125,12.359,12.437],[0.762,0.196,0.195,0.195,0.192,0.194],[null,null,null,null,null,null],[1.464,0.928,0.934,0.928,0.930,0.931],[13.498,12.932,12.500,11.681,12.168,12.202],[null,null,null,null,null,null],[1.520,0.942,0.922,0.899,0.908,0.943],[null,null,null,null,null,null],[0.975,0.282,0.275,0.280,0.274,0.277],[1.059,0.343,0.339,0.346,0.337,0.328],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.511,1.202,1.319,1.364,1.371,1.439],[1.094,0.561,0.577,0.565,0.565,0.559],[0.792,0.639,0.623,0.613,0.621,0.622],[0.754,0.620,0.623,0.614,0.622,0.611],[1.467,1.096,1.089,1.011,1.113,0.727],[null,null,null,null,null,null],[2.560,2.554,2.573,2.415,2.297,2.553],[5.432,5.612,5.221,5.564,6.103,5.575],[0.033,0.025,0.022,0.021,0.025,0.015],[0.528,0.344,0.331,0.360,0.344,0.349],[1.795,0.608,0.588,0.576,0.591,0.589],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[4.305,3.579,2.236,3.207,3.122,3.588],[2.538,1.737,2.121,2.091,2.131,1.761],[2.564,2.342,2.066,2.413,2.546,2.569],[1.770,1.789,1.710,1.653,1.761,1.820],[12.091,11.826,11.815,11.879,11.887,11.901],[2.483,2.581,2.555,2.630,2.454,2.554],[1.048,0.297,0.305,0.304,0.304,0.298],[null,null,null,null,null,null],[0.908,0.358,0.358,0.352,0.361,0.354],[1.475,1.070,1.053,1.055,1.060,1.055],[0.997,0.320,0.311,0.312,0.310,0.322],[1.728,0.927,0.912,0.914,0.912,0.916],[0.414,0.224,0.226,0.214,0.213,0.216],[1.863,1.596,1.690,1.589,1.436,1.381],[null,null,null,null,null,null],[24.314,24.134,24.148,28.119,23.859,24.947],[1.471,0.789,0.715,0.798,0.701,0.698],[null,null,null,null,null,null],[2.392,0.557,0.546,0.543,0.523,0.525],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.034,0.272,0.275,0.278,0.271,0.275],[null,null,null,null,null,null],[1.062,0.296,0.283,0.312,0.289,0.302],[30.090,29.901,30.048,29.843,29.702,29.619],[null,null,null,null,null,null],[0.009,0.008,0.008,0.027,0.008,0.009],[1.569,0.311,0.304,0.299,0.299,0.300],[0.014,0.037,0.014,0.014,0.014,0.014],[null,null,null,null,null,null],[4.466,2.955,2.491,2.548,2.893,2.771],[null,null,null,null,null,null],[2.254,2.028,1.874,1.922,1.756,2.062],[0.192,0.104,0.094,0.096,0.101,0.097],[1.261,1.199,1.202,1.064,1.049,1.131],[1.507,1.177,1.129,1.210,1.169,1.104],[null,null,null,null,null,null],[1.097,0.564,0.574,0.555,0.577,0.578],[2.237,1.788,1.797,1.792,1.798,1.802],[2.123,2.005,2.005,1.659,2.026,2.034],[0.227,0.086,0.085,0.082,0.082,0.079],[0.550,0.471,0.394,0.432,0.434,0.376],[null,null,null,null,null,null],[3.262,2.476,2.489,2.201,2.174,2.525],[null,null,null,null,null,null],[17.489,17.230,16.877,17.199,17.000,16.952],[0.556,0.140,0.145,0.142,0.145,0.142],[3.766,3.239,2.907,2.959,2.941,2.885],[null,null,null,null,null,null],[0.687,0.361,0.363,0.361,0.361,0.376],[0.881,0.770,0.823,0.812,0.767,0.771],[0.601,0.536,0.441,0.425,0.450,0.453],[0.284,0.223,0.233,0.241,0.221,0.237],[0.588,0.459,0.464,0.583,0.465,0.453],[1.534,1.056,1.147,1.453,1.422,1.177],[1.524,1.432,1.465,1.424,1.096,1.439],[1.539,1.048,1.347,1.395,1.451,1.158],[null,null,null,null,null,null],[1.669,1.126,1.210,1.136,1.136,1.219],[1.313,0.856,0.841,0.842,0.821,0.870],[2.688,2.198,2.250,2.291,2.160,2.240],[1.796,1.691,1.719,1.723,1.690,2.001],[0.882,0.763,0.763,0.748,0.369,0.776],[2.055,1.972,1.961,1.954,1.916,1.973],[0.693,0.254,0.315,0.257,0.328,0.180],[0.565,0.217,0.206,0.218,0.221,0.175],[0.650,0.382,0.368,0.299,0.313,0.226],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.171,2.011,2.005,1.943,2.027,1.886],[2.954,2.715,2.832,2.648,2.619,2.658],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.844,0.716,0.707,0.755,0.693,0.740],[1.308,1.196,1.196,1.177,1.185,0.823],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[1.651,1.558,1.501,1.486,1.522,1.467],[null,null,null,null,null,null],[0.853,0.372,0.330,0.320,0.427,0.365],[3.185,2.438,2.763,2.347,2.400,2.791],[0.916,0.488,0.454,0.462,0.444,0.409],[3.645,2.481,2.868,3.253,3.129,3.263],[2.739,2.624,2.649,2.637,2.577,2.678],[2.399,2.674,2.593,2.605,2.566,2.112],[3.010,2.833,3.277,2.814,3.155,1.862],[1.854,1.343,1.583,1.404,1.299,1.566],[1.462,0.987,0.947,0.992,0.968,0.989],[2.232,1.916,1.768,1.429,1.810,1.822],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.688,3.158,3.240,2.909,2.240,2.922],[0.006,0.006,0.006,0.006,0.005,0.006],[1.557,0.699,0.661,1.036,0.995,1.067],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.005,0.006,0.006,0.005],[0.006,0.006,0.006,0.006,0.006,0.005],[0.006,0.005,0.006,0.006,0.006,0.005],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.005,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.412,1.345,0.943,1.318,1.284,0.921],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.8.14.39","source":"results/24.8.14.39.json"} +,{"actual_version":"24.11.5.49","data_size":{"coffeeshop":44633256495,"hits":14279736285,"job":1828094510,"mgbench":2954107754,"ontime":2699155844,"ssb":73313347455,"taxi":24223614270,"tpcds":18792521581,"tpch":17236260656,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":802,"hits":224,"job":22,"mgbench":71,"ontime":57,"ssb":1419,"taxi":528,"tpcds":302,"tpch":289,"uk":30},"machine":"c7a.4xlarge","release_date":"2025-02-19","result":[[0.078,0.010,0.008,0.284,0.009,0.008],[0.037,0.019,0.016,0.019,0.014,0.018],[0.044,0.019,0.011,0.069,0.011,0.011],[0.035,0.011,0.011,0.025,0.010,0.010],[0.044,0.020,0.018,0.046,0.021,0.021],[0.066,0.017,0.017,0.036,0.015,0.015],[0.021,0.006,0.007,0.006,0.007,0.008],[0.045,0.015,0.015,0.015,0.014,0.014],[0.065,0.029,0.028,0.051,0.033,0.029],[0.084,0.049,0.050,0.050,0.048,0.049],[0.431,0.362,0.315,0.367,0.360,0.360],[0.350,0.213,0.252,0.235,0.207,0.212],[0.027,0.007,0.008,0.007,0.007,0.007],[0.027,0.014,0.014,0.012,0.013,0.013],[0.670,0.554,0.555,0.658,0.522,0.528],[0.504,0.135,0.132,0.132,0.142,0.130],[0.044,0.014,0.012,0.013,0.013,0.013],[0.040,0.012,0.012,0.012,0.011,0.031],[6.456,1.257,1.247,1.280,1.261,1.249],[4.757,0.938,0.947,0.940,0.946,0.945],[4.766,0.975,0.983,0.986,0.978,0.978],[5.353,1.648,1.657,1.644,1.673,1.667],[6.244,1.395,1.394,1.411,1.397,1.396],[3.978,0.808,0.816,0.799,0.806,0.805],[0.057,0.021,0.020,0.020,0.020,0.022],[7.880,1.869,1.892,1.912,1.869,1.873],[1.842,0.678,0.675,0.673,0.687,0.675],[1.920,0.506,0.504,0.500,0.515,0.496],[0.002,0.002,0.002,0.002,0.002,0.002],[0.029,0.008,0.009,0.008,0.008,0.008],[0.055,0.017,0.016,0.040,0.016,0.015],[0.128,0.025,0.022,0.022,0.021,0.027],[0.154,0.054,0.057,0.053,0.053,0.053],[0.289,0.124,0.122,0.129,0.131,0.122],[0.003,0.002,0.002,0.032,0.002,0.002],[0.025,0.009,0.009,0.009,0.009,0.009],[0.367,0.226,0.221,0.221,0.221,0.225],[0.408,0.259,0.259,0.272,0.257,0.262],[0.173,0.066,0.066,0.067,0.067,0.068],[0.189,0.081,0.086,0.083,0.087,0.082],[0.481,0.281,0.278,0.283,0.281,0.292],[0.653,0.393,0.397,0.385,0.392,0.386],[0.594,0.393,0.386,0.382,0.403,0.397],[0.371,0.232,0.223,0.222,0.221,0.224],[1.289,0.961,0.940,0.938,0.938,0.946],[0.882,0.621,0.619,0.613,0.613,0.605],[2.840,2.046,2.045,2.059,2.059,2.044],[0.126,0.020,0.021,0.021,0.020,0.021],[1.405,0.349,0.321,0.322,0.331,0.352],[1.737,0.389,0.351,0.373,0.355,0.357],[3.935,0.977,0.952,0.968,0.950,0.951],[2.111,0.399,0.397,0.428,0.412,0.403],[0.392,0.102,0.107,0.103,0.102,0.101],[0.241,0.081,0.083,0.079,0.080,0.079],[0.383,0.103,0.102,0.102,0.105,0.103],[1.412,0.346,0.355,0.380,0.359,0.353],[1.388,0.544,0.541,0.535,0.546,0.528],[0.055,0.022,0.021,0.040,0.023,0.021],[0.490,0.238,0.246,0.255,0.233,0.228],[0.869,0.306,0.316,0.304,0.320,0.328],[2.128,1.505,1.549,1.606,1.573,1.560],[2.763,1.646,1.601,1.592,1.582,1.593],[2.782,1.643,1.592,1.596,1.611,1.586],[0.287,0.192,0.189,0.203,0.197,0.207],[0.094,0.056,0.057,0.056,0.050,0.057],[0.053,0.031,0.027,0.029,0.030,0.029],[0.068,0.021,0.021,0.023,0.020,0.021],[0.182,0.102,0.102,0.098,0.098,0.098],[0.027,0.008,0.008,0.008,0.008,0.008],[0.023,0.008,0.008,0.008,0.008,0.008],[0.013,0.005,0.005,0.005,0.005,0.005],[0.362,0.050,0.049,0.066,0.050,0.047],[0.312,0.066,0.066,0.063,0.065,0.065],[0.099,0.035,0.035,0.058,0.036,0.035],[0.233,0.072,0.070,0.087,0.071,0.074],[0.075,0.033,0.032,0.031,0.031,0.031],[0.165,0.065,0.065,0.066,0.067,0.067],[0.187,0.084,0.087,0.086,0.084,0.083],[0.060,0.031,0.031,0.031,0.032,0.032],[0.098,0.055,0.053,0.055,0.054,0.054],[0.240,0.174,0.149,0.151,0.149,0.149],[0.436,0.172,0.174,0.171,0.171,0.172],[0.370,0.257,0.258,0.257,0.269,0.258],[0.133,0.043,0.042,0.042,0.044,0.043],[0.593,0.312,0.309,0.331,0.301,0.299],[2.622,2.061,2.066,2.071,2.066,2.070],[8.676,1.055,1.063,1.067,1.036,1.043],[2.135,1.102,1.115,1.104,1.104,1.099],[12.888,2.588,2.584,2.601,2.582,2.573],[4.271,3.387,3.347,3.339,3.327,3.357],[4.066,1.711,1.721,1.711,1.714,1.708],[4.201,4.029,4.063,4.041,4.028,4.018],[null,null,null,null,null,null],[3.572,3.274,3.270,3.274,3.257,3.291],[null,null,null,null,null,null],[5.015,4.715,4.757,4.748,4.737,4.726],[null,null,null,null,null,null],[3.447,3.198,3.219,3.192,3.188,3.217],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.765,0.685,0.690,0.512,0.452,0.460],[null,null,null,null,null,null],[20.564,20.224,20.425,20.093,20.403,20.334],[null,null,null,null,null,null],[33.865,33.817,33.729,30.634,32.831,33.295],[0.226,0.076,0.081,0.079,0.077,0.084],[19.955,19.839,18.880,18.858,19.677,20.160],[null,null,null,null,null,null],[null,null,null,null,null,null],[9.455,9.329,8.895,8.601,9.113,8.585],[0.479,0.330,0.331,0.316,0.322,0.321],[1.064,0.430,0.501,0.527,0.489,0.502],[10.677,10.526,10.556,10.202,10.453,10.658],[0.776,0.666,0.387,0.753,0.479,0.724],[0.180,0.115,0.099,0.117,0.095,0.096],[0.467,0.257,0.274,0.256,0.332,0.339],[null,null,null,null,null,null],[2.898,1.988,1.996,1.983,1.995,2.007],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.900,0.698,0.580,0.579,0.580,0.583],[3.603,3.352,3.659,3.430,3.513,3.495],[57.730,58.287,58.697,59.618,59.493,58.808],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.305,0.413,0.396,0.415,0.363,0.366],[0.889,0.522,0.490,0.499,0.508,0.516],[1.364,1.006,0.995,1.003,1.010,0.985],[null,null,null,null,null,null],[35.211,35.439,35.264,35.026,34.888,35.205],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.839,0.528,0.565,0.557,0.555,0.542],[null,null,null,null,null,null],[13.342,13.281,12.679,13.132,13.429,13.215],[null,null,null,null,null,null],[3.326,3.347,3.120,3.213,3.375,3.115],[null,null,null,null,null,null],[0.230,0.119,0.118,0.137,0.113,0.116],[0.279,0.184,0.195,0.173,0.163,0.170],[6.425,5.263,5.170,5.239,5.335,5.287],[6.592,5.644,5.777,5.636,5.648,5.686],[4.692,4.683,4.671,4.736,4.876,4.342],[5.318,4.680,4.685,4.333,5.079,4.720],[13.270,12.384,12.368,11.934,12.612,13.033],[0.712,0.231,0.214,0.200,0.199,0.201],[null,null,null,null,null,null],[1.453,0.983,0.980,0.995,0.973,0.973],[12.611,12.302,12.093,13.758,13.040,13.078],[null,null,null,null,null,null],[1.512,0.955,0.928,0.959,0.936,0.975],[null,null,null,null,null,null],[0.980,0.310,0.314,0.303,0.304,0.298],[1.034,0.358,0.371,0.365,0.364,0.349],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.568,1.479,1.394,1.532,1.289,1.412],[1.021,0.627,0.603,0.619,0.594,0.586],[0.448,0.357,0.339,0.360,0.348,0.350],[0.442,0.350,0.351,0.344,0.360,0.352],[1.497,1.177,1.171,1.176,1.153,1.171],[null,null,null,null,null,null],[2.637,2.462,2.615,2.449,2.636,2.582],[4.073,4.045,4.156,4.210,4.151,4.125],[0.034,0.015,0.026,0.021,0.019,0.014],[0.535,0.379,0.379,0.376,0.359,0.371],[1.683,0.592,0.618,0.603,0.606,0.592],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[3.930,3.814,3.267,3.854,2.332,3.321],[2.591,2.173,2.209,2.186,2.183,2.202],[2.572,2.529,2.680,2.676,2.666,2.172],[1.754,1.535,1.668,1.578,1.644,1.629],[12.527,12.389,12.196,12.320,12.142,12.243],[2.306,2.314,2.616,2.614,2.715,2.654],[1.068,0.359,0.333,0.332,0.356,0.344],[null,null,null,null,null,null],[0.905,0.414,0.403,0.402,0.398,0.408],[1.482,1.132,1.158,1.127,1.143,1.130],[1.036,0.354,0.342,0.353,0.354,0.341],[1.662,0.962,0.939,0.943,0.953,0.962],[0.388,0.229,0.237,0.231,0.229,0.235],[1.829,1.704,1.510,1.511,1.661,1.683],[null,null,null,null,null,null],[16.484,15.908,15.854,16.040,15.803,15.712],[1.489,0.841,0.761,0.858,0.795,0.767],[null,null,null,null,null,null],[2.370,0.567,0.522,0.546,0.507,0.489],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.995,0.378,0.368,0.295,0.343,0.355],[null,null,null,null,null,null],[0.975,0.306,0.310,0.303,0.311,0.304],[31.910,31.582,31.904,31.704,32.008,31.668],[null,null,null,null,null,null],[0.009,0.009,0.009,0.028,0.008,0.009],[1.572,0.327,0.329,0.325,0.326,0.324],[0.015,0.038,0.015,0.015,0.015,0.015],[null,null,null,null,null,null],[4.487,2.563,2.674,2.469,2.641,2.684],[null,null,null,null,null,null],[2.340,2.133,2.176,2.067,2.148,2.261],[0.179,0.104,0.103,0.089,0.096,0.087],[1.388,1.266,1.286,1.298,1.237,1.269],[1.491,1.229,1.210,1.265,1.153,0.823],[null,null,null,null,null,null],[1.060,0.615,0.612,0.622,0.574,0.599],[2.362,1.952,1.943,1.936,1.944,1.949],[1.902,1.825,1.834,1.665,1.858,1.555],[0.209,0.085,0.085,0.087,0.088,0.088],[0.559,0.509,0.507,0.438,0.531,0.445],[null,null,null,null,null,null],[3.305,1.637,2.707,2.629,2.694,2.615],[null,null,null,null,null,null],[18.186,17.897,17.917,17.941,18.083,17.724],[0.530,0.151,0.155,0.151,0.151,0.149],[3.489,2.425,3.016,3.386,3.313,3.383],[null,null,null,null,null,null],[0.678,0.389,0.387,0.389,0.386,0.388],[0.882,0.828,0.706,0.858,0.803,0.801],[0.576,0.538,0.517,0.449,0.514,0.417],[0.287,0.247,0.251,0.251,0.242,0.199],[0.500,0.571,0.547,0.488,0.506,0.514],[1.559,1.526,1.448,1.415,1.513,1.424],[1.565,1.503,1.441,1.519,1.480,1.496],[1.485,1.176,1.466,1.363,1.211,1.509],[null,null,null,null,null,null],[1.611,1.230,1.024,1.221,1.217,1.168],[1.307,0.901,0.866,0.583,0.892,0.895],[2.480,2.145,2.129,2.113,2.139,2.161],[1.629,1.551,1.498,1.618,1.060,1.533],[0.876,0.371,0.801,0.678,0.800,0.773],[1.794,1.789,1.742,1.724,1.750,1.758],[0.660,0.290,0.292,0.286,0.180,0.285],[0.548,0.219,0.237,0.238,0.205,0.219],[0.708,0.387,0.390,0.363,0.311,0.310],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.169,1.996,1.976,1.862,1.998,1.926],[2.909,2.466,2.618,2.713,2.720,2.830],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.869,0.748,0.731,0.766,0.779,0.752],[1.281,1.156,1.196,1.195,1.130,1.136],[0.006,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[1.694,1.488,1.485,1.534,1.580,1.480],[null,null,null,null,null,null],[0.773,0.341,0.330,0.312,0.340,0.365],[2.767,2.356,2.431,1.783,2.768,2.483],[0.890,0.494,0.450,0.376,0.408,0.498],[3.676,3.412,2.909,2.252,2.971,2.980],[2.822,2.271,2.354,2.360,2.618,2.337],[2.692,2.685,2.775,2.367,2.731,2.358],[3.373,3.296,3.326,2.813,2.812,3.343],[1.793,1.394,1.362,1.393,1.381,1.307],[1.441,0.988,1.006,1.008,0.992,0.588],[2.160,1.678,1.656,1.720,1.776,1.724],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.940,3.319,2.896,2.580,2.958,3.197],[0.006,0.006,0.006,0.006,0.006,0.006],[1.536,0.968,1.101,1.077,1.062,1.073],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.007],[0.006,0.006,0.006,0.006,0.006,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.371,1.367,1.350,1.079,1.306,1.372],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.11.5.49","source":"results/24.11.5.49.json"} +,{"actual_version":"24.12.6.70","data_size":{"coffeeshop":44632911596,"hits":14303422491,"job":1828094510,"mgbench":2954107754,"ontime":2699155844,"ssb":73313741142,"taxi":24223520849,"tpcds":18791406588,"tpch":17238564539,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":795,"hits":241,"job":30,"mgbench":83,"ontime":59,"ssb":1680,"taxi":544,"tpcds":293,"tpch":295,"uk":31},"machine":"c7a.4xlarge","release_date":"2025-03-11","result":[[0.098,0.011,0.010,0.347,0.011,0.010],[0.044,0.020,0.024,0.017,0.022,0.016],[0.055,0.022,0.013,0.076,0.012,0.012],[0.041,0.012,0.013,0.027,0.012,0.013],[0.049,0.028,0.026,0.057,0.025,0.024],[0.077,0.019,0.020,0.041,0.018,0.018],[0.027,0.008,0.007,0.008,0.007,0.008],[0.053,0.019,0.019,0.017,0.016,0.017],[0.082,0.040,0.035,0.063,0.036,0.035],[0.103,0.063,0.058,0.059,0.058,0.062],[0.512,0.424,0.425,0.432,0.415,0.436],[0.407,0.263,0.305,0.279,0.258,0.245],[0.031,0.008,0.008,0.008,0.008,0.008],[0.033,0.015,0.016,0.014,0.014,0.016],[0.825,0.692,0.686,0.822,0.666,0.664],[0.626,0.156,0.159,0.168,0.156,0.155],[0.047,0.014,0.014,0.016,0.014,0.014],[0.040,0.013,0.014,0.014,0.012,0.013],[6.476,1.575,1.579,1.601,1.592,1.576],[4.766,1.187,1.171,1.180,1.166,1.169],[4.779,1.225,1.231,1.229,1.214,1.225],[5.354,2.100,2.070,2.102,2.084,2.085],[6.255,1.777,1.753,1.797,1.769,1.789],[3.985,1.016,1.011,1.017,1.011,1.014],[0.076,0.029,0.028,0.028,0.025,0.026],[7.892,2.340,2.346,2.354,2.344,2.387],[2.097,0.859,0.856,0.838,0.852,0.854],[1.939,0.632,0.617,0.642,0.619,0.632],[0.002,0.002,0.002,0.002,0.002,0.002],[0.034,0.009,0.010,0.011,0.010,0.009],[0.067,0.021,0.019,0.049,0.022,0.020],[0.149,0.025,0.027,0.026,0.029,0.027],[0.181,0.066,0.064,0.063,0.064,0.066],[0.340,0.154,0.153,0.152,0.163,0.155],[0.006,0.003,0.003,0.036,0.003,0.003],[0.030,0.011,0.011,0.011,0.011,0.011],[0.429,0.273,0.269,0.278,0.269,0.274],[0.480,0.318,0.315,0.312,0.327,0.313],[0.207,0.079,0.084,0.082,0.081,0.080],[0.226,0.101,0.100,0.099,0.100,0.100],[0.566,0.340,0.332,0.335,0.332,0.331],[0.780,0.460,0.463,0.448,0.456,0.457],[0.676,0.461,0.445,0.446,0.456,0.446],[0.437,0.275,0.265,0.267,0.267,0.266],[1.497,1.080,1.083,1.103,1.074,1.083],[1.033,0.713,0.733,0.699,0.705,0.707],[3.221,2.254,2.263,2.294,2.342,2.336],[0.152,0.027,0.024,0.025,0.027,0.024],[1.661,0.422,0.444,0.404,0.402,0.454],[1.812,0.441,0.457,0.454,0.454,0.499],[4.009,1.226,1.211,1.227,1.207,1.200],[2.416,0.507,0.535,0.526,0.516,0.505],[0.456,0.131,0.131,0.138,0.133,0.130],[0.286,0.116,0.100,0.114,0.103,0.107],[0.458,0.127,0.130,0.126,0.129,0.133],[1.649,0.456,0.461,0.477,0.452,0.441],[1.655,0.684,0.699,0.701,0.694,0.689],[0.066,0.028,0.027,0.052,0.027,0.026],[0.592,0.305,0.298,0.317,0.283,0.280],[1.055,0.380,0.374,0.379,0.380,0.373],[2.432,1.642,1.616,1.661,1.662,1.691],[3.238,1.893,1.843,1.854,1.864,1.860],[3.202,1.867,1.842,1.838,1.845,1.837],[0.337,0.227,0.253,0.256,0.214,0.228],[0.141,0.071,0.074,0.075,0.072,0.070],[0.064,0.043,0.037,0.042,0.036,0.043],[0.094,0.033,0.030,0.031,0.029,0.031],[0.286,0.160,0.158,0.144,0.141,0.163],[0.032,0.011,0.011,0.011,0.011,0.011],[0.031,0.012,0.011,0.012,0.011,0.011],[0.016,0.007,0.006,0.007,0.006,0.006],[0.447,0.054,0.060,0.080,0.055,0.055],[0.389,0.077,0.078,0.079,0.081,0.079],[0.127,0.043,0.056,0.066,0.042,0.042],[0.280,0.089,0.088,0.105,0.085,0.086],[0.095,0.037,0.040,0.036,0.037,0.041],[0.199,0.079,0.080,0.078,0.078,0.081],[0.235,0.104,0.103,0.103,0.102,0.104],[0.066,0.048,0.041,0.037,0.037,0.037],[0.118,0.067,0.067,0.065,0.065,0.066],[0.300,0.179,0.181,0.178,0.174,0.177],[0.542,0.211,0.217,0.221,0.210,0.209],[0.452,0.316,0.312,0.310,0.313,0.313],[0.163,0.049,0.049,0.050,0.051,0.050],[0.730,0.382,0.379,0.410,0.370,0.367],[3.227,2.568,2.553,2.552,2.566,2.575],[8.661,1.285,1.278,1.306,1.295,1.275],[2.576,1.370,1.379,1.368,1.367,1.377],[12.877,3.239,3.222,3.236,3.207,3.210],[6.165,5.818,5.800,5.840,5.772,5.766],[4.074,2.115,2.127,2.115,2.127,2.119],[7.676,7.391,7.331,7.423,7.329,7.389],[null,null,null,null,null,null],[5.919,5.567,5.608,5.639,5.583,5.593],[null,null,null,null,null,null],[8.387,7.984,8.022,8.056,8.063,8.037],[null,null,null,null,null,null],[5.854,5.569,5.564,5.551,5.606,5.520],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.747,0.860,0.858,0.635,0.574,0.577],[null,null,null,null,null,null],[2.900,1.965,1.924,1.924,1.955,1.919],[null,null,null,null,null,null],[5.517,3.585,3.620,3.584,3.683,3.648],[0.258,0.094,0.097,0.096,0.093,0.100],[4.506,3.104,3.066,3.096,3.071,3.058],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.628,1.452,1.430,1.444,1.445,1.435],[0.717,0.528,0.516,0.522,0.514,0.517],[1.293,0.610,0.604,0.633,0.610,0.605],[3.505,2.898,2.932,3.016,2.874,2.924],[0.259,0.187,0.175,0.211,0.182,0.176],[0.249,0.121,0.133,0.134,0.114,0.113],[0.484,0.292,0.284,0.285,0.283,0.281],[null,null,null,null,null,null],[3.451,1.999,2.095,2.067,2.109,2.091],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.332,1.110,0.961,0.946,0.948,0.954],[2.253,1.832,1.802,1.841,1.835,1.841],[21.438,20.722,20.879,20.795,21.005,21.102],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.814,0.715,0.697,0.735,0.692,0.689],[1.154,0.713,0.709,0.707,0.706,0.731],[1.698,1.259,1.232,1.245,1.208,1.216],[null,null,null,null,null,null],[10.570,9.719,9.750,9.894,9.827,9.823],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.090,0.779,0.767,0.752,0.734,0.758],[null,null,null,null,null,null],[4.498,2.138,2.091,2.122,2.096,2.129],[null,null,null,null,null,null],[1.923,1.275,1.277,1.244,1.232,1.201],[null,null,null,null,null,null],[0.374,0.263,0.259,0.288,0.262,0.258],[0.382,0.264,0.242,0.256,0.258,0.249],[9.161,7.734,7.744,7.773,7.767,7.715],[9.557,8.345,8.312,8.399,8.345,8.431],[3.152,2.133,2.123,2.144,2.106,2.129],[2.935,2.120,2.100,2.104,2.135,2.110],[4.797,2.093,2.102,2.091,2.021,2.019],[0.907,0.332,0.334,0.334,0.328,0.335],[null,null,null,null,null,null],[1.674,1.101,1.104,1.101,1.100,1.105],[4.366,1.996,1.973,1.955,1.960,1.968],[null,null,null,null,null,null],[1.814,1.241,1.238,1.239,1.267,1.247],[null,null,null,null,null,null],[1.431,0.558,0.565,0.569,0.576,0.568],[1.367,0.592,0.585,0.586,0.582,0.586],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.332,0.202,0.201,0.192,0.199,0.202],[1.315,0.818,0.812,0.814,0.806,0.806],[0.785,0.726,0.702,0.719,0.714,0.702],[0.805,0.722,0.722,0.718,0.726,0.730],[1.316,0.888,0.887,0.890,0.892,0.920],[null,null,null,null,null,null],[1.026,0.674,0.644,0.612,0.641,0.669],[2.715,2.319,2.342,2.305,2.278,2.237],[0.026,0.019,0.018,0.019,0.018,0.020],[0.705,0.534,0.520,0.524,0.534,0.517],[2.175,0.932,0.932,0.939,0.934,0.927],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[2.619,1.504,1.460,1.540,1.457,1.502],[2.939,2.417,2.439,2.413,2.399,2.392],[0.950,0.615,0.583,0.584,0.578,0.602],[0.875,0.415,0.392,0.385,0.391,0.386],[2.195,1.570,1.611,1.558,1.581,1.655],[0.915,0.587,0.633,0.623,0.579,0.569],[1.388,0.551,0.544,0.548,0.549,0.540],[null,null,null,null,null,null],[1.362,0.820,0.800,0.792,0.807,0.789],[2.072,1.662,1.663,1.665,1.669,1.663],[1.367,0.585,0.565,0.559,0.566,0.569],[2.295,1.482,1.448,1.465,1.454,1.451],[0.700,0.535,0.522,0.526,0.533,0.518],[0.929,0.425,0.384,0.380,0.394,0.384],[null,null,null,null,null,null],[34.413,23.838,25.233,26.262,24.517,25.483],[2.625,1.816,1.737,1.841,1.740,1.740],[null,null,null,null,null,null],[2.354,0.774,0.772,0.772,0.763,0.768],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.312,0.502,0.520,0.513,0.508,0.500],[null,null,null,null,null,null],[1.204,0.430,0.420,0.425,0.428,0.428],[6.722,6.308,6.097,6.135,6.218,6.429],[null,null,null,null,null,null],[0.012,0.010,0.010,0.029,0.009,0.010],[1.667,0.553,0.550,0.553,0.556,0.568],[0.023,0.049,0.023,0.022,0.022,0.021],[null,null,null,null,null,null],[5.168,3.139,3.152,3.007,3.000,3.024],[null,null,null,null,null,null],[0.376,0.278,0.257,0.251,0.253,0.257],[0.235,0.149,0.145,0.149,0.147,0.151],[0.231,0.139,0.138,0.135,0.140,0.144],[0.874,0.503,0.501,0.525,0.490,0.494],[null,null,null,null,null,null],[1.281,0.764,0.765,0.770,0.771,0.765],[3.803,3.362,3.333,3.325,3.322,3.341],[1.063,0.532,0.515,0.520,0.522,0.503],[0.304,0.164,0.168,0.154,0.155,0.158],[0.184,0.091,0.089,0.088,0.087,0.087],[null,null,null,null,null,null],[2.390,1.477,1.462,1.512,1.551,1.516],[null,null,null,null,null,null],[6.139,5.686,5.716,5.722,5.623,5.737],[0.717,0.295,0.284,0.279,0.282,0.280],[4.162,3.604,2.670,3.643,3.630,3.603],[null,null,null,null,null,null],[1.256,0.948,0.929,0.925,0.940,0.956],[0.203,0.080,0.073,0.090,0.071,0.069],[0.446,0.319,0.376,0.384,0.371,0.379],[0.115,0.048,0.046,0.044,0.045,0.045],[0.462,0.386,0.386,0.375,0.373,0.387],[0.292,0.149,0.143,0.140,0.143,0.143],[0.273,0.135,0.133,0.136,0.142,0.131],[0.259,0.124,0.125,0.124,0.131,0.131],[null,null,null,null,null,null],[0.780,0.277,0.345,0.288,0.286,0.261],[0.716,0.191,0.190,0.184,0.195,0.186],[1.041,0.507,0.506,0.603,0.484,0.463],[1.614,2.309,1.484,1.462,1.476,1.480],[0.219,0.089,0.086,0.095,0.094,0.093],[2.160,2.005,3.639,2.006,2.031,2.022],[0.623,0.137,0.141,0.135,0.136,0.136],[0.641,0.144,0.132,0.136,0.134,0.188],[0.668,0.178,0.165,0.222,0.166,0.161],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.078,0.763,0.757,0.745,0.761,0.739],[2.448,2.226,2.257,2.144,2.110,2.104],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.298,0.111,0.112,0.110,0.108,0.111],[0.851,0.619,0.672,0.682,0.675,0.697],[0.006,0.006,0.006,0.005,0.005,0.005],[0.006,0.005,0.005,0.006,0.006,0.005],[0.450,0.264,0.261,0.240,0.246,0.264],[null,null,null,null,null,null],[0.732,0.217,0.210,0.213,0.266,0.214],[1.309,0.511,0.518,0.518,0.510,0.552],[0.732,0.240,0.228,0.238,0.292,0.245],[1.233,0.426,0.401,0.393,0.406,0.387],[0.708,0.436,0.436,0.437,0.444,0.432],[0.771,0.440,0.429,0.435,0.438,0.445],[0.870,0.474,0.457,0.473,0.482,0.472],[1.401,0.891,0.915,0.855,0.855,0.832],[1.012,0.402,0.410,0.445,0.398,0.436],[2.080,1.450,1.500,1.423,1.425,1.532],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.316,0.451,0.446,0.434,0.446,0.478],[0.006,0.007,0.006,0.006,0.006,0.006],[0.839,0.243,0.245,0.244,0.240,0.245],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.007,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.007,0.006,0.006,0.006,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.006,0.007,0.007,0.006,0.006,0.006],[0.006,0.006,0.007,0.006,0.006,0.006],[0.007,0.007,0.006,0.006,0.007,0.006],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.289,0.104,0.120,0.103,0.102,0.107],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null]],"version":"24.12.6.70","source":"results/24.12.6.70.json"} +,{"actual_version":"25.1.8.25","data_size":{"coffeeshop":44636557537,"hits":14233746218,"job":1828094510,"mgbench":2954107754,"ontime":2699155844,"ssb":73313386247,"taxi":24223565505,"tpcds":18792561867,"tpch":17234490326,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":877,"hits":228,"job":18,"mgbench":64,"ontime":52,"ssb":1406,"taxi":521,"tpcds":298,"tpch":297,"uk":30},"machine":"c7a.4xlarge","release_date":"2025-03-13","result":[[0.068,0.009,0.009,0.345,0.008,0.009],[0.040,0.017,0.018,0.014,0.014,0.020],[0.050,0.022,0.011,0.032,0.010,0.010],[0.039,0.010,0.010,0.018,0.010,0.010],[0.045,0.024,0.020,0.030,0.020,0.020],[0.071,0.018,0.015,0.026,0.016,0.015],[0.022,0.007,0.007,0.007,0.007,0.007],[0.050,0.015,0.016,0.014,0.016,0.015],[0.069,0.028,0.027,0.039,0.028,0.027],[0.089,0.050,0.048,0.055,0.047,0.046],[0.435,0.379,0.363,0.369,0.326,0.360],[0.366,0.219,0.228,0.224,0.216,0.215],[0.028,0.007,0.007,0.007,0.007,0.007],[0.030,0.012,0.012,0.012,0.015,0.013],[0.676,0.551,0.553,0.555,0.520,0.513],[0.557,0.126,0.125,0.122,0.122,0.123],[0.047,0.014,0.012,0.013,0.012,0.015],[0.060,0.012,0.011,0.012,0.011,0.011],[6.447,1.161,1.170,1.179,1.156,1.145],[4.756,0.873,0.872,0.865,0.874,0.862],[4.772,0.904,0.906,0.901,0.894,0.900],[5.347,1.526,1.517,1.525,1.528,1.522],[6.264,1.263,1.260,1.276,1.268,1.254],[3.973,0.733,0.743,0.728,0.738,0.746],[0.063,0.022,0.020,0.019,0.023,0.025],[7.877,1.741,1.733,1.730,1.708,1.726],[1.849,0.629,0.641,0.633,0.640,0.629],[1.926,0.466,0.472,0.463,0.459,0.461],[0.002,0.002,0.002,0.002,0.002,0.002],[0.022,0.007,0.008,0.007,0.007,0.008],[0.060,0.016,0.015,0.026,0.015,0.018],[0.156,0.026,0.024,0.021,0.020,0.021],[0.189,0.065,0.057,0.055,0.052,0.054],[0.343,0.117,0.118,0.119,0.118,0.117],[0.003,0.002,0.003,0.016,0.002,0.002],[0.023,0.010,0.009,0.010,0.009,0.009],[0.416,0.224,0.240,0.225,0.221,0.223],[0.461,0.259,0.258,0.258,0.258,0.258],[0.207,0.065,0.065,0.063,0.064,0.063],[0.226,0.084,0.081,0.080,0.081,0.080],[0.531,0.281,0.271,0.271,0.281,0.270],[0.740,0.398,0.375,0.391,0.374,0.378],[0.631,0.391,0.397,0.377,0.367,0.393],[0.406,0.223,0.224,0.229,0.225,0.224],[1.380,0.953,0.937,0.941,0.941,0.938],[0.960,0.620,0.606,0.601,0.617,0.605],[2.978,2.022,2.026,2.051,2.065,2.056],[0.159,0.019,0.021,0.019,0.020,0.019],[1.747,0.310,0.338,0.310,0.327,0.337],[1.906,0.347,0.346,0.358,0.352,0.347],[3.926,0.934,0.914,0.933,0.941,0.932],[2.273,0.403,0.398,0.408,0.401,0.413],[0.491,0.096,0.100,0.095,0.093,0.095],[0.291,0.073,0.074,0.077,0.073,0.074],[0.484,0.097,0.101,0.097,0.094,0.103],[1.716,0.323,0.320,0.320,0.308,0.324],[1.690,0.539,0.555,0.534,0.561,0.537],[0.066,0.021,0.021,0.031,0.023,0.027],[0.557,0.233,0.225,0.234,0.230,0.225],[1.058,0.300,0.298,0.309,0.298,0.312],[2.248,1.469,1.452,1.484,1.464,1.460],[3.066,1.623,1.568,1.563,1.564,1.566],[3.082,1.600,1.561,1.561,1.564,1.558],[0.304,0.186,0.194,0.197,0.209,0.212],[0.063,0.029,0.029,0.030,0.027,0.029],[0.041,0.022,0.022,0.022,0.020,0.023],[0.048,0.015,0.015,0.015,0.014,0.015],[0.109,0.055,0.050,0.054,0.050,0.049],[0.025,0.006,0.007,0.006,0.006,0.006],[0.023,0.007,0.007,0.006,0.006,0.006],[0.015,0.004,0.004,0.004,0.004,0.004],[0.430,0.056,0.048,0.053,0.046,0.043],[0.375,0.062,0.061,0.063,0.063,0.061],[0.110,0.035,0.037,0.042,0.034,0.035],[0.262,0.076,0.073,0.081,0.073,0.069],[0.086,0.030,0.032,0.031,0.030,0.035],[0.183,0.068,0.065,0.067,0.064,0.063],[0.212,0.090,0.085,0.083,0.089,0.083],[0.060,0.039,0.031,0.030,0.031,0.032],[0.112,0.056,0.057,0.055,0.055,0.055],[0.257,0.141,0.149,0.141,0.139,0.138],[0.500,0.172,0.170,0.173,0.170,0.173],[0.382,0.248,0.246,0.246,0.245,0.256],[0.156,0.045,0.042,0.042,0.043,0.041],[0.643,0.300,0.300,0.310,0.299,0.290],[2.546,1.849,1.838,1.839,1.857,1.850],[8.675,1.060,1.039,1.078,1.058,1.046],[2.351,1.140,1.122,1.113,1.129,1.134],[12.903,2.585,2.580,2.567,2.591,2.587],[4.279,2.937,2.956,2.919,2.908,2.932],[4.071,1.659,1.656,1.653,1.655,1.679],[3.812,3.552,3.625,3.589,3.597,3.564],[7.007,6.748,6.760,6.764,6.744,6.698],[3.305,2.881,2.979,2.840,2.820,2.831],[5.756,5.500,5.539,5.568,5.532,5.710],[5.027,4.602,4.588,4.594,4.571,4.601],[8.242,8.024,8.105,8.081,8.060,7.930],[3.277,2.941,2.907,2.921,2.926,2.929],[47.060,45.055,45.107,44.985,44.941,44.952],[6.235,5.189,5.144,5.132,5.145,5.166],[2.593,2.426,2.428,2.449,2.444,2.442],[2.400,1.688,1.686,1.672,1.676,1.673],[3.842,3.705,3.709,3.710,3.739,3.753],[14.854,14.881,14.328,14.139,14.087,14.057],[37.848,37.352,36.274,36.712,35.885,35.954],[26.321,23.783,24.043,23.985,24.024,24.062],[2.735,0.695,0.688,0.476,0.449,0.462],[null,null,null,null,null,null],[2.575,1.606,1.620,1.626,1.633,1.607],[null,null,null,null,null,null],[4.202,2.897,2.932,2.908,2.923,2.949],[0.243,0.081,0.081,0.085,0.074,0.084],[3.174,2.269,2.279,2.306,2.269,2.324],[4.727,3.373,3.435,3.404,3.449,3.423],[7.255,5.722,5.664,5.779,5.816,5.755],[2.256,1.084,1.070,1.078,1.061,1.072],[0.540,0.327,0.346,0.345,0.335,0.336],[1.272,0.446,0.440,0.445,0.439,0.439],[3.414,2.840,2.881,2.737,2.777,2.845],[0.199,0.130,0.123,0.122,0.122,0.123],[0.236,0.105,0.103,0.115,0.103,0.098],[0.398,0.219,0.212,0.211,0.210,0.211],[null,null,null,null,null,null],[3.123,1.729,1.762,1.794,1.794,1.788],[4.239,0.927,0.924,0.954,0.942,0.945],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.028,0.767,0.670,0.655,0.676,0.669],[1.994,1.604,1.549,1.555,1.587,1.580],[22.428,21.237,21.548,21.517,21.572,21.424],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.426,0.429,0.405,0.415,0.404,0.407],[0.918,0.471,0.467,0.467,0.458,0.452],[1.458,1.002,0.994,0.980,0.977,1.015],[null,null,null,null,null,null],[8.322,7.491,7.486,7.438,7.482,7.456],[0.234,0.139,0.139,0.138,0.140,0.137],[3.586,1.727,1.737,1.751,1.721,1.703],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.888,0.559,0.562,0.579,0.592,0.562],[null,null,null,null,null,null],[3.104,1.621,1.617,1.685,1.637,1.612],[1.239,0.519,0.533,0.529,0.527,0.510],[1.794,1.099,1.096,1.067,1.062,1.066],[0.388,0.247,0.242,0.246,0.243,0.239],[0.252,0.128,0.125,0.133,0.127,0.132],[0.277,0.171,0.161,0.160,0.163,0.158],[6.658,5.323,5.290,5.294,5.285,5.298],[6.873,5.777,5.771,5.794,5.805,5.812],[2.294,1.423,1.423,1.427,1.438,1.434],[2.263,1.417,1.412,1.420,1.418,1.419],[3.234,1.612,1.635,1.662,1.661,1.641],[0.776,0.224,0.219,0.233,0.249,0.227],[1.420,0.415,0.424,0.408,0.404,0.396],[1.511,0.968,0.955,0.970,0.964,0.962],[3.085,1.622,1.584,1.570,1.610,1.625],[null,null,null,null,null,null],[1.380,0.776,0.770,0.744,0.739,0.782],[null,null,null,null,null,null],[1.166,0.339,0.332,0.318,0.330,0.327],[1.131,0.338,0.327,0.329,0.333,0.324],[null,null,null,null,null,null],[0.984,0.358,0.358,0.355,0.358,0.361],[0.324,0.189,0.186,0.173,0.172,0.184],[3.838,3.659,3.672,3.679,3.673,3.715],[0.481,0.347,0.338,0.334,0.331,0.329],[0.423,0.332,0.325,0.328,0.331,0.329],[0.912,0.513,0.503,0.519,0.513,0.512],[null,null,null,null,null,null],[0.894,0.541,0.547,0.521,0.532,0.554],[2.668,2.266,2.237,2.286,2.253,2.253],[0.539,0.189,0.186,0.184,0.183,0.185],[0.560,0.343,0.345,0.366,0.342,0.349],[1.854,0.569,0.563,0.555,0.552,0.578],[3.248,2.750,2.785,2.778,2.686,2.760],[2.480,1.328,1.341,1.340,1.301,1.302],[null,null,null,null,null,null],[1.827,0.994,0.994,1.013,1.064,1.010],[2.653,2.168,1.815,2.142,2.187,2.130],[0.908,0.568,0.508,0.521,0.550,0.533],[0.788,0.324,0.314,0.301,0.295,0.305],[1.979,1.483,1.409,1.413,1.352,1.428],[0.871,0.557,0.514,0.532,0.543,0.550],[1.190,0.358,0.363,0.358,0.350,0.345],[1.392,1.125,1.102,1.096,1.073,1.087],[1.045,0.428,0.433,0.428,0.425,0.483],[1.603,1.213,1.224,1.225,1.214,1.234],[1.219,0.409,0.384,0.436,0.430,0.393],[1.800,0.923,0.920,0.922,0.923,0.919],[0.420,0.232,0.225,0.225,0.226,0.228],[0.842,0.348,0.318,0.308,0.296,0.295],[5.641,3.323,3.333,3.307,3.284,3.346],[1.040,0.619,0.644,0.591,0.591,0.634],[1.686,0.825,0.786,0.819,0.786,0.792],[15.144,14.393,14.201,14.573,14.172,15.058],[2.357,0.471,0.466,0.463,0.456,0.456],[null,null,null,null,null,null],[0.930,0.505,0.502,0.498,0.505,0.496],[1.097,0.308,0.299,0.292,0.286,0.292],[null,null,null,null,null,null],[1.058,0.267,0.267,0.268,0.270,0.258],[5.872,5.276,5.341,5.156,5.231,5.300],[null,null,null,null,null,null],[0.009,0.009,0.009,0.018,0.009,0.008],[1.593,0.332,0.327,0.325,0.322,0.324],[0.036,0.042,0.032,0.030,0.029,0.031],[1.715,0.482,0.487,0.483,0.480,0.487],[3.903,1.819,1.823,1.812,1.792,1.805],[null,null,null,null,null,null],[0.392,0.261,0.252,0.256,0.246,0.247],[0.198,0.102,0.098,0.101,0.098,0.103],[0.218,0.123,0.128,0.124,0.122,0.127],[0.712,0.359,0.378,0.365,0.384,0.363],[0.173,0.087,0.085,0.085,0.083,0.086],[3.887,3.706,3.672,3.675,3.677,3.701],[2.660,2.167,2.166,2.170,2.165,2.167],[0.868,0.358,0.324,0.331,0.326,0.328],[0.248,0.107,0.102,0.105,0.111,0.109],[0.175,0.078,0.078,0.069,0.071,0.070],[null,null,null,null,null,null],[1.915,1.031,1.034,1.035,1.001,0.982],[null,null,null,null,null,null],[5.544,5.085,5.144,5.098,5.095,5.194],[0.605,0.163,0.164,0.171,0.164,0.164],[3.861,3.286,3.327,3.276,3.286,3.263],[0.730,0.470,0.480,0.459,0.434,0.448],[0.724,0.399,0.405,0.389,0.397,0.399],[0.183,0.066,0.066,0.075,0.068,0.062],[0.324,0.242,0.217,0.251,0.258,0.209],[0.118,0.046,0.043,0.045,0.044,0.045],[0.331,0.253,0.242,0.248,0.240,0.239],[0.249,0.118,0.120,0.115,0.117,0.124],[0.230,0.108,0.110,0.109,0.110,0.107],[0.188,0.076,0.075,0.076,0.075,0.085],[0.434,0.305,0.301,0.300,0.301,0.307],[0.628,0.160,0.150,0.145,0.144,0.149],[0.629,0.141,0.195,0.144,0.142,0.137],[0.657,0.158,0.154,0.162,0.152,0.205],[0.259,0.154,0.151,0.147,0.147,0.155],[0.169,0.051,0.051,0.051,0.050,0.049],[0.304,0.189,0.182,0.184,0.179,0.177],[0.616,0.138,0.138,0.131,0.134,0.132],[0.631,0.177,0.128,0.133,0.128,0.129],[0.602,0.148,0.149,0.147,0.145,0.151],[0.790,0.585,0.592,0.578,0.583,0.573],[0.799,0.605,0.606,0.600,0.604,0.592],[0.738,0.589,0.557,0.561,0.564,0.568],[0.818,0.604,0.604,0.604,0.604,0.595],[0.765,0.575,0.573,0.566,0.559,0.576],[0.865,0.643,0.643,0.661,0.664,0.645],[0.564,0.273,0.264,0.259,0.247,0.259],[0.442,0.260,0.268,0.254,0.255,0.244],[0.873,0.485,0.438,0.444,0.475,0.442],[0.306,0.096,0.090,0.094,0.095,0.094],[0.267,0.082,0.077,0.076,0.077,0.078],[1.156,0.887,0.879,0.894,0.881,0.904],[1.114,0.907,0.869,0.873,0.878,0.893],[0.443,0.153,0.170,0.177,0.166,0.157],[0.422,0.151,0.151,0.150,0.152,0.136],[0.517,0.184,0.193,0.193,0.189,0.187],[0.524,0.223,0.217,0.209,0.218,0.210],[0.301,0.102,0.101,0.099,0.103,0.111],[0.236,0.092,0.095,0.095,0.093,0.084],[0.250,0.111,0.102,0.100,0.104,0.099],[0.007,0.005,0.006,0.005,0.006,0.005],[0.005,0.006,0.005,0.005,0.005,0.005],[0.308,0.118,0.115,0.118,0.109,0.110],[0.917,0.752,0.749,0.762,0.750,0.771],[0.710,0.204,0.203,0.202,0.209,0.255],[3.535,2.839,2.831,2.838,2.872,2.885],[0.720,0.219,0.242,0.227,0.227,0.216],[1.021,0.438,0.408,0.381,0.400,0.400],[0.628,0.439,0.439,0.439,0.438,0.423],[0.631,0.466,0.482,0.419,0.438,0.442],[0.688,0.483,0.455,0.505,0.467,0.470],[0.792,0.290,0.278,0.285,0.266,0.274],[0.768,0.274,0.250,0.243,0.249,0.248],[0.800,0.298,0.286,0.286,0.311,0.279],[0.436,0.154,0.134,0.153,0.126,0.135],[0.434,0.128,0.127,0.120,0.121,0.121],[0.433,0.148,0.135,0.139,0.138,0.130],[0.272,0.118,0.114,0.120,0.119,0.114],[3.147,2.903,2.899,2.870,2.894,2.894],[3.239,2.874,2.871,2.961,2.923,2.896],[3.160,2.882,2.918,2.937,2.914,2.956],[3.151,2.836,2.905,2.918,2.917,2.851],[2.373,2.147,2.118,2.108,2.135,2.176],[4.331,4.160,4.071,4.064,4.070,4.047],[4.309,4.126,4.034,4.048,4.055,4.099],[4.331,4.106,4.059,4.036,4.194,4.179],[2.486,2.147,2.157,2.221,2.166,2.179],[4.355,4.073,4.029,4.072,4.062,4.048],[1.383,0.786,0.722,0.723,0.678,0.723],[0.007,0.007,0.006,0.006,0.006,0.006],[0.783,0.208,0.205,0.197,0.200,0.200],[0.936,0.262,0.247,0.243,0.255,0.253],[0.910,0.246,0.238,0.227,0.232,0.230],[0.956,0.303,0.291,0.283,0.285,0.326],[1.072,0.622,0.623,0.578,0.666,0.578],[1.067,0.750,0.737,0.753,0.747,0.739],[1.003,0.753,0.728,0.713,0.717,0.718],[1.088,0.758,0.754,0.766,0.761,0.754],[0.006,0.007,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.008,0.007,0.006,0.006,0.006],[1.060,0.471,0.419,0.435,0.419,0.413],[1.058,0.443,0.452,0.430,0.421,0.443],[1.155,0.529,0.543,0.519,0.542,0.511],[1.382,0.820,0.810,0.780,0.781,0.754],[0.475,0.169,0.158,0.156,0.150,0.155],[0.468,0.166,0.157,0.148,0.154,0.149],[0.477,0.159,0.154,0.153,0.151,0.170],[1.073,0.386,0.342,0.366,0.379,0.372],[1.032,0.298,0.305,0.306,0.297,0.298],[0.856,0.231,0.211,0.210,0.207,0.214],[0.788,0.217,0.207,0.196,0.199,0.198],[0.862,0.242,0.238,0.245,0.241,0.247],[1.166,0.780,0.779,0.780,0.783,0.773],[1.080,0.778,0.764,0.756,0.772,0.742],[1.102,0.789,0.807,0.780,0.802,0.795],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.007,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.907,0.305,0.297,0.293,0.312,0.297],[0.821,0.245,0.239,0.242,0.237,0.241],[0.935,0.321,0.311,0.316,0.317,0.321],[1.036,0.307,0.302,0.298,0.300,0.364],[1.090,0.299,0.291,0.290,0.290,0.278],[1.215,0.433,0.415,0.416,0.450,0.440],[0.875,0.285,0.333,0.268,0.273,0.273],[0.862,0.266,0.301,0.253,0.246,0.244],[0.979,0.304,0.308,0.302,0.294,0.302],[0.995,0.358,0.299,0.301,0.299,0.305],[0.872,0.250,0.246,0.235,0.234,0.237],[1.027,0.307,0.303,0.306,0.308,0.309],[0.236,0.096,0.091,0.101,0.095,0.091],[0.245,0.105,0.101,0.100,0.099,0.104],[0.495,0.316,0.301,0.312,0.305,0.300],[0.333,0.162,0.162,0.156,0.157,0.176],[0.526,0.357,0.348,0.371,0.365,0.366]],"version":"25.1.8.25","source":"results/25.1.8.25.json"} +,{"actual_version":"25.2.2.39","data_size":{"coffeeshop":44639009285,"hits":14261866336,"job":1828094510,"mgbench":2954141474,"ontime":2699155844,"ssb":73314209169,"taxi":24223625444,"tpcds":18790467361,"tpch":17235079369,"uk":781025377},"kind":"versions-benchmark","load_time":{"coffeeshop":810,"hits":219,"job":16,"mgbench":62,"ontime":56,"ssb":1439,"taxi":527,"tpcds":297,"tpch":292,"uk":36},"machine":"c7a.4xlarge","release_date":"2025-03-13","result":[[0.072,0.009,0.009,0.300,0.009,0.009],[0.035,0.014,0.018,0.017,0.015,0.014],[0.040,0.022,0.010,0.031,0.010,0.010],[0.035,0.010,0.010,0.019,0.010,0.010],[0.043,0.022,0.018,0.029,0.018,0.018],[0.061,0.015,0.016,0.024,0.015,0.015],[0.023,0.006,0.006,0.006,0.006,0.007],[0.046,0.015,0.017,0.018,0.014,0.014],[0.072,0.029,0.028,0.050,0.028,0.027],[0.086,0.054,0.053,0.051,0.054,0.052],[0.437,0.374,0.353,0.358,0.348,0.359],[0.357,0.217,0.225,0.229,0.211,0.214],[0.026,0.007,0.007,0.007,0.007,0.007],[0.028,0.012,0.014,0.012,0.013,0.011],[0.713,0.605,0.582,0.576,0.540,0.567],[0.576,0.127,0.126,0.124,0.139,0.124],[0.042,0.015,0.012,0.013,0.014,0.014],[0.043,0.011,0.011,0.012,0.011,0.011],[6.478,1.189,1.191,1.184,1.193,1.203],[4.776,0.902,0.900,0.890,0.892,0.894],[4.799,0.977,0.912,0.941,0.943,0.952],[5.371,1.666,1.637,1.680,1.643,1.676],[6.267,1.289,1.335,1.289,1.335,1.311],[3.996,0.794,0.784,0.762,0.760,0.795],[0.067,0.025,0.019,0.020,0.020,0.019],[7.907,1.787,1.861,1.834,1.833,1.779],[2.063,0.655,0.680,0.670,0.653,0.660],[1.979,0.488,0.487,0.508,0.497,0.510],[0.002,0.002,0.002,0.002,0.002,0.002],[0.019,0.007,0.007,0.007,0.007,0.008],[0.055,0.019,0.015,0.026,0.017,0.016],[0.148,0.021,0.023,0.021,0.022,0.022],[0.182,0.054,0.057,0.053,0.053,0.054],[0.339,0.123,0.116,0.119,0.122,0.121],[0.002,0.002,0.002,0.016,0.002,0.002],[0.019,0.009,0.009,0.009,0.010,0.009],[0.398,0.228,0.233,0.223,0.225,0.224],[0.462,0.259,0.260,0.261,0.275,0.260],[0.191,0.068,0.069,0.064,0.065,0.065],[0.211,0.083,0.084,0.082,0.084,0.082],[0.534,0.280,0.288,0.279,0.281,0.273],[0.754,0.397,0.394,0.376,0.384,0.391],[0.614,0.385,0.395,0.413,0.379,0.382],[0.386,0.233,0.234,0.238,0.226,0.227],[1.349,0.960,0.952,0.955,0.947,0.961],[0.972,0.637,0.629,0.614,0.610,0.605],[2.986,2.020,2.007,2.028,2.038,2.036],[0.149,0.020,0.021,0.021,0.022,0.020],[1.923,0.370,0.347,0.328,0.341,0.358],[2.161,0.357,0.390,0.363,0.360,0.352],[3.944,0.943,0.926,0.960,0.930,0.933],[2.489,0.430,0.417,0.410,0.430,0.390],[0.506,0.111,0.109,0.103,0.117,0.104],[0.301,0.078,0.078,0.078,0.079,0.082],[0.547,0.106,0.103,0.103,0.101,0.104],[1.901,0.345,0.348,0.339,0.327,0.344],[1.793,0.545,0.527,0.533,0.538,0.535],[0.064,0.024,0.022,0.031,0.021,0.021],[0.589,0.236,0.237,0.234,0.233,0.242],[1.166,0.302,0.306,0.317,0.301,0.307],[2.342,1.451,1.440,1.471,1.472,1.486],[3.174,1.621,1.574,1.583,1.559,1.563],[3.131,1.643,1.625,1.599,1.594,1.617],[0.300,0.204,0.179,0.210,0.188,0.180],[0.056,0.029,0.030,0.032,0.031,0.032],[0.037,0.025,0.024,0.023,0.022,0.022],[0.042,0.014,0.015,0.015,0.014,0.014],[0.104,0.056,0.055,0.049,0.053,0.050],[0.019,0.006,0.006,0.007,0.006,0.006],[0.020,0.007,0.006,0.007,0.007,0.007],[0.012,0.004,0.005,0.004,0.004,0.004],[0.396,0.052,0.052,0.061,0.047,0.044],[0.360,0.067,0.059,0.060,0.068,0.061],[0.099,0.036,0.041,0.043,0.037,0.033],[0.231,0.073,0.071,0.080,0.074,0.071],[0.073,0.031,0.031,0.031,0.033,0.032],[0.169,0.070,0.067,0.066,0.067,0.067],[0.198,0.087,0.093,0.085,0.084,0.084],[0.057,0.030,0.030,0.034,0.031,0.031],[0.108,0.058,0.061,0.058,0.056,0.058],[0.258,0.141,0.142,0.153,0.142,0.141],[0.509,0.178,0.180,0.171,0.176,0.173],[0.388,0.248,0.252,0.252,0.249,0.251],[0.142,0.044,0.048,0.046,0.049,0.045],[0.613,0.313,0.313,0.326,0.319,0.325],[2.565,2.015,1.894,1.909,1.915,1.925],[8.670,1.060,1.050,1.052,1.028,1.061],[2.445,1.131,1.154,1.151,1.147,1.151],[12.910,2.799,2.713,2.734,2.644,2.589],[4.288,3.015,2.996,2.969,2.984,2.961],[4.068,1.734,1.665,1.702,1.726,1.697],[4.000,3.781,3.971,3.927,3.876,3.768],[6.866,6.644,6.659,6.663,6.684,6.618],[3.416,3.033,3.047,2.909,2.849,2.870],[5.493,5.155,5.112,5.183,5.150,5.147],[5.138,4.741,4.993,4.775,4.681,4.658],[8.283,7.886,7.863,7.785,7.878,8.264],[3.390,3.020,2.994,3.024,3.008,3.004],[48.965,47.065,46.404,46.560,46.192,46.588],[6.340,5.104,5.173,5.202,5.208,5.166],[2.672,2.419,2.505,2.547,2.583,2.478],[2.405,1.697,1.695,1.706,1.696,1.703],[3.860,3.650,3.740,3.717,3.711,3.749],[14.636,14.069,13.868,13.816,13.822,14.101],[37.906,37.991,37.633,37.839,37.355,37.325],[26.276,23.609,23.281,23.708,24.042,23.990],[2.750,0.712,0.694,0.463,0.447,0.448],[null,null,null,null,null,null],[2.702,1.576,1.543,1.625,1.647,1.602],[null,null,null,null,null,null],[4.298,2.877,2.928,2.908,2.885,2.959],[0.281,0.076,0.085,0.080,0.081,0.082],[3.238,2.263,2.242,2.270,2.266,2.266],[4.900,3.343,3.398,3.413,3.347,3.401],[7.281,5.622,5.615,5.687,5.834,5.611],[2.295,1.105,1.083,1.082,1.084,1.066],[0.553,0.350,0.350,0.354,0.358,0.360],[1.367,0.568,0.573,0.571,0.569,0.566],[3.512,2.957,2.934,2.850,2.784,2.872],[0.186,0.117,0.118,0.117,0.117,0.116],[0.226,0.118,0.101,0.114,0.101,0.101],[0.396,0.219,0.210,0.214,0.210,0.210],[null,null,null,null,null,null],[3.375,1.755,1.776,1.788,1.799,1.816],[4.272,0.954,0.941,0.948,0.963,0.941],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.045,0.768,0.684,0.684,0.668,0.681],[2.010,1.583,1.572,1.558,1.598,1.570],[22.689,21.147,21.392,21.225,21.304,21.469],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.583,0.419,0.404,0.409,0.400,0.398],[0.957,0.458,0.458,0.461,0.456,0.453],[1.478,1.013,1.006,0.997,0.998,0.991],[null,null,null,null,null,null],[8.221,7.382,7.604,7.432,7.397,7.399],[0.233,0.143,0.142,0.143,0.145,0.141],[3.664,1.714,1.730,1.741,1.738,1.717],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.902,0.562,0.564,0.557,0.557,0.574],[null,null,null,null,null,null],[3.146,1.633,1.661,1.674,1.650,1.643],[1.362,0.509,0.523,0.522,0.510,0.508],[1.827,1.041,1.039,1.050,1.027,1.036],[0.366,0.230,0.232,0.224,0.228,0.228],[0.240,0.128,0.125,0.135,0.126,0.121],[0.280,0.166,0.160,0.159,0.162,0.162],[6.746,5.323,5.298,5.279,5.496,5.376],[7.013,5.761,5.822,5.790,5.769,5.731],[2.377,1.415,1.397,1.435,1.429,1.422],[2.272,1.452,1.450,1.456,1.455,1.438],[3.227,1.588,1.601,1.587,1.607,1.633],[0.908,0.221,0.222,0.222,0.230,0.235],[1.668,0.415,0.408,0.399,0.409,0.401],[1.602,0.977,0.977,0.964,0.980,0.996],[3.112,1.618,1.592,1.603,1.589,1.612],[null,null,null,null,null,null],[1.582,0.831,0.848,0.793,0.768,0.783],[null,null,null,null,null,null],[1.337,0.326,0.326,0.345,0.326,0.319],[1.263,0.359,0.336,0.335,0.331,0.340],[null,null,null,null,null,null],[1.162,0.369,0.367,0.369,0.360,0.355],[0.340,0.187,0.181,0.191,0.179,0.181],[3.912,3.713,3.723,3.709,3.723,3.723],[0.489,0.359,0.344,0.346,0.337,0.343],[0.424,0.339,0.334,0.342,0.337,0.330],[0.914,0.535,0.535,0.541,0.507,0.517],[null,null,null,null,null,null],[0.918,0.552,0.533,0.521,0.524,0.528],[2.736,2.269,2.271,2.237,2.198,2.213],[0.646,0.183,0.184,0.185,0.189,0.181],[0.578,0.365,0.337,0.340,0.349,0.348],[2.056,0.576,0.553,0.551,0.542,0.549],[3.257,2.784,2.748,2.829,2.772,2.800],[2.525,1.329,1.332,1.322,1.332,1.310],[null,null,null,null,null,null],[1.841,0.997,0.998,1.007,1.003,1.042],[2.654,2.206,2.196,2.188,2.191,2.195],[0.932,0.548,0.525,0.519,0.521,0.524],[0.839,0.339,0.332,0.305,0.325,0.289],[1.998,1.417,1.443,1.383,1.333,1.411],[0.881,0.533,0.519,0.553,0.535,0.530],[1.335,0.375,0.366,0.424,0.373,0.352],[1.420,1.152,1.107,1.120,1.116,1.108],[1.135,0.524,0.524,0.500,0.515,0.496],[1.702,1.258,1.239,1.226,1.229,1.223],[1.374,0.404,0.323,0.322,0.390,0.325],[1.862,0.962,0.991,0.949,0.949,0.955],[0.406,0.236,0.237,0.242,0.233,0.246],[0.846,0.317,0.324,0.299,0.294,0.292],[5.879,3.386,3.349,3.407,3.290,3.301],[1.084,0.583,0.584,0.595,0.591,0.593],[1.692,0.840,0.814,0.841,0.801,0.801],[15.346,14.349,14.531,14.173,14.850,14.435],[2.353,0.488,0.486,0.507,0.490,0.463],[null,null,null,null,null,null],[1.035,0.518,0.513,0.516,0.507,0.539],[1.255,0.297,0.294,0.296,0.291,0.286],[null,null,null,null,null,null],[1.239,0.272,0.263,0.257,0.260,0.260],[5.831,5.143,5.165,5.083,5.171,5.114],[null,null,null,null,null,null],[0.010,0.009,0.008,0.018,0.009,0.008],[1.814,0.348,0.347,0.336,0.345,0.323],[0.036,0.043,0.035,0.037,0.032,0.034],[1.954,0.489,0.474,0.476,0.483,0.478],[3.771,1.795,1.770,1.826,1.785,1.789],[null,null,null,null,null,null],[0.381,0.270,0.254,0.247,0.253,0.266],[0.178,0.101,0.100,0.101,0.100,0.103],[0.213,0.131,0.130,0.121,0.134,0.125],[0.738,0.405,0.397,0.407,0.401,0.395],[0.178,0.090,0.087,0.084,0.086,0.086],[3.902,3.691,3.729,3.713,3.764,3.710],[2.699,2.173,2.152,2.208,2.172,2.151],[0.944,0.356,0.327,0.331,0.366,0.337],[0.261,0.108,0.105,0.106,0.105,0.106],[0.170,0.075,0.071,0.065,0.070,0.065],[null,null,null,null,null,null],[2.007,1.015,1.004,1.009,0.995,1.004],[null,null,null,null,null,null],[5.383,5.087,5.095,5.265,5.094,5.116],[0.665,0.163,0.165,0.164,0.166,0.165],[3.846,3.304,3.268,3.281,3.306,3.296],[0.754,0.435,0.449,0.440,0.454,0.455],[0.737,0.395,0.409,0.412,0.403,0.397],[0.183,0.068,0.068,0.073,0.060,0.064],[0.307,0.243,0.234,0.238,0.240,0.232],[0.116,0.044,0.045,0.048,0.052,0.045],[0.314,0.240,0.210,0.227,0.215,0.229],[0.237,0.129,0.118,0.115,0.116,0.121],[0.243,0.109,0.119,0.114,0.110,0.111],[0.191,0.088,0.080,0.084,0.074,0.070],[0.424,0.298,0.306,0.314,0.302,0.302],[0.700,0.150,0.149,0.154,0.143,0.147],[0.717,0.151,0.141,0.139,0.136,0.136],[0.801,0.167,0.161,0.158,0.156,0.151],[0.247,0.154,0.149,0.148,0.151,0.154],[0.158,0.053,0.053,0.052,0.051,0.051],[0.287,0.190,0.181,0.182,0.170,0.181],[0.661,0.138,0.136,0.130,0.133,0.137],[0.600,0.137,0.124,0.129,0.126,0.125],[0.638,0.149,0.147,0.139,0.147,0.151],[0.761,0.575,0.561,0.556,0.563,0.559],[0.786,0.608,0.599,0.590,0.594,0.588],[0.718,0.567,0.552,0.559,0.573,0.564],[0.811,0.623,0.627,0.614,0.630,0.604],[0.758,0.588,0.569,0.568,0.576,0.574],[0.875,0.665,0.657,0.644,0.645,0.650],[0.525,0.259,0.288,0.263,0.258,0.261],[0.450,0.253,0.254,0.287,0.251,0.234],[0.828,0.462,0.490,0.476,0.447,0.517],[0.319,0.092,0.092,0.088,0.095,0.097],[0.280,0.079,0.083,0.084,0.080,0.076],[1.141,0.857,0.860,0.867,0.865,0.890],[1.085,0.869,0.846,0.843,0.857,0.850],[0.459,0.167,0.176,0.170,0.174,0.159],[0.427,0.140,0.141,0.138,0.137,0.136],[0.522,0.192,0.191,0.208,0.185,0.189],[0.548,0.221,0.207,0.207,0.230,0.206],[0.303,0.111,0.100,0.105,0.100,0.099],[0.235,0.096,0.091,0.086,0.096,0.092],[0.241,0.114,0.101,0.099,0.100,0.095],[0.006,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.006,0.005,0.005],[0.305,0.115,0.109,0.110,0.125,0.116],[0.919,0.740,0.763,0.717,0.730,0.712],[0.771,0.210,0.199,0.204,0.206,0.199],[3.591,2.775,2.776,2.779,2.775,2.823],[0.753,0.246,0.222,0.233,0.221,0.210],[1.086,0.403,0.401,0.387,0.370,0.379],[0.614,0.463,0.427,0.431,0.456,0.422],[0.596,0.433,0.425,0.428,0.422,0.451],[0.652,0.541,0.461,0.461,0.460,0.449],[0.825,0.287,0.278,0.274,0.287,0.341],[0.794,0.245,0.239,0.237,0.241,0.296],[0.891,0.266,0.277,0.273,0.270,0.282],[0.469,0.138,0.147,0.129,0.125,0.129],[0.480,0.122,0.124,0.119,0.124,0.118],[0.444,0.142,0.139,0.129,0.131,0.128],[0.273,0.117,0.115,0.114,0.127,0.124],[3.076,2.823,2.895,2.866,2.802,2.834],[3.175,2.862,2.858,2.844,2.875,2.865],[3.131,2.853,2.881,2.824,2.826,2.865],[3.038,2.760,2.824,2.798,2.793,2.841],[2.311,2.083,2.115,2.105,2.111,2.097],[4.224,3.962,4.014,4.022,4.011,4.045],[4.292,4.028,4.003,3.997,4.016,4.055],[4.290,4.028,3.994,4.053,3.955,3.962],[2.393,2.118,2.107,2.123,2.145,2.144],[4.285,3.984,4.107,4.129,4.132,4.109],[1.388,0.749,0.727,0.676,0.725,0.708],[0.006,0.006,0.006,0.006,0.006,0.006],[0.793,0.204,0.207,0.198,0.210,0.203],[1.016,0.267,0.269,0.250,0.264,0.246],[1.037,0.248,0.239,0.244,0.241,0.235],[1.041,0.299,0.290,0.301,0.292,0.280],[1.141,0.692,0.652,0.688,0.606,0.626],[1.060,0.747,0.730,0.740,0.755,0.738],[1.007,0.733,0.712,0.712,0.718,0.750],[1.085,0.777,0.775,0.778,0.773,0.789],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.007,0.006,0.006,0.006,0.006,0.006],[1.087,0.432,0.427,0.427,0.424,0.424],[0.993,0.454,0.418,0.421,0.457,0.417],[1.135,0.546,0.587,0.506,0.533,0.509],[1.452,0.734,0.756,0.744,0.771,0.755],[0.472,0.154,0.151,0.148,0.153,0.151],[0.493,0.161,0.162,0.150,0.150,0.147],[0.507,0.159,0.181,0.160,0.148,0.157],[1.125,0.382,0.372,0.382,0.380,0.368],[1.124,0.309,0.307,0.299,0.302,0.352],[0.970,0.224,0.215,0.209,0.219,0.269],[0.925,0.228,0.203,0.195,0.249,0.200],[0.932,0.302,0.249,0.246,0.249,0.250],[1.183,0.803,0.783,0.797,0.786,0.791],[1.098,0.748,0.753,0.753,0.745,0.749],[1.119,0.806,0.788,0.778,0.783,0.784],[0.007,0.006,0.006,0.007,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.007,0.006,0.006,0.007,0.006],[0.951,0.295,0.348,0.299,0.290,0.291],[0.920,0.276,0.246,0.241,0.231,0.237],[0.987,0.388,0.328,0.327,0.328,0.328],[1.147,0.310,0.312,0.302,0.292,0.303],[1.163,0.290,0.281,0.276,0.339,0.283],[1.414,0.477,0.417,0.447,0.441,0.437],[0.977,0.296,0.297,0.285,0.283,0.282],[0.964,0.254,0.252,0.261,0.248,0.242],[1.055,0.315,0.314,0.311,0.318,0.306],[1.034,0.302,0.302,0.295,0.304,0.309],[0.933,0.244,0.244,0.237,0.231,0.235],[1.046,0.319,0.321,0.307,0.305,0.313],[0.242,0.096,0.087,0.086,0.088,0.088],[0.252,0.107,0.102,0.102,0.105,0.096],[0.462,0.296,0.304,0.302,0.302,0.300],[0.330,0.165,0.152,0.158,0.162,0.156],[0.504,0.369,0.391,0.356,0.355,0.362]],"version":"25.2.2.39","source":"results/25.2.2.39.json"} +,{"actual_version":"25.4.13.22","data_size":{"coffeeshop":44640624792,"hits":14248643967,"job":1828094510,"mgbench":2953750291,"ontime":2699155844,"ssb":73313166883,"taxi":24223571015,"tpcds":18791590778,"tpch":17232881253,"uk":781025370},"kind":"versions-benchmark","load_time":{"coffeeshop":799,"hits":218,"job":16,"mgbench":64,"ontime":57,"ssb":1425,"taxi":529,"tpcds":302,"tpch":285,"uk":29},"machine":"c7a.4xlarge","release_date":"2025-07-24","result":[[0.058,0.006,0.007,0.294,0.007,0.006],[0.038,0.012,0.013,0.014,0.010,0.011],[0.041,0.018,0.008,0.030,0.008,0.007],[0.033,0.009,0.008,0.023,0.008,0.009],[0.041,0.022,0.024,0.042,0.022,0.020],[0.059,0.015,0.019,0.035,0.016,0.015],[0.021,0.005,0.005,0.005,0.005,0.005],[0.046,0.006,0.006,0.006,0.005,0.006],[0.064,0.006,0.006,0.051,0.006,0.006],[0.083,0.052,0.050,0.050,0.049,0.052],[0.246,0.184,0.172,0.175,0.185,0.173],[0.339,0.208,0.228,0.220,0.201,0.204],[0.024,0.006,0.006,0.007,0.007,0.007],[0.028,0.012,0.012,0.012,0.012,0.014],[0.634,0.537,0.541,0.554,0.511,0.504],[0.472,0.079,0.076,0.085,0.084,0.088],[0.047,0.013,0.014,0.013,0.014,0.012],[0.038,0.012,0.012,0.011,0.012,0.012],[6.464,1.137,1.123,1.146,1.134,1.129],[4.752,0.867,0.857,0.855,0.868,0.860],[4.763,0.877,0.899,0.877,0.881,0.885],[5.340,1.450,1.468,1.462,1.451,1.463],[6.236,1.228,1.223,1.234,1.212,1.215],[3.969,0.629,0.628,0.623,0.625,0.614],[0.057,0.018,0.019,0.016,0.019,0.020],[7.896,1.683,1.695,1.708,1.698,1.681],[1.833,0.526,0.548,0.527,0.524,0.531],[1.916,0.368,0.366,0.369,0.366,0.366],[0.002,0.002,0.002,0.002,0.002,0.002],[0.020,0.005,0.005,0.005,0.005,0.006],[0.049,0.014,0.015,0.034,0.014,0.016],[0.132,0.021,0.023,0.022,0.020,0.020],[0.164,0.051,0.057,0.054,0.051,0.052],[0.295,0.112,0.121,0.119,0.113,0.111],[0.004,0.002,0.002,0.021,0.002,0.002],[0.018,0.007,0.007,0.007,0.007,0.008],[0.374,0.221,0.216,0.218,0.219,0.233],[0.420,0.250,0.248,0.249,0.252,0.249],[0.180,0.063,0.063,0.064,0.066,0.063],[0.195,0.078,0.079,0.078,0.083,0.080],[0.494,0.270,0.269,0.268,0.283,0.268],[0.680,0.369,0.367,0.368,0.365,0.357],[0.583,0.408,0.401,0.363,0.413,0.366],[0.371,0.271,0.272,0.222,0.220,0.220],[1.400,0.941,0.936,1.137,1.166,0.921],[1.113,0.838,0.829,0.819,0.681,0.757],[2.877,1.978,1.997,2.008,2.016,2.010],[0.130,0.002,0.002,0.002,0.002,0.002],[1.495,0.025,0.031,0.025,0.029,0.025],[1.736,0.011,0.013,0.025,0.013,0.013],[3.928,0.740,0.722,0.740,0.729,0.731],[0.747,0.641,0.648,0.647,0.658,0.650],[0.418,0.098,0.095,0.095,0.094,0.096],[0.253,0.073,0.074,0.075,0.073,0.073],[0.418,0.098,0.102,0.102,0.095,0.096],[1.473,0.280,0.279,0.298,0.323,0.311],[1.453,0.474,0.463,0.477,0.468,0.463],[0.058,0.020,0.020,0.041,0.021,0.021],[0.514,0.250,0.242,0.225,0.225,0.224],[0.917,0.299,0.334,0.320,0.309,0.325],[2.111,1.430,1.397,1.414,1.417,1.425],[2.624,1.399,1.337,1.328,1.331,1.347],[2.668,1.461,1.336,1.328,1.348,1.325],[0.281,0.214,0.219,0.184,0.187,0.206],[0.051,0.026,0.026,0.025,0.024,0.025],[0.034,0.021,0.019,0.016,0.018,0.023],[0.044,0.015,0.014,0.012,0.013,0.016],[0.095,0.053,0.047,0.046,0.048,0.045],[0.023,0.004,0.004,0.004,0.004,0.004],[0.019,0.003,0.004,0.003,0.004,0.004],[0.012,0.004,0.003,0.003,0.003,0.003],[0.362,0.038,0.036,0.068,0.035,0.039],[0.312,0.051,0.053,0.053,0.053,0.054],[0.093,0.031,0.032,0.055,0.030,0.032],[0.210,0.058,0.058,0.078,0.058,0.055],[0.074,0.030,0.032,0.030,0.030,0.034],[0.160,0.065,0.064,0.064,0.065,0.064],[0.186,0.083,0.082,0.091,0.086,0.085],[0.053,0.032,0.029,0.029,0.030,0.030],[0.110,0.054,0.054,0.063,0.054,0.053],[0.264,0.135,0.140,0.136,0.136,0.140],[0.412,0.153,0.150,0.148,0.149,0.148],[0.342,0.248,0.240,0.245,0.239,0.242],[0.121,0.030,0.030,0.031,0.032,0.031],[0.576,0.283,0.285,0.294,0.273,0.273],[2.336,1.796,1.787,1.807,1.821,1.799],[8.682,0.966,0.967,1.008,0.963,1.004],[2.023,1.038,1.032,1.028,1.024,1.024],[12.897,2.450,2.447,2.437,2.473,2.469],[4.270,2.886,2.881,2.889,2.870,2.886],[4.061,1.555,1.547,1.560,1.542,1.574],[3.631,3.406,3.403,3.451,3.403,3.393],[5.867,5.592,5.636,5.607,5.570,5.568],[3.299,2.836,2.832,2.841,2.811,2.854],[4.465,4.195,4.192,4.186,4.213,4.196],[4.557,4.268,4.238,4.297,4.245,4.242],[7.141,6.829,6.851,6.819,6.824,6.798],[3.076,2.770,2.759,2.751,2.791,2.764],[47.649,45.704,45.339,45.789,45.567,45.197],[6.215,4.861,4.843,4.871,4.866,4.838],[2.476,2.326,2.322,2.350,2.335,2.328],[2.386,1.636,1.631,1.632,1.648,1.639],[3.412,3.280,3.273,3.271,3.271,3.302],[12.306,11.956,11.947,11.905,11.973,11.912],[37.906,36.781,37.368,36.189,36.565,36.273],[26.301,23.865,24.019,24.023,24.039,24.022],[2.693,0.637,0.623,0.415,0.396,0.401],[null,null,null,null,null,null],[2.336,1.588,1.548,1.549,1.531,1.541],[null,null,null,null,null,null],[3.934,2.833,2.892,2.870,2.894,2.872],[0.197,0.074,0.077,0.074,0.078,0.077],[2.934,2.238,2.201,2.221,2.243,2.215],[4.479,3.313,3.341,3.434,3.353,3.343],[6.581,5.174,5.341,5.360,5.332,5.458],[1.987,1.095,1.067,1.053,1.073,1.063],[0.542,0.374,0.387,0.363,0.368,0.355],[1.136,0.364,0.372,0.393,0.372,0.368],[3.154,1.921,1.965,1.661,1.993,1.974],[0.174,0.122,0.115,0.110,0.110,0.116],[0.202,0.101,0.097,0.118,0.102,0.105],[0.370,0.214,0.213,0.215,0.211,0.213],[null,null,null,null,null,null],[2.109,1.201,1.189,1.234,1.205,1.194],[4.144,0.972,0.951,0.981,0.955,0.958],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.891,0.634,0.544,0.545,0.552,0.552],[1.515,1.144,1.144,1.200,1.146,1.158],[18.189,16.781,16.884,16.974,17.108,16.984],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.384,0.400,0.392,0.403,0.378,0.374],[0.840,0.445,0.439,0.440,0.448,0.440],[1.383,1.006,1.022,1.025,1.009,0.999],[null,null,null,null,null,null],[6.577,5.791,5.719,5.849,5.762,5.837],[0.228,0.137,0.129,0.134,0.134,0.130],[3.179,1.851,1.732,1.760,1.700,1.730],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.907,0.527,0.523,0.528,0.534,0.526],[null,null,null,null,null,null],[2.912,1.765,1.748,1.714,1.714,1.764],[1.197,0.583,0.584,0.604,0.577,0.576],[1.479,0.879,0.847,0.867,0.848,0.819],[0.341,0.222,0.215,0.207,0.220,0.212],[0.221,0.111,0.115,0.133,0.113,0.109],[0.286,0.177,0.156,0.161,0.166,0.159],[6.467,5.224,5.212,5.215,5.155,5.139],[6.605,5.708,5.676,5.656,5.660,5.719],[2.186,1.489,1.506,1.502,1.500,1.490],[2.138,1.504,1.500,1.509,1.507,1.514],[3.041,1.675,1.699,1.707,1.735,1.742],[0.722,0.197,0.196,0.198,0.202,0.205],[1.284,0.380,0.377,0.379,0.378,0.384],[1.421,0.956,0.957,0.969,0.950,0.957],[2.665,1.674,1.677,1.709,1.761,1.699],[null,null,null,null,null,null],[1.408,0.892,0.865,0.855,0.869,0.854],[null,null,null,null,null,null],[1.146,0.297,0.296,0.297,0.304,0.304],[1.031,0.333,0.360,0.333,0.331,0.339],[null,null,null,null,null,null],[0.959,0.373,0.377,0.374,0.374,0.375],[0.311,0.196,0.183,0.180,0.184,0.174],[4.895,4.798,4.692,4.682,4.748,4.769],[0.455,0.346,0.334,0.328,0.335,0.339],[0.417,0.354,0.338,0.329,0.331,0.341],[0.866,0.508,0.507,0.508,0.507,0.513],[null,null,null,null,null,null],[0.773,0.454,0.447,0.430,0.470,0.426],[2.011,1.626,1.636,1.614,1.606,1.625],[0.477,0.179,0.180,0.191,0.200,0.180],[0.537,0.348,0.352,0.346,0.343,0.346],[1.722,0.564,0.557,0.557,0.557,0.563],[null,null,null,null,null,null],[2.266,1.266,1.346,1.262,1.298,1.245],[null,null,null,null,null,null],[1.718,1.024,1.019,1.054,1.024,1.027],[2.597,2.174,2.171,2.140,2.123,2.125],[0.779,0.444,0.449,0.431,0.445,0.439],[0.718,0.334,0.321,0.345,0.313,0.299],[1.811,1.283,1.239,1.249,1.266,1.242],[0.713,0.436,0.437,0.443,0.443,0.445],[1.126,0.311,0.353,0.335,0.325,0.326],[null,null,null,null,null,null],[0.902,0.385,0.379,0.376,0.387,0.377],[1.449,1.074,1.066,1.081,1.079,1.069],[1.152,0.332,0.346,0.343,0.344,0.334],[1.759,0.895,0.899,0.888,0.894,0.888],[0.386,0.225,0.223,0.220,0.218,0.218],[0.779,0.331,0.307,0.310,0.303,0.298],[5.465,3.557,3.510,3.550,3.512,3.612],[1.018,0.484,0.488,0.487,0.481,0.492],[1.543,0.799,0.753,0.781,0.747,0.766],[14.305,13.690,14.150,13.355,13.502,14.093],[2.326,0.494,0.487,0.483,0.504,0.487],[null,null,null,null,null,null],[0.913,0.558,0.561,0.541,0.545,0.546],[1.112,0.275,0.271,0.273,0.276,0.271],[null,null,null,null,null,null],[1.001,0.283,0.282,0.284,0.285,0.291],[4.836,4.258,4.286,4.237,4.254,4.308],[null,null,null,null,null,null],[0.009,0.009,0.008,0.025,0.008,0.009],[1.576,0.327,0.330,0.342,0.331,0.328],[0.033,0.045,0.029,0.028,0.027,0.027],[1.668,0.473,0.472,0.470,0.479,0.473],[3.595,1.911,1.861,1.898,1.884,1.931],[null,null,null,null,null,null],[0.354,0.262,0.261,0.261,0.250,0.255],[0.167,0.093,0.089,0.085,0.097,0.093],[0.211,0.120,0.119,0.115,0.124,0.119],[0.726,0.410,0.408,0.431,0.401,0.412],[0.171,0.089,0.085,0.091,0.090,0.088],[4.903,4.632,4.740,4.674,4.715,4.702],[2.803,1.947,1.935,1.924,1.922,1.923],[0.824,0.371,0.355,0.343,0.350,0.355],[0.249,0.096,0.091,0.087,0.086,0.084],[0.156,0.067,0.066,0.060,0.059,0.063],[null,null,null,null,null,null],[1.794,0.958,0.956,0.964,0.971,0.955],[null,null,null,null,null,null],[5.291,5.262,5.304,5.363,5.376,5.283],[0.558,0.150,0.150,0.151,0.154,0.149],[3.757,3.175,3.213,3.233,2.276,3.215],[0.628,0.429,0.411,0.413,0.465,0.450],[0.678,0.383,0.384,0.383,0.381,0.383],[0.179,0.061,0.056,0.075,0.076,0.056],[0.286,0.220,0.211,0.234,0.214,0.219],[0.111,0.041,0.039,0.039,0.038,0.037],[0.317,0.256,0.231,0.235,0.242,0.214],[0.198,0.088,0.089,0.095,0.095,0.099],[0.170,0.103,0.097,0.119,0.103,0.106],[0.135,0.084,0.077,0.073,0.072,0.078],[0.196,0.130,0.131,0.115,0.120,0.114],[0.562,0.065,0.063,0.065,0.065,0.067],[0.562,0.053,0.053,0.052,0.050,0.057],[0.629,0.080,0.071,0.071,0.066,0.073],[0.232,0.143,0.135,0.139,0.145,0.137],[0.152,0.045,0.045,0.049,0.042,0.043],[0.306,0.172,0.164,0.166,0.166,0.168],[0.558,0.047,0.045,0.042,0.044,0.042],[0.630,0.037,0.038,0.036,0.037,0.037],[0.570,0.062,0.060,0.059,0.066,0.061],[0.706,0.505,0.507,0.508,0.503,0.497],[0.718,0.534,0.516,0.517,0.524,0.514],[0.619,0.495,0.488,0.483,0.494,0.481],[0.693,0.551,0.546,0.547,0.537,0.541],[0.628,0.513,0.515,0.511,0.517,0.512],[0.789,0.607,0.609,0.596,0.597,0.608],[0.480,0.234,0.220,0.223,0.225,0.219],[0.380,0.232,0.228,0.215,0.253,0.221],[0.683,0.379,0.357,0.398,0.356,0.435],[0.277,0.077,0.076,0.076,0.082,0.068],[0.216,0.050,0.047,0.045,0.047,0.047],[1.115,0.860,0.854,0.852,0.852,0.853],[1.002,0.861,0.839,0.831,0.832,0.838],[0.400,0.143,0.140,0.143,0.160,0.149],[0.387,0.115,0.118,0.118,0.119,0.116],[0.430,0.176,0.171,0.170,0.167,0.167],[0.406,0.193,0.179,0.189,0.203,0.182],[0.258,0.086,0.082,0.081,0.085,0.081],[0.216,0.083,0.086,0.073,0.075,0.078],[0.197,0.098,0.096,0.089,0.088,0.097],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[0.297,0.116,0.112,0.110,0.108,0.109],[0.402,0.320,0.305,0.321,0.317,0.322],[0.629,0.101,0.099,0.104,0.103,0.099],[1.110,0.728,0.723,0.699,0.640,0.680],[0.624,0.135,0.130,0.141,0.109,0.135],[0.856,0.336,0.306,0.313,0.325,0.316],[0.350,0.245,0.242,0.232,0.232,0.237],[0.343,0.239,0.223,0.231,0.231,0.236],[0.382,0.264,0.266,0.259,0.256,0.254],[0.707,0.174,0.178,0.173,0.173,0.161],[0.265,0.134,0.143,0.139,0.141,0.133],[0.710,0.174,0.173,0.165,0.163,0.171],[0.373,0.079,0.084,0.079,0.083,0.086],[0.211,0.086,0.082,0.073,0.077,0.069],[0.392,0.100,0.104,0.104,0.096,0.098],[0.213,0.098,0.096,0.107,0.094,0.100],[3.073,2.600,2.578,2.568,2.579,2.592],[2.831,2.614,2.638,2.609,2.601,2.611],[2.797,2.615,2.622,2.611,2.610,2.627],[2.773,2.588,2.600,2.594,2.591,2.597],[2.268,1.865,1.849,1.854,1.842,1.855],[3.610,3.447,3.440,3.406,3.440,3.412],[3.632,3.424,3.429,3.404,3.429,3.427],[3.657,3.408,3.441,3.414,3.435,3.419],[2.081,1.873,1.878,1.873,1.879,1.882],[3.654,3.477,3.478,3.484,3.475,3.470],[1.173,0.560,0.535,0.546,0.546,0.546],[0.006,0.006,0.006,0.007,0.006,0.006],[0.688,0.107,0.103,0.099,0.104,0.097],[0.832,0.159,0.160,0.152,0.152,0.149],[0.767,0.122,0.116,0.121,0.118,0.117],[0.432,0.187,0.180,0.176,0.189,0.183],[0.799,0.503,0.478,0.490,0.488,0.476],[0.929,0.628,0.617,0.607,0.618,0.617],[0.832,0.612,0.584,0.595,0.590,0.582],[0.944,0.620,0.638,0.628,0.627,0.645],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.005,0.006],[0.796,0.180,0.175,0.184,0.171,0.180],[0.345,0.176,0.190,0.174,0.183,0.176],[0.773,0.213,0.196,0.194,0.201,0.193],[0.389,0.245,0.258,0.248,0.240,0.248],[0.441,0.107,0.108,0.122,0.103,0.104],[0.422,0.102,0.106,0.114,0.106,0.103],[0.250,0.119,0.133,0.107,0.113,0.105],[0.955,0.233,0.228,0.232,0.232,0.233],[0.467,0.182,0.183,0.180,0.181,0.181],[0.708,0.128,0.119,0.119,0.123,0.128],[0.247,0.098,0.092,0.097,0.098,0.098],[0.746,0.139,0.138,0.137,0.136,0.132],[0.945,0.647,0.644,0.636,0.640,0.622],[0.884,0.616,0.618,0.614,0.635,0.625],[0.890,0.667,0.647,0.637,0.643,0.642],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.824,0.199,0.216,0.208,0.186,0.205],[0.690,0.149,0.135,0.140,0.148,0.146],[0.365,0.237,0.229,0.235,0.221,0.225],[0.956,0.185,0.186,0.178,0.177,0.185],[0.906,0.192,0.177,0.186,0.173,0.175],[0.634,0.323,0.312,0.304,0.296,0.304],[0.791,0.165,0.156,0.169,0.165,0.160],[0.304,0.137,0.139,0.133,0.136,0.131],[0.820,0.201,0.187,0.181,0.187,0.202],[0.841,0.218,0.189,0.187,0.190,0.188],[0.314,0.113,0.116,0.120,0.116,0.121],[0.859,0.209,0.211,0.199,0.199,0.205],[0.166,0.078,0.079,0.078,0.079,0.086],[0.176,0.093,0.092,0.095,0.083,0.089],[0.352,0.174,0.174,0.173,0.173,0.187],[0.266,0.165,0.146,0.140,0.136,0.147],[0.298,0.211,0.200,0.191,0.186,0.186]],"version":"25.4.13.22","source":"results/25.4.13.22.json"} +,{"actual_version":"25.8.24.21","data_size":{"coffeeshop":44633488447,"hits":14330138267,"job":1828094569,"mgbench":2948783326,"ontime":2699312914,"ssb":73068247417,"taxi":24223358847,"tpcds":18793957573,"tpch":17234372934,"uk":780916031},"kind":"versions-benchmark","load_time":{"coffeeshop":765,"hits":240,"job":18,"mgbench":62,"ontime":56,"ssb":1392,"taxi":525,"tpcds":308,"tpch":293,"uk":32},"machine":"c7a.4xlarge","release_date":"2025-08-29","result":[[0.090,0.007,0.007,0.344,0.007,0.007],[0.023,0.003,0.003,0.003,0.003,0.004],[0.048,0.021,0.010,0.030,0.009,0.008],[0.044,0.011,0.009,0.009,0.008,0.009],[0.051,0.024,0.025,0.038,0.016,0.022],[0.070,0.016,0.016,0.035,0.014,0.015],[0.024,0.007,0.005,0.004,0.005,0.005],[0.050,0.005,0.005,0.005,0.005,0.005],[0.075,0.006,0.005,0.065,0.006,0.005],[0.091,0.049,0.047,0.050,0.047,0.047],[0.276,0.181,0.182,0.177,0.178,0.179],[0.370,0.208,0.221,0.224,0.205,0.196],[0.027,0.005,0.006,0.005,0.005,0.005],[0.031,0.011,0.010,0.011,0.012,0.010],[0.675,0.518,0.530,0.535,0.494,0.495],[0.612,0.080,0.084,0.088,0.078,0.084],[0.055,0.032,0.013,0.014,0.016,0.014],[0.047,0.013,0.014,0.014,0.014,0.014],[6.460,1.095,1.083,1.107,1.095,1.087],[4.773,0.828,0.837,0.834,0.850,0.833],[4.753,0.862,0.870,0.871,0.873,0.866],[5.361,1.404,1.414,1.391,1.394,1.390],[6.252,1.205,1.179,1.178,1.180,1.189],[3.971,0.631,0.603,0.597,0.596,0.590],[0.076,0.020,0.021,0.021,0.017,0.018],[7.812,1.649,1.639,1.660,1.643,1.642],[2.235,0.516,0.505,0.510,0.507,0.517],[2.076,0.363,0.353,0.353,0.354,0.353],[0.001,0.001,0.001,0.001,0.001,0.002],[0.023,0.006,0.006,0.006,0.005,0.006],[0.061,0.016,0.014,0.036,0.016,0.016],[0.169,0.023,0.020,0.020,0.020,0.019],[0.199,0.054,0.056,0.051,0.052,0.053],[0.347,0.106,0.111,0.109,0.105,0.110],[0.004,0.002,0.002,0.022,0.002,0.002],[0.022,0.007,0.007,0.007,0.007,0.008],[0.391,0.219,0.220,0.215,0.217,0.216],[0.462,0.253,0.253,0.252,0.253,0.255],[0.212,0.062,0.061,0.061,0.061,0.060],[0.233,0.076,0.075,0.075,0.081,0.077],[0.515,0.276,0.258,0.254,0.258,0.257],[0.784,0.381,0.375,0.370,0.397,0.362],[0.583,0.337,0.312,0.309,0.320,0.298],[0.377,0.178,0.181,0.182,0.176,0.177],[1.239,0.775,0.760,0.760,0.770,0.766],[0.770,0.431,0.417,0.428,0.423,0.430],[2.397,1.441,1.655,1.478,1.444,1.689],[0.177,0.002,0.002,0.002,0.002,0.002],[1.951,0.024,0.028,0.032,0.027,0.031],[2.165,0.007,0.008,0.023,0.008,0.008],[3.994,0.730,0.730,0.736,0.724,0.729],[1.108,0.097,0.093,0.096,0.100,0.094],[0.492,0.094,0.093,0.095,0.097,0.096],[0.299,0.077,0.072,0.071,0.071,0.072],[0.506,0.093,0.093,0.093,0.097,0.093],[2.018,0.286,0.284,0.333,0.305,0.309],[1.853,0.465,0.461,0.466,0.456,0.457],[0.065,0.020,0.023,0.620,0.020,0.021],[0.562,0.231,0.236,0.234,0.224,0.220],[1.176,0.335,0.279,0.315,0.335,0.273],[2.276,1.466,1.538,1.457,1.448,1.514],[3.097,1.362,1.698,1.576,1.455,1.375],[3.088,1.534,1.574,1.673,1.603,1.549],[0.270,0.177,0.172,0.173,0.187,0.169],[0.107,0.046,0.052,0.053,0.048,0.045],[0.045,0.028,0.027,0.028,0.024,0.029],[0.068,0.020,0.019,0.019,0.018,0.019],[0.190,0.099,0.096,0.093,0.097,0.093],[0.036,0.004,0.004,0.004,0.004,0.003],[0.026,0.004,0.003,0.003,0.004,0.003],[0.015,0.003,0.003,0.003,0.004,0.003],[0.468,0.047,0.041,0.058,0.038,0.038],[0.414,0.054,0.053,0.058,0.053,0.053],[0.132,0.036,0.036,0.053,0.035,0.034],[0.251,0.056,0.054,0.075,0.052,0.053],[0.083,0.023,0.027,0.025,0.021,0.026],[0.195,0.062,0.057,0.055,0.060,0.058],[0.239,0.077,0.074,0.078,0.073,0.073],[0.056,0.021,0.022,0.025,0.022,0.023],[0.119,0.043,0.041,0.051,0.046,0.038],[0.265,0.114,0.122,0.121,0.120,0.117],[0.575,0.147,0.156,0.147,0.147,0.154],[0.379,0.235,0.235,0.236,0.245,0.233],[0.160,0.029,0.030,0.028,0.028,0.032],[0.706,0.284,0.282,0.301,0.276,0.276],[2.279,1.662,1.678,1.676,1.662,1.659],[8.682,0.982,0.980,1.034,0.977,0.984],[2.644,0.985,0.957,0.970,0.965,0.947],[12.876,2.319,2.300,2.304,2.308,2.294],[4.291,2.175,2.165,2.176,2.193,2.134],[4.074,1.509,1.545,1.522,1.521,1.511],[3.244,2.885,2.895,2.909,2.893,2.910],[5.758,5.337,5.347,5.332,5.314,5.300],[3.300,2.195,2.185,2.226,2.192,2.203],[4.396,3.922,3.898,3.907,3.882,3.940],[4.292,3.323,3.335,3.353,3.336,3.323],[6.733,6.298,6.310,6.323,6.304,6.311],[2.813,2.131,2.146,2.174,2.147,2.144],[46.254,46.274,45.003,45.563,45.174,45.041],[6.231,4.263,4.255,4.293,4.285,4.271],[2.541,2.079,2.090,2.093,2.099,2.090],[2.440,1.377,1.385,1.385,1.380,1.391],[3.278,3.038,3.032,3.032,3.052,3.027],[9.938,9.550,9.480,9.497,9.392,9.421],[34.839,36.476,35.190,35.344,35.461,35.067],[26.353,23.346,24.003,24.043,24.062,24.033],[2.719,0.623,0.624,0.424,0.397,0.394],[0.885,0.453,0.438,0.461,0.447,0.442],[2.641,1.830,1.871,1.571,1.809,1.787],[1.783,1.092,1.084,1.093,0.786,0.794],[4.491,3.061,3.355,3.166,3.358,3.354],[0.324,0.077,0.073,0.076,0.075,0.074],[2.779,1.714,1.695,1.683,1.697,1.726],[5.170,3.684,3.852,3.795,3.815,3.869],[6.918,6.001,6.039,6.161,6.353,5.793],[2.442,1.239,1.087,1.053,1.052,1.239],[0.474,0.240,0.237,0.235,0.237,0.236],[1.416,0.300,0.306,0.312,0.292,0.294],[3.098,1.914,1.601,1.663,1.654,1.349],[0.195,0.098,0.096,0.093,0.094,0.100],[0.234,0.101,0.109,0.122,0.099,0.107],[0.384,0.182,0.180,0.178,0.182,0.184],[3.262,1.629,1.549,1.471,1.456,1.458],[2.727,1.262,1.251,1.256,1.230,1.256],[4.240,0.926,0.926,0.927,0.940,0.928],[0.778,0.154,0.157,0.148,0.144,0.145],[null,null,null,null,null,null],[0.638,0.238,0.236,0.248,0.245,0.234],[0.241,0.113,0.087,0.101,0.090,0.089],[0.962,0.625,0.541,0.537,0.531,0.534],[1.681,1.148,1.146,1.141,1.142,1.144],[28.922,27.468,27.684,27.435,27.534,27.334],[null,null,null,null,null,null],[2.186,1.808,1.798,1.800,1.773,1.812],[1.749,0.302,0.303,0.316,0.297,0.309],[0.986,0.379,0.373,0.364,0.372,0.376],[1.617,0.994,0.998,0.964,0.977,0.964],[1.031,0.238,0.244,0.236,0.247,0.237],[6.578,5.716,5.729,5.800,5.781,5.807],[0.215,0.070,0.069,0.077,0.069,0.070],[3.632,1.549,1.492,1.518,1.540,1.505],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.788,0.442,0.442,0.443,0.445,0.448],[6.212,5.242,5.539,5.578,5.532,5.322],[3.189,1.541,1.461,1.481,1.474,1.517],[1.489,0.485,0.503,0.474,0.471,0.466],[1.810,1.085,0.833,0.795,0.774,0.806],[0.313,0.104,0.104,0.109,0.111,0.104],[0.205,0.066,0.067,0.083,0.064,0.065],[0.290,0.182,0.191,0.181,0.178,0.178],[5.903,3.966,3.862,3.809,3.838,3.845],[5.751,4.266,4.363,4.374,4.534,4.653],[2.297,1.251,1.233,1.230,1.271,1.228],[2.210,1.241,1.226,1.231,1.250,1.260],[3.270,1.577,1.446,1.711,1.464,1.471],[1.022,0.159,0.158,0.175,0.165,0.164],[1.677,0.304,0.301,0.301,0.311,0.303],[1.769,0.954,0.955,0.961,0.950,0.951],[2.862,1.618,1.655,1.470,1.457,1.438],[0.316,0.093,0.073,0.075,0.071,0.071],[1.542,0.649,0.646,0.649,0.642,0.667],[0.325,0.086,0.081,0.082,0.085,0.079],[1.516,0.229,0.226,0.220,0.225,0.220],[1.416,0.262,0.261,0.262,0.259,0.259],[1.064,0.271,0.271,0.301,0.270,0.265],[1.214,0.274,0.272,0.278,0.268,0.270],[0.343,0.209,0.175,0.169,0.172,0.188],[4.958,4.719,4.733,4.755,4.709,4.697],[0.347,0.222,0.193,0.201,0.196,0.203],[0.333,0.215,0.203,0.205,0.199,0.213],[0.850,0.389,0.383,0.393,0.390,0.388],[0.033,0.014,0.015,0.014,0.015,0.015],[0.906,0.465,0.439,0.562,0.578,0.463],[2.181,1.530,1.519,1.551,1.557,1.529],[0.673,0.183,0.182,0.181,0.190,0.192],[0.467,0.270,0.265,0.262,0.270,0.269],[2.294,0.456,0.444,0.430,0.429,0.428],[2.336,1.800,1.803,1.824,1.814,1.805],[2.616,1.163,1.091,1.130,1.131,1.138],[null,null,null,null,null,null],[1.821,0.882,0.895,0.889,0.850,0.904],[2.661,2.021,2.065,2.015,2.030,1.667],[0.871,0.448,0.432,0.440,0.421,0.427],[0.930,0.316,0.295,0.293,0.302,0.295],[1.972,1.093,1.088,1.055,1.049,1.088],[0.883,0.461,0.427,0.424,0.430,0.429],[1.389,0.235,0.238,0.245,0.245,0.241],[1.009,0.784,0.763,0.758,0.753,0.761],[1.090,0.323,0.285,0.303,0.300,0.260],[1.588,1.023,1.027,1.027,1.020,1.017],[1.499,0.255,0.251,0.253,0.249,0.247],[1.857,0.574,0.570,0.562,0.550,0.562],[0.410,0.179,0.176,0.176,0.177,0.183],[0.989,0.323,0.296,0.298,0.281,0.286],[5.925,2.946,3.021,2.972,2.966,2.954],[1.131,0.343,0.363,0.358,0.355,0.341],[1.707,0.644,0.598,0.636,0.591,0.601],[15.734,15.002,15.060,15.380,15.086,15.178],[2.699,0.411,0.413,0.407,0.424,0.426],[1.045,0.230,0.223,0.220,0.224,0.230],[0.992,0.433,0.413,0.404,0.407,0.483],[1.406,0.201,0.198,0.197,0.199,0.199],[null,null,null,null,null,null],[1.358,0.234,0.240,0.240,0.231,0.232],[5.013,4.364,4.296,4.235,4.348,4.351],[null,null,null,null,null,null],[0.008,0.007,0.007,0.007,0.007,0.007],[2.065,0.278,0.257,0.248,0.269,0.263],[0.030,0.043,0.025,0.033,0.026,0.024],[2.141,0.367,0.383,0.370,0.369,0.366],[3.947,1.390,1.384,1.382,1.365,1.411],[0.262,0.101,0.106,0.104,0.104,0.104],[0.435,0.271,0.255,0.250,0.270,0.270],[0.173,0.069,0.071,0.093,0.069,0.078],[0.223,0.129,0.127,0.126,0.119,0.119],[0.762,0.336,0.332,0.357,0.341,0.330],[0.176,0.071,0.076,0.076,0.072,0.071],[4.940,4.705,4.734,4.684,4.734,4.681],[2.363,1.322,1.340,1.297,1.322,1.305],[1.014,0.347,0.322,0.313,0.324,0.320],[0.278,0.062,0.064,0.063,0.065,0.063],[0.163,0.051,0.050,0.050,0.049,0.050],[0.181,0.057,0.060,0.061,0.060,0.058],[1.695,0.653,0.644,0.656,0.665,0.675],[3.398,2.910,3.200,2.919,2.916,2.957],[5.487,5.442,5.433,5.434,5.430,5.403],[0.765,0.105,0.105,0.107,0.104,0.106],[3.887,3.191,3.180,3.206,2.251,3.263],[0.609,0.195,0.191,0.194,0.196,0.191],[0.736,0.329,0.328,0.333,0.327,0.329],[0.195,0.057,0.057,0.082,0.054,0.053],[0.289,0.205,0.215,0.189,0.176,0.216],[0.119,0.038,0.038,0.037,0.037,0.035],[0.301,0.223,0.216,0.224,0.209,0.220],[0.226,0.090,0.083,0.093,0.089,0.089],[0.184,0.105,0.112,0.096,0.093,0.095],[0.155,0.075,0.075,0.069,0.066,0.078],[0.209,0.125,0.117,0.111,0.121,0.117],[0.792,0.066,0.062,0.065,0.067,0.061],[0.754,0.057,0.053,0.054,0.052,0.053],[0.812,0.082,0.070,0.071,0.076,0.076],[0.257,0.136,0.146,0.147,0.139,0.146],[0.163,0.043,0.041,0.041,0.039,0.039],[0.286,0.173,0.169,0.158,0.164,0.162],[0.697,0.043,0.045,0.046,0.044,0.041],[0.717,0.038,0.037,0.033,0.036,0.035],[0.729,0.062,0.057,0.058,0.060,0.059],[0.656,0.406,0.407,0.413,0.415,0.415],[0.617,0.416,0.420,0.416,0.420,0.412],[0.555,0.399,0.399,0.403,0.402,0.395],[0.626,0.434,0.429,0.427,0.427,0.433],[0.585,0.452,0.413,0.426,0.420,0.408],[0.698,0.485,0.485,0.473,0.479,0.477],[0.533,0.216,0.219,0.207,0.217,0.221],[0.415,0.224,0.222,0.226,0.232,0.203],[0.733,0.354,0.315,0.316,0.325,0.306],[0.325,0.076,0.068,0.086,0.069,0.063],[0.258,0.043,0.045,0.043,0.044,0.042],[1.002,0.692,0.679,0.686,0.690,0.682],[0.869,0.704,0.679,0.673,0.677,0.674],[0.488,0.153,0.149,0.147,0.138,0.139],[0.490,0.121,0.121,0.110,0.105,0.107],[0.476,0.172,0.159,0.161,0.166,0.156],[0.512,0.192,0.173,0.166,0.171,0.163],[0.340,0.078,0.077,0.081,0.079,0.078],[0.254,0.082,0.075,0.076,0.074,0.068],[0.237,0.099,0.089,0.079,0.084,0.089],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[0.309,0.104,0.099,0.097,0.095,0.106],[0.458,0.324,0.301,0.315,0.327,0.329],[0.846,0.102,0.101,0.100,0.097,0.098],[1.279,0.540,0.516,0.523,0.521,0.508],[0.804,0.107,0.124,0.143,0.152,0.124],[1.044,0.329,0.309,0.320,0.324,0.316],[0.385,0.225,0.225,0.225,0.221,0.227],[0.371,0.230,0.224,0.222,0.217,0.224],[0.388,0.272,0.263,0.266,0.258,0.263],[0.936,0.164,0.159,0.142,0.156,0.154],[0.301,0.161,0.167,0.148,0.149,0.151],[0.942,0.162,0.178,0.161,0.144,0.152],[0.444,0.096,0.097,0.087,0.075,0.081],[0.236,0.076,0.070,0.073,0.075,0.073],[0.480,0.092,0.088,0.090,0.084,0.090],[0.254,0.092,0.096,0.092,0.093,0.092],[2.292,1.832,1.850,1.845,1.831,1.828],[2.119,1.883,1.865,1.886,1.868,1.870],[2.110,1.839,1.849,1.873,1.871,1.855],[2.063,1.848,1.799,1.839,1.867,1.853],[1.651,1.292,1.292,1.280,1.296,1.306],[2.019,1.798,1.799,1.785,1.809,1.796],[2.026,1.789,1.816,1.785,1.800,1.795],[2.012,1.796,1.824,1.798,1.797,1.793],[1.541,1.333,1.310,1.305,1.323,1.323],[2.049,1.855,1.805,1.823,1.821,1.850],[1.286,0.558,0.527,0.526,0.500,0.501],[0.005,0.005,0.005,0.005,0.005,0.005],[0.874,0.108,0.100,0.099,0.092,0.092],[1.117,0.145,0.142,0.150,0.142,0.139],[0.999,0.116,0.115,0.113,0.117,0.110],[0.468,0.176,0.166,0.170,0.171,0.163],[0.815,0.402,0.395,0.392,0.402,0.396],[1.039,0.615,0.605,0.607,0.619,0.635],[0.918,0.616,0.594,0.593,0.598,0.592],[1.024,0.621,0.639,0.632,0.617,0.616],[0.006,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.006,0.005,0.006,0.005],[0.963,0.140,0.135,0.135,0.135,0.134],[0.341,0.156,0.159,0.136,0.144,0.139],[0.941,0.159,0.154,0.155,0.147,0.152],[0.364,0.207,0.199,0.195,0.186,0.188],[0.516,0.117,0.106,0.104,0.099,0.096],[0.496,0.107,0.104,0.102,0.098,0.108],[0.276,0.114,0.108,0.102,0.104,0.106],[1.164,0.207,0.201,0.210,0.201,0.208],[0.563,0.185,0.179,0.165,0.172,0.171],[1.018,0.120,0.114,0.113,0.111,0.122],[0.292,0.093,0.094,0.101,0.097,0.096],[0.935,0.144,0.126,0.123,0.134,0.126],[1.062,0.655,0.634,0.650,0.633,0.630],[1.020,0.619,0.622,0.609,0.613,0.645],[0.990,0.686,0.637,0.640,0.641,0.641],[0.009,0.006,0.006,0.005,0.006,0.005],[0.005,0.006,0.006,0.006,0.005,0.005],[0.006,0.005,0.006,0.006,0.006,0.006],[1.002,0.161,0.158,0.161,0.150,0.146],[0.902,0.144,0.132,0.134,0.125,0.129],[0.361,0.155,0.151,0.169,0.145,0.153],[1.223,0.173,0.165,0.160,0.164,0.167],[1.125,0.172,0.180,0.163,0.161,0.165],[0.693,0.284,0.258,0.250,0.246,0.282],[1.061,0.162,0.152,0.159,0.161,0.143],[0.335,0.136,0.125,0.125,0.123,0.123],[0.996,0.179,0.174,0.167,0.169,0.174],[1.073,0.185,0.177,0.211,0.180,0.185],[0.371,0.118,0.125,0.116,0.110,0.112],[1.073,0.202,0.208,0.195,0.189,0.202],[0.188,0.087,0.081,0.081,0.085,0.080],[0.183,0.097,0.088,0.089,0.085,0.091],[0.335,0.173,0.169,0.167,0.166,0.164],[0.267,0.152,0.140,0.145,0.138,0.140],[0.321,0.203,0.187,0.194,0.179,0.182]],"version":"25.8.24.21","source":"results/25.8.24.21.json"} +,{"actual_version":"25.6.13.41","data_size":{"coffeeshop":44638735660,"hits":14240831538,"job":1828094510,"mgbench":2954107753,"ontime":2699155844,"ssb":73314016575,"taxi":24223493899,"tpcds":18794066147,"tpch":17233125506,"uk":781025370},"kind":"versions-benchmark","load_time":{"coffeeshop":821,"hits":215,"job":18,"mgbench":66,"ontime":60,"ssb":1456,"taxi":539,"tpcds":291,"tpch":282,"uk":32},"machine":"c7a.4xlarge","release_date":"2025-10-14","result":[[0.072,0.007,0.007,0.276,0.006,0.007],[0.018,0.004,0.004,0.004,0.004,0.003],[0.038,0.021,0.009,0.030,0.009,0.009],[0.037,0.009,0.009,0.032,0.010,0.009],[0.039,0.022,0.022,0.043,0.018,0.022],[0.063,0.016,0.015,0.035,0.015,0.016],[0.022,0.006,0.006,0.006,0.006,0.006],[0.045,0.006,0.006,0.006,0.006,0.006],[0.065,0.006,0.006,0.055,0.006,0.006],[0.086,0.052,0.053,0.056,0.050,0.055],[0.248,0.184,0.184,0.172,0.176,0.176],[0.345,0.208,0.218,0.225,0.203,0.213],[0.024,0.007,0.007,0.007,0.007,0.007],[0.027,0.012,0.012,0.012,0.013,0.012],[0.640,0.532,0.537,0.569,0.506,0.507],[0.513,0.083,0.098,0.084,0.097,0.084],[0.044,0.017,0.016,0.014,0.014,0.014],[0.042,0.013,0.013,0.014,0.014,0.013],[6.467,1.113,1.139,1.176,1.130,1.138],[4.755,0.878,0.885,0.893,0.882,0.885],[4.769,0.913,0.926,0.916,0.918,0.906],[5.337,1.494,1.504,1.511,1.469,1.480],[6.242,1.247,1.233,1.237,1.241,1.228],[3.971,0.661,0.629,0.623,0.623,0.629],[0.064,0.024,0.038,0.019,0.018,0.020],[7.875,1.717,1.714,1.742,1.710,1.706],[1.844,0.526,0.543,0.524,0.529,0.531],[1.919,0.400,0.388,0.378,0.384,0.387],[0.001,0.001,0.001,0.001,0.002,0.001],[0.022,0.006,0.006,0.006,0.006,0.006],[0.052,0.014,0.015,0.034,0.014,0.018],[0.138,0.026,0.020,0.024,0.022,0.020],[0.169,0.055,0.055,0.052,0.054,0.056],[0.297,0.115,0.127,0.116,0.114,0.114],[0.003,0.002,0.002,0.022,0.002,0.002],[0.018,0.008,0.008,0.008,0.008,0.008],[0.386,0.220,0.219,0.217,0.220,0.217],[0.429,0.253,0.258,0.256,0.256,0.260],[0.189,0.063,0.062,0.063,0.066,0.061],[0.203,0.079,0.078,0.079,0.080,0.077],[0.486,0.292,0.273,0.276,0.289,0.280],[0.690,0.383,0.366,0.371,0.382,0.364],[0.599,0.376,0.395,0.426,0.397,0.376],[0.386,0.229,0.224,0.221,0.227,0.229],[1.539,0.965,0.951,0.959,0.961,0.966],[1.161,0.722,0.619,0.618,0.626,0.643],[2.950,2.091,2.066,2.099,2.064,2.089],[0.138,0.002,0.002,0.002,0.002,0.002],[1.545,0.030,0.026,0.031,0.044,0.032],[1.730,0.013,0.016,0.025,0.012,0.012],[3.925,0.752,0.752,0.763,0.744,0.736],[0.721,0.635,0.621,0.620,0.621,0.623],[0.432,0.099,0.098,0.100,0.098,0.097],[0.256,0.074,0.075,0.076,0.077,0.076],[0.432,0.102,0.103,0.098,0.106,0.097],[1.512,0.295,0.286,0.312,0.302,0.289],[1.489,0.489,0.490,0.477,0.478,0.479],[0.058,0.024,0.021,0.628,0.019,0.019],[0.508,0.243,0.225,0.239,0.223,0.217],[0.925,0.362,0.342,0.365,0.320,0.347],[2.207,1.524,1.487,1.532,1.547,1.531],[2.661,1.434,1.364,1.375,1.360,1.352],[2.682,1.378,1.405,1.351,1.385,1.402],[0.268,0.228,0.222,0.242,0.225,0.238],[0.064,0.030,0.029,0.037,0.028,0.027],[0.033,0.023,0.023,0.021,0.020,0.021],[0.046,0.014,0.015,0.013,0.013,0.013],[0.104,0.051,0.048,0.051,0.049,0.049],[0.024,0.004,0.004,0.004,0.004,0.004],[0.020,0.004,0.004,0.004,0.004,0.004],[0.012,0.004,0.004,0.004,0.003,0.004],[0.356,0.045,0.039,0.057,0.037,0.044],[0.303,0.053,0.058,0.054,0.057,0.054],[0.095,0.033,0.034,0.053,0.033,0.038],[0.220,0.060,0.060,0.080,0.060,0.060],[0.077,0.034,0.037,0.043,0.034,0.036],[0.175,0.072,0.069,0.067,0.070,0.072],[0.195,0.088,0.084,0.103,0.088,0.088],[0.058,0.033,0.033,0.038,0.033,0.033],[0.111,0.061,0.060,0.069,0.062,0.066],[0.251,0.144,0.149,0.144,0.145,0.147],[0.424,0.166,0.155,0.157,0.154,0.155],[0.355,0.253,0.246,0.247,0.245,0.244],[0.125,0.042,0.033,0.033,0.032,0.033],[0.580,0.289,0.288,0.304,0.282,0.279],[2.388,1.857,1.819,1.834,1.844,1.847],[8.665,0.979,0.963,1.022,1.084,1.099],[2.118,1.075,1.065,1.059,1.051,1.046],[12.893,2.593,2.537,2.623,2.724,2.764],[4.266,3.295,3.316,3.035,3.018,3.224],[4.075,1.744,1.571,1.574,1.571,1.596],[3.994,3.842,3.613,3.674,3.837,3.580],[6.144,6.331,6.447,6.209,6.130,6.083],[3.303,2.959,2.990,3.002,3.050,3.046],[4.790,4.715,4.746,4.757,4.749,4.905],[5.090,4.827,4.989,4.932,4.756,4.793],[8.011,7.892,7.744,7.458,7.643,8.033],[3.425,3.074,3.087,3.130,3.300,3.270],[46.920,46.673,44.675,45.037,44.880,45.384],[6.808,5.665,5.414,5.613,5.596,5.588],[2.641,2.552,2.535,2.410,2.402,2.390],[2.390,1.687,1.675,1.684,1.679,1.689],[3.545,3.388,3.402,3.414,3.434,3.421],[12.647,12.277,12.302,12.215,12.166,12.190],[33.460,34.741,34.121,34.113,34.142,34.460],[26.276,23.729,23.987,24.043,24.000,24.012],[2.688,0.631,0.622,0.428,0.397,0.395],[null,null,null,null,null,null],[2.439,1.626,1.621,1.642,1.627,1.654],[null,null,null,null,null,null],[4.126,3.066,3.054,3.127,3.105,3.078],[0.204,0.081,0.082,0.078,0.077,0.078],[3.048,2.319,2.314,2.318,2.331,2.309],[4.589,3.514,3.528,3.529,3.503,3.604],[6.629,5.455,5.477,5.514,5.558,5.634],[2.047,1.124,1.123,1.179,1.121,1.139],[0.526,0.384,0.366,0.377,0.369,0.369],[1.205,0.396,0.381,0.394,0.379,0.384],[3.478,2.051,2.077,2.120,2.139,2.156],[0.192,0.115,0.112,0.116,0.118,0.117],[0.197,0.116,0.108,0.126,0.110,0.109],[0.376,0.235,0.237,0.233,0.228,0.234],[null,null,null,null,null,null],[2.235,1.340,1.346,1.375,1.432,1.374],[4.160,1.013,1.002,1.068,1.014,1.017],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.927,0.667,0.613,0.621,0.643,0.634],[1.643,1.298,1.314,1.271,1.239,1.277],[18.797,17.938,17.611,17.716,17.774,17.623],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.396,0.412,0.399,0.413,0.381,0.382],[0.882,0.507,0.468,0.471,0.484,0.516],[1.437,1.036,0.990,0.988,0.975,0.973],[null,null,null,null,null,null],[6.737,6.065,6.017,6.374,6.148,5.961],[0.230,0.139,0.147,0.148,0.136,0.139],[3.248,1.830,1.758,1.856,1.810,1.955],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.845,0.594,0.574,0.583,0.577,0.591],[null,null,null,null,null,null],[3.114,1.714,1.753,1.770,1.801,1.779],[1.188,0.584,0.613,0.615,0.589,0.581],[1.583,0.900,0.879,0.866,0.851,0.835],[0.353,0.237,0.226,0.226,0.229,0.222],[0.227,0.120,0.118,0.139,0.121,0.115],[0.307,0.179,0.171,0.164,0.180,0.164],[6.773,5.374,5.339,5.317,5.315,5.354],[6.724,5.782,5.772,5.811,5.766,5.837],[2.289,1.558,1.573,1.556,1.541,1.554],[2.231,1.535,1.561,1.548,1.596,1.626],[3.280,1.937,1.884,1.822,1.792,1.820],[0.680,0.199,0.198,0.203,0.198,0.210],[1.332,0.395,0.389,0.384,0.376,0.388],[1.432,0.956,0.955,0.958,0.953,0.968],[2.773,1.752,1.763,1.798,1.760,1.773],[null,null,null,null,null,null],[1.443,0.904,0.897,0.880,0.910,0.869],[null,null,null,null,null,null],[1.121,0.304,0.307,0.300,0.316,0.311],[1.073,0.335,0.332,0.337,0.338,0.339],[null,null,null,null,null,null],[0.971,0.385,0.390,0.398,0.388,0.384],[0.312,0.186,0.186,0.181,0.180,0.184],[5.105,4.919,4.868,4.882,4.952,4.849],[0.456,0.362,0.340,0.344,0.342,0.338],[0.425,0.355,0.347,0.350,0.347,0.353],[0.860,0.521,0.526,0.513,0.525,0.524],[null,null,null,null,null,null],[0.788,0.492,0.432,0.455,0.461,0.436],[2.110,1.721,1.691,1.702,1.723,1.676],[0.479,0.184,0.195,0.194,0.201,0.193],[0.557,0.371,0.357,0.393,0.360,0.356],[1.764,0.578,0.566,0.566,0.574,0.570],[3.245,2.775,2.738,2.759,2.750,2.755],[2.303,1.355,1.344,1.311,1.332,1.342],[null,null,null,null,null,null],[1.781,1.057,1.057,1.085,1.075,1.088],[2.613,2.232,2.229,2.247,2.185,2.216],[0.793,0.492,0.476,0.440,0.458,0.449],[0.706,0.323,0.310,0.304,0.307,0.308],[1.837,1.331,1.247,1.264,1.265,1.257],[0.744,0.492,0.447,0.476,0.449,0.458],[1.120,0.346,0.359,0.343,0.340,0.333],[1.282,1.146,1.120,1.099,1.115,1.091],[0.965,0.410,0.392,0.424,0.395,0.401],[1.517,1.127,1.128,1.122,1.123,1.128],[1.185,0.369,0.344,0.364,0.350,0.350],[1.828,0.925,0.934,0.904,0.909,0.910],[0.386,0.235,0.238,0.240,0.238,0.237],[0.787,0.352,0.323,0.302,0.313,0.302],[5.698,3.695,3.621,3.727,3.666,3.705],[1.035,0.491,0.487,0.490,0.504,0.487],[1.562,0.846,0.812,0.844,0.811,0.808],[14.794,14.412,14.376,14.086,14.339,15.402],[2.310,0.511,0.506,0.503,0.497,0.509],[null,null,null,null,null,null],[0.926,0.563,0.550,0.564,0.590,0.557],[1.081,0.284,0.286,0.279,0.277,0.287],[null,null,null,null,null,null],[1.008,0.291,0.290,0.286,0.287,0.286],[5.057,4.411,4.484,4.403,4.457,4.511],[null,null,null,null,null,null],[0.009,0.009,0.009,0.027,0.009,0.009],[1.574,0.342,0.343,0.344,0.341,0.339],[0.033,0.049,0.028,0.038,0.028,0.028],[1.698,0.506,0.501,0.490,0.485,0.492],[3.695,1.995,2.001,1.956,1.936,2.001],[null,null,null,null,null,null],[0.382,0.308,0.304,0.278,0.271,0.266],[0.161,0.088,0.087,0.124,0.094,0.093],[0.210,0.123,0.125,0.123,0.128,0.122],[0.718,0.422,0.425,0.445,0.423,0.425],[0.171,0.092,0.094,0.099,0.092,0.101],[5.361,5.239,5.269,5.333,5.265,5.217],[3.165,2.210,2.119,2.156,2.175,2.174],[0.861,0.403,0.435,0.378,0.385,0.384],[0.253,0.098,0.093,0.099,0.100,0.099],[0.157,0.072,0.065,0.068,0.062,0.065],[null,null,null,null,null,null],[2.000,1.119,1.149,1.119,1.047,1.105],[null,null,null,null,null,null],[5.802,5.889,5.853,5.791,5.844,5.764],[0.578,0.168,0.167,0.169,0.171,0.169],[4.030,3.421,3.428,3.493,3.450,3.537],[0.704,0.454,0.445,0.444,0.459,0.464],[0.667,0.441,0.414,0.405,0.406,0.408],[0.181,0.062,0.062,0.083,0.074,0.064],[0.301,0.227,0.225,0.249,0.233,0.223],[0.102,0.038,0.039,0.041,0.038,0.037],[0.319,0.259,0.230,0.230,0.252,0.243],[0.214,0.087,0.092,0.089,0.086,0.096],[0.173,0.118,0.107,0.101,0.103,0.119],[0.139,0.076,0.077,0.074,0.068,0.075],[0.189,0.118,0.125,0.120,0.126,0.116],[0.547,0.066,0.070,0.069,0.065,0.071],[0.535,0.060,0.060,0.057,0.052,0.052],[0.571,0.075,0.078,0.071,0.071,0.075],[0.229,0.147,0.152,0.141,0.146,0.144],[0.140,0.047,0.048,0.046,0.046,0.046],[0.265,0.174,0.174,0.172,0.185,0.162],[0.511,0.047,0.046,0.044,0.046,0.042],[0.544,0.037,0.036,0.038,0.035,0.035],[0.535,0.059,0.062,0.058,0.059,0.054],[0.709,0.515,0.515,0.509,0.526,0.532],[0.733,0.581,0.548,0.543,0.538,0.548],[0.631,0.515,0.516,0.508,0.509,0.519],[0.698,0.576,0.572,0.573,0.598,0.581],[0.639,0.539,0.522,0.520,0.524,0.521],[0.806,0.617,0.611,0.607,0.613,0.599],[0.475,0.245,0.227,0.219,0.221,0.233],[0.404,0.219,0.238,0.219,0.225,0.242],[0.690,0.407,0.405,0.393,0.381,0.389],[0.267,0.076,0.079,0.079,0.078,0.072],[0.209,0.046,0.046,0.046,0.049,0.047],[1.176,0.915,0.900,0.890,0.894,0.881],[1.047,0.894,0.881,0.897,0.867,0.862],[0.399,0.159,0.160,0.145,0.143,0.148],[0.398,0.122,0.127,0.121,0.122,0.132],[0.434,0.187,0.177,0.171,0.186,0.176],[0.416,0.223,0.216,0.192,0.189,0.189],[0.260,0.101,0.091,0.092,0.096,0.089],[0.213,0.097,0.090,0.078,0.071,0.083],[0.205,0.101,0.101,0.094,0.095,0.092],[0.006,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[0.292,0.113,0.107,0.108,0.108,0.108],[0.410,0.326,0.321,0.326,0.324,0.315],[0.595,0.107,0.110,0.096,0.104,0.107],[1.131,0.663,0.733,0.719,0.710,0.699],[0.584,0.120,0.113,0.142,0.134,0.126],[0.862,0.352,0.333,0.336,0.322,0.293],[0.349,0.250,0.250,0.258,0.232,0.242],[0.347,0.236,0.256,0.240,0.237,0.238],[0.374,0.286,0.272,0.294,0.277,0.282],[0.655,0.188,0.165,0.160,0.165,0.166],[0.271,0.152,0.136,0.143,0.142,0.144],[0.700,0.175,0.188,0.179,0.160,0.170],[0.359,0.092,0.089,0.087,0.083,0.081],[0.204,0.079,0.091,0.075,0.072,0.074],[0.376,0.106,0.105,0.101,0.092,0.092],[0.218,0.108,0.102,0.100,0.107,0.099],[3.221,2.707,2.698,2.693,2.716,2.747],[3.047,2.845,2.844,2.821,2.788,2.835],[2.919,2.714,2.717,2.739,2.774,2.743],[2.904,2.725,2.725,2.739,2.715,2.739],[2.357,1.945,2.013,1.948,1.999,1.925],[3.810,3.646,3.590,3.587,3.574,3.602],[3.749,3.560,3.581,3.563,3.594,3.587],[3.727,3.612,3.541,3.579,3.559,3.552],[2.137,1.999,2.028,1.995,2.038,2.067],[3.778,3.680,3.667,3.692,3.718,3.657],[1.151,0.548,0.580,0.575,0.569,0.596],[0.006,0.006,0.006,0.006,0.006,0.006],[0.666,0.119,0.107,0.111,0.101,0.101],[0.790,0.162,0.159,0.154,0.159,0.163],[0.740,0.127,0.116,0.126,0.128,0.119],[0.420,0.185,0.178,0.181,0.193,0.182],[0.853,0.493,0.499,0.502,0.508,0.499],[0.958,0.647,0.628,0.620,0.644,0.648],[0.839,0.631,0.616,0.607,0.614,0.649],[0.951,0.673,0.655,0.650,0.645,0.641],[0.006,0.006,0.005,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.767,0.185,0.187,0.174,0.177,0.173],[0.335,0.177,0.182,0.185,0.195,0.179],[0.732,0.214,0.201,0.199,0.198,0.192],[0.385,0.245,0.271,0.250,0.241,0.252],[0.399,0.110,0.111,0.109,0.108,0.104],[0.402,0.109,0.111,0.100,0.105,0.108],[0.244,0.118,0.118,0.112,0.115,0.109],[0.921,0.259,0.242,0.232,0.241,0.235],[0.464,0.197,0.190,0.188,0.191,0.184],[0.688,0.115,0.113,0.115,0.114,0.124],[0.249,0.097,0.101,0.096,0.108,0.111],[0.714,0.153,0.142,0.140,0.133,0.137],[0.977,0.673,0.659,0.654,0.648,0.649],[0.905,0.668,0.637,0.631,0.633,0.642],[0.916,0.678,0.690,0.674,0.667,0.666],[0.007,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.007],[0.822,0.205,0.222,0.193,0.206,0.206],[0.676,0.158,0.149,0.166,0.145,0.138],[0.391,0.233,0.218,0.235,0.232,0.249],[0.934,0.184,0.182,0.181,0.174,0.175],[0.865,0.184,0.178,0.182,0.167,0.176],[0.647,0.325,0.356,0.349,0.348,0.322],[0.772,0.179,0.167,0.159,0.155,0.160],[0.299,0.143,0.134,0.136,0.137,0.133],[0.798,0.196,0.195,0.189,0.185,0.191],[0.808,0.199,0.204,0.223,0.203,0.196],[0.302,0.130,0.124,0.126,0.133,0.126],[0.842,0.219,0.220,0.214,0.222,0.220],[0.170,0.086,0.087,0.087,0.086,0.079],[0.172,0.102,0.091,0.102,0.096,0.101],[0.355,0.198,0.181,0.203,0.182,0.184],[0.274,0.157,0.154,0.155,0.144,0.156],[0.323,0.245,0.218,0.191,0.195,0.188]],"version":"25.6.13.41","source":"results/25.6.13.41.json"} +,{"actual_version":"25.7.8.71","data_size":{"coffeeshop":44637658127,"hits":14268631218,"job":1828094510,"mgbench":2953957163,"ontime":2699155844,"ssb":73313673251,"taxi":24223754794,"tpcds":18796541214,"tpch":17235435683,"uk":781025370},"kind":"versions-benchmark","load_time":{"coffeeshop":831,"hits":175,"job":19,"mgbench":70,"ontime":55,"ssb":1403,"taxi":517,"tpcds":311,"tpch":325,"uk":30},"machine":"c7a.4xlarge","release_date":"2025-10-14","result":[[0.066,0.007,0.007,0.287,0.007,0.006],[0.020,0.003,0.003,0.003,0.003,0.003],[0.040,0.018,0.009,0.030,0.008,0.010],[0.033,0.009,0.009,0.009,0.009,0.009],[0.041,0.024,0.019,0.043,0.023,0.019],[0.058,0.018,0.017,0.034,0.015,0.015],[0.020,0.004,0.005,0.005,0.005,0.005],[0.042,0.006,0.006,0.005,0.005,0.005],[0.066,0.005,0.005,0.050,0.005,0.005],[0.084,0.049,0.048,0.049,0.053,0.053],[0.248,0.186,0.183,0.175,0.175,0.175],[0.352,0.209,0.224,0.223,0.206,0.204],[0.024,0.005,0.005,0.006,0.005,0.006],[0.026,0.013,0.010,0.011,0.011,0.011],[0.641,0.523,0.524,0.549,0.496,0.506],[0.490,0.109,0.085,0.084,0.085,0.087],[0.044,0.015,0.018,0.014,0.014,0.015],[0.041,0.014,0.013,0.016,0.016,0.013],[6.479,1.099,1.100,1.123,1.117,1.116],[4.753,0.847,0.871,0.856,0.848,0.868],[4.774,0.897,0.881,0.873,0.888,0.887],[5.351,1.435,1.420,1.448,1.435,1.433],[6.243,1.200,1.206,1.191,1.199,1.196],[3.977,0.634,0.621,0.608,0.615,0.598],[0.061,0.018,0.024,0.019,0.018,0.017],[7.875,1.668,1.695,1.709,1.703,1.691],[1.848,0.526,0.523,0.517,0.539,0.518],[1.921,0.384,0.361,0.368,0.371,0.364],[0.001,0.001,0.001,0.001,0.001,0.001],[0.022,0.006,0.006,0.006,0.005,0.006],[0.048,0.015,0.015,0.034,0.014,0.014],[0.125,0.020,0.019,0.022,0.020,0.021],[0.155,0.052,0.053,0.052,0.056,0.053],[0.278,0.113,0.120,0.112,0.111,0.115],[0.003,0.002,0.002,0.021,0.002,0.002],[0.020,0.007,0.007,0.007,0.008,0.008],[0.363,0.219,0.218,0.218,0.216,0.224],[0.409,0.254,0.254,0.253,0.254,0.254],[0.173,0.064,0.063,0.065,0.061,0.062],[0.188,0.078,0.083,0.082,0.078,0.081],[0.482,0.276,0.276,0.265,0.274,0.257],[0.651,0.381,0.377,0.379,0.393,0.381],[0.607,0.390,0.395,0.394,0.390,0.428],[0.323,0.178,0.178,0.182,0.179,0.182],[1.280,0.907,0.904,0.908,0.900,0.901],[0.869,0.622,0.592,0.626,0.607,0.607],[2.756,1.868,1.883,1.898,1.882,1.874],[0.126,0.002,0.002,0.002,0.002,0.002],[1.420,0.027,0.023,0.026,0.030,0.022],[1.756,0.011,0.013,0.023,0.012,0.011],[3.941,0.759,0.733,0.756,0.737,0.729],[0.734,0.662,0.678,0.664,0.657,0.646],[0.385,0.102,0.100,0.096,0.094,0.102],[0.238,0.075,0.074,0.076,0.076,0.079],[0.394,0.102,0.099,0.099,0.100,0.108],[1.414,0.319,0.307,0.311,0.300,0.292],[1.379,0.468,0.457,0.463,0.452,0.460],[0.054,0.019,0.020,0.618,0.018,0.019],[0.512,0.237,0.243,0.253,0.214,0.218],[0.865,0.332,0.277,0.364,0.359,0.306],[2.113,1.495,1.490,1.479,1.505,1.506],[2.593,1.394,1.368,1.359,1.407,1.371],[2.591,1.368,1.323,1.331,1.348,1.369],[0.221,0.146,0.161,0.171,0.163,0.168],[0.123,0.076,0.068,0.065,0.067,0.067],[0.053,0.032,0.032,0.034,0.034,0.035],[0.078,0.027,0.026,0.025,0.026,0.024],[0.232,0.135,0.146,0.126,0.155,0.126],[0.032,0.004,0.004,0.004,0.004,0.004],[0.029,0.004,0.004,0.004,0.004,0.004],[0.012,0.003,0.004,0.004,0.004,0.004],[0.360,0.050,0.047,0.060,0.038,0.039],[0.305,0.054,0.054,0.058,0.055,0.058],[0.094,0.034,0.033,0.054,0.038,0.032],[0.213,0.056,0.063,0.073,0.053,0.054],[0.068,0.026,0.025,0.021,0.026,0.022],[0.159,0.058,0.058,0.058,0.063,0.059],[0.176,0.077,0.081,0.077,0.075,0.074],[0.049,0.029,0.030,0.023,0.024,0.027],[0.095,0.043,0.042,0.047,0.037,0.036],[0.221,0.115,0.118,0.120,0.116,0.117],[0.420,0.149,0.148,0.157,0.151,0.153],[0.346,0.243,0.234,0.235,0.236,0.237],[0.121,0.031,0.029,0.031,0.030,0.033],[0.580,0.288,0.282,0.294,0.272,0.288],[2.222,1.680,1.666,1.670,1.656,1.653],[8.695,0.998,0.964,0.983,1.001,0.978],[2.047,0.955,0.968,0.946,0.955,0.955],[12.896,2.297,2.299,2.316,2.300,2.297],[4.265,2.773,2.629,2.632,2.633,2.657],[4.061,1.537,1.542,1.536,1.537,1.534],[3.524,3.333,3.334,3.336,3.326,3.320],[5.777,5.506,5.477,5.473,5.449,5.471],[3.298,2.732,2.726,2.736,2.765,2.755],[4.388,4.111,4.082,4.103,4.119,4.142],[4.443,4.101,4.204,4.211,4.159,4.205],[7.056,6.782,6.793,6.752,6.743,6.772],[3.037,2.747,2.734,2.770,2.728,2.736],[46.391,45.431,44.473,44.272,44.040,43.821],[6.209,4.659,4.703,4.645,4.671,4.645],[2.383,2.263,2.249,2.243,2.251,2.251],[2.386,1.580,1.560,1.560,1.574,1.557],[3.333,3.200,3.190,3.201,3.193,3.187],[12.259,11.932,11.926,11.863,11.843,11.814],[33.517,34.100,33.629,33.678,33.664,33.796],[26.276,23.706,24.011,24.052,24.026,24.049],[2.729,0.621,0.623,0.445,0.388,0.387],[null,null,null,null,null,null],[2.421,1.550,1.541,1.571,1.537,1.534],[null,null,null,null,null,null],[4.003,2.818,2.919,2.859,2.922,2.864],[0.221,0.079,0.080,0.082,0.081,0.085],[2.649,1.927,1.965,1.916,1.929,1.915],[4.607,3.375,3.326,3.325,3.397,3.424],[6.673,6.146,5.801,5.960,6.253,6.293],[2.040,1.068,1.058,1.053,1.045,1.055],[0.452,0.290,0.286,0.294,0.282,0.287],[1.187,0.292,0.290,0.315,0.309,0.296],[2.986,1.612,1.624,1.711,1.654,1.680],[0.176,0.093,0.102,0.099,0.105,0.098],[0.196,0.106,0.103,0.122,0.105,0.103],[0.332,0.190,0.188,0.192,0.191,0.186],[null,null,null,null,null,null],[2.167,1.260,1.255,1.256,1.281,1.245],[4.214,0.953,0.933,0.952,0.942,0.942],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.871,0.637,0.534,0.539,0.534,0.534],[1.525,1.156,1.163,1.184,1.153,1.132],[17.704,16.928,17.004,16.980,17.135,17.090],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.367,0.354,0.349,0.363,0.330,0.327],[0.829,0.409,0.407,0.405,0.411,0.409],[1.338,0.951,0.952,0.967,0.945,0.940],[null,null,null,null,null,null],[6.423,5.556,5.601,5.584,5.596,5.589],[0.176,0.083,0.080,0.090,0.085,0.084],[3.063,1.580,1.567,1.588,1.602,1.677],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.745,0.457,0.455,0.463,0.458,0.453],[null,null,null,null,null,null],[2.842,1.587,1.582,1.622,1.555,1.573],[1.137,0.492,0.495,0.491,0.509,0.493],[1.528,0.864,0.838,0.786,0.773,0.796],[0.272,0.113,0.110,0.114,0.109,0.110],[0.181,0.086,0.087,0.107,0.091,0.087],[0.227,0.135,0.130,0.132,0.130,0.125],[6.001,4.772,4.738,4.712,4.702,4.703],[6.042,5.158,5.116,5.123,5.117,5.105],[2.008,1.320,1.307,1.313,1.296,1.307],[1.982,1.325,1.308,1.302,1.323,1.302],[2.962,1.547,1.585,1.590,1.583,1.566],[0.715,0.177,0.178,0.172,0.176,0.176],[1.199,0.333,0.326,0.325,0.326,0.329],[1.416,0.950,0.943,0.944,0.944,0.955],[2.587,1.609,1.621,1.626,1.616,1.595],[null,null,null,null,null,null],[1.267,0.737,0.735,0.725,0.729,0.721],[null,null,null,null,null,null],[1.018,0.257,0.253,0.256,0.258,0.263],[1.015,0.298,0.303,0.298,0.293,0.302],[null,null,null,null,null,null],[0.914,0.338,0.344,0.347,0.336,0.336],[0.309,0.185,0.181,0.178,0.171,0.173],[5.095,4.932,4.934,5.031,4.927,4.982],[0.383,0.314,0.295,0.291,0.303,0.297],[0.376,0.305,0.300,0.288,0.293,0.296],[0.791,0.435,0.424,0.428,0.419,0.424],[null,null,null,null,null,null],[0.788,0.448,0.479,0.443,0.441,0.445],[1.957,1.589,1.580,1.580,1.568,1.597],[0.478,0.195,0.192,0.188,0.194,0.194],[0.459,0.288,0.290,0.292,0.288,0.289],[1.695,0.513,0.511,0.511,0.522,0.525],[2.549,2.128,2.097,2.103,2.091,2.095],[2.129,1.169,1.170,1.157,1.167,1.162],[null,null,null,null,null,null],[1.626,0.913,0.911,0.956,0.917,0.900],[2.476,2.089,2.077,2.092,2.134,1.723],[0.778,0.453,0.438,0.449,0.436,0.460],[0.709,0.338,0.312,0.313,0.328,0.303],[1.653,1.049,1.071,1.066,1.052,1.052],[0.706,0.429,0.454,0.438,0.423,0.438],[0.972,0.274,0.269,0.276,0.275,0.274],[0.958,0.733,0.746,0.739,0.733,0.735],[0.831,0.338,0.340,0.365,0.329,0.418],[1.421,1.034,1.060,1.036,1.042,1.043],[1.017,0.282,0.289,0.295,0.283,0.278],[1.719,0.825,0.825,0.826,0.832,0.819],[0.362,0.205,0.201,0.202,0.199,0.200],[0.786,0.318,0.300,0.323,0.297,0.299],[5.136,3.165,3.142,3.175,3.182,3.207],[0.969,0.446,0.440,0.439,0.441,0.445],[1.484,0.718,0.680,0.715,0.702,0.688],[14.170,13.224,13.490,13.815,13.722,13.727],[2.306,0.449,0.450,0.447,0.444,0.446],[null,null,null,null,null,null],[0.857,0.489,0.485,0.495,0.483,0.483],[0.983,0.236,0.239,0.238,0.238,0.236],[null,null,null,null,null,null],[0.946,0.251,0.249,0.251,0.252,0.252],[4.789,4.102,4.093,4.104,4.152,4.072],[null,null,null,null,null,null],[0.008,0.008,0.008,0.026,0.008,0.008],[1.561,0.307,0.294,0.280,0.293,0.302],[0.027,0.043,0.024,0.032,0.024,0.025],[1.646,0.440,0.444,0.451,0.444,0.442],[3.338,1.645,1.652,1.644,1.702,1.669],[null,null,null,null,null,null],[0.356,0.261,0.250,0.246,0.247,0.260],[0.152,0.078,0.081,0.105,0.074,0.076],[0.208,0.123,0.125,0.132,0.117,0.113],[0.653,0.350,0.345,0.369,0.361,0.353],[0.151,0.073,0.082,0.081,0.077,0.078],[4.924,4.708,4.710,4.716,4.680,4.701],[2.369,1.675,1.625,1.645,1.618,1.625],[0.812,0.351,0.335,0.329,0.318,0.320],[0.219,0.080,0.077,0.077,0.081,0.081],[0.142,0.055,0.054,0.051,0.052,0.050],[null,null,null,null,null,null],[1.458,0.780,0.776,0.780,0.770,0.773],[null,null,null,null,null,null],[5.252,5.348,5.425,5.434,5.421,5.438],[0.534,0.128,0.129,0.126,0.125,0.125],[3.650,3.162,3.175,3.263,3.135,3.058],[0.486,0.214,0.213,0.210,0.211,0.212],[0.656,0.346,0.348,0.345,0.349,0.345],[0.168,0.057,0.057,0.071,0.054,0.057],[0.258,0.227,0.213,0.195,0.208,0.208],[0.094,0.036,0.036,0.036,0.035,0.037],[0.286,0.210,0.185,0.205,0.210,0.184],[0.194,0.084,0.083,0.087,0.096,0.086],[0.161,0.097,0.091,0.096,0.093,0.090],[0.135,0.073,0.073,0.067,0.073,0.064],[0.176,0.121,0.109,0.107,0.108,0.108],[0.543,0.065,0.070,0.064,0.065,0.067],[0.538,0.057,0.051,0.054,0.053,0.053],[0.559,0.076,0.074,0.070,0.070,0.068],[0.216,0.130,0.125,0.122,0.124,0.126],[0.142,0.047,0.040,0.044,0.043,0.041],[0.247,0.156,0.155,0.149,0.148,0.150],[0.510,0.041,0.046,0.041,0.047,0.041],[0.534,0.036,0.036,0.036,0.034,0.036],[0.532,0.061,0.057,0.058,0.055,0.058],[0.604,0.411,0.413,0.424,0.411,0.419],[0.602,0.459,0.472,0.462,0.447,0.441],[0.520,0.407,0.420,0.403,0.404,0.403],[0.601,0.461,0.461,0.462,0.458,0.459],[0.548,0.438,0.424,0.424,0.427,0.424],[0.681,0.500,0.508,0.506,0.497,0.518],[0.479,0.240,0.224,0.217,0.204,0.216],[0.350,0.218,0.206,0.240,0.214,0.203],[0.675,0.372,0.381,0.376,0.350,0.351],[0.271,0.065,0.071,0.072,0.078,0.068],[0.207,0.045,0.046,0.042,0.049,0.042],[1.053,0.777,0.775,0.779,0.785,0.787],[0.918,0.814,0.752,0.756,0.758,0.775],[0.395,0.139,0.134,0.137,0.140,0.141],[0.378,0.110,0.111,0.109,0.109,0.113],[0.429,0.175,0.184,0.166,0.168,0.154],[0.398,0.182,0.180,0.170,0.173,0.177],[0.262,0.080,0.085,0.080,0.091,0.083],[0.204,0.073,0.068,0.067,0.067,0.066],[0.182,0.090,0.090,0.093,0.084,0.084],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.006,0.005,0.005],[0.279,0.110,0.097,0.101,0.097,0.098],[0.392,0.308,0.311,0.303,0.295,0.289],[0.601,0.094,0.095,0.098,0.096,0.098],[1.044,0.648,0.678,0.678,0.710,0.638],[0.576,0.107,0.116,0.119,0.146,0.117],[0.846,0.327,0.324,0.296,0.304,0.321],[0.352,0.235,0.236,0.231,0.229,0.220],[0.329,0.235,0.223,0.227,0.224,0.230],[0.367,0.275,0.284,0.257,0.257,0.259],[0.639,0.149,0.138,0.143,0.155,0.155],[0.253,0.131,0.132,0.126,0.129,0.127],[0.679,0.153,0.152,0.142,0.155,0.156],[0.368,0.082,0.077,0.080,0.084,0.088],[0.187,0.074,0.077,0.071,0.068,0.069],[0.376,0.099,0.090,0.091,0.089,0.089],[0.205,0.096,0.095,0.097,0.087,0.090],[2.806,2.319,2.322,2.311,2.329,2.317],[2.551,2.342,2.393,2.357,2.361,2.349],[2.560,2.338,2.427,2.411,2.360,2.397],[2.477,2.350,2.323,2.354,2.338,2.329],[2.012,1.587,1.578,1.571,1.601,1.590],[2.790,2.627,2.602,2.618,2.606,2.614],[2.795,2.615,2.636,2.610,2.607,2.657],[2.774,2.629,2.601,2.605,2.612,2.633],[1.778,1.616,1.615,1.632,1.624,1.630],[2.842,2.665,2.661,2.669,2.647,2.665],[1.079,0.529,0.521,0.538,0.549,0.542],[0.006,0.005,0.006,0.006,0.005,0.005],[0.647,0.107,0.104,0.100,0.099,0.093],[0.804,0.148,0.145,0.146,0.145,0.146],[0.730,0.117,0.118,0.112,0.109,0.106],[0.412,0.170,0.176,0.171,0.178,0.172],[0.826,0.476,0.472,0.451,0.462,0.461],[0.923,0.613,0.609,0.613,0.607,0.617],[0.819,0.598,0.590,0.594,0.579,0.601],[0.938,0.663,0.630,0.621,0.640,0.647],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.005,0.006,0.005,0.006],[0.763,0.180,0.162,0.157,0.158,0.166],[0.324,0.169,0.180,0.164,0.169,0.159],[0.751,0.178,0.180,0.186,0.188,0.181],[0.355,0.229,0.224,0.230,0.226,0.226],[0.383,0.104,0.110,0.107,0.097,0.107],[0.393,0.106,0.101,0.103,0.105,0.102],[0.245,0.110,0.102,0.112,0.102,0.110],[0.911,0.231,0.223,0.235,0.221,0.225],[0.452,0.180,0.175,0.173,0.174,0.166],[0.685,0.122,0.117,0.106,0.112,0.112],[0.239,0.093,0.093,0.101,0.098,0.099],[0.705,0.131,0.129,0.123,0.129,0.125],[0.960,0.646,0.637,0.620,0.631,0.621],[0.884,0.631,0.625,0.639,0.644,0.620],[0.901,0.654,0.649,0.659,0.633,0.644],[0.007,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.797,0.197,0.182,0.187,0.187,0.194],[0.667,0.129,0.133,0.144,0.131,0.130],[0.394,0.240,0.214,0.214,0.210,0.214],[0.916,0.169,0.174,0.176,0.169,0.160],[0.855,0.179,0.162,0.161,0.167,0.160],[0.615,0.289,0.298,0.334,0.295,0.366],[0.751,0.156,0.149,0.149,0.154,0.156],[0.296,0.128,0.130,0.126,0.125,0.122],[0.800,0.179,0.171,0.183,0.180,0.174],[0.828,0.206,0.185,0.179,0.178,0.181],[0.295,0.115,0.115,0.106,0.110,0.110],[0.818,0.212,0.192,0.191,0.192,0.206],[0.167,0.077,0.079,0.079,0.078,0.095],[0.166,0.095,0.085,0.087,0.086,0.087],[0.324,0.183,0.166,0.160,0.162,0.169],[0.254,0.142,0.153,0.140,0.136,0.136],[0.299,0.182,0.188,0.177,0.182,0.180]],"version":"25.7.8.71","source":"results/25.7.8.71.json"} +,{"actual_version":"25.5.11.15","data_size":{"coffeeshop":44644419975,"hits":14247687019,"job":1828094510,"mgbench":2954107753,"ontime":2699155844,"ssb":73313888209,"taxi":24223470578,"tpcds":18793057599,"tpch":17236038412,"uk":781025370},"kind":"versions-benchmark","load_time":{"coffeeshop":802,"hits":221,"job":18,"mgbench":61,"ontime":57,"ssb":1426,"taxi":529,"tpcds":286,"tpch":281,"uk":36},"machine":"c7a.4xlarge","release_date":"2025-10-15","result":[[0.068,0.007,0.007,0.283,0.007,0.007],[0.021,0.003,0.003,0.004,0.003,0.003],[0.042,0.018,0.008,0.029,0.008,0.009],[0.037,0.009,0.009,0.023,0.008,0.009],[0.044,0.022,0.022,0.045,0.022,0.025],[0.056,0.015,0.015,0.034,0.015,0.015],[0.022,0.006,0.005,0.006,0.005,0.005],[0.044,0.006,0.006,0.006,0.006,0.006],[0.066,0.007,0.006,0.049,0.006,0.006],[0.087,0.056,0.055,0.052,0.056,0.052],[0.256,0.175,0.177,0.173,0.182,0.183],[0.344,0.209,0.228,0.224,0.222,0.219],[0.023,0.007,0.007,0.007,0.007,0.007],[0.028,0.013,0.012,0.013,0.013,0.014],[0.633,0.538,0.522,0.542,0.498,0.508],[0.481,0.081,0.078,0.082,0.113,0.092],[0.040,0.014,0.016,0.015,0.015,0.015],[0.043,0.013,0.014,0.013,0.013,0.013],[6.447,1.115,1.085,1.113,1.097,1.098],[4.759,0.848,0.831,0.847,0.848,0.849],[4.774,0.880,0.884,0.879,0.872,0.872],[5.353,1.472,1.428,1.423,1.437,1.413],[6.246,1.188,1.194,1.192,1.184,1.193],[3.972,0.623,0.614,0.603,0.611,0.603],[0.056,0.021,0.022,0.018,0.018,0.019],[7.877,1.672,1.655,1.701,1.650,1.656],[1.837,0.520,0.508,0.514,0.504,0.510],[1.926,0.360,0.357,0.357,0.353,0.365],[0.002,0.001,0.001,0.001,0.001,0.001],[0.015,0.006,0.005,0.005,0.006,0.006],[0.048,0.014,0.014,0.036,0.016,0.014],[0.128,0.019,0.020,0.021,0.019,0.021],[0.163,0.052,0.052,0.052,0.054,0.052],[0.293,0.111,0.113,0.112,0.110,0.111],[0.003,0.002,0.002,0.022,0.002,0.002],[0.016,0.007,0.008,0.008,0.008,0.007],[0.377,0.221,0.214,0.214,0.213,0.236],[0.424,0.254,0.251,0.250,0.249,0.256],[0.182,0.061,0.064,0.062,0.062,0.061],[0.197,0.077,0.077,0.077,0.083,0.078],[0.491,0.287,0.278,0.284,0.271,0.266],[0.661,0.375,0.373,0.373,0.367,0.369],[0.573,0.391,0.399,0.385,0.386,0.374],[0.376,0.226,0.222,0.224,0.220,0.223],[1.319,0.963,0.942,1.132,0.930,1.128],[1.132,0.622,0.616,0.616,0.614,0.618],[2.868,2.003,1.993,2.014,2.023,2.003],[0.134,0.002,0.002,0.002,0.002,0.002],[1.484,0.029,0.025,0.026,0.025,0.020],[1.747,0.013,0.012,0.025,0.012,0.015],[3.927,0.735,0.743,0.734,0.730,0.729],[0.717,0.639,0.632,0.649,0.650,0.627],[0.408,0.096,0.100,0.094,0.094,0.097],[0.250,0.077,0.074,0.075,0.075,0.073],[0.417,0.099,0.096,0.095,0.094,0.095],[1.469,0.307,0.314,0.336,0.284,0.286],[1.455,0.474,0.467,0.474,0.465,0.472],[0.054,0.021,0.020,0.625,0.020,0.020],[0.509,0.241,0.233,0.246,0.215,0.229],[0.926,0.296,0.326,0.316,0.283,0.329],[2.116,1.464,1.425,1.449,1.479,1.456],[2.611,1.426,1.349,1.364,1.337,1.353],[2.650,1.374,1.377,1.336,1.376,1.419],[0.288,0.214,0.207,0.240,0.176,0.175],[0.056,0.028,0.027,0.029,0.030,0.030],[0.034,0.025,0.022,0.020,0.022,0.021],[0.043,0.014,0.014,0.013,0.014,0.013],[0.094,0.051,0.052,0.048,0.046,0.047],[0.022,0.004,0.004,0.004,0.004,0.004],[0.019,0.004,0.004,0.004,0.004,0.004],[0.013,0.004,0.004,0.004,0.003,0.003],[0.359,0.040,0.039,0.058,0.043,0.038],[0.303,0.055,0.056,0.054,0.052,0.062],[0.098,0.037,0.034,0.068,0.031,0.036],[0.218,0.058,0.064,0.085,0.058,0.057],[0.080,0.035,0.037,0.034,0.032,0.037],[0.170,0.071,0.066,0.068,0.068,0.065],[0.183,0.095,0.085,0.086,0.091,0.088],[0.057,0.033,0.036,0.033,0.038,0.032],[0.111,0.065,0.065,0.072,0.058,0.061],[0.245,0.149,0.150,0.153,0.141,0.141],[0.426,0.163,0.154,0.157,0.168,0.159],[0.354,0.246,0.242,0.263,0.242,0.242],[0.129,0.032,0.034,0.031,0.034,0.036],[0.572,0.288,0.282,0.297,0.284,0.273],[2.303,1.778,1.786,1.778,1.788,1.767],[8.646,0.974,0.970,0.984,0.966,0.995],[2.042,1.033,1.042,1.048,1.051,1.042],[12.872,2.492,2.477,2.505,2.502,2.483],[4.267,2.881,2.880,2.873,2.893,2.891],[4.071,1.535,1.544,1.548,1.544,1.542],[3.646,3.452,3.429,3.463,3.434,3.404],[5.885,5.584,5.604,5.662,5.592,5.587],[3.303,2.813,2.823,2.828,2.818,2.801],[4.511,4.202,4.225,4.210,4.215,4.204],[4.563,4.233,4.277,4.296,4.251,4.255],[7.075,6.835,6.825,6.877,6.849,6.830],[3.054,2.761,2.741,2.756,2.746,2.744],[46.374,45.048,45.367,44.559,44.056,44.119],[6.219,4.839,4.810,4.812,4.797,4.860],[2.464,2.329,2.321,2.320,2.321,2.317],[2.391,1.625,1.626,1.631,1.630,1.619],[3.423,3.293,3.343,3.295,3.297,3.284],[12.231,11.897,11.932,11.823,11.794,11.835],[33.301,34.093,34.681,33.853,33.932,33.763],[26.276,23.677,24.003,24.038,24.000,24.001],[2.743,0.629,0.618,0.426,0.387,0.387],[null,null,null,null,null,null],[2.432,1.668,1.553,1.619,1.546,1.533],[null,null,null,null,null,null],[4.053,2.880,2.943,2.922,2.955,2.948],[0.221,0.075,0.078,0.079,0.082,0.079],[3.065,2.273,2.258,2.243,2.266,2.262],[4.594,3.373,3.427,3.413,3.390,3.389],[6.611,5.266,5.408,5.402,5.454,5.450],[2.025,1.126,1.083,1.072,1.098,1.075],[0.529,0.364,0.359,0.362,0.363,0.366],[1.170,0.381,0.377,0.393,0.382,0.384],[3.070,1.903,1.922,1.944,1.961,1.664],[0.193,0.109,0.110,0.109,0.105,0.110],[0.208,0.104,0.116,0.118,0.099,0.103],[0.366,0.208,0.221,0.213,0.213,0.209],[null,null,null,null,null,null],[2.161,1.234,1.248,1.245,1.248,1.247],[4.273,0.954,0.944,0.947,0.975,0.953],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.870,0.630,0.556,0.555,0.549,0.558],[1.533,1.165,1.145,1.138,1.144,1.163],[17.634,16.357,16.591,16.711,16.625,16.750],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.400,0.397,0.378,0.399,0.370,0.366],[0.826,0.459,0.444,0.436,0.437,0.447],[1.355,0.978,0.976,0.989,0.979,0.984],[null,null,null,null,null,null],[6.590,5.800,5.837,5.825,5.844,5.861],[0.230,0.143,0.138,0.146,0.139,0.141],[3.199,1.726,1.783,1.743,1.779,1.761],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.842,0.541,0.527,0.530,0.530,0.572],[null,null,null,null,null,null],[2.931,1.710,1.686,1.813,1.698,1.698],[1.214,0.574,0.588,0.595,0.565,0.567],[1.531,0.870,0.847,0.849,0.868,0.849],[0.359,0.246,0.248,0.240,0.237,0.233],[0.213,0.111,0.108,0.128,0.111,0.109],[0.291,0.163,0.157,0.157,0.153,0.151],[6.454,5.109,5.132,5.067,5.041,5.049],[6.456,5.581,5.534,5.560,5.522,5.514],[2.207,1.475,1.461,1.481,1.475,1.477],[2.213,1.485,1.469,1.509,1.554,1.489],[3.055,1.678,1.696,1.684,1.686,1.718],[0.703,0.197,0.193,0.192,0.198,0.205],[1.339,0.381,0.371,0.368,0.370,0.377],[1.424,0.944,0.961,0.943,0.942,0.952],[2.642,1.719,1.663,1.684,1.727,1.734],[null,null,null,null,null,null],[1.397,0.892,0.867,0.880,0.856,0.847],[null,null,null,null,null,null],[1.129,0.291,0.294,0.298,0.287,0.295],[1.072,0.331,0.336,0.326,0.327,0.326],[null,null,null,null,null,null],[0.982,0.373,0.374,0.378,0.376,0.375],[0.296,0.193,0.179,0.175,0.185,0.175],[4.856,4.692,4.662,4.661,4.600,4.659],[0.444,0.352,0.330,0.331,0.333,0.340],[0.411,0.345,0.332,0.332,0.332,0.343],[0.848,0.500,0.505,0.493,0.496,0.520],[null,null,null,null,null,null],[0.777,0.462,0.471,0.445,0.441,0.462],[2.023,1.636,1.638,1.639,1.607,1.619],[0.485,0.189,0.182,0.183,0.182,0.179],[0.541,0.354,0.347,0.343,0.344,0.344],[1.740,0.553,0.552,0.544,0.551,0.545],[3.155,2.550,2.548,2.496,2.513,2.560],[2.230,1.293,1.264,1.294,1.291,1.268],[null,null,null,null,null,null],[1.743,1.003,1.019,1.036,1.001,1.001],[2.528,2.190,2.158,2.152,2.107,2.113],[0.788,0.447,0.435,0.445,0.448,0.421],[0.705,0.330,0.304,0.298,0.310,0.320],[1.791,1.268,1.235,1.285,1.253,1.211],[0.716,0.450,0.445,0.448,0.478,0.469],[1.119,0.331,0.323,0.314,0.320,0.328],[1.245,1.066,1.082,1.056,1.048,1.032],[0.875,0.376,0.376,0.402,0.379,0.381],[1.457,1.066,1.054,1.064,1.054,1.061],[1.148,0.334,0.353,0.334,0.345,0.336],[1.810,0.874,0.871,0.874,0.885,0.876],[0.377,0.222,0.227,0.218,0.223,0.226],[0.778,0.322,0.312,0.301,0.299,0.302],[5.519,3.547,3.531,3.574,3.485,3.518],[1.045,0.487,0.487,0.488,0.472,0.474],[1.593,0.800,0.757,0.797,0.773,0.771],[13.984,12.934,14.396,13.658,13.220,13.444],[2.328,0.487,0.491,0.484,0.479,0.481],[null,null,null,null,null,null],[0.904,0.538,0.536,0.530,0.536,0.533],[1.070,0.272,0.272,0.267,0.269,0.264],[null,null,null,null,null,null],[0.974,0.284,0.279,0.282,0.283,0.281],[4.775,4.209,4.288,4.221,4.226,4.249],[null,null,null,null,null,null],[0.009,0.009,0.009,0.026,0.009,0.009],[1.581,0.324,0.325,0.327,0.319,0.320],[0.033,0.047,0.028,0.036,0.031,0.028],[1.658,0.466,0.463,0.463,0.465,0.462],[3.608,1.870,1.843,1.886,1.848,1.851],[null,null,null,null,null,null],[0.382,0.266,0.256,0.262,0.255,0.257],[0.156,0.087,0.085,0.117,0.090,0.089],[0.202,0.120,0.122,0.113,0.122,0.114],[0.689,0.400,0.401,0.425,0.424,0.402],[0.159,0.089,0.084,0.087,0.092,0.087],[4.875,4.683,4.665,4.729,4.669,4.633],[2.756,1.912,1.910,1.906,1.897,1.889],[0.808,0.352,0.329,0.335,0.370,0.337],[0.233,0.083,0.084,0.084,0.081,0.084],[0.145,0.065,0.061,0.063,0.059,0.060],[null,null,null,null,null,null],[1.828,0.971,0.985,1.008,0.994,0.974],[null,null,null,null,null,null],[5.204,5.271,5.263,5.290,5.254,5.218],[0.556,0.143,0.148,0.143,0.145,0.147],[3.717,3.275,3.207,3.222,3.207,3.192],[0.610,0.365,0.371,0.380,0.399,0.386],[0.662,0.377,0.375,0.374,0.382,0.378],[0.178,0.056,0.063,0.086,0.059,0.055],[0.281,0.211,0.223,0.222,0.213,0.212],[0.102,0.041,0.037,0.043,0.042,0.037],[0.305,0.239,0.210,0.236,0.222,0.226],[0.190,0.090,0.090,0.089,0.084,0.090],[0.171,0.118,0.106,0.096,0.093,0.098],[0.136,0.072,0.070,0.084,0.067,0.080],[0.191,0.117,0.115,0.119,0.111,0.110],[0.555,0.066,0.065,0.067,0.074,0.063],[0.564,0.063,0.053,0.053,0.053,0.053],[0.572,0.076,0.070,0.071,0.072,0.066],[0.222,0.128,0.131,0.135,0.135,0.141],[0.138,0.061,0.044,0.043,0.041,0.042],[0.258,0.167,0.156,0.157,0.163,0.161],[0.507,0.044,0.046,0.044,0.046,0.043],[0.529,0.037,0.038,0.036,0.037,0.039],[0.528,0.069,0.061,0.059,0.059,0.068],[0.703,0.505,0.498,0.492,0.495,0.501],[0.714,0.532,0.521,0.525,0.529,0.522],[0.607,0.489,0.487,0.484,0.484,0.493],[0.689,0.556,0.555,0.538,0.543,0.546],[0.638,0.508,0.514,0.511,0.503,0.511],[0.760,0.599,0.589,0.591,0.600,0.597],[0.465,0.224,0.218,0.224,0.234,0.218],[0.367,0.218,0.222,0.214,0.228,0.218],[0.709,0.378,0.391,0.368,0.359,0.400],[0.263,0.067,0.071,0.071,0.066,0.073],[0.212,0.044,0.046,0.045,0.046,0.044],[1.109,0.852,0.845,0.849,0.864,0.853],[0.985,0.846,0.826,0.824,0.837,0.824],[0.400,0.149,0.143,0.167,0.146,0.154],[0.389,0.120,0.118,0.122,0.129,0.117],[0.431,0.179,0.166,0.179,0.172,0.175],[0.401,0.203,0.195,0.176,0.185,0.189],[0.263,0.083,0.084,0.083,0.082,0.087],[0.202,0.074,0.077,0.071,0.071,0.077],[0.190,0.085,0.093,0.093,0.094,0.095],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[0.286,0.102,0.098,0.105,0.110,0.098],[0.392,0.303,0.302,0.319,0.309,0.296],[0.589,0.105,0.103,0.099,0.098,0.105],[1.098,0.663,0.706,0.729,0.695,0.726],[0.587,0.105,0.123,0.112,0.105,0.125],[0.841,0.337,0.339,0.318,0.311,0.337],[0.350,0.248,0.239,0.230,0.243,0.239],[0.333,0.241,0.233,0.224,0.224,0.235],[0.378,0.259,0.257,0.266,0.264,0.274],[0.667,0.160,0.167,0.159,0.160,0.163],[0.269,0.141,0.145,0.144,0.145,0.135],[0.684,0.183,0.180,0.162,0.172,0.173],[0.383,0.090,0.090,0.097,0.085,0.086],[0.202,0.078,0.076,0.085,0.077,0.073],[0.387,0.097,0.099,0.100,0.095,0.099],[0.214,0.113,0.109,0.101,0.104,0.100],[3.081,2.561,2.568,2.572,2.558,2.578],[2.799,2.610,2.588,2.601,2.605,2.627],[2.809,2.608,2.614,2.675,2.604,2.619],[2.730,2.577,2.597,2.582,2.562,2.581],[2.312,1.843,1.826,1.832,1.856,1.849],[3.601,3.453,3.416,3.410,3.435,3.441],[3.591,3.413,3.424,3.423,3.433,3.420],[3.584,3.456,3.429,3.435,3.428,3.433],[2.052,1.870,1.881,1.898,1.862,1.876],[3.630,3.450,3.461,3.498,3.487,3.456],[1.101,0.551,0.561,0.530,0.560,0.532],[0.007,0.006,0.006,0.006,0.008,0.007],[0.664,0.103,0.106,0.099,0.106,0.097],[0.805,0.155,0.155,0.152,0.154,0.157],[0.747,0.128,0.125,0.116,0.122,0.116],[0.413,0.182,0.182,0.184,0.189,0.182],[0.773,0.488,0.496,0.489,0.491,0.499],[0.907,0.627,0.607,0.623,0.612,0.606],[0.804,0.608,0.590,0.597,0.593,0.598],[0.944,0.626,0.619,0.621,0.674,0.628],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.777,0.176,0.189,0.176,0.174,0.173],[0.327,0.174,0.187,0.171,0.188,0.181],[0.736,0.206,0.198,0.196,0.199,0.201],[0.367,0.237,0.245,0.250,0.265,0.244],[0.397,0.118,0.108,0.110,0.105,0.106],[0.398,0.111,0.103,0.105,0.109,0.111],[0.235,0.118,0.115,0.115,0.110,0.118],[0.908,0.248,0.249,0.232,0.233,0.237],[0.457,0.204,0.181,0.179,0.182,0.172],[0.695,0.125,0.114,0.119,0.117,0.118],[0.239,0.098,0.097,0.109,0.096,0.097],[0.717,0.163,0.140,0.140,0.145,0.129],[0.939,0.677,0.626,0.623,0.628,0.631],[0.883,0.622,0.613,0.610,0.617,0.622],[0.875,0.662,0.653,0.635,0.638,0.641],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.007,0.006,0.007,0.006,0.006],[0.812,0.209,0.203,0.194,0.187,0.197],[0.664,0.152,0.136,0.143,0.139,0.137],[0.375,0.233,0.222,0.244,0.230,0.212],[0.923,0.178,0.173,0.169,0.171,0.177],[0.856,0.178,0.184,0.172,0.173,0.182],[0.620,0.324,0.338,0.296,0.310,0.328],[0.756,0.174,0.164,0.161,0.162,0.148],[0.289,0.130,0.130,0.134,0.130,0.134],[0.804,0.182,0.183,0.188,0.185,0.182],[0.823,0.183,0.182,0.182,0.191,0.188],[0.290,0.113,0.117,0.111,0.111,0.118],[0.813,0.215,0.197,0.210,0.205,0.195],[0.157,0.086,0.082,0.082,0.082,0.084],[0.164,0.096,0.090,0.101,0.088,0.088],[0.326,0.188,0.177,0.170,0.165,0.172],[0.269,0.153,0.152,0.139,0.138,0.147],[0.302,0.189,0.184,0.196,0.196,0.195]],"version":"25.5.11.15","source":"results/25.5.11.15.json"} +,{"actual_version":"25.9.7.56","data_size":{"coffeeshop":44635030695,"hits":14323186592,"job":1828094569,"mgbench":2953341335,"ontime":2699312914,"ssb":73079342297,"taxi":24223726616,"tpcds":18792337957,"tpch":17235461040,"uk":780916031},"kind":"versions-benchmark","load_time":{"coffeeshop":811,"hits":196,"job":20,"mgbench":69,"ontime":58,"ssb":1468,"taxi":555,"tpcds":280,"tpch":309,"uk":37},"machine":"c7a.4xlarge","release_date":"2025-12-19","result":[[0.074,0.007,0.006,0.326,0.006,0.007],[0.022,0.003,0.003,0.003,0.003,0.003],[0.052,0.019,0.009,0.031,0.009,0.008],[0.041,0.010,0.009,0.008,0.009,0.010],[0.055,0.020,0.024,0.044,0.018,0.022],[0.065,0.016,0.017,0.035,0.016,0.015],[0.027,0.004,0.004,0.004,0.005,0.005],[0.050,0.005,0.006,0.005,0.005,0.005],[0.071,0.005,0.005,0.050,0.005,0.005],[0.093,0.051,0.053,0.051,0.056,0.052],[0.270,0.205,0.207,0.194,0.199,0.190],[0.393,0.239,0.244,0.243,0.228,0.239],[0.026,0.005,0.004,0.004,0.005,0.004],[0.028,0.009,0.011,0.010,0.009,0.013],[0.694,0.588,0.584,0.589,0.560,0.559],[0.522,0.081,0.078,0.086,0.081,0.083],[0.042,0.013,0.034,0.013,0.015,0.014],[0.040,0.012,0.011,0.012,0.012,0.012],[6.398,1.214,1.219,1.241,1.224,1.215],[4.723,0.937,0.962,0.942,0.956,0.938],[4.735,0.957,0.985,0.978,0.966,0.956],[5.307,1.524,1.523,1.542,1.529,1.530],[6.207,1.298,1.304,1.298,1.289,1.298],[3.933,0.702,0.689,0.668,0.665,0.695],[0.064,0.017,0.019,0.021,0.017,0.017],[7.761,1.927,1.830,1.826,1.807,1.784],[1.794,0.555,0.576,0.570,0.571,0.601],[1.874,0.445,0.448,0.414,0.434,0.436],[0.002,0.002,0.001,0.002,0.002,0.001],[0.017,0.006,0.006,0.006,0.006,0.006],[0.055,0.018,0.017,0.038,0.017,0.019],[0.139,0.024,0.024,0.023,0.025,0.026],[0.172,0.065,0.057,0.061,0.055,0.056],[0.299,0.120,0.123,0.127,0.122,0.121],[0.004,0.002,0.002,0.022,0.002,0.002],[0.018,0.008,0.008,0.008,0.008,0.008],[0.413,0.261,0.259,0.268,0.248,0.236],[0.440,0.282,0.280,0.280,0.286,0.281],[0.189,0.069,0.070,0.066,0.071,0.073],[0.202,0.091,0.090,0.090,0.091,0.089],[0.521,0.302,0.290,0.293,0.284,0.287],[0.696,0.402,0.431,0.384,0.389,0.387],[0.588,0.369,0.347,0.333,0.351,0.337],[0.385,0.212,0.195,0.212,0.209,0.209],[1.313,0.831,0.808,0.846,0.808,0.805],[0.800,0.507,0.490,0.489,0.506,0.469],[2.471,1.607,1.540,1.547,1.519,1.538],[0.135,0.002,0.002,0.002,0.002,0.002],[1.627,0.023,0.023,0.023,0.021,0.024],[1.786,0.008,0.007,0.021,0.007,0.007],[4.000,0.840,0.786,0.826,0.805,0.825],[0.975,0.086,0.082,0.081,0.079,0.083],[0.425,0.103,0.104,0.102,0.102,0.103],[0.255,0.080,0.086,0.080,0.080,0.082],[0.426,0.106,0.112,0.100,0.107,0.102],[1.546,0.315,0.329,0.340,0.314,0.326],[1.515,0.539,0.509,0.516,0.548,0.542],[0.061,0.025,0.023,0.656,0.024,0.026],[0.557,0.235,0.243,0.258,0.232,0.231],[0.973,0.308,0.312,0.334,0.317,0.353],[2.321,1.540,1.497,1.527,1.574,1.488],[2.910,1.584,1.441,1.396,1.449,1.478],[2.862,1.503,1.521,1.453,1.461,1.489],[0.246,0.168,0.182,0.211,0.203,0.203],[0.107,0.063,0.057,0.064,0.067,0.058],[0.046,0.035,0.029,0.031,0.028,0.034],[0.072,0.021,0.025,0.023,0.023,0.024],[0.194,0.123,0.109,0.118,0.121,0.104],[0.032,0.004,0.004,0.004,0.004,0.004],[0.026,0.004,0.004,0.004,0.004,0.003],[0.015,0.003,0.003,0.004,0.004,0.004],[0.454,0.039,0.043,0.064,0.041,0.043],[0.377,0.060,0.063,0.059,0.060,0.056],[0.134,0.035,0.035,0.055,0.034,0.034],[0.257,0.062,0.057,0.081,0.068,0.062],[0.075,0.022,0.025,0.022,0.020,0.020],[0.176,0.063,0.059,0.057,0.059,0.064],[0.203,0.092,0.081,0.079,0.083,0.082],[0.050,0.023,0.021,0.022,0.023,0.021],[0.105,0.040,0.036,0.045,0.036,0.039],[0.255,0.124,0.139,0.125,0.135,0.123],[0.503,0.166,0.159,0.159,0.169,0.157],[0.404,0.258,0.251,0.252,0.251,0.250],[0.147,0.032,0.029,0.030,0.030,0.028],[0.673,0.307,0.309,0.337,0.316,0.325],[2.503,1.956,1.982,1.976,1.987,1.962],[8.679,1.149,1.078,1.161,1.154,1.150],[2.568,1.188,1.187,1.129,1.139,1.175],[12.883,2.604,2.615,2.571,2.636,2.592],[4.277,2.396,2.414,2.488,2.466,2.431],[4.069,1.835,1.826,1.860,1.870,1.876],[3.690,3.228,3.214,3.247,3.463,3.400],[6.598,6.089,6.066,6.315,6.542,6.573],[3.313,2.680,2.748,2.758,2.714,2.742],[5.136,4.648,4.898,4.944,4.782,4.871],[4.381,4.078,4.093,4.102,3.907,4.096],[7.989,7.665,7.663,7.634,7.633,7.664],[2.974,2.611,2.629,2.638,2.572,2.657],[48.758,47.317,46.238,47.073,45.968,45.648],[6.230,4.967,4.889,4.853,4.940,4.828],[2.561,2.400,2.397,2.393,2.388,2.396],[2.407,1.615,1.639,1.605,1.608,1.597],[3.686,3.496,3.457,3.483,3.489,3.523],[11.238,10.863,10.802,10.750,10.884,11.123],[35.505,35.916,35.857,35.523,35.144,35.712],[26.315,23.577,23.976,24.007,24.006,24.004],[2.700,0.686,0.752,0.540,0.482,0.469],[0.927,0.530,0.511,0.517,0.491,0.563],[2.858,1.763,1.729,1.732,1.698,1.722],[1.504,0.907,0.872,0.894,0.838,0.830],[4.544,2.953,2.946,2.959,2.912,3.098],[0.250,0.096,0.091,0.090,0.096,0.088],[2.838,1.839,1.714,1.910,1.802,1.797],[5.274,3.831,3.717,3.752,3.801,3.739],[7.351,6.377,6.030,6.246,6.528,6.391],[2.257,1.234,1.165,1.155,1.110,1.211],[0.447,0.259,0.268,0.278,0.278,0.269],[1.580,0.344,0.342,0.363,0.349,0.342],[3.036,1.830,1.807,1.858,1.802,1.889],[0.206,0.106,0.105,0.115,0.105,0.108],[0.223,0.130,0.112,0.130,0.116,0.112],[0.384,0.204,0.206,0.200,0.196,0.201],[2.899,1.808,1.731,1.719,1.700,1.757],[2.559,1.460,1.426,1.383,1.388,1.454],[4.189,1.125,1.126,1.111,1.105,1.117],[0.620,0.172,0.171,0.176,0.165,0.175],[null,null,null,null,null,null],[0.858,0.281,0.299,0.296,0.275,0.275],[0.256,0.114,0.103,0.103,0.117,0.102],[1.069,0.741,0.640,0.641,0.665,0.659],[1.719,1.297,1.281,1.299,1.285,1.285],[30.557,29.702,29.382,28.893,29.873,29.234],[null,null,null,null,null,null],[2.478,1.978,1.999,2.061,1.988,1.988],[1.486,0.369,0.382,0.395,0.367,0.379],[0.900,0.438,0.447,0.431,0.422,0.445],[1.596,1.160,1.154,1.139,1.174,1.182],[0.862,0.295,0.292,0.284,0.285,0.289],[7.080,6.204,6.150,6.151,6.131,6.259],[0.210,0.089,0.086,0.099,0.089,0.083],[3.485,1.821,1.850,1.855,1.787,1.797],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.813,0.510,0.507,0.541,0.487,0.500],[6.951,6.055,6.025,6.019,5.993,6.149],[3.199,1.665,1.653,1.566,1.614,1.605],[1.256,0.548,0.561,0.528,0.562,0.545],[1.732,0.899,0.911,0.881,0.857,0.848],[0.302,0.122,0.124,0.125,0.127,0.122],[0.196,0.082,0.080,0.103,0.077,0.077],[0.310,0.200,0.193,0.194,0.193,0.197],[5.847,4.433,4.301,4.371,4.262,4.241],[5.977,4.869,4.679,4.698,4.822,4.769],[2.228,1.421,1.437,1.376,1.366,1.336],[2.112,1.379,1.359,1.298,1.454,1.345],[2.860,1.625,1.607,1.693,1.677,1.564],[0.785,0.206,0.196,0.197,0.191,0.198],[1.391,0.384,0.377,0.371,0.346,0.364],[1.741,1.125,1.152,1.176,1.160,1.102],[2.874,1.744,1.618,1.682,1.521,1.645],[null,null,null,null,null,null],[1.418,0.782,0.758,0.807,0.804,0.805],[0.309,0.104,0.099,0.104,0.098,0.096],[1.156,0.277,0.264,0.261,0.263,0.262],[1.176,0.307,0.309,0.309,0.310,0.322],[0.920,0.323,0.342,0.368,0.321,0.321],[1.006,0.331,0.323,0.347,0.327,0.314],[0.368,0.223,0.214,0.229,0.212,0.200],[5.479,5.327,5.136,5.353,5.195,5.224],[0.358,0.239,0.232,0.233,0.232,0.227],[0.319,0.236,0.229,0.205,0.209,0.216],[0.829,0.459,0.453,0.441,0.452,0.438],[0.037,0.020,0.018,0.017,0.016,0.016],[0.919,0.541,0.550,0.497,0.490,0.514],[2.147,1.688,1.622,1.683,1.722,1.655],[0.593,0.226,0.220,0.212,0.218,0.233],[0.472,0.288,0.295,0.304,0.301,0.312],[1.899,0.535,0.562,0.545,0.477,0.481],[2.682,2.042,2.148,2.056,2.138,2.187],[2.374,1.267,1.291,1.260,1.333,1.232],[null,null,null,null,null,null],[1.778,0.951,0.980,0.981,0.960,0.964],[2.717,1.862,2.313,1.844,2.252,2.312],[0.925,0.558,0.547,0.526,0.482,0.503],[0.866,0.426,0.338,0.335,0.341,0.341],[1.993,1.199,1.238,1.217,1.277,1.162],[0.853,0.524,0.498,0.476,0.507,0.492],[1.133,0.281,0.282,0.281,0.294,0.277],[1.086,0.894,0.892,0.843,0.868,0.871],[0.933,0.324,0.334,0.361,0.333,0.319],[1.652,1.207,1.228,1.218,1.137,1.178],[1.183,0.298,0.295,0.294,0.297,0.294],[1.666,0.685,0.671,0.671,0.680,0.664],[0.399,0.199,0.219,0.232,0.213,0.219],[0.882,0.340,0.344,0.325,0.344,0.323],[5.743,3.272,3.378,3.321,3.191,3.199],[0.970,0.475,0.466,0.500,0.466,0.501],[1.585,0.678,0.639,0.685,0.679,0.671],[16.483,16.155,16.477,16.024,16.244,17.031],[2.336,0.505,0.495,0.498,0.501,0.460],[0.854,0.282,0.254,0.273,0.285,0.263],[0.960,0.529,0.454,0.560,0.506,0.485],[1.075,0.230,0.221,0.226,0.220,0.219],[null,null,null,null,null,null],[1.067,0.259,0.264,0.255,0.255,0.261],[5.482,4.448,4.367,4.471,4.484,4.362],[null,null,null,null,null,null],[0.009,0.008,0.008,0.009,0.008,0.008],[1.593,0.297,0.293,0.281,0.291,0.276],[0.030,0.044,0.027,0.034,0.027,0.026],[1.709,0.414,0.410,0.411,0.411,0.405],[3.466,1.493,1.531,1.471,1.472,1.463],[null,null,null,null,null,null],[0.468,0.300,0.265,0.260,0.262,0.270],[0.168,0.066,0.065,0.100,0.075,0.085],[0.229,0.131,0.131,0.122,0.120,0.122],[0.694,0.359,0.361,0.370,0.344,0.365],[0.174,0.083,0.081,0.082,0.091,0.085],[5.231,5.143,4.987,4.967,5.095,5.125],[2.467,1.522,1.501,1.516,1.535,1.508],[0.936,0.408,0.384,0.370,0.374,0.430],[0.244,0.076,0.076,0.077,0.070,0.076],[0.164,0.060,0.055,0.056,0.055,0.055],[0.164,0.064,0.066,0.065,0.066,0.066],[1.505,0.746,0.732,0.741,0.696,0.699],[3.790,3.100,3.190,3.340,3.305,3.346],[5.677,5.248,5.225,5.177,5.137,5.169],[0.615,0.127,0.120,0.122,0.120,0.120],[3.802,3.315,3.221,2.407,3.546,3.575],[0.563,0.227,0.227,0.229,0.229,0.230],[0.678,0.381,0.379,0.375,0.375,0.386],[0.190,0.062,0.058,0.074,0.057,0.060],[0.277,0.212,0.227,0.199,0.228,0.210],[0.114,0.040,0.040,0.039,0.039,0.041],[0.324,0.245,0.248,0.231,0.217,0.218],[0.207,0.095,0.106,0.101,0.109,0.104],[0.184,0.106,0.103,0.110,0.110,0.100],[0.156,0.081,0.085,0.079,0.075,0.074],[0.203,0.133,0.125,0.130,0.123,0.120],[0.647,0.080,0.071,0.068,0.070,0.069],[0.644,0.058,0.057,0.064,0.057,0.055],[0.674,0.078,0.075,0.084,0.070,0.088],[0.259,0.157,0.144,0.151,0.146,0.156],[0.156,0.044,0.044,0.045,0.042,0.045],[0.289,0.180,0.172,0.176,0.172,0.198],[0.603,0.046,0.052,0.045,0.045,0.048],[0.634,0.039,0.041,0.039,0.036,0.038],[0.630,0.067,0.066,0.066,0.060,0.057],[0.671,0.467,0.463,0.430,0.427,0.450],[0.673,0.478,0.444,0.458,0.440,0.451],[0.564,0.430,0.423,0.421,0.447,0.450],[0.628,0.454,0.497,0.450,0.464,0.461],[0.614,0.462,0.469,0.452,0.444,0.442],[0.710,0.532,0.547,0.579,0.577,0.588],[0.527,0.261,0.245,0.239,0.253,0.254],[0.419,0.241,0.239,0.260,0.231,0.217],[0.709,0.353,0.331,0.317,0.325,0.331],[0.309,0.081,0.087,0.079,0.083,0.084],[0.235,0.045,0.046,0.047,0.045,0.048],[1.008,0.743,0.726,0.753,0.745,0.719],[0.898,0.741,0.746,0.734,0.709,0.723],[0.442,0.172,0.147,0.153,0.146,0.148],[0.420,0.123,0.126,0.116,0.119,0.121],[0.465,0.182,0.174,0.173,0.173,0.167],[0.440,0.184,0.180,0.182,0.184,0.190],[0.291,0.085,0.085,0.082,0.084,0.091],[0.230,0.079,0.070,0.070,0.074,0.079],[0.216,0.098,0.094,0.092,0.092,0.084],[0.006,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[0.319,0.126,0.112,0.103,0.114,0.118],[0.463,0.381,0.323,0.311,0.313,0.338],[0.710,0.118,0.110,0.103,0.107,0.101],[1.211,0.568,0.557,0.553,0.530,0.541],[0.698,0.150,0.135,0.149,0.111,0.140],[0.936,0.338,0.352,0.322,0.344,0.361],[0.368,0.260,0.254,0.235,0.235,0.232],[0.385,0.244,0.258,0.230,0.234,0.233],[0.400,0.277,0.277,0.259,0.259,0.273],[0.774,0.174,0.174,0.159,0.161,0.153],[0.312,0.156,0.161,0.161,0.158,0.166],[0.779,0.171,0.164,0.171,0.155,0.180],[0.439,0.103,0.102,0.093,0.094,0.099],[0.227,0.077,0.079,0.078,0.078,0.077],[0.459,0.097,0.109,0.101,0.100,0.103],[0.244,0.099,0.110,0.108,0.105,0.102],[2.470,1.875,1.926,1.962,1.945,1.927],[2.171,1.958,1.946,1.917,1.944,1.958],[2.202,1.948,1.972,1.957,2.008,2.020],[2.111,1.921,1.944,1.962,1.953,1.938],[1.774,1.428,1.418,1.394,1.391,1.382],[2.153,2.006,1.942,2.001,1.978,1.944],[2.198,2.038,2.161,2.148,2.144,2.165],[2.378,2.158,2.167,2.015,2.149,2.135],[1.744,1.551,1.559,1.524,1.578,1.525],[2.272,2.246,2.186,2.233,2.213,2.183],[1.269,0.627,0.544,0.599,0.612,0.575],[0.006,0.006,0.006,0.006,0.006,0.006],[0.799,0.110,0.125,0.114,0.110,0.110],[0.945,0.176,0.174,0.184,0.175,0.173],[0.895,0.145,0.133,0.130,0.136,0.133],[0.494,0.207,0.202,0.226,0.189,0.198],[0.855,0.419,0.411,0.442,0.449,0.442],[1.111,0.688,0.687,0.698,0.680,0.704],[0.983,0.662,0.680,0.657,0.605,0.621],[1.070,0.733,0.680,0.718,0.710,0.715],[0.006,0.006,0.006,0.006,0.007,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.891,0.161,0.158,0.151,0.162,0.154],[0.353,0.174,0.160,0.163,0.168,0.156],[0.833,0.181,0.176,0.169,0.171,0.176],[0.392,0.234,0.236,0.228,0.224,0.220],[0.472,0.130,0.122,0.124,0.115,0.115],[0.467,0.120,0.120,0.109,0.105,0.117],[0.291,0.129,0.127,0.122,0.117,0.125],[1.077,0.269,0.245,0.238,0.239,0.240],[0.546,0.217,0.204,0.204,0.193,0.210],[0.851,0.141,0.142,0.130,0.129,0.146],[0.270,0.099,0.103,0.114,0.114,0.110],[0.837,0.166,0.163,0.142,0.140,0.149],[1.091,0.731,0.690,0.715,0.711,0.733],[1.037,0.725,0.696,0.701,0.679,0.717],[1.031,0.738,0.726,0.729,0.719,0.732],[0.007,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.007,0.006,0.007,0.006],[0.007,0.006,0.006,0.007,0.006,0.007],[0.951,0.185,0.180,0.178,0.179,0.179],[0.806,0.151,0.155,0.154,0.174,0.142],[0.351,0.187,0.181,0.181,0.177,0.175],[1.119,0.221,0.196,0.198,0.200,0.199],[1.059,0.218,0.204,0.196,0.203,0.205],[0.698,0.330,0.351,0.319,0.294,0.332],[0.919,0.190,0.175,0.177,0.183,0.167],[0.335,0.151,0.152,0.142,0.145,0.155],[0.948,0.195,0.193,0.187,0.174,0.182],[0.969,0.213,0.205,0.204,0.194,0.207],[0.323,0.123,0.113,0.121,0.117,0.118],[0.971,0.214,0.232,0.204,0.212,0.198],[0.202,0.087,0.086,0.087,0.095,0.085],[0.185,0.103,0.093,0.094,0.098,0.098],[0.341,0.186,0.178,0.196,0.178,0.178],[0.276,0.155,0.145,0.146,0.147,0.137],[0.342,0.223,0.218,0.212,0.217,0.208]],"version":"25.9.7.56","source":"results/25.9.7.56.json"} +,{"actual_version":"25.3.14.14","data_size":{"coffeeshop":44632860718,"hits":14269491911,"job":1828094510,"mgbench":2954107753,"ontime":2699155844,"ssb":73313539780,"taxi":24223601247,"tpcds":18804300741,"tpch":17234801645,"uk":781025370},"kind":"versions-benchmark","load_time":{"coffeeshop":952,"hits":235,"job":21,"mgbench":73,"ontime":66,"ssb":1557,"taxi":582,"tpcds":280,"tpch":297,"uk":38},"machine":"c7a.4xlarge","release_date":"2026-02-02","result":[[0.075,0.009,0.009,0.275,0.008,0.009],[0.038,0.014,0.015,0.018,0.014,0.014],[0.040,0.018,0.013,0.035,0.012,0.012],[0.034,0.011,0.011,0.028,0.012,0.011],[0.043,0.027,0.028,0.044,0.025,0.022],[0.060,0.018,0.016,0.038,0.016,0.016],[0.023,0.007,0.007,0.007,0.007,0.006],[0.044,0.015,0.015,0.021,0.014,0.016],[0.068,0.032,0.034,0.077,0.031,0.034],[0.096,0.063,0.062,0.062,0.062,0.054],[0.277,0.216,0.215,0.192,0.197,0.186],[0.364,0.230,0.248,0.241,0.223,0.225],[0.025,0.007,0.007,0.008,0.007,0.007],[0.027,0.014,0.014,0.014,0.014,0.013],[0.709,0.610,0.604,0.614,0.623,0.624],[0.519,0.152,0.160,0.132,0.145,0.147],[0.045,0.014,0.014,0.015,0.015,0.014],[0.040,0.013,0.013,0.013,0.013,0.013],[6.459,1.287,1.269,1.327,1.387,1.365],[4.763,0.952,0.934,0.973,0.962,0.974],[4.779,0.981,1.003,0.995,1.033,1.059],[5.350,1.628,1.668,1.626,1.757,1.642],[6.259,1.406,1.409,1.456,1.389,1.464],[3.980,0.862,0.860,0.870,0.874,0.807],[0.060,0.022,0.023,0.023,0.022,0.023],[7.877,1.871,1.894,1.956,1.875,1.903],[1.843,0.736,0.702,0.712,0.706,0.744],[1.927,0.550,0.497,0.507,0.495,0.493],[0.002,0.002,0.002,0.002,0.002,0.002],[0.029,0.008,0.008,0.007,0.008,0.007],[0.056,0.015,0.018,0.035,0.016,0.016],[0.131,0.022,0.022,0.023,0.022,0.022],[0.162,0.059,0.058,0.057,0.059,0.061],[0.297,0.125,0.124,0.124,0.132,0.133],[0.005,0.003,0.003,0.022,0.003,0.003],[0.026,0.010,0.009,0.009,0.009,0.009],[0.398,0.246,0.247,0.245,0.242,0.255],[0.455,0.310,0.296,0.276,0.274,0.278],[0.185,0.067,0.067,0.067,0.068,0.068],[0.196,0.097,0.094,0.086,0.087,0.091],[0.535,0.299,0.290,0.292,0.306,0.308],[0.747,0.428,0.403,0.386,0.388,0.438],[0.677,0.462,0.485,0.463,0.478,0.496],[0.435,0.266,0.284,0.278,0.278,0.260],[1.398,1.026,1.038,1.315,1.093,1.098],[1.038,0.710,0.710,0.955,0.664,0.643],[3.138,2.243,2.264,2.289,2.130,2.187],[0.132,0.025,0.023,0.021,0.021,0.023],[1.476,0.338,0.343,0.347,0.345,0.357],[1.750,0.382,0.372,0.392,0.376,0.390],[3.940,0.840,0.823,0.829,0.839,0.833],[2.123,0.457,0.427,0.434,0.426,0.450],[0.412,0.117,0.112,0.108,0.111,0.106],[0.252,0.086,0.089,0.096,0.090,0.083],[0.411,0.111,0.110,0.110,0.113,0.105],[1.442,0.320,0.317,0.351,0.339,0.364],[1.450,0.511,0.496,0.493,0.502,0.521],[0.056,0.024,0.021,0.043,0.024,0.022],[0.547,0.260,0.255,0.262,0.254,0.257],[0.974,0.357,0.385,0.370,0.383,0.399],[2.333,1.612,1.592,1.647,1.640,1.644],[2.749,1.537,1.477,1.433,1.479,1.541],[2.811,1.529,1.499,1.562,1.551,1.519],[0.326,0.251,0.263,0.254,0.255,0.207],[0.096,0.058,0.061,0.054,0.068,0.057],[0.051,0.034,0.033,0.035,0.034,0.034],[0.075,0.022,0.023,0.022,0.024,0.025],[0.193,0.116,0.109,0.122,0.112,0.118],[0.027,0.009,0.009,0.009,0.009,0.009],[0.025,0.008,0.008,0.009,0.009,0.010],[0.014,0.005,0.005,0.005,0.005,0.005],[0.376,0.056,0.058,0.079,0.055,0.055],[0.326,0.073,0.073,0.075,0.075,0.073],[0.101,0.045,0.047,0.059,0.038,0.039],[0.241,0.080,0.083,0.103,0.081,0.085],[0.075,0.036,0.037,0.033,0.034,0.038],[0.170,0.076,0.075,0.068,0.067,0.072],[0.187,0.097,0.103,0.099,0.099,0.100],[0.059,0.034,0.034,0.033,0.044,0.034],[0.116,0.065,0.062,0.062,0.062,0.062],[0.252,0.160,0.161,0.159,0.162,0.160],[0.463,0.205,0.203,0.203,0.199,0.200],[0.412,0.299,0.296,0.280,0.296,0.296],[0.142,0.044,0.047,0.043,0.043,0.042],[0.641,0.326,0.324,0.348,0.325,0.323],[2.806,2.267,2.263,2.239,2.086,2.309],[8.700,1.204,1.250,1.251,1.255,1.214],[2.228,1.303,1.300,1.291,1.266,1.314],[12.895,3.191,3.154,3.227,3.133,3.171],[4.293,3.759,3.729,3.814,3.496,3.748],[4.064,1.985,2.003,1.956,1.991,1.987],[4.756,4.266,4.432,4.480,4.462,4.470],[7.617,7.542,7.573,7.550,7.479,7.504],[3.916,3.621,3.421,3.645,3.623,3.642],[5.625,5.205,5.178,5.102,5.126,5.191],[5.277,4.945,5.037,5.013,4.987,5.005],[8.549,8.305,8.269,8.367,8.395,8.365],[3.519,3.239,3.217,3.200,3.242,3.229],[49.127,47.745,48.634,47.093,47.952,48.672],[7.393,5.954,5.967,5.909,5.867,5.891],[2.939,2.856,2.812,2.874,2.850,2.821],[2.578,2.034,1.979,1.981,2.010,1.978],[4.260,4.122,4.094,4.150,4.132,4.135],[14.854,14.561,14.522,14.546,14.211,14.031],[39.398,37.233,38.796,37.007,38.241,38.858],[26.363,23.489,24.023,24.028,23.999,24.031],[2.707,0.744,0.751,0.524,0.495,0.494],[null,null,null,null,null,null],[2.920,1.936,1.704,1.875,1.906,1.927],[null,null,null,null,null,null],[4.498,3.095,3.378,3.368,3.238,3.462],[0.204,0.088,0.092,0.088,0.086,0.088],[3.461,2.603,2.481,2.476,2.481,2.520],[5.136,3.833,3.969,3.940,4.001,3.924],[7.736,6.405,6.286,6.396,6.445,6.465],[2.292,1.286,1.251,1.242,1.272,1.314],[0.596,0.432,0.415,0.415,0.418,0.424],[1.589,0.666,0.663,0.715,0.661,0.678],[4.268,2.316,2.293,2.280,2.263,2.352],[0.193,0.133,0.132,0.122,0.120,0.132],[0.219,0.110,0.117,0.133,0.116,0.117],[0.398,0.254,0.245,0.242,0.244,0.239],[null,null,null,null,null,null],[2.508,1.540,1.533,1.545,1.535,1.525],[4.210,1.132,1.154,1.131,1.135,1.152],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.055,0.782,0.676,0.704,0.686,0.669],[2.117,1.790,1.747,1.752,1.794,1.826],[25.171,23.783,24.233,24.466,24.135,24.368],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.521,0.470,0.449,0.452,0.435,0.440],[1.010,0.566,0.585,0.589,0.566,0.571],[1.501,1.210,1.169,1.140,1.182,1.164],[null,null,null,null,null,null],[9.019,8.012,7.836,8.115,8.535,8.524],[0.243,0.157,0.162,0.153,0.156,0.156],[3.605,1.974,2.121,2.068,2.065,2.051],[null,null,null,null,null,null],[null,null,null,null,null,null],[1.043,0.616,0.630,0.617,0.635,0.623],[null,null,null,null,null,null],[3.324,2.044,1.999,1.993,2.020,1.844],[1.378,0.661,0.681,0.687,0.688,0.683],[1.865,1.120,1.147,1.158,1.223,1.194],[0.390,0.260,0.259,0.255,0.251,0.248],[0.241,0.128,0.127,0.142,0.123,0.124],[0.320,0.187,0.184,0.179,0.176,0.182],[7.059,5.849,5.895,5.994,6.012,6.125],[7.349,6.504,6.496,6.143,6.335,6.561],[2.434,1.606,1.656,1.640,1.613,1.633],[2.354,1.660,1.612,1.687,1.721,1.617],[3.292,1.858,1.823,1.848,1.938,1.848],[0.798,0.234,0.227,0.229,0.238,0.250],[1.386,0.420,0.428,0.446,0.422,0.407],[1.655,1.084,1.059,1.086,1.089,1.035],[2.872,1.849,1.873,1.806,1.913,1.811],[null,null,null,null,null,null],[1.583,0.963,0.958,0.979,1.024,1.025],[null,null,null,null,null,null],[1.214,0.340,0.360,0.359,0.380,0.365],[1.208,0.392,0.399,0.409,0.410,0.397],[null,null,null,null,null,null],[1.083,0.453,0.455,0.455,0.458,0.465],[0.344,0.197,0.193,0.197,0.197,0.207],[5.625,5.175,5.440,5.263,5.282,5.184],[0.525,0.407,0.394,0.386,0.403,0.414],[0.465,0.396,0.395,0.392,0.404,0.383],[1.011,0.581,0.586,0.581,0.598,0.591],[null,null,null,null,null,null],[0.959,0.652,0.609,0.615,0.629,0.599],[2.866,2.484,2.413,2.495,2.394,2.596],[0.532,0.241,0.203,0.207,0.210,0.216],[0.595,0.402,0.400,0.407,0.399,0.382],[1.912,0.683,0.675,0.667,0.676,0.662],[3.312,2.873,2.894,2.968,2.918,2.782],[2.487,1.417,1.471,1.462,1.521,1.540],[null,null,null,null,null,null],[1.943,1.193,1.217,1.212,1.249,1.159],[2.922,2.423,2.296,2.387,2.290,2.425],[0.934,0.658,0.534,0.534,0.563,0.573],[0.741,0.366,0.360,0.348,0.352,0.341],[1.942,1.350,1.318,1.345,1.326,1.370],[0.833,0.558,0.544,0.582,0.543,0.537],[1.190,0.351,0.350,0.364,0.359,0.358],[1.345,1.114,1.112,1.152,1.077,1.072],[1.015,0.423,0.421,0.417,0.415,0.436],[1.620,1.193,1.190,1.198,1.206,1.259],[1.256,0.365,0.364,0.354,0.362,0.368],[1.921,1.002,0.976,0.981,0.973,0.981],[0.423,0.277,0.268,0.248,0.246,0.249],[0.821,0.367,0.367,0.394,0.339,0.346],[5.816,3.898,3.729,3.821,3.803,3.788],[1.139,0.524,0.541,0.556,0.564,0.551],[1.719,0.926,0.891,0.909,0.866,0.907],[15.251,15.726,14.814,14.099,14.588,14.092],[2.335,0.545,0.538,0.538,0.536,0.532],[null,null,null,null,null,null],[0.987,0.599,0.595,0.599,0.608,0.608],[1.149,0.299,0.297,0.297,0.293,0.294],[null,null,null,null,null,null],[1.033,0.305,0.310,0.332,0.308,0.308],[6.000,5.385,5.702,5.911,5.574,5.394],[null,null,null,null,null,null],[0.009,0.009,0.009,0.027,0.008,0.009],[1.576,0.360,0.383,0.371,0.387,0.369],[0.039,0.053,0.035,0.033,0.028,0.028],[1.781,0.541,0.542,0.538,0.525,0.554],[3.915,2.151,2.151,2.111,2.113,2.186],[null,null,null,null,null,null],[0.408,0.291,0.294,0.294,0.292,0.300],[0.180,0.110,0.102,0.097,0.095,0.104],[0.219,0.127,0.128,0.130,0.130,0.123],[0.742,0.445,0.428,0.474,0.444,0.438],[0.178,0.106,0.102,0.104,0.102,0.104],[5.288,5.000,5.049,4.920,4.996,4.991],[3.144,2.166,2.154,2.159,2.189,2.184],[0.918,0.446,0.414,0.383,0.384,0.385],[0.245,0.094,0.093,0.095,0.091,0.090],[0.153,0.070,0.064,0.066,0.064,0.064],[null,null,null,null,null,null],[1.908,1.037,1.040,1.049,1.055,1.007],[null,null,null,null,null,null],[5.652,5.579,5.630,5.624,5.571,5.598],[0.584,0.171,0.168,0.180,0.177,0.176],[4.015,3.557,3.472,3.504,3.492,3.517],[0.685,0.439,0.470,0.459,0.420,0.388],[0.770,0.450,0.445,0.447,0.424,0.420],[0.198,0.066,0.068,0.080,0.070,0.063],[0.299,0.227,0.245,0.232,0.256,0.245],[0.113,0.050,0.043,0.041,0.041,0.043],[0.335,0.273,0.259,0.231,0.243,0.224],[0.206,0.104,0.099,0.112,0.101,0.099],[0.205,0.122,0.110,0.118,0.121,0.123],[0.166,0.086,0.079,0.081,0.080,0.079],[0.217,0.146,0.135,0.137,0.129,0.136],[0.564,0.161,0.160,0.166,0.162,0.165],[0.546,0.144,0.140,0.149,0.146,0.140],[0.592,0.176,0.215,0.157,0.161,0.162],[0.242,0.150,0.160,0.163,0.154,0.153],[0.153,0.047,0.051,0.046,0.048,0.052],[0.274,0.180,0.167,0.173,0.177,0.189],[0.515,0.134,0.134,0.130,0.136,0.135],[0.553,0.126,0.177,0.126,0.181,0.133],[0.528,0.145,0.151,0.146,0.150,0.156],[0.762,0.569,0.556,0.558,0.570,0.558],[0.808,0.633,0.594,0.589,0.599,0.605],[0.722,0.562,0.551,0.566,0.567,0.556],[0.803,0.628,0.632,0.631,0.636,0.640],[0.724,0.576,0.586,0.574,0.573,0.566],[0.874,0.677,0.681,0.655,0.687,0.689],[0.489,0.242,0.259,0.264,0.264,0.251],[0.404,0.247,0.237,0.263,0.246,0.248],[0.739,0.468,0.394,0.415,0.397,0.412],[0.280,0.084,0.091,0.094,0.093,0.088],[0.240,0.067,0.067,0.067,0.070,0.066],[1.220,0.915,0.907,0.923,0.930,0.919],[1.043,0.919,0.908,0.894,0.918,0.924],[0.407,0.193,0.192,0.200,0.200,0.186],[0.435,0.158,0.164,0.186,0.160,0.158],[0.485,0.220,0.211,0.209,0.214,0.210],[0.457,0.242,0.217,0.261,0.252,0.227],[0.271,0.104,0.096,0.099,0.098,0.102],[0.229,0.112,0.113,0.101,0.103,0.106],[0.249,0.117,0.118,0.128,0.123,0.123],[0.007,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.007],[0.313,0.124,0.133,0.132,0.124,0.120],[0.481,0.386,0.426,0.431,0.436,0.441],[0.636,0.213,0.220,0.228,0.230,0.225],[1.384,0.830,0.939,0.898,0.808,0.827],[0.619,0.286,0.263,0.256,0.233,0.277],[0.911,0.390,0.394,0.384,0.356,0.366],[0.426,0.302,0.291,0.297,0.301,0.290],[0.368,0.266,0.272,0.257,0.271,0.271],[0.430,0.319,0.304,0.317,0.311,0.306],[0.732,0.282,0.291,0.278,0.261,0.283],[0.665,0.253,0.242,0.256,0.251,0.249],[0.735,0.293,0.301,0.277,0.278,0.283],[0.400,0.146,0.138,0.130,0.136,0.131],[0.382,0.128,0.120,0.128,0.111,0.125],[0.409,0.136,0.132,0.129,0.158,0.131],[0.251,0.134,0.129,0.120,0.120,0.118],[3.584,3.016,3.025,2.890,3.029,3.021],[3.269,2.952,3.061,3.095,3.103,2.964],[3.282,3.044,3.058,3.036,2.949,2.997],[2.997,2.881,2.915,2.870,2.907,2.888],[2.596,2.108,2.128,2.093,2.107,2.120],[4.286,4.116,4.009,4.052,4.050,4.057],[4.304,4.066,4.015,4.085,4.087,4.111],[4.250,4.075,4.166,4.155,4.179,4.197],[2.305,2.148,2.131,2.164,2.154,2.172],[4.324,4.162,4.320,4.205,4.065,4.126],[1.159,0.717,0.611,0.672,0.731,0.617],[0.008,0.007,0.006,0.006,0.007,0.006],[0.672,0.238,0.225,0.219,0.289,0.220],[0.833,0.263,0.323,0.328,0.265,0.259],[0.777,0.260,0.244,0.240,0.240,0.237],[0.860,0.303,0.293,0.282,0.293,0.302],[0.918,0.555,0.555,0.569,0.541,0.522],[1.056,0.739,0.723,0.729,0.755,0.737],[0.925,0.728,0.727,0.717,0.725,0.712],[1.051,0.765,0.774,0.773,0.763,0.775],[0.006,0.007,0.006,0.006,0.006,0.006],[0.006,0.007,0.007,0.006,0.006,0.006],[0.007,0.007,0.006,0.006,0.006,0.006],[0.774,0.287,0.269,0.269,0.280,0.270],[0.794,0.350,0.270,0.271,0.275,0.271],[0.767,0.311,0.294,0.300,0.308,0.284],[0.783,0.366,0.367,0.345,0.354,0.366],[0.403,0.141,0.141,0.138,0.141,0.142],[0.396,0.141,0.139,0.136,0.138,0.140],[0.401,0.164,0.139,0.145,0.140,0.143],[0.943,0.357,0.354,0.351,0.352,0.356],[0.889,0.308,0.298,0.303,0.326,0.301],[0.731,0.216,0.215,0.216,0.218,0.217],[0.707,0.205,0.191,0.192,0.192,0.201],[0.734,0.247,0.246,0.241,0.241,0.252],[1.075,0.765,0.783,0.765,0.764,0.765],[1.015,0.743,0.749,0.741,0.742,0.735],[1.025,0.805,0.780,0.767,0.768,0.780],[0.007,0.007,0.006,0.006,0.007,0.006],[0.007,0.007,0.007,0.006,0.006,0.006],[0.007,0.007,0.007,0.006,0.007,0.006],[0.831,0.302,0.291,0.283,0.270,0.279],[0.704,0.251,0.234,0.235,0.224,0.232],[0.801,0.345,0.368,0.361,0.313,0.342],[0.950,0.306,0.299,0.300,0.310,0.300],[0.965,0.297,0.284,0.284,0.275,0.285],[1.044,0.472,0.418,0.468,0.495,0.442],[0.765,0.270,0.261,0.267,0.271,0.265],[0.727,0.247,0.295,0.240,0.234,0.233],[0.836,0.295,0.295,0.290,0.297,0.303],[0.845,0.294,0.288,0.306,0.298,0.290],[0.748,0.225,0.236,0.224,0.228,0.220],[0.872,0.339,0.309,0.309,0.302,0.308],[0.182,0.089,0.093,0.091,0.088,0.089],[0.173,0.119,0.099,0.100,0.102,0.099],[0.333,0.178,0.178,0.179,0.174,0.183],[0.264,0.152,0.155,0.158,0.158,0.154],[0.333,0.236,0.209,0.200,0.204,0.204]],"version":"25.3.14.14","source":"results/25.3.14.14.json"} +,{"actual_version":"25.11.9.34","data_size":{"coffeeshop":49923669462,"hits":14996692341,"job":1905031892,"mgbench":3186282929,"ontime":3440107771,"ssb":86985447108,"taxi":24334690080,"tpcds":18796831053,"tpch":17930077405,"uk":1002191183},"kind":"versions-benchmark","load_time":{"coffeeshop":712,"hits":192,"job":21,"mgbench":57,"ontime":59,"ssb":1587,"taxi":460,"tpcds":303,"tpch":276,"uk":28},"machine":"c7a.4xlarge","release_date":"2026-02-17","result":[[0.108,0.007,0.006,0.352,0.006,0.006],[0.026,0.004,0.003,0.003,0.003,0.003],[0.054,0.016,0.008,0.032,0.008,0.008],[0.038,0.008,0.009,0.008,0.008,0.008],[0.052,0.017,0.023,0.044,0.019,0.021],[0.066,0.015,0.016,0.033,0.014,0.016],[0.029,0.004,0.004,0.003,0.003,0.004],[0.053,0.004,0.005,0.004,0.004,0.004],[0.072,0.004,0.004,0.066,0.004,0.004],[0.092,0.053,0.049,0.048,0.048,0.047],[0.254,0.169,0.168,0.166,0.164,0.171],[0.349,0.205,0.229,0.223,0.200,0.215],[0.040,0.003,0.003,0.003,0.003,0.003],[0.032,0.009,0.008,0.008,0.008,0.008],[0.451,0.300,0.294,0.323,0.273,0.282],[0.545,0.077,0.076,0.077,0.073,0.074],[0.044,0.012,0.014,0.012,0.012,0.013],[0.054,0.011,0.011,0.012,0.011,0.011],[8.138,1.050,1.045,1.059,1.056,1.058],[6.421,0.860,0.861,0.868,0.870,0.857],[6.439,0.771,0.768,0.766,0.797,0.776],[8.731,1.614,1.632,1.637,1.622,1.659],[8.018,1.317,1.313,1.327,1.314,1.335],[3.851,0.487,0.463,0.453,0.451,0.464],[0.059,0.014,0.014,0.017,0.016,0.017],[10.086,1.810,1.812,1.822,1.804,1.800],[2.557,0.547,0.577,0.541,0.547,0.543],[2.368,0.401,0.407,0.411,0.409,0.407],[0.001,0.002,0.001,0.001,0.001,0.001],[0.031,0.007,0.006,0.006,0.006,0.006],[0.050,0.014,0.014,0.034,0.015,0.015],[0.125,0.020,0.020,0.020,0.019,0.020],[0.147,0.050,0.055,0.055,0.053,0.054],[0.267,0.113,0.105,0.112,0.109,0.103],[0.005,0.003,0.003,0.021,0.002,0.002],[0.024,0.008,0.008,0.007,0.007,0.008],[0.349,0.222,0.229,0.221,0.222,0.227],[0.402,0.261,0.261,0.264,0.250,0.258],[0.174,0.065,0.063,0.062,0.063,0.061],[0.174,0.071,0.071,0.072,0.073,0.072],[0.466,0.264,0.256,0.249,0.252,0.263],[0.665,0.371,0.370,0.376,0.373,0.383],[0.533,0.333,0.320,0.318,0.301,0.306],[0.322,0.177,0.177,0.179,0.180,0.174],[1.175,0.805,0.788,0.789,0.773,0.886],[0.761,0.452,0.464,0.463,0.461,0.488],[2.471,1.615,1.482,1.488,1.492,1.620],[0.122,0.002,0.002,0.002,0.002,0.002],[1.596,0.022,0.022,0.021,0.021,0.021],[1.969,0.008,0.008,0.020,0.008,0.007],[4.372,0.746,0.735,0.735,0.723,0.729],[1.236,0.099,0.096,0.105,0.099,0.097],[0.360,0.093,0.109,0.097,0.089,0.091],[0.237,0.075,0.070,0.071,0.076,0.075],[0.376,0.094,0.090,0.097,0.096,0.094],[0.168,0.053,0.061,0.074,0.055,0.054],[1.349,0.458,0.468,0.452,0.460,0.461],[0.055,0.022,0.021,0.717,0.021,0.022],[0.338,0.194,0.178,0.178,0.162,0.172],[0.697,0.303,0.233,0.299,0.259,0.270],[2.161,1.515,1.601,1.580,1.587,1.530],[2.789,1.417,1.534,1.517,1.332,1.488],[2.617,1.467,1.606,1.588,1.572,1.661],[0.277,0.166,0.164,0.149,0.128,0.181],[0.112,0.057,0.058,0.048,0.051,0.053],[0.050,0.034,0.031,0.026,0.032,0.029],[0.064,0.022,0.022,0.019,0.021,0.020],[0.185,0.104,0.100,0.093,0.091,0.101],[0.031,0.004,0.004,0.004,0.004,0.004],[0.024,0.004,0.003,0.003,0.003,0.003],[0.016,0.003,0.003,0.003,0.003,0.003],[0.452,0.040,0.039,0.061,0.041,0.049],[0.400,0.053,0.055,0.053,0.053,0.053],[0.129,0.034,0.033,0.053,0.033,0.033],[0.257,0.055,0.053,0.074,0.053,0.052],[0.074,0.018,0.017,0.017,0.017,0.017],[0.157,0.049,0.049,0.050,0.052,0.051],[0.174,0.071,0.075,0.065,0.066,0.065],[0.045,0.016,0.016,0.015,0.016,0.015],[0.090,0.027,0.025,0.035,0.028,0.024],[0.209,0.093,0.091,0.091,0.088,0.092],[0.454,0.138,0.135,0.134,0.134,0.137],[0.394,0.230,0.232,0.232,0.228,0.241],[0.149,0.027,0.027,0.027,0.028,0.028],[0.606,0.267,0.271,0.285,0.266,0.264],[1.752,1.265,1.268,1.277,1.293,1.296],[8.553,1.003,0.976,0.992,0.981,0.993],[2.006,0.987,0.990,0.976,0.981,0.972],[12.825,2.322,2.363,2.334,2.317,2.319],[5.032,2.406,2.378,2.381,2.351,2.373],[5.665,1.590,1.584,1.608,1.587,1.578],[3.296,2.974,3.045,3.060,3.052,3.043],[6.906,6.495,6.499,6.462,6.425,6.510],[4.046,2.390,2.424,2.396,2.381,2.394],[5.697,4.469,4.442,4.435,4.414,4.419],[5.033,3.584,3.572,3.593,3.569,3.613],[8.555,6.330,6.293,6.314,6.335,6.343],[3.486,2.316,2.314,2.301,2.296,2.304],[47.220,46.387,45.685,45.072,45.233,45.142],[8.549,4.518,4.499,4.499,4.498,4.467],[3.482,2.157,2.164,2.163,2.168,2.148],[3.486,1.472,1.478,1.476,1.519,1.478],[3.501,3.068,3.054,3.089,3.057,3.078],[10.850,10.199,10.237,10.044,10.035,10.029],[34.847,35.682,34.150,34.054,33.916,33.908],[28.079,25.315,25.740,25.759,25.738,25.767],[2.697,0.606,0.606,0.420,0.378,0.380],[0.828,0.463,0.436,0.453,0.437,0.433],[2.433,1.758,1.576,1.540,1.895,1.897],[1.164,0.604,0.576,0.593,0.614,0.581],[4.210,3.116,3.417,3.297,3.185,3.356],[0.231,0.074,0.070,0.073,0.076,0.070],[2.495,1.623,1.631,1.674,1.658,1.704],[4.624,3.866,3.843,3.725,3.801,3.740],[6.537,5.970,5.656,5.717,6.010,5.787],[2.121,1.314,1.058,1.196,1.040,1.029],[0.436,0.260,0.271,0.256,0.263,0.262],[1.215,0.308,0.304,0.362,0.351,0.323],[2.681,1.414,1.067,1.078,1.062,1.085],[0.180,0.087,0.092,0.087,0.086,0.097],[0.203,0.101,0.099,0.117,0.101,0.097],[0.362,0.183,0.185,0.188,0.182,0.186],[3.423,1.564,1.555,1.521,1.465,1.403],[2.213,1.224,1.198,1.179,1.196,1.200],[4.145,0.914,0.935,0.914,0.914,0.905],[0.550,0.134,0.132,0.141,0.135,0.134],[null,10.308,10.094,10.148,10.155,10.100],[0.551,0.230,0.220,0.236,0.214,0.218],[0.239,0.100,0.108,0.108,0.097,0.113],[0.893,0.633,0.555,0.546,0.555,0.546],[1.654,1.307,1.259,1.279,1.288,1.313],[18.319,28.157,29.733,27.289,26.950,29.418],[null,null,null,null,null,null],[2.276,1.935,1.915,1.922,1.919,1.937],[1.370,0.310,0.299,0.327,0.307,0.306],[0.800,0.360,0.350,0.352,0.350,0.353],[1.411,1.010,1.028,1.013,1.008,1.015],[0.792,0.240,0.234,0.247,0.233,0.244],[6.394,5.649,5.737,5.817,5.775,5.794],[0.195,0.073,0.071,0.079,0.073,0.074],[3.155,1.683,1.657,1.691,1.645,1.558],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.777,0.488,0.479,0.489,0.483,0.528],[1.039,0.372,0.358,0.373,0.363,0.368],[2.949,1.501,1.716,1.722,1.516,1.467],[1.210,0.488,0.478,0.491,0.485,0.487],[1.665,0.158,0.158,0.164,0.158,0.160],[0.274,0.108,0.109,0.104,0.108,0.106],[0.189,0.070,0.069,0.086,0.068,0.068],[0.251,0.139,0.133,0.138,0.140,0.142],[5.278,4.672,4.447,4.304,4.390,4.317],[5.973,4.658,4.714,5.040,4.844,5.001],[2.055,1.221,1.246,1.203,1.230,1.252],[2.000,1.223,1.215,1.260,1.204,1.239],[2.769,1.461,1.618,1.469,1.442,1.739],[0.735,0.173,0.164,0.161,0.164,0.162],[1.337,0.302,0.307,0.303,0.306,0.307],[1.503,0.959,0.956,0.986,0.961,0.968],[2.561,1.419,1.597,1.521,1.421,1.666],[0.251,0.087,0.087,0.082,0.079,0.077],[1.241,0.648,0.651,0.649,0.653,0.651],[0.268,0.079,0.078,0.092,0.079,0.080],[1.057,0.230,0.225,0.221,0.221,0.229],[1.120,0.256,0.254,0.253,0.253,0.259],[1.007,0.385,0.378,0.394,0.373,0.376],[0.933,0.278,0.272,0.281,0.280,0.276],[0.338,0.121,0.126,0.129,0.123,0.120],[4.873,4.656,4.641,4.695,4.662,4.692],[0.329,0.226,0.206,0.200,0.217,0.216],[0.319,0.214,0.213,0.210,0.211,0.206],[0.749,0.390,0.382,0.396,0.383,0.422],[0.034,0.016,0.016,0.016,0.015,0.015],[0.873,0.091,0.089,0.087,0.088,0.088],[2.139,0.202,0.198,0.198,0.206,0.207],[0.036,0.024,0.026,0.021,0.025,0.017],[0.464,0.275,0.276,0.276,0.275,0.279],[1.679,0.429,0.434,0.429,0.437,0.433],[2.444,2.007,2.024,2.024,2.009,2.011],[2.237,1.157,1.191,1.198,1.196,1.188],[null,null,null,null,null,null],[1.641,0.856,0.852,0.886,0.862,0.887],[2.088,1.651,1.602,1.662,1.599,1.634],[0.405,0.091,0.091,0.088,0.088,0.089],[0.814,0.313,0.297,0.291,0.281,0.457],[1.826,1.100,1.086,1.072,1.086,1.093],[0.793,0.090,0.094,0.091,0.089,0.089],[1.035,0.237,0.246,0.248,0.237,0.258],[0.973,0.772,0.771,0.767,0.756,0.759],[0.821,0.292,0.291,0.316,0.287,0.282],[1.459,1.084,1.061,1.063,1.057,1.067],[1.034,0.248,0.244,0.246,0.248,0.248],[1.454,0.551,0.552,0.554,0.553,0.557],[0.343,0.181,0.172,0.173,0.178,0.174],[0.818,0.304,0.280,0.285,0.285,0.284],[5.119,2.924,2.965,2.923,2.966,2.988],[0.943,0.345,0.341,0.361,0.346,0.345],[1.435,0.632,0.593,0.618,0.596,0.614],[14.623,14.185,14.160,14.020,14.332,14.217],[2.341,0.424,0.414,0.410,0.402,0.410],[0.740,0.223,0.234,0.228,0.220,0.220],[0.834,0.410,0.476,0.406,0.412,0.408],[1.005,0.201,0.202,0.203,0.197,0.197],[null,null,null,null,null,null],[1.035,0.229,0.228,0.229,0.227,0.228],[4.820,4.242,4.321,4.382,4.426,4.508],[null,null,null,null,null,null],[0.009,0.009,0.008,0.008,0.008,0.008],[1.592,0.276,0.262,0.260,0.252,0.283],[0.034,0.044,0.027,0.036,0.028,0.027],[1.656,0.373,0.372,0.371,0.366,0.365],[3.204,1.442,1.453,1.447,1.392,1.435],[0.215,0.108,0.112,0.110,0.108,0.111],[0.419,0.196,0.185,0.183,0.210,0.224],[0.164,0.096,0.115,0.151,0.100,0.116],[0.230,0.131,0.127,0.123,0.119,0.118],[0.668,0.337,0.336,0.356,0.337,0.335],[0.150,0.076,0.081,0.076,0.073,0.076],[4.817,4.635,4.673,4.712,4.625,4.656],[2.181,1.325,1.298,1.301,1.283,1.290],[0.829,0.353,0.327,0.340,0.345,0.331],[0.231,0.065,0.061,0.067,0.063,0.063],[0.152,0.050,0.050,0.050,0.047,0.048],[0.157,0.055,0.057,0.056,0.059,0.065],[1.390,0.682,0.674,0.679,0.682,0.679],[0.494,0.187,0.188,0.184,0.188,0.187],[5.332,5.289,5.373,5.295,5.355,5.324],[0.576,0.108,0.106,0.105,0.107,0.108],[1.331,0.757,0.752,0.786,0.743,0.754],[0.505,0.192,0.192,0.190,0.194,0.190],[0.620,0.316,0.315,0.315,0.331,0.315],[0.193,0.060,0.060,0.075,0.053,0.056],[0.262,0.186,0.191,0.202,0.206,0.197],[0.115,0.038,0.035,0.037,0.035,0.035],[0.280,0.213,0.210,0.197,0.199,0.191],[0.209,0.111,0.111,0.104,0.106,0.102],[0.169,0.101,0.095,0.095,0.106,0.100],[0.144,0.060,0.060,0.054,0.054,0.054],[0.206,0.136,0.133,0.140,0.130,0.143],[0.583,0.063,0.067,0.068,0.062,0.063],[0.579,0.059,0.053,0.052,0.052,0.052],[0.612,0.071,0.075,0.069,0.068,0.081],[0.238,0.139,0.142,0.147,0.140,0.137],[0.148,0.042,0.047,0.040,0.042,0.044],[0.268,0.174,0.172,0.169,0.168,0.169],[0.554,0.044,0.040,0.048,0.045,0.045],[0.581,0.037,0.038,0.038,0.037,0.039],[0.578,0.060,0.058,0.057,0.056,0.056],[0.641,0.441,0.440,0.433,0.430,0.436],[0.630,0.461,0.451,0.450,0.454,0.447],[0.556,0.420,0.427,0.431,0.430,0.421],[0.598,0.459,0.450,0.449,0.454,0.464],[0.582,0.450,0.439,0.448,0.447,0.439],[0.723,0.504,0.500,0.500,0.510,0.508],[0.483,0.201,0.211,0.221,0.204,0.200],[0.388,0.205,0.198,0.197,0.199,0.195],[0.680,0.312,0.299,0.301,0.293,0.296],[0.305,0.071,0.077,0.075,0.069,0.072],[0.242,0.045,0.045,0.045,0.046,0.046],[0.980,0.696,0.690,0.691,0.689,0.706],[0.871,0.721,0.693,0.679,0.684,0.691],[0.415,0.136,0.141,0.134,0.134,0.136],[0.414,0.112,0.108,0.107,0.108,0.108],[0.434,0.160,0.151,0.160,0.158,0.147],[0.407,0.201,0.182,0.168,0.182,0.181],[0.286,0.085,0.077,0.082,0.087,0.083],[0.228,0.075,0.069,0.070,0.070,0.076],[0.223,0.094,0.083,0.078,0.081,0.081],[0.005,0.005,0.005,0.005,0.005,0.005],[0.005,0.005,0.005,0.005,0.005,0.007],[0.292,0.073,0.076,0.069,0.073,0.068],[0.381,0.282,0.275,0.274,0.276,0.275],[0.628,0.094,0.092,0.100,0.093,0.092],[1.069,0.545,0.499,0.513,0.529,0.533],[0.615,0.120,0.120,0.101,0.130,0.112],[0.879,0.323,0.327,0.309,0.320,0.278],[0.345,0.228,0.227,0.224,0.229,0.242],[0.353,0.233,0.241,0.231,0.234,0.224],[0.394,0.289,0.266,0.299,0.249,0.243],[0.701,0.155,0.145,0.148,0.147,0.149],[0.285,0.157,0.156,0.154,0.157,0.165],[0.709,0.156,0.153,0.159,0.159,0.153],[0.396,0.083,0.096,0.091,0.079,0.083],[0.225,0.075,0.075,0.076,0.078,0.072],[0.396,0.096,0.090,0.089,0.091,0.089],[0.227,0.099,0.092,0.099,0.099,0.091],[1.966,1.524,1.515,1.533,1.518,1.516],[1.791,1.570,1.554,1.547,1.553,1.560],[1.773,1.588,1.550,1.597,1.563,1.568],[1.731,1.584,1.531,1.539,1.542,1.540],[1.639,1.256,1.253,1.245,1.264,1.267],[2.098,1.908,1.892,1.913,1.883,1.943],[2.069,1.887,1.868,1.839,1.883,1.882],[2.075,1.891,1.879,1.885,1.877,1.876],[1.484,1.298,1.298,1.270,1.271,1.282],[2.115,1.919,1.935,1.941,1.905,1.924],[1.114,0.354,0.313,0.307,0.332,0.322],[0.007,0.006,0.006,0.006,0.006,0.006],[0.709,0.103,0.091,0.099,0.093,0.094],[0.839,0.155,0.142,0.149,0.148,0.145],[0.804,0.126,0.121,0.121,0.120,0.119],[0.438,0.173,0.168,0.170,0.162,0.168],[0.710,0.369,0.363,0.360,0.352,0.360],[1.004,0.622,0.622,0.624,0.646,0.636],[0.840,0.607,0.609,0.599,0.595,0.596],[1.002,0.641,0.625,0.630,0.623,0.634],[0.006,0.007,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.782,0.142,0.139,0.137,0.141,0.137],[0.341,0.141,0.142,0.146,0.139,0.139],[0.745,0.157,0.152,0.151,0.145,0.146],[0.352,0.203,0.191,0.184,0.184,0.184],[0.444,0.109,0.109,0.106,0.104,0.103],[0.430,0.110,0.103,0.101,0.107,0.097],[0.267,0.108,0.105,0.104,0.111,0.110],[0.940,0.215,0.194,0.195,0.191,0.200],[0.497,0.171,0.160,0.174,0.168,0.165],[0.773,0.110,0.117,0.110,0.108,0.126],[0.280,0.098,0.093,0.096,0.092,0.101],[0.779,0.128,0.125,0.120,0.123,0.125],[0.989,0.671,0.636,0.633,0.637,0.640],[0.923,0.655,0.632,0.635,0.643,0.643],[0.910,0.673,0.659,0.677,0.659,0.644],[0.007,0.007,0.007,0.006,0.006,0.006],[0.007,0.007,0.007,0.007,0.007,0.007],[0.007,0.007,0.007,0.007,0.007,0.007],[0.850,0.162,0.157,0.156,0.157,0.158],[0.723,0.140,0.128,0.135,0.129,0.129],[0.351,0.165,0.159,0.154,0.154,0.155],[0.997,0.186,0.174,0.163,0.162,0.166],[0.934,0.184,0.180,0.168,0.157,0.169],[0.610,0.278,0.243,0.248,0.238,0.258],[0.830,0.158,0.156,0.142,0.147,0.152],[0.330,0.125,0.126,0.127,0.117,0.112],[0.852,0.178,0.169,0.175,0.169,0.172],[0.899,0.183,0.189,0.179,0.173,0.172],[0.352,0.112,0.111,0.118,0.111,0.120],[0.896,0.200,0.187,0.192,0.193,0.193],[0.183,0.067,0.061,0.063,0.066,0.058],[0.173,0.062,0.060,0.058,0.063,0.060],[0.326,0.157,0.156,0.153,0.157,0.161],[0.275,0.145,0.140,0.142,0.140,0.144],[0.313,0.239,0.181,0.177,0.183,0.171]],"version":"25.11.9.34","source":"results/25.11.9.34.json"} +,{"actual_version":"26.3.13.31","data_size":{"coffeeshop":49961793856,"hits":14998946475,"job":1905034682,"mgbench":3186296631,"ontime":3440144847,"ssb":86984203337,"taxi":24334706870,"tpcds":18785363430,"tpch":17933655972,"uk":1002235637},"kind":"versions-benchmark","load_time":{"coffeeshop":818,"hits":241,"job":21,"mgbench":65,"ontime":62,"ssb":1516,"taxi":524,"tpcds":285,"tpch":323,"uk":31},"machine":"c7a.4xlarge","release_date":"2026-03-27","result":[[0.100,0.007,0.007,0.362,0.007,0.007],[0.029,0.005,0.003,0.003,0.003,0.003],[0.058,0.014,0.009,0.035,0.009,0.008],[0.044,0.010,0.010,0.010,0.009,0.008],[0.053,0.023,0.020,0.042,0.020,0.023],[0.072,0.018,0.016,0.034,0.016,0.016],[0.173,0.004,0.004,0.005,0.004,0.004],[0.053,0.005,0.005,0.004,0.005,0.004],[0.078,0.004,0.005,0.068,0.005,0.005],[0.101,0.051,0.052,0.052,0.049,0.050],[0.365,0.262,0.270,0.269,0.263,0.268],[0.384,0.224,0.240,0.242,0.220,0.218],[0.031,0.004,0.004,0.004,0.004,0.004],[0.031,0.011,0.009,0.011,0.010,0.010],[0.537,0.410,0.363,0.393,0.348,0.353],[0.559,0.058,0.062,0.064,0.060,0.058],[0.053,0.014,0.014,0.013,0.013,0.015],[0.047,0.014,0.014,0.014,0.014,0.015],[8.271,1.147,1.162,1.135,1.149,1.169],[6.446,0.948,0.963,0.981,1.020,1.005],[6.457,0.898,1.065,0.968,0.904,0.900],[8.750,1.665,1.624,1.680,1.649,1.645],[8.026,1.368,1.363,1.667,1.367,1.347],[3.888,0.539,0.522,0.500,0.526,0.516],[0.072,0.023,0.018,0.022,0.018,0.021],[10.115,1.795,1.825,1.811,1.828,1.845],[2.572,0.585,0.566,0.555,0.576,0.576],[2.379,0.417,0.423,0.415,0.420,0.441],[0.002,0.002,0.002,0.002,0.002,0.002],[0.028,0.006,0.006,0.006,0.006,0.006],[0.052,0.015,0.015,0.038,0.016,0.015],[0.122,0.022,0.020,0.020,0.023,0.020],[0.146,0.053,0.050,0.051,0.054,0.056],[0.279,0.118,0.124,0.118,0.116,0.124],[0.003,0.003,0.003,0.021,0.003,0.003],[0.021,0.008,0.008,0.008,0.008,0.008],[0.374,0.233,0.244,0.237,0.238,0.250],[0.434,0.268,0.277,0.266,0.272,0.268],[0.170,0.065,0.060,0.059,0.059,0.060],[0.176,0.067,0.069,0.067,0.066,0.069],[0.505,0.270,0.274,0.255,0.274,0.264],[0.633,0.374,0.371,0.381,0.365,0.361],[0.485,0.277,0.308,0.284,0.316,0.294],[0.338,0.186,0.199,0.195,0.188,0.185],[1.137,0.772,0.752,0.757,0.743,0.747],[0.739,0.491,0.472,0.480,0.478,0.477],[2.292,1.548,1.426,1.545,1.385,1.377],[0.085,0.002,0.002,0.002,0.002,0.002],[1.618,0.024,0.028,0.027,0.025,0.025],[2.007,0.011,0.008,0.024,0.008,0.008],[4.388,0.817,0.775,0.796,0.763,0.813],[0.511,0.051,0.053,0.052,0.054,0.048],[0.356,0.089,0.090,0.099,0.090,0.089],[0.240,0.082,0.081,0.079,0.083,0.075],[0.358,0.093,0.088,0.086,0.088,0.091],[0.173,0.060,0.060,0.077,0.053,0.056],[1.411,0.549,0.528,0.506,0.528,0.498],[0.073,0.031,0.025,0.687,0.024,0.022],[0.327,0.170,0.174,0.176,0.158,0.151],[0.726,0.230,0.218,0.233,0.228,0.217],[2.204,1.601,1.647,1.587,1.496,1.520],[2.752,1.716,1.700,1.631,1.759,1.444],[2.799,1.810,1.461,1.861,1.728,1.616],[0.271,0.190,0.183,0.177,0.179,0.186],[0.097,0.042,0.042,0.046,0.049,0.045],[0.048,0.031,0.029,0.023,0.031,0.031],[0.068,0.022,0.025,0.022,0.021,0.022],[0.190,0.097,0.085,0.117,0.089,0.087],[0.032,0.004,0.004,0.004,0.004,0.004],[0.026,0.004,0.004,0.004,0.004,0.004],[0.016,0.004,0.004,0.004,0.004,0.004],[0.459,0.040,0.043,0.068,0.044,0.046],[0.402,0.060,0.063,0.061,0.057,0.056],[0.134,0.037,0.037,0.055,0.036,0.037],[0.246,0.053,0.053,0.076,0.058,0.057],[0.072,0.020,0.018,0.019,0.019,0.019],[0.161,0.048,0.052,0.051,0.051,0.048],[0.179,0.074,0.070,0.071,0.069,0.068],[0.046,0.017,0.017,0.017,0.018,0.018],[0.101,0.033,0.027,0.035,0.027,0.026],[0.218,0.105,0.103,0.106,0.110,0.100],[0.435,0.131,0.133,0.142,0.137,0.130],[0.515,0.372,0.351,0.367,0.337,0.352],[0.146,0.029,0.031,0.029,0.030,0.028],[0.609,0.291,0.276,0.311,0.274,0.270],[1.888,1.444,1.420,1.474,1.389,1.428],[8.535,1.132,1.173,1.340,1.126,1.101],[2.120,1.060,1.055,1.039,1.052,1.083],[12.786,2.757,2.877,2.648,2.687,2.617],[5.039,2.809,2.801,2.834,2.809,2.818],[5.649,1.841,1.842,1.869,1.840,1.897],[3.851,3.617,3.617,3.661,3.675,3.654],[7.340,6.973,7.052,7.118,7.076,7.078],[4.060,2.833,2.821,2.894,2.906,2.773],[5.689,5.194,5.203,5.223,5.217,5.276],[5.041,4.260,4.343,4.261,4.286,4.358],[null,null,null,null,null,null],[3.481,2.686,2.583,2.743,2.706,2.677],[49.311,47.554,46.962,45.000,46.171,45.346],[8.583,null,null,null,null,null],[3.498,54.890,54.831,56.238,56.223,55.241],[3.482,35.244,35.190,35.061,34.871,34.975],[null,null,null,null,null,null],[12.586,11.821,11.703,11.664,11.857,11.707],[null,null,null,null,null,null],[26.415,11.304,27.719,29.760,29.391,29.761],[2.691,0.619,0.608,0.531,0.504,0.529],[0.610,0.245,0.234,0.244,0.233,0.236],[2.902,2.072,1.844,2.103,2.213,1.940],[1.079,0.553,0.560,0.566,0.578,0.568],[null,null,null,null,null,null],[0.229,0.075,0.064,0.107,0.061,0.064],[2.826,0.921,0.941,0.923,0.916,0.896],[5.150,4.327,4.213,4.431,4.351,4.312],[7.887,6.941,6.811,6.735,6.947,7.210],[2.650,1.863,1.770,1.773,1.434,1.519],[0.544,0.133,0.133,0.136,0.137,0.136],[1.517,0.649,0.585,0.614,0.628,0.634],[2.004,1.088,0.822,0.815,0.839,0.849],[0.182,0.095,0.093,0.106,0.102,0.106],[0.230,0.113,0.115,0.144,0.120,0.113],[0.409,0.209,0.209,0.208,0.216,0.205],[4.786,3.917,3.976,4.009,4.065,3.902],[2.666,1.427,1.421,1.413,1.438,1.413],[3.913,0.640,0.658,0.653,0.659,0.651],[0.627,0.242,0.222,0.221,0.234,0.228],[5.225,2.969,2.923,2.772,2.805,2.839],[0.526,0.240,0.236,0.258,0.245,0.242],[0.264,0.098,0.103,0.109,0.096,0.101],[0.531,0.308,0.271,0.279,0.259,0.275],[0.129,0.036,0.034,0.041,0.040,0.035],[4.965,3.678,3.494,3.183,3.102,3.522],[null,null,null,null,null,null],[0.427,0.197,0.154,0.171,0.152,0.151],[1.200,7.872,7.597,7.672,7.772,7.635],[0.602,1.442,1.464,1.298,1.328,1.323],[1.338,1.009,0.995,1.023,0.996,1.004],[0.722,0.225,0.225,0.221,0.227,0.244],[2.235,1.527,1.506,1.516,1.512,1.490],[0.179,0.056,0.057,0.061,0.054,0.058],[2.078,0.465,0.450,0.515,0.460,0.479],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.349,0.105,0.101,0.105,0.100,0.100],[0.972,0.887,0.859,0.847,0.795,0.865],[1.433,5.483,5.289,5.273,5.262,5.240],[1.075,0.365,3.766,3.670,3.657,3.670],[0.536,0.142,0.139,0.134,0.135,0.135],[0.247,0.080,0.076,0.081,0.078,0.090],[0.109,0.723,0.657,0.526,0.552,0.519],[0.215,0.850,0.825,0.876,0.844,0.843],[13.538,24.226,23.892,24.206,24.246,24.113],[24.835,23.952,24.145,24.185,24.110,24.387],[1.536,2.996,2.993,3.042,3.039,2.958],[3.594,2.930,2.943,3.072,2.662,2.982],[1.384,0.914,0.885,0.875,0.912,0.874],[4.174,3.834,3.831,3.866,3.763,3.781],[1.199,5.425,5.411,5.458,5.501,5.482],[1.331,0.899,0.883,0.874,0.868,0.837],[1.511,1.248,1.265,1.317,1.354,1.316],[0.303,0.145,0.127,0.133,0.115,0.114],[1.427,1.961,1.970,1.901,1.950,1.942],[0.254,0.028,0.026,0.025,0.025,0.026],[1.005,0.306,0.315,0.339,0.339,0.316],[0.945,2.503,2.289,2.309,2.357,2.483],[0.851,0.344,0.336,0.349,0.326,0.344],[0.791,3.883,3.861,3.556,3.787,3.727],[0.206,0.125,0.128,0.126,0.153,0.131],[5.503,4.658,4.682,4.814,4.737,4.674],[0.150,0.958,0.974,0.850,0.660,0.796],[0.994,0.826,0.712,0.902,0.845,0.792],[1.338,1.236,1.340,1.283,1.256,1.271],[0.033,0.016,0.015,0.016,0.017,0.015],[0.283,0.066,0.074,0.073,0.076,0.066],[1.417,1.007,1.003,1.039,1.005,1.012],[0.027,0.022,0.021,0.024,0.028,0.028],[0.287,0.158,0.154,0.156,0.157,0.159],[1.698,4.078,3.786,4.048,4.028,3.955],[2.270,51.829,51.916,52.471,52.239,52.175],[1.458,0.391,0.414,0.423,0.382,0.402],[null,null,null,null,null,null],[4.017,0.373,0.437,0.485,0.397,0.381],[1.509,1.051,1.060,1.060,1.013,1.024],[0.281,0.065,0.066,0.066,0.067,0.066],[0.624,0.264,0.267,0.268,0.259,0.275],[0.842,0.273,0.258,0.264,0.276,0.272],[0.289,0.074,0.079,0.071,0.073,0.073],[0.746,0.502,0.304,0.278,0.287,0.285],[15.449,15.328,15.350,15.198,15.401,15.386],[0.795,0.238,0.233,0.263,0.232,0.248],[0.846,0.516,0.484,0.499,0.493,0.489],[0.903,0.399,0.298,0.330,0.304,0.330],[0.955,1.090,0.998,0.976,0.940,0.936],[0.276,10.829,10.852,10.843,10.830,10.731],[0.607,0.263,0.270,0.259,0.267,0.261],[0.779,0.452,0.319,0.322,0.331,0.320],[0.953,0.523,0.524,0.507,0.491,0.508],[1.046,1.528,1.262,1.491,1.436,1.275],[13.051,27.674,27.970,27.904,27.967,28.138],[2.377,2.351,2.287,2.247,2.205,2.117],[0.781,0.245,0.250,0.250,0.250,0.251],[0.828,9.870,9.605,9.655,9.869,9.877],[0.934,0.283,0.267,0.255,0.255,0.254],[1.900,1.288,1.368,1.242,1.428,1.488],[0.858,1.754,1.734,1.500,1.496,1.659],[1.846,1.305,1.281,1.247,1.316,1.252],[null,null,null,null,null,null],[0.010,0.010,0.009,0.010,0.010,0.010],[1.453,0.418,0.386,0.400,0.409,0.352],[0.038,0.052,0.035,0.050,0.033,0.031],[1.702,7.212,7.318,7.272,7.153,7.133],[2.154,1.560,1.263,1.316,1.286,1.361],[0.339,0.202,0.197,0.217,0.217,0.197],[0.354,0.265,0.276,0.263,0.263,0.257],[0.168,0.058,0.060,0.099,0.062,0.061],[0.243,0.032,0.037,0.032,0.032,0.034],[0.524,0.182,0.176,0.220,0.181,0.164],[0.354,0.304,0.279,0.303,0.313,0.310],[4.983,4.698,4.667,4.746,4.725,4.671],[1.518,9.029,8.999,8.930,8.827,8.975],[0.601,0.275,0.272,0.274,0.268,0.271],[0.219,0.087,0.077,0.074,0.085,0.080],[0.148,0.199,0.185,0.175,0.164,0.161],[0.178,0.079,0.079,0.078,0.077,0.085],[2.986,2.408,2.324,2.444,2.387,2.466],[0.490,0.201,0.175,0.176,0.189,0.161],[5.905,5.592,5.497,5.608,5.542,5.578],[0.513,0.667,0.629,0.698,0.696,0.663],[1.185,0.648,0.632,0.629,0.630,0.622],[0.429,0.146,0.147,0.151,0.150,0.148],[18.507,18.469,18.467,18.396,18.339,18.543],[0.139,0.040,0.041,0.055,0.040,0.036],[0.449,0.023,0.018,0.018,0.019,0.019],[0.113,0.022,0.023,0.023,0.022,0.022],[0.074,0.018,0.018,0.018,0.018,0.018],[0.210,0.088,0.083,0.086,0.077,0.091],[0.162,0.077,0.080,0.073,0.072,0.074],[0.095,0.039,0.042,0.037,0.045,0.046],[0.243,0.152,0.128,0.142,0.149,0.148],[0.519,0.428,0.141,0.291,0.145,0.290],[0.458,0.152,0.140,0.143,0.137,0.141],[0.659,0.182,0.178,0.182,0.179,0.178],[0.222,0.038,0.033,0.034,0.035,0.033],[0.163,0.049,0.049,0.049,0.047,0.049],[0.160,0.054,0.055,0.054,0.060,0.056],[0.602,0.132,0.132,0.129,0.136,0.130],[0.683,0.023,0.017,0.017,0.016,0.017],[0.499,0.268,0.152,0.139,0.155,0.155],[0.148,0.031,0.030,0.030,0.032,0.030],[0.160,0.039,0.036,0.034,0.034,0.029],[0.136,0.031,0.030,0.031,0.029,0.031],[0.178,0.037,0.041,0.038,0.038,0.037],[0.137,0.033,0.030,0.032,0.031,0.029],[0.359,0.163,0.170,0.149,0.153,0.170],[0.220,0.067,0.058,0.059,0.059,0.059],[0.157,0.055,0.058,0.058,0.056,0.056],[0.516,0.231,0.216,0.217,0.244,0.221],[0.286,0.151,0.085,0.062,0.064,0.062],[0.234,0.101,0.057,0.057,0.052,0.053],[0.519,0.913,0.896,0.873,0.877,0.949],[0.376,0.129,0.120,0.117,0.127,0.130],[0.372,0.148,0.148,0.159,0.133,0.131],[0.312,0.155,0.122,0.128,0.098,0.096],[0.428,0.178,0.170,0.161,0.155,0.150],[0.330,0.200,0.188,0.206,0.187,0.200],[0.237,0.104,0.065,0.062,0.062,0.059],[0.159,0.039,0.037,0.033,0.030,0.031],[0.329,0.662,0.605,0.615,0.583,0.689],[0.006,0.006,0.005,0.006,0.005,0.006],[0.006,0.006,0.005,0.006,0.006,0.006],[0.251,0.086,0.080,0.089,0.087,0.078],[0.193,0.080,0.078,0.076,0.076,0.080],[0.320,0.173,0.127,0.422,0.158,0.110],[0.364,0.318,0.331,0.319,0.312,0.316],[0.223,0.628,0.235,0.223,0.236,0.228],[0.346,0.633,0.636,0.676,0.652,0.668],[0.321,0.557,0.531,0.545,0.552,0.551],[0.635,0.486,0.538,0.513,0.560,0.517],[0.796,0.721,0.692,0.749,0.682,0.750],[0.472,0.134,0.125,0.116,0.120,0.122],[0.232,0.064,0.062,0.060,0.063,0.066],[0.686,0.187,0.163,0.200,0.221,0.205],[0.389,0.188,0.075,0.222,0.068,0.065],[0.214,0.216,0.142,0.056,0.070,0.062],[0.274,0.181,0.073,0.083,0.075,0.184],[0.235,0.081,0.060,0.058,0.058,0.058],[0.605,0.120,0.125,0.145,0.141,0.146],[0.915,0.716,0.671,0.666,0.721,0.715],[0.588,0.639,0.665,0.625,0.682,0.699],[0.560,0.147,0.172,0.138,0.170,0.155],[0.455,0.445,0.404,0.407,0.416,0.420],[0.242,0.413,0.393,0.366,0.380,0.380],[0.192,0.445,0.407,0.397,0.382,0.356],[0.267,0.419,0.369,0.377,0.366,0.373],[1.054,0.912,0.924,0.934,0.869,0.770],[0.528,0.490,0.489,0.456,0.451,0.469],[0.300,0.152,0.135,0.136,0.121,0.121],[0.006,0.006,0.006,0.006,0.006,0.006],[0.793,0.224,0.199,0.182,0.244,0.179],[0.448,0.283,0.366,0.262,0.287,0.220],[0.313,0.374,0.111,0.372,0.158,0.133],[0.726,0.433,0.291,0.317,0.284,0.292],[0.503,1.146,1.159,1.118,1.160,1.192],[0.351,0.145,0.304,0.238,0.268,0.272],[0.221,0.369,0.295,0.294,0.259,0.256],[0.436,0.180,0.246,0.215,0.227,0.240],[0.007,0.006,0.006,0.006,0.006,0.007],[0.006,0.006,0.007,0.007,0.006,0.007],[0.006,0.007,0.006,0.006,0.007,0.006],[0.477,0.287,0.278,0.272,0.162,0.204],[0.555,0.283,0.366,0.279,0.343,0.254],[0.476,0.210,0.195,0.172,0.433,0.144],[0.335,0.206,0.264,0.476,0.168,0.178],[0.394,0.140,0.097,0.107,0.106,0.096],[0.258,0.117,0.397,0.319,0.292,0.300],[0.391,0.211,0.159,0.114,0.125,0.119],[0.829,0.242,0.285,0.258,0.239,0.233],[0.375,0.567,0.217,0.181,0.169,0.198],[0.891,0.293,0.499,0.395,0.506,0.431],[0.361,0.134,0.138,0.137,0.140,0.143],[0.419,0.454,0.455,0.578,0.417,0.422],[0.472,0.294,0.178,0.176,0.174,0.190],[0.490,0.280,0.176,0.160,0.156,0.150],[0.496,0.216,0.237,0.265,0.236,0.248],[0.008,0.006,0.006,0.006,0.006,0.006],[0.007,0.006,0.006,0.007,0.007,0.006],[0.007,0.007,0.006,0.007,0.007,0.007],[0.733,0.317,0.308,0.141,0.166,0.125],[0.420,0.352,0.603,0.268,0.429,0.260],[0.565,0.557,0.362,0.593,0.353,0.370],[0.432,0.160,0.123,0.157,0.115,0.118],[0.410,0.136,0.118,0.111,0.113,0.121],[0.660,0.196,0.361,0.174,0.181,0.177],[0.803,0.214,0.347,0.350,0.331,0.340],[0.551,0.671,0.545,0.323,0.344,0.313],[0.801,0.376,0.442,0.330,0.343,0.348],[0.826,0.203,0.173,0.161,0.170,0.298],[0.408,0.299,0.182,0.232,0.143,0.153],[0.447,0.196,0.211,0.162,0.158,0.238],[0.163,0.055,0.058,0.055,0.047,0.052],[0.129,0.051,0.053,0.050,0.052,0.047],[0.250,0.325,0.310,0.292,0.304,0.310],[0.270,0.233,0.190,0.227,0.212,0.198],[0.463,0.481,0.361,0.345,0.394,0.326]],"version":"26.3.13.31","source":"results/26.3.13.31.json"} +,{"actual_version":"25.10.7.6","data_size":{"coffeeshop":44632750241,"hits":14323777871,"job":1828094569,"mgbench":2954108501,"ontime":2699312914,"ssb":73073144249,"taxi":24223627187,"tpcds":18792872836,"tpch":17237278555,"uk":780916031},"kind":"versions-benchmark","load_time":{"coffeeshop":820,"hits":242,"job":17,"mgbench":62,"ontime":64,"ssb":1482,"taxi":566,"tpcds":311,"tpch":278,"uk":32},"machine":"c7a.4xlarge","release_date":"2026-04-30","result":[[0.079,0.007,0.007,0.315,0.006,0.007],[0.025,0.003,0.003,0.003,0.003,0.003],[0.053,0.021,0.008,0.028,0.008,0.009],[0.043,0.010,0.009,0.009,0.009,0.009],[0.070,0.024,0.020,0.041,0.019,0.022],[0.074,0.016,0.016,0.034,0.015,0.015],[0.026,0.004,0.004,0.004,0.003,0.004],[0.047,0.005,0.005,0.004,0.004,0.004],[0.071,0.004,0.005,0.051,0.004,0.004],[0.093,0.052,0.054,0.052,0.053,0.052],[0.307,0.209,0.197,0.195,0.201,0.187],[0.420,0.235,0.234,0.241,0.217,0.226],[0.025,0.003,0.003,0.003,0.003,0.003],[0.029,0.009,0.010,0.010,0.009,0.008],[0.546,0.345,0.347,0.375,0.323,0.330],[0.656,0.081,0.082,0.079,0.078,0.080],[0.056,0.013,0.013,0.016,0.014,0.015],[0.044,0.012,0.012,0.012,0.012,0.012],[6.485,1.198,1.218,1.264,1.235,1.247],[4.740,0.928,0.963,0.944,0.938,0.924],[4.781,0.966,0.975,0.974,0.976,0.966],[5.393,1.552,1.560,1.589,1.595,1.559],[6.209,1.338,1.343,1.328,1.338,1.354],[3.940,0.764,0.717,0.686,0.697,0.685],[0.063,0.019,0.018,0.018,0.019,0.017],[7.772,1.921,1.874,1.854,1.837,1.843],[2.540,0.592,0.555,0.572,0.556,0.589],[2.356,0.400,0.397,0.404,0.402,0.397],[0.002,0.001,0.001,0.001,0.001,0.001],[0.021,0.006,0.006,0.007,0.006,0.006],[0.056,0.017,0.017,0.038,0.019,0.017],[0.172,0.022,0.023,0.022,0.024,0.024],[0.233,0.057,0.057,0.061,0.058,0.057],[0.390,0.123,0.126,0.116,0.121,0.117],[0.002,0.003,0.002,0.021,0.002,0.002],[0.022,0.007,0.007,0.007,0.007,0.008],[0.442,0.241,0.237,0.242,0.238,0.239],[0.491,0.290,0.279,0.276,0.276,0.275],[0.231,0.066,0.067,0.069,0.065,0.066],[0.276,0.088,0.082,0.083,0.083,0.084],[0.557,0.272,0.269,0.260,0.255,0.268],[0.786,0.403,0.395,0.388,0.371,0.404],[0.632,0.345,0.326,0.337,0.376,0.332],[0.376,0.212,0.194,0.197,0.195,0.197],[1.332,0.841,0.833,0.826,0.855,0.835],[0.839,0.528,0.484,0.518,0.490,0.499],[2.704,1.840,1.602,1.754,1.613,1.557],[0.176,0.002,0.002,0.002,0.002,0.002],[2.170,0.021,0.019,0.019,0.019,0.023],[2.514,0.007,0.007,0.021,0.007,0.007],[4.363,0.800,0.793,0.809,0.791,0.796],[1.002,0.090,0.088,0.083,0.086,0.089],[0.613,0.106,0.105,0.107,0.110,0.105],[0.336,0.085,0.082,0.086,0.084,0.081],[0.571,0.106,0.109,0.110,0.110,0.107],[2.142,0.264,0.278,0.282,0.260,0.261],[2.038,0.520,0.505,0.522,0.503,0.508],[0.068,0.022,0.026,0.637,0.021,0.022],[0.631,0.251,0.232,0.255,0.214,0.219],[1.287,0.337,0.295,0.356,0.336,0.345],[2.385,1.562,1.608,1.663,1.551,1.514],[3.376,1.390,1.606,1.446,1.610,1.638],[3.414,1.650,1.611,1.633,1.399,1.643],[0.301,0.196,0.170,0.193,0.197,0.183],[0.092,0.056,0.052,0.057,0.057,0.055],[0.044,0.033,0.035,0.030,0.030,0.031],[0.066,0.021,0.022,0.021,0.019,0.020],[0.199,0.128,0.117,0.118,0.110,0.109],[0.030,0.004,0.004,0.003,0.004,0.004],[0.035,0.004,0.003,0.004,0.004,0.004],[0.014,0.004,0.004,0.004,0.004,0.003],[0.452,0.044,0.040,0.061,0.040,0.041],[0.412,0.058,0.055,0.055,0.057,0.058],[0.131,0.038,0.038,0.058,0.037,0.036],[0.241,0.059,0.059,0.083,0.062,0.057],[0.075,0.018,0.019,0.018,0.017,0.017],[0.209,0.055,0.056,0.055,0.055,0.056],[0.237,0.074,0.075,0.074,0.073,0.076],[0.059,0.019,0.018,0.018,0.019,0.019],[0.101,0.032,0.028,0.036,0.030,0.028],[0.235,0.116,0.114,0.118,0.115,0.114],[0.623,0.153,0.152,0.157,0.157,0.152],[0.377,0.250,0.249,0.246,0.250,0.246],[0.139,0.028,0.028,0.027,0.028,0.028],[0.715,0.303,0.304,0.320,0.299,0.316],[2.533,1.901,1.894,1.826,1.958,1.904],[8.685,1.109,1.088,1.138,1.119,1.127],[2.842,1.093,1.092,1.159,1.121,1.157],[12.916,2.664,2.719,2.893,2.866,2.699],[4.287,2.601,2.670,2.536,2.386,2.466],[4.068,1.930,1.959,1.984,1.957,1.908],[3.576,3.190,3.436,3.443,3.469,3.136],[6.878,6.382,6.167,6.384,6.561,6.570],[3.312,2.607,2.601,2.632,2.403,2.449],[5.074,4.343,4.387,4.420,4.366,4.446],[4.616,3.784,3.782,3.787,3.791,3.791],[7.872,7.357,7.327,7.369,7.272,7.305],[3.264,2.434,2.440,2.652,2.641,2.586],[49.732,48.242,46.133,46.441,47.922,47.257],[6.248,4.698,4.656,4.635,4.639,4.572],[2.828,2.248,2.241,2.287,2.286,2.255],[2.455,1.536,1.547,1.546,1.521,1.550],[3.645,3.294,3.339,3.344,3.289,3.362],[11.106,10.425,10.519,10.471,10.903,10.926],[37.014,38.213,37.525,37.608,37.644,37.568],[26.271,23.601,24.018,24.003,24.024,24.018],[2.732,0.673,0.667,0.469,0.450,0.434],[0.933,0.474,0.447,0.458,0.446,0.455],[2.804,1.816,1.839,1.863,1.903,1.934],[2.021,1.043,1.061,1.026,0.730,1.089],[4.690,3.377,3.376,3.382,3.560,3.427],[0.336,0.078,0.080,0.079,0.080,0.079],[2.842,1.793,1.753,1.710,1.733,1.771],[5.393,4.094,3.951,4.097,3.949,3.995],[7.510,6.196,5.979,6.095,6.085,6.212],[2.600,1.124,1.036,1.093,1.244,1.081],[0.482,0.247,0.250,0.253,0.245,0.243],[1.538,0.311,0.351,0.388,0.326,0.310],[3.010,1.931,1.683,1.703,1.675,1.684],[0.198,0.108,0.101,0.102,0.097,0.107],[0.244,0.131,0.109,0.119,0.105,0.103],[0.404,0.202,0.193,0.191,0.201,0.194],[3.684,1.809,1.716,1.572,1.532,1.654],[2.841,1.301,1.302,1.298,1.300,1.301],[4.254,1.006,0.991,1.006,0.989,1.009],[0.840,0.196,0.198,0.191,0.184,0.194],[null,11.169,10.921,10.999,10.825,10.830],[0.756,0.322,0.237,0.328,0.238,0.326],[null,null,null,null,null,null],[1.007,0.659,0.564,0.566,0.562,0.558],[1.798,1.286,1.296,1.285,1.294,1.283],[30.904,28.951,29.072,29.422,29.620,29.767],[null,null,null,null,null,null],[2.435,2.033,1.949,1.968,2.018,2.012],[1.848,0.326,0.327,0.366,0.331,0.322],[1.068,0.397,0.413,0.408,0.401,0.418],[1.694,1.046,1.037,1.037,1.060,1.034],[1.103,0.255,0.242,0.241,0.253,0.255],[7.140,6.320,6.279,6.430,6.343,6.350],[0.204,0.069,0.070,0.078,0.070,0.075],[3.880,1.549,1.628,1.605,1.563,1.623],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.817,0.465,0.457,0.455,0.454,0.464],[1.358,0.394,0.394,0.416,0.393,0.388],[3.197,1.459,1.455,1.659,1.517,1.477],[1.488,0.498,0.514,0.497,0.492,0.486],[1.908,0.171,0.208,0.212,0.204,0.184],[0.336,0.111,0.114,0.112,0.112,0.110],[0.199,0.070,0.069,0.088,0.070,0.070],[0.261,0.148,0.141,0.140,0.137,0.135],[6.231,4.089,4.502,4.193,4.142,4.546],[5.987,4.824,4.595,4.500,4.789,4.561],[2.411,1.280,1.266,1.265,1.286,1.309],[2.356,1.270,1.306,1.295,1.282,1.269],[3.070,1.515,1.483,1.766,1.497,1.436],[1.014,0.178,0.180,0.182,0.183,0.183],[1.819,0.327,0.328,0.325,0.318,0.320],[1.920,1.020,1.042,1.025,1.038,1.043],[2.851,1.515,1.462,1.751,1.650,1.506],[0.229,0.095,0.096,0.085,0.089,0.082],[1.558,0.712,0.714,0.719,0.711,0.736],[0.342,0.087,0.094,0.086,0.088,0.090],[1.519,0.250,0.237,0.240,0.249,0.241],[1.493,0.287,0.282,0.280,0.281,0.282],[1.237,0.414,0.388,0.442,0.407,0.393],[1.213,0.287,0.294,0.295,0.290,0.289],[0.334,0.151,0.131,0.131,0.122,0.124],[4.984,4.759,4.795,4.760,4.767,4.743],[0.336,0.212,0.195,0.204,0.201,0.193],[0.277,0.225,0.208,0.192,0.196,0.200],[0.867,0.404,0.410,0.408,0.393,0.410],[0.031,0.015,0.015,0.017,0.015,0.015],[0.967,0.100,0.099,0.096,0.094,0.097],[2.405,0.216,0.212,0.217,0.213,0.211],[0.725,0.206,0.203,0.205,0.205,0.202],[0.484,0.282,0.282,0.272,0.280,0.283],[2.328,0.470,0.482,0.473,0.466,0.475],[2.559,2.032,2.027,2.010,1.996,2.128],[2.668,1.194,1.186,1.102,1.197,1.187],[null,null,null,null,null,null],[1.840,0.904,0.893,0.911,0.899,0.909],[2.688,2.134,2.200,2.161,2.180,1.851],[0.559,0.096,0.097,0.097,0.098,0.098],[1.054,0.366,0.320,0.335,0.316,0.306],[2.022,1.163,1.176,1.170,1.120,1.120],[0.957,0.097,0.101,0.097,0.095,0.097],[1.555,0.263,0.262,0.260,0.260,0.262],[1.021,0.774,0.776,0.781,0.765,0.768],[1.120,0.292,0.283,0.303,0.269,0.270],[1.594,1.063,1.073,1.069,1.068,1.065],[1.488,0.266,0.268,0.262,0.271,0.268],[1.819,0.607,0.598,0.599,0.596,0.593],[0.397,0.186,0.184,0.183,0.190,0.185],[1.007,0.343,0.339,0.297,0.307,0.476],[6.378,3.176,3.461,3.106,3.167,3.073],[1.148,0.379,0.384,0.398,0.396,0.375],[1.748,0.644,0.604,0.637,0.606,0.598],[14.638,14.409,13.966,14.245,14.230,14.361],[2.810,0.458,0.447,0.451,0.437,0.443],[1.032,0.231,0.233,0.232,0.227,0.228],[1.090,0.427,0.427,0.430,0.428,0.427],[1.477,0.216,0.215,0.219,0.216,0.213],[null,null,null,null,null,null],[1.406,0.256,0.254,0.259,0.250,0.252],[5.345,4.837,4.723,4.750,4.697,4.774],[null,null,null,null,null,null],[0.009,0.009,0.009,0.008,0.008,0.008],[2.052,0.288,0.321,0.280,0.274,0.277],[0.034,0.045,0.026,0.036,0.027,0.025],[2.346,0.399,0.403,0.397,0.399,0.396],[4.028,1.452,1.464,1.440,1.484,1.485],[0.225,0.114,0.113,0.119,0.114,0.112],[0.437,0.224,0.199,0.206,0.203,0.199],[0.173,0.066,0.064,0.098,0.074,0.072],[0.229,0.128,0.133,0.121,0.124,0.121],[0.763,0.353,0.342,0.362,0.348,0.351],[0.192,0.077,0.079,0.081,0.079,0.082],[4.979,4.663,4.700,4.683,4.661,4.682],[2.508,1.417,1.397,1.394,1.386,1.403],[1.028,0.388,0.363,0.340,0.343,0.349],[0.272,0.067,0.069,0.069,0.072,0.065],[0.160,0.050,0.049,0.052,0.050,0.048],[0.191,0.061,0.063,0.067,0.060,0.065],[1.717,0.714,0.682,0.717,0.701,0.710],[0.659,0.211,0.200,0.210,0.217,0.208],[5.506,5.417,5.487,5.480,5.407,5.523],[0.791,0.114,0.115,0.113,0.118,0.118],[3.928,3.249,3.238,3.260,3.256,3.271],[0.641,0.193,0.192,0.191,0.192,0.189],[0.734,0.333,0.340,0.340,0.334,0.335],[0.186,0.065,0.065,0.082,0.069,0.062],[0.284,0.219,0.213,0.208,0.209,0.210],[0.117,0.039,0.036,0.037,0.039,0.037],[0.301,0.230,0.212,0.215,0.217,0.207],[0.203,0.098,0.093,0.091,0.091,0.094],[0.190,0.100,0.099,0.099,0.106,0.097],[0.152,0.060,0.060,0.062,0.053,0.056],[0.218,0.136,0.119,0.124,0.119,0.124],[0.902,0.068,0.069,0.070,0.065,0.070],[0.860,0.062,0.064,0.056,0.055,0.057],[0.818,0.077,0.077,0.073,0.077,0.079],[0.251,0.145,0.142,0.139,0.148,0.147],[0.162,0.045,0.043,0.045,0.041,0.041],[0.297,0.181,0.179,0.163,0.170,0.169],[0.771,0.045,0.047,0.046,0.044,0.046],[0.748,0.036,0.037,0.036,0.036,0.036],[0.745,0.064,0.063,0.073,0.063,0.060],[0.673,0.442,0.448,0.440,0.444,0.449],[0.670,0.466,0.455,0.466,0.457,0.459],[0.595,0.440,0.440,0.434,0.434,0.438],[0.630,0.474,0.483,0.482,0.480,0.480],[0.619,0.458,0.466,0.466,0.457,0.455],[0.738,0.511,0.524,0.525,0.527,0.530],[0.529,0.246,0.234,0.231,0.231,0.228],[0.425,0.230,0.234,0.229,0.214,0.229],[0.749,0.338,0.334,0.331,0.324,0.323],[0.348,0.073,0.077,0.077,0.078,0.076],[0.273,0.047,0.047,0.046,0.044,0.047],[1.005,0.710,0.701,0.708,0.714,0.757],[0.914,0.711,0.696,0.704,0.701,0.715],[0.544,0.139,0.147,0.147,0.144,0.144],[0.487,0.128,0.123,0.125,0.126,0.125],[0.505,0.163,0.164,0.156,0.162,0.165],[0.507,0.203,0.176,0.170,0.178,0.174],[0.367,0.084,0.088,0.084,0.083,0.085],[0.261,0.082,0.074,0.076,0.078,0.075],[0.242,0.099,0.091,0.088,0.089,0.091],[0.006,0.006,0.005,0.005,0.005,0.005],[0.006,0.005,0.005,0.005,0.005,0.005],[0.320,0.079,0.073,0.073,0.073,0.082],[0.454,0.361,0.330,0.341,0.345,0.343],[0.849,0.105,0.104,0.107,0.104,0.097],[1.333,0.544,0.545,0.533,0.555,0.533],[0.827,0.126,0.131,0.130,0.126,0.121],[1.068,0.311,0.319,0.329,0.292,0.334],[0.360,0.247,0.237,0.242,0.235,0.246],[0.363,0.248,0.243,0.236,0.235,0.229],[0.390,0.282,0.280,0.266,0.263,0.264],[0.871,0.146,0.161,0.154,0.148,0.147],[0.307,0.155,0.160,0.158,0.160,0.163],[0.884,0.154,0.152,0.155,0.156,0.156],[0.476,0.085,0.088,0.105,0.099,0.083],[0.243,0.082,0.072,0.073,0.074,0.077],[0.516,0.103,0.095,0.097,0.095,0.099],[0.247,0.103,0.096,0.102,0.090,0.094],[2.406,1.909,1.911,1.871,1.912,1.918],[2.156,1.941,1.960,1.958,1.948,1.962],[2.168,1.957,1.988,1.960,1.943,1.971],[2.130,1.910,1.930,1.948,1.920,1.949],[1.742,1.368,1.343,1.375,1.356,1.368],[2.156,1.975,1.965,1.970,1.977,1.966],[2.168,1.953,1.988,1.961,1.972,1.946],[2.212,2.006,1.987,1.981,1.956,1.956],[1.600,1.384,1.375,1.390,1.403,1.369],[2.228,2.017,2.055,2.018,2.016,2.047],[1.366,0.364,0.348,0.370,0.376,0.342],[0.007,0.006,0.006,0.006,0.006,0.006],[0.898,0.108,0.100,0.098,0.097,0.102],[1.113,0.154,0.160,0.158,0.148,0.154],[1.086,0.134,0.123,0.122,0.118,0.122],[0.502,0.178,0.175,0.178,0.176,0.180],[0.742,0.400,0.379,0.381,0.384,0.385],[1.055,0.648,0.664,0.641,0.642,0.637],[0.927,0.638,0.651,0.624,0.634,0.621],[1.050,0.668,0.664,0.653,0.646,0.650],[0.007,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.981,0.148,0.146,0.154,0.147,0.144],[0.336,0.161,0.154,0.145,0.150,0.155],[0.974,0.168,0.157,0.154,0.151,0.153],[0.356,0.212,0.204,0.218,0.206,0.199],[0.476,0.119,0.109,0.105,0.106,0.112],[0.497,0.100,0.115,0.108,0.107,0.101],[0.279,0.114,0.105,0.113,0.104,0.109],[1.230,0.223,0.221,0.218,0.209,0.221],[0.603,0.183,0.182,0.174,0.181,0.195],[0.982,0.120,0.123,0.119,0.115,0.114],[0.276,0.094,0.112,0.096,0.097,0.096],[1.018,0.140,0.131,0.134,0.129,0.124],[1.065,0.667,0.669,0.660,0.652,0.659],[0.999,0.667,0.663,0.647,0.640,0.676],[1.012,0.710,0.682,0.676,0.673,0.658],[0.007,0.007,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.963,0.162,0.163,0.156,0.153,0.163],[0.911,0.137,0.129,0.131,0.137,0.148],[0.355,0.170,0.161,0.157,0.157,0.163],[1.246,0.180,0.182,0.172,0.176,0.173],[1.240,0.194,0.181,0.178,0.174,0.184],[0.712,0.291,0.312,0.265,0.275,0.269],[1.113,0.172,0.158,0.162,0.152,0.154],[0.339,0.138,0.131,0.126,0.137,0.126],[1.055,0.182,0.178,0.179,0.178,0.185],[1.125,0.199,0.190,0.188,0.188,0.183],[0.349,0.120,0.112,0.113,0.118,0.116],[1.097,0.210,0.207,0.202,0.196,0.201],[0.192,0.066,0.061,0.065,0.064,0.060],[0.187,0.065,0.067,0.066,0.060,0.061],[0.351,0.192,0.189,0.176,0.168,0.171],[0.285,0.161,0.145,0.144,0.142,0.141],[0.325,0.228,0.206,0.197,0.209,0.195]],"version":"25.10.7.6","source":"results/25.10.7.6.json"} +,{"actual_version":"25.12.11.4","data_size":{"coffeeshop":49966807235,"hits":14988146847,"job":1905031892,"mgbench":3186282929,"ontime":3440107771,"ssb":86991255890,"taxi":24334822142,"tpcds":18797231648,"tpch":17933004396,"uk":1002191183},"kind":"versions-benchmark","load_time":{"coffeeshop":790,"hits":250,"job":26,"mgbench":63,"ontime":53,"ssb":1463,"taxi":497,"tpcds":331,"tpch":286,"uk":33},"machine":"c7a.4xlarge","release_date":"2026-04-30","result":[[0.077,0.007,0.007,0.277,0.006,0.007],[0.019,0.004,0.003,0.003,0.003,0.003],[0.047,0.016,0.009,0.033,0.007,0.007],[0.035,0.009,0.009,0.009,0.008,0.008],[0.048,0.018,0.022,0.037,0.018,0.027],[0.058,0.018,0.018,0.032,0.014,0.014],[0.021,0.004,0.004,0.004,0.004,0.004],[0.049,0.005,0.005,0.005,0.004,0.004],[0.065,0.004,0.004,0.058,0.004,0.004],[0.089,0.048,0.048,0.047,0.048,0.047],[0.242,0.168,0.166,0.165,0.162,0.163],[0.342,0.213,0.221,0.220,0.206,0.201],[0.029,0.003,0.003,0.004,0.003,0.003],[0.027,0.008,0.010,0.009,0.008,0.008],[0.469,0.351,0.341,0.362,0.328,0.320],[0.489,0.057,0.055,0.056,0.060,0.059],[0.039,0.011,0.012,0.010,0.010,0.011],[0.037,0.010,0.011,0.010,0.010,0.010],[8.195,1.010,1.013,1.050,1.034,1.036],[6.440,0.850,0.828,0.838,0.834,0.879],[6.459,0.774,0.798,0.764,0.784,0.770],[8.750,1.507,1.509,1.516,1.517,1.499],[8.030,1.265,1.269,1.267,1.287,1.297],[3.875,0.488,0.452,0.454,0.459,0.441],[0.053,0.017,0.030,0.017,0.015,0.015],[10.122,1.747,1.736,1.764,1.732,1.748],[2.564,0.524,0.514,0.520,0.538,0.513],[2.380,0.384,0.385,0.390,0.381,0.388],[0.002,0.001,0.002,0.001,0.002,0.001],[0.027,0.006,0.006,0.006,0.006,0.006],[0.051,0.015,0.015,0.035,0.014,0.014],[0.115,0.025,0.021,0.020,0.020,0.020],[0.143,0.052,0.050,0.052,0.050,0.052],[0.254,0.107,0.108,0.108,0.105,0.106],[0.004,0.002,0.002,0.021,0.002,0.002],[0.019,0.007,0.008,0.008,0.007,0.007],[0.356,0.219,0.218,0.220,0.225,0.219],[0.397,0.254,0.253,0.268,0.262,0.254],[0.156,0.061,0.060,0.057,0.056,0.057],[0.163,0.068,0.063,0.063,0.063,0.064],[0.454,0.251,0.242,0.245,0.244,0.249],[0.595,0.349,0.360,0.345,0.343,0.341],[0.490,0.284,0.261,0.284,0.286,0.272],[0.305,0.175,0.178,0.176,0.179,0.178],[1.094,0.743,0.715,0.710,0.707,0.705],[0.705,0.468,0.458,0.446,0.441,0.460],[2.200,1.520,1.497,1.355,1.471,1.345],[0.117,0.002,0.002,0.002,0.002,0.002],[1.570,0.024,0.021,0.020,0.022,0.022],[1.966,0.007,0.007,0.019,0.007,0.007],[4.341,0.679,0.684,0.699,0.674,0.687],[0.412,0.047,0.050,0.047,0.048,0.048],[0.331,0.081,0.081,0.079,0.084,0.079],[0.211,0.068,0.072,0.067,0.067,0.068],[0.344,0.079,0.083,0.083,0.081,0.078],[0.153,0.049,0.048,0.066,0.059,0.048],[1.297,0.435,0.455,0.433,0.431,0.439],[0.050,0.024,0.023,0.705,0.021,0.023],[0.304,0.159,0.170,0.162,0.161,0.135],[0.652,0.238,0.214,0.230,0.260,0.204],[2.073,1.468,1.434,1.445,1.464,1.570],[2.692,1.370,1.501,1.505,1.593,1.524],[2.582,1.544,1.453,1.541,1.531,1.383],[0.247,0.171,0.143,0.170,0.177,0.184],[0.090,0.041,0.049,0.046,0.042,0.046],[0.041,0.025,0.026,0.027,0.026,0.027],[0.056,0.018,0.020,0.019,0.018,0.019],[0.157,0.094,0.083,0.092,0.095,0.084],[0.029,0.003,0.004,0.003,0.004,0.004],[0.019,0.004,0.004,0.003,0.004,0.003],[0.012,0.003,0.003,0.003,0.003,0.003],[0.397,0.039,0.044,0.062,0.040,0.039],[0.351,0.054,0.054,0.054,0.055,0.054],[0.111,0.038,0.036,0.054,0.032,0.033],[0.215,0.050,0.051,0.078,0.052,0.051],[0.066,0.018,0.018,0.018,0.018,0.018],[0.141,0.041,0.042,0.041,0.041,0.041],[0.159,0.060,0.070,0.061,0.062,0.063],[0.042,0.015,0.016,0.017,0.015,0.015],[0.086,0.026,0.024,0.033,0.025,0.024],[0.187,0.085,0.084,0.088,0.084,0.084],[0.378,0.115,0.116,0.117,0.114,0.115],[0.369,0.240,0.238,0.228,0.229,0.238],[0.125,0.027,0.028,0.028,0.029,0.027],[0.557,0.258,0.259,0.270,0.252,0.254],[1.637,1.265,1.248,1.242,1.262,1.287],[8.547,0.970,0.981,1.031,0.976,0.997],[1.873,0.906,0.929,0.913,0.921,0.927],[12.825,2.265,2.258,2.289,2.292,2.263],[5.045,2.371,2.383,2.369,2.387,2.389],[5.674,1.554,1.533,1.544,1.557,1.562],[3.231,3.006,3.004,3.022,3.000,3.010],[6.899,6.336,6.321,6.386,6.380,6.299],[4.050,2.381,2.403,2.436,2.404,2.405],[5.687,4.580,4.582,4.584,4.604,4.566],[5.045,3.607,3.623,3.653,3.612,3.639],[null,null,null,null,null,null],[3.473,2.244,2.229,2.277,2.278,2.265],[47.345,46.713,46.639,46.134,46.328,45.417],[8.573,null,null,null,null,null],[3.480,52.580,52.684,52.603,53.237,52.960],[3.473,33.092,33.092,33.653,33.659,33.735],[95.079,95.127,96.914,94.639,94.815,95.285],[10.865,10.177,10.222,10.178,10.132,10.136],[null,null,null,null,null,null],[28.064,29.895,29.696,29.663,29.629,29.704],[2.675,0.604,0.600,0.406,0.369,0.369],[1.371,0.896,0.882,0.906,0.869,0.866],[2.382,1.804,1.756,1.917,1.844,1.881],[1.017,0.546,0.545,0.523,0.548,0.524],[null,null,null,null,null,null],[0.194,0.060,0.059,0.096,0.058,0.060],[9.186,8.862,8.854,8.876,8.829,7.205],[4.717,3.738,3.926,3.947,3.725,3.808],[6.932,5.823,5.657,5.759,5.884,5.850],[2.293,1.597,1.469,1.670,1.670,1.639],[0.435,0.095,0.097,0.090,0.095,0.094],[1.365,0.300,0.293,0.340,0.332,0.309],[1.845,1.163,0.968,0.955,0.950,0.958],[0.171,0.090,0.084,0.092,0.082,0.084],[0.198,0.099,0.101,0.114,0.101,0.104],[0.340,0.177,0.180,0.212,0.177,0.177],[6.943,6.571,6.402,6.277,6.306,6.413],[2.294,1.241,1.238,1.248,1.199,1.211],[4.103,0.809,0.829,0.805,0.801,0.816],[0.498,0.130,0.125,0.128,0.128,0.134],[null,6.860,6.464,6.766,6.776,6.652],[0.701,0.227,0.227,0.237,0.225,0.226],[0.200,0.101,0.114,0.101,0.098,0.105],[0.834,0.600,0.530,0.531,0.538,0.532],[1.664,1.289,1.267,1.286,1.319,1.291],[17.906,26.206,26.269,26.512,26.668,26.645],[null,null,null,null,null,null],[0.467,0.612,0.561,0.371,0.378,0.357],[1.228,8.081,7.918,8.175,8.097,7.760],[3.267,17.563,17.878,17.955,17.723,17.516],[1.181,0.821,0.814,0.797,0.795,0.792],[0.728,0.212,0.208,0.215,0.208,0.207],[6.058,5.564,5.566,5.658,5.574,5.628],[0.199,0.052,0.051,0.057,0.050,0.050],[54.718,53.816,54.374,55.435,55.378,55.465],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.630,0.331,0.334,0.328,0.332,0.334],[0.952,1.829,1.745,1.706,1.695,1.729],[1.369,5.012,4.967,4.853,4.840,4.951],[1.077,0.610,2.033,2.001,1.997,1.942],[1.603,1.860,1.610,1.563,1.559,1.777],[0.221,0.059,0.064,0.059,0.065,0.062],[0.138,0.501,0.614,0.492,0.495,0.554],[0.203,0.759,0.822,0.851,0.957,0.787],[12.818,23.524,23.523,23.427,23.826,23.458],[24.209,23.794,23.468,23.747,22.703,24.083],[1.546,2.991,2.967,3.002,2.762,3.003],[3.279,2.861,3.024,3.025,2.959,2.982],[1.441,0.803,0.822,0.824,0.803,0.831],[4.231,3.914,3.958,3.860,3.866,3.938],[1.248,6.038,5.982,6.100,5.778,5.846],[1.233,0.750,0.762,0.728,0.718,0.724],[1.714,1.150,1.197,1.223,1.287,1.307],[0.282,0.215,0.218,0.214,0.196,0.193],[1.203,2.256,2.218,2.274,2.261,2.233],[0.246,0.079,0.078,0.080,0.077,0.080],[0.998,0.307,0.278,0.320,0.268,0.280],[0.970,2.853,2.652,2.851,2.847,2.818],[0.852,0.359,0.354,0.380,0.353,0.352],[0.790,4.068,4.028,3.955,4.097,4.082],[0.233,0.167,0.046,0.042,0.044,0.043],[4.896,4.569,4.594,4.647,4.686,4.676],[0.198,1.313,0.920,1.163,1.197,1.004],[1.362,1.246,1.356,1.212,1.240,1.168],[1.224,1.170,1.080,1.151,1.256,1.173],[0.033,0.015,0.015,0.016,0.015,0.015],[0.821,0.098,0.143,0.101,0.085,0.085],[2.097,3.135,3.056,3.185,3.178,3.097],[0.023,0.028,0.029,0.016,0.027,0.016],[0.250,0.119,0.145,0.137,0.115,0.143],[1.685,4.513,4.449,4.313,4.535,4.470],[2.012,49.233,49.548,49.682,50.498,50.189],[16.612,15.755,15.887,15.942,15.887,16.718],[null,null,null,null,null,null],[3.490,0.425,0.426,0.383,0.356,0.390],[2.130,1.617,1.671,1.629,1.693,1.651],[0.378,0.150,0.120,0.084,0.126,0.131],[0.765,0.314,0.285,0.279,0.273,0.289],[1.601,1.110,1.085,1.044,1.091,1.069],[0.754,0.083,0.140,0.118,0.114,0.083],[1.006,0.232,0.244,0.271,0.268,0.262],[14.370,14.251,14.097,14.210,14.037,13.987],[0.711,0.232,0.207,0.226,0.169,0.192],[1.405,1.031,1.039,1.033,1.032,1.015],[0.974,0.302,0.266,0.241,0.262,0.257],[1.269,0.920,0.880,0.960,0.914,0.901],[10.189,10.151,10.287,10.352,10.366,9.756],[0.731,0.464,0.453,0.299,0.292,0.284],[5.214,null,null,null,null,null],[0.913,0.500,0.455,0.481,0.454,0.474],[1.001,1.430,1.336,1.357,1.419,1.425],[13.439,27.460,27.343,27.861,27.967,27.713],[2.318,3.460,3.333,3.382,3.409,3.401],[0.692,0.212,0.209,0.213,0.209,0.213],[4.016,9.319,9.491,9.618,9.319,9.604],[0.989,0.201,0.196,0.194,0.193,0.196],[null,null,null,null,null,null],[1.015,2.074,1.943,2.048,1.864,1.880],[4.809,4.258,4.382,4.359,4.238,4.326],[null,null,null,null,null,null],[0.009,0.008,0.010,0.027,0.010,0.011],[1.603,0.373,0.402,0.377,0.323,0.325],[0.024,0.039,0.021,0.034,0.020,0.022],[1.653,6.757,6.819,6.777,6.930,6.685],[3.020,1.269,1.208,1.266,1.246,1.211],[0.222,0.327,0.335,0.339,0.360,0.370],[0.354,0.055,0.054,0.054,0.053,0.055],[0.137,0.068,0.048,0.081,0.048,0.049],[0.201,0.031,0.028,0.027,0.026,0.030],[5.406,5.229,5.214,5.267,5.272,4.869],[0.344,0.309,0.292,0.307,0.313,0.292],[4.899,4.635,4.725,4.631,4.678,4.703],[1.921,10.314,10.168,10.206,10.141,10.167],[0.732,0.370,0.332,0.336,0.324,0.358],[0.205,0.063,0.074,0.062,0.056,0.060],[0.122,0.156,0.136,0.150,0.165,0.144],[0.150,0.118,0.112,0.105,0.111,0.104],[1.372,0.672,0.698,0.699,0.685,0.697],[0.484,0.415,0.398,0.326,0.242,0.357],[5.352,5.429,5.523,5.442,5.449,5.460],[0.534,1.017,1.053,1.020,1.031,1.023],[1.317,0.766,0.738,0.767,0.762,0.806],[0.516,0.127,0.121,0.126,0.123,0.142],[17.621,17.786,17.635,17.726,17.503,17.722],[0.144,0.027,0.028,0.042,0.025,0.026],[0.273,0.125,0.104,0.103,0.112,0.105],[0.092,0.023,0.023,0.021,0.021,0.022],[0.203,0.158,0.159,0.137,0.155,0.117],[0.142,0.054,0.051,0.052,0.047,0.050],[0.109,0.042,0.043,0.049,0.052,0.051],[0.110,0.038,0.042,0.040,0.032,0.034],[0.197,0.120,0.108,0.109,0.114,0.089],[0.553,0.061,0.066,0.058,0.062,0.058],[0.547,0.055,0.054,0.051,0.053,0.051],[0.564,0.080,0.072,0.067,0.070,0.070],[0.148,0.098,0.097,0.109,0.092,0.101],[0.129,0.048,0.046,0.043,0.041,0.042],[0.184,0.272,0.249,0.243,0.264,0.231],[0.527,0.024,0.023,0.022,0.022,0.023],[0.610,0.025,0.025,0.026,0.025,0.025],[0.555,0.035,0.033,0.032,0.033,0.032],[0.228,0.029,0.027,0.027,0.028,0.028],[0.190,0.026,0.026,0.026,0.027,0.026],[0.159,0.026,0.024,0.024,0.023,0.026],[0.176,0.031,0.031,0.030,0.031,0.031],[0.169,0.028,0.029,0.028,0.028,0.028],[0.269,0.140,0.143,0.153,0.128,0.130],[0.475,0.245,0.216,0.227,0.220,0.217],[0.341,0.185,0.199,0.189,0.189,0.184],[0.836,0.371,0.320,0.329,0.338,0.301],[0.258,0.043,0.041,0.039,0.039,0.040],[0.227,0.039,0.039,0.037,0.038,0.039],[0.367,1.002,0.972,0.983,0.849,0.926],[0.289,0.123,0.121,0.121,0.130,0.121],[0.395,0.108,0.112,0.117,0.111,0.117],[0.361,0.058,0.062,0.060,0.057,0.058],[0.318,0.060,0.060,0.061,0.059,0.058],[0.325,0.197,0.188,0.175,0.172,0.176],[0.252,0.051,0.049,0.050,0.056,0.051],[0.195,0.025,0.024,0.025,0.027,0.025],[0.253,0.439,0.441,0.425,0.405,0.353],[0.006,0.006,0.006,0.005,0.006,0.005],[0.005,0.005,0.005,0.005,0.006,0.006],[0.230,0.118,0.086,0.081,0.090,0.088],[0.339,0.235,0.239,0.241,0.237,0.265],[0.600,0.106,0.109,0.106,0.112,0.103],[0.610,0.177,0.163,0.169,0.160,0.164],[0.626,0.140,0.140,0.138,0.124,0.134],[0.649,0.606,0.626,0.418,0.597,0.651],[0.657,0.584,0.595,0.596,0.593,0.590],[0.618,0.597,0.601,0.596,0.585,0.569],[0.716,0.671,0.589,0.631,0.676,0.645],[0.661,0.126,0.161,0.156,0.160,0.150],[0.242,0.124,0.079,0.070,0.126,0.130],[0.598,0.102,0.087,0.137,0.138,0.131],[0.368,0.041,0.042,0.042,0.041,0.044],[0.213,0.042,0.043,0.040,0.040,0.040],[0.396,0.091,0.085,0.088,0.083,0.088],[0.221,0.040,0.039,0.041,0.040,0.040],[0.371,0.049,0.048,0.047,0.046,0.046],[0.431,0.314,0.310,0.326,0.288,0.313],[1.367,0.321,0.307,0.276,0.289,0.305],[0.536,0.077,0.071,0.073,0.077,0.072],[0.397,0.188,0.190,0.181,0.178,0.173],[0.275,0.313,0.313,0.306,0.289,0.284],[0.257,0.316,0.259,0.279,0.300,0.294],[0.281,0.289,0.305,0.315,0.298,0.300],[0.300,0.184,0.176,0.203,0.201,0.187],[0.437,0.314,0.322,0.300,0.304,0.281],[1.087,0.155,0.168,0.177,0.149,0.154],[0.007,0.006,0.006,0.007,0.006,0.006],[0.663,0.150,0.113,0.115,0.089,0.127],[0.794,0.142,0.147,0.125,0.156,0.144],[0.743,0.097,0.090,0.093,0.097,0.092],[0.390,0.154,0.152,0.153,0.138,0.155],[0.485,0.795,0.781,0.702,0.768,0.775],[0.355,0.429,0.718,0.695,0.709,0.693],[0.291,0.568,0.579,0.565,0.531,0.563],[0.402,0.125,0.140,0.127,0.126,0.127],[0.007,0.006,0.006,0.008,0.006,0.006],[0.007,0.007,0.007,0.007,0.006,0.006],[0.007,0.006,0.006,0.006,0.006,0.006],[0.717,0.122,0.209,0.203,0.204,0.207],[0.316,0.226,0.231,0.218,0.208,0.152],[0.681,0.097,0.240,0.234,0.233,0.234],[0.385,0.274,0.178,0.269,0.257,0.251],[0.402,0.103,0.101,0.103,0.104,0.102],[0.367,0.086,0.132,0.135,0.153,0.134],[0.243,0.105,0.102,0.101,0.105,0.102],[0.843,0.217,0.194,0.208,0.199,0.187],[0.449,0.191,0.189,0.179,0.176,0.179],[0.697,0.125,0.118,0.128,0.124,0.114],[0.240,0.069,0.069,0.069,0.072,0.087],[0.733,0.249,0.239,0.273,0.223,0.245],[0.954,0.627,0.630,0.624,0.638,0.619],[0.866,0.615,0.634,0.618,0.621,0.629],[0.845,0.628,0.620,0.618,0.619,0.619],[0.007,0.007,0.006,0.007,0.007,0.007],[0.007,0.007,0.007,0.007,0.006,0.006],[0.007,0.006,0.006,0.007,0.006,0.007],[0.736,0.112,0.246,0.237,0.247,0.248],[0.637,0.094,0.094,0.091,0.091,0.091],[0.391,0.238,0.236,0.233,0.236,0.227],[0.904,0.158,0.156,0.144,0.157,0.160],[0.782,0.133,0.127,0.130,0.134,0.129],[0.537,0.233,0.206,0.203,0.204,0.197],[0.713,0.309,0.294,0.308,0.337,0.251],[0.266,0.331,0.347,0.320,0.275,0.331],[0.940,0.351,0.330,0.359,0.331,0.359],[0.753,0.344,0.335,0.336,0.278,0.319],[0.298,0.340,0.316,0.295,0.318,0.335],[1.002,0.392,0.355,0.367,0.338,0.380],[0.165,0.028,0.028,0.027,0.033,0.028],[0.162,0.032,0.031,0.033,0.035,0.034],[0.254,0.146,0.128,0.131,0.123,0.122],[0.215,0.107,0.106,0.109,0.110,0.093],[0.251,0.205,0.254,0.256,0.240,0.232]],"version":"25.12.11.4","source":"results/25.12.11.4.json"} +,{"actual_version":"26.4.3.37","data_size":{"coffeeshop":49998728322,"hits":15031434959,"job":1906776471,"mgbench":3227217238,"ontime":3440144847,"ssb":88402811567,"taxi":24367083400,"tpcds":18837265521,"tpch":18515286063,"uk":1002235637},"kind":"versions-benchmark","load_time":{"coffeeshop":766,"hits":240,"job":21,"mgbench":63,"ontime":61,"ssb":1532,"taxi":492,"tpcds":298,"tpch":294,"uk":31},"machine":"c7a.4xlarge","release_date":"2026-05-05","result":[[0.075,0.007,0.007,0.305,0.007,0.007],[0.038,0.004,0.004,0.005,0.004,0.005],[0.045,0.007,0.019,0.029,0.007,0.007],[0.035,0.010,0.009,0.011,0.008,0.009],[0.050,0.028,0.019,0.047,0.020,0.023],[0.062,0.016,0.016,0.034,0.016,0.015],[0.023,0.004,0.004,0.004,0.004,0.004],[0.044,0.005,0.005,0.005,0.004,0.004],[0.063,0.005,0.004,0.056,0.005,0.005],[0.085,0.051,0.046,0.048,0.047,0.048],[0.312,0.246,0.249,0.244,0.243,0.239],[0.337,0.204,0.217,0.229,0.200,0.204],[0.031,0.004,0.004,0.004,0.004,0.004],[0.025,0.010,0.012,0.011,0.010,0.011],[0.477,0.348,0.344,0.357,0.318,0.319],[0.251,0.062,0.064,0.062,0.064,0.062],[0.044,0.013,0.014,0.013,0.014,0.014],[0.039,0.014,0.014,0.014,0.014,0.013],[8.393,1.023,1.016,1.033,1.012,1.013],[6.484,0.882,0.882,0.890,0.879,0.916],[6.606,0.825,0.839,0.909,0.930,0.852],[8.896,1.521,1.518,1.498,1.501,1.441],[8.039,1.201,1.199,1.210,1.190,1.430],[3.913,0.482,0.471,0.464,0.458,0.457],[0.062,0.019,0.019,0.019,0.019,0.018],[10.133,1.603,1.604,1.642,1.606,1.612],[2.552,0.504,0.498,0.499,0.498,0.497],[2.364,0.373,0.367,0.371,0.368,0.371],[0.002,0.002,0.002,0.002,0.001,0.001],[0.023,0.006,0.006,0.006,0.006,0.006],[0.046,0.014,0.013,0.035,0.014,0.014],[0.107,0.019,0.018,0.019,0.019,0.020],[0.132,0.047,0.046,0.050,0.046,0.045],[0.244,0.105,0.105,0.104,0.106,0.106],[0.003,0.003,0.002,0.021,0.003,0.003],[0.018,0.007,0.007,0.007,0.008,0.008],[0.341,0.217,0.216,0.218,0.218,0.218],[0.382,0.253,0.252,0.252,0.251,0.252],[0.182,0.058,0.058,0.057,0.055,0.057],[0.157,0.064,0.063,0.063,0.064,0.066],[0.439,0.252,0.245,0.242,0.248,0.247],[0.591,0.352,0.355,0.348,0.343,0.352],[0.485,0.314,0.295,0.285,0.285,0.263],[0.296,0.172,0.172,0.172,0.174,0.176],[1.036,0.718,0.706,0.700,0.701,0.709],[0.668,0.467,0.447,0.450,0.467,0.445],[2.332,1.526,1.317,1.316,1.497,1.336],[0.074,0.002,0.002,0.002,0.002,0.002],[1.570,0.019,0.021,0.022,0.021,0.025],[1.599,0.007,0.007,0.020,0.007,0.008],[4.369,0.749,0.750,0.751,0.744,0.758],[0.424,0.046,0.042,0.045,0.047,0.046],[0.329,0.080,0.082,0.082,0.082,0.082],[0.213,0.070,0.073,0.071,0.072,0.071],[0.322,0.087,0.084,0.085,0.082,0.083],[0.150,0.050,0.050,0.070,0.050,0.052],[1.282,0.451,0.455,0.449,0.448,0.452],[0.055,0.022,0.023,0.716,0.021,0.021],[0.291,0.168,0.157,0.166,0.148,0.154],[0.616,0.207,0.251,0.237,0.207,0.232],[2.046,1.447,1.531,1.507,1.498,1.451],[2.582,1.599,1.531,1.355,1.723,1.584],[2.655,1.530,1.353,1.511,1.430,1.670],[0.244,0.156,0.184,0.138,0.168,0.159],[0.099,0.055,0.053,0.058,0.045,0.052],[0.039,0.027,0.027,0.026,0.026,0.023],[0.059,0.022,0.019,0.020,0.022,0.019],[0.157,0.098,0.087,0.112,0.093,0.089],[0.020,0.004,0.004,0.004,0.004,0.004],[0.017,0.004,0.004,0.004,0.005,0.004],[0.014,0.004,0.004,0.006,0.004,0.004],[0.399,0.041,0.042,0.063,0.039,0.039],[0.357,0.072,0.078,0.075,0.058,0.054],[0.110,0.035,0.035,0.056,0.034,0.034],[0.212,0.051,0.051,0.074,0.050,0.051],[0.068,0.021,0.021,0.021,0.020,0.020],[0.144,0.049,0.048,0.051,0.049,0.050],[0.162,0.067,0.068,0.068,0.067,0.067],[0.044,0.020,0.020,0.020,0.020,0.020],[0.092,0.034,0.031,0.038,0.031,0.032],[0.197,0.097,0.099,0.096,0.097,0.096],[0.388,0.125,0.127,0.126,0.127,0.127],[0.464,0.327,0.317,0.322,0.318,0.315],[0.122,0.030,0.030,0.029,0.030,0.029],[0.541,0.247,0.247,0.276,0.236,0.240],[1.764,1.281,1.264,1.267,1.274,1.272],[8.551,0.997,0.989,1.006,0.995,0.996],[1.902,0.947,0.964,0.961,0.957,0.970],[13.354,2.338,2.329,2.375,2.307,2.265],[5.040,2.416,2.348,2.320,2.330,2.327],[5.680,1.566,1.571,1.563,1.596,1.579],[3.165,3.175,2.993,3.002,2.978,2.947],[6.879,6.059,6.122,6.070,6.032,6.032],[4.056,2.341,2.340,2.367,2.367,2.334],[5.682,4.359,4.409,4.386,4.410,4.425],[5.036,3.676,3.630,3.670,3.612,3.579],[8.572,6.326,6.487,6.409,6.434,6.370],[3.496,2.344,2.336,2.366,2.377,2.326],[43.059,40.713,40.244,40.480,41.118,40.499],[8.553,4.594,4.644,4.624,4.631,4.593],[3.483,2.240,2.242,2.250,2.251,2.280],[3.478,1.552,1.504,1.512,1.504,1.514],[3.496,3.091,3.022,3.012,3.127,3.104],[10.462,9.720,9.710,9.611,9.606,9.549],[36.247,35.594,34.689,34.541,34.163,34.221],[26.438,22.625,24.135,24.102,24.178,24.222],[2.635,0.545,0.534,0.480,0.443,0.440],[19.766,10.354,10.366,10.330,10.381,10.299],[1.174,0.569,0.575,0.569,0.562,0.571],[0.911,0.555,0.555,0.551,0.542,0.536],[null,null,null,null,null,null],[2.132,0.338,0.056,0.071,0.062,0.054],[2.667,1.643,1.362,1.783,1.440,1.661],[4.944,null,null,null,null,null],[39.758,36.921,37.458,37.411,37.424,37.276],[1.925,0.874,0.869,0.861,0.856,0.843],[0.462,0.126,0.122,0.121,0.126,0.121],[2.185,0.300,0.320,0.319,0.301,0.300],[1.617,0.765,0.757,0.752,0.762,0.752],[0.223,0.088,0.088,0.114,0.089,0.086],[0.285,0.106,0.106,0.121,0.105,0.106],[0.406,0.197,0.190,0.197,0.191,0.189],[3.515,0.595,0.612,0.610,0.592,0.592],[4.538,1.426,1.341,1.297,1.354,1.451],[3.842,0.534,0.530,0.559,0.548,0.530],[0.565,0.199,0.203,0.199,0.199,0.197],[4.468,2.643,2.625,2.480,2.568,2.554],[0.619,0.348,0.329,0.291,0.345,0.357],[0.274,0.098,0.094,0.115,0.100,0.095],[0.470,0.272,0.233,0.233,0.230,0.227],[0.104,0.026,0.026,0.026,0.025,0.025],[4.534,3.273,3.227,2.860,3.209,3.269],[null,null,null,null,null,null],[0.460,0.167,0.141,0.151,0.137,0.135],[1.179,0.322,0.315,0.340,0.317,0.317],[0.538,0.165,0.165,0.167,0.164,0.164],[1.414,0.916,0.937,0.976,0.921,0.931],[0.927,0.219,0.210,0.209,0.216,0.211],[1.989,1.309,1.293,1.280,1.328,1.283],[0.157,0.056,0.053,0.064,0.056,0.054],[2.313,0.444,0.395,0.426,0.359,0.355],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.326,0.090,0.094,0.101,0.089,0.094],[0.876,0.254,0.257,0.267,0.263,0.254],[1.489,0.508,0.466,0.485,0.481,0.482],[0.978,0.325,0.305,0.311,0.296,0.300],[0.398,0.080,0.080,0.075,0.079,0.079],[0.241,0.085,0.091,0.085,0.087,0.088],[0.068,0.034,0.036,0.064,0.031,0.035],[0.214,0.212,0.184,0.171,0.176,0.173],[5.114,3.978,4.024,4.050,4.043,4.015],[5.125,4.233,4.192,4.157,3.947,4.261],[2.733,1.902,2.112,1.917,2.109,1.924],[2.747,1.939,2.153,1.899,1.855,1.964],[1.651,0.514,0.393,0.547,0.487,0.515],[0.665,0.142,0.154,0.150,0.149,0.140],[1.175,0.341,0.341,0.341,0.332,0.329],[1.203,0.774,0.762,0.771,0.776,0.778],[2.057,0.791,0.907,0.836,0.830,0.842],[0.292,0.136,0.118,0.134,0.106,0.123],[1.286,0.693,0.696,0.704,0.716,0.688],[0.221,0.070,0.073,0.071,0.070,0.069],[0.905,0.284,0.282,0.280,0.278,0.283],[0.915,0.282,0.255,0.280,0.274,0.256],[0.833,0.316,0.305,0.332,0.308,0.313],[0.761,0.288,0.268,0.279,0.265,0.262],[0.269,0.155,0.141,0.139,0.139,0.130],[5.385,4.070,4.041,4.066,4.017,4.048],[0.133,0.125,0.094,0.100,0.096,0.102],[0.122,0.104,0.095,0.112,0.100,0.115],[0.304,0.071,0.070,0.085,0.068,0.069],[0.031,0.016,0.015,0.015,0.016,0.016],[0.214,0.042,0.043,0.042,0.047,0.041],[1.342,0.978,0.934,0.944,0.945,0.928],[0.025,0.025,0.020,0.021,0.023,0.021],[0.216,0.091,0.095,0.082,0.090,0.090],[1.682,0.432,0.427,0.426,0.432,0.435],[2.065,1.684,1.688,1.709,1.669,1.674],[1.429,0.294,0.298,0.344,0.296,0.298],[null,null,null,null,null,null],[3.806,0.374,0.398,0.442,0.360,0.352],[1.463,0.942,0.960,0.951,0.898,0.963],[0.209,0.042,0.043,0.043,0.044,0.042],[0.582,0.248,0.240,0.243,0.238,0.237],[0.778,0.233,0.234,0.244,0.230,0.231],[0.213,0.052,0.044,0.048,0.048,0.045],[0.668,0.141,0.141,0.140,0.138,0.136],[0.775,0.566,0.573,0.590,0.576,0.568],[0.704,0.213,0.199,0.238,0.203,0.208],[0.773,0.437,0.438,0.436,0.442,0.438],[0.830,0.217,0.218,0.225,0.222,0.217],[0.829,0.713,0.614,0.634,0.635,0.645],[0.249,0.100,0.097,0.095,0.095,0.097],[0.586,0.237,0.232,0.231,0.229,0.231],[0.708,0.403,0.304,0.307,0.305,0.305],[0.854,0.383,0.436,0.432,0.438,0.440],[0.921,0.253,0.223,0.259,0.223,0.220],[12.217,11.678,11.971,11.959,12.056,11.825],[2.343,0.423,0.422,0.446,0.418,0.418],[0.806,0.294,0.285,0.279,0.278,0.284],[0.736,0.389,0.375,0.374,0.383,0.375],[0.844,0.223,0.224,0.223,0.224,0.223],[1.665,0.989,1.061,0.928,1.033,1.123],[0.860,0.270,0.259,0.279,0.259,0.272],[1.688,1.097,1.089,1.097,1.095,1.082],[null,null,null,null,null,null],[0.010,0.014,0.010,0.010,0.010,0.010],[1.449,0.283,0.318,0.287,0.274,0.275],[0.039,0.053,0.033,0.048,0.030,0.032],[1.676,0.402,0.403,0.398,0.403,0.399],[1.941,0.272,0.271,0.267,0.272,0.271],[0.325,0.208,0.213,0.211,0.209,0.219],[0.370,0.223,0.224,0.214,0.211,0.202],[0.160,0.065,0.064,0.096,0.065,0.066],[0.205,0.043,0.045,0.043,0.042,0.043],[0.467,0.162,0.162,0.204,0.150,0.162],[0.161,0.074,0.071,0.075,0.074,0.078],[4.268,4.051,4.070,4.067,4.062,4.063],[1.393,0.957,0.950,0.946,0.932,0.929],[0.585,0.242,0.246,0.244,0.240,0.236],[0.198,0.060,0.059,0.061,0.061,0.057],[0.134,0.170,0.159,0.153,0.159,0.129],[0.160,0.073,0.075,0.074,0.073,0.072],[2.867,2.297,2.293,2.283,2.248,2.287],[0.423,0.122,0.119,0.126,0.123,0.118],[5.659,5.305,5.395,5.330,5.301,5.352],[0.470,0.112,0.113,0.113,0.114,0.116],[1.121,0.568,0.569,0.569,0.574,0.581],[0.410,0.152,0.157,0.156,0.163,0.153],[0.449,0.161,0.185,0.165,0.162,0.165],[0.122,0.031,0.032,0.048,0.033,0.031],[0.417,0.021,0.017,0.017,0.019,0.017],[0.100,0.021,0.022,0.020,0.021,0.021],[0.067,0.018,0.020,0.018,0.018,0.018],[0.186,0.085,0.086,0.075,0.078,0.081],[0.142,0.063,0.062,0.067,0.067,0.062],[0.080,0.039,0.035,0.034,0.037,0.036],[0.229,0.149,0.142,0.125,0.124,0.113],[0.549,0.280,0.282,0.280,0.260,0.216],[0.548,0.169,0.137,0.156,0.156,0.158],[0.795,0.561,0.457,0.442,0.512,0.528],[0.209,0.039,0.032,0.033,0.032,0.034],[0.144,0.045,0.045,0.043,0.045,0.044],[0.137,0.048,0.050,0.054,0.049,0.048],[0.525,0.120,0.121,0.120,0.118,0.118],[0.535,0.167,0.015,0.016,0.015,0.015],[0.552,0.110,0.119,0.115,0.109,0.111],[0.176,0.030,0.030,0.030,0.032,0.031],[0.127,0.030,0.030,0.029,0.030,0.028],[0.115,0.031,0.028,0.030,0.028,0.032],[0.154,0.033,0.032,0.035,0.035,0.035],[0.134,0.035,0.037,0.036,0.037,0.035],[7.112,6.826,6.838,6.881,6.775,6.924],[1.570,1.074,1.039,1.051,1.081,1.098],[1.246,1.095,1.135,1.082,1.093,1.083],[3.939,0.265,0.147,0.146,0.168,0.157],[0.259,0.086,0.050,0.053,0.052,0.052],[0.200,0.102,0.052,0.050,0.049,0.049],[0.612,0.920,0.869,0.775,0.878,0.923],[0.488,0.402,0.324,0.321,0.391,0.378],[0.336,0.176,0.145,0.121,0.130,0.119],[0.310,0.153,0.099,0.098,0.089,0.093],[0.417,0.082,0.074,0.075,0.074,0.074],[0.382,0.178,0.172,0.168,0.170,0.165],[0.302,0.194,0.185,0.182,0.186,0.185],[0.165,0.111,0.030,0.030,0.029,0.028],[0.435,0.623,0.634,0.608,0.549,0.609],[0.006,0.006,0.006,0.005,0.006,0.006],[0.006,0.006,0.005,0.006,0.006,0.006],[0.213,0.080,0.073,0.083,0.075,0.069],[0.164,0.076,0.073,0.073,0.073,0.074],[0.577,0.126,0.308,0.294,0.284,0.316],[0.160,0.288,0.274,0.295,0.287,0.273],[0.652,0.152,0.317,0.301,0.316,0.315],[0.504,0.277,0.179,0.182,0.220,0.193],[0.319,0.237,0.228,0.239,0.223,0.195],[0.326,0.238,0.223,0.244,0.198,0.204],[0.390,0.227,0.247,0.259,0.262,0.243],[0.577,0.363,0.152,0.143,0.148,0.140],[0.562,0.140,0.122,0.118,0.119,0.120],[0.584,0.358,0.290,0.282,0.287,0.276],[0.393,0.075,0.072,0.072,0.076,0.075],[0.341,0.081,0.065,0.063,0.065,0.065],[0.389,1.947,1.836,1.732,1.859,1.798],[0.250,0.279,0.271,0.262,0.188,0.210],[0.435,0.617,0.546,0.520,0.510,0.532],[1.559,1.362,1.330,1.267,1.326,1.318],[0.589,1.434,1.454,1.394,1.418,1.425],[0.525,0.112,0.103,0.106,0.111,0.103],[0.372,0.240,0.234,0.234,0.211,0.243],[0.544,0.173,0.128,0.115,0.110,0.123],[0.201,1.469,1.334,1.420,1.489,1.455],[0.279,0.222,0.204,0.201,0.186,0.184],[0.631,0.485,0.457,0.417,0.399,0.414],[0.545,0.196,0.175,0.173,0.186,0.198],[0.243,0.251,0.254,0.277,0.252,0.254],[0.007,0.006,0.007,0.006,0.006,0.006],[0.648,0.187,0.187,0.196,0.178,0.186],[0.736,0.260,0.196,0.204,0.202,0.209],[0.669,0.249,0.181,0.171,0.193,0.175],[0.764,0.258,0.224,0.228,0.216,0.218],[0.723,0.184,0.191,0.161,0.192,0.162],[0.280,0.130,0.051,0.046,0.049,0.045],[0.230,0.051,0.046,0.042,0.043,0.043],[0.400,4.964,4.578,4.966,4.761,4.771],[0.006,0.006,0.006,0.007,0.006,0.007],[0.007,0.007,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.753,0.234,0.346,0.304,0.210,0.210],[0.705,0.217,0.213,0.209,0.207,0.212],[0.706,0.304,0.293,0.288,0.294,0.306],[0.893,0.420,0.410,0.433,0.421,0.383],[0.564,0.163,0.287,0.293,0.312,0.288],[0.385,0.135,0.143,0.157,0.164,0.152],[0.566,0.411,0.382,0.411,0.437,0.404],[0.734,0.202,0.195,0.206,0.214,0.204],[0.677,0.167,0.171,0.180,0.163,0.168],[0.741,0.177,0.171,0.178,0.176,0.178],[0.727,0.180,0.169,0.169,0.170,0.167],[0.720,0.275,0.266,0.264,0.266,0.295],[0.439,1.224,1.106,1.131,1.046,1.151],[0.369,0.152,0.132,0.151,0.155,0.140],[3.519,3.150,2.933,3.391,3.167,2.896],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.007,0.006],[0.791,0.279,0.707,0.394,0.191,0.188],[0.655,0.203,0.183,0.181,0.185,0.179],[0.734,0.236,0.240,0.238,0.241,0.236],[0.810,0.199,0.205,0.209,0.230,0.194],[0.789,0.188,0.185,0.187,0.183,0.184],[0.757,0.205,0.206,0.217,0.204,0.204],[0.788,0.285,0.236,0.250,0.222,0.223],[0.864,0.211,0.203,0.211,0.196,0.203],[0.867,0.363,0.351,0.361,0.347,0.339],[0.819,0.295,0.307,0.272,0.278,0.284],[0.726,0.239,0.212,0.192,0.193,0.205],[0.949,0.396,0.376,0.380,0.364,0.395],[0.131,0.047,0.047,0.046,0.049,0.053],[0.114,0.050,0.049,0.051,0.050,0.051],[0.209,0.313,0.295,0.270,0.272,0.281],[0.262,0.188,0.212,0.195,0.171,0.210],[0.427,0.445,0.372,0.367,0.305,0.349]],"version":"26.4.3.37","source":"results/26.4.3.37.json"} +,{"actual_version":"26.1.12.23","data_size":{"coffeeshop":49925643328,"hits":14988088184,"job":1905031892,"mgbench":3186290647,"ontime":3440107771,"ssb":86987518012,"taxi":24334532762,"tpcds":18791106824,"tpch":17931430289,"uk":1002191183},"kind":"versions-benchmark","load_time":{"coffeeshop":790,"hits":294,"job":26,"mgbench":60,"ontime":56,"ssb":1456,"taxi":493,"tpcds":338,"tpch":283,"uk":34},"machine":"c7a.4xlarge","release_date":"2026-05-11","result":[[0.087,0.007,0.007,0.324,0.006,0.007],[0.022,0.004,0.003,0.003,0.003,0.003],[0.048,0.017,0.008,0.032,0.008,0.008],[0.034,0.009,0.008,0.008,0.008,0.008],[0.050,0.021,0.016,0.043,0.020,0.015],[0.065,0.020,0.014,0.038,0.014,0.014],[0.024,0.004,0.004,0.005,0.004,0.004],[0.051,0.004,0.005,0.004,0.004,0.004],[0.073,0.004,0.004,0.061,0.004,0.004],[0.094,0.054,0.046,0.048,0.049,0.053],[0.246,0.168,0.173,0.162,0.160,0.164],[0.349,0.209,0.215,0.224,0.193,0.205],[0.030,0.004,0.004,0.004,0.004,0.004],[0.028,0.009,0.009,0.009,0.009,0.008],[0.504,0.348,0.342,0.367,0.319,0.323],[0.545,0.057,0.058,0.060,0.056,0.056],[0.046,0.013,0.013,0.013,0.012,0.013],[0.042,0.013,0.013,0.026,0.013,0.013],[8.182,1.024,1.023,1.056,1.067,1.025],[6.449,0.853,0.840,0.844,0.847,0.833],[6.448,0.792,0.777,0.767,0.814,0.769],[8.740,1.512,1.514,1.507,1.507,1.530],[8.024,1.272,1.288,1.270,1.284,1.268],[3.869,0.496,0.452,0.446,0.444,0.446],[0.062,0.022,0.018,0.018,0.018,0.018],[10.135,1.746,1.745,1.750,1.752,1.736],[2.580,0.520,0.525,0.528,0.539,0.528],[2.390,0.387,0.394,0.385,0.384,0.383],[0.002,0.001,0.001,0.001,0.001,0.001],[0.032,0.006,0.006,0.006,0.006,0.006],[0.058,0.025,0.014,0.035,0.019,0.015],[0.131,0.019,0.019,0.019,0.019,0.019],[0.155,0.053,0.053,0.053,0.051,0.052],[0.267,0.101,0.099,0.101,0.100,0.103],[0.004,0.002,0.002,0.020,0.002,0.002],[0.023,0.007,0.007,0.007,0.007,0.007],[0.357,0.215,0.220,0.216,0.218,0.212],[0.411,0.249,0.251,0.272,0.250,0.251],[0.173,0.056,0.058,0.059,0.060,0.056],[0.189,0.065,0.064,0.067,0.070,0.063],[0.460,0.250,0.247,0.246,0.241,0.245],[0.623,0.344,0.338,0.341,0.348,0.347],[0.492,0.288,0.284,0.290,0.268,0.273],[0.335,0.174,0.172,0.177,0.175,0.172],[1.088,0.707,0.689,0.685,0.684,0.696],[0.700,0.440,0.440,0.452,0.438,0.434],[2.205,1.514,1.316,1.301,1.445,1.331],[0.138,0.002,0.002,0.002,0.002,0.002],[1.650,0.022,0.024,0.023,0.023,0.023],[1.971,0.009,0.007,0.021,0.007,0.007],[4.361,0.711,0.674,0.686,0.694,0.681],[0.506,0.051,0.052,0.052,0.053,0.050],[0.407,0.080,0.078,0.079,0.081,0.085],[0.240,0.066,0.066,0.066,0.066,0.073],[0.423,0.081,0.085,0.079,0.089,0.079],[0.174,0.051,0.048,0.068,0.051,0.049],[1.523,0.437,0.439,0.444,0.437,0.450],[0.060,0.021,0.021,0.700,0.020,0.020],[0.312,0.155,0.151,0.164,0.138,0.146],[0.729,0.241,0.246,0.206,0.242,0.248],[2.077,1.422,1.477,1.547,1.464,1.465],[2.785,1.611,1.547,1.345,1.559,1.498],[2.829,1.492,1.579,1.333,1.498,1.554],[0.257,0.171,0.158,0.177,0.148,0.163],[0.103,0.054,0.046,0.044,0.047,0.047],[0.041,0.027,0.029,0.025,0.028,0.024],[0.058,0.019,0.018,0.019,0.018,0.018],[0.171,0.094,0.089,0.104,0.096,0.089],[0.030,0.004,0.004,0.004,0.004,0.004],[0.022,0.003,0.004,0.004,0.004,0.004],[0.013,0.003,0.003,0.003,0.003,0.003],[0.424,0.040,0.041,0.062,0.039,0.041],[0.399,0.056,0.054,0.055,0.058,0.057],[0.117,0.035,0.035,0.051,0.034,0.033],[0.219,0.052,0.051,0.072,0.049,0.051],[0.068,0.017,0.018,0.019,0.019,0.019],[0.147,0.043,0.043,0.043,0.042,0.041],[0.175,0.062,0.063,0.062,0.060,0.064],[0.045,0.015,0.015,0.017,0.015,0.015],[0.088,0.026,0.023,0.032,0.023,0.024],[0.199,0.083,0.092,0.086,0.086,0.087],[0.446,0.114,0.114,0.116,0.113,0.128],[0.395,0.233,0.233,0.230,0.227,0.227],[0.142,0.026,0.029,0.026,0.031,0.027],[0.569,0.262,0.268,0.284,0.255,0.258],[1.629,1.229,1.264,1.237,1.246,1.236],[8.538,1.004,0.997,1.006,1.008,0.999],[2.111,0.908,0.907,0.907,0.928,0.909],[12.802,2.282,2.263,2.261,2.259,2.328],[5.030,2.355,2.343,2.363,2.343,2.343],[5.677,1.541,1.532,1.538,1.529,1.533],[3.267,2.990,3.009,3.009,2.998,2.990],[6.901,6.219,6.219,6.270,6.158,6.204],[4.027,2.366,2.355,2.371,2.355,2.377],[5.689,4.404,4.436,4.424,4.459,4.435],[5.018,3.580,3.595,3.586,3.584,3.554],[null,null,null,null,null,null],[3.472,2.209,2.207,2.250,2.239,2.203],[47.842,46.885,46.129,45.618,45.811,44.709],[8.554,null,null,null,null,null],[3.501,52.434,52.947,52.784,52.968,53.134],[3.475,33.268,33.506,33.793,33.349,33.398],[94.604,94.540,95.178,94.817,94.534,95.672],[10.903,10.044,10.070,10.104,9.951,9.940],[null,null,null,null,null,null],[28.079,29.915,29.489,29.735,29.715,29.799],[2.651,0.603,0.598,0.404,0.366,0.368],[1.394,0.872,0.887,0.812,0.873,0.861],[2.525,1.838,1.807,1.948,1.900,1.592],[1.138,0.536,0.547,0.529,0.531,0.552],[null,null,null,null,null,null],[0.218,0.061,0.058,0.102,0.059,0.058],[2.522,0.946,0.943,0.947,0.848,0.936],[4.826,3.823,3.813,3.999,3.727,3.842],[7.073,6.023,5.794,6.020,5.755,5.998],[2.384,1.729,1.658,1.409,1.618,1.342],[0.467,0.091,0.095,0.091,0.096,0.096],[1.582,0.295,0.295,0.321,0.296,0.295],[2.009,1.135,0.959,0.962,0.968,0.956],[0.178,0.094,0.086,0.090,0.088,0.085],[0.206,0.102,0.100,0.118,0.102,0.102],[0.377,0.184,0.173,0.175,0.175,0.184],[7.053,6.488,6.424,6.396,6.373,6.358],[2.585,1.281,1.216,1.174,1.183,1.210],[4.094,0.666,0.665,0.687,0.667,0.663],[0.612,0.129,0.127,0.130,0.128,0.129],[7.440,2.754,2.766,2.671,2.696,2.673],[0.836,0.226,0.229,0.236,0.226,0.228],[0.229,0.127,0.099,0.100,0.133,0.098],[0.873,0.607,0.523,0.528,0.525,0.523],[1.686,1.265,1.256,1.272,1.291,1.278],[18.146,27.259,27.518,27.463,26.977,27.374],[null,null,null,null,null,null],[0.514,0.564,0.373,0.379,0.433,0.362],[1.380,7.995,8.205,8.135,8.274,7.960],[3.420,17.361,17.292,17.215,17.398,16.948],[1.227,0.789,0.786,0.818,0.767,0.781],[0.853,0.212,0.211,0.211,0.217,0.215],[6.177,5.757,5.503,5.656,5.671,5.641],[0.204,0.054,0.050,0.057,0.047,0.049],[2.614,0.383,0.379,0.430,0.382,0.380],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.605,0.327,0.328,0.337,0.324,0.328],[0.910,0.994,0.934,0.917,0.967,0.984],[1.588,5.006,4.826,4.794,4.642,4.948],[1.254,0.624,2.014,2.033,2.000,1.996],[1.644,1.700,1.684,1.408,1.514,1.501],[0.259,0.079,0.077,0.073,0.061,0.063],[0.148,0.645,0.519,0.637,0.638,0.381],[0.217,0.869,0.790,0.807,0.859,0.807],[13.375,23.595,23.566,23.380,23.277,23.284],[25.351,23.674,24.092,23.781,23.343,23.554],[1.685,2.940,3.038,2.981,3.106,2.959],[3.601,2.915,2.990,2.977,2.961,2.898],[1.583,0.764,0.780,0.813,0.801,0.816],[4.213,3.864,3.765,3.778,3.749,3.801],[1.363,5.932,6.026,5.959,5.892,6.144],[1.371,0.750,0.755,0.728,0.715,0.719],[1.845,1.160,1.230,1.269,1.221,1.069],[0.296,0.222,0.220,0.213,0.219,0.210],[1.304,2.434,2.207,2.243,2.237,2.239],[0.276,0.078,0.079,0.082,0.081,0.079],[1.135,0.288,0.261,0.249,0.260,0.320],[1.072,2.795,2.590,2.640,2.746,2.801],[0.978,0.354,0.351,0.381,0.353,0.341],[0.898,4.087,3.750,3.919,3.972,3.888],[0.244,0.170,0.047,0.048,0.045,0.046],[4.772,4.709,4.708,4.940,4.922,5.246],[0.213,1.368,1.238,1.331,1.325,1.230],[1.366,1.088,1.193,1.112,1.230,1.247],[1.254,1.203,1.280,1.175,1.242,1.235],[0.034,0.016,0.015,0.017,0.015,0.016],[0.855,0.122,0.079,0.081,0.117,0.081],[2.192,3.156,3.207,3.058,3.112,3.121],[0.032,0.029,0.018,0.025,0.022,0.028],[0.297,0.126,0.137,0.144,0.113,0.125],[1.740,4.529,4.346,4.464,4.590,4.478],[2.090,49.743,49.899,49.767,50.146,50.687],[1.558,0.333,0.334,0.356,0.329,0.328],[null,null,null,null,null,null],[3.541,0.400,0.404,0.421,0.357,0.339],[2.172,1.627,1.618,1.573,1.582,1.620],[0.441,0.123,0.145,0.119,0.151,0.156],[0.790,0.309,0.291,0.478,0.475,0.310],[1.710,1.077,1.061,1.045,1.055,1.040],[0.772,0.087,0.081,0.139,0.103,0.081],[1.118,0.236,0.240,0.239,0.238,0.241],[14.422,14.123,14.289,14.200,14.076,14.152],[0.897,0.182,0.207,0.243,0.181,0.170],[1.466,1.010,1.017,1.012,1.012,1.023],[1.121,0.268,0.272,0.255,0.299,0.319],[1.355,0.914,0.907,0.959,0.886,0.960],[10.123,10.266,10.169,10.133,10.269,10.197],[0.796,0.308,0.292,0.488,0.480,0.304],[5.464,null,null,null,null,null],[0.980,0.513,0.452,0.496,0.460,0.460],[1.148,1.467,1.434,1.425,1.466,1.288],[12.760,25.971,26.160,26.094,26.327,26.616],[2.365,3.421,3.296,3.533,3.189,3.418],[0.838,0.219,0.210,0.213,0.208,0.206],[4.000,9.159,9.446,9.377,9.191,9.214],[1.104,0.209,0.198,0.206,0.204,0.197],[null,null,null,null,null,null],[1.071,2.074,1.954,1.956,1.872,1.888],[4.709,4.243,4.252,4.202,4.251,4.264],[null,null,null,null,null,null],[0.012,0.011,0.010,0.027,0.009,0.009],[1.620,0.387,0.376,0.370,0.362,0.360],[0.035,0.049,0.029,0.046,0.029,0.029],[1.676,6.761,6.899,6.710,6.781,6.634],[3.081,1.271,1.211,1.244,1.213,1.193],[0.241,0.344,0.356,0.355,0.352,0.393],[0.377,0.052,0.052,0.055,0.064,0.053],[0.154,0.066,0.046,0.081,0.049,0.047],[0.215,0.027,0.027,0.025,0.028,0.030],[0.525,0.150,0.142,0.202,0.149,0.143],[0.336,0.300,0.298,0.301,0.315,0.317],[4.773,4.523,4.683,4.611,4.628,4.603],[1.994,10.301,10.005,10.053,10.107,10.502],[0.775,0.355,0.355,0.355,0.330,0.338],[0.233,0.059,0.075,0.061,0.073,0.066],[0.135,0.165,0.152,0.165,0.166,0.153],[0.162,0.109,0.104,0.105,0.108,0.101],[1.417,0.664,0.656,0.685,0.657,0.677],[0.455,0.200,0.233,0.221,0.223,0.207],[5.272,5.384,5.380,5.399,5.346,5.329],[0.592,0.989,1.039,1.056,0.971,1.028],[1.388,0.766,0.755,0.775,0.758,0.753],[0.579,0.154,0.121,0.151,0.124,0.125],[17.283,17.222,17.296,17.231,17.193,17.471],[0.189,0.033,0.035,0.042,0.027,0.025],[0.343,0.127,0.119,0.100,0.092,0.113],[0.104,0.021,0.021,0.022,0.021,0.021],[0.231,0.149,0.159,0.158,0.141,0.150],[0.158,0.046,0.053,0.048,0.054,0.069],[0.118,0.049,0.049,0.047,0.064,0.045],[0.117,0.041,0.042,0.037,0.040,0.039],[0.192,0.102,0.120,0.112,0.108,0.090],[0.643,0.057,0.065,0.070,0.060,0.068],[0.615,0.052,0.051,0.051,0.053,0.050],[0.642,0.079,0.075,0.074,0.071,0.078],[0.175,0.096,0.092,0.093,0.093,0.089],[0.151,0.044,0.049,0.043,0.042,0.042],[0.205,0.265,0.260,0.270,0.274,0.233],[0.649,0.011,0.011,0.012,0.011,0.011],[0.677,0.011,0.011,0.011,0.011,0.012],[0.648,0.032,0.031,0.032,0.031,0.032],[0.245,0.026,0.027,0.026,0.026,0.026],[0.222,0.026,0.024,0.025,0.025,0.025],[0.174,0.022,0.026,0.023,0.024,0.023],[0.198,0.030,0.033,0.029,0.033,0.030],[0.200,0.027,0.027,0.028,0.028,0.028],[0.285,0.139,0.114,0.139,0.131,0.127],[0.495,0.240,0.233,0.216,0.221,0.222],[0.357,0.190,0.194,0.191,0.182,0.184],[0.623,0.265,0.246,0.256,0.260,0.244],[0.295,0.042,0.040,0.044,0.039,0.040],[0.254,0.039,0.039,0.038,0.037,0.036],[0.385,1.000,0.973,0.914,1.023,0.972],[0.311,0.120,0.119,0.128,0.125,0.127],[0.411,0.124,0.068,0.067,0.068,0.066],[0.378,0.058,0.057,0.056,0.056,0.057],[0.350,0.059,0.058,0.058,0.061,0.057],[0.343,0.195,0.194,0.175,0.177,0.170],[0.266,0.050,0.054,0.052,0.054,0.053],[0.207,0.021,0.021,0.023,0.024,0.024],[0.272,0.450,0.411,0.426,0.375,0.432],[0.006,0.005,0.005,0.005,0.005,0.005],[0.006,0.005,0.006,0.005,0.005,0.006],[0.243,0.094,0.090,0.099,0.090,0.092],[0.349,0.234,0.252,0.230,0.244,0.232],[0.662,0.102,0.102,0.104,0.105,0.108],[0.786,0.166,0.153,0.154,0.161,0.157],[0.680,0.129,0.147,0.138,0.121,0.124],[0.733,0.608,0.611,0.588,0.538,0.639],[0.668,0.570,0.583,0.564,0.584,0.583],[0.646,0.569,0.569,0.578,0.583,0.555],[0.673,0.661,0.540,0.664,0.676,0.641],[0.728,0.137,0.161,0.155,0.152,0.153],[0.267,0.115,0.119,0.117,0.119,0.084],[0.765,0.164,0.165,0.158,0.156,0.155],[0.391,0.042,0.042,0.042,0.044,0.042],[0.213,0.041,0.041,0.043,0.040,0.040],[0.413,0.042,0.043,0.041,0.042,0.041],[0.240,0.040,0.039,0.039,0.040,0.039],[0.398,0.052,0.046,0.046,0.049,0.046],[0.462,0.325,0.313,0.300,0.305,0.308],[1.364,0.289,0.299,0.285,0.297,0.274],[0.522,0.072,0.071,0.071,0.071,0.070],[0.391,0.177,0.191,0.190,0.189,0.187],[0.280,0.305,0.314,0.315,0.306,0.324],[0.292,0.310,0.293,0.304,0.315,0.296],[0.276,0.316,0.285,0.313,0.269,0.310],[0.304,0.201,0.201,0.200,0.214,0.201],[0.443,0.321,0.292,0.300,0.303,0.316],[1.148,0.151,0.170,0.169,0.174,0.165],[0.006,0.006,0.006,0.006,0.005,0.007],[0.767,0.136,0.140,0.121,0.117,0.109],[0.888,0.138,0.158,0.146,0.160,0.138],[0.848,0.072,0.071,0.072,0.071,0.067],[0.392,0.241,0.216,0.195,0.201,0.190],[0.575,0.774,0.742,0.778,0.812,0.752],[0.394,0.421,0.735,0.716,0.702,0.690],[0.321,0.615,0.565,0.550,0.513,0.524],[0.411,0.316,0.537,0.499,0.505,0.492],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.007,0.006,0.006],[0.824,0.122,0.207,0.200,0.209,0.202],[0.353,0.198,0.190,0.212,0.211,0.208],[0.785,0.097,0.224,0.221,0.233,0.233],[0.410,0.266,0.263,0.271,0.268,0.171],[0.430,0.475,0.485,0.459,0.470,0.465],[0.407,0.103,0.156,0.158,0.155,0.136],[0.262,0.104,0.100,0.104,0.109,0.105],[1.029,0.211,0.205,0.201,0.234,0.228],[0.490,0.189,0.208,0.210,0.193,0.191],[0.843,0.132,0.129,0.118,0.124,0.110],[0.276,0.069,0.083,0.087,0.083,0.084],[0.845,0.247,0.234,0.262,0.238,0.259],[0.988,0.647,0.626,0.622,0.632,0.629],[0.878,0.630,0.157,0.118,0.124,0.116],[0.922,0.671,0.650,0.638,0.644,0.662],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.828,0.119,0.247,0.251,0.249,0.258],[0.745,0.106,0.088,0.095,0.094,0.093],[0.408,0.229,0.159,0.219,0.219,0.230],[1.021,0.131,0.131,0.139,0.136,0.136],[0.945,0.140,0.134,0.128,0.125,0.116],[0.578,0.155,0.134,0.148,0.157,0.152],[0.840,0.370,0.328,0.341,0.324,0.311],[0.291,0.345,0.320,0.328,0.305,0.280],[1.021,0.337,0.327,0.347,0.348,0.361],[0.875,0.354,0.351,0.332,0.338,0.324],[0.329,0.315,0.352,0.328,0.319,0.345],[1.081,0.411,0.375,0.390,0.372,0.388],[0.188,0.029,0.029,0.025,0.025,0.026],[0.172,0.033,0.031,0.032,0.031,0.035],[0.263,0.139,0.125,0.126,0.127,0.130],[0.225,0.106,0.105,0.103,0.107,0.084],[0.281,0.207,0.246,0.255,0.179,0.205]],"version":"26.1.12.23","source":"results/26.1.12.23.json"} +,{"actual_version":"26.5.3.52","data_size":{"coffeeshop":49971196557,"hits":14991859879,"job":1906776471,"mgbench":3220840045,"ontime":3440144847,"ssb":88494151076,"taxi":24367180118,"tpcds":18829154857,"tpch":18560436681,"uk":1002235637},"kind":"versions-benchmark","load_time":{"coffeeshop":734,"hits":205,"job":23,"mgbench":58,"ontime":59,"ssb":1520,"taxi":541,"tpcds":287,"tpch":276,"uk":32},"machine":"c7a.4xlarge","release_date":"2026-05-21","result":[[0.085,0.007,0.006,0.351,0.006,0.006],[0.038,0.004,0.004,0.004,0.005,0.004],[0.047,0.007,0.016,0.032,0.007,0.008],[0.036,0.009,0.008,0.008,0.009,0.008],[0.053,0.025,0.021,0.048,0.017,0.024],[0.070,0.015,0.015,0.033,0.015,0.014],[0.025,0.004,0.004,0.004,0.004,0.005],[0.049,0.004,0.004,0.005,0.004,0.005],[0.061,0.005,0.004,0.056,0.004,0.004],[0.097,0.053,0.047,0.051,0.050,0.047],[0.322,0.258,0.244,0.243,0.250,0.258],[0.359,0.200,0.223,0.215,0.197,0.196],[0.031,0.004,0.004,0.004,0.004,0.004],[0.171,0.011,0.012,0.011,0.011,0.009],[0.506,0.353,0.352,0.372,0.329,0.327],[0.317,0.066,0.067,0.068,0.067,0.068],[0.050,0.015,0.014,0.014,0.014,0.013],[0.041,0.014,0.015,0.014,0.014,0.015],[8.423,1.117,1.103,1.096,1.078,1.095],[6.709,0.952,0.984,0.937,0.949,0.939],[6.624,0.844,0.846,0.831,0.817,0.822],[8.924,1.504,1.509,1.487,1.483,1.473],[8.068,1.226,1.226,1.226,1.228,1.231],[3.999,0.529,0.491,0.483,0.476,0.473],[0.067,0.019,0.020,0.022,0.019,0.019],[10.148,1.651,1.647,1.677,1.658,1.660],[2.568,0.515,0.516,0.595,0.595,0.517],[2.375,0.376,0.382,0.383,0.383,0.383],[0.002,0.002,0.002,0.002,0.001,0.001],[0.019,0.006,0.006,0.006,0.006,0.006],[0.054,0.014,0.014,0.036,0.014,0.015],[0.145,0.019,0.018,0.019,0.020,0.018],[0.167,0.048,0.047,0.045,0.049,0.046],[0.305,0.108,0.106,0.108,0.108,0.108],[0.003,0.002,0.002,0.022,0.002,0.002],[0.015,0.007,0.008,0.008,0.007,0.009],[0.379,0.221,0.217,0.218,0.218,0.216],[0.419,0.257,0.255,0.256,0.254,0.254],[0.218,0.057,0.060,0.061,0.061,0.059],[0.204,0.066,0.068,0.064,0.064,0.065],[0.481,0.247,0.245,0.252,0.245,0.253],[0.640,0.373,0.356,0.339,0.352,0.337],[0.503,0.266,0.277,0.275,0.263,0.279],[0.324,0.175,0.176,0.177,0.179,0.176],[1.065,0.678,0.681,0.674,0.661,0.666],[0.683,0.418,0.421,0.419,0.414,0.411],[2.102,1.568,1.208,1.240,1.220,1.197],[0.085,0.002,0.002,0.002,0.002,0.002],[1.729,0.018,0.019,0.016,0.018,0.016],[1.727,0.007,0.006,0.019,0.006,0.006],[4.357,0.775,0.793,0.780,0.769,0.777],[1.488,0.210,0.208,0.206,0.208,0.206],[0.238,0.024,0.024,0.022,0.021,0.023],[0.277,0.072,0.069,0.070,0.068,0.070],[0.245,0.029,0.025,0.023,0.022,0.022],[0.183,0.048,0.049,0.068,0.049,0.051],[1.642,0.466,0.461,0.460,0.466,0.459],[0.059,0.024,0.024,0.724,0.022,0.023],[0.328,0.156,0.152,0.160,0.146,0.146],[0.783,0.271,0.286,0.235,0.229,0.273],[2.286,1.469,1.482,1.569,1.427,1.402],[2.958,1.513,1.482,1.571,1.500,1.604],[2.881,1.480,1.543,1.589,1.629,1.576],[0.287,0.183,0.172,0.204,0.205,0.190],[0.105,0.057,0.051,0.060,0.055,0.051],[0.050,0.035,0.034,0.029,0.031,0.033],[0.074,0.026,0.025,0.022,0.026,0.023],[0.229,0.154,0.151,0.132,0.141,0.154],[0.026,0.004,0.004,0.004,0.004,0.005],[0.022,0.005,0.005,0.004,0.004,0.004],[0.013,0.004,0.004,0.004,0.004,0.004],[0.425,0.039,0.039,0.063,0.040,0.038],[0.422,0.054,0.055,0.055,0.055,0.054],[0.127,0.036,0.035,0.055,0.035,0.036],[0.222,0.051,0.050,0.074,0.051,0.053],[0.071,0.021,0.021,0.022,0.021,0.021],[0.153,0.054,0.055,0.050,0.053,0.052],[0.201,0.069,0.069,0.069,0.071,0.069],[0.049,0.020,0.020,0.021,0.020,0.020],[0.105,0.035,0.032,0.042,0.032,0.032],[0.216,0.097,0.105,0.105,0.103,0.103],[0.505,0.131,0.130,0.129,0.133,0.131],[0.480,0.318,0.318,0.323,0.318,0.318],[0.143,0.030,0.028,0.031,0.030,0.029],[0.560,0.257,0.257,0.279,0.249,0.247],[1.739,1.312,1.311,1.324,1.322,1.329],[8.642,1.036,0.989,1.033,1.011,1.010],[2.176,0.954,0.943,0.944,0.948,0.956],[12.927,2.377,2.322,2.353,2.329,2.316],[5.023,2.275,2.297,2.286,2.251,2.275],[5.660,1.678,1.641,1.639,1.612,1.628],[3.151,3.093,3.054,2.971,2.903,2.864],[6.944,6.513,6.464,6.462,6.548,6.397],[4.047,2.397,2.270,2.289,2.279,2.258],[5.691,4.610,4.551,4.557,4.627,4.610],[5.024,3.458,3.477,3.469,3.454,3.427],[8.545,6.264,6.248,6.253,6.161,6.193],[3.476,2.227,2.248,2.234,2.234,2.255],[43.925,41.878,41.651,41.766,42.150,42.669],[8.632,5.043,5.011,5.006,5.053,5.061],[3.483,2.398,2.269,2.265,2.260,2.252],[3.485,1.484,1.481,1.488,1.503,1.543],[3.495,2.909,2.919,2.910,2.898,2.904],[10.439,9.567,9.574,9.547,9.426,9.366],[35.964,35.738,34.834,34.390,34.626,34.466],[26.379,5.041,4.824,4.667,4.419,4.587],[2.625,0.562,0.564,0.493,0.454,0.452],[9.400,8.829,9.074,8.918,10.134,9.041],[1.509,0.646,0.763,0.651,0.573,0.624],[0.970,0.623,0.612,0.532,0.513,0.552],[null,null,null,null,null,null],[0.342,0.134,0.142,0.138,0.145,0.143],[5.192,2.996,2.217,2.093,2.163,2.224],[5.748,null,null,null,null,null],[null,null,null,null,null,null],[41.195,27.050,14.398,18.493,4.697,4.723],[2.870,0.580,0.582,0.575,0.594,0.577],[3.804,1.527,1.552,1.545,1.512,1.494],[8.932,3.936,3.799,3.965,3.827,3.789],[0.814,0.467,0.493,0.413,0.497,0.488],[0.644,0.317,0.280,0.327,0.303,0.284],[1.618,0.952,0.967,0.988,0.953,0.927],[9.754,3.191,3.174,3.217,3.177,3.177],[14.781,8.624,8.348,13.312,13.142,14.978],[11.386,2.840,2.895,2.910,2.866,2.898],[1.115,0.306,0.298,0.315,0.302,0.303],[43.455,2.937,2.827,2.755,2.462,2.748],[0.705,0.321,0.319,0.345,0.388,0.394],[0.256,0.130,0.131,0.124,0.129,0.133],[0.528,0.300,0.275,0.256,0.275,0.263],[0.155,0.033,0.034,0.033,0.034,0.034],[6.565,5.667,5.698,5.640,5.557,5.673],[null,null,null,null,null,null],[0.539,0.179,0.174,0.187,0.169,0.165],[1.312,0.378,0.380,0.393,0.376,0.380],[0.616,0.196,0.195,0.193,0.193,0.195],[1.448,1.032,1.030,1.082,1.014,1.053],[0.895,0.264,0.251,0.250,0.252,0.253],[2.597,1.847,1.844,1.855,1.858,1.871],[0.190,0.071,0.064,0.071,0.064,0.066],[2.614,0.503,0.462,0.496,0.425,0.429],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.218,0.094,0.090,0.106,0.087,0.096],[0.590,0.218,0.229,0.241,0.223,0.219],[1.636,0.555,0.511,0.625,0.661,0.600],[0.829,0.538,0.481,0.451,0.409,0.405],[0.637,0.118,0.118,0.111,0.113,0.110],[0.187,0.093,0.099,0.089,0.091,0.090],[0.094,0.041,0.047,0.075,0.037,0.039],[0.207,0.218,0.159,0.164,0.147,0.171],[7.765,7.036,7.088,6.972,7.098,7.155],[8.044,7.295,7.351,7.880,8.221,5.428],[31.690,30.421,29.895,30.308,30.020,31.032],[30.821,2.573,3.012,2.871,2.797,2.784],[2.248,0.484,0.460,0.459,0.450,0.453],[0.630,0.242,0.201,0.214,0.173,0.217],[1.200,0.341,0.337,0.337,0.338,0.336],[1.306,0.765,0.771,0.776,0.764,0.773],[2.821,0.511,0.609,0.596,0.467,0.449],[0.264,0.118,0.104,0.126,0.122,0.116],[1.402,0.703,0.739,0.703,0.699,0.704],[0.161,0.066,0.066,0.068,0.066,0.068],[0.850,0.253,0.242,0.242,0.242,0.241],[0.934,0.272,0.268,0.268,0.268,0.269],[0.904,0.322,0.311,0.328,0.312,0.304],[0.799,0.285,0.277,0.288,0.272,0.277],[0.353,0.205,0.200,0.193,0.181,0.199],[5.360,3.808,3.990,3.860,4.004,4.014],[0.142,0.114,0.084,0.099,0.094,0.087],[0.123,0.111,0.093,0.101,0.089,0.091],[0.236,0.076,0.068,0.068,0.062,0.061],[0.036,0.016,0.014,0.015,0.016,0.016],[0.337,0.053,0.050,0.052,0.052,0.051],[1.365,0.987,0.979,0.976,0.984,0.983],[0.035,0.020,0.021,0.025,0.020,0.021],[0.277,0.104,0.096,0.100,0.094,0.103],[1.706,0.438,0.423,0.428,0.420,0.421],[2.171,1.876,1.818,1.865,1.814,1.825],[1.441,0.295,0.298,0.305,0.295,0.298],[null,null,null,null,null,null],[60.043,0.376,0.360,0.427,0.354,0.361],[1.460,1.019,1.271,1.304,1.214,1.272],[0.318,0.052,0.052,0.051,0.051,0.052],[0.632,0.264,0.253,0.257,0.259,0.254],[0.868,0.239,0.244,0.255,0.250,0.244],[0.347,0.053,0.052,0.059,0.053,0.052],[0.869,0.151,0.150,0.152,0.147,0.149],[0.753,0.523,0.523,0.541,0.520,0.518],[0.732,0.210,0.206,0.250,0.217,0.188],[0.791,0.438,0.429,0.438,0.428,0.434],[0.799,0.224,0.213,0.216,0.215,0.219],[1.062,0.374,0.342,0.361,0.349,0.346],[0.289,0.108,0.105,0.105,0.110,0.099],[0.631,0.259,0.260,0.252,0.246,0.252],[0.907,0.476,0.328,0.320,0.320,0.317],[0.892,0.413,0.404,0.419,0.408,0.406],[0.844,0.294,0.214,0.275,0.242,0.223],[12.606,12.350,12.041,12.092,12.097,11.944],[2.323,0.435,0.433,0.427,0.420,0.421],[0.907,0.297,0.289,0.290,0.292,0.296],[0.779,0.405,0.397,0.400,0.405,0.396],[0.817,0.219,0.216,0.218,0.216,0.211],[1.534,1.101,1.103,1.041,0.984,0.975],[0.913,0.272,0.238,0.268,0.261,0.263],[1.935,1.267,1.260,1.269,1.260,1.234],[null,null,null,null,null,null],[0.011,0.015,0.010,0.010,0.010,0.011],[1.232,0.262,0.259,0.267,0.262,0.267],[0.042,0.055,0.033,0.048,0.033,0.032],[1.683,0.377,0.377,0.399,0.391,0.394],[2.402,0.309,0.307,0.310,0.304,0.310],[0.295,0.176,0.182,0.181,0.151,0.157],[0.504,0.337,0.327,0.306,0.310,0.333],[0.167,0.067,0.062,0.097,0.069,0.063],[0.264,0.035,0.031,0.034,0.031,0.031],[0.542,0.172,0.168,0.200,0.169,0.170],[0.187,0.082,0.078,0.078,0.079,0.080],[4.490,4.077,4.156,4.096,3.994,3.864],[1.468,0.962,0.950,0.966,0.943,0.944],[0.604,0.251,0.245,0.243,0.247,0.247],[0.214,0.062,0.064,0.069,0.063,0.066],[0.144,0.166,0.148,0.145,0.138,0.139],[0.174,0.075,0.075,0.076,0.078,0.086],[2.708,1.438,2.147,2.175,2.193,2.176],[0.520,0.132,0.126,0.128,0.126,0.134],[6.056,5.485,5.523,5.329,5.551,5.543],[0.562,0.116,0.114,0.114,0.113,0.117],[1.205,0.639,0.623,0.592,0.609,0.642],[0.441,0.159,0.161,0.160,0.159,0.162],[0.402,0.157,0.158,0.158,0.157,0.160],[0.131,0.034,0.033,0.050,0.031,0.031],[0.446,0.022,0.020,0.019,0.019,0.021],[0.113,0.025,0.024,0.024,0.023,0.023],[0.077,0.020,0.022,0.020,0.019,0.021],[0.199,0.077,0.076,0.077,0.075,0.078],[0.162,0.072,0.072,0.075,0.067,0.075],[0.095,0.044,0.042,0.040,0.039,0.040],[0.254,0.110,0.111,0.110,0.098,0.098],[0.654,0.145,0.144,0.154,0.148,0.146],[0.687,0.149,0.145,0.151,0.142,0.142],[0.710,0.155,0.150,0.158,0.151,0.145],[0.215,0.112,0.100,0.113,0.118,0.114],[0.129,0.028,0.023,0.027,0.024,0.026],[0.253,0.148,0.115,0.124,0.126,0.126],[0.055,0.024,0.023,0.021,0.023,0.022],[0.051,0.020,0.022,0.022,0.020,0.018],[0.634,0.126,0.125,0.121,0.121,0.125],[0.194,0.040,0.033,0.037,0.038,0.033],[0.130,0.035,0.036,0.036,0.037,0.036],[0.130,0.035,0.033,0.036,0.033,0.035],[0.152,0.038,0.037,0.040,0.038,0.038],[0.152,0.038,0.040,0.041,0.040,0.042],[3.977,3.229,3.228,3.253,3.246,3.202],[1.775,1.366,1.431,1.810,1.623,1.787],[1.780,1.309,1.234,1.586,2.539,1.879],[3.972,3.041,3.447,3.818,3.257,3.477],[0.336,0.170,0.129,0.096,0.106,0.096],[0.221,0.091,0.056,0.057,0.050,0.053],[0.529,0.511,0.439,0.435,0.406,0.416],[0.650,0.249,0.235,0.220,0.229,0.223],[0.398,0.271,0.161,0.173,0.188,0.152],[0.365,0.252,0.143,0.142,0.241,0.145],[0.514,0.207,0.171,0.173,0.202,0.316],[0.570,0.214,0.230,0.208,0.301,0.192],[0.328,0.087,0.086,0.170,0.087,0.088],[0.230,0.127,0.187,0.180,0.087,0.075],[0.542,0.320,0.360,0.386,0.359,0.266],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.285,0.217,0.151,0.164,0.170,0.145],[0.421,0.365,0.339,0.371,0.348,0.330],[0.706,0.179,0.173,0.175,0.159,0.174],[0.179,0.061,0.061,0.079,0.060,0.059],[0.774,0.251,0.236,0.234,0.213,0.253],[0.640,0.435,0.398,0.218,0.180,0.602],[0.377,0.362,0.313,0.354,0.354,0.367],[0.420,0.261,0.370,0.365,0.233,0.338],[0.504,0.270,0.305,0.366,0.365,0.268],[0.701,0.305,0.289,0.300,0.290,0.315],[0.685,0.136,0.118,0.118,0.122,0.124],[0.737,0.336,0.314,0.320,0.313,0.292],[0.477,0.145,0.137,0.144,0.149,0.137],[0.393,0.150,0.135,0.133,0.125,0.125],[0.390,0.169,0.193,0.178,0.194,0.172],[0.266,0.118,0.118,0.115,0.118,0.115],[0.762,0.549,0.599,0.515,0.529,0.588],[0.515,0.350,0.343,0.318,0.351,0.336],[0.928,0.606,0.659,0.559,0.539,0.545],[0.868,0.706,0.559,0.567,0.528,0.513],[0.371,0.236,0.226,0.201,0.222,0.239],[0.233,0.404,0.307,0.283,0.266,0.291],[0.202,0.405,0.310,0.312,0.272,0.284],[0.272,0.367,0.318,0.293,0.284,0.305],[0.417,0.235,0.246,0.245,0.243,0.214],[0.419,0.358,0.312,0.304,0.293,0.306],[0.263,0.159,0.143,0.141,0.104,0.099],[0.006,0.006,0.006,0.007,0.007,0.006],[0.818,0.185,0.190,0.170,0.185,0.188],[0.876,0.329,0.306,0.322,0.363,0.335],[0.827,0.225,0.312,0.296,0.346,0.216],[0.940,0.334,0.366,0.288,0.272,0.346],[0.946,0.571,0.566,0.517,0.470,0.585],[0.348,0.111,0.136,0.123,0.126,0.140],[0.283,0.091,0.081,0.087,0.076,0.083],[0.494,0.352,0.287,0.260,0.325,0.334],[0.007,0.007,0.007,0.007,0.007,0.007],[0.007,0.006,0.007,0.007,0.007,0.007],[0.007,0.007,0.007,0.007,0.006,0.007],[0.899,0.275,0.250,0.236,0.248,0.241],[0.856,0.258,0.256,0.246,0.236,0.237],[0.881,0.250,0.250,0.244,0.240,0.238],[0.840,0.276,0.248,0.252,0.248,0.246],[0.544,0.205,0.175,0.217,0.182,0.178],[0.409,0.291,0.287,0.276,0.275,0.226],[0.620,0.309,0.285,0.311,0.231,0.305],[0.857,0.205,0.193,0.208,0.182,0.181],[0.825,0.204,0.181,0.183,0.197,0.174],[0.898,0.174,0.176,0.173,0.176,0.159],[0.842,0.209,0.237,0.225,0.225,0.224],[0.986,0.271,0.263,0.269,0.263,0.266],[0.592,0.275,0.336,0.228,0.226,0.231],[0.504,0.249,0.230,0.233,0.194,0.214],[0.611,0.360,0.248,0.267,0.266,0.283],[0.007,0.007,0.007,0.006,0.007,0.007],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.927,0.272,0.257,0.253,0.253,0.262],[0.791,0.181,0.184,0.183,0.176,0.203],[0.940,0.273,0.274,0.265,0.279,0.269],[0.943,0.226,0.206,0.241,0.234,0.207],[0.913,0.216,0.191,0.192,0.195,0.189],[0.883,0.211,0.216,0.218,0.212,0.212],[0.945,0.352,0.341,0.329,0.310,0.328],[0.958,0.339,0.267,0.322,0.324,0.321],[0.989,0.312,0.310,0.312,0.308,0.305],[1.024,0.312,0.299,0.286,0.283,0.287],[0.907,0.200,0.207,0.190,0.189,0.195],[1.027,0.369,0.439,0.306,0.322,0.388],[0.201,0.053,0.058,0.055,0.069,0.068],[0.188,0.061,0.078,0.056,0.062,0.093],[0.243,0.248,0.238,0.230,0.222,0.238],[0.261,0.174,0.162,0.191,0.174,0.174],[0.368,0.381,0.340,0.294,0.298,0.291]],"version":"26.5.3.52","source":"results/26.5.3.52.json"} +,{"actual_version":"26.2.19.43","data_size":{"coffeeshop":49929806921,"hits":14984370958,"job":1905031892,"mgbench":3185898523,"ontime":3440107771,"ssb":86987487888,"taxi":24334901168,"tpcds":18793894154,"tpch":17932488042,"uk":1002191183},"kind":"versions-benchmark","load_time":{"coffeeshop":807,"hits":241,"job":25,"mgbench":60,"ontime":55,"ssb":1489,"taxi":525,"tpcds":332,"tpch":303,"uk":33},"machine":"c7a.4xlarge","release_date":"2026-05-22","result":[[0.084,0.007,0.007,0.278,0.007,0.006],[0.023,0.003,0.003,0.003,0.003,0.003],[0.050,0.018,0.009,0.033,0.008,0.008],[0.035,0.009,0.009,0.009,0.009,0.008],[0.046,0.020,0.021,0.039,0.017,0.019],[0.061,0.018,0.015,0.034,0.014,0.015],[0.027,0.004,0.004,0.004,0.003,0.004],[0.050,0.004,0.004,0.004,0.004,0.004],[0.064,0.004,0.004,0.059,0.005,0.004],[0.091,0.049,0.049,0.047,0.047,0.047],[0.321,0.244,0.245,0.244,0.241,0.241],[0.342,0.203,0.225,0.221,0.206,0.202],[0.028,0.003,0.004,0.004,0.003,0.004],[0.025,0.009,0.009,0.010,0.009,0.008],[0.471,0.339,0.331,0.347,0.310,0.310],[0.460,0.054,0.054,0.054,0.053,0.054],[0.043,0.013,0.012,0.013,0.013,0.013],[0.039,0.013,0.013,0.013,0.013,0.013],[8.156,1.027,1.017,1.043,1.019,0.997],[6.431,0.863,0.859,0.851,0.853,0.868],[6.458,0.801,0.805,0.788,0.802,0.792],[8.724,1.480,1.440,1.465,1.440,1.443],[8.044,1.205,1.202,1.201,1.208,1.197],[3.869,0.482,0.464,0.450,0.450,0.446],[0.061,0.023,0.018,0.018,0.017,0.020],[10.119,1.623,1.608,1.617,1.617,1.611],[2.562,0.496,0.507,0.500,0.499,0.500],[2.367,0.369,0.367,0.372,0.370,0.373],[0.002,0.002,0.002,0.002,0.002,0.002],[0.026,0.006,0.006,0.007,0.007,0.006],[0.056,0.014,0.016,0.033,0.014,0.015],[0.113,0.018,0.021,0.019,0.019,0.018],[0.140,0.049,0.049,0.046,0.051,0.048],[0.264,0.109,0.106,0.107,0.116,0.106],[0.003,0.003,0.002,0.021,0.003,0.002],[0.019,0.008,0.007,0.007,0.008,0.007],[0.355,0.219,0.230,0.217,0.217,0.212],[0.398,0.256,0.250,0.253,0.253,0.253],[0.162,0.057,0.058,0.056,0.058,0.058],[0.171,0.063,0.063,0.063,0.064,0.062],[0.446,0.247,0.243,0.247,0.255,0.243],[0.617,0.355,0.342,0.350,0.360,0.343],[0.477,0.268,0.260,0.292,0.273,0.282],[0.313,0.172,0.175,0.173,0.178,0.174],[1.076,0.721,0.712,0.707,0.707,0.705],[0.711,0.452,0.443,0.457,0.445,0.448],[2.182,1.760,1.333,1.339,1.462,1.337],[0.077,0.002,0.002,0.002,0.002,0.002],[1.566,0.023,0.024,0.023,0.029,0.023],[1.936,0.007,0.007,0.019,0.007,0.007],[4.342,0.688,0.702,0.696,0.700,0.688],[0.443,0.050,0.047,0.052,0.046,0.046],[0.342,0.081,0.080,0.079,0.080,0.080],[0.220,0.071,0.070,0.073,0.069,0.070],[0.346,0.080,0.084,0.081,0.083,0.082],[0.158,0.048,0.049,0.070,0.052,0.049],[1.348,0.461,0.456,0.466,0.465,0.483],[0.054,0.026,0.024,0.708,0.021,0.020],[0.304,0.173,0.168,0.167,0.141,0.157],[0.644,0.206,0.205,0.202,0.227,0.215],[2.088,1.451,1.516,1.471,1.467,1.497],[2.562,1.520,1.587,1.620,1.516,1.327],[2.653,1.337,1.480,1.573,1.650,1.526],[0.250,0.154,0.168,0.149,0.170,0.155],[0.101,0.055,0.053,0.048,0.045,0.046],[0.044,0.030,0.025,0.027,0.024,0.027],[0.057,0.022,0.020,0.019,0.019,0.020],[0.157,0.099,0.097,0.105,0.090,0.091],[0.029,0.004,0.004,0.004,0.004,0.004],[0.020,0.004,0.004,0.004,0.004,0.004],[0.013,0.004,0.004,0.003,0.004,0.003],[0.399,0.040,0.042,0.066,0.041,0.041],[0.353,0.054,0.055,0.056,0.058,0.053],[0.110,0.036,0.036,0.052,0.034,0.033],[0.216,0.051,0.053,0.073,0.050,0.050],[0.065,0.020,0.018,0.020,0.017,0.019],[0.139,0.056,0.051,0.049,0.045,0.048],[0.159,0.068,0.065,0.066,0.066,0.066],[0.044,0.016,0.016,0.017,0.016,0.016],[0.087,0.034,0.025,0.032,0.026,0.026],[0.198,0.091,0.089,0.091,0.088,0.091],[0.384,0.117,0.119,0.116,0.119,0.116],[0.466,0.313,0.314,0.310,0.312,0.313],[0.127,0.029,0.028,0.029,0.028,0.028],[0.536,0.247,0.244,0.264,0.239,0.237],[1.666,1.270,1.267,1.257,1.254,1.266],[8.543,0.987,1.001,1.009,0.993,1.005],[1.871,0.918,0.917,0.928,0.912,0.932],[12.837,2.275,2.317,2.281,2.293,2.296],[5.043,2.438,2.414,2.449,2.452,2.426],[5.684,1.567,1.564,1.552,1.564,1.574],[3.251,3.107,3.086,3.107,3.059,3.068],[6.882,6.353,6.347,6.387,6.294,6.313],[4.041,2.426,2.415,2.425,2.435,2.407],[5.694,4.542,4.520,4.510,4.532,4.513],[5.019,3.664,3.722,3.710,3.659,3.659],[null,null,null,null,null,null],[3.507,2.257,2.265,2.288,2.263,2.252],[47.699,47.645,46.338,46.166,45.392,45.764],[8.643,null,null,null,null,null],[3.481,53.094,53.468,53.463,54.108,54.025],[3.475,34.227,33.919,33.959,33.898,33.983],[98.153,97.759,96.082,98.076,97.885,98.489],[10.990,10.330,10.411,10.271,10.226,10.275],[null,null,null,null,null,null],[26.501,30.501,29.882,30.070,29.968,29.888],[2.691,0.602,0.602,0.410,0.368,0.370],[0.546,0.222,0.213,0.228,0.210,0.213],[2.644,2.028,1.992,2.156,1.971,2.164],[1.001,0.525,0.506,0.502,0.532,0.505],[null,null,null,null,null,null],[0.196,0.056,0.060,0.097,0.057,0.061],[2.589,0.859,0.873,0.852,0.843,0.852],[4.868,4.010,4.022,4.251,4.086,4.133],[7.350,6.525,6.640,6.353,6.737,6.635],[2.438,1.794,1.670,1.680,1.622,1.670],[0.508,0.132,0.120,0.121,0.122,0.120],[1.396,0.616,0.576,0.817,0.771,0.619],[1.871,0.972,0.765,0.756,0.776,0.763],[0.175,0.088,0.089,0.097,0.090,0.093],[0.213,0.103,0.103,0.122,0.104,0.107],[0.359,0.192,0.188,0.187,0.199,0.192],[4.467,3.776,3.719,3.758,3.774,3.734],[2.280,1.309,1.303,1.287,1.308,1.330],[3.916,0.559,0.557,0.576,0.560,0.557],[0.561,0.207,0.204,0.202,0.200,0.203],[4.842,2.730,2.654,2.582,2.651,2.314],[0.493,0.215,0.216,0.236,0.224,0.214],[0.229,0.096,0.089,0.089,0.092,0.091],[0.483,0.276,0.243,0.248,0.242,0.239],[0.110,0.030,0.031,0.033,0.032,0.032],[4.656,3.214,3.252,3.219,2.929,3.136],[null,null,null,null,null,null],[0.387,0.185,0.138,0.149,0.140,0.134],[1.190,7.409,7.531,7.215,7.410,7.529],[0.583,1.330,1.225,1.291,1.216,1.217],[1.266,0.925,0.902,0.943,0.919,0.904],[0.674,0.207,0.201,0.200,0.203,0.204],[2.047,1.382,1.377,1.360,1.357,1.370],[0.154,0.051,0.048,0.054,0.048,0.052],[2.033,0.392,0.392,0.438,0.389,0.394],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.312,0.091,0.088,0.100,0.092,0.091],[0.874,0.832,0.808,0.775,0.759,0.802],[1.418,5.158,4.878,5.096,5.113,5.111],[0.955,0.333,3.486,3.494,3.447,3.472],[0.475,0.113,0.117,0.118,0.116,0.118],[0.220,0.071,0.072,0.068,0.075,0.072],[0.083,0.672,0.599,0.609,0.545,0.629],[0.168,0.829,0.801,0.812,0.792,0.805],[13.111,22.824,23.210,22.535,23.133,23.177],[23.901,23.213,23.078,23.271,23.108,23.393],[1.473,2.874,2.894,2.830,2.922,2.889],[3.476,2.847,2.813,2.858,2.872,2.965],[1.405,0.833,0.816,0.847,0.824,0.822],[4.082,3.696,3.713,3.676,3.735,3.616],[1.233,5.223,5.138,5.304,5.342,5.429],[1.244,0.825,0.774,0.755,0.754,0.747],[1.483,1.152,1.171,1.230,1.220,1.221],[0.269,0.134,0.124,0.131,0.123,0.129],[1.302,1.875,1.860,1.781,1.792,1.807],[0.226,0.027,0.024,0.024,0.024,0.024],[0.938,0.317,0.277,0.296,0.305,0.293],[0.948,2.461,2.327,2.318,2.251,2.391],[0.790,0.294,0.297,0.318,0.301,0.298],[0.831,3.723,3.606,3.751,3.590,3.603],[0.176,0.146,0.127,0.139,0.113,0.131],[5.264,4.417,4.621,4.524,4.646,4.494],[0.145,0.930,0.891,0.738,0.862,0.655],[0.842,0.883,0.766,0.822,0.663,0.697],[1.192,1.262,1.327,1.129,1.212,1.135],[0.029,0.016,0.015,0.015,0.015,0.016],[0.245,0.056,0.058,0.061,0.055,0.061],[1.366,0.979,0.955,0.957,0.963,0.953],[0.024,0.019,0.019,0.022,0.022,0.023],[0.263,0.137,0.127,0.139,0.140,0.131],[1.683,3.893,3.882,3.934,3.932,3.955],[2.017,50.850,51.031,51.654,51.785,51.799],[1.428,0.353,0.345,0.369,0.359,0.351],[null,null,null,null,null,null],[3.930,0.383,0.377,0.417,0.356,0.348],[1.507,0.920,0.919,0.888,0.903,0.933],[0.246,0.054,0.055,0.052,0.055,0.055],[0.618,0.240,0.238,0.244,0.237,0.232],[0.789,0.230,0.233,0.237,0.231,0.232],[0.245,0.059,0.058,0.056,0.056,0.057],[0.666,0.465,0.243,0.248,0.245,0.232],[14.934,14.877,14.832,14.722,14.779,14.733],[0.754,0.231,0.214,0.247,0.221,0.206],[0.805,0.435,0.436,0.425,0.436,0.426],[0.819,0.361,0.293,0.289,0.287,0.293],[0.906,1.053,0.910,0.888,0.880,0.887],[0.249,10.386,10.215,10.242,10.371,10.385],[0.606,0.243,0.251,0.240,0.239,0.236],[0.715,0.411,0.290,0.294,0.289,0.292],[0.873,0.373,0.370,0.380,0.371,0.371],[0.965,1.473,1.374,1.369,1.345,1.195],[12.859,27.350,27.602,27.165,27.114,27.423],[2.337,2.246,2.170,2.008,2.023,2.212],[0.711,0.241,0.229,0.227,0.229,0.226],[0.779,9.674,9.605,9.334,9.389,9.343],[0.855,0.231,0.227,0.240,0.230,0.223],[1.727,1.126,1.261,1.153,1.207,1.139],[0.943,1.699,1.581,1.592,1.651,1.704],[1.717,1.157,1.145,1.142,1.164,1.167],[null,null,null,null,null,null],[0.010,0.009,0.009,0.009,0.009,0.009],[1.442,0.369,0.367,0.367,0.375,0.352],[0.036,0.048,0.030,0.048,0.031,0.031],[1.673,6.953,6.774,6.908,6.731,6.941],[1.974,1.511,1.266,1.252,1.266,1.145],[0.303,0.216,0.194,0.211,0.209,0.204],[0.293,0.235,0.219,0.198,0.214,0.210],[0.155,0.055,0.055,0.086,0.056,0.056],[0.219,0.029,0.034,0.031,0.030,0.033],[0.470,0.164,0.174,0.194,0.164,0.159],[0.329,0.300,0.293,0.286,0.289,0.292],[4.737,4.521,4.535,4.608,4.578,4.532],[1.423,8.641,8.436,8.420,8.539,8.401],[0.585,0.247,0.245,0.237,0.235,0.239],[0.196,0.074,0.069,0.070,0.075,0.073],[0.125,0.178,0.166,0.158,0.165,0.158],[0.156,0.074,0.076,0.073,0.072,0.073],[2.909,1.322,2.272,2.255,1.305,2.314],[0.427,0.180,0.164,0.163,0.162,0.154],[5.558,5.256,5.229,5.298,5.249,5.251],[0.498,0.612,0.628,0.644,0.646,0.647],[1.095,0.584,0.578,0.575,0.578,0.588],[0.410,0.137,0.131,0.129,0.130,0.132],[17.266,17.300,17.652,17.514,17.562,17.880],[0.141,0.036,0.038,0.049,0.032,0.032],[0.423,0.020,0.018,0.017,0.017,0.017],[0.099,0.020,0.021,0.021,0.020,0.022],[0.068,0.018,0.017,0.018,0.017,0.017],[0.185,0.077,0.082,0.081,0.082,0.084],[0.146,0.062,0.064,0.067,0.068,0.068],[0.083,0.036,0.036,0.039,0.037,0.036],[0.238,0.150,0.123,0.129,0.141,0.141],[0.453,0.398,0.139,0.271,0.139,0.276],[0.403,0.123,0.125,0.127,0.125,0.121],[0.584,0.170,0.162,0.160,0.162,0.164],[0.201,0.037,0.035,0.031,0.032,0.031],[0.144,0.044,0.043,0.043,0.043,0.044],[0.145,0.051,0.049,0.050,0.047,0.059],[0.524,0.127,0.128,0.127,0.128,0.126],[0.607,0.020,0.015,0.015,0.014,0.014],[0.452,0.241,0.148,0.152,0.152,0.138],[0.133,0.027,0.027,0.029,0.031,0.027],[0.140,0.033,0.030,0.029,0.028,0.028],[0.115,0.028,0.029,0.028,0.027,0.028],[0.158,0.033,0.036,0.035,0.035,0.034],[0.122,0.032,0.029,0.030,0.028,0.028],[0.320,0.155,0.150,0.155,0.150,0.153],[0.195,0.061,0.054,0.054,0.053,0.055],[0.137,0.049,0.051,0.051,0.053,0.051],[0.472,0.212,0.204,0.208,0.223,0.207],[0.250,0.139,0.076,0.059,0.059,0.055],[0.209,0.095,0.054,0.052,0.048,0.047],[0.490,0.913,0.852,0.858,0.886,0.895],[0.363,0.104,0.109,0.116,0.109,0.114],[0.321,0.154,0.151,0.142,0.127,0.119],[0.291,0.131,0.108,0.098,0.093,0.090],[0.371,0.158,0.151,0.164,0.149,0.138],[0.317,0.187,0.193,0.174,0.171,0.184],[0.219,0.092,0.057,0.052,0.053,0.052],[0.145,0.035,0.033,0.028,0.027,0.028],[0.304,0.615,0.622,0.619,0.581,0.557],[0.006,0.005,0.005,0.005,0.006,0.006],[0.005,0.005,0.006,0.006,0.005,0.005],[0.211,0.077,0.076,0.082,0.068,0.073],[0.164,0.072,0.069,0.073,0.072,0.071],[0.190,0.116,0.117,0.233,0.113,0.135],[0.334,0.278,0.279,0.294,0.305,0.279],[0.446,0.225,0.142,0.213,0.203,0.299],[0.439,0.649,0.637,0.603,0.615,0.608],[0.609,0.533,0.208,0.522,0.527,0.521],[0.546,0.529,0.451,0.506,0.497,0.506],[0.759,0.610,0.655,0.724,0.695,0.666],[0.411,0.122,0.110,0.107,0.114,0.106],[0.197,0.060,0.055,0.055,0.056,0.052],[0.604,0.170,0.195,0.206,0.183,0.184],[0.364,0.168,0.056,0.055,0.065,0.064],[0.198,0.192,0.067,0.097,0.063,0.068],[0.325,0.081,0.068,0.075,0.072,0.163],[0.211,0.074,0.058,0.055,0.057,0.054],[0.552,0.114,0.105,0.102,0.107,0.121],[0.796,0.627,0.690,0.673,0.659,0.665],[0.551,0.618,0.581,0.601,0.607,0.615],[0.499,0.126,0.148,0.122,0.148,0.142],[0.405,0.414,0.373,0.399,0.371,0.402],[0.213,0.421,0.364,0.333,0.348,0.357],[0.178,0.420,0.331,0.364,0.342,0.357],[0.247,0.378,0.369,0.372,0.326,0.325],[0.991,0.741,0.840,0.838,0.811,0.854],[0.406,0.416,0.427,0.410,0.424,0.425],[0.284,0.139,0.141,0.139,0.129,0.134],[0.006,0.006,0.006,0.006,0.005,0.006],[0.413,0.210,0.254,0.291,0.188,0.208],[0.507,0.503,0.311,0.190,0.192,0.165],[0.285,0.522,0.104,0.152,0.098,0.120],[0.389,0.338,0.474,0.241,0.296,0.262],[0.575,1.131,1.122,1.133,1.072,1.126],[0.331,0.133,0.323,0.245,0.220,0.244],[0.202,0.352,0.228,0.232,0.230,0.224],[0.394,0.177,0.258,0.205,0.193,0.194],[0.007,0.006,0.006,0.006,0.006,0.007],[0.007,0.006,0.006,0.006,0.006,0.006],[0.007,0.006,0.006,0.006,0.006,0.006],[0.766,0.231,0.249,0.243,0.136,0.136],[0.363,0.260,0.339,0.457,0.235,0.246],[0.343,0.257,0.218,0.396,0.137,0.154],[0.675,0.172,0.162,0.189,0.158,0.160],[0.344,0.128,0.091,0.194,0.099,0.090],[0.217,0.102,0.372,0.290,0.268,0.287],[0.278,0.234,0.097,0.270,0.089,0.092],[0.706,0.276,0.287,0.259,0.256,0.216],[0.353,0.264,0.185,0.161,0.332,0.186],[0.446,0.289,0.653,0.405,0.393,0.412],[0.325,0.138,0.120,0.123,0.125,0.112],[0.679,0.548,0.433,0.415,0.358,0.507],[0.427,0.270,0.166,0.161,0.163,0.169],[0.455,0.263,0.159,0.143,0.145,0.144],[0.422,0.209,0.211,0.223,0.218,0.220],[0.006,0.007,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.007,0.006,0.006],[0.411,0.257,0.303,0.140,0.120,0.252],[0.485,0.301,0.450,0.287,0.287,0.227],[0.669,0.302,0.567,0.364,0.286,0.352],[0.382,0.142,0.112,0.142,0.108,0.108],[0.378,0.123,0.107,0.104,0.104,0.103],[0.771,0.200,0.167,0.169,0.211,0.147],[0.404,0.192,0.315,0.328,0.251,0.350],[0.506,0.331,0.310,0.309,0.369,0.294],[0.653,0.338,0.317,0.317,0.229,0.342],[0.540,0.179,0.144,0.161,0.304,0.146],[0.352,0.171,0.176,0.133,0.149,0.159],[0.664,0.162,0.153,0.152,0.147,0.174],[0.134,0.047,0.044,0.046,0.050,0.047],[0.113,0.049,0.049,0.047,0.048,0.049],[0.215,0.328,0.309,0.323,0.292,0.288],[0.278,0.176,0.203,0.212,0.188,0.205],[0.414,0.417,0.363,0.368,0.353,0.323]],"version":"26.2.19.43","source":"results/26.2.19.43.json"} +,{"actual_version":"26.6.1.1193","data_size":{"coffeeshop":49993649315,"hits":15029693316,"job":1906776740,"mgbench":3231090175,"ontime":3440144847,"ssb":88382967776,"taxi":24366683380,"tpcds":18840431571,"tpch":18589718494,"uk":1002235637},"kind":"versions-benchmark","load_time":{"coffeeshop":707,"hits":203,"job":23,"mgbench":61,"ontime":53,"ssb":1490,"taxi":495,"tpcds":338,"tpch":316,"uk":29},"machine":"c7a.4xlarge","release_date":"2026-06-25","result":[[0.094,0.007,0.007,0.362,0.007,0.007],[0.034,0.003,0.003,0.003,0.003,0.003],[0.055,0.007,0.014,0.027,0.007,0.007],[0.046,0.011,0.009,0.008,0.008,0.008],[0.057,0.027,0.021,0.044,0.021,0.022],[0.076,0.015,0.016,0.035,0.014,0.013],[0.026,0.004,0.004,0.004,0.004,0.004],[0.048,0.004,0.004,0.004,0.004,0.004],[0.063,0.005,0.005,0.059,0.004,0.004],[0.091,0.046,0.044,0.045,0.045,0.043],[0.316,0.245,0.243,0.238,0.236,0.240],[0.359,0.209,0.220,0.219,0.195,0.191],[0.031,0.004,0.004,0.004,0.004,0.004],[0.029,0.010,0.011,0.011,0.010,0.009],[0.510,0.342,0.346,0.364,0.318,0.329],[0.316,0.062,0.060,0.062,0.062,0.061],[0.047,0.013,0.014,0.014,0.014,0.014],[0.043,0.014,0.013,0.013,0.014,0.013],[8.208,0.979,0.966,0.992,1.010,0.968],[6.433,0.852,0.852,0.864,0.854,0.863],[6.769,0.783,0.746,0.745,0.747,0.749],[8.954,1.487,1.483,1.472,1.470,1.454],[8.304,1.159,1.155,1.167,1.158,1.152],[3.928,0.369,0.365,0.369,0.365,0.366],[0.063,0.017,0.017,0.018,0.018,0.017],[10.147,1.738,1.566,1.603,1.559,1.559],[2.562,0.485,0.480,0.480,0.481,0.483],[2.371,0.357,0.358,0.355,0.357,0.354],[0.002,0.001,0.001,0.001,0.001,0.002],[0.026,0.006,0.006,0.006,0.006,0.006],[0.050,0.017,0.015,0.035,0.014,0.014],[0.125,0.020,0.019,0.018,0.018,0.018],[0.152,0.047,0.047,0.046,0.045,0.046],[0.283,0.104,0.102,0.103,0.103,0.103],[0.005,0.002,0.002,0.023,0.002,0.002],[0.022,0.008,0.008,0.008,0.008,0.008],[0.364,0.221,0.222,0.219,0.221,0.216],[0.400,0.254,0.254,0.254,0.247,0.248],[0.174,0.060,0.058,0.059,0.057,0.060],[0.180,0.066,0.064,0.063,0.063,0.063],[0.445,0.248,0.240,0.228,0.244,0.230],[0.602,0.320,0.313,0.321,0.333,0.329],[0.492,0.302,0.280,0.294,0.307,0.269],[0.317,0.177,0.176,0.175,0.175,0.174],[1.093,0.839,0.715,0.800,0.819,0.812],[0.749,0.459,0.441,0.439,0.434,0.428],[2.082,1.495,1.247,1.252,1.215,1.218],[0.095,0.002,0.002,0.002,0.002,0.002],[1.659,0.022,0.020,0.020,0.020,0.021],[1.674,0.007,0.007,0.020,0.007,0.007],[4.391,0.736,0.741,0.924,0.788,0.762],[1.722,0.533,0.308,0.317,0.296,0.284],[0.208,0.025,0.022,0.022,0.022,0.021],[0.263,0.070,0.066,0.065,0.065,0.067],[0.211,0.025,0.022,0.022,0.022,0.022],[0.170,0.051,0.049,0.070,0.050,0.050],[1.563,0.483,0.472,0.476,0.478,0.474],[0.060,0.023,0.023,0.724,0.023,0.021],[0.317,0.155,0.175,0.169,0.146,0.143],[0.783,0.207,0.223,0.240,0.245,0.237],[2.115,1.783,1.444,1.442,1.426,1.508],[2.673,1.212,1.190,1.430,1.453,1.429],[2.668,1.477,1.260,1.406,1.506,1.493],[0.249,0.183,0.160,0.185,0.185,0.206],[0.114,0.046,0.053,0.045,0.045,0.052],[0.045,0.029,0.029,0.025,0.029,0.029],[0.065,0.022,0.021,0.021,0.021,0.023],[0.183,0.091,0.106,0.105,0.094,0.103],[0.024,0.005,0.005,0.005,0.005,0.005],[0.018,0.005,0.005,0.005,0.005,0.005],[0.015,0.005,0.005,0.005,0.005,0.005],[0.420,0.041,0.039,0.063,0.038,0.038],[0.407,0.054,0.056,0.054,0.054,0.053],[0.118,0.037,0.035,0.054,0.034,0.035],[0.234,0.054,0.056,0.079,0.054,0.053],[0.072,0.021,0.021,0.021,0.021,0.021],[0.152,0.048,0.048,0.048,0.051,0.049],[0.184,0.070,0.069,0.067,0.067,0.067],[0.044,0.020,0.021,0.021,0.019,0.023],[0.107,0.038,0.033,0.044,0.030,0.033],[0.216,0.106,0.100,0.102,0.100,0.100],[0.482,0.125,0.124,0.122,0.121,0.121],[0.471,0.318,0.320,0.320,0.312,0.323],[0.145,0.029,0.028,0.029,0.028,0.028],[0.559,0.244,0.241,0.262,0.224,0.234],[1.752,1.307,1.368,1.298,1.289,1.292],[8.697,0.965,1.000,0.998,1.018,0.993],[2.271,0.979,0.989,0.973,0.980,0.979],[13.374,2.475,2.397,2.462,2.394,2.426],[5.031,2.390,2.389,2.389,2.383,2.478],[5.680,1.563,1.545,1.547,1.527,1.533],[3.146,2.831,2.833,2.851,2.842,2.833],[6.903,6.286,6.196,6.293,6.174,6.188],[4.039,2.202,2.252,2.238,2.187,2.201],[5.684,4.460,4.517,4.430,4.533,4.556],[5.023,3.348,3.362,3.367,3.327,3.346],[8.548,6.179,6.155,6.173,6.160,6.138],[3.485,2.206,2.211,2.215,2.225,2.205],[43.892,42.320,40.908,40.412,39.722,40.035],[8.544,4.560,4.586,4.533,4.530,4.555],[3.478,2.216,2.199,2.218,2.212,2.230],[3.469,1.413,1.423,1.413,1.426,1.421],[3.483,2.827,2.807,2.802,2.831,2.809],[10.425,9.524,9.541,9.496,9.513,9.448],[36.705,34.781,34.204,33.831,33.984,33.138],[26.648,24.063,23.619,23.958,24.034,24.043],[2.712,0.534,0.548,0.476,0.429,0.432],[12.855,14.039,14.056,13.778,14.400,13.992],[1.412,0.536,0.718,0.647,0.710,0.580],[1.157,0.522,0.562,0.548,0.498,0.512],[null,null,null,null,null,null],[0.358,0.191,0.203,0.167,0.168,0.192],[4.848,2.594,1.906,2.166,2.158,2.139],[5.615,null,null,null,null,null],[29.855,25.763,27.532,26.136,22.074,8.594],[8.970,3.871,4.005,3.948,4.047,3.857],[2.781,0.464,0.461,0.462,0.469,0.470],[3.554,1.204,1.230,1.234,1.175,1.210],[8.572,3.958,3.566,3.629,3.479,3.684],[0.855,0.450,0.450,0.480,0.478,0.447],[0.625,0.312,0.298,0.334,0.308,0.277],[1.506,0.829,0.884,0.845,0.749,0.842],[9.506,3.163,3.124,3.118,3.158,3.105],[16.246,10.719,10.956,13.133,8.793,9.967],[11.380,2.751,2.752,2.761,2.808,2.751],[1.203,0.363,0.364,0.368,0.374,0.379],[38.815,2.736,2.608,2.327,2.621,2.548],[0.668,0.253,0.245,0.279,0.247,0.309],[0.257,0.142,0.125,0.129,0.126,0.130],[0.549,0.329,0.270,0.262,0.266,0.265],[0.081,0.027,0.027,0.028,0.030,0.029],[6.224,4.510,4.554,4.523,4.639,4.603],[null,null,null,null,null,null],[0.633,0.161,0.155,0.171,0.161,0.150],[1.697,0.354,0.349,0.379,0.351,0.354],[0.757,0.192,0.184,0.184,0.188,0.184],[1.492,0.962,0.948,1.011,0.972,0.952],[1.030,0.251,0.241,0.241,0.240,0.243],[3.141,2.199,2.193,2.203,2.218,2.195],[0.176,0.055,0.057,0.065,0.054,0.057],[2.651,0.515,0.456,0.497,0.416,0.411],[null,null,null,null,null,null],[null,null,null,null,null,null],[0.370,0.119,0.114,0.118,0.101,0.104],[1.056,0.294,0.289,0.309,0.284,0.295],[2.069,0.585,0.663,0.528,0.689,0.700],[1.202,0.392,0.375,0.362,0.365,0.332],[0.374,0.073,0.071,0.074,0.079,0.072],[0.260,0.080,0.082,0.080,0.079,0.082],[0.097,0.049,0.041,0.077,0.037,0.037],[0.228,0.169,0.163,0.206,0.175,0.171],[6.331,5.098,5.056,5.240,6.281,5.755],[6.092,4.753,4.905,4.968,4.803,4.746],[28.344,28.463,28.303,28.758,28.833,30.145],[27.760,2.466,2.436,2.345,2.447,2.703],[2.224,0.430,0.427,0.352,0.428,0.431],[0.744,0.147,0.148,0.143,0.145,0.142],[1.561,0.332,0.340,0.334,0.327,0.324],[1.348,0.721,0.731,0.764,0.722,0.731],[3.145,0.471,0.616,0.558,0.432,0.419],[0.255,0.121,0.114,0.113,0.122,0.106],[1.489,0.682,0.686,0.689,0.675,0.678],[0.248,0.077,0.074,0.073,0.073,0.071],[1.176,0.259,0.259,0.250,0.249,0.254],[1.227,0.280,0.271,0.280,0.256,0.268],[0.949,0.306,0.294,0.317,0.292,0.298],[1.038,0.278,0.268,0.281,0.267,0.266],[0.375,0.198,0.173,0.172,0.171,0.177],[4.867,4.292,4.306,4.343,4.219,4.236],[0.164,0.116,0.088,0.088,0.080,0.082],[0.119,0.097,0.087,0.102,0.082,0.082],[0.344,0.069,0.069,0.069,0.068,0.064],[0.035,0.015,0.014,0.014,0.014,0.014],[0.204,0.033,0.035,0.034,0.033,0.033],[1.465,0.993,0.974,0.948,0.963,0.945],[0.025,0.023,0.020,0.023,0.021,0.028],[0.254,0.092,0.092,0.087,0.093,0.088],[2.096,0.437,0.422,0.429,0.433,0.426],[2.038,1.543,1.544,1.568,1.547,1.540],[1.661,0.286,0.281,0.292,0.295,0.288],[null,null,null,null,null,null],[57.424,0.312,0.309,0.383,0.307,0.301],[1.461,1.053,1.135,1.180,0.870,0.978],[0.188,0.034,0.036,0.033,0.035,0.034],[0.788,0.243,0.231,0.239,0.230,0.229],[0.995,0.232,0.234,0.238,0.234,0.232],[0.196,0.034,0.033,0.034,0.035,0.034],[0.769,0.120,0.120,0.119,0.119,0.117],[0.773,0.546,0.548,0.568,0.534,0.541],[0.869,0.260,0.202,0.265,0.242,0.238],[0.936,0.422,0.417,0.417,0.415,0.414],[1.039,0.202,0.208,0.201,0.208,0.200],[1.031,0.274,0.271,0.275,0.263,0.239],[0.279,0.101,0.096,0.101,0.097,0.097],[0.764,0.242,0.236,0.236,0.239,0.234],[0.672,0.393,0.299,0.296,0.302,0.306],[0.975,0.343,0.345,0.355,0.340,0.341],[1.112,0.246,0.203,0.248,0.209,0.208],[12.081,11.756,11.737,11.755,11.657,11.666],[2.442,0.448,0.434,0.420,0.419,0.413],[0.914,0.240,0.233,0.229,0.231,0.226],[0.910,0.394,0.383,0.386,0.381,0.394],[1.121,0.216,0.214,0.214,0.216,0.213],[1.875,1.064,1.070,0.994,0.962,0.851],[1.199,0.268,0.266,0.272,0.263,0.246],[2.243,1.500,1.471,1.462,1.486,1.481],[null,null,null,null,null,null],[0.011,0.016,0.010,0.010,0.011,0.011],[1.596,0.275,0.301,0.271,0.267,0.262],[0.040,0.055,0.031,0.049,0.031,0.030],[1.985,0.403,0.395,0.393,0.406,0.380],[2.030,0.236,0.229,0.226,0.230,0.227],[0.291,0.180,0.187,0.176,0.174,0.173],[0.480,0.290,0.270,0.253,0.264,0.269],[0.163,0.061,0.058,0.092,0.060,0.055],[0.255,0.036,0.031,0.031,0.030,0.033],[0.554,0.160,0.162,0.202,0.164,0.158],[0.177,0.078,0.077,0.077,0.078,0.077],[4.622,4.442,4.278,4.320,4.254,4.366],[1.587,0.928,0.911,0.915,0.904,0.902],[0.781,0.235,0.231,0.221,0.222,0.232],[0.221,0.065,0.060,0.060,0.060,0.062],[0.148,0.161,0.148,0.128,0.141,0.144],[0.165,0.068,0.068,0.068,0.068,0.065],[66.586,67.747,67.749,64.623,66.467,65.752],[0.499,0.127,0.125,0.125,0.124,0.126],[11.290,10.519,10.345,10.445,10.586,10.468],[0.664,0.112,0.109,0.110,0.113,0.111],[1.271,0.627,0.615,0.622,0.638,0.661],[0.511,0.133,0.128,0.130,0.129,0.130],[0.488,0.162,0.158,0.162,0.164,0.160],[0.128,0.027,0.028,0.046,0.027,0.027],[0.316,0.021,0.018,0.019,0.019,0.019],[0.102,0.024,0.023,0.024,0.023,0.023],[0.073,0.019,0.020,0.019,0.019,0.019],[0.182,0.064,0.064,0.062,0.062,0.064],[0.144,0.063,0.063,0.057,0.059,0.060],[0.093,0.037,0.036,0.037,0.036,0.038],[0.217,0.107,0.086,0.092,0.089,0.095],[0.658,0.139,0.135,0.134,0.130,0.138],[0.626,0.142,0.139,0.136,0.139,0.132],[0.659,0.143,0.143,0.137,0.144,0.138],[0.185,0.077,0.077,0.080,0.080,0.068],[0.126,0.025,0.023,0.022,0.024,0.023],[0.216,0.111,0.108,0.101,0.074,0.086],[0.054,0.024,0.023,0.022,0.021,0.022],[0.052,0.021,0.020,0.020,0.019,0.019],[0.618,0.118,0.122,0.120,0.114,0.120],[0.193,0.037,0.068,0.069,0.066,0.067],[0.161,0.049,0.035,0.037,0.035,0.037],[0.136,0.032,0.031,0.031,0.031,0.030],[0.163,0.045,0.043,0.042,0.043,0.043],[0.133,0.031,0.031,0.031,0.030,0.030],[0.386,0.174,0.128,0.106,0.218,0.133],[0.850,0.536,0.450,0.426,0.530,0.567],[1.021,0.671,0.474,0.794,0.459,0.526],[1.776,1.215,1.099,1.172,1.053,1.098],[0.283,0.158,0.092,0.080,0.098,0.107],[0.218,0.087,0.065,0.059,0.060,0.059],[0.495,0.384,0.427,0.428,0.327,0.343],[0.576,0.204,0.194,0.177,0.187,0.180],[0.382,0.210,0.182,0.095,0.092,0.112],[0.446,0.130,0.132,0.120,0.129,0.120],[0.573,0.301,0.183,0.162,0.137,0.146],[0.618,0.202,0.177,0.296,0.173,0.185],[0.340,0.183,0.087,0.195,0.102,0.176],[0.205,0.067,0.069,0.066,0.065,0.081],[0.470,0.258,0.241,0.223,0.226,0.240],[0.006,0.006,0.006,0.005,0.006,0.005],[0.005,0.005,0.005,0.005,0.005,0.005],[0.482,0.213,0.143,0.148,0.127,0.136],[0.439,0.330,0.308,0.340,0.315,0.324],[0.659,0.155,0.152,0.167,0.154,0.150],[0.157,0.042,0.037,0.038,0.048,0.036],[0.732,0.244,0.210,0.220,0.237,0.221],[0.837,0.362,0.177,0.333,0.154,0.279],[0.426,0.183,0.184,0.203,0.188,0.189],[0.323,0.275,0.215,0.191,0.198,0.178],[0.372,0.208,0.227,0.201,0.304,0.294],[0.649,0.305,0.283,0.295,0.286,0.259],[0.629,0.135,0.118,0.119,0.116,0.112],[0.653,0.316,0.305,0.278,0.275,0.278],[0.431,0.114,0.106,0.098,0.116,0.106],[0.351,0.062,0.062,0.064,0.063,0.062],[0.372,0.242,0.213,0.202,0.247,0.216],[0.307,0.179,0.185,0.148,0.176,0.156],[0.642,0.365,0.388,0.362,0.415,0.434],[0.449,0.254,0.266,0.250,0.221,0.257],[0.738,0.462,0.422,0.389,0.384,0.464],[0.703,0.448,0.419,0.365,0.400,0.456],[0.348,0.129,0.125,0.128,0.114,0.125],[0.285,0.181,0.114,0.113,0.109,0.112],[0.212,1.252,1.070,0.677,0.778,0.746],[0.305,0.127,0.113,0.116,0.113,0.103],[0.589,0.375,0.322,0.351,0.301,0.339],[0.510,0.165,0.166,0.149,0.155,0.162],[0.236,0.152,0.159,0.142,0.130,0.142],[0.007,0.006,0.006,0.006,0.006,0.006],[0.714,0.169,0.172,0.149,0.166,0.169],[0.963,0.317,0.310,0.300,0.238,0.199],[0.840,0.321,0.288,0.300,0.219,0.175],[0.922,0.236,0.244,0.221,0.307,0.338],[0.736,0.512,0.372,0.405,0.434,0.431],[0.294,0.144,0.120,0.106,0.098,0.097],[0.245,0.064,0.059,0.060,0.059,0.058],[0.431,0.233,0.126,0.229,0.222,0.203],[0.007,0.006,0.007,0.007,0.007,0.006],[0.007,0.007,0.007,0.007,0.007,0.007],[0.007,0.007,0.007,0.007,0.007,0.007],[0.740,0.184,0.170,0.156,0.157,0.162],[0.744,0.166,0.164,0.174,0.157,0.170],[0.758,0.176,0.178,0.174,0.177,0.168],[0.744,0.183,0.188,0.182,0.187,0.180],[0.471,0.161,0.149,0.164,0.153,0.151],[0.403,0.231,0.156,0.227,0.233,0.239],[0.557,0.272,0.249,0.273,0.229,0.242],[0.828,0.185,0.189,0.193,0.177,0.174],[0.816,0.187,0.171,0.177,0.178,0.167],[0.891,0.165,0.159,0.160,0.165,0.170],[0.845,0.185,0.176,0.175,0.178,0.175],[0.960,0.239,0.241,0.214,0.219,0.233],[0.512,0.243,0.130,0.127,0.192,0.206],[0.430,0.158,0.175,0.153,0.122,0.128],[0.417,0.245,0.127,0.133,0.139,0.131],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.006,0.006,0.006,0.006,0.006,0.006],[0.815,0.193,0.181,0.175,0.177,0.177],[0.754,0.154,0.155,0.159,0.147,0.150],[0.792,0.185,0.196,0.195,0.184,0.181],[0.911,0.206,0.188,0.198,0.182,0.195],[0.900,0.190,0.174,0.172,0.176,0.172],[0.844,0.187,0.188,0.201,0.205,0.189],[0.872,0.328,0.249,0.293,0.301,0.298],[1.003,0.314,0.288,0.306,0.298,0.303],[0.878,0.209,0.194,0.205,0.205,0.199],[0.936,0.236,0.208,0.213,0.198,0.205],[0.831,0.187,0.170,0.169,0.174,0.169],[0.970,0.336,0.319,0.239,0.233,0.221],[0.643,0.055,0.095,0.052,0.054,0.045],[0.225,0.056,0.127,0.060,0.067,0.077],[0.197,0.213,0.229,0.194,0.237,0.234],[0.257,0.175,0.168,0.162,0.171,0.173],[0.362,0.381,0.263,0.373,0.270,0.248]],"version":"26.6.1.1193","source":"results/26.6.1.1193.json"} + +]; diff --git a/versions/fetch-results.sh b/versions/fetch-results.sh new file mode 100755 index 0000000000..18a844f64a --- /dev/null +++ b/versions/fetch-results.sh @@ -0,0 +1,116 @@ +#!/bin/bash -e + +# Fetch the latest Versions Benchmark result for every version from the sink database +# (sink.data, rows with kind = "versions-benchmark", sent by cloud-init.sh.in) and write +# results/.json, enriched with the release date. The committed result files are +# produced solely by this script -- do not edit them by hand. +# +# Connection settings come from $CONNECTION_PARAMS, as in the repo's collect-results.sh: +# CONNECTION_PARAMS='--user check_benchmark_results --password *** --host play.clickhouse.com --secure' \ +# ./fetch-results.sh +# +# Then regenerate the page data with ./generate-results.sh. + +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +cd "${HERE}" +CH() { clickhouse-client ${CONNECTION_PARAMS} "$@"; } + +mkdir -p results + +# Release-date lookup. list-versions.sh resolves it (column 3) for published and tagged +# builds from the authoritative version_date.tsv; the reconstructed monthly snapshots are +# not in that list, so fall back to their commit date in build-from-source/monthly.tsv. +LV="$(./list-versions.sh 2>/dev/null || true)" + +# For calendar versions (18.x onwards) the page groups by YY.MM (major.minor). Use the +# date of the FIRST release in that YY.MM line so the group sorts/displays by when the +# release series began, not by the latest patch. GROUP_FIRST maps "YY.MM" -> earliest +# date, computed from the full release list in version_date.tsv. +VD="prepare-data/data/version_date.tsv" +declare -A GROUP_FIRST +if [ -s "${VD}" ]; then + while IFS=$'\t' read -r mm d; do GROUP_FIRST["${mm}"]="${d}"; done < <( + awk -F'\t' '{ v=$1; sub(/^v/,"",v); n=split(v,a,"."); + if (n>=2) { k=a[1]"."a[2]; if (!(k in m) || $2 < m[k]) m[k]=$2 } } + END { for (k in m) print k"\t"m[k] }' "${VD}") +fi + +reldate() { + local v="$1" d mm + if [[ "${v}" =~ ^([0-9]+)\.([0-9]+)\. ]] && [ "${BASH_REMATCH[1]}" -ge 18 ]; then + mm="${BASH_REMATCH[1]}.${BASH_REMATCH[2]}" + [ -n "${GROUP_FIRST[$mm]:-}" ] && { printf '%s' "${GROUP_FIRST[$mm]}"; return; } + fi + d="$(awk -F'\t' -v v="$v" '$1==v{print $3; exit}' <<<"${LV}")" + [ -z "${d}" ] && d="$(awk -F'\t' -v v="$v" '$1==v{print $3; exit}' build-from-source/monthly.tsv 2>/dev/null)" + printf '%s' "${d}" +} + +mapfile -t VERSIONS < <(CH --query " + SELECT DISTINCT JSONExtractString(content, 'version') AS v + FROM sink.data + WHERE JSONExtractString(content, 'kind') = 'versions-benchmark' AND v != '' + AND length(JSONExtractArrayRaw(content, 'result')) = 344 + ORDER BY v + FORMAT TSV") + +echo "fetching ${#VERSIONS[@]} versions from the sink" >&2 +rm -f results/*.json +for v in "${VERSIONS[@]}"; do + [ -z "${v}" ] && continue + # argMax over time keeps the most recent run for this version. + CH --query " + SELECT argMax(content, time) FROM sink.data + WHERE JSONExtractString(content, 'kind') = 'versions-benchmark' + AND JSONExtractString(content, 'version') = '${v}' + AND length(JSONExtractArrayRaw(content, 'result')) = 344 + FORMAT TSVRaw" > /tmp/vb-content.json + # Skip runs whose data load did not complete: an OOM during the (parallel) load can + # kill the server mid-INSERT and take the container down, leaving data_size null + # and/or the big datasets unloaded (this is what repeatedly corrupted 18.10.3, + # 1.1.54310/54327, 53989/53990 -- all from runs before the loader was fixed to bound + # concurrency + retry). hits loads on every version, so a missing hits load time is a + # reliable "incomplete run" signal. Such versions are simply left out until re-run. + if jq -e '(.data_size == null) or (.load_time.hits == null)' /tmp/vb-content.json >/dev/null 2>&1; then + echo " SKIP ${v}: incomplete load (data_size/hits missing) -- re-run needed" >&2 + continue + fi + rd="$(reldate "${v}")" + # Keep the recorded fields; add release_date (preferring one already in the payload). + # Compact one line per file: these are generated artifacts, kept small in git. + # Prefer a non-empty release_date already in the payload; otherwise use the looked-up + # one (reldate). Note jq's // only defaults on null, not on an empty string, so an empty + # payload release_date (what run-version.sh writes when it couldn't resolve a date) must + # be handled explicitly -- else it would shadow the value we just resolved here. + jq -cS --arg rd "${rd}" \ + '. + {release_date: (if (.release_date // "") != "" then .release_date + elif $rd != "" then $rd else null end)}' \ + /tmp/vb-content.json > "results/${v}.json" + echo " results/${v}.json (released ${rd:-unknown})" >&2 +done +echo "wrote $(ls results/*.json 2>/dev/null | wc -l) result files" >&2 + +# Name files without a dotted version prefix (bare revision-number tag builds such as +# 53996) after their server-reported actual_version (1.1.53996), so every committed file +# is named by a real version. Several consecutive tag builds can report the same version +# (the revision wasn't bumped every tag), so dedupe by keeping the highest tag -- it is +# the one matching the reported revision -- and set that file's version field to match. +declare -A best +for f in results/*.json; do + v="$(basename "${f}" .json)" + case "${v}" in [0-9]*.[0-9]*) continue ;; esac # already has a dotted prefix + av="$(jq -r '.actual_version // empty' "${f}")"; [ -z "${av}" ] && continue + if [ -z "${best[${av}]:-}" ] || [ "${v}" -gt "${best[${av}]}" ]; then best[${av}]="${v}"; fi +done +for f in results/*.json; do + v="$(basename "${f}" .json)" + case "${v}" in [0-9]*.[0-9]*) continue ;; esac + av="$(jq -r '.actual_version // empty' "${f}")"; [ -z "${av}" ] && continue + if [ "${v}" = "${best[${av}]}" ]; then + jq -cS --arg av "${av}" '.version = $av' "${f}" > results/.rename.tmp + rm -f "${f}"; mv results/.rename.tmp "results/${av}.json" + echo " renamed ${v}.json -> ${av}.json" >&2 + else + rm -f "${f}"; echo " dropped ${v}.json (duplicate of ${av})" >&2 + fi +done diff --git a/versions/generate-results.sh b/versions/generate-results.sh index a6241c1fb4..f2e8e72206 100755 --- a/versions/generate-results.sh +++ b/versions/generate-results.sh @@ -1,31 +1,61 @@ #!/bin/bash -e -# This script will substitute the benchmark results into the HTML page. -# Note: editing HTML with sed may look strange, but at least we avoid using node.js and npm, and that's good. - -# This is needed on Mac OS. Do `brew install coreutils`. -[ -n "$HOMEBREW_PREFIX" ] && PATH="${HOMEBREW_PREFIX}/opt/coreutils/libexec/gnubin:${PATH}" -if command -v gsed >/dev/null 2>&1 -then - alias sed='gsed' -fi - -( - sed '/^const data = \[$/q' index.html - - FIRST=1 - ls -1 results/*.json | while read file - do - >&2 echo processing ${file} - [ "${FIRST}" = "0" ] && echo -n ',' - jq --compact-output ". += {\"source\": \"${file}\"}" "${file}" - FIRST=0 - done +# Build data.generated.js (loaded by index.html) from the committed per-version result +# files in results/ (produced by fetch-results.sh) and the query sets in queries/. +# +# Output has two consts: +# const datasets = [{name, queries:[...]}, ...] // in the QUERY_ORDER the result +# // arrays are concatenated in +# const data = [{version, actual_version, release_date, machine, +# load_time:{ds:sec}, data_size:{ds:bytes}, result:[[...]], source}] +# +# Keeping data out of index.html (as the main ClickBench page does with +# data.generated.js) keeps the page diffable and lets the data regenerate on its own. + +HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)" +cd "${HERE}" + +# The order the runner concatenates per-dataset query results into result[] (see +# QUERY_ORDER in run-version.sh). datasets[].queries line up with result[] by offset. +QUERY_ORDER="mgbench ssb hits uk ontime taxi coffeeshop tpch tpcds job" - echo ']; // end of data' - sed '0,/^\]; \/\/ end of data$/d' index.html +OUT=data.generated.js -) > index.html.new +{ + echo '// Generated by generate-results.sh from results/*.json and queries/*.sql. Do not edit.' + + # datasets: name + its queries (one per non-empty line of queries/.sql). + echo -n 'const datasets = [' + first=1 + for ds in ${QUERY_ORDER}; do + [ "${first}" = 0 ] && echo -n ',' + first=0 + queries_json="$(jq -R -s 'split("\n") | map(select(length > 0))' "queries/${ds}.sql")" + printf '\n{"name":"%s","queries":%s}' "${ds}" "${queries_json}" + done + echo '' + echo '];' + echo '' + + # data: one entry per version, oldest release first (ties broken by version). + echo -n 'const data = [' + first=1 + while IFS=$'\t' read -r _rd file; do + [ -z "${file}" ] && continue + >&2 echo "processing ${file}" + [ "${first}" = 0 ] && echo -n ',' + first=0 + jq --compact-output ". += {\"source\": \"${file}\"}" "${file}" + done < <( + for f in results/*.json; do + # A missing OR empty release_date must still yield a non-empty sort key: an empty + # first field makes the line start with a tab, which `read -r _rd file` then strips + # as leading IFS whitespace, shifting the filename into _rd and dropping the entry. + printf '%s\t%s\n' "$(jq -r 'if (.release_date // "") == "" then "9999-99-99" else .release_date end' "${f}")" "${f}" + done | sort -t$'\t' -k1,1 -k2,2V + ) + echo '' + echo '];' +} > "${OUT}" -mv index.html index.html.bak -mv index.html.new index.html +>&2 echo "wrote ${OUT} ($(wc -c < "${OUT}") bytes)" diff --git a/versions/index.html b/versions/index.html index 3923323b0a..6367aa3398 100644 --- a/versions/index.html +++ b/versions/index.html @@ -28,6 +28,10 @@ --summary-every-other-row-color: #F8F8F8; --highlight-color: #EEE; --bar-color: #FFCB80; + --bar-color1: oklch(calc(0.9 - 0.6) 0.1 calc(90 - 60)); + --bar-color2: oklch(calc(0.9 - 0.4) 0.1 calc(90 - 40)); + --bar-color3: oklch(calc(0.9 - 0.1) 0.1 calc(90 - 20)); + --bar-color4: oklch(0.9 0.1 90); --tooltip-text-color: white; --tooltip-background-color: black; @@ -54,6 +58,10 @@ --summary-every-other-row-color: #042e41; --highlight-color: #064663; --bar-color: #088; + --bar-color1: oklch(calc(0.4 + 0.6) 0.1 calc(250 - 180)); + --bar-color2: oklch(calc(0.4 + 0.4) 0.1 calc(250 - 120)); + --bar-color3: oklch(calc(0.4 + 0.2) 0.1 calc(250 - 60)); + --bar-color4: oklch(0.4 0.1 250); --tooltip-text-color: white; --tooltip-background-color: #444; @@ -74,7 +82,7 @@ body { font-family: 'Inter', sans-serif; - padding: 1% 3% 0 3%; + padding: 0 3% 0 0; /* no top/left padding: sticky header and left columns pin to the page edge */ } h1 { @@ -90,6 +98,22 @@ left: 0px; } + /* Modest left indent for the top of the page and the Detailed Comparison heading, + while the tables' sticky columns stay flush with the page edge. */ + .header, .selectors-container, div.comparison, .annotation { + margin-left: 1.5rem; + } + + .annotation { + margin-top: 2.5rem; + margin-right: 3%; + font-size: 0.9rem; + line-height: 1.5; + opacity: 0.85; + } + .annotation h2 { font-size: 1.1rem; } + .annotation li { margin-bottom: 0.3rem; } + .selectors-container { padding: 2rem 0 2rem 0; user-select: none; @@ -147,16 +171,52 @@ padding-right: 1rem; } + /* The whole summary row (version name, date, value) in monospace. */ + tr.summary-row { + font-family: monospace; + } + + .remove-system { + visibility: hidden; + cursor: pointer; + color: var(--link-color); + user-select: none; + padding-right: 0.4rem; + } + + .summary-row:hover .remove-system { + visibility: visible; + } + + .remove-system:hover { + color: var(--link-hover-color); + } + .summary-bar-cell { width: 100%; + position: relative; } .summary-bar { height: 1rem; - background: var(--bar-color); + width: 100%; border-radius: 0 0.2rem 0.2rem 0; } + .summary-date { + position: absolute; + right: 0.5rem; + top: 0; + bottom: 0; + display: flex; + align-items: center; + font-size: 80%; + -webkit-text-stroke: 2px var(--background-color); + paint-order: stroke fill; + pointer-events: none; + font-family: monospace; + } + .summary-number { font-family: monospace; text-align: right; @@ -164,6 +224,12 @@ white-space: nowrap; } + #scale_hint { + font-weight: normal; + font-size: 80%; + filter: contrast(10%); + } + th { padding-bottom: 0.5rem; } @@ -185,6 +251,44 @@ #details th { vertical-align: bottom; white-space: pre; + position: sticky; + top: 0; + background-color: var(--background-color); + z-index: 2; + } + + #details th .th-date { + font-size: 78%; + font-weight: normal; + opacity: 0.55; + } + + /* Keep the two left columns (checkbox + query number / label) pinned to the + left, and the version/date header row pinned to the top, while scrolling the + wide table. The top-left corner cells need the highest z-index. */ + #details td:nth-child(1), #details td:nth-child(2) { + position: sticky; + background-color: var(--background-color); + z-index: 1; + } + #details th:nth-child(1), #details th:nth-child(2) { + z-index: 3; + } + #details td:nth-child(1), #details th:nth-child(1) { + left: 0; + width: 1.2rem; + text-align: left; /* so every checkbox (query, dataset, Total) shares the same left position */ + padding-left: 0.2rem; + padding-right: 0.2rem; + } + #details td:nth-child(2), #details th:nth-child(2) { + left: var(--qn-left, 1.6rem); /* set to column 1's real width in render() */ + } + /* Preserve the dataset-header band colour on the sticky left cells, and left-align + the dataset name (overriding the right-aligned #details td default). */ + #details tr.dataset-header td { + background-color: rgba(128, 128, 128, 0.18); + text-align: left; } #details td { @@ -220,7 +324,7 @@ box-shadow: 0 0 1rem var(--shadow-color); padding: 0.5rem 0.75rem; border-radius: 0.5rem; - z-index: 1; + z-index: 1000; text-align: left; white-space: normal; } @@ -233,14 +337,21 @@ .tooltip-query { left: 0; - width: 40rem; - margin-left: -3rem; + width: 50rem; + margin-left: 0; } - .note:hover .tooltip { + .note:hover .tooltip, .note:active .tooltip { visibility: visible; } + /* The query-number cell is a sticky cell (its own stacking context), so its + tooltip cannot rise above the sticky header/other sticky cells on its own. + Lift the whole cell above everything while hovered. */ + #details td.note:hover { + z-index: 1000; + } + .tooltip::after { content: " "; position: absolute; @@ -256,8 +367,7 @@ } .tooltip-query::after { - left: 3rem; - margin-left: 0.5rem; + left: 0.5rem; } .nowrap { @@ -285,209 +395,26 @@ font-size: 90%; } - + +
🌚🌞

ClickHouse Versions Benchmark

- Source | Report Mistake | Benchmark For Analytical DBMS | Hardware Benchmark + Source | Report Mistake | Benchmark For Analytical DBMS | Hardware Benchmark
@@ -497,11 +424,19 @@

ClickHouse Versions Benchmark

All + + + +
Dataset: + All +
Metric: Cold Run Hot Run + Load Time + Data Size
@@ -513,7 +448,8 @@

ClickHouse Versions Benchmark

version - Relative time (lower is better) + Relative query time (lower is better).
+ @@ -536,13 +472,31 @@

Detailed Comparison

-
-

This includes a combination of three benchmarks: MgBench, Star Schema Benchmark, New York Taxi Rides Benchmark and ClickBench.

-

Hardware used to run tests: x86_64 AWS m5.8xlarge Ubuntu 20.04.

-

In 23.7 sparse columns feature is enabled by default. Tables were populated again to utilize sparse columns.

-

Old versions had no support of these features/syntax: toISOWeek, SUBSTRING, EXTRACT, WITH. Queries were changed. All version runs use same queries.

-

Star Schema Benchmark Patrick O'Neil, Elizabeth (Betty) O'Neil and Xuedong Chen. "The Star Schema Benchmark," Online Publication of Database Generation program., January 2007. http://www.cs.umb.edu/~poneil/StarSchemaB.pdf

-

Summary of the 1.1 Billion Taxi Rides Benchmarks, Mark Litwintschikhttps://tech.marksblogg.com/benchmarks.html

+
+

About this benchmark

+

The same benchmark, on the same data, is run across every ClickHouse version to show how + performance has evolved over the years. Each version runs on a dedicated + AWS c7a.4xlarge machine (16 vCPU, 32 GB RAM) with a 1000 GB gp3 EBS volume + provisioned at 16000 IOPS and 1000 MB/s throughput. Every query runs once + cold (with the OS page cache dropped) and five times hot; the reported time is the fastest hot + run.

+

The datasets (each loaded into its own database), with their scale:

+
    +
  • hits — web-analytics page hits: 100 million rows, ~105 columns (the standard ClickBench table). 43 queries.
    • +
  • ssb — Star Schema Benchmark at scale factor 100, denormalized into a single lineorder_flat table (~600 million rows). 13 queries.
    • +
  • mgbench — Brown University MgBench: three log tables (server metrics, web requests, IoT device events). 15 queries.
    • +
  • uk — UK property price-paid records (~28 million rows). 3 queries.
    • +
  • ontime — US airline on-time flight performance. 11 queries.
    • +
  • taxi — New York City taxi trips, the full ~1.3 billion-row dataset. 4 queries.
    • +
  • coffeeshop — a synthetic coffee-shop sales star schema with a 500 million-row fact table. 17 queries.
    • +
  • tpch — TPC-H at scale factor 40 (~10 GB), 8 tables. 22 queries.
    • +
  • tpcds — TPC-DS at scale factor 32 (~10 GB), 24 tables. 103 queries.
    • +
  • job — Join Order Benchmark over the IMDb dataset, 21 tables. 113 queries.
    • +
+

The data is stored using only types available in the oldest releases, so one set of files + loads into every version. A query a version does not support (a missing function or syntax) is + recorded as no result, and a dataset that does not fully load on a version is skipped entirely + for it.