Elysia Tools

Browse tools, examples, visual explainers, and topic guides from one clear workspace.

Top Categories

Hubs

Language
ZHDERUPTENFRES

Elysia Tools

Navigation

Data Analysis

Parquet Bloom Filter ZoneMap Dictionary and Column Statistics Pruner Evaluator

· Last updated:2026-09-06

Decode a Parquet thrift footer and quantify predicate-pushdown pruning: zone-map min/max, split-block bloom filters (XXH64), dictionary ratios and encodings, with per-row-group prune-savings estimates for example WHERE clauses.

Details

What this tool helps you do

A hand-rolled thrift compact protocol reader decodes the footer and walks every page header; statistics decode into real zone maps; bloom membership runs the actual XXH64 + SBBF arithmetic; predicates (=, !=, <, <=, >, >=, BETWEEN, IN) are scored per row group as pruned-by-zone-map, pruned-by-bloom or scan with byte costs from totalcompressedsize.

Execution

Run this tool

Fill in the form, run the tool, and review the result in one place.

Samples

Examples that match this tool

Related

Continue with connected tools and hubs

Written by the Elysia Tools team

Tool usage guide

Learn when to use this tool, what it supports, and how real users apply it.

Key facts

Category
Data Analysis
Input types
file, textarea
Output type
html
Sample coverage
4
API ready
Yes

Overview

The Parquet Bloom Filter ZoneMap Dictionary and Column Statistics Pruner Evaluator parses Apache Parquet Thrift footers to analyze metadata and measure predicate pushdown efficiency. It decodes column statistics into zone maps, executes XXH64 and split-block Bloom filter lookups, inspects dictionary encodings, and calculates exact row group skip savings in bytes for custom WHERE clauses.

When to use

  • When evaluating whether split-block Bloom filters or column min/max statistics are effectively pruning row groups on targeted queries.
  • When debugging query performance and scan bottlenecks across Parquet files written by engines like Arrow, DuckDB, or Spark.
  • When verifying dictionary encoding ratios and page-level column statistics before deploying analytical datasets to object storage.

How it works

  1. 1Upload a Parquet file to decode the Thrift compact protocol footer and parse column metadata across all row groups and page headers.
  2. 2Enter optional WHERE clauses with operators like =, !=, <, <=, >, >=, BETWEEN, or IN to test predicate pushdown rules.
  3. 3The engine performs XXH64 hashing and Split-Block Bloom Filter arithmetic against decoded zone maps and dictionary tables.
  4. 4Inspect the generated HTML report displaying per-row-group scan decisions, pruning causes, dictionary ratios, and byte savings based on total compressed size.

Use cases

  • Optimizing data lake layouts by measuring the pruning efficacy of sorting keys against column statistics and zone maps.
  • Auditing newly generated Parquet datasets to ensure Split-Block Bloom filters are properly serialized and non-empty.
  • Estimating network and I/O byte reduction when applying selective WHERE clauses against partition files in cloud storage.

Examples

1. Evaluate Bloom filter and zone map pruning on multi-row-group files

Data Platform Engineer

Background

A data engineer wants to verify whether point queries on an ID column are pruned by zone maps or Bloom filters across multiple row groups.

Problem

Unclear whether query engines will prune row groups or scan entire partitions for point lookups.

How to use

Upload the Parquet file and supply target WHERE clauses in the predicates text area.

id = 75
id > 60
name = 'zeta'

Outcome

Receives an HTML report showing row group 0 pruned by zone maps, Bloom filter hit details, and the exact byte savings achieved.

2. Audit dictionary encodings and zone maps on Arrow-written Parquet

Database Optimizer

Background

An analyst is checking column compression and dictionary encoding efficiency on an Arrow table export.

Problem

Need to confirm whether an equality filter falls within column min/max bounds and if missing Bloom filters cause full scans.

How to use

FAQ

Which SQL predicate operators are supported?

The evaluator supports =, !=, <, <=, >, >=, BETWEEN a AND b, and IN (x, y) predicates formatted as one clause per line.

How does the tool evaluate Split-Block Bloom Filters?

It extracts raw SBBF byte blocks from the footer/pages, hashes predicate literals using XXH64, and tests bit set membership directly.

What determines whether a row group is pruned or scanned?

A row group is pruned if the predicate falls outside min/max zone maps or fails the Bloom filter test; otherwise, it is marked for scan.

What is the maximum supported file upload size?

The tool accepts Parquet files up to 100 MB (104,857,600 bytes).

How are byte savings calculated for skipped row groups?

Byte savings are calculated by summing the total_compressed_size metadata values of row groups that are fully pruned by filters or zone maps.

Home
Tools3212
Samples593
Visualizations471
Viewers103
Hubs239
Tags333
Images, Audio & Video657

Image, audio, and video processing, conversion, and optimization tools

Math, Date & Finance647

Calculators, numerics, date logic, statistics, and finance tools

Design & Color298

Color, layout, graphics, visual styling, and design helper tools

Text & Writing209

Writing, cleanup, formatting, extraction, and text analysis tools

Developer & Web193

Developer utilities, networking, web debugging, and automation helpers

Conversion & Encoding175

Format, file, archive, unit, and encoding conversion tools

Lead Generation Quiz Launch and Contact Handoff
Memorial Drafts: Family Review and Print Handoff
Private Habit Records: Backup, Restore and Sharing Review
Article to X and LinkedIn Drafts: Fact Review and Handoff
Markdown Interactive Deck Review and Offline Handoff

© 2026 Elysia Tools. All rights reserved.

DocsPricingAboutTerms of ServicePrivacy PolicyCookiesContact
Data Analysis

Parquet Pruning Samples

Parquet fixtures exercising the bloom filter, zone map and dictionary pruning evaluator

Java

Android Image Processing Java Samples

Android Java image processing examples including reading/saving images, scaling, and format conversion

Kotlin

Android Image Processing Kotlin Samples

Android Kotlin image processing examples including reading/saving images, scaling, and format conversion

Python

Web Image Processing Python Samples

Web Python image processing examples using PIL/Pillow including reading, saving, resizing, and format conversion

Design

Social Media Template Resize Grid Composer

One master image in, a full multi-platform asset kit out — every crop previewed with verified safe-zone overlays and shipped as a ZIP.

Media

HDR AVIF to SDR PNG Tone Mapper

Decode PQ or HLG AVIF, convert BT.2020 to sRGB, and tone map highlights into a viewable SDR PNG.

Media

Batch Image Compress

Compress multiple images with quality control, output format selection, and size optimization

Development

Data URI Generator

Convert files into Data URIs (Base64 or percent-encoded) for inlining images, fonts, and assets directly into HTML, CSS, or Markdown

Upload the generated .parquet file and add the equality predicate into the query input.

product = 'Keyboard'

Outcome

Generates a detailed summary of dictionary pages, RLE encodings, zone map ranges, and indicates that the row group must be scanned.