Elysia Tools

Browse tools, examples, visual explainers, and topic guides from one clear workspace.

Top Categories

Hubs

Language
ZHDERUPTENFRES

Elysia Tools

Navigation

Text Processing

Text Encoding Forensics and Repair

· Last updated:2026-08-02

Inspect text encoding, BOM, newline style and mojibake symptoms, then produce a scored local repair candidate.

Execution

Run this tool

Fill in the form, run the tool, and review the result in one place.

Samples

Examples that match this tool

Related

Continue with connected tools and hubs

Written by the Elysia Tools team

Tool usage guide

Learn when to use this tool, what it supports, and how real users apply it.

Key facts

Category
Text Processing
Input types
textarea, file, select, checkbox
Output type
json
Sample coverage
4
API ready
Yes

Overview

Text Encoding Forensics and Repair inspects pasted text or supported text files for encoding issues, BOM markers, newline styles, and mojibake symptoms, then returns a JSON result with a local repair candidate and diagnostics.

When to use

  • Repair UTF-8 mojibake such as "Café" when the original text was decoded incorrectly.
  • Detect and normalize BOM markers and line endings in text, CSV, JSON, or Markdown files.
  • Check an unknown text encoding before choosing UTF-8, UTF-16, GB18030, Windows-1252, or ISO-8859-1.

How it works

  1. 1Paste text into the input or upload a supported text, CSV, JSON, or Markdown file.
  2. 2Choose automatic detection or specify the source encoding.
  3. 3Select automatic mojibake repair, BOM and newline normalization, or text preservation.
  4. 4Review the JSON output, including repaired text and encoding, BOM, newline, or mojibake diagnostics when available.

Use cases

  • Recover readable accented characters from incorrectly decoded UTF-8 text.
  • Standardize mixed text files by removing a BOM and converting Windows CRLF endings to Unix LF.
  • Inspect imported data before saving or passing it to another text-processing workflow.

Compare alternatives

  • Forecast future periods from CSV or JSON time-series data and inspect trend, seasonal, and residual decomposition in one report

  • Group CSV data by specified columns with aggregation options.

  • Transform and process CSV data with column operations, calculations, and data type conversions.

Who it's for

Best for

  • Analyze CSV files in the browser.
  • Workflows where Source Encoding matters, such as Automatic Detection or UTF-8.
  • The “Repair UTF-8 mojibake” workflow, done in one pass.

Not ideal for

  • Fully automated batch jobs — this page is built for interactive use; use the API endpoint for scripts.
  • Files in formats this tool does not accept — it works with .txt, .csv, .json, .md input.

Edge cases & common failures

  • Byte-order mark (BOM)

    A UTF-8 BOM at the start of the file can appear as odd characters in the first header name.

  • Very large files

    Large files take longer and can hit browser memory limits — try a smaller sample first.

  • Skipping the output check

    Compare the first rows or pages of the output with the input before using it in production.

Examples

1. Repair UTF-8 mojibake

Content editor

Background

A text snippet contains incorrectly decoded accented characters, including "Café déjà vu".

Problem

The text is difficult to read and needs a reversible local repair.

How to use

Paste the text, keep Source Encoding set to Automatic Detection, choose Automatic Mojibake Repair, preserve newlines, and enable Remove BOM.

sourceEncoding: auto; repairMode: auto; newlineMode: preserve; removeBom: true

Outcome

The JSON result includes repairedText as "Café déjà vu" with a mojibakeScoreAfter of 0.

2. Normalize BOM and Windows newlines

Data engineer

Background

A UTF-8 text value begins with a BOM and uses CRLF line endings.

Problem

The content must use LF line endings without the leading BOM.

How to use

Paste the text, select UTF-8, choose Normalize BOM and Newlines, set Newline Output to LF, and enable Remove BOM.

FAQ

What input can I use?

You can paste text or upload one text/plain, text/csv, application/json, or text/markdown file up to 10 MB.

Which encodings are supported?

The tool supports automatic detection, UTF-8, UTF-16LE, UTF-16BE, GB18030/GBK, Windows-1252, and ISO-8859-1.

Can it repair mojibake?

Yes. Automatic Mojibake Repair scores a local reversible repair candidate and returns the best result.

Can I change line endings?

Yes. You can preserve the original style or output LF or CRLF line endings.

Can I remove a BOM?

Yes. Enable Remove BOM to remove a leading BOM and report whether it was removed.

Home
Tools3212
Samples593
Visualizations471
Viewers103
Hubs239
Tags333
Images, Audio & Video657

Image, audio, and video processing, conversion, and optimization tools

Math, Date & Finance647

Calculators, numerics, date logic, statistics, and finance tools

Design & Color298

Color, layout, graphics, visual styling, and design helper tools

Text & Writing209

Writing, cleanup, formatting, extraction, and text analysis tools

Developer & Web193

Developer utilities, networking, web debugging, and automation helpers

Conversion & Encoding175

Format, file, archive, unit, and encoding conversion tools

Lead Generation Quiz Launch and Contact Handoff
Memorial Drafts: Family Review and Print Handoff
Private Habit Records: Backup, Restore and Sharing Review
Article to X and LinkedIn Drafts: Fact Review and Handoff
Markdown Interactive Deck Review and Offline Handoff

© 2026 Elysia Tools. All rights reserved.

DocsPricingAboutTerms of ServicePrivacy PolicyCookiesContact
Document

PDF Samples

Generated PDF samples from tools dated 2026-02-01 to 2026-02-10

Data

CSV Samples

Sample CSV files with various data types, sizes, and complexity levels

Programming Languages

Python Samples

Essential Python code examples and Hello World demonstrations

text-processing

Hex/Unicode Encoding Format Samples

Examples of hex (\xXX) and unicode (\uXXXX) escape sequence encoding formats

AI

AI Token Estimator

Analyze language mix and estimate token usage across OpenAI, Codex, Claude, and DeepSeek profiles

Data Processing

BOM Character Remover

Remove BOM (Byte Order Mark) characters from text and file content. Perfect for cleaning up text files that have encoding issues, fixing CSV imports, and preparing data for processing. Features: - Detect and remove UTF-8 BOM (EF BB BF) - Detect and remove UTF-16 BOM (FE FF or FF FE) - Detect and remove UTF-32 BOM (00 00 FE FF or FF FE 00 00) - Support multiple input formats - Visual BOM character display - Detailed detection report - Support for batch text processing Common Use Cases: - Fix CSV file import errors - Clean up text file encoding issues - Prepare data for JSON parsing - Fix XML parsing problems - Resolve API data encoding conflicts - Standardize text data format

Text Processing

Messy Text to Structured Data Workbench

Infer tables from pasted text, mixed delimiters, key-value lines, or HTML and export CSV, JSON, and Markdown.

Data Processing

TXT File Merger

Merge multiple text files with various strategies (concatenate, interleave, etc.)

sourceEncoding: utf-8; repairMode: normalize; newlineMode: lf; removeBom: true

Outcome

The result contains "line one\nline two\n", reports that the BOM was removed, and identifies the original newline style as CRLF.

3. Inspect an uploaded text file

Developer

Background

A developer receives a text, CSV, JSON, or Markdown file with unclear character encoding.

Problem

The source encoding and newline style need to be checked before further use.

How to use

Upload the supported file, leave Source Encoding on Automatic Detection, select Preserve Text, and keep the original newline style.

Outcome

The JSON output provides the inspected text and available encoding, BOM, newline, or mojibake diagnostics without requesting a repair.

Time Series Forecast & Seasonality Analyzer
CSV Data Grouper
CSV Transformer