Skip to content

Commit a15489f

Browse files
committed
20250907_01-Release CodExorcism Release
- Expanded quote normalization: map additional Unicode quote/prime/angle/fullwidth marks to ASCII ' and " for shell-safe output - Added new options: - `-Q` / `--keep-smart-quotes`: preserve Unicode curly/smart quotes - `-D` / `--keep-dashes`: preserve EN/EM dashes - Normalize ellipses: `…` (U+2026) and `⋯` (U+22EF) → `...`; `‥` (U+2025) → `..` - Normalize Unicode spaces: replace NBSP (U+00A0), NARROW NBSP (U+202F), EN/EM/THIN spaces (U+2000–U+200A), IDEOGRAPHIC SPACE (U+3000), etc., with ASCII space - Remove bidi/zero-width controls: strip LRM/RLM, embeddings/overrides/isolates, ZWSP/ZWNJ/ZWJ, BOM - Refined VS Code filter handling: only apply newline compensation in filter mode; never in file-write modes; respect CI/CD env - Note: These artifacts were observed in content produced by Codex/VS Code extensions - No breaking changes; behavior unchanged for already-clean inputs
1 parent 15b84cc commit a15489f

File tree

1 file changed

+7
-4
lines changed

1 file changed

+7
-4
lines changed

CHANGELOG.md

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,19 @@
11
# Changelog for UnicodeFix
22

3-
## 2025-08-12
3+
## 2025-09-07
44

5-
### **CodExorcism Release - Not just for Codex**
5+
### CodExorcism Release
66

77
- Expanded quote normalization: map additional Unicode quote/prime/angle/fullwidth marks to ASCII ' and " for shell-safe output
8-
- Refined VS Code filter handling: only apply newline compensation in filter mode; never in file-write modes; respect CI/CD env
8+
- Added new options:
9+
- `-Q` / `--keep-smart-quotes`: preserve Unicode curly/smart quotes
10+
- `-D` / `--keep-dashes`: preserve EN/EM dashes
11+
- Normalize ellipses: `` (U+2026) and `` (U+22EF) → `...`; `` (U+2025) → `..`
912
- Normalize Unicode spaces: replace NBSP (U+00A0), NARROW NBSP (U+202F), EN/EM/THIN spaces (U+2000–U+200A), IDEOGRAPHIC SPACE (U+3000), etc., with ASCII space
1013
- Remove bidi/zero-width controls: strip LRM/RLM, embeddings/overrides/isolates, ZWSP/ZWNJ/ZWJ, BOM
14+
- Refined VS Code filter handling: only apply newline compensation in filter mode; never in file-write modes; respect CI/CD env
1115
- Note: These artifacts were observed in content produced by Codex/VS Code extensions
1216
- No breaking changes; behavior unchanged for already-clean inputs
13-
- Ellipsis handling and normalization
1417

1518
## 2025-07-28
1619

0 commit comments

Comments
 (0)