Follow up on the unresolved Copilot review findings in PR #593.
Investigate and add focused regression coverage for all four concerns together:
- Preserve extraction of ASCII emails before sentence punctuation without accepting a partial email/TLD match.
- Treat a preceding non-ASCII UTF-16LE code unit as a left boundary even when its low byte is ASCII alphanumeric.
- Define and test the UTF-16 trailing-context behavior for unaligned following bytes and sentence punctuation; compare it with the corresponding UTF-16 URL rule before changing the lexer rule.
- Strengthen accepted UTF-16 length-limit tests to assert the exact emitted
email.txt feature and offset, not merely non-empty output.
Document the boundary cases chosen and verify that the change does not increase partial-email false positives.
Follow up on the unresolved Copilot review findings in PR #593.
Investigate and add focused regression coverage for all four concerns together:
email.txtfeature and offset, not merely non-empty output.Document the boundary cases chosen and verify that the change does not increase partial-email false positives.