Skip to content

EZP-31248: Fixed handling non-printable characters for Search #2904

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
alongosz merged 10 commits into from
May 6, 2020
Merged

EZP-31248: Fixed handling non-printable characters for Search #2904

Changes from 2 commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
daf5bf0
EZP-31248 Remove all non-printable characters
hgiesenow Dec 19, 2019
5f378de
Added space replace for tab, horizontal tab and form feed
mateuszbieniek Apr 21, 2020
36853c0
Added test + some refactoring
mateuszbieniek Apr 22, 2020
43b0d9d
Update eZ/Publish/API/Repository/Tests/SearchServiceLocationTest.php
mateuszbieniek Apr 22, 2020
865ed96
Update eZ/Publish/API/Repository/Tests/SearchServiceLocationTest.php
mateuszbieniek Apr 22, 2020
63115c9
Update eZ/Publish/API/Repository/Tests/SearchServiceLocationTest.php
mateuszbieniek Apr 22, 2020
e9641fb
Fixed broken tests
mateuszbieniek Apr 27, 2020
4f7f26e
Added test with escaped string + CS fixes
mateuszbieniek May 5, 2020
898b701
Changed condition for test to skip
mateuszbieniek May 5, 2020
2c2c6c3
Replaced AND with &&
mateuszbieniek May 5, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 9 additions & 2 deletions eZ/Publish/Core/Search/Common/FieldValueMapper/StringMapper.php
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -51,9 +51,16 @@ public function map(Field $field)
*/
protected function convert($value)
{
// Remove non-printable characters
// Replace tab, vertical tab, form-feed chars to single space.
$value = preg_replace(
'([\x09\x0B\x0C]+)',
' ',
(string)$value
);

// Remove non-printable characters (except LF and CR).
return preg_replace(
'([\x00-\x09\x0B\x0C\x1E\x1F]+)',
'([\x00-\x08\x0E-\x1F]+)',
'',
(string)$value
);
Expand Down