Configurable strips

[sveredyuk]

Fixed #106

[sveredyuk]

Hi, @dblock any chance to fix CI ?

[dblock]

I'm really not actively involved in this project, I just brought it into the mongoid org. But if nobody steps up I could help out maybe. Would appreciate some PRs and happy to look and merge for trivial things like CI of course.

[sveredyuk]

@dblock Thx

[rtrv]

@sveredyuk check out Travis result. Your last commit "Sort filtered keys" damages functionality. And I suppose it's out of "configurable strips" feature scope. Without that change all tests are passing well

[sveredyuk]

@rtrv Hm... ok. I'll try to revert it. It was so time ago that I really don't remember why this code was changed but not committed.

[Mohakjuneja]

@sveredyuk I have an abbreviation field in my search criteria. However, an abbreviation such as B.E. is saved as two different keywords 'B' and 'E'. How can I ignore the dots while creating keywords for this field using configurable strips?

[sveredyuk]

@ Mohakjuneja You need one keyword like "BE" ?

[rtrv]

@Mohakjuneja here is the default configuration for gem initialization:

config.strip_symbols = /[._:;'\"`,?|+={}()!@#%^&*<>~\$\-\\\/\[\]]/

You can just remove the dot out of the regex:

config.strip_symbols = /[_:;'\"`,?|+={}()!@#%^&*<>~\$\-\\\/\[\]]/

Then you'll be able to search for "B.E." including dots and from the string Example string. the following keywords will be extracted: example and string. with a dot. If you want to search for BE, change config.strip_accents from the default:

config.strip_accents = /[^\s\p{Alnum}]/

To the following, adding the dot:

config.strip_accents = /[.^\s\p{Alnum}]/

Don't forget to reindex by

$ rake mongoid_search:index

[Mohakjuneja]

Thank you so much! That works!

[rgaufman]

Any suggestion how to change the above to correctly index MAC addresses and IP addresses?

When I try the above,I get this :( <

test(staging)> Camera.active.map(&:_keywords)
=> [[], [], [], [], [], [], [], [], [":::::"], [], [":::::"], [":::::"], [":::::"]]

[rgaufman]

Ah, this does what I want:

    config.strip_symbols = /[_;'\"`,?|+={}()!@#%^&*<>~\$\-\\\/\[\]]/
    config.strip_accents = /[^\s\p{Alnum}.:]/