search suggestion - Solr (Open Solr) suggester results contain punctuation marks -

-

i'm working on suggester , results i'm gettig contain punctuation. example, when type "volcan" get:

"volcanoes", "volcanic", "volcano", "volcano,", <- comma "volcanoes." <- period/full stop

here code in solrconfig.xml file:

<searchcomponent class="solr.spellcheckcomponent" name="suggest">   <lst name="spellchecker">     <str name="name">suggest</str>     <str name="classname">org.apache.solr.spelling.suggest.suggester</str>     <str name="lookupimpl">org.apache.solr.spelling.suggest.tst.tstlookup</str>     <str name="field">text</str>     <float name="threshold">0.005</float>     <str name="buildoncommit">true</str>   </lst> </searchcomponent> <requesthandler class="org.apache.solr.handler.component.searchhandler" name="/suggest">   <lst name="defaults">     <str name="echoparams">explicit</str>     <str name="spellcheck">true</str>     <str name="spellcheck.dictionary">suggest</str>     <str name="spellcheck.onlymorepopular">true</str>     <str name="spellcheck.count">5</str>     <str name="spellcheck.collate">true</str>   </lst>   <lst name="invariants">       <!-- run suggester queries handler -->       <str name="spellcheck">true</str>       <!-- collate not needed, query if tokenized keyword, need suggestions term -->       <str name="spellcheck.collate">false</str>   </lst>   <arr name="components">     <str>suggest</str>   </arr> </requesthandler>

in schema.xml file have this:

<fieldtype name="spell" class="solr.textfield" positionincrementgap="100" indexed="true" stored="false" multivalued="true" termvectors="true" termpositions="true" termoffsets="true">   <analyzer type="index">     <tokenizer class="solr.standardtokenizerfactory"/>     <filter class="solr.stopfilterfactory" ignorecase="true" words="stopwords.txt"/>     <filter class="solr.standardfilterfactory"/>     <filter class="solr.removeduplicatestokenfilterfactory"/>     <filter class="solr.shinglefilterfactory"                     minshinglesize="2"                     maxshinglesize="4"                     outputunigrams="true"                     outputunigramsifnoshingles="true"/>     <filter class="solr.lowercasefilterfactory"/>   </analyzer>   <analyzer type="query">     <tokenizer class="solr.keywordtokenizerfactory"/>     <filter class="solr.synonymfilterfactory" synonyms="synonyms.txt" ignorecase="true" expand="true"/>     <filter class="solr.trimfilterfactory"/>     <filter class="solr.stopfilterfactory" ignorecase="true" words="stopwords.txt"/>     <filter class="solr.standardfilterfactory"/>     <filter class="solr.removeduplicatestokenfilterfactory"/>     <filter class="solr.lowercasefilterfactory"/>   </analyzer> </fieldtype>

and result is:

{     "responseheader": {         "status": 0,         "qtime": 0,         "params": {             "wt": "json",             "q": "volcan"         }     },     "spellcheck": {         "suggestions": [             "volcan",             {                 "numfound": 5,                 "startoffset": 0,                 "endoffset": 6,                 "suggestion": [                     "volcanoes",                     "volcanic",                     "volcano",                     "volcano,",                     "volcanoes."                 ]             }         ]     } }

the problem not on requesthandler... rather, seems reside in way you're indexing files go spell field, , maybe spell field it's self. i'm thinking should enable tokenizer strips out punctuation fields.

here's spell field definition works me in schema.xml

<fieldtype name="spell" class="solr.textfield" positionincrementgap="100">   <analyzer type="index">     <tokenizer class="solr.standardtokenizerfactory"/>     <filter class="solr.stopfilterfactory" ignorecase="true" words="stopwords.txt"/>     <filter class="solr.standardfilterfactory"/>     <filter class="solr.removeduplicatestokenfilterfactory"/>   </analyzer>   <analyzer type="query">     <tokenizer class="solr.standardtokenizerfactory"/>     <filter class="solr.synonymfilterfactory" synonyms="synonyms.txt" ignorecase="true" expand="true"/>     <filter class="solr.stopfilterfactory" ignorecase="true" words="stopwords.txt"/>     <filter class="solr.standardfilterfactory"/>     <filter class="solr.removeduplicatestokenfilterfactory"/>   </analyzer> </fieldtype>

Comments

Post a Comment

Popular posts from this blog

matlab - "Contour not rendered for non-finite ZData" -

-
i'm trying plot frequency characteristic equation using ezplot, matlab gives following warning, "contour not rendered non-finite zdata". have used command plot frequency equations warning , plot display empty , not change axis range well. can please help. appreciated. here's code i'm using. % transfer matrix case-i, thin rotor clear all; clc; ei = 1626; l = 0.15; m = 0.44108; = 2.178*10^-4; i_p = 2.205*10^-5; itr = 0.24; i_pr = 0.479; syms p n; f = [1 l*1i l^2/(2*ei)*1i l^3/(6*ei); 0 1 l/ei -l^2/(2*ei)*1i; 0 0 1 -l*1i; 0 0 0 l]; p = [ 1 0 0 0; 0 1 0 0; 0 -it*p^2+i_p*n*p 1 0; -m*p^2 0 0 1]; p_r = [1 0 0 0; 0 1 0 0; 0 -itr*p^2+i_pr*n*p 1 0; -m*p^2 0 0 1]; = f*p*f*p*f*p*f; b = p_r*f*p*f*p*f; r = a(1,2)/a(1,4); a12_p = 0; a22_p = a(2,2)-r*a(2,4); a32_p = a(3,2)-r*a(3,4); a42_p = a(4,2)-r*a(4,4); ap(2,2) = a22_p; ap(3,2) = a32_p; ap(4,2) = a42_p; ap(4,4) = 1; c = b*ap; m = [c(3,2) c(3,4); c(4,2) c(4,...
Read more

delphi - Indy UDP Read Contents of Adata -

-
i using indy udp server read string of data. however, not know how work adata parameter. can around converting binary using bytetobin function below , convert hex using bintohex1 . feel stupid , works slow. know how can directly results without 2 conversions? thanks!! here codes: procedure tform1.idudpserver1udpread(athread: tidudplistenerthread; const adata: tidbytes; abinding: tidsockethandle); var buf: tidbytes; buffer: string; data_received: string; begin if bytestostring(adata) <> 'hello' begin buffer := hextostring('00'); setlength(buf, length(buffer)); copytidstring(buffer, buf, 0); abinding.sendto(abinding.peerip, abinding.peerport, buf); data_received := bintohex1(bytetobin(adata[1]) + bytetobin(adata[2]) + bytetobin(adata[3]) + bytetobin(adata[4]) + bytetobin(adata[5]) + bytetobin(adata[6]) + bytetobin(adata[7]) + bytetobin(adata[8]) + bytetobin(adata[9]) + bytetobin(adata[10]) + bytetobin(adata[11...
Read more

qt - How to embed QML toolbar and menubar into QMainWindow -

-
i using qwt library plot data. seems not possible embed qwidget qml quick 2 . so, decided create qmainwindow main window , create toolbar , menubar using quick controls . how should embed qml toolbar , menubar qmainwindow ? you should create qml applicationwindow qml menubar , toolbar main.qml applicationwindow { visible: false menubar: menubar { menu { title: "edit" menuitem { text: "cut" } } } toolbar: toolbar { row { anchors.fill: parent toolbutton { iconsource: "1.png" } } } } main.cpp qapplication app(argc, argv); qqmlapplicationengine engine; engine.load(qurl(qstringliteral("qrc:///main.qml"))); then pointer applicationwindow qwindow *qmlwindow = qobject_cast<qwindow*>(engine.rootobjects().at(0)); create window container, using qwidget::createwindowco...
Read more