|
»
»
»
solr search
|
View:
New views
14 Messages
—
Rating Filter:
Alert me
|
 |
solr search
by manishkbawne
::
Rate this Message:
I am using solr search to search through xml files. As I am working on millions of data, the result output is slower. Can anyone please suggest me some way, by which I can increase the search result output?
|
|
|
Re: solr search
by Karsten F.
::
Rate this Message:
hi manishkbawne,
unspecific ideas of search improvements are her: http://wiki.apache.org/solr/SolrPerformanceFactors I really like the last idea in http://wiki.apache.org/lucene-java/ImproveSearchingSpeed : Use a profiler and ask a more specific question in this forum. Best regards Karsten
|
|
|
Re: solr search
by manishkbawne
::
Rate this Message:
Thanks for your reply .. I am trying to use the database for solr search but getting this error..
<abortOnConfigurationError>false</abortOnConfigurationError> in null ------------------------------------------------------------- java.lang.NullPointerException at org.apache.solr.handler.dataimport.DataImporter.<init>(DataImporter.java:95) at org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:106) at org.apache.solr.core.SolrResourceLoader Can you please suggest me some possible solution?
|
|
|
Re: solr search
by Karsten F.
::
Rate this Message:
Hi
I never used DBMS/SQL Import in solr by myself. Possible http://old.nabble.com/Using-DataImportHandler-with-mysql-database-to20425791.html#a20435463 can help you. regards Karsten
|
|
|
Re: solr search
by Lance Norskog-2
::
Rate this Message:
Please post your dataimporthandler configuration file.
On Fri, Oct 30, 2009 at 4:17 AM, manishkbawne <manish.bawne@...> wrote: > > Thanks for your reply .. I am trying to use the database for solr search but > getting this error.. > > <abortOnConfigurationError>false</abortOnConfigurationError> in null > ------------------------------------------------------------- > java.lang.NullPointerException at > org.apache.solr.handler.dataimport.DataImporter.<init>(DataImporter.java:95) > at > org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:106) > at org.apache.solr.core.SolrResourceLoader > > Can you please suggest me some possible solution? > > > > > > > > > Karsten F. wrote: >> >> hi manishkbawne, >> >> unspecific ideas of search improvements are her: >> http://wiki.apache.org/solr/SolrPerformanceFactors >> >> I really like the last idea in >> http://wiki.apache.org/lucene-java/ImproveSearchingSpeed >> : >> Use a profiler and ask a more specific question in this forum. >> >> Best regards >> Karsten >> >> >> >> manishkbawne wrote: >>> >>> I am using solr search to search through xml files. As I am working on >>> millions of data, the result output is slower. Can anyone please suggest >>> me some way, by which I can increase the search result output? >>> >> >> > > -- > View this message in context: http://old.nabble.com/solr-search-tp26125183p26128341.html > Sent from the Solr - User mailing list archive at Nabble.com. > > -- Lance Norskog goksron@... |
|
|
Re: solr search
by manishkbawne
::
Rate this Message:
Hi,
I have made following changes in solrconfig.xml <requestHandler name="/dataimport" class="org.apache.solr.handler.dataimport.DataImportHandler"> <lst name="defaults"> <str name="config">C:/Apache-Tomcat/apache-tomcat-6.0.20/solr/conf/db-data-config.xml</str> </lst> </requestHandler> in db-dataconfig.xml <dataConfig> <document name="id1"> <dataSource type="JdbcDataSource" driver="com.microsoft.sqlserver.jdbc.SQLServerDriver" url="jdbc:sqlserver://servername:1433/databasename" user="sa" password="pass@123"/> <entity name="id1" query="select id from be" > <field column="id" name="id1" /> </entity> </document> </dataConfig> in schema.xml files <field name="id1" type="string" indexes="true" default="none"/> Please suggest me the possible cause of error??
|
|
|
Re: solr search
by Lance Norskog-2
::
Rate this Message:
The problem is in db-dataconfig.xml. You should start with the example
DataImportHandler configuration fles. The structure is wrong. First there is a datasource, then there are 'entities' which fetch a document's fields from the datasource. On Fri, Oct 30, 2009 at 9:03 PM, manishkbawne <manish.bawne@...> wrote: > > Hi, > I have made following changes in solrconfig.xml > > <requestHandler name="/dataimport" > class="org.apache.solr.handler.dataimport.DataImportHandler"> > <lst name="defaults"> > <str > name="config">C:/Apache-Tomcat/apache-tomcat-6.0.20/solr/conf/db-data-config.xml</str> > </lst> > </requestHandler> > > > in db-dataconfig.xml > <dataConfig> > <document name="id1"> > <dataSource type="JdbcDataSource" > driver="com.microsoft.sqlserver.jdbc.SQLServerDriver" > url="jdbc:sqlserver://servername:1433/databasename" user="sa" > password="pass@123"/> > <entity name="id1" query="select id from be" > > <field column="id" name="id1" /> > </entity> > </document> > </dataConfig> > > in schema.xml files > <field name="id1" type="string" indexes="true" default="none"/> > > Please suggest me the possible cause of error?? > > > > > Lance Norskog-2 wrote: >> >> Please post your dataimporthandler configuration file. >> >> On Fri, Oct 30, 2009 at 4:17 AM, manishkbawne <manish.bawne@...> >> wrote: >>> >>> Thanks for your reply .. I am trying to use the database for solr search >>> but >>> getting this error.. >>> >>> <abortOnConfigurationError>false</abortOnConfigurationError> in null >>> ------------------------------------------------------------- >>> java.lang.NullPointerException at >>> org.apache.solr.handler.dataimport.DataImporter.<init>(DataImporter.java:95) >>> at >>> org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:106) >>> at org.apache.solr.core.SolrResourceLoader >>> >>> Can you please suggest me some possible solution? >>> >>> >>> >>> >>> >>> >>> >>> >>> Karsten F. wrote: >>>> >>>> hi manishkbawne, >>>> >>>> unspecific ideas of search improvements are her: >>>> http://wiki.apache.org/solr/SolrPerformanceFactors >>>> >>>> I really like the last idea in >>>> http://wiki.apache.org/lucene-java/ImproveSearchingSpeed >>>> : >>>> Use a profiler and ask a more specific question in this forum. >>>> >>>> Best regards >>>> Karsten >>>> >>>> >>>> >>>> manishkbawne wrote: >>>>> >>>>> I am using solr search to search through xml files. As I am working on >>>>> millions of data, the result output is slower. Can anyone please >>>>> suggest >>>>> me some way, by which I can increase the search result output? >>>>> >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://old.nabble.com/solr-search-tp26125183p26128341.html >>> Sent from the Solr - User mailing list archive at Nabble.com. >>> >>> >> >> >> >> -- >> Lance Norskog >> goksron@... >> >> > > -- > View this message in context: http://old.nabble.com/solr-search-tp26125183p26139946.html > Sent from the Solr - User mailing list archive at Nabble.com. > > -- Lance Norskog goksron@... |
|
|
Re: solr search
by manishkbawne
::
Rate this Message:
Thank you for your reply. I have corrected this error, but now I am getting this error --
HTTP Status 500 - Bad version number in .class file java.lang.UnsupportedClassVersionError: Bad version number in .class file at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass I have checked the java -version and javac -version. Both shows the same version 1.5.0_09. How to remove this error?
|
|
|
Re: solr search
by Noble Paul നോബിള് नोब्ळ्-2
::
Rate this Message:
start with the examples in the download. That should help
On Wed, Nov 4, 2009 at 11:14 AM, manishkbawne <manish.bawne@...> wrote: > > Thank you for your reply. I have corrected this error, but now I am getting > this error -- > > HTTP Status 500 - Bad version number in .class file > java.lang.UnsupportedClassVersionError: Bad version number in .class file at > java.lang.ClassLoader.defineClass1(Native Method) at > java.lang.ClassLoader.defineClass > > I have checked the java -version and javac -version. Both shows the same > version 1.5.0_09. > > How to remove this error? > > > > Lance Norskog-2 wrote: >> >> The problem is in db-dataconfig.xml. You should start with the example >> DataImportHandler configuration fles. >> >> The structure is wrong. First there is a datasource, then there are >> 'entities' which fetch a document's fields from the datasource. >> >> On Fri, Oct 30, 2009 at 9:03 PM, manishkbawne <manish.bawne@...> >> wrote: >>> >>> Hi, >>> I have made following changes in solrconfig.xml >>> >>> <requestHandler name="/dataimport" >>> class="org.apache.solr.handler.dataimport.DataImportHandler"> >>> <lst name="defaults"> >>> <str >>> name="config">C:/Apache-Tomcat/apache-tomcat-6.0.20/solr/conf/db-data-config.xml</str> >>> </lst> >>> </requestHandler> >>> >>> >>> in db-dataconfig.xml >>> <dataConfig> >>> <document name="id1"> >>> <dataSource type="JdbcDataSource" >>> driver="com.microsoft.sqlserver.jdbc.SQLServerDriver" >>> url="jdbc:sqlserver://servername:1433/databasename" >>> user="sa" >>> password="pass@123"/> >>> <entity name="id1" query="select id from be" > >>> <field column="id" name="id1" /> >>> </entity> >>> </document> >>> </dataConfig> >>> >>> in schema.xml files >>> <field name="id1" type="string" indexes="true" default="none"/> >>> >>> Please suggest me the possible cause of error?? >>> >>> >>> >>> >>> Lance Norskog-2 wrote: >>>> >>>> Please post your dataimporthandler configuration file. >>>> >>>> On Fri, Oct 30, 2009 at 4:17 AM, manishkbawne <manish.bawne@...> >>>> wrote: >>>>> >>>>> Thanks for your reply .. I am trying to use the database for solr >>>>> search >>>>> but >>>>> getting this error.. >>>>> >>>>> <abortOnConfigurationError>false</abortOnConfigurationError> in null >>>>> ------------------------------------------------------------- >>>>> java.lang.NullPointerException at >>>>> org.apache.solr.handler.dataimport.DataImporter.<init>(DataImporter.java:95) >>>>> at >>>>> org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:106) >>>>> at org.apache.solr.core.SolrResourceLoader >>>>> >>>>> Can you please suggest me some possible solution? >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> Karsten F. wrote: >>>>>> >>>>>> hi manishkbawne, >>>>>> >>>>>> unspecific ideas of search improvements are her: >>>>>> http://wiki.apache.org/solr/SolrPerformanceFactors >>>>>> >>>>>> I really like the last idea in >>>>>> http://wiki.apache.org/lucene-java/ImproveSearchingSpeed >>>>>> : >>>>>> Use a profiler and ask a more specific question in this forum. >>>>>> >>>>>> Best regards >>>>>> Karsten >>>>>> >>>>>> >>>>>> >>>>>> manishkbawne wrote: >>>>>>> >>>>>>> I am using solr search to search through xml files. As I am working >>>>>>> on >>>>>>> millions of data, the result output is slower. Can anyone please >>>>>>> suggest >>>>>>> me some way, by which I can increase the search result output? >>>>>>> >>>>>> >>>>>> >>>>> >>>>> -- >>>>> View this message in context: >>>>> http://old.nabble.com/solr-search-tp26125183p26128341.html >>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>> >>>>> >>>> >>>> >>>> >>>> -- >>>> Lance Norskog >>>> goksron@... >>>> >>>> >>> >>> -- >>> View this message in context: >>> http://old.nabble.com/solr-search-tp26125183p26139946.html >>> Sent from the Solr - User mailing list archive at Nabble.com. >>> >>> >> >> >> >> -- >> Lance Norskog >> goksron@... >> >> > > -- > View this message in context: http://old.nabble.com/solr-search-tp26125183p26191282.html > Sent from the Solr - User mailing list archive at Nabble.com. > > -- ----------------------------------------------------- Noble Paul | Principal Engineer| AOL | http://aol.com |
|
|
Re: solr search
by manishkbawne
::
Rate this Message:
Thank you again , but still my problem is not solved. When i run on the browser "http://localhost:9000/solr/dataimport". I get this page as-
<?xml version="1.0" encoding="UTF-8" ?> - <response> - <lst name="responseHeader"> <int name="status">0</int> <int name="QTime">0</int> </lst> - <lst name="initArgs"> - <lst name="defaults"> <str name="config">db-data-config.xml</str> - <lst name="datasource"> <str name="driver">com.microsoft.sqlserver.jdbc.SQLServerDriver</str> <str name="url">jdbc:sqlserver://192.168.20.31:1433/PDM_Source</str> <str name="user">sa</str> <str name="password">pass@123</str> </lst> </lst> </lst> <str name="status">DataImportHandler started. Not Initialized. No commands can be run</str> </response The changes that I have done in the db-dataconfig.xml file is :- <dataConfig> <document name="id1"> <!-- <entity name="be" query="select id from be "> <field column="id" name="id" /> </entity> --> </document> </dataConfig> when I run with these changes on the browser "http://localhost:9000/solr/admin/dataimport.jsp", I get this page :- <?xml version="1.0" encoding="UTF-8" ?> - <response> - <lst name="responseHeader"> <int name="status">0</int> <int name="QTime">31</int> </lst> - <lst name="initArgs"> - <lst name="defaults"> <str name="config">db-data-config.xml</str> - <lst name="datasource"> <str name="driver">com.microsoft.sqlserver.jdbc.SQLServerDriver</str> <str name="url">jdbc:sqlserver://192.168.20.31:1433/PDM_Source</str> <str name="user">sa</str> <str name="password">pass@123</str> </lst> </lst> </lst> <str name="command">full-import</str> <str name="mode">debug</str> <null name="documents" /> <str name="status">idle</str> <str name="importResponse">Configuration Re-loaded sucessfully</str> - <lst name="statusMessages"> <str name="Total Requests made to DataSource">0</str> <str name="Total Rows Fetched">0</str> <str name="Total Documents Processed">0</str> <str name="Total Documents Skipped">0</str> <str name="">Indexing completed. Added/Updated: 0 documents. Deleted 0 documents.</str> <str name="Committed">2009-11-05 16:39:15</str> <str name="Optimized">2009-11-05 16:39:15</str> <str name="Time taken">0:0:0.31</str> </lst> <str name="WARNING">This response format is experimental. It is likely to change in the future.</str> </response But when I uncomment the changes in db-dataconfig.xml file as <dataConfig> <document name="id1"> <entity name="be" query="select id from be "> <field column="id" name="id" /> </entity> </document> </dataConfig> I get this error HTTP Status 500 - Bad version number in .class file java.lang.UnsupportedClassVersionError: Bad version number in .class file at java.lang.ClassLoader.defineClass1 Please suggest me way to solve this error?? Manish Bawne Software Engineer Biz Integra systems pvt Ltd, Mumbai http://www.bizhandel.com Noble Paul നോബിള് नोब्ळ्-2 wrote: > > start with the examples in the download. That should help > > On Wed, Nov 4, 2009 at 11:14 AM, manishkbawne <manish.bawne@gmail.com> > wrote: >> >> Thank you for your reply. I have corrected this error, but now I am >> getting >> this error -- >> >> HTTP Status 500 - Bad version number in .class file >> java.lang.UnsupportedClassVersionError: Bad version number in .class file >> at >> java.lang.ClassLoader.defineClass1(Native Method) at >> java.lang.ClassLoader.defineClass >> >> I have checked the java -version and javac -version. Both shows the same >> version 1.5.0_09. >> >> How to remove this error? >> >> >> >> Lance Norskog-2 wrote: >>> >>> The problem is in db-dataconfig.xml. You should start with the example >>> DataImportHandler configuration fles. >>> >>> The structure is wrong. First there is a datasource, then there are >>> 'entities' which fetch a document's fields from the datasource. >>> >>> On Fri, Oct 30, 2009 at 9:03 PM, manishkbawne <manish.bawne@gmail.com> >>> wrote: >>>> >>>> Hi, >>>> I have made following changes in solrconfig.xml >>>> >>>> <requestHandler name="/dataimport" >>>> class="org.apache.solr.handler.dataimport.DataImportHandler"> >>>> <lst name="defaults"> >>>> <str >>>> name="config">C:/Apache-Tomcat/apache-tomcat-6.0.20/solr/conf/db-data-config.xml</str> >>>> </lst> >>>> </requestHandler> >>>> >>>> >>>> in db-dataconfig.xml >>>> <dataConfig> >>>> <document name="id1"> >>>> <dataSource type="JdbcDataSource" >>>> driver="com.microsoft.sqlserver.jdbc.SQLServerDriver" >>>> url="jdbc:sqlserver://servername:1433/databasename" >>>> user="sa" >>>> password="pass@123"/> >>>> <entity name="id1" query="select id from be" > >>>> <field column="id" name="id1" /> >>>> </entity> >>>> </document> >>>> </dataConfig> >>>> >>>> in schema.xml files >>>> <field name="id1" type="string" indexes="true" default="none"/> >>>> >>>> Please suggest me the possible cause of error?? >>>> >>>> >>>> >>>> >>>> Lance Norskog-2 wrote: >>>>> >>>>> Please post your dataimporthandler configuration file. >>>>> >>>>> On Fri, Oct 30, 2009 at 4:17 AM, manishkbawne <manish.bawne@gmail.com> >>>>> wrote: >>>>>> >>>>>> Thanks for your reply .. I am trying to use the database for solr >>>>>> search >>>>>> but >>>>>> getting this error.. >>>>>> >>>>>> <abortOnConfigurationError>false</abortOnConfigurationError> in null >>>>>> ------------------------------------------------------------- >>>>>> java.lang.NullPointerException at >>>>>> org.apache.solr.handler.dataimport.DataImporter.<init>(DataImporter.java:95) >>>>>> at >>>>>> org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:106) >>>>>> at org.apache.solr.core.SolrResourceLoader >>>>>> >>>>>> Can you please suggest me some possible solution? >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> Karsten F. wrote: >>>>>>> >>>>>>> hi manishkbawne, >>>>>>> >>>>>>> unspecific ideas of search improvements are her: >>>>>>> http://wiki.apache.org/solr/SolrPerformanceFactors >>>>>>> >>>>>>> I really like the last idea in >>>>>>> http://wiki.apache.org/lucene-java/ImproveSearchingSpeed >>>>>>> : >>>>>>> Use a profiler and ask a more specific question in this forum. >>>>>>> >>>>>>> Best regards >>>>>>> Karsten >>>>>>> >>>>>>> >>>>>>> >>>>>>> manishkbawne wrote: >>>>>>>> >>>>>>>> I am using solr search to search through xml files. As I am working >>>>>>>> on >>>>>>>> millions of data, the result output is slower. Can anyone please >>>>>>>> suggest >>>>>>>> me some way, by which I can increase the search result output? >>>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>>> -- >>>>>> View this message in context: >>>>>> http://old.nabble.com/solr-search-tp26125183p26128341.html >>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>> >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Lance Norskog >>>>> goksron@gmail.com >>>>> >>>>> >>>> >>>> -- >>>> View this message in context: >>>> http://old.nabble.com/solr-search-tp26125183p26139946.html >>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>> >>>> >>> >>> >>> >>> -- >>> Lance Norskog >>> goksron@gmail.com >>> >>> >> >> -- >> View this message in context: >> http://old.nabble.com/solr-search-tp26125183p26191282.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> > > > > -- > ----------------------------------------------------- > Noble Paul | Principal Engineer| AOL | http://aol.com > > Quoted from: http://old.nabble.com/solr-search-tp26125183p26191830.html |
|
|
Re: solr search
by Chantal Ackermann
::
Rate this Message:
Hi Manish,
is this a typo in your e-mail or is your config file really missing a hyphen? (Your repeating the name without second hyphen several times.) Cheers, Chantal manishkbawne schrieb: > <str name="config">db-data-config.xml</str> > > The changes that I have done in the db-dataconfig.xml file is :- |
|
|
Re: solr search
by manishkbawne
::
Rate this Message:
Thanks for assistance. Actually I installed jdk 6 and my problem was resolved. But now I am getting this exception:-
org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query: select PkMenuId from WCM_Menu Processing Document # 1 at org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.<init>(JdbcDataSource.java:186) at --- The changes the db-dataconfig.xml file are as :- <dataConfig> <document> <entity name="WCM_Menu" query="select PkMenuId from WCM_Menu" fetchSize="1"> <field column="PkMenuId" name="id1" /> </entity> </document> </dataConfig> I don't think, there is some problem with missing hyphen. Please anybody suggest me some way to resolve this error? Manish Bawne Software Engineer Biz Integra Systems www.bizhandel.com
|
|
|
Re: solr search
by Noble Paul നോബിള് नोब्ळ्-2
::
Rate this Message:
Please paste the complete stacktrace
On Fri, Nov 6, 2009 at 1:37 PM, manishkbawne <manish.bawne@...> wrote: > > Thanks for assistance. Actually I installed jdk 6 and my problem was > resolved. But now I am getting this exception:- > org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to > execute query: select PkMenuId from WCM_Menu Processing Document # 1 > at > org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.<init>(JdbcDataSource.java:186) > at --- > > The changes the db-dataconfig.xml file are as :- > <dataConfig> > <document> > <entity name="WCM_Menu" query="select PkMenuId from WCM_Menu" > fetchSize="1"> > <field column="PkMenuId" name="id1" /> > </entity> > </document> > </dataConfig> > > I don't think, there is some problem with missing hyphen. Please anybody > suggest me some way to resolve this error? > > Manish Bawne > Software Engineer > Biz Integra Systems > www.bizhandel.com > > > > > > > > > > > > Chantal Ackermann wrote: >> >> Hi Manish, >> >> is this a typo in your e-mail or is your config file really missing a >> hyphen? (Your repeating the name without second hyphen several times.) >> >> Cheers, >> Chantal >> >> manishkbawne schrieb: >>> <str name="config">db-data-config.xml</str> >>> >>> The changes that I have done in the db-dataconfig.xml file is :- >> >> > > -- > View this message in context: http://old.nabble.com/solr-search-tp26125183p26228077.html > Sent from the Solr - User mailing list archive at Nabble.com. > > -- ----------------------------------------------------- Noble Paul | Principal Engineer| AOL | http://aol.com |
|
|
Re: solr search
by manishkbawne
::
Rate this Message:
Thanks for your replies.My problem has been resolved. It was a sql server connection problem. I declared a variable "databasename" in the dataconfig.xml file and removed the database name from url.
Can anyone suggest me some good link or url for multiple indexing and spell check in solr? Manish Bawne Software Engineer Biz Integra Systems Pvt Ltd http://www.bizhandel.com
|
| Free embeddable forum powered by Nabble | Forum Help |
