Placing a CSV file into SOLR Server

View: New views
4 Messages — Rating Filter:   Alert me  

Placing a CSV file into SOLR Server

by Anand Kumar Prabhakar :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Is there any way to Place the CSV file to index in the SOLR Server so that the file can be indexed and searched. If so please let me know the location in which we have to place the file. We are looking for a workaround to avoid the HTTP request to the SOLR server as it is taking much time.

Re: Placing a CSV file into SOLR Server

by Yonik Seeley-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

from: http://wiki.apache.org/solr/UpdateCSV
"""
The following request will cause Solr to directly read the input file:

curl http://localhost:8983/solr/update/csv?stream.file=exampledocs/books.csv&stream.contentType=text/plain;charset=utf-8
#NOTE: The full path, or a path relative to the CWD of the running
solr server must be used.
"""

So you can put it anywhere local and give solr the full path to
directly read it.

-Yonik
http://www.lucidimagination.com



On Wed, Jul 8, 2009 at 8:34 AM, Anand Kumar
Prabhakar<anand2485@...> wrote:

>
> Is there any way to Place the CSV file to index in the SOLR Server so that
> the file can be indexed and searched. If so please let me know the location
> in which we have to place the file. We are looking for a workaround to avoid
> the HTTP request to the SOLR server as it is taking much time.
> --
> View this message in context: http://www.nabble.com/Placing-a-CSV-file-into-SOLR-Server-tp24390648p24390648.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>

Re: Placing a CSV file into SOLR Server

by Anand Kumar Prabhakar :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Thank you for the input Yonik, anyway again we are sending an HTTP request to the server, my requirement is to skip the HTTP request to the SOLR server.
Is there any way to avoid these HTTP requests?


Yonik Seeley-2 wrote:
from: http://wiki.apache.org/solr/UpdateCSV
"""
The following request will cause Solr to directly read the input file:

curl http://localhost:8983/solr/update/csv?stream.file=exampledocs/books.csv&stream.contentType=text/plain;charset=utf-8
#NOTE: The full path, or a path relative to the CWD of the running
solr server must be used.
"""

So you can put it anywhere local and give solr the full path to
directly read it.

-Yonik
http://www.lucidimagination.com



On Wed, Jul 8, 2009 at 8:34 AM, Anand Kumar
Prabhakar<anand2485@gmail.com> wrote:
>
> Is there any way to Place the CSV file to index in the SOLR Server so that
> the file can be indexed and searched. If so please let me know the location
> in which we have to place the file. We are looking for a workaround to avoid
> the HTTP request to the SOLR server as it is taking much time.
> --
> View this message in context: http://www.nabble.com/Placing-a-CSV-file-into-SOLR-Server-tp24390648p24390648.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>

Re: Placing a CSV file into SOLR Server

by Yonik Seeley-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Wed, Jul 8, 2009 at 9:33 AM, Anand Kumar
Prabhakar<anand2485@...> wrote:
> Thank you for the input Yonik, anyway again we are sending an HTTP request to
> the server, my requirement is to skip the HTTP request to the SOLR server.
> Is there any way to avoid these HTTP requests?

You're sending a tiny HTTP request to the server that tells Solr to
directly read the big CSV file from disk... that should satisfy the
requirement which seemed to stem from the desire to avoid network
overhead, no?

-Yonik
http://www.lucidimagination.com