Custom EventList for huge datasets?

[Daniel Rampanelli]

Hi,

I'm working on a client-server application and I use several virtual SWT tables to display the data from the database. Since the application will handle huge datasets (over 50.000), I was thinking about improving the performance even more.

Right now I load the whole data at the start of the application which result in fast sorting/filtering but the initalization of the table is rather slow. I have even implemented a "paging" concept by using RangeList.

I was thinking about creating a custom EventList that would query the database only for the necessary rows. This would even apply for filtering and sorting.

Has anyone suggestions for my problem? Or maybe does something similar already exist?

Thank you in advance,
Daniel

[James Lemieux]

Hey Daniel. It is certainly possible to do this with a custom EventList, but I don't think it's necessary to model it as one. I'd keep the parts of your pipeline stock and write a "service" that you can ask to fetch data and dump into your "standard" pipeline. That said, of course filtering and sorting look much different than what FilterList and SortedList provide (maybe they're just calls to your "service" to fetch new data?).

Just a thought...

James

On Fri, Jul 3, 2009 at 12:51 AM, Daniel Rampanelli <daniel.rampanelli@...> wrote:

Hi,

I'm working on a client-server application and I use several virtual SWT
tables to display the data from the database. Since the application will
handle huge datasets (over 50.000), I was thinking about improving the
performance even more.

Right now I load the whole data at the start of the application which result
in fast sorting/filtering but the initalization of the table is rather slow.
I have even implemented a "paging" concept by using RangeList.

I was thinking about creating a custom EventList that would query the
database only for the necessary rows. This would even apply for filtering
and sorting.

Has anyone suggestions for my problem? Or maybe does something similar
already exist?

Thank you in advance,
Daniel
--
View this message in context: http://www.nabble.com/Custom-EventList-for-huge-datasets--tp24319091p24319091.html
Sent from the GlazedLists - User mailing list archive at Nabble.com.


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@...
For additional commands, e-mail: users-help@...

[Daniel Rampanelli]

Mmmmh I'm not sure I understand completely your point. Do you mean to use standard lists and simply assign them the results of the server-side components?

Cheers,
Daniel

James Lemieux wrote:

Hey Daniel. It is certainly possible to do this with a custom EventList, but
I don't think it's necessary to model it as one. I'd keep the parts of your
pipeline stock and write a "service" that you can ask to fetch data and dump
into your "standard" pipeline. That said, of course filtering and sorting
look much different than what FilterList and SortedList provide (maybe
they're just calls to your "service" to fetch new data?).

Just a thought...

James

On Fri, Jul 3, 2009 at 12:51 AM, Daniel Rampanelli <
[e-mail]> wrote:

>
> Hi,
>
> I'm working on a client-server application and I use several virtual SWT
> tables to display the data from the database. Since the application will
> handle huge datasets (over 50.000), I was thinking about improving the
> performance even more.
>
> Right now I load the whole data at the start of the application which
> result
> in fast sorting/filtering but the initalization of the table is rather
> slow.
> I have even implemented a "paging" concept by using RangeList.
>
> I was thinking about creating a custom EventList that would query the
> database only for the necessary rows. This would even apply for filtering
> and sorting.
>
> Has anyone suggestions for my problem? Or maybe does something similar
> already exist?
>
> Thank you in advance,
> Daniel
> --
> View this message in context:
> http://www.nabble.com/Custom-EventList-for-huge-datasets--tp24319091p24319091.html
> Sent from the GlazedLists - User mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [e-mail]
> For additional commands, e-mail: [e-mail]
>
>