Nabble - Esper

Re: How many UpdateListener instances?

2009-12-16T10:25:20Z

Regardless of thread-safety, Esper can lock a listener while it is processing subscribed events.. That is my concern.

On Wed, Dec 16, 2009 at 4:04 PM, Nicolas Dufour <nrdufour@...> wrote:

Hello

I would say that it depends if your listener is thread-safe or not.

I have a tendency to never ever write a listener that store a mutable state or so.

Nicolas Dufour
nrdufour@...

--
“Investment in knowledge pays the best interest.”
—Benjamin Franklin

2009/12/16 António Alegria <antoniomcalegria@...>

Hi!

If I only have one UpdateListener class, that can handle, in a generic way, any kind of subscribed events, is it OK to have only one instance of it or should I distribute subscribed statements across several similar instances? Is it thread-safe to use a single instance for all statements? What do you recommend in this respect?

Thank you,

António Alegria

From forum: Esper User list

Re: How many UpdateListener instances?

2009-12-16T08:04:07Z

Hello

I would say that it depends if your listener is thread-safe or not.

I have a tendency to never ever write a listener that store a mutable state or so.

Nicolas Dufour
nrdufour@...

--
“Investment in knowledge pays the best interest.”
—Benjamin Franklin

2009/12/16 António Alegria <antoniomcalegria@...>

Hi!

If I only have one UpdateListener class, that can handle, in a generic way, any kind of subscribed events, is it OK to have only one instance of it or should I distribute subscribed statements across several similar instances? Is it thread-safe to use a single instance for all statements? What do you recommend in this respect?

Thank you,

António Alegria

From forum: Esper User list

How many UpdateListener instances?

2009-12-16T03:01:47Z

Hi!

If I only have one UpdateListener class, that can handle, in a generic way, any kind of subscribed events, is it OK to have only one instance of it or should I distribute subscribed statements across several similar instances? Is it thread-safe to use a single instance for all statements? What do you recommend in this respect?

Thank you,

António Alegria

From forum: Esper User list

Re: time_batch vs time + output limitation

2009-12-15T14:17:54Z

I forgot to specify exactly what I'm talking about. The cases I'm interested in are event aggregation, such as calculating an average for a given interval (once every 5 minutes).

Example:

insert into Stats5m

select avg(value)

from InputEvents.win:time_batch(5 minutes)

group by name

having count(*) > 0

insert into Stats5m

select avg(value)

from InputEvents.win:time(5 minutes)

group by name

having count(*) > 0

output last at(*/5, *, *, *, *)

2009/12/15 António Alegria <antoniomcalegria@...>

Hi,

Is there any performance advantage in using time_batch (e.g. win:time_batch(5 minutes)) instead of using a normal win:time with output limitation (e.g. output last at(*/5, *, *, *, *)).

It would seem the latter option would create lots more events (and, thus, more objects and memory) but only one would be inserted in the resulting stream each 5 minutes. Am I wrong or is it optimized and it is actually as efficient as an equivalent time_batch?

Thanks,

António Alegria

From forum: Esper User list

time_batch vs time + output limitation

2009-12-15T14:08:34Z

Hi,

Is there any performance advantage in using time_batch (e.g. win:time_batch(5 minutes)) instead of using a normal win:time with output limitation (e.g. output last at(*/5, *, *, *, *)).

It would seem the latter option would create lots more events (and, thus, more objects and memory) but only one would be inserted in the resulting stream each 5 minutes. Am I wrong or is it optimized and it is actually as efficient as an equivalent time_batch?

Thanks,

António Alegria

From forum: Esper User list

[jira] Resolved: (ESPER-433) Support variable remove/destroy

2009-12-15T08:15:55Z

[ http://jira.codehaus.org/browse/ESPER-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Bernhardt resolved ESPER-433.
------------------------------------

Resolution: Fixed

changes are in bugfix320 branch

> Support variable remove/destroy
> -------------------------------
>
> Key: ESPER-433
> URL: http://jira.codehaus.org/browse/ESPER-433
> Project: Esper
> Issue Type: Improvement
> Components: Core
> Affects Versions: 3.2
> Reporter: Thomas Bernhardt
> Priority: Minor
> Fix For: 3.3
>
>
> stmt1: create variable x ....
> destroy stmt1
> stmt2: create variable x ...
> fails - that is the x variable is not cleaned up fully (even with no statement refering to it).

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper Dev list

Re: Stuck at NStreamQueryPlanBuilder.computeBestPath

2009-12-15T08:02:51Z

The problem was captured in http://jira.codehaus.org/browse/ESPER-431

Best regards
Tom

From: pedroteixeira <pedro.t@...>
To: user@...
Sent: Sun, December 13, 2009 7:09:33 PM
Subject: Re: [esper-user] Stuck at NStreamQueryPlanBuilder.computeBestPath

Hi,

I'm finding a bit cumbersome to assert that it *should not* try all
permutations.
I have just recently started looking at Esper's code, so someone might
suggest a better alternative..

--- following code cannot be O(n!) ----

int numStreams = 15;
QueryGraph largeQueryGraph = new QueryGraph(numStreams);
HistoricalDependencyGraph dependencyGraph = new
HistoricalDependencyGraph(numStreams);
NStreamQueryPlanBuilder.BestChainResult bestChain =
NStreamQueryPlanBuilder.computeBestPath(0, largeQueryGraph,
dependencyGraph);

cheers,
Pedro

Thomas Bernhardt wrote:

>
> Hi,
> can you please create a JIRA and attach the test Java class.
> As a workaround to a 15-stream join consider subqueries.
>
>
> Best regards
> Tom
>
>
> ________________________________
> From: pedroteixeira <pedro.t@...>
> To: user@...
> Sent: Wed, December 9, 2009 8:10:18 AM
> Subject: Re: [esper-user] Stuck at NStreamQueryPlanBuilder.computeBestPath
>
>
>
> TYPO. The actual query is more like this:
>
> select a.value, b.value, c.value ... j.value from Stream(id =
> 1).std:lastevent() as a, Stream(id = 2).std:lastevent() as b, ...,
> Stream(id
> =10).std:lastevent() as j
>
>
>
> pedroteixeira wrote:
>>
>>
>> Hello,
>>
>> I've stumbled across a problem, but need some help to understand what it
>> is the intended behavior of the NStreamQueryPlanBuilder class. Perhaps,
>> someone has already had this problem, but I was not able to find in the
>> archive.
>>
>>
>> I have a query which joins 10 streams in the following manner:
>>
>> select a.value, b.value, c.value ... j.value from Stream(id = 1) as a,
>> Stream(id = 2) as b, ..., Stream(id =10) as j
>>
>>
>> The esper engine gets stuck in the "computeBestPath" method, consuming
>> one
>> of the CPUs allocated to the running thread. With yourkit, I extracted
>> the
>> following stack trace:
>>
>>
>> com.espertech.esper.collection.PermutationEnumeration.nextElement()
>> com.espertech.esper.collection.NumberSetPermutationEnumeration.nextElement()
>> com.espertech.esper.epl.join.plan.NStreamQueryPlanBuilder.computeBestPath(int,
>> QueryGraph, HistoricalDependencyGraph)
>> com.espertech.esper.epl.join.plan.NStreamQueryPlanBuilder.build(QueryGraph,
>> EventType[], boolean, boolean[], HistoricalDependencyGraph,
>> HistoricalStreamIndexList[])
>> com.espertech.esper.epl.join.plan.QueryPlanBuilder.getPlan(EventType[],
>> List, QueryGraph, String[], boolean, boolean[],
>> HistoricalDependencyGraph, HistoricalStreamIndexList[],
>> ExprEvaluatorContext)
>> com.espertech.esper.epl.join.JoinSetComposerFactoryImpl.makeComposer(List,
>> ExprNode, EventType[], String[], Viewable[],
>> SelectClauseStreamSelectorEnum, StreamJoinAnalysisResult,
>> ExprEvaluatorContext)
>> com.espertech.esper.core.EPStatementStartMethod.handleJoin(String[],
>> EventType[], Viewable[], ResultSetProcessor,
>> SelectClauseStreamSelectorEnum, StatementContext, List,
>> StreamJoinAnalysisResult)
>> com.espertech.esper.core.EPStatementStartMethod.startSelect(boolean)
>> com.espertech.esper.core.EPStatementStartMethod.start(boolean, boolean,
>> boolean)
>> com.espertech.esper.core.StatementLifecycleSvcImpl.startInternal(String,
>> StatementLifecycleSvcImpl$EPStatementDesc, boolean, boolean, boolean)
>> com.espertech.esper.core.StatementLifecycleSvcImpl.start(String,
>> StatementLifecycleSvcImpl$EPStatementDesc, boolean, boolean, boolean)
>> com.espertech.esper.core.StatementLifecycleSvcImpl.createAndStart(StatementSpecRaw,
>> String, boolean, String, String, Map, Object, EPIsolationUnitServices)
>> com.espertech.esper.core.StatementLifecycleSvcImpl.createAndStart(StatementSpecRaw,
>> String, boolean, String, Object, EPIsolationUnitServices)
>> com.espertech.esper.core.EPAdministratorImpl.create(EPStatementObjectModel,
>> String)
>> com.espertech.esper.core.EPAdministratorImpl.create(EPStatementObjectModel)
>>
>>
>>
>> There seems to be some sort of caveat in the "computeBestPath" method,
>> since it might have to try 15! combinations (in my case). Is that really
>> intented?
>>
>> Thanks a bunch,
>> Pedro
>>
>>
>>
>
> --
> View this message in context:

> http://old.nabble.com/Stuck-at-NStreamQueryPlanBuilder.computeBestPath-tp26709887p26709902.html
> Sent from the Esper User list mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe from this list, please visit:
>
> http://xircles.codehaus.org/manage_email
>
>
>
>

--
View this message in context: http://old.nabble.com/Stuck-at-NStreamQueryPlanBuilder.computeBestPath-tp26709887p26771259.html
Sent from the Esper User list mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper User list

Esper 3.3 release Thursday 12/17

2009-12-15T07:53:41Z

We are planning to complete release 3.3 on Thursday Dec. 17, please make any final contributions available by end of day tomorrow.

Best regards,
Tom

From forum: Esper Dev list

group by , HAVING, groupby()

2009-12-15T07:35:31Z

Hi,
I am trying to get "groupby" and "group by" to work together.

select a.symbol as symbol
, stddev(a.price) as price
, count(*) as count
from PriceEvent.std:groupby(symbol).win:length(800) as a
group by a.symbol
having stddev(a.price) > .1

I want group symbols individually so each symbol will have its own 800 events in its window. I also only want to output if that symbol's stddev is greater than .1. However, it seems the above query's HAVING clause works on an 800 event window that uses all the symbols.

Note, I only use the count(*) to see how many events are in a symbol's window.

From forum: Esper User list

[jira] Resolved: (ESPER-432) Dangling meta character in regexp hangs the engine

2009-12-15T05:56:55Z

[ http://jira.codehaus.org/browse/ESPER-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Bernhardt resolved ESPER-432.
------------------------------------

Resolution: Fixed
Fix Version/s: 3.3

Resolved in release 3.2 bugfix branch

> Dangling meta character in regexp hangs the engine
> --------------------------------------------------
>
> Key: ESPER-432
> URL: http://jira.codehaus.org/browse/ESPER-432
> Project: Esper
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2
> Reporter: Pedro Teixeira
> Priority: Critical
> Fix For: 3.3
>
> Attachments: TestRegexpExpression.java
>
>
> Creating the following stmt:
> select * from SupportBean where string regexp "*any*"
> will (correctly) raise an java.util.regex.PatternSyntaxException,
> but all subsequent calls to the EPServiceProvider are blocked.
> It seems a locking issue, but I was not able to find it.

From forum: Esper Dev list

[jira] Commented: (ESPER-432) Dangling meta character in regexp hangs the engine

2009-12-15T05:34:55Z

[ http://jira.codehaus.org/browse/ESPER-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=202677#action_202677 ]

Pedro Teixeira commented on ESPER-432:
--------------------------------------

jira removed the asterix surrounding "any" from the EPL.
The exception happens when typing regexp "[asterix]any[/asterix]"

> Dangling meta character in regexp hangs the engine
> --------------------------------------------------
>
> Key: ESPER-432
> URL: http://jira.codehaus.org/browse/ESPER-432
> Project: Esper
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2
> Reporter: Pedro Teixeira
> Priority: Critical
> Attachments: TestRegexpExpression.java
>
>
> Creating the following stmt:
> select * from SupportBean where string regexp "*any*"
> will (correctly) raise an java.util.regex.PatternSyntaxException,
> but all subsequent calls to the EPServiceProvider are blocked.
> It seems a locking issue, but I was not able to find it.

From forum: Esper Dev list

[jira] Commented: (ESPER-432) Dangling meta character in regexp hangs the engine

2009-12-15T05:32:55Z

[ http://jira.codehaus.org/browse/ESPER-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=202675#action_202675 ]

Pedro Teixeira commented on ESPER-432:
--------------------------------------

Thomas, I already had attached a unit test with the issue. Does it pass for you?

> Dangling meta character in regexp hangs the engine
> --------------------------------------------------
>
> Key: ESPER-432
> URL: http://jira.codehaus.org/browse/ESPER-432
> Project: Esper
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2
> Reporter: Pedro Teixeira
> Priority: Critical
> Attachments: TestRegexpExpression.java
>
>
> Creating the following stmt:
> select * from SupportBean where string regexp "*any*"
> will (correctly) raise an java.util.regex.PatternSyntaxException,
> but all subsequent calls to the EPServiceProvider are blocked.
> It seems a locking issue, but I was not able to find it.

From forum: Esper Dev list

[jira] Created: (ESPER-433) Support variable remove/destroy

2009-12-15T04:57:55Z

Support variable remove/destroy
-------------------------------

Key: ESPER-433
URL: http://jira.codehaus.org/browse/ESPER-433
Project: Esper
Issue Type: Improvement
Components: Core
Affects Versions: 3.2
Reporter: Thomas Bernhardt
Priority: Minor
Fix For: 3.3

stmt1: create variable x ....
destroy stmt1
stmt2: create variable x ...

fails - that is the x variable is not cleaned up fully (even with no statement refering to it).

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper Dev list

[jira] Commented: (ESPER-432) Dangling meta character in regexp hangs the engine

2009-12-14T21:48:55Z

[ http://jira.codehaus.org/browse/ESPER-432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=202645#action_202645 ]

Thomas Bernhardt commented on ESPER-432:
----------------------------------------

Please provide test case, cannot reproduce.

> Dangling meta character in regexp hangs the engine
> --------------------------------------------------
>
> Key: ESPER-432
> URL: http://jira.codehaus.org/browse/ESPER-432
> Project: Esper
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2
> Reporter: Pedro Teixeira
> Priority: Critical
> Attachments: TestRegexpExpression.java
>
>
> Creating the following stmt:
> select * from SupportBean where string regexp "*any*"
> will (correctly) raise an java.util.regex.PatternSyntaxException,
> but all subsequent calls to the EPServiceProvider are blocked.
> It seems a locking issue, but I was not able to find it.

From forum: Esper Dev list

[jira] Created: (ESPER-432) Dangling meta character in regexp hangs the engine

2009-12-14T17:48:55Z

Dangling meta character in regexp hangs the engine
--------------------------------------------------

Key: ESPER-432
URL: http://jira.codehaus.org/browse/ESPER-432
Project: Esper
Issue Type: Bug
Components: Core
Affects Versions: 3.2
Reporter: Pedro Teixeira
Priority: Critical
Attachments: TestRegexpExpression.java

Creating the following stmt:

select * from SupportBean where string regexp "*any*"

will (correctly) raise an java.util.regex.PatternSyntaxException,
but all subsequent calls to the EPServiceProvider are blocked.

It seems a locking issue, but I was not able to find it.

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper Dev list

[jira] Resolved: (ESPER-431) 20-stream join hangs query optimizer

2009-12-14T13:59:55Z

[ http://jira.codehaus.org/browse/ESPER-431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Bernhardt resolved ESPER-431.
------------------------------------

Resolution: Fixed

in 3.3 release

> 20-stream join hangs query optimizer
> ------------------------------------
>
> Key: ESPER-431
> URL: http://jira.codehaus.org/browse/ESPER-431
> Project: Esper
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2
> Reporter: Thomas Bernhardt
> Priority: Minor
> Fix For: 3.3
>
>
> Sample:
> StringWriter buf = new StringWriter();
> buf.append("select * from ");
> String delimiter = "";
> for (int i = 0; i < 20; i++) {
> buf.append(delimiter);
> buf.append("S0(id=" + i + ").std:lastevent() as s_" + i);
> delimiter = ", ";
> }
> EPStatement stmt = epService.getEPAdministrator().createEPL(buf.toString());

From forum: Esper Dev list

[jira] Commented: (ESPER-431) 20-stream join hangs query optimizer

2009-12-14T08:24:56Z

[ http://jira.codehaus.org/browse/ESPER-431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=202544#action_202544 ]

Thomas Bernhardt commented on ESPER-431:
----------------------------------------

Workaround is to use subqueries.

From forum: Esper Dev list

[jira] Created: (ESPER-431) 20-stream join hangs query optimizer

2009-12-14T08:24:56Z

20-stream join hangs query optimizer
------------------------------------

Key: ESPER-431
URL: http://jira.codehaus.org/browse/ESPER-431
Project: Esper
Issue Type: Bug
Components: Core
Affects Versions: 3.2
Reporter: Thomas Bernhardt
Priority: Minor
Fix For: 3.3

Sample:

StringWriter buf = new StringWriter();
buf.append("select * from ");

String delimiter = "";
for (int i = 0; i < 20; i++) {
buf.append(delimiter);
buf.append("S0(id=" + i + ").std:lastevent() as s_" + i);
delimiter = ", ";
}
EPStatement stmt = epService.getEPAdministrator().createEPL(buf.toString());

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper Dev list

Re: Retrieving events prior an event

2009-12-14T07:55:36Z

Hi Nat,

the rest of your message got cut off. We'll look at the instanceof in match_recognize.
The dynamic properties are further way to go, or adding a property that returns the type to your event would also be a simple solution.

Best regards
Tom

From: Nat Luengnaruemitchai <nat.lueng@...>
To: user@...
Sent: Sun, December 13, 2009 11:19:41 AM
Subject: RE: [esper-user] Retrieving events prior an event

-----Original Message-----
From: CédricMoonen <cedric.moonen@...>
Sent: Thursday, December 10, 2009 9:53 PM
To: user@...
Subject: Re: [esper-user] Retrieving events prior an event

Hello Thomas,

Thanks for the reply, but I still can't reach a good solution for this...

If I use the match_recognize, I end up with something like this:
select * from BaseEvent
match_recognize(
measures A as start, B as stop
pattern(A B)
define
B as instanceof(B, DerivedEvent)
)

This gives an error (Incorrect syntax near 'B').
Furthermore, I still can't access the fields
specific to DerivedEvent (or I have to use the
cast function and I will end up with something extremely complicated).

I tried also using the prev function and it could
almost do what I'm looking for, except that the
prev function selects only a field, and not the
complette event. Is it possible to have something like this:

[The entire original message is not included]

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper User list

Blocking statement

2009-12-13T23:53:30Z

Hi - I'm evaluating esper for high arrival streams which has also high matching ratio. On the documentation it states, consider to use multiple statements and distribute the streams over those statements yet the blocking is statement level. Which makes sense to me if the statement has finite state like select sum(price) as total_price from invoice.

But what I observed is, the engine is also blocking non finite state statements like select * from invoice (price < 100). I made this conclusion nothing but the benchmarking so I am not sure It's blocking at all.

I wonder, is the engine is really blocking those kind of statements, if yes why? if no, what reduces my throughput when the hitting ratio increases.

I've added the related documentation for easy reference.

Best Regards,
Onur

14.2.14. High-Arrival-Rate Streams and Single Statements

A statement is associated with certain statement state that consists of current aggregation values, partial pattern matches, data windows or other view state depending on whether your statement uses such constructs. When an engine receives events it updates statement state under locking such that statement state remains consistent under concurrent multi-threaded access.

For high-volume streams, the locking required to protected statement state may slow down or introduce blocking for very high arrival rates of events that apply to the very same statement and its state. You may want to consider splitting a single statement into multiple statements that each look for a certain subset of the high-arrival-rate stream. There is very little cost in terms of memory or CPU resources per statement, the engine can handle larger number of statements usually as efficiently as single statements.

Windows Live Hotmail: Arkadaşlarınız Facebook'taki güncellemelerinizi doğrudan Hotmail®'den görür.

From forum: Esper User list

Re: Stuck at NStreamQueryPlanBuilder.computeBestPath

2009-12-13T16:09:33Z

Hi,

I'm finding a bit cumbersome to assert that it *should not* try all permutations.
I have just recently started looking at Esper's code, so someone might suggest a better alternative..

--- following code cannot be O(n!) ----

int numStreams = 15;
QueryGraph largeQueryGraph = new QueryGraph(numStreams);
HistoricalDependencyGraph dependencyGraph = new HistoricalDependencyGraph(numStreams);
NStreamQueryPlanBuilder.BestChainResult bestChain = NStreamQueryPlanBuilder.computeBestPath(0, largeQueryGraph, dependencyGraph);

cheers,
Pedro

Thomas Bernhardt wrote:

Hi,
can you please create a JIRA and attach the test Java class.
As a workaround to a 15-stream join consider subqueries.

Best regards
Tom

________________________________
From: pedroteixeira <pedro.t@gmail.com>
To: user@esper.codehaus.org
Sent: Wed, December 9, 2009 8:10:18 AM
Subject: Re: [esper-user] Stuck at NStreamQueryPlanBuilder.computeBestPath

TYPO. The actual query is more like this:

select a.value, b.value, c.value ... j.value from Stream(id =
1).std:lastevent() as a, Stream(id = 2).std:lastevent() as b, ..., Stream(id
=10).std:lastevent() as j

pedroteixeira wrote:
>
>
> Hello,
>
> I've stumbled across a problem, but need some help to understand what it
> is the intended behavior of the NStreamQueryPlanBuilder class. Perhaps,
> someone has already had this problem, but I was not able to find in the
> archive.
>
>
> I have a query which joins 10 streams in the following manner:
>
> select a.value, b.value, c.value ... j.value from Stream(id = 1) as a,
> Stream(id = 2) as b, ..., Stream(id =10) as j
>
>
> The esper engine gets stuck in the "computeBestPath" method, consuming one
> of the CPUs allocated to the running thread. With yourkit, I extracted the
> following stack trace:
>
>
> com.espertech.esper.collection.PermutationEnumeration.nextElement()
> com.espertech.esper.collection.NumberSetPermutationEnumeration.nextElement()
> com.espertech.esper.epl.join.plan.NStreamQueryPlanBuilder.computeBestPath(int,
> QueryGraph, HistoricalDependencyGraph)
> com.espertech.esper.epl.join.plan.NStreamQueryPlanBuilder.build(QueryGraph,
> EventType[], boolean, boolean[], HistoricalDependencyGraph,
> HistoricalStreamIndexList[])
> com.espertech.esper.epl.join.plan.QueryPlanBuilder.getPlan(EventType[],
> List, QueryGraph, String[], boolean, boolean[],
> HistoricalDependencyGraph, HistoricalStreamIndexList[],
> ExprEvaluatorContext)
> com.espertech.esper.epl.join.JoinSetComposerFactoryImpl.makeComposer(List,
> ExprNode, EventType[], String[], Viewable[],
> SelectClauseStreamSelectorEnum, StreamJoinAnalysisResult,
> ExprEvaluatorContext)
> com.espertech.esper.core.EPStatementStartMethod.handleJoin(String[],
> EventType[], Viewable[], ResultSetProcessor,
> SelectClauseStreamSelectorEnum, StatementContext, List,
> StreamJoinAnalysisResult)
> com.espertech.esper.core.EPStatementStartMethod.startSelect(boolean)
> com.espertech.esper.core.EPStatementStartMethod.start(boolean, boolean,
> boolean)
> com.espertech.esper.core.StatementLifecycleSvcImpl.startInternal(String,
> StatementLifecycleSvcImpl$EPStatementDesc, boolean, boolean, boolean)
> com.espertech.esper.core.StatementLifecycleSvcImpl.start(String,
> StatementLifecycleSvcImpl$EPStatementDesc, boolean, boolean, boolean)
> com.espertech.esper.core.StatementLifecycleSvcImpl.createAndStart(StatementSpecRaw,
> String, boolean, String, String, Map, Object, EPIsolationUnitServices)
> com.espertech.esper.core.StatementLifecycleSvcImpl.createAndStart(StatementSpecRaw,
> String, boolean, String, Object, EPIsolationUnitServices)
> com.espertech.esper.core.EPAdministratorImpl.create(EPStatementObjectModel,
> String)
> com.espertech.esper.core.EPAdministratorImpl.create(EPStatementObjectModel)
>
>
>
> There seems to be some sort of caveat in the "computeBestPath" method,
> since it might have to try 15! combinations (in my case). Is that really
> intented?
>
> Thanks a bunch,
> Pedro
>
>
>

--
View this message in context: http://old.nabble.com/Stuck-at-NStreamQueryPlanBuilder.computeBestPath-tp26709887p26709902.html
Sent from the Esper User list mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper User list

RE: Retrieving events prior an event

2009-12-13T08:19:41Z

-----Original Message-----
From: CédricMoonen <cedric.moonen@...>
Sent: Thursday, December 10, 2009 9:53 PM
To: user@...
Subject: Re: [esper-user] Retrieving events prior an event

Hello Thomas,

Thanks for the reply, but I still can't reach a good solution for this...

If I use the match_recognize, I end up with something like this:
select * from BaseEvent
match_recognize(
measures A as start, B as stop
pattern(A B)
define
B as instanceof(B, DerivedEvent)
)

This gives an error (Incorrect syntax near 'B').
Furthermore, I still can't access the fields
specific to DerivedEvent (or I have to use the
cast function and I will end up with something extremely complicated).

I tried also using the prev function and it could
almost do what I'm looking for, except that the
prev function selects only a field, and not the
complette event. Is it possible to have something like this:

[The entire original message is not included]

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper User list

Conflict Management

2009-12-12T13:41:32Z

Hello

My current engine is correlating events of a unique type according to certain criteria.

When the listener is fired. it aggregate those correlated events under a "master" event.

My problem is I can have multiple statements firing that listener on a similar set of events.

Example:

t0 - A(1)

t1 - A(2)

t2 - A(3)

--> correlate A(2) and A(3) because it's on the switch. (statement 1)

--> correlate A(1), A(2) and A(3) because it's the same domain (statement 2).

In that case I'm searching a way to make sure the listener attached to statement 2 is indeed fired but the not the one attached to statement 1.

The idea behind is: It's more *important* to detect statement 2 than statement 1.

I tried to use @Priority but it's just changing the order of firing.

Any idea would be appreciated.

Thank you

Nicolas Dufour
nrdufour@...

--
“Investment in knowledge pays the best interest.”
—Benjamin Franklin

From forum: Esper User list

[jira] Updated: (ESPER-430) PlugInProjectionExpression should allow more than one expression

2009-12-11T14:43:55Z

[ http://jira.codehaus.org/browse/ESPER-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pedro Teixeira updated ESPER-430:
---------------------------------

Attachment: ESPER-430.patch

Changing Expressions facade also.

> PlugInProjectionExpression should allow more than one expression
> ----------------------------------------------------------------
>
> Key: ESPER-430
> URL: http://jira.codehaus.org/browse/ESPER-430
> Project: Esper
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2
> Reporter: Pedro Teixeira
> Attachments: ESPER-430.patch, ESPER-430.patch
>
>
> "select customAgg(foo, barr) from Movies" is a valid EPL but when converted to an object model and then back to EPL, it becomes:
> "select customAgg(foo) from Movies".
> Perhaps it is just a matter of changing PlugInProjectionExpression.toEPL

From forum: Esper Dev list

[jira] Updated: (ESPER-430) PlugInProjectionExpression should allow more than one expression

2009-12-11T14:32:55Z

> PlugInProjectionExpression should allow more than one expression
> ----------------------------------------------------------------
>
> Key: ESPER-430
> URL: http://jira.codehaus.org/browse/ESPER-430
> Project: Esper
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2
> Reporter: Pedro Teixeira
> Attachments: ESPER-430.patch
>
>
> "select customAgg(foo, barr) from Movies" is a valid EPL but when converted to an object model and then back to EPL, it becomes:
> "select customAgg(foo) from Movies".
> Perhaps it is just a matter of changing PlugInProjectionExpression.toEPL

From forum: Esper Dev list

[jira] Commented: (ESPER-430) PlugInProjectionExpression should allow more than one expression

2009-12-11T13:26:55Z

[ http://jira.codehaus.org/browse/ESPER-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=202306#action_202306 ]

Pedro Teixeira commented on ESPER-430:
--------------------------------------

I've started working on a patch... let's see if it works ;)

> PlugInProjectionExpression should allow more than one expression
> ----------------------------------------------------------------
>
> Key: ESPER-430
> URL: http://jira.codehaus.org/browse/ESPER-430
> Project: Esper
> Issue Type: Bug
> Components: Core
> Affects Versions: 3.2
> Reporter: Pedro Teixeira
>
> "select customAgg(foo, barr) from Movies" is a valid EPL but when converted to an object model and then back to EPL, it becomes:
> "select customAgg(foo) from Movies".
> Perhaps it is just a matter of changing PlugInProjectionExpression.toEPL

From forum: Esper Dev list

[jira] Created: (ESPER-430) PlugInProjectionExpression should allow more than one expression

2009-12-11T13:24:55Z

PlugInProjectionExpression should allow more than one expression
----------------------------------------------------------------

Key: ESPER-430
URL: http://jira.codehaus.org/browse/ESPER-430
Project: Esper
Issue Type: Bug
Components: Core
Affects Versions: 3.2
Reporter: Pedro Teixeira

"select customAgg(foo, barr) from Movies" is a valid EPL but when converted to an object model and then back to EPL, it becomes:
"select customAgg(foo) from Movies".

Perhaps it is just a matter of changing PlugInProjectionExpression.toEPL

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper Dev list

[jira] Updated: (ESPER-429) Replace "childNodeType" with "parameterType" in section 12.2.3

2009-12-10T05:58:55Z

[ http://jira.codehaus.org/browse/ESPER-429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Pedro Teixeira updated ESPER-429:
---------------------------------

Attachment: esper-429.diff

patch for doc

> Replace "childNodeType" with "parameterType" in section 12.2.3
> --------------------------------------------------------------
>
> Key: ESPER-429
> URL: http://jira.codehaus.org/browse/ESPER-429
> Project: Esper
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 3.2
> Reporter: Pedro Teixeira
> Priority: Trivial
> Attachments: esper-429.diff
>
> Original Estimate: 5 minutes
> Remaining Estimate: 5 minutes
>
> replace "childNodeType" with "parameterType" in the following extract in section 12.2.3:
> public void validateMultiParameter(Class[] parameterType,
> boolean[] isConstantValue,
> Object[] constantValue) {
> super.validateMultiParameter(childNodeType, isConstantValue, constantValue);
> if ((childNodeType[0] != Integer.class) || (childNodeType[1] != Integer.class)) {
> throw new IllegalArgumentException("Expected integer bounds");
> }
> }

From forum: Esper Dev list

Re: Retrieving events prior an event

2009-12-10T05:53:25Z

Hello Thomas,

Thanks for the reply, but I still can't reach a good solution for this...

If I use the match_recognize, I end up with something like this:
select * from BaseEvent
match_recognize(
measures A as start, B as stop
pattern(A B)
define
B as instanceof(B, DerivedEvent)
)

This gives an error (Incorrect syntax near 'B'). Furthermore, I still can't access the fields specific to DerivedEvent (or I have to use the cast function and I will end up with something extremely complicated).

I tried also using the prev function and it could almost do what I'm looking for, except that the prev function selects only a field, and not the complette event. Is it possible to have something like this:
select prev(5, BaseEvent) from DerivedEvent(....) unidirectional, BaseEvent.win:length(5)

So, in the prev function I select the full BaseEvent (of course, this gives an error stating that BaseEvent is not valid in any streams).

I really would like to find an elegant solution to this problem but it seems there's none :(. The problem seemed to be very simple but trying to express that in Esper is much more complicated than I first thought.

Thanks for any additional feedback.
Cédric

At 14:14 10/12/2009, you wrote:

Hi Cedric,

match recognize can also work with variant streams, i.e. multiple types of events. Yes followed-by in a pattern is another way, and a where-clause against "prev" is also possible for example with length window.

Best regards
Tom

From: Cédric Moonen <cedric.moonen@...>
To: user@...
Sent: Wed, December 9, 2009 5:02:00 AM
Subject: Re: [esper-user] Retrieving events prior an event

Hello Thomas,

I've looked at the documentation of Esper 3.2 and this is a new feature (we were still using 3.1). It looks indeed very promising to use the match-recognize. I will have to experiment with it but I think what might be a problem (not sure for now) is that you can only work with one type of events. Luckily, all our events have the same common base class so there is probably a work around here if we are able to specify a more defined type in the define clause. Is that possible ?
By the way, I realized that I made a small mistake in my previous example: what should be retrieved is "A3 B1" and "A12 B2" (and not "A12 B1"), sorry for the confusion.

Out of curiosity, is there a way to achieve this without using the match-recognize ? Any way using the prev or prior function ?

There is a way but it is really ugly and I really would like to find an easier solution. Here is what we have right now:
select * from B as evtB unidirectional, pattern[every A[5] as evtA]

This seems to work fine but it is really complex. Any other better looking way :-) ?

Thanks
Cédric

At 19:24 8/12/2009, you wrote:

Hi Cedrik,

here is a possible match-recognize (the regular expression only):
- A3 B1: (A X X X X B), select A and B
- A12 B1: (B X X X X A), select A and B

or both at the same time "(A X X X X B) | (B X X X X A)"

Best regards
Tom

From: Cédric Moonen <cedric.moonen@...>
To: user@...
Sent: Tue, December 8, 2009 9:07:18 AM
Subject: Re: [esper-user] Retrieving events prior an event

Thanks for the reply,

But I don't think this will really solve my problem. Let me show you with an example, which will probably be clearer than my explanation. Suppose the following sequence of events:
A1 A2 A3 A4 A5 A6 A7 B1 A8 A9 A10 A11 A12 A13 A14 A15 A16 B2 A17 A18

What I want to retrieve is:
- A3 B1 (A3 being the fifth A event before B10)
- A12 B1

I don't think this is really feasible using a pattern, is it ?

At 14:51 8/12/2009, you wrote:

May be a pattern using repeat or repeat until would be a better way?

2009/12/8 Cédric Moonen <cedric.moonen@... >

Hello,
I'm a bit stuck with a problem when trying to retrieve events that happened before a specific event. My scenario is that I have events coming in and all those events have the same base event (let's call it BaseEvent). Then, there are some specific events that I am looking for (SpecificEvent). I need to retrieve all those specific events with the base event that occured 5th-prior that specific event.
The first thing I did was something like this:
select * from SpecificEvent as event unidirectional, BaseEvent.win:length(5).std:firstevent() as prevEvent
But this didn't work as I expected and looking at the documentation of the std:firstevent, it is explained there that I should use the prev function instead because the window is restarted each time. So, I tried then to use the prev function but there's no explanation in the doc on how I have to specify that I want the full event and not one of the properties (although, it is stated that it should be possible). I tried to write something like this:
select event, prev(5, *) as prevEvent from SpecificEvent as event unidirectional, BaseEvent.win:length(5)
But it complains about the syntax error for the '*' symbol.
So my questions are:
1) How to write suche a statement ?
2) If there are multiple streams, how will the prev function "know" for which stream it has to select the event ?
I'm a bit confused with this prev function.
Thanks for your feedback.
Cédric

---------------------------------------------------------------------
To unsubscribe from this list, please visit:
http://xircles.codehaus.org/manage_email

Cédric Moonen
Projectingenieur

Flanders' MECHATRONICS Technology Centre (FMTC)
Celestijnenlaan 300D
B-3001 Leuven
Belgium

GSM: +32-498-91.94.14
Fax: +32-16-32.80.64
cedric.moonen@...

www.fmtc.be

Cédric Moonen
Projectingenieur

Flanders' MECHATRONICS Technology Centre (FMTC)
Celestijnenlaan 300D
B-3001 Leuven
Belgium

GSM: +32-498-91.94.14
Fax: +32-16-32.80.64
cedric.moonen@...

www.fmtc.be

Cédric Moonen
Projectingenieur

Flanders' MECHATRONICS Technology Centre (FMTC)
Celestijnenlaan 300D
B-3001 Leuven
Belgium

GSM: +32-498-91.94.14
Fax: +32-16-32.80.64
cedric.moonen@...

www.fmtc.be

From forum: Esper User list

[jira] Created: (ESPER-429) Replace "childNodeType" with "parameterType" in section 12.2.3

2009-12-10T05:33:55Z

Replace "childNodeType" with "parameterType" in section 12.2.3
--------------------------------------------------------------

Key: ESPER-429
URL: http://jira.codehaus.org/browse/ESPER-429
Project: Esper
Issue Type: Bug
Components: Documentation
Affects Versions: 3.2
Reporter: Pedro Teixeira
Priority: Trivial

replace "childNodeType" with "parameterType" in the following extract in section 12.2.3:

public void validateMultiParameter(Class[] parameterType,
boolean[] isConstantValue,
Object[] constantValue) {
super.validateMultiParameter(childNodeType, isConstantValue, constantValue);
if ((childNodeType[0] != Integer.class) || (childNodeType[1] != Integer.class)) {
throw new IllegalArgumentException("Expected integer bounds");
}
}

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://jira.codehaus.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper Dev list

Re: Retrieving events prior an event

2009-12-10T05:14:57Z

Hi Cedric,

match recognize can also work with variant streams, i.e. multiple types of events. Yes followed-by in a pattern is another way, and a where-clause against "prev" is also possible for example with length window.

Best regards
Tom

From: Cédric Moonen <cedric.moonen@...>
To: user@...
Sent: Wed, December 9, 2009 5:02:00 AM
Subject: Re: [esper-user] Retrieving events prior an event

Hello Thomas,

I've looked at the documentation of Esper 3.2 and this is a new feature (we were still using 3.1). It looks indeed very promising to use the match-recognize. I will have to experiment with it but I think what might be a problem (not sure for now) is that you can only work with one type of events. Luckily, all our events have the same common base class so there is probably a work around here if we are able to specify a more defined type in the define clause. Is that possible ?
By the way, I realized that I made a small mistake in my previous example: what should be retrieved is "A3 B1" and "A12 B2" (and not "A12 B1"), sorry for the confusion.

Out of curiosity, is there a way to achieve this without using the match-recognize ? Any way using the prev or prior function ?

There is a way but it is really ugly and I really would like to find an easier solution. Here is what we have right now:
select * from B as evtB unidirectional, pattern[every A[5] as evtA]

This seems to work fine but it is really complex. Any other better looking way :-) ?

Thanks
Cédric

At 19:24 8/12/2009, you wrote:

Hi Cedrik,

here is a possible match-recognize (the regular expression only):
- A3 B1: (A X X X X B), select A and B
- A12 B1: (B X X X X A), select A and B

or both at the same time "(A X X X X B) | (B X X X X A)"

Best regards
Tom

From: Cédric Moonen <cedric.moonen@...>
To: user@...
Sent: Tue, December 8, 2009 9:07:18 AM
Subject: Re: [esper-user] Retrieving events prior an event

Thanks for the reply,

But I don't think this will really solve my problem. Let me show you with an example, which will probably be clearer than my explanation. Suppose the following sequence of events:
A1 A2 A3 A4 A5 A6 A7 B1 A8 A9 A10 A11 A12 A13 A14 A15 A16 B2 A17 A18

What I want to retrieve is:
- A3 B1 (A3 being the fifth A event before B10)
- A12 B1

I don't think this is really feasible using a pattern, is it ?

At 14:51 8/12/2009, you wrote:

May be a pattern using repeat or repeat until would be a better way?

2009/12/8 Cédric Moonen <cedric.moonen@... >

Hello,

I'm a bit stuck with a problem when trying to retrieve events that happened before a specific event. My scenario is that I have events coming in and all those events have the same base event (let's call it BaseEvent). Then, there are some specific events that I am looking for (SpecificEvent). I need to retrieve all those specific events with the base event that occured 5th-prior that specific event.

The first thing I did was something like this:
select * from SpecificEvent as event unidirectional, BaseEvent.win:length(5).std:firstevent() as prevEvent

But this didn't work as I expected and looking at the documentation of the std:firstevent, it is explained there that I should use the prev function instead because the window is restarted each time. So, I tried then to use the prev function but there's no explanation in the doc on how I have to specify that I want the full event and not one of the properties (although, it is stated that it should be possible). I tried to write something like this:

select event, prev(5, *) as prevEvent from SpecificEvent as event unidirectional, BaseEvent.win:length(5)

But it complains about the syntax error for the '*' symbol.

So my questions are:
1) How to write suche a statement ?
2) If there are multiple streams, how will the prev function "know" for which stream it has to select the event ?

I'm a bit confused with this prev function.

Thanks for your feedback.
Cédric

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

Cédric Moonen
Projectingenieur

Flanders' MECHATRONICS Technology Centre (FMTC)
Celestijnenlaan 300D
B-3001 Leuven
Belgium

GSM: +32-498-91.94.14
Fax: +32-16-32.80.64
cedric.moonen@...

www.fmtc.be

Cédric Moonen
Projectingenieur

Flanders' MECHATRONICS Technology Centre (FMTC)
Celestijnenlaan 300D
B-3001 Leuven
Belgium

GSM: +32-498-91.94.14
Fax: +32-16-32.80.64
cedric.moonen@...

www.fmtc.be

From forum: Esper User list

Re: Stuck at NStreamQueryPlanBuilder.computeBestPath

2009-12-09T19:22:18Z

got it. thanks a lot!

yep, I just needs to keep a single value from the last event from many streams and convert them (kind of transposing) to a single event. The mechanism should be efficient even with ~ 500 events. The use case for this is that I want Esper to create a kind of vector snapshot from several streams.

Thomas Bernhardt wrote:

If your 15 subqueries are very similar, perhaps a single subquery and a custom plugin aggregation function would be another way to go, function to simply return all x events in an array

For example:

select
(select myaggregation(value) from Event.std:unique(value)), j.value
from Event(id=14).std.lastevent() as j

Best regards
Tom

________________________________
From: pedroteixeira <pedro.t@gmail.com>
To: user@esper.codehaus.org
Sent: Wed, December 9, 2009 2:04:42 PM
Subject: Re: [esper-user] Stuck at NStreamQueryPlanBuilder.computeBestPath

Thanks, Thomas. Will create a test case and then create the issue.

I'was reading the example in the docs:
// Fast version, second alternative
select
(select avg(value) from MyEvent.win:length(100)) as avgA,
(select avg(value) from MyEvent.win:length(50)) as avgB,
a.symbol
from MyEvent.std:lastevent() a, MyEvent.std:lastevent() b

For a 15-stream join, is this the subquery approach that you meant?

select
(select value from Event(id=1).std:lastevent()),
(select value from Event(id=2).std:lastevent()),
...
(select value from Event(id=13).std:lastevent()),
j.value
from Event(id=14).std.lastevent() as j

cheers,
Pedro

Thomas Bernhardt wrote:
>
> Hi,
> can you please create a JIRA and attach the test Java class.
> As a workaround to a 15-stream join consider subqueries.
>
>
> Best regards
> Tom
>
>
> ________________________________
> From: pedroteixeira <pedro.t@gmail.com>
> To: user@esper.codehaus.org
> Sent: Wed, December 9, 2009 8:10:18 AM
> Subject: Re: [esper-user] Stuck at NStreamQueryPlanBuilder.computeBestPath
>
>
>
> TYPO. The actual query is more like this:
>
> select a.value, b.value, c.value ... j.value from Stream(id =
> 1).std:lastevent() as a, Stream(id = 2).std:lastevent() as b, ...,
> Stream(id
> =10).std:lastevent() as j
>
>
>
> pedroteixeira wrote:
>>
>>
>> Hello,
>>
>> I've stumbled across a problem, but need some help to understand what it
>> is the intended behavior of the NStreamQueryPlanBuilder class. Perhaps,
>> someone has already had this problem, but I was not able to find in the
>> archive.
>>
>>
>> I have a query which joins 10 streams in the following manner:
>>
>> select a.value, b.value, c.value ... j.value from Stream(id = 1) as a,
>> Stream(id = 2) as b, ..., Stream(id =10) as j
>>
>>
>> The esper engine gets stuck in the "computeBestPath" method, consuming
>> one
>> of the CPUs allocated to the running thread. With yourkit, I extracted
>> the
>> following stack trace:
>>
>>
>> com.espertech.esper.collection.PermutationEnumeration.nextElement()
>> com.espertech.esper.collection.NumberSetPermutationEnumeration.nextElement()
>> com.espertech.esper.epl.join.plan.NStreamQueryPlanBuilder.computeBestPath(int,
>> QueryGraph, HistoricalDependencyGraph)
>> com.espertech.esper.epl.join.plan.NStreamQueryPlanBuilder.build(QueryGraph,
>> EventType[], boolean, boolean[], HistoricalDependencyGraph,
>> HistoricalStreamIndexList[])
>> com.espertech.esper.epl.join.plan.QueryPlanBuilder.getPlan(EventType[],
>> List, QueryGraph, String[], boolean, boolean[],
>> HistoricalDependencyGraph, HistoricalStreamIndexList[],
>> ExprEvaluatorContext)
>> com.espertech.esper.epl.join.JoinSetComposerFactoryImpl.makeComposer(List,
>> ExprNode, EventType[], String[], Viewable[],
>> SelectClauseStreamSelectorEnum, StreamJoinAnalysisResult,
>> ExprEvaluatorContext)
>> com.espertech.esper.core.EPStatementStartMethod.handleJoin(String[],
>> EventType[], Viewable[], ResultSetProcessor,
>> SelectClauseStreamSelectorEnum, StatementContext, List,
>> StreamJoinAnalysisResult)
>> com.espertech.esper.core.EPStatementStartMethod.startSelect(boolean)
>> com.espertech.esper.core.EPStatementStartMethod.start(boolean, boolean,
>> boolean)
>> com.espertech.esper.core.StatementLifecycleSvcImpl.startInternal(String,
>> StatementLifecycleSvcImpl$EPStatementDesc, boolean, boolean, boolean)
>> com.espertech.esper.core.StatementLifecycleSvcImpl.start(String,
>> StatementLifecycleSvcImpl$EPStatementDesc, boolean, boolean, boolean)
>> com.espertech.esper.core.StatementLifecycleSvcImpl.createAndStart(StatementSpecRaw,
>> String, boolean, String, String, Map, Object, EPIsolationUnitServices)
>> com.espertech.esper.core.StatementLifecycleSvcImpl.createAndStart(StatementSpecRaw,
>> String, boolean, String, Object, EPIsolationUnitServices)
>> com.espertech.esper.core.EPAdministratorImpl.create(EPStatementObjectModel,
>> String)
>> com.espertech.esper.core.EPAdministratorImpl.create(EPStatementObjectModel)
>>
>>
>>
>> There seems to be some sort of caveat in the "computeBestPath" method,
>> since it might have to try 15! combinations (in my case). Is that really
>> intented?
>>
>> Thanks a bunch,
>> Pedro
>>
>>
>>
>
> --
> View this message in context:
> http://old.nabble.com/Stuck-at-NStreamQueryPlanBuilder.computeBestPath-tp26709887p26709902.html
> Sent from the Esper User list mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe from this list, please visit:
>
> http://xircles.codehaus.org/manage_email
>
>
>
>

--
View this message in context: http://old.nabble.com/Stuck-at-NStreamQueryPlanBuilder.computeBestPath-tp26709887p26715790.html
Sent from the Esper User list mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper User list

Re: Retrieving events prior an event

2009-12-09T18:58:56Z

use "instanceof"?

Best regards
Tom

From: Cédric Moonen <cedric.moonen@...>
To: user@...
Sent: Wed, December 9, 2009 6:12:41 AM
Subject: Re: [esper-user] Retrieving events prior an event

I made a mistake in my previous reply. The statement that is working looks like this in fact:
select * from B as evtB unidirectional, pattern[every evtA=A -> A -> A -> A -> A]

Which is even more ugly...

I've been looking at the mathc_recognize but as I expected I am a bit stuck on detecting the type of the event in the define clause. What I have so far is:

select * from BaseEvent
match_recognize (
measures A as start, B as stop
pattern(A X X X X B)
define
B as (??? AND B.var1="Val1" AND B.var2="Val2" )
)

So, to summarize, both A and B inherit from BaseEvent. The "???" in the define should be replaced by something that specifies the type of the event B (event A can be of any type). var1 and var2 are both members of the more derived type which B is representing. Is there any way to do this ?

Thanks for any feedback.
Cédric

At 11:02 9/12/2009, you wrote:

Hello Thomas,

I've looked at the documentation of Esper 3.2 and this is a new feature (we were still using 3.1). It looks indeed very promising to use the match-recognize. I will have to experiment with it but I think what might be a problem (not sure for now) is that you can only work with one type of events. Luckily, all our events have the same common base class so there is probably a work around here if we are able to specify a more defined type in the define clause. Is that possible ?
By the way, I realized that I made a small mistake in my previous example: what should be retrieved is "A3 B1" and "A12 B2" (and not "A12 B1"), sorry for the confusion.

Out of curiosity, is there a way to achieve this without using the match-recognize ? Any way using the prev or prior function ?

There is a way but it is really ugly and I really would like to find an easier solution. Here is what we have right now:
select * from B as evtB unidirectional, pattern[every A[5] as evtA]

This seems to work fine but it is really complex. Any other better looking way :-) ?

Thanks
Cédric

At 19:24 8/12/2009, you wrote:

Hi Cedrik,

here is a possible match-recognize (the regular expression only):
- A3 B1: (A X X X X B), select A and B
- A12 B1: (B X X X X A), select A and B

or both at the same time "(A X X X X B) | (B X X X X A)"

Best regards
Tom

From: Cédric Moonen <cedric.moonen@...>
To: user@...
Sent: Tue, December 8, 2009 9:07:18 AM
Subject: Re: [esper-user] Retrieving events prior an event

Thanks for the reply,

But I don't think this will really solve my problem. Let me show you with an example, which will probably be clearer than my explanation. Suppose the following sequence of events:
A1 A2 A3 A4 A5 A6 A7 B1 A8 A9 A10 A11 A12 A13 A14 A15 A16 B2 A17 A18

What I want to retrieve is:
- A3 B1 (A3 being the fifth A event before B10)
- A12 B1

I don't think this is really feasible using a pattern, is it ?

At 14:51 8/12/2009, you wrote:

May be a pattern using repeat or repeat until would be a better way?

2009/12/8 Cédric Moonen <cedric.moonen@... >

Hello,
I'm a bit stuck with a problem when trying to retrieve events that happened before a specific event. My scenario is that I have events coming in and all those events have the same base event (let's call it BaseEvent). Then, there are some specific events that I am looking for (SpecificEvent). I need to retrieve all those specific events with the base event that occured 5th-prior that specific event.
The first thing I did was something like this:
select * from SpecificEvent as event unidirectional, BaseEvent.win:length(5).std:firstevent() as prevEvent
But this didn't work as I expected and looking at the documentation of the std:firstevent, it is explained there that I should use the prev function instead because the window is restarted each time. So, I tried then to use the prev function but there's no explanation in the doc on how I have to specify that I want the full event and not one of the properties (although, it is stated that it should be possible). I tried to write something like this:
select event, prev(5, *) as prevEvent from SpecificEvent as event unidirectional, BaseEvent.win:length(5)
But it complains about the syntax error for the '*' symbol.
So my questions are:
1) How to write suche a statement ?
2) If there are multiple streams, how will the prev function "know" for which stream it has to select the event ?
I'm a bit confused with this prev function.
Thanks for your feedback.
Cédric

---------------------------------------------------------------------
To unsubscribe from this list, please visit:
http://xircles.codehaus.org/manage_email

Cédric Moonen
Projectingenieur

Flanders' MECHATRONICS Technology Centre (FMTC)
Celestijnenlaan 300D
B-3001 Leuven
Belgium

GSM: +32-498-91.94.14
Fax: +32-16-32.80.64
cedric.moonen@...

www.fmtc.be

Cédric Moonen
Projectingenieur

Flanders' MECHATRONICS Technology Centre (FMTC)
Celestijnenlaan 300D
B-3001 Leuven
Belgium

GSM: +32-498-91.94.14
Fax: +32-16-32.80.64
cedric.moonen@...

www.fmtc.be

Cédric Moonen
Projectingenieur

Flanders' MECHATRONICS Technology Centre (FMTC)
Celestijnenlaan 300D
B-3001 Leuven
Belgium

GSM: +32-498-91.94.14
Fax: +32-16-32.80.64
cedric.moonen@...

www.fmtc.be

From forum: Esper User list

Re: Stuck at NStreamQueryPlanBuilder.computeBestPath

2009-12-09T18:56:20Z

If your 15 subqueries are very similar, perhaps a single subquery and a custom plugin aggregation function would be another way to go, function to simply return all x events in an array

For example:

select
(select myaggregation(value) from Event.std:unique(value)), j.value
from Event(id=14).std.lastevent() as j

Best regards
Tom

From: pedroteixeira <pedro.t@...>
To: user@...
Sent: Wed, December 9, 2009 2:04:42 PM
Subject: Re: [esper-user] Stuck at NStreamQueryPlanBuilder.computeBestPath

Thanks, Thomas. Will create a test case and then create the issue.

I'was reading the example in the docs:
// Fast version, second alternative
select
(select avg(value) from MyEvent.win:length(100)) as avgA,
(select avg(value) from MyEvent.win:length(50)) as avgB,
a.symbol
from MyEvent.std:lastevent() a, MyEvent.std:lastevent() b

For a 15-stream join, is this the subquery approach that you meant?

select
(select value from Event(id=1).std:lastevent()),
(select value from Event(id=2).std:lastevent()),
...
(select value from Event(id=13).std:lastevent()),
j.value
from Event(id=14).std.lastevent() as j

cheers,
Pedro

Thomas Bernhardt wrote:

> http://old.nabble.com/Stuck-at-NStreamQueryPlanBuilder.computeBestPath-tp26709887p26709902.html
> Sent from the Esper User list mailing list archive at Nabble.com.
>
>
> ---------------------------------------------------------------------
> To unsubscribe from this list, please visit:
>
> http://xircles.codehaus.org/manage_email
>
>
>
>

--
View this message in context: http://old.nabble.com/Stuck-at-NStreamQueryPlanBuilder.computeBestPath-tp26709887p26715790.html
Sent from the Esper User list mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper User list

Re: Stuck at NStreamQueryPlanBuilder.computeBestPath

2009-12-09T11:04:41Z

Thanks, Thomas. Will create a test case and then create the issue.

I'was reading the example in the docs:
// Fast version, second alternative
select
(select avg(value) from MyEvent.win:length(100)) as avgA,
(select avg(value) from MyEvent.win:length(50)) as avgB,
a.symbol
from MyEvent.std:lastevent() a, MyEvent.std:lastevent() b

For a 15-stream join, is this the subquery approach that you meant?

select
(select value from Event(id=1).std:lastevent()),
(select value from Event(id=2).std:lastevent()),
...
(select value from Event(id=13).std:lastevent()),
j.value
from Event(id=14).std.lastevent() as j

cheers,
Pedro

Thomas Bernhardt wrote:

Hi,
can you please create a JIRA and attach the test Java class.
As a workaround to a 15-stream join consider subqueries.

Best regards
Tom

________________________________
From: pedroteixeira <pedro.t@gmail.com>
To: user@esper.codehaus.org
Sent: Wed, December 9, 2009 8:10:18 AM
Subject: Re: [esper-user] Stuck at NStreamQueryPlanBuilder.computeBestPath

TYPO. The actual query is more like this:

select a.value, b.value, c.value ... j.value from Stream(id =
1).std:lastevent() as a, Stream(id = 2).std:lastevent() as b, ..., Stream(id
=10).std:lastevent() as j

pedroteixeira wrote:
>
>
> Hello,
>
> I've stumbled across a problem, but need some help to understand what it
> is the intended behavior of the NStreamQueryPlanBuilder class. Perhaps,
> someone has already had this problem, but I was not able to find in the
> archive.
>
>
> I have a query which joins 10 streams in the following manner:
>
> select a.value, b.value, c.value ... j.value from Stream(id = 1) as a,
> Stream(id = 2) as b, ..., Stream(id =10) as j
>
>
> The esper engine gets stuck in the "computeBestPath" method, consuming one
> of the CPUs allocated to the running thread. With yourkit, I extracted the
> following stack trace:
>
>
> com.espertech.esper.collection.PermutationEnumeration.nextElement()
> com.espertech.esper.collection.NumberSetPermutationEnumeration.nextElement()
> com.espertech.esper.epl.join.plan.NStreamQueryPlanBuilder.computeBestPath(int,
> QueryGraph, HistoricalDependencyGraph)
> com.espertech.esper.epl.join.plan.NStreamQueryPlanBuilder.build(QueryGraph,
> EventType[], boolean, boolean[], HistoricalDependencyGraph,
> HistoricalStreamIndexList[])
> com.espertech.esper.epl.join.plan.QueryPlanBuilder.getPlan(EventType[],
> List, QueryGraph, String[], boolean, boolean[],
> HistoricalDependencyGraph, HistoricalStreamIndexList[],
> ExprEvaluatorContext)
> com.espertech.esper.epl.join.JoinSetComposerFactoryImpl.makeComposer(List,
> ExprNode, EventType[], String[], Viewable[],
> SelectClauseStreamSelectorEnum, StreamJoinAnalysisResult,
> ExprEvaluatorContext)
> com.espertech.esper.core.EPStatementStartMethod.handleJoin(String[],
> EventType[], Viewable[], ResultSetProcessor,
> SelectClauseStreamSelectorEnum, StatementContext, List,
> StreamJoinAnalysisResult)
> com.espertech.esper.core.EPStatementStartMethod.startSelect(boolean)
> com.espertech.esper.core.EPStatementStartMethod.start(boolean, boolean,
> boolean)
> com.espertech.esper.core.StatementLifecycleSvcImpl.startInternal(String,
> StatementLifecycleSvcImpl$EPStatementDesc, boolean, boolean, boolean)
> com.espertech.esper.core.StatementLifecycleSvcImpl.start(String,
> StatementLifecycleSvcImpl$EPStatementDesc, boolean, boolean, boolean)
> com.espertech.esper.core.StatementLifecycleSvcImpl.createAndStart(StatementSpecRaw,
> String, boolean, String, String, Map, Object, EPIsolationUnitServices)
> com.espertech.esper.core.StatementLifecycleSvcImpl.createAndStart(StatementSpecRaw,
> String, boolean, String, Object, EPIsolationUnitServices)
> com.espertech.esper.core.EPAdministratorImpl.create(EPStatementObjectModel,
> String)
> com.espertech.esper.core.EPAdministratorImpl.create(EPStatementObjectModel)
>
>
>
> There seems to be some sort of caveat in the "computeBestPath" method,
> since it might have to try 15! combinations (in my case). Is that really
> intented?
>
> Thanks a bunch,
> Pedro
>
>
>

--
View this message in context: http://old.nabble.com/Stuck-at-NStreamQueryPlanBuilder.computeBestPath-tp26709887p26709902.html
Sent from the Esper User list mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe from this list, please visit:

http://xircles.codehaus.org/manage_email

From forum: Esper User list