« Return to Thread: CSV Playback - sending time tick event all events for a particular time have been received

CSV Playback - sending time tick event all events for a particular time have been received

by Daniel Korzekwa-2 :: Rate this Message:

| View in Thread

Question about:

From  http://esper.codehaus.org/esperio-4.5.0/doc/reference/en/html/adapter_csv.html#csv-timer 
"'... If external timing is enabled then esperio will run through the input file at full speed without pausing. The algorithm used sends a time event after all events for a particular time have been received. For the above example file a time event for 2 will be sent after IBM, for 3 after MSFT and 1004 after JAVA. For many of use cases this gives a performance improvement. .."

What is the reasoning for sending time tick event all events for a particular time have been received. Consider those two CreateAccount events in a CVS file:

account_id, timestamp
1, 1000
2,100000

The effective time for the second event is 1000, even though this account was created at timestamp 100000. My desired behavior would be to set timestamp in Esper to 100000 before processing the second event.

I believe there is a good reason for sending time tick event after processing all events for a given timestamp and I would appreciate if someone could explain it for me. 

--
Daniel Korzekwa
Software Engineer
priv: http://danmachine.com
blog: http://blog.danmachine.com

 « Return to Thread: CSV Playback - sending time tick event all events for a particular time have been received