To Scheduled Task, or Not to Scheduled Task?

[Jessica Kennedy-2]

Hi, I'm working on a project where a user uploads a video (via uploadify), and then based on what format the video is it will either be sent for transcoding, or sent to our streaming server.  

I'm trying to decide how to most efficiently transfer these large files to our streaming server.  I considered sending the videos straight to the server once a user uploads them, but I don't think they would want to sit and wait for that to happen.  So, I then considered setting up a scheduled task that ran every 20 min. or so that would loop through all the videos that need uploading and place them on the SS.  However, I wasn't sure if that would be a good idea as it seems like it would be a serious resource drain and slow everything down site-wide.

Does anybody have any advice or solutions on what to do?

Oh! I guess it's also important to know that the users are not expecting their videos to be publicly available for 1-2 days as all videos will have to be approved by a moderator.

Thanks!

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists
Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:328089
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.4

[Dave Watts]

> I'm trying to decide how to most efficiently transfer these large files to our streaming
> server.  I considered sending the videos straight to the server once a user uploads them,
> but I don't think they would want to sit and wait for that to happen.  So, I then considered
> setting up a scheduled task that ran every 20 min. or so that would loop through all the
> videos that need uploading and place them on the SS.  However, I wasn't sure if that would
> be a good idea as it seems like it would be a serious resource drain and slow everything
> down site-wide.
>
> Does anybody have any advice or solutions on what to do?
>
> Oh! I guess it's also important to know that the users are not expecting their videos to be
> publicly available for 1-2 days as all videos will have to be approved by a moderator.

There's no need to make users wait for a process to complete, when you
have CFTHREAD.

On the other hand, if people will have to wait up to two days to see
results anyway, why not just process them all at once once a day or
so?

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/

Fig Leaf Software provides the highest caliber vendor-authorized
instruction at our training centers in Washington DC, Atlanta,
Chicago, Baltimore, Northern Virginia, or on-site at your location.
Visit http://training.figleaf.com/ for more informati

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists
Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:328091
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.4

[Barney Boisvert]

You can use CFTHREAD (or even CFHTTP) to do the copy in the background
so the user doesn't have to wait, but it still happens at upload time
rather than in a batch run.  But the same amount of copying will
happen in any case, so I don't know that using a scheduled task will
really be problematic, and it'll probably be the simplest solution.

cheers,
barneyb

On Fri, Nov 6, 2009 at 7:42 AM, Jessica Kennedy
<police_kidnapped_your_children@...> wrote:

>
> Hi, I'm working on a project where a user uploads a video (via uploadify), and then based on what format the video is it will either be sent for transcoding, or sent to our streaming server.
>
> I'm trying to decide how to most efficiently transfer these large files to our streaming server.  I considered sending the videos straight to the server once a user uploads them, but I don't think they would want to sit and wait for that to happen.  So, I then considered setting up a scheduled task that ran every 20 min. or so that would loop through all the videos that need uploading and place them on the SS.  However, I wasn't sure if that would be a good idea as it seems like it would be a serious resource drain and slow everything down site-wide.
>
> Does anybody have any advice or solutions on what to do?
>
> Oh! I guess it's also important to know that the users are not expecting their videos to be publicly available for 1-2 days as all videos will have to be approved by a moderator.
>
> Thanks!
>
>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists
Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:328092
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.4