E-mail- Batch is SLOW

View: New views
9 Messages — Rating Filter:   Alert me  

E-mail- Batch is SLOW

by TennP :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

I posted a question about this 1-2 months ago and thanks for the feedback  
then. I have further isolated the problem.
 
I am using 4D Runtime 2003.6.  When my clients send group e-mails  
(100-500) short e-mails (less than 500 characters), it can take hours when they  are
using authentication. When the few that don't have to use authentication  
(they can do it either with or without), it take about 15 minutes.
 
So here is the scenario:
 
One of my customer sends 100 e-mails ( 500 characters) with authentication:
 takes 2-3 hours.
Same customer sends 100 e-mails(500 characters) without authentication:  
takes 10 minutes.
Same customer send 100 e-mails(500 characters) with authentication from  
OUTLOOK: takes 10 minutes.
 
Below is my code that I loop when authentication is required. Am I missing  
something? I have also tried just using the authentication on the first
e-mail  and not the subsequent ones but get an error message on the subsequent  
ones.
 
  If  (vEmailResponseTimeOut<5)
$Error:=IT_SetTimeOut  (15)
Else
$Error:=IT_SetTimeOut  (vEmailResponseTimeOut)
End if  

Case of
:  (Not(ErrorCheckingMail ("New";SMTP_New ($smtp_ID))))
:  (Not(ErrorCheckingMail ("Set Port";IT_SetPort  (2;vEmailPort))))
: (Not(ErrorCheckingMail  ("Auth";SMTP_Auth  
($smtp_ID;vEmailUserName;vEmailUserPassword;0))))
:  (Not(ErrorCheckingMail ("Host";SMTP_Host  ($smtp_ID;vEmailSMTP;0))))
: (Not(ErrorCheckingMail  ("To";SMTP_From ($smtp_ID;vEmailFromDefault;1))))
:  (Not(ErrorCheckingMail ("New";SMTP_To  ($smtp_ID;$1->;1))))
: (Not(ErrorCheckingMail  ("Body";SMTP_Body ($smtp_ID;vEmailText;1))))
:  (Not(ErrorCheckingMail ("Subject";SMTP_Subject  
($smtp_ID;vEmailSubject;1))))
: (Not(Attachments  ($smtp_ID)))
: (Not(ErrorCheckingMail ("Send";SMTP_Send  ($smtp_ID))))
: (Not(ErrorCheckingMail ("Clear";SMTP_Clear  ($smtp_ID))))

End case
 
Thanks for any help.
 
Paul  Ziegler
President
Mt. Taylor Programs
Private Advantage  Software
privateadvantage@...
www.privateadv.com
**************It's raining cats and dogs -- Come to PawNation, a place
where pets rule! (http://www.pawnation.com/?ncid=emlcntnew00000008)
**********************************************************************
Register for 4D Summit 2009 Today
Early Bird Pricing Ends August 28th - http://www.4d.com/summit

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

RE: E-mail- Batch is SLOW

by David Ringsmuth :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Paul,

I had to write an email throttle to do the opposite of what I am about to
recommend to you, because many ISP's flag as spam a sender when too many
emails are received too quickly.

If that is not a problem for you, you may want to verify that your sending
computer has reverse-lookup email authentication configured  (PTR record).

Optionally you may want to send through a relay such as PostCast, or IIS and
allow those to handle delivery. I've used both of these. Sending to them is
like printing to a spooler. Both have email logs that help fix other email
sending problems (blocked, bad ehelo, helo, bad PTR, etc.)

Hth
David Ringsmuth

-----Original Message-----
From: 4d_tech-bounces@... [mailto:4d_tech-bounces@...] On
Behalf Of TennP@...
Sent: Wednesday, July 01, 2009 4:13 PM
To: 4d_tech@...
Subject: E-mail- Batch is SLOW

I posted a question about this 1-2 months ago and thanks for the feedback  
then. I have further isolated the problem.
 
I am using 4D Runtime 2003.6.  When my clients send group e-mails  
(100-500) short e-mails (less than 500 characters), it can take hours when
they  are
using authentication. When the few that don't have to use authentication  
(they can do it either with or without), it take about 15 minutes.
 
So here is the scenario:
 
One of my customer sends 100 e-mails ( 500 characters) with authentication:
 takes 2-3 hours.
Same customer sends 100 e-mails(500 characters) without authentication:  
takes 10 minutes.
Same customer send 100 e-mails(500 characters) with authentication from  
OUTLOOK: takes 10 minutes.
 
Below is my code that I loop when authentication is required. Am I missing  
something? I have also tried just using the authentication on the first
e-mail  and not the subsequent ones but get an error message on the
subsequent  
ones.
 
  If  (vEmailResponseTimeOut<5)
$Error:=IT_SetTimeOut  (15)
Else
$Error:=IT_SetTimeOut  (vEmailResponseTimeOut)
End if  

Case of
:  (Not(ErrorCheckingMail ("New";SMTP_New ($smtp_ID))))
:  (Not(ErrorCheckingMail ("Set Port";IT_SetPort  (2;vEmailPort))))
: (Not(ErrorCheckingMail  ("Auth";SMTP_Auth  
($smtp_ID;vEmailUserName;vEmailUserPassword;0))))
:  (Not(ErrorCheckingMail ("Host";SMTP_Host  ($smtp_ID;vEmailSMTP;0))))
: (Not(ErrorCheckingMail  ("To";SMTP_From ($smtp_ID;vEmailFromDefault;1))))
:  (Not(ErrorCheckingMail ("New";SMTP_To  ($smtp_ID;$1->;1))))
: (Not(ErrorCheckingMail  ("Body";SMTP_Body ($smtp_ID;vEmailText;1))))
:  (Not(ErrorCheckingMail ("Subject";SMTP_Subject  
($smtp_ID;vEmailSubject;1))))
: (Not(Attachments  ($smtp_ID)))
: (Not(ErrorCheckingMail ("Send";SMTP_Send  ($smtp_ID))))
: (Not(ErrorCheckingMail ("Clear";SMTP_Clear  ($smtp_ID))))

End case
 
Thanks for any help.
 
Paul  Ziegler
President
Mt. Taylor Programs
Private Advantage  Software
privateadvantage@...
www.privateadv.com
**************It's raining cats and dogs -- Come to PawNation, a place
where pets rule! (http://www.pawnation.com/?ncid=emlcntnew00000008)
**********************************************************************
Register for 4D Summit 2009 Today
Early Bird Pricing Ends August 28th - http://www.4d.com/summit

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

**********************************************************************
Register for 4D Summit 2009 Today
Early Bird Pricing Ends August 28th - http://www.4d.com/summit

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

Re: E-mail- Batch is SLOW

by Mehboob Alam :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


Paul,

Try setting your own local SMTP server which then routes to the outside ISP server. Then point the 4D Email blast at the local in-house server.
You didnt mention which OS this is running on - XP or Vista?

 sincerely,
mehboob alam




Electricity is actually made up of extremely tiny particles called electrons,
that you cannot see with the naked eye unless you have been drinking.
- Dave Barry



----- Original Message ----
From: "TennP@..." <TennP@...>
To: 4d_tech@...
Sent: Wednesday, July 1, 2009 5:12:37 PM
Subject: E-mail- Batch is SLOW

I posted a question about this 1-2 months ago and thanks for the feedback  
then. I have further isolated the problem.

I am using 4D Runtime 2003.6.  When my clients send group e-mails  
(100-500) short e-mails (less than 500 characters), it can take hours when they  are
using authentication. When the few that don't have to use authentication  
(they can do it either with or without), it take about 15 minutes.

So here is the scenario:

One of my customer sends 100 e-mails ( 500 characters) with authentication:
takes 2-3 hours.
Same customer sends 100 e-mails(500 characters) without authentication:  
takes 10 minutes.
Same customer send 100 e-mails(500 characters) with authentication from  
OUTLOOK: takes 10 minutes.

Below is my code that I loop when authentication is required. Am I missing  
something? I have also tried just using the authentication on the first
e-mail  and not the subsequent ones but get an error message on the subsequent  
ones.

  If  (vEmailResponseTimeOut<5)
$Error:=IT_SetTimeOut  (15)
Else
$Error:=IT_SetTimeOut  (vEmailResponseTimeOut)
End if  

Case of
:  (Not(ErrorCheckingMail ("New";SMTP_New ($smtp_ID))))
:  (Not(ErrorCheckingMail ("Set Port";IT_SetPort  (2;vEmailPort))))
: (Not(ErrorCheckingMail  ("Auth";SMTP_Auth  
($smtp_ID;vEmailUserName;vEmailUserPassword;0))))
:  (Not(ErrorCheckingMail ("Host";SMTP_Host  ($smtp_ID;vEmailSMTP;0))))
: (Not(ErrorCheckingMail  ("To";SMTP_From ($smtp_ID;vEmailFromDefault;1))))
:  (Not(ErrorCheckingMail ("New";SMTP_To  ($smtp_ID;$1->;1))))
: (Not(ErrorCheckingMail  ("Body";SMTP_Body ($smtp_ID;vEmailText;1))))
:  (Not(ErrorCheckingMail ("Subject";SMTP_Subject  
($smtp_ID;vEmailSubject;1))))
: (Not(Attachments  ($smtp_ID)))
: (Not(ErrorCheckingMail ("Send";SMTP_Send  ($smtp_ID))))
: (Not(ErrorCheckingMail ("Clear";SMTP_Clear  ($smtp_ID))))

End case

Thanks for any help.

Paul  Ziegler
President
Mt. Taylor Programs
Private Advantage  Software
privateadvantage@...
www.privateadv.com
**************It's raining cats and dogs -- Come to PawNation, a place
where pets rule! (http://www.pawnation.com/?ncid=emlcntnew00000008)
**********************************************************************
Register for 4D Summit 2009 Today
Early Bird Pricing Ends August 28th - http://www.4d.com/summit

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************



     
**********************************************************************
Register for 4D Summit 2009 Today
Early Bird Pricing Ends August 28th - http://www.4d.com/summit

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

Parent Message unknown RE: E-mail- Batch is SLOW

by TennP :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Thanks for the replies.
 
Re: If  that is not a problem for you, you may want to verify that your  
sending
computer has reverse-lookup email authentication configured   (PTR record).


Where  is this configured. I am using Win Vista and sending the emails from
 4D.
 
 
 
Paul  Ziegler
President
Mt. Taylor Programs
Private Advantage  Software
privateadvantage@...
www.privateadv.com
**************It's raining cats and dogs -- Come to PawNation, a place
where pets rule! (http://www.pawnation.com/?ncid=emlcntnew00000008)
**********************************************************************
Register for 4D Summit 2009 Today
Early Bird Pricing Ends August 28th - http://www.4d.com/summit

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

RE: E-mail- Batch is SLOW

by David Ringsmuth :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Paul,

Re: "Where is this configured"

Ask the business who provides the public IP address to add a PTR record that
points to the (sub)domain name at your IP address.

In my situations the subdomain is set up where the DNS is parked. It is an
"A" record such as "secure.domain.com" that references the IP address where
email is sent from.

The assumption here is that you have an (sub)domain that resolves to the IP
address from which you are sending email.

David

-----Original Message-----
From: 4d_tech-bounces@... [mailto:4d_tech-bounces@...] On
Behalf Of TennP@...
Sent: Thursday, July 02, 2009 2:46 PM
To: 4d_tech@...
Subject: RE: E-mail- Batch is SLOW

Thanks for the replies.
 
Re: If  that is not a problem for you, you may want to verify that your  
sending
computer has reverse-lookup email authentication configured   (PTR record).


Where  is this configured. I am using Win Vista and sending the emails from
 4D.
 
 
 
Paul  Ziegler
President
Mt. Taylor Programs
Private Advantage  Software
privateadvantage@...
www.privateadv.com
**************It's raining cats and dogs -- Come to PawNation, a place
where pets rule! (http://www.pawnation.com/?ncid=emlcntnew00000008)

**********************************************************************
Register for 4D Summit 2009 Today
Early Bird Pricing Ends August 28th - http://www.4d.com/summit

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

Re: E-mail- Batch is SLOW

by Mehboob Alam :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message


In Vista, you may also run afoul of the system UAC (User Account Control).

If you have a chance to experiment, try turning it off
http://www.petri.co.il/disable_uac_in_windows_vista.htm

I have read numerous reports of email-blast vendors having to fix their products to work with Vista, or instruct the users to switch off the AUC.
http://www.sendblaster.com/why-we-make-best-bulk-emailers/win-vista-turning-uac-on/

 sincerely,
mehboob alam




Electricity is actually made up of extremely tiny particles called electrons, that you cannot see with the naked eye unless you have been drinking. - Dave Barry



----- Original Message ----
From: "TennP@..." <TennP@...>
To: 4d_tech@...
Sent: Thursday, July 2, 2009 3:45:55 PM
Subject: RE: E-mail- Batch is SLOW

Thanks for the replies.

Re: If  that is not a problem for you, you may want to verify that your  
sending
computer has reverse-lookup email authentication configured   (PTR record).


Where  is this configured. I am using Win Vista and sending the emails from
4D.



Paul  Ziegler
President
Mt. Taylor Programs
Private Advantage  Software
privateadvantage@...
www.privateadv.com
**************It's raining cats and dogs -- Come to PawNation, a place
where pets rule! (http://www.pawnation.com/?ncid=emlcntnew00000008)
**********************************************************************
Register for 4D Summit 2009 Today
Early Bird Pricing Ends August 28th - http://www.4d.com/summit

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************



     
**********************************************************************
Live Data Mapping Services with 4D v11 SQL
See it for yourself - http://www.4d.com/solutions/ndwater.html

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

Re: E-mail- Batch is SLOW

by Matthias Schmidt-6 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Am/On Thu, 2 Jul 2009 15:45:55 -0400 schrieb/wrote TennP@...:

>Re: If  that is not a problem for you, you may want to verify that your
>sending
>computer has reverse-lookup email authentication configured   (PTR record).
>
>
>Where  is this configured. I am using Win Vista and sending the emails from
> 4D.

in your DNS server.
The reverse pointer should correctly resolve to the A-Record of your
public IP.

cheers,
Matthias

------------------------------------------------------------------------
Admilon Consulting GmbH
Am Wiesengrund 9a, 90584 Allersberg, Germany
Geschäftsführer: Peter Frank, Matthias Schmidt
Amtsgericht Nürnberg: HRB 21750
VAT Reg.No: DE242271157
Tel.: +49-9174 - 6646 Fax: +49-9174 - 6647
<http://www.admilon-consulting.de>
-------------------------------------------------------------------------

------------------ RFC822  Header folgt------------------
From: "Matthias Schmidt" <4D_info@...>
To: "4D iNug Technical" <4d_tech@...>
Subject: Re: E-mail- Batch is SLOW
Date: Fri, 3 Jul 2009 13:30:49 +0900
Message-Id: <20090703043049.2104704160@...>
In-Reply-To: <c67.580fb8ca.377e6873@...>
References: <c67.580fb8ca.377e6873@...>
X-Mailer: CTM PowerMail version 6.0.2 build 4601 German (intel)
 <http://www.ctmdev.com>
Organization: Admilon Consulting GmbH
X-Archive: encrypt
MIME-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
-----------------------------------------------------------



**********************************************************************
Live Data Mapping Services with 4D v11 SQL
See it for yourself - http://www.4d.com/solutions/ndwater.html

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

Re: E-mail- Batch is SLOW

by Justus Janssen - 4Dnug :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Paul,

TennP@... wrote:

>
> Case of
> : (Not(ErrorCheckingMail ("New";SMTP_New ($smtp_ID))))
> : (Not(ErrorCheckingMail ("Set Port";IT_SetPort  (2;vEmailPort))))
> : (Not(ErrorCheckingMail ("Auth";SMTP_Auth  
>      ($smtp_ID;vEmailUserName;vEmailUserPassword;0))))
> : (Not(ErrorCheckingMail ("Host";SMTP_Host  ($smtp_ID;vEmailSMTP;0))))
> : (Not(ErrorCheckingMail ("To";SMTP_From ($smtp_ID;vEmailFromDefault;1))))
> : (Not(ErrorCheckingMail ("New";SMTP_To  ($smtp_ID;$1->;1))))
> : (Not(ErrorCheckingMail ("Body";SMTP_Body ($smtp_ID;vEmailText;1))))
> : (Not(ErrorCheckingMail ("Subject";SMTP_Subject  
>      ($smtp_ID;vEmailSubject;1))))
> : (Not(Attachments ($smtp_ID)))
> : (Not(ErrorCheckingMail ("Send";SMTP_Send  ($smtp_ID))))
> : (Not(ErrorCheckingMail ("Clear";SMTP_Clear  ($smtp_ID))))
>

could it be that initiating a new SMTP session for each message, is what
is causing the delays? In typical Batch processing, one tries to
eliminate as much overhead as possible. The new series of commands would
then be:

New
Set port
Auth
Host
... (loop for each mail) ...
   From
   To
   Subject
   Body
   Attachments
   Send
... (end loop) ...
Clear

Depending on the type and content of the mailing, the "From", "Subject",
"Body" and/or "Attachments" field(s) might be set outside the loop too.
Haven't tested this for speed, though it should work technically.

Hope this helps,

--
Justus Janssen
Arpa - Veldhoven, Netherlands
**********************************************************************
Live Data Mapping Services with 4D v11 SQL
See it for yourself - http://www.4d.com/solutions/ndwater.html

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************

Parent Message unknown Re: E-mail- Batch is SLOW

by TennP :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Thanks for all the replies.
 
Justus- I tried what you suggested and it works on my office computer, but  
I wasn't having problems with that one. I will test it in the field soon
and let  you know the results. It certainly seems that it logically should
have an  effect.
 
 
 
Paul  Ziegler
President
Mt. Taylor Programs
Private Advantage  Software
privateadvantage@...
www.privateadv.com
**************Summer concert season is here! Find your favorite artists on
tour at TourTracker.com.
(http://www.tourtracker.com/?ncid=emlcntusmusi00000006)
**********************************************************************
Live Data Mapping Services with 4D v11 SQL
See it for yourself - http://www.4d.com/solutions/ndwater.html

4D Internet Users Group (4D iNUG)
FAQ:  http://www.4D.com/support/faqnug.html
Archive:  http://lists.4D.com/archives.html
Options: https://lists.4d.com/mailman/options/4d_tech
Unsub:  mailto:4D_Tech-Unsubscribe@...
**********************************************************************