UDT data transfer in UNICORE 6.2.1

View: New views
3 Messages — Rating Filter:   Alert me  

UDT data transfer in UNICORE 6.2.1

by Maryna Kuliashova :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Bernd,

I test the UDT server-server data transfer for unicore-servers-6.2.1 and ucc-1.2.0.
I configured the UDT service according to:
http://unicore.svn.sourceforge.net/viewvc/unicore/unicorex/trunk/uas-udt/README.txt?revision=4948&view=markup

But unfortunately while running the command:
ucc copy-file -v -s u6://DEMO-SITE/Home/temp/demo-site/test.txt?protocol=UDT -t u6://DEMO-SITE_1/Home/temp/demo-site_1/test.txt?protocol=UDT
[ucc copy-file] Reading properties file </home/marina/.ucc/preferences>
[ucc copy-file] Keystore = /home/marina/ucc-1.2.0/certs/user-keystore.jks
[ucc copy-file] Keystore password given.
[ucc copy-file] Using default alias.
[ucc copy-file] Keystore type = jks
[ucc copy-file] Registry = https://localhost:8080/REGISTRY/services/Registry?res=default_registry 
[ucc copy-file] Checking registry connection.
[ucc copy-file] Registry connection status: OK
[ucc copy-file] Output goes to <.>
[ucc copy-file] Synchronous transfer = true
[ucc copy-file] Output goes to <.>
[ucc copy-file] Resolved location u6://DEMO-SITE/Home/temp/demo-site/test.txt as <https://localhost:8080/DEMO-SITE/services/StorageManagement?res=e20d03a3-1d08-49e5-a848-7614dac1d8f9>, using protocol <UDT>
[ucc copy-file] Resolved location u6://DEMO-SITE_1/Home/temp/demo-site_1/test.txt as <https://localhost:8082/DEMO-SITE_1/services/StorageManagement?res=657a06ea-86d1-46d7-ab2a-a097e9de8631>, using protocol <UDT>
[ucc copy-file] SMS https://localhost:8082/DEMO-SITE_1/services/StorageManagement?res=657a06ea-86d1-46d7-ab2a-a097e9de8631 contacted, server reply: servertime=2009-09-17T13:59:04.861+03:00
[ucc copy-file] Initiating FetchFile on SMS=<https://localhost:8082/DEMO-SITE_1/services/StorageManagement?res=657a06ea-86d1-46d7-ab2a-a097e9de8631>,receiving file<u6://DEMO-SITE/Home/temp/demo-site/test.txt?protocol=UDT>, writing to temp/demo-site_1/test.txt
[ucc copy-file] Checking for services at https://localhost:8082/DEMO-SITE_1 
[ucc copy-file] Delegating to EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo unicorex
[ucc copy-file] Have filetransfer instance: https://localhost:8082/DEMO-SITE_1/services/FileTransfer?res=3853eb50-e34e-4274-9462-c57ddccd34ff 
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
...
this UDT server-server transfer process does not finish.

There is the following info on source server in uas.log :
2009-09-17 13:56:08,537 [UNICORE/X-Startup] INFO  UAS  - Startup time: 22663 ms.
2009-09-17 13:56:08,538 [UNICORE/X-Startup] INFO  UAS  - ***** Server started. *****
2009-09-17 13:56:10,105 [UNICORE/X-Startup] INFO  ServiceGroupRegistrationImpl  - Refreshing registry entry for: https://localhost:8080/DEMO-SITE/services/CISInfoProvider 
2009-09-17 13:56:10,169 [UNICORE/X-Startup] INFO  RegistryEntryUpdater  - Refreshed registry entry for: https://localhost:8080/DEMO-SITE/services/CISInfoProvider 
2009-09-17 13:56:10,686 [UNICORE/X-Startup] INFO  ServiceGroupRegistrationImpl  - Refreshing registry entry for: https://localhost:8080/DEMO-SITE/services/TargetSystemFactoryService?res=default_target_system_factory 
2009-09-17 13:56:10,712 [UNICORE/X-Startup] INFO  RegistryEntryUpdater  - Refreshed registry entry for: https://localhost:8080/DEMO-SITE/services/TargetSystemFactoryService?res=default_target_system_factory 
2009-09-17 13:57:33,193 [15828664@qtp-5056711-2] INFO  XUUDBAuthoriser  - New client: EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user
2009-09-17 13:57:35,611 [15828664@qtp-5056711-2] INFO  TargetSystemFactoryImpl  - Created new TargetSystem resource <10d7f532-48d1-4403-ab55-812d3c3440a4> for EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user
2009-09-17 13:59:08,713 [25881841@qtp-5056711-4] INFO  FileTransferImpl  - New file transfer:  from '/home/marina//temp/demo-site/test.txt' for EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user protocol=UDT isExport=true overwrite=true workdir=/home/marina/ isPipe=false
2009-09-17 13:59:08,718 [25881841@qtp-5056711-4] INFO  StorageClient  - Registered filetransfer client class class de.fzj.unicore.uas.client.UDTClient for protocolUDT.
2009-09-17 13:59:08,737 [25881841@qtp-5056711-4] WARN  ModifiableResourceProperty  - No schema type found for type {http://unigrids.org/2006/04/services/fts}TransferredBytes in properties document {http://unigrids.org/2006/04/services/fts}FileTransferProperties

There is the folowing info on target server in uas.log:
2009-09-17 13:56:50,888 [UNICORE/X-Startup] INFO  UAS  - Startup time: 17642 ms.
2009-09-17 13:56:50,889 [UNICORE/X-Startup] INFO  UAS  - ***** Server started. *****
2009-09-17 13:56:52,630 [UNICORE/X-Startup] INFO  ServiceGroupRegistrationImpl  - Refreshing registry entry for: https://localhost:8082/DEMO-SITE_1/services/TargetSystemFactoryService?res=default_target_system_factory 
2009-09-17 13:56:52,693 [UNICORE/X-Startup] INFO  RegistryEntryUpdater  - Refreshed registry entry for: https://localhost:8082/DEMO-SITE_1/services/TargetSystemFactoryService?res=default_target_system_factory 
2009-09-17 13:56:53,189 [UNICORE/X-Startup] INFO  ServiceGroupRegistrationImpl  - Refreshing registry entry for: https://localhost:8082/DEMO-SITE_1/services/CISInfoProvider 
2009-09-17 13:56:53,202 [UNICORE/X-Startup] INFO  RegistryEntryUpdater  - Refreshed registry entry for: https://localhost:8082/DEMO-SITE_1/services/CISInfoProvider 
2009-09-17 13:57:38,352 [10204247@qtp-3392486-3] INFO  XUUDBAuthoriser  - New client: EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user
2009-09-17 13:57:39,948 [10204247@qtp-3392486-3] INFO  TargetSystemFactoryImpl  - Created new TargetSystem resource <9c7223d3-cc2c-4585-8c94-894a3935fa6c> for EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user
2009-09-17 13:59:06,516 [20155709@qtp-3392486-4] INFO  FileTransferImpl  - New file transfer:  from 'UDT:https://localhost:8080/DEMO-SITE/services/StorageManagement?res=e20d03a3-1d08-49e5-a848-7614dac1d8f9#/temp/demo-site/test.txt' to '/home/marina//temp/demo-site_1/test.txt' for EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user protocol=null isExport=false overwrite=true workdir=/home/marina/ isPipe=false
2009-09-17 13:59:06,519 [20155709@qtp-3392486-4] INFO  UDTCreator  - +++ creating file import UDT:https://localhost:8080/DEMO-SITE/services/StorageManagement?res=e20d03a3-1d08-49e5-a848-7614dac1d8f9#/temp/demo-site/test.txt -> /home/marina//temp/demo-site_1/test.txt
2009-09-17 13:59:09,470 [wsrflite-executor-4] INFO  StorageClient  - Registered filetransfer client class class de.fzj.unicore.uas.client.UDTClient for protocol UDT.
2009-09-17 13:59:09,689 [wsrflite-executor-4] INFO  BasicTSIFactory  - Creating new uspace for 023f6226-4e44-4fac-970b-626abe74d92b
client: EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user
Xlogin: [marina], role: user: role from authorisation, authenticated using <CONSIGNOR X509v3>

There is the following info in file out.023f6226-4e44-4fac-970b-626abe74d92b on target server in working directory
unicorex/data/FILESPACE/023f6226-4e44-4fac-970b-626abe74d92b

cat out.023f6226-4e44-4fac-970b-626abe74d92b
OUT: 33641
INFO: Comm in-file not found, waiting...
INFO: Comm in-file not found, waiting...
INFO: Comm in-file not found, waiting...
INFO: Comm in-file not found, waiting...
INFO: Comm in-file not found, waiting...
INFO: Comm in-file not found, waiting...
INFO: Comm in-file not found, waiting...
INFO: Comm in-file not found, waiting...
...

Please advise me about the reason of this error?

Best regards,
Maryna Kuliashova
Researcher
The Laboratory of High-Performance Systems
United Institute of Information Problems
National Academy of Sciense of Belarus
http://uiip.bas-net.by
tel. +375 17 284 23 60




------------------------------------------------------------------------------
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
_______________________________________________
Unicore-support mailing list
Unicore-support@...
https://lists.sourceforge.net/lists/listinfo/unicore-support

Re: UDT data transfer in UNICORE 6.2.1

by Bernd Schuller :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Maryna,

my mistake, sorry! There is a change in the TSI ExecuteScript.pm module,
that I forgot to include in the UNICORE 6.2.1 release.

You can get it from
http://unicore.svn.sourceforge.net/viewvc/unicore/tsi/trunk/tsi/SHARED/ExecuteScript.pm

and you should write it to your TSI installation and restart the TSI.

Thanks a lot for testing this!!

Best regards,
Bernd.

On Mi, 2009-09-23 at 11:26 +0200, Maryna Kuliashova wrote:

> Hi Bernd,
>
> I test the UDT server-server data transfer for unicore-servers-6.2.1 and ucc-1.2.0.
> I configured the UDT service according to:
> http://unicore.svn.sourceforge.net/viewvc/unicore/unicorex/trunk/uas-udt/README.txt?revision=4948&view=markup
>
> But unfortunately while running the command:
> ucc copy-file -v -s u6://DEMO-SITE/Home/temp/demo-site/test.txt?protocol=UDT -t u6://DEMO-SITE_1/Home/temp/demo-site_1/test.txt?protocol=UDT
> [ucc copy-file] Reading properties file </home/marina/.ucc/preferences>
> [...]
> this UDT server-server transfer process does not finish.

> ...
>
> Please advise me about the reason of this error?
>
> Best regards,
> Maryna Kuliashova

--
Dr. Bernd Schuller
Distributed Systems and Grid Computing
Juelich Supercomputing Centre, http://www.fz-juelich.de/jsc
Phone: +49 246161-8736 (fax -8556)
Personal blog: www.jroller.com/page/gridhaus


------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzende des Aufsichtsrats: MinDir'in Baerbel Brumme-Bothe
Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender),
Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
Prof. Dr. Sebastian M. Schmidt
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
_______________________________________________
Unicore-support mailing list
Unicore-support@...
https://lists.sourceforge.net/lists/listinfo/unicore-support

Re: UDT data transfer in UNICORE 6.2.1

by Maryna Kuliashova :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Bernd,

Thanks a lot for the information,
Iĺl try to test the UDT filetransfer with the TSI ExecuteScript.pm module from svn.

Best regards,
Maryna Kuliashova.


On Wednesday 23 September 2009 16:16, you wrote:

> Hi Maryna,
>
> my mistake, sorry! There is a change in the TSI ExecuteScript.pm module,
> that I forgot to include in the UNICORE 6.2.1 release.
>
> You can get it from
> http://unicore.svn.sourceforge.net/viewvc/unicore/tsi/trunk/tsi/SHARED/ExecuteScript.pm
>
> and you should write it to your TSI installation and restart the TSI.
>
> Thanks a lot for testing this!!
>
> Best regards,
> Bernd.
>
> On Mi, 2009-09-23 at 11:26 +0200, Maryna Kuliashova wrote:
> > Hi Bernd,
> >
> > I test the UDT server-server data transfer for unicore-servers-6.2.1 and ucc-1.2.0.
> > I configured the UDT service according to:
> > http://unicore.svn.sourceforge.net/viewvc/unicore/unicorex/trunk/uas-udt/README.txt?revision=4948&view=markup
> >
> > But unfortunately while running the command:
> > ucc copy-file -v -s u6://DEMO-SITE/Home/temp/demo-site/test.txt?protocol=UDT -t u6://DEMO-SITE_1/Home/temp/demo-site_1/test.txt?protocol=UDT
> > [ucc copy-file] Reading properties file </home/marina/.ucc/preferences>
> > [...]
> > this UDT server-server transfer process does not finish.
>
> > ...
> >
> > Please advise me about the reason of this error?
> >
> > Best regards,
> > Maryna Kuliashova
>
> --
> Dr. Bernd Schuller
> Distributed Systems and Grid Computing
> Juelich Supercomputing Centre, http://www.fz-juelich.de/jsc
> Phone: +49 246161-8736 (fax -8556)
> Personal blog: www.jroller.com/page/gridhaus
>
>
> ------------------------------------------------------------------------------------------------
> ------------------------------------------------------------------------------------------------
> Forschungszentrum Juelich GmbH
> 52425 Juelich
> Sitz der Gesellschaft: Juelich
> Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
> Vorsitzende des Aufsichtsrats: MinDir'in Baerbel Brumme-Bothe
> Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender),
> Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
> Prof. Dr. Sebastian M. Schmidt
> ------------------------------------------------------------------------------------------------
> ------------------------------------------------------------------------------------------------
>

------------------------------------------------------------------------------
Come build with us! The BlackBerry® Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9-12, 2009. Register now!
http://p.sf.net/sfu/devconf
_______________________________________________
Unicore-support mailing list
Unicore-support@...
https://lists.sourceforge.net/lists/listinfo/unicore-support