UDT data transfer in UNICORE 6.2.2

[Maryna Kuliashova]

Hi Bernd,

I tested the UDT server-server data transfer for unicore-servers-6.2.2 and ucc-1.2.0.
But the UDT server-server data transfer is yet unstable.

When running the command:
ucc copy-file -v -s u6://DEMO-SITE/Home/temp/demo-site/test.txt?protocol=UDT -t u6://DEMO-SITE_1/Home/temp/demo-site_1/test.txt?protocol=UDT
[ucc copy-file] Reading properties file </home/marina/.ucc/preferences>
[ucc copy-file] Keystore = /home/marina/ucc-1.2.0/certs/user-keystore.jks
[ucc copy-file] Keystore password given.
[ucc copy-file] Using default alias.
[ucc copy-file] Keystore type = jks
[ucc copy-file] Registry = https://localhost:8080/REGISTRY/services/Registry?res=default_registry 
[ucc copy-file] Checking registry connection.
[ucc copy-file] Registry connection status: OK
[ucc copy-file] Output goes to <.>
[ucc copy-file] Synchronous transfer = true
[ucc copy-file] Output goes to <.>
[ucc copy-file] Resolved location u6://DEMO-SITE/Home/temp/demo-site/test.txt as <https://localhost:8080/DEMO-SITE/services/StorageManagement?res=6ef42c32-36c7-4ce4-ade4-c94dbef6c252>, using protocol <UDT>
[ucc copy-file] Resolved location u6://DEMO-SITE_1/Home/temp/demo-site_1/test.txt as <https://localhost:8082/DEMO-SITE_1/services/StorageManagement?res=f8bc2329-51ac-4a28-8a62-37049ec5e049>, using protocol <UDT>
[ucc copy-file] SMS https://localhost:8082/DEMO-SITE_1/services/StorageManagement?res=f8bc2329-51ac-4a28-8a62-37049ec5e049 contacted, server reply: servertime=2009-10-08T12:50:08.579+03:00
[ucc copy-file] Initiating FetchFile on SMS=<https://localhost:8082/DEMO-SITE_1/services/StorageManagement?res=f8bc2329-51ac-4a28-8a62-37049ec5e049>,receiving file<u6://DEMO-SITE/Home/temp/demo-site/test.txt?protocol=UDT>, writing to temp/demo-site_1/test.txt
[ucc copy-file] Checking for services at https://localhost:8082/DEMO-SITE_1 
[ucc copy-file] Delegating to EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo unicorex
[ucc copy-file] Have filetransfer instance: https://localhost:8082/DEMO-SITE_1/services/FileTransfer?res=a53ba799-8b13-4896-8d75-0c4d755c0b99 
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [487k / 960k ]
[ucc copy-file] [960k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
[ucc copy-file] [0k / 960k ]
...
the UDT server-server transfer process does not finish although the file has been transfered successfully.

In this case there is the following info on target server in uas.log:
2009-10-08 12:50:10,756 [8664812@qtp-25389802-4] INFO  FileTransferImpl  - New file transfer:  from 'UDT:https://localhost:8080/DEMO-SITE/services/StorageManagement?res=6ef42c32-36c7-4ce4-ade4-c94dbef6c252#/temp/demo-site/test.txt' to '/home/marina//temp/demo-site_1/test.txt' for EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user protocol=null isExport=false overwrite=true workdir=/home/marina/ isPipe=false
2009-10-08 12:50:10,757 [8664812@qtp-25389802-4] INFO  UDTCreator  - +++ creating file import UDT:https://localhost:8080/DEMO-SITE/services/StorageManagement?res=6ef42c32-36c7-4ce4-ade4-c94dbef6c252#/temp/demo-site/test.txt -> /home/marina//temp/demo-site_1/test.txt
2009-10-08 12:50:12,294 [wsrflite-executor-7] INFO  BasicTSIFactory  - Creating new uspace for 29d96aa5-76b2-4a9d-9a29-ec9ea45b40b7
client: EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user
Xlogin: [marina], role: user: role from authorisation, authenticated using <CONSIGNOR X509v3>
2009-10-08 12:50:12,432 [wsrflite-executor-7] INFO  UDTSession  - Started UDT receive

In some cases the UDT filetransfer process finished successfully but at that there is the following error info on target server in uas.log:
2009-10-08 12:47:42,484 [13514081@qtp-25389802-3] INFO  FileTransferImpl  - New file transfer:  from 'UDT:https://localhost:8080/DEMO-SITE/services/StorageManagement?res=6ef42c32-36c7-4ce4-ade4-c94dbef6c252#/temp/demo-site/test.txt' to '/home/marina//temp/demo-site_1/test.txt' for EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user protocol=null isExport=false overwrite=true workdir=/home/marina/ isPipe=false
2009-10-08 12:47:42,484 [13514081@qtp-25389802-3] INFO  UDTCreator  - +++ creating file import UDT:https://localhost:8080/DEMO-SITE/services/StorageManagement?res=6ef42c32-36c7-4ce4-ade4-c94dbef6c252#/temp/demo-site/test.txt -> /home/marina//temp/demo-site_1/test.txt
2009-10-08 12:47:43,574 [wsrflite-executor-6] INFO  BasicTSIFactory  - Creating new uspace for e47da268-4a90-43ff-a321-8d8c54b0537b
client: EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user
Xlogin: [marina], role: user: role from authorisation, authenticated using <CONSIGNOR X509v3>
2009-10-08 12:47:43,772 [wsrflite-executor-6] INFO  UDTSession  - Started UDT receive
2009-10-08 12:47:51,125 [13514081@qtp-25389802-3] ERROR ReliableProxy  - Error making call for UpdateResourceProperties on https://localhost:8080/DEMO-SITE/services/FileTransferUDT?res=fcb0ff5a-b229-4d7c-b05b-0b383a48f794
2009-10-08 12:47:51,126 [13514081@qtp-25389802-3] ERROR ReliableProxy  - The root error was: de.fzj.unicore.wsrflite.xmlbeans.exceptions.ResourceUnknownFault: Resource 'fcb0ff5a-b229-4d7c-b05b-0b383a48f794' not found for service 'FileTransferUDT'
2009-10-08 12:47:51,126 [13514081@qtp-25389802-3] ERROR ReliableProxy  - To see the full error stack trace, set log4j.logger.unicore.wsrflite.ReliableProxy=DEBUG
2009-10-08 12:47:51,126 [13514081@qtp-25389802-3] ERROR BaseUASClient  - Got Error: class de.fzj.unicore.wsrflite.xmlbeans.exceptions.ResourceUnknownFault Resource'fcb0ff5a-b229-4d7c-b05b-0b383a48f794' not found for service 'FileTransferUDT'
2009-10-08 12:47:51,126 [13514081@qtp-25389802-3] ERROR UDTClient  - Could not get size of local file.
2009-10-08 12:47:51,127 [13514081@qtp-25389802-3] ERROR UDTClient  - The root error was: de.fzj.unicore.wsrflite.xmlbeans.exceptions.ResourceUnknownFault: Resource'fcb0ff5a-b229-4d7c-b05b-0b383a48f794' not found for service 'FileTransferUDT'
2009-10-08 12:47:51,127 [13514081@qtp-25389802-3] ERROR UDTClient  - To see the full error stack trace, set log4j.logger.unicore.client.UDTClient=DEBUG
2009-10-08 12:47:51,677 [13514081@qtp-25389802-3] INFO  ServerToServerFileTransferImpl  - Aborting filetransfer 9e0068ed-5fdd-45bd-85b2-a8a84dbd1e4a for client EMAILADDRESS=unicore-support@..., C=DE, O=unicore.eu, OU=Testing, CN=UNICORE demo user

Could you advise me about the UDTserver-server data transfer in UNICORE 6.2.2?

Best regards,
Maryna Kuliashova
Researcher
The Laboratory of High-Performance Systems
United Institute of Information Problems
National Academy of Sciense of Belarus
http://uiip.bas-net.by
tel. [phone]




------------------------------------------------------------------------------
Come build with us! The BlackBerry(R) Developer Conference in SF, CA
is the only developer event you need to attend this year. Jumpstart your
developing skills, take BlackBerry mobile applications to market and stay
ahead of the curve. Join us from November 9 - 12, 2009. Register now!
http://p.sf.net/sfu/devconference
_______________________________________________
Unicore-support mailing list
Unicore-support@...
https://lists.sourceforge.net/lists/listinfo/unicore-support