[Openroad-users] Importing data - Copy statement

gareth.2.edwards at bt.com gareth.2.edwards at bt.com
Thu Nov 2 21:55:35 EST 2006


OR4.1, Win2000

Hi All,

Having not done much with the copy statement previously, I'm a litle lost. 

I have to import some data, the two formats available are:

1) Comma seperated, but every data value is in "quotes"
2) Tab delimited, money values greater than 999 are in "quotes" and also contain a comma to break the thousand/hundred value

Are there any ways to deal with these imports? In particular the quoted values??

The only way I can think of is to use option 2), with

Copy table test
( col1 = c(0)tab, col2 = c(0)tab  etc...
)

Copy into a varchar column for the money values, then post-process stripping out the quotes and comma, then casting it. Which seems a very dirty & consuming way to do it.

Any help appreciated...

Cheers,
Gareth Edwards

BT Global Services 
tel: +44 (0)131 345 4671 
email: gareth.2.edwards at bt.com

-----Original Message-----
From: openroad-users-bounces at peerlessit.com [mailto:openroad-users-bounces at peerlessit.com] On Behalf Of neil.warnock at luminary.co.uk
Sent: Thursday, November 02, 2006 2:16 AM
To: International OpenROAD Users; martin.pomej at myworkplace.com.au
Subject: Re: [Openroad-users] App Server performance

I agree completely. Hardwired initiates should be avoided at all costs unless you are prepared to write your own nameserver logic (in which case you have not hardwired the connection anyway!) The initiate method should only be used directly in exceptional circumstances for example after invoking GetConnectionDetails earlier in the session. Performance problems are usually due to configured bottlenecks(too few slaves or process affinity) and/or poorly performing sql. Rgds Neil Warnock Sent from my BlackBerry® wireless device  

-----Original Message-----
From: "Durwin Wright" <durwin.wright at ingres.com>
Date: Wed, 1 Nov 2006 16:25:56 
To:<martin.pomej at myworkplace.com.au>,       "'International OpenROAD Users'" <openroad-users at peerlessit.com>
Subject: Re: [Openroad-users] App Server performance

The name server is an OpenROAD Server Application that once initialized, does not do any additional file I/O.  An initiate() method request sends a request to the OpenROAD Server.  This request either starts an OpenROAD Server Slave process (ASO) if one is not running already or uses an already initialized process.  A connect() method request sends a request to the OpenROAD Server.  This request is routed to the OpenROAD Name Server ASO and it resolves the AKAName send to the initiate method parameters.  Assuming that the Name Server is already running (by default it is configured to shutdown after 60 minutes of idle), the overhead should be between 10 to 40 mSec.  This results of this request to the OpenROAD Name Server are then used to internally send an initiate() method request to connect to the target application.
 
 
 
The advantage of the connect() method request is that you can refer to an application by a logical name instead of needing to know the image file name and the details of the command flags.  I would recommend that connect() should be the way to go.
 
 
 
There are two types of load balancing: (1) Dynamic Load Balancing and (2) Static Load Balancing.  Each type of Load Balancing is very different.
 
 
 
Dynamic Load Balancing is available if you are not using ASOLib.  (Connect() can be used without the need to use ASOLib.)  In Dynamic Load Balancing, you specify that two or more Slaves can be started for each OpenROAD Application.  The OpenROAD Server will then start the additional OpenROAD Slave processes (ORASO) if needed.  It will also dynamically load balance between the processes associated with each application.  Each client Call4GL() method request can be routed to a different OpenROAD Server Slave process in the pool.  The OpenROAD Server Dispatcher will dynamically pick the OpenROAD Server Slave process that is the least busy.
 
 
 
Static Load Balancing is available only if you are using ASOLib.  In this scenario, you define two or more application entries with the same AKAName.  The command flags need to be different however.  In each application definition, you can define one and only one ASO Slave process.  You also need to leave VASA running to achieve the effects of Static Load Balancing.  When a client connects to an OpenROAD Server application, the static load balance manager will bind the request to a specific OpenROAD Slave instance.  Each client Call4GL() method request will be routed back to the same OpenROAD Slave process.  (I am looking at relaxing the need to have a copy of VASA running to achieve make the Static Load Balancing and ASO Housekeeping active.  Some of our customers have written applications that implement these items already.)
 
 
 
If you are using the OpenROAD Server, I would encourage you to make sure that SPOLog is always turned on.  In the OpenROAD 2006 reference guide, I added documentation that describes these SPO Log events.   Let me know you need access to this excerpt in case you do not have the OpenROAD 2006 Beta.
 
 
 
 
Durwin Wright | Sr. Architect | Durwin.Wright at ingres.com | Ingres | 500 Arguello Street | Suite 200 | Redwood City | CA | 94063 | USA  +1 650-587-5523 | fax: +1 650-587-5550 
 
 
 
----------------
 
From: openroad-users-bounces at peerlessit.com [mailto:openroad-users-bounces at peerlessit.com] On Behalf Of Martin Pomej
 Sent: Wednesday, November 01, 2006 3:24 PM
 To: OpenROAD Users
 Subject: [Openroad-users] App Server performance
 
 
 
 
Hello OR world,
 
 
 
 
 
Talking about windows clients communicating to a windows 2003 server, has anyone noticed any performance gains by using either a name server connection ie ASONameServer.Connect or a direct connection ie RemoteServer.Initiate?
 
 
 
 
 
I understand that by using a name server you get the advantage of load balancing, but currently I'm after performance.
 
 
 
 
 
Regards,
 Martin Pomej
 MyWorkplace Solutions Pty Ltd
 Ph:     1300 733 731
 Mob:    0414 230 845
 Em:     martin.pomej at myworkplace.com.au  Making Service our Priority
  <http://www.myworkplace.com.au/> www.myworkplace.com.au 
 
 
 
 _______________________________________________
Openroad-users mailing list
Openroad-users at peerlessit.com
http://peerlessit.com/mailman/listinfo/openroad-users

_______________________________________________
Openroad-users mailing list
Openroad-users at peerlessit.com
http://peerlessit.com/mailman/listinfo/openroad-users





More information about the Openroad-users mailing list