Page 1 of 1 1
Topic Options
#109083 - 2003-11-27 01:02 PM Asset Management
AndyBell Offline
Fresh Scripter

Registered: 2003-07-30
Posts: 13
This questions has been covered (slightly) in various topics but I never really found one that hit the mark 100%. Basically I have a program that runs under KiX and compiles lots of information on software/hardware on a machine (~2500 machines currently) then sends this in a text file to a central location. This is parsed into a csv file then imported into access. ASP is then used to display on the web.

Anyway, I am looking at expanding this application throughout our environment and realise that copying flat files about is pretty horrible. Which leaves me with the issue of copying about files. The current file i copy is only a few lines (~1k).

My options as I see them are to either go with SQL (I can use KiX for this) or look at re-writing the script in some other language.

The questions I have are:

  • Is SQL the right way to go?
  • Is Kix the right way to go for a potentially global product (~10000 machines)
  • Is SQL efficient in terms of bandwidth. I.e. 4 lines to text translates to small information transmittal.


I have had a look about on various sites and nothing really seemed to hit the mark. Any help would be much appreciated and I would be willing to share the work I have done.

Top
#109084 - 2003-11-27 01:17 PM Re: Asset Management
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22346
Loc: OK
now...
wonder what other options you would have...
if you don't like flat files, is there some other option than database?
when it comes to speed and efficiency, there is nothing that beats flat files.

if you go to database, you are actually looking for something different, like ease of management.


Edited by Lonkero (2003-11-27 01:18 PM)
_________________________
!

download KiXnet

Top
#109085 - 2003-11-27 04:53 PM Re: Asset Management
AndyBell Offline
Fresh Scripter

Registered: 2003-07-30
Posts: 13
The problem with flat files is that you are relying on the copies of files working compared to say talking to a central server. Advantage with central server is that you only have to make sure that one thing is working, whereas with flat files I store them on various servers and then pull them in.

The database means that it is easy to present the information via the web and all the queries are done in this.

The real problem faced is getting the information from the clients (spread across multiple sites/countries) to a central location. Information could be as little as 1k in a file so I am guessing im looking for some super efficient way to send this .

Top
#109086 - 2003-11-27 05:09 PM Re: Asset Management
Les Offline
KiX Master
*****

Registered: 2001-06-11
Posts: 12734
Loc: fortfrances.on.ca
There is no reason why you couldn't use both. The clients could write to individual INI files that a central admin script compiles to SQL.

I, being an SMS shop, use neither.
_________________________
Give a man a fish and he will be back for more. Slap him with a fish and he will go away forever.

Top
#109087 - 2004-01-09 11:05 AM Re: Asset Management
AndyBell Offline
Fresh Scripter

Registered: 2003-07-30
Posts: 13
For anyone that is interested I hunted about through various options :

  • SQL From client to server
  • Sticking with Flat Files
  • And many more hairbrained schemes


And it seems that the best way is to have the option of either flat files (depending on environment) or using KiX to launch IE. This would then post information directly to the website which would be submitted into the access database.

Hopefully by its very nature it will be bandwidth friendly and the only issue left is to try and spread out the updates from ~3000 machines so they dont happen all at once.

Oh for cron (unfortunately installing a cron like program onto our build is not an option). Which leaves:

  • Run at machine startup - Need users to reboot which you can never rely on
  • Run at user login - Some people stay logged in all the time and you would never capture machines not used (but you would still want to know about them)
  • Schedule task at some point during day - If during early morning some of our sites are physically switched off

Oh the dilemmas

Top
#109088 - 2004-01-09 01:11 PM Re: Asset Management
Radimus Moderator Offline
Moderator
*****

Registered: 2000-01-06
Posts: 5187
Loc: Tampa, FL
or... make an agent (kix script running as service) that will at startup run an inventory, store as local ini file and then at random times startup + rnd(*120 minutes or whatever) upload to SQL server

your logon script can read the ini file for required info necessary details that your script needs... memory, SP, hotfixes, whatever. which whould be faster than determining it at logon runtime... the inventory processess whould be 'hidden' in the startup processes where it is expected to be slow
_________________________
How to ask questions the smart way <-----------> Before you ask

Top
#109089 - 2004-01-09 02:58 PM Re: Asset Management
Kdyer Offline
KiX Supporter
*****

Registered: 2001-01-03
Posts: 6241
Loc: Tigard, OR
While you can write to a db, INI, etc. You have other options too. For example: Altiris, Tivoli, Mobile Automation, SMS, etc. I know these are not free, but may cover your needs.

One that has been talked about before which is pretty comprehensive, and you can run remote to put into a DB, is - Aida: http://www.aida32.hu/aida32.php and is free.

HTH,

Kent
_________________________
Utilize these resources:
UDFs (Full List)
KiXtart FAQ & How to's

Top
#109090 - 2004-01-09 03:49 PM Re: Asset Management
Sealeopard Offline
KiX Master
*****

Registered: 2001-04-25
Posts: 11164
Loc: Boston, MA, USA
Quote:

using KiX to launch IE. This would then post information directly to the website which would be submitted into the access database.




Why is this better than having KiXtart write directly to the database?
_________________________
There are two types of vessels, submarines and targets.

Top
#109091 - 2004-01-15 09:11 PM Re: Asset Management
AndyBell Offline
Fresh Scripter

Registered: 2003-07-30
Posts: 13
Its not a proper SQL server (yes I know shame on me its access ODBC) and i was told that throttling/bandwidth usage was better via HTTP handling requests than SQL server.
Top
#109092 - 2004-01-15 09:28 PM Re: Asset Management
Sealeopard Offline
KiX Master
*****

Registered: 2001-04-25
Posts: 11164
Loc: Boston, MA, USA
An MS Access DB can be accessed via KiXtart as well using DNS-less connections. See for example the DBCommand() UDF.
_________________________
There are two types of vessels, submarines and targets.

Top
#109093 - 2004-01-16 03:47 PM Re: Asset Management
AndyBell Offline
Fresh Scripter

Registered: 2003-07-30
Posts: 13
I understand that there are various ways of accomplishing the end result but when you take into account the need for:

  • Ability for multiple (~ a few hundred) machines to update at same time (worst case scenario)
    many
  • Need to use minimum amount of WAN bandwidth
  • Flexibility

Then it does limit what you can use to acheive the desired result. On looking at SQL forums the best solutions anyone had were always using IIS to handle requests due to its ability to handle concurrent connections for superior to say MYSQL.

However, because I run the kix file as a scheduled task it runs as the system account which seems to have problems with running IE. If i run the script as a user it works fine. It could well be that the IE connection wizard is running or something stupid like that so must investigate.

Top
#109094 - 2004-01-16 05:09 PM Re: Asset Management
Sealeopard Offline
KiX Master
*****

Registered: 2001-04-25
Posts: 11164
Loc: Boston, MA, USA
The system account does not have network access rights.

Also, "concurrent connections" with regards to the database access are contorlled by the database access layer/driver and not by IIS itself. MS Access is recommended for no more than ten concurrent connection, though I believe up to 255 concurrent connections are theoretically possible.


Edited by sealeopard (2004-01-16 05:11 PM)
_________________________
There are two types of vessels, submarines and targets.

Top
#109095 - 2004-01-16 05:43 PM Re: Asset Management
AndyBell Offline
Fresh Scripter

Registered: 2003-07-30
Posts: 13
I am aware that the system account does not have access to network drives but this is all done via http. Hence, I would have thought, since it is only launching IE (system account has rights to do this) then navigating to a site using IE (its within firewall so no proxy related issues) then network rights would not come into play.

Finding exactly what the system account can/cannot do is not fun unfortunately. And debugging what is going wrong is also impossible since the ie process is never visible.

Top
Page 1 of 1 1


Moderator:  Arend_, Allen, Jochen, Radimus, Glenn Barnas, ShaneEP, Ruud van Velsen, Mart 
Hop to:
Shout Box

Who's Online
1 registered (Allen) and 264 anonymous users online.
Newest Members
Jojo67, MaikSimon, kvn317, kixtarts2025, SERoyalty
17873 Registered Users

Generated in 0.062 seconds in which 0.023 seconds were spent on a total of 12 queries. Zlib compression enabled.

Search the board with:
superb Board Search
or try with google:
Google
Web kixtart.org