Page 1 of 2 12>
Topic Options
#94175 - 2002-10-08 08:12 PM parallel registry writes
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22346
Loc: OK
I'm thinking of speeding up my script by using about 1000 scripts running simultaneously.

has anyone tried what happens if there is multiple simultaneous regwrites at the same time?

can I crash my machine?
I'm just playing cautious. if none has done that yet, I'll try it immediately. [Razz]

 

[ 08. October 2002, 20:37: Message edited by: Lonkero ]
_________________________
!

download KiXnet

Top
#94176 - 2002-10-08 08:44 PM Re: parallel registry writes
Sealeopard Offline
KiX Master
*****

Registered: 2001-04-25
Posts: 11165
Loc: Boston, MA, USA
I would assume that there are provisions to prevent registry corruption due to multiple registry writes at the same time. Otherwise, you'll end up with corrupted registries all the time while using multiple applications at the same time. Isn't the internal registry structure modeled like a database?
_________________________
There are two types of vessels, submarines and targets.

Top
#94177 - 2002-10-08 09:06 PM Re: parallel registry writes
Shawn Administrator Offline
Administrator
*****

Registered: 1999-08-13
Posts: 8611
I think there are 1000's of simultaneous registry writes happening all the time anyways under Windows NT - even when your machine is quiet - even while your out in the alley having drinkies with the twins [Wink] [especially with McAfee running]. Whats another couple hundred going to do ?

[Wink] [Wink] [Wink]

Top
#94178 - 2002-10-08 09:19 PM Re: parallel registry writes
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22346
Loc: OK
I thought something similar...
just didn't want to crash my laptop.

I quess, kent does not want to try my investor at the production environment, but this should make some change.

ok, going for some code.
_________________________
!

download KiXnet

Top
#94179 - 2002-10-08 09:19 PM Re: parallel registry writes
Jack Lothian Offline
MM club member
*****

Registered: 1999-10-22
Posts: 1169
Loc: Ottawa,Ontario, Canada
Jooel,

You have a great sense of humour. The idea is staggering. [Wink]
_________________________
Jack

Top
#94180 - 2002-10-08 09:22 PM Re: parallel registry writes
Shawn Administrator Offline
Administrator
*****

Registered: 1999-08-13
Posts: 8611
yes - jooel is getting into MPKS - Massively Parallel Kixtart Scripting.

[edit]

Imagine that hitting the registry from all sides is an ok thing to do - not sure what happens when you converge on a single value though.

[ 08. October 2002, 21:24: Message edited by: Shawn ]

Top
#94181 - 2002-10-08 09:33 PM Re: parallel registry writes
NTDOC Administrator Offline
Administrator
*****

Registered: 2000-07-28
Posts: 11628
Loc: CA
Lonkero,

Here is some more in-depth coverage of how the Registry works.

Inside the Registry - Mark Russinovich

Description of the Microsoft Windows Registry - Q256986

Top
#94182 - 2002-10-08 09:53 PM Re: parallel registry writes
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22346
Loc: OK
doc, that is pretty hard reading...

red some blocks and decided to try before reading [Wink]

I just wonder, if the size is set for registry to be 50Mbytes, what happens if my data gets to 150Mbytes?
_________________________
!

download KiXnet

Top
#94183 - 2002-10-08 11:44 PM Re: parallel registry writes
NTDOC Administrator Offline
Administrator
*****

Registered: 2000-07-28
Posts: 11628
Loc: CA
Okay... here is a little lighter reading (but still technical)

Platform SDK: Windows System Information

Registry Element Size Limits

The following are the size limits for the various registry elements.

The maximum size of a key name is 255 characters.
The maximum size of a value name is as follows:
Windows XP, Windows .NET Server: 16383 characters
Windows 2000: 260 ANSI characters or 16383 Unicode characters.
Windows 95/98/Me: 255 characters
Long values (more than 2048 bytes) should be stored as files with the file names stored in the registry. This helps the registry perform efficiently. The maximum size of a value is as follows:
Windows NT/2000/XP: Available memory.
Windows 95/98/Me: 16,300 bytes. There is a 64K limit for the total size of all values of a key.

http://msdn.microsoft.com/library/default.asp?url=/library/en-us/sysinfo/base/registry.asp

http://msdn.microsoft.com/library/default.asp?url=/library/en-us/sysinfo/base/registry_storage_space.asp

Top
#94184 - 2002-10-08 11:52 PM Re: parallel registry writes
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22346
Loc: OK
the memory I'm thinking right now...
there is not so many kix-processes to be raised as memory is limited in normal machine...

what comes to the length, it's no problem as it's not even efficient to read data from multi-mega sized string.
 
_________________________
!

download KiXnet

Top
#94185 - 2002-10-09 12:17 AM Re: parallel registry writes
NTDOC Administrator Offline
Administrator
*****

Registered: 2000-07-28
Posts: 11628
Loc: CA
Understanding and Configuring Registry Size Limit (RSL)

In a nutshell, I don't think you will corrupt the Registry unless you write TOO much data or INVALID data. If the writes are all performed correctly then I don't think you will have an issue on Windows 2000/XP/.NET

But that is only "my opinion".

Top
#94186 - 2002-10-09 12:19 AM Re: parallel registry writes
kholm Offline
Korg Regular
*****

Registered: 2000-06-19
Posts: 714
Loc: Randers, Denmark
Just a thought !

Have any of you ever hit the cealing, meaning, KiX running out of memoryspace for creating variables, or expanding arrays ?

Top
#94187 - 2002-10-09 12:35 AM Re: parallel registry writes
NTDOC Administrator Offline
Administrator
*****

Registered: 2000-07-28
Posts: 11628
Loc: CA
I have not done so myself
Top
#94188 - 2002-10-09 01:44 AM Re: parallel registry writes
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22346
Loc: OK
erik, I quess the the kixweeper is good example of trying to do it with arrays. stack overflow.

at some point had checker hitting the memory limit on w2k machine with windows will adjust memo as needed.
crash.

I got the investor do what wanted but on my small test environment with a maximum of 2mb bandwidth over vpn, it took 4 times much as simply doing it serially. [Frown]
 
_________________________
!

download KiXnet

Top
#94189 - 2002-10-09 05:51 PM Re: parallel registry writes
Bryce Offline
KiX Supporter
*****

Registered: 2000-02-29
Posts: 3167
Loc: Houston TX
Something i can add to!!

I currently have a small project where I have the following.

1 Central kix script
2 Data collection scripts.
3 Report scripts

Of the 2 data collection scripts, 1 is being ran 3 times. this gives me a total of 4 data collection scripts running. All 4 scripts are using the reg as a database to store information and this has been working with out a hitch for months now.

a couple of things that I had to work out to control these child process...

1. brand each child script with a process number at startup. the child script will look for this process number that the main script put in a reg setting. If the number is not found don't run the script.

2. Makes each child script pay attention to a status flag controlled by the main script. if the main script is shut down (controlled shutdown), it will issue a shutdown status to the child scripts.

Bryce

Top
#94190 - 2002-12-11 05:03 AM Re: parallel registry writes
MCA Offline
KiX Supporter
*****

Registered: 2000-04-28
Posts: 5152
Loc: Netherlands, EU
Lonkero, the only real problem we see what will be the result when different scripts
are changing the same registry key with different values.
Even when the registry becomes corrupt which happens mostly with a powerdown windows
will repair it automatically.

But our question is:
- how you can manage 1.000 scripts.
- what are the tasks of those 1.000 scripts.
We doesn't hope they will run during each logging on on each client.
greetings.
_________________________
email scripting@wanadoo.nl homepage scripting@wanadoo.nl | Links | Summary of Site Site KiXforms FAQ kixtart.org library collection mirror MCA | FAQ & UDF help file UDF kixtart.org library collection mirror MCA | mirror USA | mirror europe UDF scriptlogic library collection UDFs | mirror MCA

Top
#94191 - 2002-12-11 05:09 AM Re: parallel registry writes
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22346
Loc: OK
dear, I did it already when wanted to make some realtime network scan with dynamic contents:
Investor 1.2 - the Power of MultiProcessing

it truly is powerfull when you know how to control the memusage and such (like that script)
_________________________
!

download KiXnet

Top
#94192 - 2002-12-11 05:15 AM Re: parallel registry writes
MCA Offline
KiX Supporter
*****

Registered: 2000-04-28
Posts: 5152
Loc: Netherlands, EU
Normally kixtart was using only for logging o tasks.
Now your BBChecker is running whole day.
The Investor release some other realtime things.

It confirms again that hardly anything can be done with KiXtart.
You surely remember the reseller from last week.
greetings.
_________________________
email scripting@wanadoo.nl homepage scripting@wanadoo.nl | Links | Summary of Site Site KiXforms FAQ kixtart.org library collection mirror MCA | FAQ & UDF help file UDF kixtart.org library collection mirror MCA | mirror USA | mirror europe UDF scriptlogic library collection UDFs | mirror MCA

Top
#94193 - 2002-12-11 05:26 AM Re: parallel registry writes
Lonkero Administrator Offline
KiX Master Guru
*****

Registered: 2001-06-05
Posts: 22346
Loc: OK
those talks make me [Mad]

actually, I was using before c++ for almost everything and once found kixtart, there has been no need to open my visual studio anymore.
_________________________
!

download KiXnet

Top
#94194 - 2002-12-11 05:30 AM Re: parallel registry writes
MCA Offline
KiX Supporter
*****

Registered: 2000-04-28
Posts: 5152
Loc: Netherlands, EU
The only issue can be the differences between compiler and interpreter the execution speed.
greetings.
_________________________
email scripting@wanadoo.nl homepage scripting@wanadoo.nl | Links | Summary of Site Site KiXforms FAQ kixtart.org library collection mirror MCA | FAQ & UDF help file UDF kixtart.org library collection mirror MCA | mirror USA | mirror europe UDF scriptlogic library collection UDFs | mirror MCA

Top
Page 1 of 2 12>


Moderator:  Arend_, Allen, Jochen, Radimus, Glenn Barnas, ShaneEP, Ruud van Velsen, Mart 
Hop to:
Shout Box

Who's Online
1 registered (Allen) and 1198 anonymous users online.
Newest Members
M_Moore, BeeEm, min_seow, Audio, Hoschi
17883 Registered Users

Generated in 0.076 seconds in which 0.031 seconds were spent on a total of 13 queries. Zlib compression enabled.

Search the board with:
superb Board Search
or try with google:
Google
Web kixtart.org