[RELz] Oblivion - PyFFI Optimization Kit : IV - Oblivion

» Wed Mar 30, 2011 11:14 am

@andalaybay:
The stuff falling through floors thing is supposedly fixed int PyFFI v2.1.9b5 according to http://sourceforge.net/tracker/index.php?func=detail&aid=3194017&group_id=199269&atid=968813.

Thanks Gratis.

As to the second part, I found the registry entry for the context menu, but I'm not quite sure how to change things so that these optimizations are called on a single file.

The current context menu can be found in:

HKEY_CLASSES_ROOT\Folder\shell\Optimize with PyFFI

and it basically just calls the niftoaster spell. I could change it to call the batch file instead, but I suspect the parameters on the niftoaster spells it calls are configured to use to in and out directories. So I guess the answer is to create a new batch file that uses the four ini files, but with the same parameters the current context menu uses...

» Wed Mar 30, 2011 12:04 am

I've figured my problem and have now a good Oblivion.bsa.

Tomorrow I'll update the pyffi kit with an improved interface and an important fix for the optimization of far.nif meshes.

Saw this on the official PyFFi thread. I'll grab it right away and, assuming all's well, redo my Oblivion meshes BSA sometime within the next several days. My current BSA was made with PyFFi 2.1.7. I just "upgraded" to PyFFi 2.1.9beta5 (from 2.1.9beta2) and am anxious to see what if any improvements the combo of the latest PyFFi and your Optimizer give.

-Decrepit-

» Wed Mar 30, 2011 12:28 am

2.19 actually.

I also asked over at the PYFFI thread, as well. May not be your files.

You're using QTP3 optimized with the latest PyFFI right?

I'll be using that setup so see if I can help you. It'd be good to know about other mods or mesh replacers you use that can possibly touch the area.

On another note, I had an important fix to make so here it is:

3, 2011/03/09:* fixed oblivion_optimize_04.ini for correct optimization of _far.nif meshes after the general optimization pass.* improved run_oblivion_optimize.bat interface* removed resuming support* cleaned ini configuration

» Wed Mar 30, 2011 5:39 am

Saw this on the official PyFFi thread. I'll grab it right away and, assuming all's well, redo my Oblivion meshes BSA sometime within the next several days. My current BSA was made with PyFFi 2.1.7. I just "upgraded" to PyFFi 2.1.9beta5 (from 2.1.9beta2) and am anxious to see what if any improvements the combo of the latest PyFFi and your Optimizer give.

-Decrepit-

You don't have to process every mesh again unless you want to use the latest PyFFI 2.1.9beta5. I used it and really recommend - large space optimization so far on the Oblivion - Meshes.bsa.

The error I got when going to exteriors was because of a nasty mistake - I thought far.nif meshes could be optimized with opt_cleanfarnif but it turns out it didn't work very well. I corrected this in the latest version.

» Wed Mar 30, 2011 12:30 am

Quick update with the (hopefully) final revision of the script. Everything seems to be fine with the configuration files.

I would also like to second the request to be able to run these ini configurations with right-click -> optimize with PyFFI.

The purpose of this kit is to expand the original ini configuration with enhancements only found scattered at the forums so far.

Instead of using left click on the single original PyFFI ini and select Optimize with PyFFI you now just double click "run_oblivion_optimize.bat".

The enhancements require several passes so that meshes that should not be touched can be properly bypassed without skipping meshes that can be optimized.

This is what made me assemble the general batch script from the start.

As an example, to assemble an optimized Oblivion.bsa you would have to follow these steps:

I'll clarify this step on the first post, since it was explained in "simplistic" fashion in that post.

» Wed Mar 30, 2011 11:37 am

Paths with SPACE and other symbols (exclude numbers) need write in "", otherwise it will cause an error.

» Wed Mar 30, 2011 7:12 am

Seems to work fine from first appearances.
Good work.

Ironing out the bugs will be the second priority.

» Wed Mar 30, 2011 1:48 pm

Fixed. Thank you.

» Tue Mar 29, 2011 11:41 pm

Those who downloaded version 5 in the last ten minutes, please re-download. The correct version 5 has been re-uploaded. :facepalm:

» Wed Mar 30, 2011 8:03 am

Those who downloaded version 5 in the last ten minutes, please re-download. The correct version 5 has been re-uploaded. :facepalm:

Ya gotta love the versioning of all the modders out there.
We all have different ways of it.
v3
v4
v5
v6

===

v0.01
v0.02
v0.05
v1.00

===

v1
v100
v1000
v10000

Haha not to serious on this, but thanks for the quick update.

Mooo

» Wed Mar 30, 2011 7:09 am

I hate to say it, but you're gonna need at least one more v5 upload. The second v5 I downloaded does not generate either \in or \out folders. It's easy enough to create 'em on my own, but it might confuse the less savvy amongst us.

-Decrepit-

» Wed Mar 30, 2011 6:52 am

Many thanks Ulrim for sharing your work on this utility.
Can anyone please advise me about this message: On initiating the bat file, Im recieving a grey box message ( 16 bit MS-DOS Subsystem) saying: 'Oblivion - PyFFI Optimization Kit
C:\PROGRA~1\Symantec\S32EVNT1.DLL. An installable Virtual Device Driver failed Dll initialization. Choose 'Close' to terminate the application.' I also get the same message box once more upon closing it.

The optimation black box window is open in the background, and when I Close the gery error message box the black box optimisation appears to be running ( a blinking cursor under the 'running optimisation pass 1' text. Also a PyFFI_Log_01.txt is generated so is working according to your instruction). My concern was if the grey box error message would corrupt the Optimisation in some way. I hope I've explained myself and am grateful for any advice.

I should say Im using PYFII 2.1.9 b5.

Thanks again

» Wed Mar 30, 2011 8:46 am

I hate to say it, but you're gonna need at least one more v5 upload. The second v5 I downloaded does not generate either \in or \out folders. It's easy enough to create 'em on my own, but it might confuse the less savvy amongst us.

-Decrepit-

But this folders included in archive.

» Wed Mar 30, 2011 6:04 am

But this folders included in archive.

I re-downloaded it while ago. It does indeed now have the folders in question. Don't know if another v5 has been uploaded or I ran in to some strange quirk on my end earlier. In any case all's well now...so far as I know.

» Wed Mar 30, 2011 12:20 am

Ya gotta love the versioning of all the modders out there.We all have different ways of it.v3v4v5v6===v0.01v0.02v0.05v1.00===v1v100v1000v10000Haha not to serious on this, but thanks for the quick update.Mooo

Its funny sometimes, that's why I thought to put some kind of reference to it, too :lmao:

I hate to say it, but you're gonna need at least one more v5 upload. The second v5 I downloaded does not generate either \in or \out folders. It's easy enough to create 'em on my own, but it might confuse the less savvy amongst us.-Decrepit-

True. I had been testing and writing at the same time but when I uploaded the file was not saved yet - silly me. Now it's all good for v6, at least.

Many thanks Ulrim for sharing your work on this utility. Can anyone please advise me about this message: On initiating the bat file, Im recieving a grey box message ( 16 bit MS-DOS Subsystem) saying: 'Oblivion - PyFFI Optimization Kit C:\PROGRA~1\Symantec\S32EVNT1.DLL. An installable Virtual Device Driver failed Dll initialization. Choose 'Close' to terminate the application.' I also get the same message box once more upon closing it.The optimation black box window is open in the background, and when I Close the gery error message box the black box optimisation appears to be running ( a blinking cursor under the 'running optimisation pass 1' text. Also a PyFFI_Log_01.txt is generated so is working according to your instruction). My concern was if the grey box error message would corrupt the Optimisation in some way. I hope I've explained myself and am grateful for any advice.I should say Im using PYFII 2.1.9 b5.Thanks again

Try v6 please and tell me how it went. Maybe you were missing the folders, too :ninja:

If there's anything not working *flawlessly* let me know.

» Wed Mar 30, 2011 1:29 am

Del

» Wed Mar 30, 2011 11:04 am

The purpose of this kit is to expand the original ini configuration with enhancements only found scattered at the forums so far.

Instead of using left click on the single original PyFFI ini and select Optimize with PyFFI you now just double click "run_oblivion_optimize.bat".

The enhancements require several passes so that meshes that should not be touched can be properly bypassed without skipping meshes that can be optimized.

This is what made me assemble the general batch script from the start.

Ah, you misunderstood my request. I understand the new batch file and the way of running it. The right-click approach is for the times you only want to optimize one or two nif''s. I'm not clicking on the ini file, I like to be able to right-click on the NIF file that is sitting in one of my mod folders somewhere.

Often when I putting a mod together, I've already PyFFI'd all my files. And then I tweak something at the end. Rather than having to copy it to the "in" folder, I usually just select the Optimize command from the context menu and optimize it right there. I just find it handier to do it that way - especially for a few files scattered here and there in various directories.

» Wed Mar 30, 2011 5:38 am

Its funny sometimes, that's why I thought to put some kind of reference to it, too :lmao:

True. I had been testing and writing at the same time but when I uploaded the file was not saved yet - silly me. Now it's all good for v6, at least.

Try v6 please and tell me how it went. Maybe you were missing the folders, too :ninja:

If there's anything not working *flawlessly* let me know.

Thanks again Ulrim. You have V6 already....wow. The in and out folders existed already from the prevoius version. I forgot to mention that I had tried Version 3 yesterday and it had not given any initial error message as had Version 5, although the resulting Meshes seemed to cause strange graphical artifacts and Crashing on loading exterior cells.

I have V5 still running after 3or 4 hrs and it seems to be generating the various Mesh folders in the Out folder. I suppose it could ( I hope) finish at some time soon....so I ought to see what happens there.

Thankyou for Version 6!

» Wed Mar 30, 2011 3:26 am

@andalaybay

The advantage of this kit is

Lets see if I can understand your point of view:

When applying PyFFI over meshes I'm selecting individually, I don't really need the skip list unless I'm not sure if they should be skipped at all. Provided the mesh has a sensible name of its type to compare to the list - i.e. helmet.nif - it may not be worth optimizing but checked for some particular operation - like fix_texturepath or similar. PyFFI is getting better each version - hopefuly to allow me to stop worrying about such cases. Nevertheless I see the usefulness of a customized optimization here.

When applying PyFFI on a folder with a complex structure, what you'd like to do is to let the meshes be skipped appropriately on the spot. For this, the only difference being the place where the folders are, I can try to make a custom right-mouse button command.

However, there may be a time when you want to do some specific optimization and the standard PyFFI command is still preferred.

Don't forget about testing and how the PyFFI project can progress to help us mortal mod users let go of all this care. :foodndrink:

» Wed Mar 30, 2011 2:20 pm

Thanks again Ulrim. You have V6 already....wow. The in and out folders existed already from the prevoius version. I forgot to mention that I had tried Version 3 yesterday and it had not given any initial error message as had Version 5, although the resulting Meshes seemed to cause strange graphical artifacts and Crashing on loading exterior cells.

I have V5 still running after 3or 4 hrs and it seems to be generating the various Mesh folders in the Out folder. I suppose it could ( I hope) finish at some time soon....so I ought to see what happens there.

Thankyou for Version 6!

I can try to check for myself but you have to post where the place was or what mods did you use in that particular spot. Crashing on exteriors meshes were caused by incorrect use of spell to optimize _far.nif. It's corrected now with Vorians optimization suggestions.

» Wed Mar 30, 2011 6:36 am

Thanks Ulrim. I'll need to learn about posting Load lists/ attachments for future reference. Incidentally the crash was on exiting Fort Histeria ( added by either the Fort Akatosh redux Mod or the Legion ranger Addon ) in addition to all the UL's and a basic FCOM load order....ordered with the Boss utility.
In anycase hopefully thats obselete now as you say with your newer optimisations.

I've left the V5 optimisation tool running now for over 4 hrs.....again it seems to have created most of the Meshes sub folders, but is still displaying 'running optimisation pass 1'. Since it is only the Vanilla Meshes, can you anticipate how long it might take? I ask as the last time the process seemed speedier....albeit ultimately unsuccessful? Should I abort V5 and start again with V6.

I'll try V6 next time and let you know about any error messages. Thanks again

» Wed Mar 30, 2011 6:46 am

There is no difference in terms of optimization since version 3 had all the necessary optimization pass fixes. Last versions have only minor updates to the batch command line interface and fixes only related to the interface.

I have been running around Tamriel like crazy on a bay horse - trying to find oddities or crashes.

This is my setup with the mods I have been currently testing besides QTP3 Redimized and QTP3 and a few other replacers:

Spoiler

Active Mod Files:00  Oblivion.esm01  All Natural Base.esm  [Version 1.2.1]02  Francesco's Leveled Creatures-Items Mod.esm  [Version 4.5bSI]03  Francesco's Optional New Items Add-On.esm  [Version 4.5bSI]04  Cobl Main.esm  [Version 1.73]05  Oscuro's_Oblivion_Overhaul.esm  [Version 1.34]06  Mart's Monster Mod.esm  [Version 3.7b3p3]07  FCOM_Convergence.esm  [Version 0.9.9MB3]08  Unofficial Oblivion Patch.esp  [Version 3.3.4]++  Oblivion Citadel Door Fix.esp09  DLCShiveringIsles.esp0A  Unofficial Shivering Isles Patch.esp  [Version 1.4.1]0B  SM Plugin Refurbish - SI.esp  [Version 1.30]0C  Francesco's Optional Chance of Stronger Bosses.esp0D  Francesco's Optional Chance of Stronger Enemies.esp0E  Francesco's Optional Chance of More Enemies.esp0F  Francesco's Optional Leveled Guards.esp++  FCOM_Francescos.esp  [Version 0.9.9]++  FCOM_FrancescosItemsAddOn.esp  [Version 0.9.9]10  FCOM_FrancescosNamedBosses.esp  [Version 0.9.9]11  All Natural.esp  [Version 1.2]12  All Natural - SI.esp  [Version 1.2.1]13  All Natural - Real Lights.esp  [Version 1.2.1]14  DLCHorseArmor.esp15  DLCHorseArmor - Unofficial Patch.esp  [Version 1.0.6]16  SM Plugin Refurbish - HorseArmor.esp  [Version 1.11]17  DLCOrrery.esp18  DLCOrrery - Unofficial Patch.esp  [Version 1.0.4]19  SM Plugin Refurbish - Orrery.esp  [Version 1.11]1A  DLCSpellTomes.esp++  DLCSpellTomes - Unofficial Patch.esp  [Version 1.0.1]1B  XSPipeMod.esp  [Version 1.2]1C  Cobl Glue.esp  [Version 1.73]1D  Cobl Si.esp  [Version 1.63]++  Cobl Tweaks.esp  [Version 1.73]1E  Bob's Armory Oblivion.esp1F  FCOM_BobsArmory.esp  [Version 0.9.9]20  Oblivion WarCry EV.esp  [Version 1.09]21  FCOM_WarCry.esp  [Version 0.9.9MB5]22  Oscuro's_Oblivion_Overhaul.esp  [Version 1.34]**  OMOBS.esp  [Version 1.0]**  OMOBS_SI.esp  [Version 1.0]23  OOO 1.32-Cobl.esp  [Version 1.72]24  FCOM_Convergence.esp  [Version 0.9.9Mb3]++  FCOM_EntropicOrderRebalance.esp  [Version 0.9.9beta2]25  FCOM_RealSwords.esp  [Version 0.9.9]++  FCOM_DurabilityAndDamage.esp  [Version 0.9.9]++  FCOM_SpawnRatesSlightlyReduced.esp  [Version 0.9.9MB3]++  Mart's Monster Mod - More Passive Wildlife.esp  [Version 3.7b3p3]++  FCOM_SaferRoads.esp  [Version 0.9.9]++  FCOM_LessRats.esp  [Version 0.9.9]26  Mart's Monster Mod - Extra Wounding.esp  [Version 3.7b3p3]++  Mart's Monster Mod - Looting NPCs & Creatures.esp  [Version 3.7b3p3]++  Mart's Monster Mod - Less Bone Loot.esp  [Version 3.7b3p3]27  Mart's Monster Mod - Safer Quest Locations.esp  [Version 3.7b3p3]28  Mart's Monster Mod - Gems & Gem Dust.esp  [Version 3.7b3p3]29  Mart's Monster Mod - Hunting & Crafting.esp  [Version 3.7b3p3]2A  Mart's Monster Mod - Farm Animals.esp  [Version 3.7b3p3]2B  Mart's Monster Mod - Diverse WaterLife.esp  [Version 3.7b3p3f]++  Mart's Monster Mod - Diverse Runeskulls Loot OOO.esp  [Version 3.7b3p3]++  FCOM_DiverseGuardUnity.esp  [Version 0.9.9]++  FCOM_HungersUnitySI.esp  [Version 0.9.9]**  FCOM_FriendlierFactions.esp  [Version 0.9.9]++  Mart's Monster Mod - Shivering Isles.esp  [Version 3.7b3p3]++  MMM-Cobl.esp  [Version 1.73]2C  Mart's Monster Mod - City Defences.esp  [Version 3.7b3p3]2D  xuldarkforest.esp  [Version 1.0.5]2E  xulStendarrValley.esp  [Version 1.2.2]2F  xulTheHeath.esp30  XulEntiusGorge.esp31  xulFallenleafEverglade.esp  [Version 1.3.1]32  xulChorrolHinterland.esp  [Version 1.2.2]33  xulBeachesOfCyrodiilLostCoast.esp  [Version 1.6.4]34  xulLushWoodlands.esp  [Version 1.3.1]35  xulAncientYews.esp  [Version 1.4.3]36  xulAncientRedwoods.esp  [Version 1.6]37  xulCloudtopMountains.esp  [Version 1.0.3]38  xulArriusCreek.esp  [Version 1.1.3]39  xulPatch_AY_AC.esp  [Version 1.1]3A  xulRollingHills_EV.esp  [Version 1.3.3]3B  xulPantherRiver.esp3C  xulRiverEthe.esp  [Version 1.0.2]3D  xulBrenaRiverRavine.esp  [Version 1.1]3E  xulBlackwoodForest.esp  [Version 1.1.0]3F  xulCheydinhalFalls.esp  [Version 1.0.1]40  xulAspenWood.esp  [Version 1.0.2]41  xulSkingradOutskirts.esp  [Version 1.0.1]42  xulSnowdale.esp  [Version 1.0.2]++  OOO-Snowdale Patch.esp43  xulCliffsOfAnvil.esp44  OOOCliffsofAnvilPatch.esp  [Version 1.0]45  Salmo the Baker, Cobl.esp  [Version 3.08]++  Enhanced Vegetation [110%].esp46  Alternative Beginnings.esp  [Version 1.0]47  SM Bounty.esp  [Version 1.22c]**  Let There Be Darkness - Cyrodiil + SI.esp**  Let There Be Darkness - OOO.esp**  Let There Be Darkness - UL Lost Coast.esp**  Let There Be Darkness - UL Brena.esp**  Let There Be Darkness - UL Blackwood Forest.esp48  bgBalancingEVCore.esp  [Version 10.52EV-D]++  EyelashesForVanillaRaces1.0.esp  [Version y]++  WhiskersAll.esp++  MergedMouth.esp++  JoinedJaws.esp49  bgMagicEV.esp  [Version 1.7EV]++  bgMagicSpellTomes_for_WryeBash.esp  [Version 1.68EV]++  bgMagicItemSigil.esp  [Version 1.68EV]++  bgMagicEVStartspells.esp  [Version 1.68EV]4A  bgMagicBonus.esp  [Version 1.7EV]++  bgMagicEVAddEnVar.esp  [Version 1.68EV]4B  bgMagicEVPaperChase.esp  [Version 1.68EV]++  bgMagicAlchemy.esp  [Version 1.57]++  bgMagicPotionNumberSoulGemValue.esp  [Version 1.68UV]++  bgBalancingEVOptionalClasses.esp  [Version 9.0EV-U]++  bgBalancingEVOptionalFangs.esp  [Version 10.0EV-D]++  bgBalancingEVOptionalMoreEyes.esp  [Version 10]**  bgBalancingEVOptionalNPCDiversity, TNR Merge.esp  [Version 10.0EV-D]++  bgBalancingEVOptionalFCOMAdditions.esp  [Version 10.]4C  bgBalancingEVLAMEAddition.esp  [Version 10.51EV-D]++  bgBalancingEVLAMEGlue.esp  [Version 10.0EV-D1.62EV]**  bgBalancingEVOptionalNPCDiversityLAME.esp  [Version 10.5EV-D]++  bgBalancingEVOptionalSeamReducerHighElfFix.esp  [Version 10.0EV-D]4D  bgIntegrationEV.esp  [Version 0.993]++  bgMagicShaderLifeDetect.esp  [Version 1.68]++  bgMagicLightningbolt.esp**  FCOM_Archery.esp  [Version 0.9.9]++  Cobl Filter Late MERGE ONLY.esp  [Version 1.53]++  All Natural - Indoor Weather Filter For Mods.esp  [Version 1.2]4E  Bashed Patch, 0.esp

» Tue Mar 29, 2011 11:44 pm

Its interesting to see your Mod setup Ulrim, thanks. Other than Fort Akatosh and the Tamriel resource Mod, your setup includes and far exceeds what i'm trying to use. I'm not using any replacers other than Bomrets normals I think....my pc wouldn't cope. The optimisation Window is still showing ' running optimization pass 1'....? I'm running out of time now and will not have another chance again until Sunday.....but I'm looking forward to Using V6 then and discovering the results. Many thanks again.

» Wed Mar 30, 2011 12:05 pm

It takes about an hour to optimize the full Oblivion - Meshes.bsa but I haven't timed it. Going to test PyFFI Optimization Kit v6 with PyFFI 2.1.9b5

Machine specs:

» Wed Mar 30, 2011 12:01 pm

Well, I've aborted the V5 Optimisation Window as something must be wrong.

Although I'm now finally out of time I just had to initiate the V6 kit to see what happens.

I've just found it too starts with the same grey DOS box (16 bit MS-DOS Subsystem) saying: 'Oblivion - PyFFI Optimization Kit
C:\PROGRA~1\Symantec\S32EVNT1.DLL. An installable Virtual Device Driver failed Dll initialization. Choose 'Close' to terminate the application.'

Again, that didn't occur when I used V3...? Sorry to double post that error message....it doesn't really mean much to me, but was afraid it could corrupt the process, which otherwise seems to be on-going. I'll have to give it a full trial on Monday.

My system spec is somewhat less able than yours Ulrim: Asus P5B motherboard, CPU: Core 2 duo 2.66 Ghz, Memory 2GB. I'm assuming that PYFII auto uses both the cores....still it doesnt compare to i7 CPU's and possibly could explain why it was taking more time here. Thanks for all your work on this.