I've put out a new version: tes3cmd-0.37g-2010.07.10.7z
http://code.google.com/p/mlox/downloads/list

This experimental version can merge leveled lists with the tes3cmd multipatch command. See tes3cmd help multipatch for details. My algorithm is slightly different from the one used in Wrye Mash.

Use at your own risk, of course, this is a release for people interested in testing new stuff.

Still working on more cleanup, testing and new features ...

I tried the new version. Leveled list merging works really well.

Thanks!

Thanks for the feedback.

You'll see minor differences between the tes3cmd leveled list merger and "Mashed Lists.esp". I'll try to write up a full explanation sometime, but basically tes3cmd and Mash handle duplicated items in leveled lists a little differently, tes3cmd tries to preserve the original number of entries a given item may have in the list, while Mash may change the number of entries.

I'm also considering adding variations of the merging algorithm so that no single plugin can "swamp" the leveled list with its own items.

Yes I saw the difference. Mash merged 30 different LEVI entries and tes3cmd 80. Now the only thing missing is a Merged Objects replacement

Wow, this keeps getting more impressive - can't wait for the final release.

^^" *cough* So, I may have gotten this mixed up with that new object merger program someone /else/ was making. ^^"

@john.moonsugar

I can see you are working on the Merge Objects function. I wish you good luck with that. I am sure it isn't easy

Actually, I'm not quite there yet. I've been working on a complete rewrite of the internals, which were a bit scruffy. It's coming along nicely, if I can just make friends with Perl's reference counting. I'll probably do a release based on the rewrite in the near future, and then start working on more features, like merging objects.

It's still a lot of work nonetheless. And yes, Perl can be a little tricky but CPAN alone makes it one of the best scripting languages.

Oh, I've been a happy user since Perl 4 days, and it's one of my favorite scripting languages because it is generally so flexible and speedy. But let's be honest, reference counting is stone-age. (I may yet rewrite it in Ocaml )

I've put out a new version: tes3cmd-0.37h-2010.07.22.7z:
http://code.google.com/p/mlox/downloads/list

This new version features a new record parser that is much more flexible under the covers, and it is more complete in terms of translating various fields symbolically, so you see more names instead of numbers that are indexes into some array stashed somewhere you don't know about.

The "multipatch" feature which includes merged leveled lists is looking pretty good. There is also a "fixit" command that cleans all plugins, makes a multipatch, and synchronizes plugin headers to masters.

The "dump" command is handy for converting a plugin to an easy to read text file, which makes some problems easier to figure out.

The "modify" command has been rewritten and is pretty powerful. If anyone has any requests for batch processing of plugins, let me know, and I'll see if I can add how to do it to the documentation. Here's a simple example of how to create a little patch plugin from the current documentation:

# Problem: Aleanne's clothing mods do not have restocking inventory# Solution: create a small patch to change the counts for inventory containers#   to negative numbers so they will be restocking.# Step 0: confirm the problem, showing the non-negative counts:tes3cmd dump --type cont ale_clothing_v?.esp# Step 1: Create the patch file ale_patch.esp containing just the container records:tes3cmd dump --type cont --raw-with-header ale_patch.esp ale_clothing_v?.esp# Step 2: Change all the count fields for the containers in Aleanne's Clothing to -3 (for restocking wares)tes3cmd modify --type cont --run "$R->set({f=>'Count'}, -3)" ale_patch.esp

I've done some testing, but please still consider this alpha until I release the final 0.38 version, which should be stable. Even though tes3cmd does it's best to make sure it always does backups for you and never overwrite things, it's always a good idea to back things up on your own.

Great!

Thank you for your hard work. This release of tes3cmd looks very promising.

EDIT:

A small error after I used fixit:

Thanks for taking the plunge. I hope to make fixit as useful as TESTOOL's "Just Fix It" button, just safer and improved, if possible. The one big thing it's missing is merging objects, but hopefully I'll be able to get around to that sometime (I've actually been saying this for 2 years now, but I really mean it ). I'm currently planning to put merged objects, a savegame cleaner, and a simple GUI, if possible, in release 0.40. There's still time to get feature requests in for 0.38 though.

The uninitiialzed value warning you got should now be fixed in 0.37i, which I just uploaded. I have strict warnings enabled, at least for these development releases, and in this case the warning just meant there were no leveled creature merges to be done, let me know if you feel that is not correct for your current active plugins.

I also forgot to to mark the plugin modified when cleaning WHGT/AMBI, so that's fixed too in 0.37i too. Oops.

The road goes ever on and on ...

It's already better. Nearly every Testool function is bugged.



I am looking forward to it. The only good savegame cleaner is Wrye Mash right now and it's not compatible with Linux. If only fglrx wasn't the worst driver in existence, but this is another story.


Thanks. The message vanished and the Leveled Lists are correct as far as I can see.

two minor "bugs":


the command is called header not headers.

Also --synchronize doesn't support -R. I need to rename the ~1 files to the original names.

Thanks, currently fixed in subversion, will be in next release.


I'm not sure I'm understanding this one. The "~" files are backups. So if you do "tes3cmd header --synchronize foo.esp", foo.esp is modified and "foo~1.esp" would be the first backup of the original unmodified plugin. If you modify foo.esp again, you'll get a "foo~2.esp" which is a backup of foo.esp from just prior to the modification. You only need to rename "~" files to the original name when you want to undo a modification. This has always been left to the user to do manually, and -R (which is now --replace for the "clean" command) does not do this.

I'll add a better description of how backup files work to the documentation.

I'm also probably going to implement an option so that backups can be automatically stashed away, either in "Data Files/tes3cmd/backups" by default, or in some place chosen by the user.

Let me know if I need to clarify that some more.

That's what I also thought. I cleaned TR_Map2.esm, used tes3cmd header --synchronize "TR_Map2.esm" and it's still yellow in Wrye Mash. The backup file had the correct header applied.

If you clean TR_Map2.esm, that would probably decrease it's size a little, and so you would have to do "header --synchronize" on all plugins that depend on TR_Map2.esm, not on TR_Map2.esm itself.

When a plugin is yellow in Mash, it means the size of one of its masters has changed. If TR_Map2.esm itself is yellow, and if "header --synchronize TR_Map2.esm" isn't clearing it, that's a bug in tes3cmd, and I'll look into it.

Ok, I was wrong. Even the backup file was yellow.

I made a little screenshot:
http://omploader.org/vNTFmOA/header.jpg

tes3cmd pretended to change the size and the size was still incorrect.

Ah, okay. That's my fault. There was an encoding bug for a few fields in version 0.37i. I fixed it in the version I'm currently working on, so I just uploaded it for you to try if you want: tes3cmd-0.37j-2010.07.25.7z ( http://code.google.com/p/mlox/downloads/list ).

Thanks! Works fine now. The sizes of the .esm files are now correct.

There's a couple new commands in 0.37j: "active", "resetdates", and "lint" (which is not actually implemented). These things aren't really tested at all, yet, so beware.

Edit: there are probably a few other little problems with 0.37j, as I was sort of in the middle of things, I'll try to get out a more fixed version later today.

I have a new version for trial, with now even fewer bugs: tes3cmd-0.37l-2010.07.31.7z
http://code.google.com/p/mlox/downloads/list

I finally got around to implementing a little automated test program, so I should have an easier time of making sure I don't flub things up by breaking one thing when I fix another. But that's boring. This version is the best yet, but I'm still testing. It'll probably be at least another couple of weeks before I release what I think is a truly "stable" release.

Great! Thanks for your hard work, john.moonsugar. I will try the new version as soon as possible.

Bug:

I tried to clean "TR_Data.esm" from Tamriel Rebuilt Map 2 and tes3cmd made an error:



I am sure it didn't before.