Commit Graph

848 Commits

Author SHA1 Message Date
Timothy Baldridge
cfa69948c7
Merge pull request #1287 from wabbajack-tools/fix-bsa-tests
Fix some small bsa tests
2021-01-29 21:06:55 -07:00
Timothy Baldridge
a6bbc62944 Bump version, disable long BSA test not that it passes 2021-01-29 18:21:36 -07:00
Timothy Baldridge
53a1e7af74
Merge pull request #1273 from LostDragonist/less_ram
Reduce memory used by open file streams
2021-01-29 07:59:09 -07:00
Timothy Baldridge
835d56bf68 Upgrade deps, fix several warnings 2021-01-28 21:02:26 -07:00
Chris Bessent
6b18564dc1 Catch exceptions when reading broken EGS manifests 2021-01-26 03:09:42 -07:00
Chris Bessent
e2d5a42254 Reduce memory used by open file streams
Allocating 1 MB for each file stream was causing memory usage
during the install of certain lists to exceed 60 GB.  This is
primarily due to BSA/BA2 creation where tens of thousands of files
are open at the same time.  Additionally, there appears to be a
couple file stream leaks where file streams are not closed until
the entire program is closed.

There appears to still be some discussion on how this affects
performance and a proper fix.  This is more of a dirty "make it work
for more users" fix so people can stop messing with their page files.
2021-01-18 06:13:14 -07:00
Timothy Baldridge
a754d9ae68 Dispose of file handles in BSA creation, don't load unused patches. 2021-01-15 07:00:58 -07:00
Timothy Baldridge
c8abca742a HOTFIX: Fix game file sources that don't have MO2 specific names 2021-01-13 18:53:08 -07:00
erri120
37683d73a5 Return null instead of Hash.Empty on exception during hashing 2021-01-09 19:44:52 +01:00
erri120
a5088bc10e Add NotNull for IEnumerable<T> where T : struct 2021-01-09 19:44:29 +01:00
Timothy Baldridge
019bd9282b Fix bad constraint checking in patch builder 2021-01-09 11:26:25 -07:00
Timothy Baldridge
e8630a24ac
Merge pull request #1248 from wabbajack-tools/da2-dao-support
DA2/DAI support
2021-01-08 07:41:51 -07:00
Timothy Baldridge
1ed06fb79d DA2/DAI support 2021-01-08 06:42:58 -07:00
Unnoen
5d9677dbd1
Optimise SQL database store and IO
* Remove unnecessary ROWID from tables.
* Set JOURNAL_MODE to MEMORY, reducing disk IO.
* VACUUM databases after install/compile.
2021-01-07 02:47:59 +11:00
Timothy Baldridge
d81b9026d4 Fix Steam ID for DA:O 2021-01-05 20:01:37 -07:00
Timothy Baldridge
e1e5a96e7a Fix some missing checks in the patch code 2021-01-05 17:08:13 -07:00
Timothy Baldridge
da521ba3c0 Ignore harmless constraint failures 2021-01-05 15:53:26 -07:00
Timothy Baldridge
13eef5c695 Remove RocksDB (replaced with SQLite) 2021-01-05 15:09:32 -07:00
Timothy Baldridge
dea841136f Add support for Origin 2021-01-04 22:07:06 -07:00
Timothy Baldridge
fd1cada3ea Everything appears to build 2021-01-01 11:21:07 -07:00
Timothy Baldridge
90280e8b6f WIP getting .LIB to compile with 5.0 2020-12-31 17:06:56 -07:00
Timothy Baldridge
0638612e0d Converted Common to .net 5.0 2020-12-31 16:39:28 -07:00
erri120
c66ad8f149
Merge pull request #1233 from EzioTheDeadPoet/Kingdome-Come-GOG
Kingdome Come: Deliverance GOG support
2020-12-31 10:40:47 +00:00
Timothy Baldridge
db3b441d19 #### Version - 2.3.6.1 - 12/31/2020
* When IPS4 (e.g. LL) sites based on CEF fail to validate, they no longer hang the app
* If a IPS4 CEF site throws a 503, or 400 error, retry
* Clean out the cookies during IPS4 CEF downloads so that they don't cause 400 errors
* Limit the number of connections to IPS4 sites to 20 per minute (one per 6 seconds)
* If a site *does* timeout, throw a log of the CEF state into `CEFStates` for easier debugging by the WJ team
* Wrote a new CLI utility to stress test the Verification routines.
* Ignore files that have `\Edit Scripts\Export\` in their path
2020-12-30 23:44:58 -07:00
Luca|EzioTheDeadPoet
d1b71fe178 add GOG ID for KC:D 2020-12-30 14:06:33 +01:00
Timothy Baldridge
196d8f050a
Merge pull request #1226 from wabbajack-tools/dependabot/nuget/HtmlAgilityPack-1.11.29
Bump HtmlAgilityPack from 1.11.28 to 1.11.29
2020-12-29 17:18:38 -07:00
Timothy Baldridge
b0f79cde32
Merge pull request #1230 from EzioTheDeadPoet/patch-3
Added Darkest Dungeon EGS Support
2020-12-29 17:18:07 -07:00
Luca|EzioTheDeadPoet
e73e516fd1 No Man's Sky GOG&Steam fix 2020-12-30 01:01:06 +01:00
Luca|EzioTheDeadPoet
1f2c62ab87 Merge branch 'master' of https://github.com/wabbajack-tools/wabbajack 2020-12-29 23:22:18 +01:00
Luca
8f0ad2934a
Added Darkest Dungeon EGS Support
- changed the used executable to use the executable located in `_windowsnosteam\\Darkest.exe` cause it is present in all available versions of the game.
- added the ESG Store ID
2020-12-27 14:39:39 +01:00
Timothy Baldridge
b22943c2b5 2.3.5.1 HOTFIX 2020-12-23 06:55:13 -07:00
dependabot-preview[bot]
fac1947e03
Bump HtmlAgilityPack from 1.11.28 to 1.11.29
Bumps [HtmlAgilityPack](https://github.com/zzzprojects/html-agility-pack) from 1.11.28 to 1.11.29.
- [Release notes](https://github.com/zzzprojects/html-agility-pack/releases)
- [Commits](https://github.com/zzzprojects/html-agility-pack/compare/v1.11.28...v1.11.29)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-12-17 05:47:26 +00:00
Timothy Baldridge
5d8a76f265 Downgrade YAML 2020-12-16 16:28:35 -07:00
Timothy Baldridge
9101ed48f5 Merge remote-tracking branch 'origin/mw5-support' into mw5-support
# Conflicts:
#	Wabbajack.Test/Wabbajack.Test.csproj
#	Wabbajack/Wabbajack.csproj
2020-12-16 14:42:45 -07:00
Timothy Baldridge
364bfe6cea 2.3.5.0 Bump and MW5 support 2020-12-16 14:41:28 -07:00
Timothy Baldridge
b79830ad54 Added purge-archive verb 2020-12-09 14:46:08 -07:00
Timothy Baldridge
053a71795a disable back button and 2.3.4.3 2020-12-06 21:26:02 -07:00
Timothy Baldridge
021cb61563 MW5 Support 2020-12-01 15:58:07 -07:00
Timothy Baldridge
164a8a4f4f Fix game file indexing 2020-11-30 05:49:54 -07:00
Timothy Baldridge
f97fcd5aa0 2.3.4.2 2020-11-24 15:14:09 -07:00
Timothy Baldridge
3a3206755a
Merge pull request #1193 from wabbajack-tools/improved-services
Improve backend services, add watchdog service, and add utility_modli…
2020-11-19 16:32:52 -07:00
Timothy Baldridge
9717d4ac42 Improve backend services, add watchdog service, and add utility_modlists.json 2020-11-19 15:56:30 -07:00
Chris Bessent
35b910be98 Make more path comparisons ignore case
Paths for Windows should be case-agnostic.  The primary impetus for
this change is to prevent WJ from deleting downloads if the case of
the folder name doesn't match the case of the install setting.
Normally this would be caught by the GUI validation but several users
have managed to get around that.
2020-11-18 20:04:43 -07:00
erri120
c37248c221
Fixed build errors 2020-11-18 12:37:31 +01:00
Timothy Baldridge
802448c934 Deps version bump 2020-11-14 07:26:04 -07:00
Timothy Baldridge
90e9af05b1 More fine-grained status updates 2020-11-03 07:45:08 -07:00
Timothy Baldridge
7f603e9c85 Store game file hashes on GitHub 2020-11-02 18:55:54 -07:00
Luca EzioTheDeadPoet
ee73db962e potential fix for Dishonored 2020-11-02 16:30:02 +01:00
Timothy Baldridge
0a976dc427
Merge pull request #1158 from wabbajack-tools/bump-deps-42
bump deps
2020-11-01 22:26:54 -07:00
Timothy Baldridge
61671bf701
Merge pull request #1157 from wabbajack-tools/server-updates-for-mirrored-files
Updates to smooth out server update features
2020-11-01 21:47:31 -07:00
Timothy Baldridge
4a2cef1ab4 bump deps 2020-11-01 21:11:29 -07:00
Timothy Baldridge
0c5913c70a Extractor fixes for broken Lucian introspection 2020-11-01 21:06:18 -07:00
Luca
607fb263d5
added Dishonored
mainly to test the non MO2 dependent list compiler.
2020-10-25 23:05:14 +01:00
Timothy Baldridge
6499f20d4b Yet another test fix 2020-10-24 10:04:24 -06:00
Timothy Baldridge
6007c326e1 Could compile via the UI 2020-10-19 16:16:35 -06:00
Timothy Baldridge
e557e46556 Rework file extraction to combine the old and new methods 2020-10-09 21:02:58 -06:00
Justin Swanson
6c627f32c8
Merge pull request #1104 from Noggog/wj-optional-logging
Optional Logging
2020-10-04 10:30:17 -07:00
Timothy Baldridge
76cd109dc1
Whitespace change to trigger new build 2020-10-04 07:24:17 -06:00
Timothy Baldridge
844881375f
Merge branch 'master' into code-cleanup 2020-10-01 06:25:50 -06:00
Timothy Baldridge
d0febcd8a9 Several tweaks, bump version to 2.3.0.1 2020-10-01 06:24:26 -06:00
Timothy Baldridge
13068a59e7 Code cleanup 2020-09-30 21:50:09 -06:00
Justin Swanson
0a58fcb353 LoggingSettings.LogToFile 2020-09-22 16:58:48 -05:00
Justin Swanson
59b20dca8b Moved logging functionality to dedicated file 2020-09-22 16:50:54 -05:00
Justin Swanson
1d6663629e Moved Utils WJ LocalAppData filewatching to lazy system 2020-09-21 22:48:12 -05:00
Unnoen
7b1812af87
Use .Where for filtering 2020-09-18 00:08:30 +10:00
Unnoen
4b837d83bb
Don't attempt to compress files smaller than the cluster size. 2020-09-17 22:49:41 +10:00
Timothy Baldridge
59eb915475 Make extra included games explicit 2020-09-11 06:54:24 -06:00
Timothy Baldridge
16041170d2 Fix strange edge-case with BSA extraction 2020-09-09 14:40:28 -06:00
Timothy Baldridge
ab5010594f IPS4 reworks 2020-09-09 12:56:16 -06:00
Timothy Baldridge
f1b50b0e09 Merge remote-tracking branch 'origin/7zip-improvements' into 7zip-improvements 2020-09-08 17:25:30 -06:00
Timothy Baldridge
48bb6e1998
Merge branch 'master' into 7zip-improvements 2020-09-08 16:19:35 -06:00
Timothy Baldridge
548a0553d2 Re-add OMOD support 2020-09-08 16:15:33 -06:00
Timothy Baldridge
3bdab577e1 EndToEnd Tests pass 2020-09-05 21:19:05 -06:00
Timothy Baldridge
a847d69851 Patching and extraction works, fewer failing tests 2020-09-05 08:01:32 -06:00
Timothy Baldridge
8a365ac445 WIP, massive rework of file extraction 2020-09-04 15:00:29 -06:00
Timothy Baldridge
47e45965c4 Fix for server error that kills services 2020-09-02 20:49:45 -06:00
Timothy Baldridge
27f3571951 7zip extraction improvements 2020-09-02 16:14:56 -06:00
halgari
496a35a605 BSA fix, better logging for failed IPS4 downloads 2020-08-24 19:34:57 -06:00
halgari
a716097802 Server fixes and a bit of a UI nagging 2020-08-16 22:15:19 -06:00
halgari
eb3e323971 Fix endless loop in CopyToLimit 2020-08-15 13:33:05 -07:00
Timothy Baldridge
251d960e65 Bump packages for Nuget 2020-08-14 19:28:35 -06:00
Justin Swanson
b77fa3d0c7 Made RocksDB initialization lazier
Was causing problems, as it's a singleton across the entire computer, so eagerly initializing them was causing problems for users of Wabbajack.Common that weren't interested in RocksDB.  Only one could run at a time.
2020-08-14 07:16:09 -05:00
Timothy Baldridge
167b81d586 Package version name updates 2020-08-13 06:03:20 -06:00
Timothy Baldridge
35a8bebe76 Add version numbers to libs with nuget publishing 2020-08-13 05:51:30 -06:00
Timothy Baldridge
f0cfbc6b0c
Merge pull request #1031 from wabbajack-tools/ll-updates
Ll updates
2020-08-13 05:46:54 -06:00
Timothy Baldridge
b181d48722 More test fixes 2020-08-12 22:14:35 -06:00
Timothy Baldridge
39078b21d9 LL autohealing 2020-08-12 16:23:02 -06:00
Timothy Baldridge
bc94ec4321 Tons of server-side fixes and tweaks to deal with strange nexus states 2020-08-11 22:25:12 -06:00
Timothy Baldridge
c21cc7db78
Merge pull request #1024 from Noggog/bsa-optimization
Bsa Optimizations
2020-08-11 12:54:47 -06:00
Justin Swanson
ea8b0d601f Removed RxUI from Wabbajack.Common 2020-08-11 10:37:17 -05:00
Justin Swanson
05e25c7fb3 Common and BSA libraries include their PDB 2020-08-11 09:24:23 -05:00
Justin Swanson
e1f0f4f0cf Refactor BSAReader to a lazier overlay style 2020-08-11 09:23:55 -05:00
Justin Swanson
9e6468d517 Ported MemorySlice over from Noggog.CSharpExt 2020-08-11 08:02:46 -05:00
erri120
77275dd30b
Current Wabbajack must be newer than Wabbajack version of compiled Modlist 2020-08-11 14:31:58 +02:00
Justin Swanson
2e3b25ee69 File open/write async flag enabled. 1MB buffer 2020-08-11 07:13:33 -05:00
erri120
4bf1e943a2
Added WABBAJACK_ALWAYS_DISABLE flag 2020-08-10 19:18:16 +02:00
Justin Swanson
da7857aeb3 Fix for progress bar display. Was not being converted to overall status 2020-08-08 07:14:37 -05:00
Unnoen
c3f34fedde
Add a folder checker to CheckValidInstallPath. 2020-08-07 23:22:48 +10:00
Unnoen
a4254af3c9
Utilize hash cache on install. 2020-08-07 18:29:20 +10:00
Timothy Baldridge
e14501afdf
Merge pull request #1008 from wabbajack-tools/mirrored-files
Mirrored files
2020-08-05 18:18:04 -07:00