Commit Graph

45 Commits

Author SHA1 Message Date
Timothy Baldridge
802448c934 Deps version bump 2020-11-14 07:26:04 -07:00
Timothy Baldridge
e557e46556 Rework file extraction to combine the old and new methods 2020-10-09 21:02:58 -06:00
Timothy Baldridge
844881375f
Merge branch 'master' into code-cleanup 2020-10-01 06:25:50 -06:00
Timothy Baldridge
13068a59e7 Code cleanup 2020-09-30 21:50:09 -06:00
Timothy Baldridge
06a320611d tweaks to downloads and compilation 2020-09-17 21:27:59 -06:00
Timothy Baldridge
5d7bceb6dc Spool large files to disk during extraction to save memory 2020-09-07 20:22:23 -06:00
Timothy Baldridge
9de30ea8b7 Removed cruft of old extractor 2020-09-05 21:28:31 -06:00
Timothy Baldridge
3bdab577e1 EndToEnd Tests pass 2020-09-05 21:19:05 -06:00
Timothy Baldridge
a847d69851 Patching and extraction works, fewer failing tests 2020-09-05 08:01:32 -06:00
Timothy Baldridge
8a365ac445 WIP, massive rework of file extraction 2020-09-04 15:00:29 -06:00
Timothy Baldridge
74c4360da9 Extraction fixes 2020-07-27 21:30:25 -06:00
Timothy Baldridge
009b59289c Don't re-hash files during compilation 2020-07-10 16:59:39 -06:00
Timothy Baldridge
0b74c04c86 And priority to how game files are resolved 2020-06-20 17:10:43 -06:00
Timothy Baldridge
191f321dc2 VirtualFile now useses Async IO exclusively 2020-05-25 10:30:47 -06:00
Timothy Baldridge
80b98935fa Move xxHash and VFS cache data into RocksDB so we don't pollute folders and can cache more files 2020-05-12 15:28:09 -06:00
Timothy Baldridge
c96665cde3 Print the archive being extracted when analysis fails. 2020-04-30 06:17:18 -06:00
Timothy Baldridge
fee49cca12 Fix VFS FullPath errors 2020-04-24 07:56:03 -06:00
Timothy Baldridge
bb9ef89dee BSA archives are now lazily extracted.
7Zip extracted archives now only extract the fewest files required.
Audited the uses of .Wait
Lazily init the VFS cleaning
2020-04-16 21:52:19 -06:00
Timothy Baldridge
712438c6a6 Several ProcessStartInfo -> ProcessHelper conversions 2020-04-10 06:58:55 -06:00
Timothy Baldridge
45254b0055 No more MessagePack, Json is love, Json is life 2020-04-06 14:48:54 -06:00
Justin Swanson
0550dd751c Missing awaits 2020-04-03 16:41:17 -06:00
Timothy Baldridge
85b39d5dcc Fix some more race conditions in tests 2020-04-03 16:41:17 -06:00
Timothy Baldridge
129f6b4fc2 Cleaned up a bunch of warnings and errors 2020-04-03 16:40:52 -06:00
Timothy Baldridge
72d77bef1a VFS Tests pass 2020-04-03 16:37:28 -06:00
Timothy Baldridge
2b45210159 One test passes 2020-04-03 16:37:28 -06:00
Timothy Baldridge
80195b5620 WIP, VFS compiles, need to work on VFS tests 2020-04-03 16:37:27 -06:00
Timothy Baldridge
b37728eefd Tons of WIP changes for paths 2020-04-03 16:37:27 -06:00
Timothy Baldridge
3b895f4dbb WIP, converted Hashes to a Hash struct 2020-04-03 16:37:27 -06:00
Timothy Baldridge
186facb066 Fixes for WorkBase 2020-03-03 22:23:08 -07:00
Timothy Baldridge
b77db18bfa Fix a bunch of issues with compilation, indexing and VFS loading performance 2020-02-14 06:30:58 -07:00
Timothy Baldridge
5393ed4a84 Can now get meta.ini data from a download state 2020-01-10 21:15:53 -07:00
Timothy Baldridge
a1258b5ea9 Index all archives from all modlists 2020-01-10 06:16:41 -07:00
Timothy Baldridge
51aa59ecee Integrate build server file indexing into the main app 2020-01-09 21:47:06 -07:00
Timothy Baldridge
717ad8c70a Rework WJ caching, move cache server routines to MongoDB 2020-01-01 09:19:06 -07:00
Justin Swanson
e9deda9f44 Large swap to make WorkQueue able to take Task work items 2019-12-06 22:47:49 -06:00
erri120
694a5b8f8d
.exe files can be extracted with innounp after being tested 2019-12-01 14:57:28 +01:00
Timothy Baldridge
3976d7e526 Macro-level progress bar updates. 2019-11-24 16:03:36 -07:00
erri120
6892eced57
Removed unused imports from Wabbajack.VirtualFileSystem 2019-11-21 15:27:10 +01:00
Timothy Baldridge
9db982a13d Merge latest from master 2019-11-16 21:30:22 -07:00
Timothy Baldridge
baab601f09 Rework Work queue to be non-static 2019-11-16 21:16:42 -07:00
Timothy Baldridge
11cd96693a Compiles, working through the tests 2019-11-15 17:01:37 -07:00
Timothy Baldridge
a8dd59227d Several fixes and performance improvements 2019-11-15 16:13:27 -07:00
Timothy Baldridge
3d4947a27a All sanity checks pass 2019-11-15 06:41:08 -07:00
Timothy Baldridge
f6a27ac094 Much simpler integration 2019-11-15 06:06:34 -07:00
Timothy Baldridge
133fa2febd
Async VFS Implementation (#171)
* New VFS implementation can load/save/analyze files. All in a immutable, lock free (mostly) async parallel manner.

* VFS indexing is complete

* Can stage files

* Can extract VirtualFiles into PortableFiles and create contexts from PortableFiles

* Code cleanup
2019-11-14 15:22:53 -07:00