Commit Graph

61 Commits

Author SHA1 Message Date
Timothy Baldridge
bb9ef89dee BSA archives are now lazily extracted.
7Zip extracted archives now only extract the fewest files required.
Audited the uses of .Wait
Lazily init the VFS cleaning
2020-04-16 21:52:19 -06:00
Timothy Baldridge
cc6b6eb3c7 Fix nexus updater code 2020-04-15 15:01:01 -06:00
Timothy Baldridge
470992cc4a Merge Master 2020-04-15 06:05:05 -06:00
Timothy Baldridge
65cac27403 List validation, can heal HTTP downloads (and probably Nexus archives) 2020-04-14 21:25:00 -06:00
Timothy Baldridge
74a332d6cb WIP Archive Patching 2020-04-14 07:31:03 -06:00
Timothy Baldridge
94514bd2cb Validation service seems to be working well 2020-04-13 17:31:48 -06:00
Justin Swanson
01588dbcc9 Merge branch 'master' into wabbajack-lib-nullability 2020-04-12 00:40:49 -05:00
Timothy Baldridge
f59fe643f1 Fix heartbeat test 2020-04-10 22:42:07 -06:00
Timothy Baldridge
508eb32230 Fixes for nexus cache priming 2020-04-10 21:16:10 -06:00
Justin Swanson
806ff74893 Wabbajack.Lib nullability finished up 2020-04-10 13:32:35 -05:00
Justin Swanson
86641d01df Wabbajack.Lib Compilation steps nullable enabled 2020-04-10 13:23:23 -05:00
Timothy Baldridge
a481f546c1 Fix a bunch of tests with auto-healing 2020-04-09 21:54:02 -06:00
Timothy Baldridge
7cf817853c Implement tests for List validation 2020-04-07 22:19:36 -06:00
Timothy Baldridge
45254b0055 No more MessagePack, Json is love, Json is life 2020-04-06 14:48:54 -06:00
Timothy Baldridge
3d16b1e838 Purge all remaining references to MongoDB and BJSON 2020-04-05 15:15:01 -06:00
Timothy Baldridge
07bc3546bb Fix for the temp folder being on a different drive. 2020-04-04 11:25:54 -06:00
Timothy Baldridge
a140b1daca Rebase against latest master 2020-04-03 16:56:14 -06:00
Timothy Baldridge
eef41fc908 Changes I forgot to include 2020-04-03 16:41:42 -06:00
Timothy Baldridge
8af841f3d6 Fix several more tests 2020-04-03 16:41:42 -06:00
Timothy Baldridge
55fb7e1467 Nexus Cache is now SQL Based 2020-04-03 16:41:42 -06:00
Timothy Baldridge
be2d24a578 Add Nexus cache ingestion support 2020-04-03 16:41:19 -06:00
Timothy Baldridge
e39f483b81 Tests for INI uploading/downloading 2020-04-03 16:41:17 -06:00
Timothy Baldridge
a6e3ef5f72 Game type is now an enum for Nexus downloads 2020-04-03 16:41:17 -06:00
Timothy Baldridge
160ac8a4c3 Fixes for author APIs 2020-04-03 16:41:17 -06:00
Timothy Baldridge
8b9210eeb0 Tests for the listing uploaded files by user 2020-04-03 16:41:17 -06:00
Timothy Baldridge
fcb589a442 Uploaded files and API keys are now stored in SQL, still working on adding more tests 2020-04-03 16:41:17 -06:00
Timothy Baldridge
ea3f33350c Adding tests for the build server, changed the Queue Service over to SQL 2020-04-03 16:40:52 -06:00
Timothy Baldridge
b5006a0737 Everything compiles 2020-04-03 16:40:52 -06:00
Timothy Baldridge
3b895f4dbb WIP, converted Hashes to a Hash struct 2020-04-03 16:37:27 -06:00
Timothy Baldridge
386cb247c6 Add Nexus data export endpoint 2020-04-01 22:21:19 -06:00
Timothy Baldridge
522b672f1e Ini exporter 2020-03-30 16:12:49 -06:00
Timothy Baldridge
2ae65688f0 Fixes and changes to get into 1.1.4.0 2020-03-30 14:53:59 -06:00
Timothy Baldridge
7978cd098c Fixes for strange edge cases on the server, we now log metrics about list healing 2020-03-10 14:41:45 -06:00
Timothy Baldridge
44b78111a3 Server side cleanup, give authors the ability to delete their own files. Some sanity and logging checks for 2020-03-02 16:16:15 -07:00
Timothy Baldridge
f30da8a27a Support self-healing lists, and a lot of server fixes 2020-02-27 06:46:34 -07:00
Timothy Baldridge
42e732559c Fix issues with the server upload dieing, add server-log verb 2020-02-25 16:10:41 -07:00
Timothy Baldridge
b77db18bfa Fix a bunch of issues with compilation, indexing and VFS loading performance 2020-02-14 06:30:58 -07:00
Timothy Baldridge
f036420b42 * Disable server-side indexing of all mods from the Nexus
* Accept download states from clients and index the mods we haven't seen
* Fixes for Skyrin VR USSEP patch
* Remember the download states that we index on the server
* Only print remaining nexus quotas when they change
2020-02-13 05:29:59 -07:00
Timothy Baldridge
7c6e797244 Fix file uploading and implement server-side hash verification. 2020-01-31 22:41:09 -07:00
Timothy Baldridge
a63b664aad Return a 404 (instead of an exception) when an archive isn't indexed 2020-01-30 16:53:10 -07:00
Timothy Baldridge
b7ef339978 Fix file extractor tests, convert metrics to SQL 2020-01-30 06:07:16 -07:00
Timothy Baldridge
fe4a4918d4 Switch the indexed archives backend to MSSQL for better ACID support 2020-01-25 21:50:17 -07:00
Timothy Baldridge
b0725e1fc2 Fixes for bad indexed data 2020-01-23 16:02:49 -07:00
Timothy Baldridge
8f92862b74 CDN FTP uploads, fixed meta download issues with 3dNPCs, Uploads to the build server are now multi-threaded. 2020-01-21 20:43:53 -07:00
Timothy Baldridge
7e436818b7 Server changes for CDN optimization 2020-01-21 05:49:49 -07:00
Timothy Baldridge
f2359ab273 Rewrote the uploader to use a block based approach 2020-01-18 22:51:12 -07:00
Timothy Baldridge
72977ec0b3 Fix a bug in the users path 2020-01-18 15:24:55 -07:00
Timothy Baldridge
6969a531e2 Add Upload support to WJ, fixes for the new server, etc. 2020-01-18 15:09:32 -07:00
Timothy Baldridge
fdc4e1f92c Start on file upload support 2020-01-17 15:55:03 -07:00
Timothy Baldridge
af9f0dbf89 Can manually enqueue jobs 2020-01-14 06:35:50 -07:00