Graham
9be1a54b76
Add estimated cache size column
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
ee567cc76f
Treat empty loc groups as valid
...
I've decided to reverse my decision in
e3e0094b43
.
If you treat empty loc groups as valid, some OSRS caches do have 100%
valid keys. Being able to pick these out in the list of caches will be
useful.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
40d6ccbb61
Add ent's output to the keys page
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
221252895c
Check exit code of ent
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
09b6605a99
Update dependencies
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
4e713b53f8
Make T3 errors non-fatal
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
593f46d9fd
Add percentages to the keys page
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
6c728d758c
Add total number of encrypted/validated groups to the keys page
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
6cf9eb5043
Set source name for original caches to 'Jagex'
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
f1c9fed36f
Rename 'Name' column to 'Source(s)'
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
879e0f5e13
Refactor underlay/overlay-related code
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
ab58a83a5d
Update dependencies
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
4337020b6b
Add endpoint for exporting all keys in bulk
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
93ee863e20
Add initial support for plotting a map of valid/invalid XTEA keys
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
dbd169aa1a
Make fastutil part of the cache library's API
...
The group unpacking code exposes a fastutil type. (In the long run this
might be replaced with an array, allowing us to revert this commit or
drop the fastutil dependency entirely.)
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
da3cc57b3f
Add link to download keys in the text format
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
f6961a50f1
Add cache size in bytes to master_index_stats
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
8bc25e7e47
Set compression lewel to -9
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
aad469c05d
Generate XTEA key zip reproducibly
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
c4f807d38f
Add X-Forwarded-For support
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
2d136c89e9
Add zipped text version of the XTEA key endpoint
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
a02eb169f4
Fix NPE in TextKeyReader if the input is invalid
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
a6fa7bf5b6
Throw exception before importing a cache if its master index is empty
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
ae88bca924
Add ent command for analysing the randomness of keys
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
e4776f7c3c
Only call games.single() when game is accessed
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
f870410a09
Update dependencies
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
e6af0affb6
Ignore corrupt indexes in Js5MasterIndex::create
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
bf86fa48e9
Update dependencies
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
8c395bcf4b
Add index on key_id
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
a8fbfd851c
Replace PL/pgSQL functions with inlineable SQL functions
...
This speeds up the resolved_* views by a reasonable amount, though it
does mean we won't be able to use the smarter resolution logic (which is
far too slow anyway at the moment, so I'm not sure what I'm going to do
about that in the future...)
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
5d1fa42623
Remove pointless LATERAL JOINs
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
b792b65f5e
Remove smarter resolution algorithm for now
...
It's significantly slower. I'm not sure why yet.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
3a897d4e67
Downgrade Netty
...
The native libraries haven't been linked correctly in 4.1.60.Final.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
18d7fdc343
Resolve collisions by prioritising groups from the same source
...
This doesn't fix all cases, as a master index can have multiple sources,
each with a distinct copy of the same (archive, group, checksum,
version) tuple. However, it's probably as good as we'll be able to do
automatically - and it'll work particularly well for master indexes
downloaded directly over JS5, where we won't have done multiple imports
of the same cache.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
1f735f4b99
Remove duplicate descriptions
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
f04d163d98
Add non-truncated version numbers to the collisions view
...
Will be useful for determining if a collision is caused by version
truncation.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
f59d9213eb
Update dependencies
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
c49ce684c8
Optimize master_index_stats
...
We no longer need COUNT DISTINCT - the resolve_* functions can only
return a single row.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
24d5b91ebe
Mark functions as stable, strict and parallel safe
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
cba34b54c9
Add resolve_{group,index} functions
...
These functions reduce the amount of group resolution logic
significantly, concentrating it in a single place. In addition to the
usual code de-duplication benefits, many of the queries are now much
simpler as the complexity is hidden behind the function calls.
This change also allows us to make the group resolution logic more
complicated. The first change is that the functions are guaranteed to
only return a single row, which was not true with the old JOIN-based
approach. The row that is chosen is chosen deterministically.
The resolution logic will probably be improved in the future, so we can
make a better decision where there are multiple possible groups, due to
collisions.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
a8794aca99
Include empty master index in master_index_stats
...
This fixes the caches with an empty master index from displaying as
'Calculating...'.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
b685d901aa
Mark empty master index as invalid
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
38be1905cb
Fix cache source URL list
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
006c8f7b9b
Improve grammar
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
eeb82d2e47
Fix typo in master_index_stats JOIN
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
9bce5cc1b3
Replace LEFT JOIN on sources/games with a JOIN
...
Each master index now has at least one source.
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
4ad9b31aae
Update dependencies
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
c0f9590f48
Add foreign key to source_groups
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
4353d8a616
Refactor identikit-related code
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago
Graham
69a511a3c5
Update dependencies
...
Signed-off-by: Graham <gpe@openrs2.org>
4 years ago