218 Commits (6bfdb07f42a0306483f0abed5467fffc653ab983)

Author	SHA1	Message	Date
Graham	469fe2eecc	Add environment and language columns to the caches table ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	211041ab6d	Update support build list ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	3b4fcad8f4	Add link to RuneWiki ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	334424e57a	Fix addMasterIndex() ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	f4ae5540d7	Skip version list entries with a version of zero ... The client uses these to indicate files that don't exist. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	0cf1881db4	Rename 'Indexes' column to 'Archives' ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	ab964a2b1f	Skip corrupt files when importing a legacy cache ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	f079c415f5	Add initial support for archiving legacy caches ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	2eaba6a680	Fix cache size calculation ... It didn't take the 2 byte version trailer into account previously. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	39d2ad7ee3	Fix ByteBuf leak ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	ab2c56f0af	Set HttpClient timeouts ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	046ccbc2c9	Optimize the master_index_stats view ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	1efa370fdd	Reconnect to the JS5 server if we lose connection while parsing indexes ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	20868a39ad	Fix warnings in CacheExporter ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	2a6ffa87a6	Fix elvis operator on non-nullable type warning ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	3368818ca1	Download names from Polar's fork of RuneStar ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	f0cd4afcf0	Add sorting and filtering to the caches table ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	e1a650aec4	Update introduction text ... We now download RuneScape 3 caches automatically. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	3848a89f68	Ensure a directory is created for the ARCHIVESET archive ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	36f5efa1ad	Serve flat file caches as .tar.gz files instead of .zip files ... Streaming .tar.gz files requires less memory, as we don't need to remember metadata about each file for the end of directory record. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	cbb2a90388	Disable .dat2/.idx link if the cache is too big for a DiskStore ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	a52955fe4b	Switch to ktor's CIO backend ... It seems to deal with backpressure better than the Netty backend. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	0ec7736764	Log the number of XTEA keys imported ... This makes it a bit easier to determine if the keys are parsed correctly. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	7915698cda	Reduce CacheExporter BATCH_SIZE ... I think this is causing OOMs. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	821cb732fd	Remove signature verification from the cache downloader ... The keys seem to change in each release now, which is going to be too much of a pain to keep up with. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	0781e23874	Add update links to each master index ... Flenarn provided a spreadsheet mapping our master indexes to the corresponding update. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	6f02ab2f65	Add NXT cache downloader ... I'm still not particularly happy with this: if the JS5 download finishes before HTTP, it'll time out and kill the whole process. Similarly, because it takes so long to import the indexes and as we can't fetch groups in parallel with that, it can often time out early during the process. In the long term, I think I am going to try and move most of the logic outside of the Netty threads and communicate between threads with queues or channels. This would also allow us to run multiple JS5 clients in parallel. The code also needs some tidying up, particularly constants in the Js5ChannelHandler constructors. Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	21ed41c307	Use applet viewer config to find the hostname of a JS5 server ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	11a43242b9	Add applet viewer config parser ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	637e311a67	Fix SELECT DISTINCT query ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	fc6e739879	Add e prefix to the name generator ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	d925b68db3	Remove duplicate keys from valid.json ... Signed-off-by: Graham <gpe@openrs2.org>	3 years ago
Graham	01b50e33f7	Fix resolve_group() if the version number is greater than 65535 ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	a3cca0e6c3	Add Protocol constants ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	ce741279b4	Add read-only Js5Index.{Group,File} types ... These will be used by the high-level cache API, where we don't want to expose mutable versions of the group/file types as that would allow the index/cache to get out of sync. Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	1c0bf7529c	Update Bootstrap ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	b37e4d0d0b	Use alternatives for most methods deprecated in Kotlin 1.5 ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	cf8110e5a7	Fix possible off-by-one error in KeyBruteForcer ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	3293454c17	Add support for importing keys in binary format ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	09961589e3	Fix map square coordinate text ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	ba60fecb50	Add support for downloading caches in flat file format ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	e0a2df889b	Add more information to the individual cache pages ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	d89c45940b	Infer the number of bytes to skip automatically in the material decoder ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	1f9e7798e7	Improve size estimation footnote ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	193af138fe	Use non-breaking space in the size column ... This has the convenient side effect of us no longer needing to exclude the byteunits dependency from minimisation. Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	9be1a54b76	Add estimated cache size column ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	ee567cc76f	Treat empty loc groups as valid ... I've decided to reverse my decision in e3e0094b43. If you treat empty loc groups as valid, some OSRS caches do have 100% valid keys. Being able to pick these out in the list of caches will be useful. Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	40d6ccbb61	Add ent's output to the keys page ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	221252895c	Check exit code of ent ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago
Graham	593f46d9fd	Add percentages to the keys page ... Signed-off-by: Graham <gpe@openrs2.org>	4 years ago