"ASM tracing" is the first thing I'll say on the subject. Odds are it's a LZ scheme of some sort, the likes of which I've discussed in detail
here. It might not be 100% compatible, but if it's using the GBA's built-in LZ or anything like it, much of what you'll read here should apply.