To pass the knowledge over the relative dependencies of different tokens appearing at distinct spots during the sequence, a relative positional encoding is calculated by some kind of Understanding. Two popular different types of relative encodings are:It’s also well worth noting that LLMs can make outputs in structured formats like JSON, facilita