# PMB Data File Formats

Each document folder in the folder 20261203 (e.g. `p31_d0352/`) contains the following files:

## `en.raw`
The raw sentence as plain text.
Example: `Damian is not normally a man of action so now, stirred into action, he looks like he means business.`

## `en.tok`
Tokenized version of the sentence, with punctuation separated from words by spaces.
Example: `Damian is not normally a man of action so now , stirred into action , he looks like he means business .`

## `en.drs.sbn`
Semantic annotation in Sequence Notation (SBN). Each line corresponds to a token or logical relation and contains:

- **Sense**: WordNet synset ID (e.g. `male.n.02`), or empty if the line represents only a discourse relation

- **Operators**: semantic role labels and relations (e.g. `Theme -1`, `EQU now`, `ANA -3`), or discourse operators (e.g. `NEGATION`, `EXPLANATION`)

- **Word info**: the surface token(s) aligned to this line, with character offsets in brackets (e.g. `[0-6]`); function words appear in red in terminal output

## `en.wordnet`
One WordNet synset ID per line, listing the sense assigned to each token. Tokens without a WordNet sense are marked `O`.

## `en.semtag`
One semantic tag per line, one per token. Tags indicate semantic categories such as `ENS` (event, non-specific), `CON` (concept), `PRO` (pronoun), `NOT` (negation), `NOW` (deictic time), etc.

## `en.cats`
One CCG (Combinatory Categorial Grammar) category per line, one per token. Categories describe the syntactic type of each word (e.g. `NP/N` for a determiner, `(S[dcl]\NP)/NP` for a transitive verb).

## `en.semlex`
Detailed semantic lexicon entries, one per token. Tab-separated columns include token ID, character offsets, CCG category, semantic tag, WordNet synset, lemma, surface form, a hash, and a lambda-calculus expression encoding the compositional semantics of the token.

## `en.drs.sbn.dot` / `en.drs.dot`
GraphViz DOT format visualizations of the semantic representation:

- **`en.sbn.dot`**: graph based directly on the SBN annotation, showing synsets and relations as nodes and edges

- **`en.drs.dot`**: graph of the full Discourse Representation Structure (DRS), grouping discourse referents into labelled boxes with conditions

The folder `merged` stores sbn\_combined.tsv, which is the result of merging SBN files into a single one and adding sentence information and splitting into columns. It is the output of the jupyter notebook merging\_data.ipynb.
