<div align="center">
<h1>Bolaco</h1>
</div>

This repo contains the code for "Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization"([https://arxiv.org/abs/2405.10616](https://arxiv.org/abs/2405.10616))

## Quick start
### Installation
```
pip install -r requirement.txt
```

### Low-rank compression
```
bash run.sh
```

### Post-training
```
bash run_posttrain.sh
```


## Model checkpoint
You can download the checkpoints for the model from [here](https://huggingface.co/baldwin6/Bolaco)
