Skip to content

An Integration Study of Language Models and Message Passing Networks on Quantum Chemistry

License

Notifications You must be signed in to change notification settings

jiaqingxie/LM-MPNN

Repository files navigation

GICL

Geometry Injection of Molecule with Contrastive Learning

Baseline: Pretrained Mol-Language Model

HIV: python baseline.py --dataset HIV --out_dim 2 --task clf --device cuda
BACE: python baseline.py --dataset BACE --out_dim 2 --task clf --device cuda
BBBP: python baseline.py --dataset BBBP --out_dim 2 --task clf --device cuda
ESOL: python baseline.py --dataset ESOL --out_dim 1 --task reg --device cuda
QM9: python baseline.py --dataset QM9 --out_dim 1 --task reg --device cuda
--pretrained: v1/v2/gpt

Baseline: Message Passing Neural Networks (MPNN)

HIV: python mpnn.py --dataset HIV --out_dim 2 --task clf --device cuda
BACE: python mpnn.py --dataset BACE --out_dim 2 --task clf --device cuda
BBBP: python mpnn.py --dataset BBBP --out_dim 2 --task clf --device cuda
ESOL: python mpnn.py --dataset ESOL --out_dim 1 --task reg --device cuda
QM9: python mpnn.py --dataset QM9 --out_dim 1 --task reg --device cuda
--graph_model: mpnn/gnn

Node-Level Contrastive Learning

HIV: python node_contrast.py --dataset HIV --out_dim 2 --task clf --device cuda
BACE: python node_contrast.py --dataset BACE --out_dim 2 --task clf --device cuda
BBBP: python node_contrast.py --dataset BBBP --out_dim 2 --task clf --device cuda
ESOL: python node_contrast.py --dataset ESOL --out_dim 1 --task reg --device cuda
QM9: python node_contrast.py --dataset QM9 --out_dim 1 --task reg --device cuda
--pretrained: v1/v2/gpt
--weight_cl: a float number

Graph-Level Contrastive Learning

HIV: python graph_contrast.py --dataset HIV --out_dim 2 --task clf --device cuda
BACE: python graph_contrast.py --dataset BACE --out_dim 2 --task clf --device cuda
BBBP: python graph_contrast.py --dataset BBBP --out_dim 2 --task clf --device cuda
ESOL: python graph_contrast.py --dataset ESOL --out_dim 1 --task reg --device cuda
QM9: python graph_contrast.py --dataset QM9 --out_dim 1 --task reg --device cuda
--pretrained: v1/v2/gpt
--weight_cl: a float number

Late Fusion

HIV: python late_fusion.py --dataset HIV --out_dim 2 --task clf --device cuda
BACE: python late_fusion.py --dataset BACE --out_dim 2 --task clf --device cuda
BBBP: python late_fusion.py --dataset BBBP --out_dim 2 --task clf --device cuda
ESOL: python late_fusion.py --dataset ESOL --out_dim 1 --task reg --device cuda
QM9: python late_fusion.py --dataset QM9 --out_dim 1 --task reg --device cuda
--pretrained: v1/v2/gpt
--aggr: sum/max/concat/gate
--graph_model: mpnn/gnn

Joint Fusion

HIV: python joint_fusion.py --dataset HIV --out_dim 2 --task clf --device cuda
BACE: python joint_fusion.py --dataset BACE --out_dim 2 --task clf --device cuda
BBBP: python joint_fusion.py --dataset BBBP --out_dim 2 --task clf --device cuda
ESOL: python joint_fusion.py --dataset ESOL --out_dim 1 --task reg --device cuda
QM9: python joint_fusion.py --dataset QM9 --out_dim 1 --task reg --device cuda
--pretrained: v1/v2/gpt
--joint: mpnn2lm/lm2mpnn
--aggr: sum/max/concat
--graph_model: mpnn/gnn

About

An Integration Study of Language Models and Message Passing Networks on Quantum Chemistry

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages