Kaggle Solubility competition: overview
Kaggle Solubility competition is over. It did draw the attention of 100 participants with some strong issues underlined by the participants. I decided to share my dive into this... Data: 70 711 compounds in train set: A very good and diverse dataset. 30 308 compounds in test set . Quality m etric: Kappa coefficient (was it changed later?). Results Initial winner (by leaderboard) was a Ohue laboratory of Tokyo Institute of Technology with a combination of the BART transformer language model and GNN with focal loss ( solution ). The dramatic difference between the winner and the rest of the participants was noticeably big and raised a lot of questions. Bernhard Rohde (Novartis) was the second leaderboard winner. He underlined the same issue and showed that “plate/row/column” has a drastic effect on model quality (explicit IDs were provided: EOS12286). Still, the Bayesian Instance-Based Offset Learning solution he used draw my attention, because it can be app...