Knowledge Centre
For ML (Machine Learning),
- Conception of supervised and unsupervised learning
- Cross validation and regularisation
- KNN
- K Means
- SVM and Decision tree (optional)
- Artificial Neural Network (MLP, RNN, LSTM)
For NLP (Natural Language Processing),
- Word embedding
- Word2Vec
- GloVe
- ELMO
- Attention and Transformer (this is from ML actually)
- BERT (including pre-training and fine-tuning structure)
Most models now are based on neural network, here is an introduction: ANN & Word2Vec