Knowledge Centre

For ML (Machine Learning),

  1. Conception of supervised and unsupervised learning
  2. Cross validation and regularisation
  3. KNN
  4. K Means
  5. SVM and Decision tree (optional)
  6. Artificial Neural Network (MLP, RNN, LSTM)

For NLP (Natural Language Processing),

  1. Word embedding
  2. Word2Vec
  3. GloVe
  4. ELMO
  5. Attention and Transformer (this is from ML actually)
  6. BERT (including pre-training and fine-tuning structure)

Most models now are based on neural network, here is an introduction: ANN & Word2Vec