Deep Learning Keywords

새로운 분야에 대해서 공부하기 시작할 때 접근하기 위해서 필요한 키워드를 정리하는 것을 목적으로 한다. 그 분야에 대해서 공부를 할 때 발견한 키워드들을 기록할 예정이다. 

 

• Model Compression
  • Pruning
  • Knowledge Distillation (KD) - Knowledge transfer
    • Response-based Knowledge
• Segmentation
  • Image Segmentation, Semantic Segmentation
• Object Detection
• Classification
• XAI
• Learning
  • Active Learning
    • warm-up
    • sample selection
  • Multitask Learning
• Loss Function
  • Segmentation Loss
    • Distribution-based Loss
      • Cross-Entropy Loss
    • Region-based Loss
      • Dice Loss
    • Boundary-based Loss
      • Hausdorff Distance Loss
    • Compounded Loss
• Learning Rate - Super Convergence
  • Cyclical Learning Rate (CLR)
• Backbone Network
  • MobileNet

---

Reference

• Knowledge Distillation: A Survey