knowledge distillation
Machine learning method to transfer knowledge from a large model to a smaller one.
- Type of
- machine learning
- Instance of
- machine learning method
Connected
More concepts & methods
- AlexNettype of convolutional neural network
- online machine learninga method where a model is trained incrementally on data as it becomes available, in contrast to batch learning where the entire dataset is used at once
- federated learningmethod for artificial intelligence
- cognitive architectureblueprint for intelligent agents
- adversarial machine learningmachine learning technique that attempts to prevent models being fooled by supplying deceptive input
- multimodal learningmachine learning combining different information resources, such as images and text
Sources
- Wikidata Q74253442 (structured facts, CC0)
- Wikipedia