Natural language processing (NLP) machines have made great progress by learning to recognize complex statistical patterns in sentences and paragraphs. Work with modern deep learning models such as the transformer has shown that sufficiently large networks (hundreds of millions parameters) can do a good job processing language (e.g., translation), without having any information about what … Continue reading “Learning Words with Pictures”
‘If I have seen further, it is by standing on the shoulders of giants’ Sir Isaak Newton, 1619 Technical disciplines have always progressed by researchers building on past work, but the deep learning research community does this in spades with transfer learning. Transfer learning builds new deep learning systems on top of previously developed ones. … Continue reading “Machines Learning From Machines”
Training a Machine Learning system requires a journey through the cost terrain, where each location in the terrain represents particular values for all ML system parameters, and the height of the terrain is the cost, a mathematical value that reflects how well the ML system is performing for that parameter set (smaller cost means better … Continue reading “Navigating the Cost Terrain with Minibatches”
Machine learning applications generally rely on supervised learning, learning from training samples that have been labeled by a human ‘teacher’. Unsupervised learning learns what it can from unlabeled training samples. What can be learned this way are basic structural characteristics of the training data, and this information can be a useful aid to supervised learning. In my latest … Continue reading “Learning Without a Teacher”
Language is a hallmark of human intelligence, and Natural Language Processing (NLP) has long been a goal of Artificial Intelligence. The ability of early computers to process rules and look up definitions made machine translation seem right around the corner. However language proved to be more complicated than rules and definitions. The observation that humans … Continue reading “The Road to Human-Level Natural Language Processing”
iMerit is a remarkable company of over 4000 people that specializes in annotating the data needed to train machine learning systems. I am writing a series of blogs for them on various aspects of machine learning. In my latest blog I explain how ML systems embody both human intelligence and a form of machine ‘intelligence’. Just as … Continue reading “Encoding Human and Machine Knowledge for Machine Learning”
iMerit is a remarkable company of over 4000 people that specializes in annotating the data needed to train machine learning systems. I am writing a series of blogs for them on various aspects of machine learning. In my latest blog I explain how ML systems can be fooled by being either too ‘simple‘, too ‘inexperienced‘, or faced … Continue reading “The Three Edge Case Culprits: Bias, Variance, and Unpredictability”
iMerit is a remarkable company of over 4000 people that specializes in annotating the data needed to train machine learning systems. I am writing a series of blogs for them on various aspects of machine learning. In my latest blog I explain how inaccuracies in training data labels (‘label noise’) affect ML system performance. It turns … Continue reading “How Does Mislabeled Training Data Affect ML System Performance?”
AI’s have been developed that respond to human language, drive cars, and play masterful chess. As these feats traditionally require human intelligence, it might be said that AIs possess a form of intelligence. What do we humans make of this artificial ‘intelligence’? Are AIs intelligent entities in the same sense as we humans? Can machines … Continue reading “Thinking About Thinking Machines”
Artificial intelligence gets its name from the fact that AIs perform tasks associated with human intelligence, such as recognizing faces or understanding language or playing chess. For these tasks, we can measure AI performance and compare it to human performance, using a single ‘yardstick’, such as accuracy or word error rate or games won. But … Continue reading “Inside an AI”
Something went wrong. Please refresh the page and/or try again.
Follow My Blog
Get new content delivered directly to your inbox.