Close this search box.

Glossary of Artificial Intelligence (AI), Machine Learning (ML), and Big Data Terms

Curse of Dimensionality

The more dimensions you need to learn and classify, the more that the samples of data you need in order to get enough valid information upon which to create generalizations. Without enough data, you will have very few examples for each combination of dimensions. This means you need lots and lots of data to make sure there are enough real examples to train the systems for predictable results. This is why Machine Learning is data hungry. “A typical rule of thumb is that there should be at least 5 training examples for each dimension in the representation”. As the number of dimensions on which a machine learning system is trained goes up, initially the performance of the model improves, but then later substantially decreases. One big goal of machine learning is to reduce the number of dimensions needed upon which a good machine learning model can be built that provides good generalizations.

Get Certified on the Proven Path to Success with AI, Big Data & Analytics Projects

Login Or Register


Register to View Event


Get The Curse of Dimensionality


AI Best Practices

Get the Step By Step Checklist for AI Projects


Login to register for events. Don’t have an account? Just register for an event and an account will be created for you!