A polynomial regression wants to model a non-linear, polynomial relationship within the data. It can be just reduced to a linear regression via variable substitution, reducing the features to linear ones. A generic polynomial model is
The problem can be reduced to that of a multiple linear regression where the features are the polynomials of
so that the model is linear in all of these new features.
The same applies to non-polynomial features, say exponentials or other functions.