A Choice of Pipelines for Data Analysis

AI Thread Summary
When processing data using Linear or Multilinear Regression, there is a question of whether TensorFlow (TF) would yield the same output as traditional methods if the right activation functions are chosen. The discussion suggests that under similar conditions, TF should converge on the same coefficients as traditional calculations, but the introduction of hidden layers in neural networks may lead to better performance through non-linear fits. The conversation also references the Keras tutorial on fuel efficiency as a practical resource for learning. Additionally, two recommended books provide insights into machine learning pipelines and project setups. Overall, the choice of pipeline can significantly impact the results of data analysis.
WWGD
Science Advisor
Homework Helper
Messages
7,691
Reaction score
12,622
TL;DR Summary
What kind of rules of thumb are there to decide choice of pipeline?
Hi,
So say I have some data to process. I am trying, say, Linear/Multilinear Regression. I know how to do this within Python Pandas. I can learn how with Tensorflow (TF). Would TF produce the same output given the "right" choice of Activation Functions *? Or would it output a model that is somehow "More General"?

* I assume this is the only/main variable affecting this choice and not other variables such as choice of metrics, sessions, etc.
 
Physics news on Phys.org
Given the same model structure (choice of metrics, properly normalized data, loss function) I don't see why TF should not converge on the same coefficients as a traditional calculation. However with a neural network we introduce hidden layers that create a non-linear fit which in most cases will perform better.

Have you worked through the Keras tutorial on the fuel efficiency dataset?
 
Does TF stand for TensorFlow or The f$%*? ;). Thanks for your answer. Will look up the link; thanks.
 
WWGD said:
Does TF stand for TensorFlow or The f$%*? ;).
I must admit to having used the words "why won't you converge you f$%*?" or similar on a number of occasions.
 
Last edited:
  • Like
Likes PhDeezNutz and WWGD

Similar threads

Back
Top