Data Science Stack Exchange Community Digest

Top new questions this week:

Would adding Elastic Net as an additional Benchmark add any value when LASSO is already an included benchmark?

I am currently engaged in a research project with a collaborator in which he is proposing a novel learning algorithm for optimal variable selection, and exploring its computational, statistical, and …

machine-learning feature-selection feature-engineering research

asked by Marlen Score of 3 answered by Spencer Score of 2

What is the differenc between Real concept drift, virtual concept drift and feature drift

As far as I know, the real concept drift is caused by changes in the decision boundary while virtual drift occurs because of changes in data distribution. Some researchers mention that virtual drift …

machine-learning classification feature-engineering data-stream-mining concept-drift

asked by Imen F Score of 2 answered by German C M Score of 0

Identifying competition climbing styles from World Cup data

In competitive climbing, it is well known that there are many different styles, differentiated by e.g. the steepness of the climbing wall. Some athletes excel at certain styles more than others. I …

clustering pca

asked by Yly Score of 2 answered by Darren Cook Score of 1

What size language model can you train on a GPU with x GB of memory?

I’m trying to figure out what size language model I will be able to train on a GPU with a certain amount of memory. Let’s for simplicity say that 1 GB = 109 bytes; that means that, for example, on a …

nlp gpu language-model memory

asked by HelloGoodbye Score of 2

In ChatGPT, what is the difference between Reinforcement-Learning-from-Human-Feedback and Data-Re-Label-from-Reward?

RLHF vs TrainingData-Label-Again-based-on-Reward. Reward come from human labeling.

machine-learning deep-learning nlp openai-gpt

asked by DunkOnly Score of 1 answered by noe Score of 1

Random Forest Classifier is giving me an array of zeroes

I used VGG16 as feature extractor on a dataset with 9 classes and trained the Random Forest Classifier on the feature vector. I tried to make prediction on the test feature vector but the prediction …

python tensorflow cnn random-forest vgg16

asked by gray Score of 1

Good flowchart for which ML model to use given characteristics of the dataset?

There are so many ML models to choose from. Looking for a flow chart that someone may have created or come across that helps you decide which ML model(s) to use. Here is some of the possible flow …

model-selection

asked by Katsu Score of 1 answered by German C M Score of 1

Greatest hits from previous weeks:

Train Accuracy vs Test Accuracy vs Confusion matrix

After I developed my predictive model using Random Forest I get the following metrics: …

python predictive-modeling accuracy confusion-matrix classifier

asked by Pedro Alves Score of 16 answered by S van Balen Score of 25

GraphViz not working when imported inside PydotPlus (`GraphViz's executables not found`)

I’ve been trying to make these packages work for quite some time now but with no success. Basically the error is: GraphViz’s Executables not found EDIT: I had …

python visualization jupyter anaconda graphviz

asked by Philippe Fanaro Score of 25 answered by Rob Score of 18

Pandas change value of a column based another column condition

I have values in column1, I have columns in column2. What I want to achieve: Condition: where column2 == 2 leave to be 2 if column1 < 30 elsif change to 3 if column1 > 90. Here is what i did so …

data-mining pandas

asked by Koko Score of 13 answered by Vlad_Z Score of 13

AttributeError: module 'tensorflow.python.keras.utils' has no attribute 'to_categorical'

I’m trying to run the code below in my Jupyter Notebook. I get: AttributeError: module ‘tensorflow.python.keras.utils’ has no attribute ‘to_categorical’ This is code from Kaggle tutorial. I have …

keras tensorflow

asked by vojtak Score of 10 answered by Vin Bolisetti Score of 8

Does scikit-learn have a forward selection/stepwise regression algorithm?

I am working on a problem with too many features and training my models takes way too long. I implemented a forward selection algorithm to choose features. However, I was wondering does scikit-learn …

feature-selection scikit-learn

asked by Maksud Score of 59 answered by brentlance Score of 34

Cross-entropy loss explanation

Suppose I build a neural network for classification. The last layer is a dense layer with Softmax activation. I have five different classes to classify. Suppose for a single training example, the <...

machine-learning neural-network deep-learning softmax

asked by enterML Score of 73 answered by Neil Slater Score of 96

IDE alternatives for R programming (RStudio, IntelliJ IDEA, Eclipse, Visual Studio)

I use RStudio for R programming. I remember about solid IDE-s from other technology stacks, like Visual Studio or Eclipse. I have two questions: What other IDE-s than RStudio are used (please …

r tools rstudio programming

asked by IgorS Score of 60 answered by karupakalas Score of 24

Can you answer these questions?

In a broad sense, can all the machine learning tasks be viewed as classification?

In a broad sense, can all the deep learning tasks be viewed as classification?

machine-learning deep-learning classification

asked by DunkOnly Score of 1 answered by Dave Score of 0

Why don't data scientists use Panel Data Econometric Techniques?

I am currently only one semester away from finishing a Masters of science degree in data analytics engineering from George Mason University and I decided to transition into the data analysis and …

data-science-model data-analysis methods

asked by Spencer Score of 1

Python train convolutional on numerical values shape issue

I want to train a convolutional neural network autoencoder on a csv file which contains values pixel neighborhood position of an original image of 1024×1024. When I try to train it, I have the …

python convolutional-neural-network autoencoder csv image

asked by user979974 Score of 1