Data Science Stack Exchange Community Digest

Top new questions this week:

Imputation of missing values based on target variable

I want to impute missing values in German Credit Risk dataset. …

scikit-learn missing-data

asked by Ars ML Score of 3 answered by Brian Spiering Score of 1

Early anomaly detection / Failure prediction on time series

My problem here is that I want to predict failures in advance with respect to their occurrence. I have sensors mounted on my machine and with a certain frequency, they send data to my database. …

time-series lstm predictive-modeling anomaly-detection autoencoder

asked by Andrea Score of 2 answered by Jon Nordby Score of 2

Surrogate splits in Python

I want to use RandomForestClassifier from Sklearn to predict categorical variable (credit risk). But one of the predictors seems to have missing values: …

python scikit-learn random-forest decision-trees missing-data

asked by Ars ML Score of 2 answered by lcrmorin Score of 0

Does OpenAI and ChatGPT use Scikit Learn?

Scikit Learn is Python’s go-to open source package for running common AI and machine learning algorithms. Does OpenAI and its product ChatGPT use or rely on Scikit Learn on its back-end at all? If not,…

python scikit-learn ai openai-gpt chatbot

asked by user610620 Score of 2 answered by Brian Spiering Score of 3

How to extract values from unstructured text

I’m implementing a tool which should extract values of interest from unstructured text entries. The data set is several hundred thousands of medical entries. Each entry is relatively short (around 100 …

nlp training

asked by Jan Score of 1 answered by Brian Spiering Score of 0

How can I best plot a dataset to visualize the tradeoff between two or more metrics combined?

Basically I have a datasets in which different metrics are present, imagine inference speed and model accuracy. Some models are fast but have lower accuracy, while some others are some what the …

pandas matplotlib

asked by Hossein Score of 1 answered by Hossein Score of 2

Threshold for auto encoder anomaly detection

I have fitted an auto encoder on 25-dimensional time series data hoping to be able to detect anomalies. training set is 100k observations, testset for threshold setting is 10k observations. all …

anomaly-detection autoencoder

asked by Student Score of 1

Greatest hits from previous weeks:

When should I use Gini Impurity as opposed to Information Gain (Entropy)?

Can someone practically explain the rationale behind Gini impurity vs Information gain (based on Entropy)? Which metric is better to use in different scenarios while using decision trees?

machine-learning decision-trees information-theory

asked by Krish Mahajan Score of 107 answered by Dawny33 Score of 75

How to perform one hot encoding on multiple categorical columns

I am trying to perform one-hot encoding on some categorical columns. From the tutorial I am following, I am supposed to do LabelEncoding before One hot encoding. I have successfully performed the …

scikit-learn pandas

asked by radioactive Score of 20 answered by Rusoiba Score of 18

How can I check the correlation between features and target variable?

I am trying to build a Regression model and I am looking for a way to check whether there’s any correlation between features and target variables? This is my …

machine-learning scikit-learn regression linear-regression

asked by user_6396 Score of 31 answered by JahKnows Score of 24

K-Means clustering for mixed numeric and categorical data

My data set contains a number of numeric attributes and one categorical. Say, NumericAttr1, NumericAttr2, …, NumericAttrN, CategoricalAttr, where …

data-mining clustering octave k-means categorical-data

asked by IgorS Score of 198 answered by Tim Goodman Score of 180

How to get accuracy, F1, precision and recall, for a keras model?

I want to compute the precision, recall and F1-score for my binary KerasClassifier model, but don’t find any solution. Here’s my actual code: …

machine-learning neural-network deep-learning classification keras

asked by ZelelB Score of 60 answered by Tasos Score of 61

Understanding predict_proba from MultiOutputClassifier

I’m following this example on the scikit-learn website to perform a multioutput classification with a Random Forest model. …

scikit-learn random-forest multilabel-classification

asked by Harpal Score of 48 answered by chrisckwong821 Score of 45

What is the difference between “equivariant to translation” and “invariant to translation”

I’m having trouble understanding the difference between equivariant to translation and invariant to translation. In the book Deep Learning. MIT Press, 2016 (I. Goodfellow, A. Courville, and Y. Bengio)…

neural-network deep-learning convolution

asked by Aamir Score of 79 answered by Laurent Duval Score of 82

Can you answer this question?

Knowing the standard deviation of 2 normal distribution

I’m learning linear algebra for data science on some site. There is a quiz and the result I’ve answered that I linked to the image. I’m curious about why the standard deviation part is wrong? As I …

machine-learning gaussian

asked by Rickyslash Score of 1 answered by Erwan Score of 0