Data Science Stack Exchange Community Digest

Top new questions this week:

What advantages does Data Visualization have in EDA?

It is not clear to me what advantage the EDA data visualization provides. By advantage I mean what decision I will make according to one or the other visualization. Could someone give me an example …

machine-learning visualization data-analysis

asked by Enrique Benito Casado Score of 5 answered by liakoyras Score of 5

Flipping the labels in a binary classification gives different model and results

I have an imbalanced dataset and I want to train a binary classifier to model the dataset. Here was my approach which resulted into (relatively) acceptable performance: 1- I made a random split to get …

python classification scikit-learn class-imbalance imbalanced-data

asked by Farzad Score of 1 answered by the_strange Score of 0

What are good Bipartite Graphs Algorithms?

Currently, I have a dataset with pairs . The idea is to detect any anomaly in these relationships. I was able to just use pandas to do the analysis so far. |Customer|Agent|Duration|Marks|etc |C1…….

graphs social-network-analysis

asked by mehmat Score of 1 answered by umair mughal Score of 1

Classification of data points using vertical lines through visualisations

I am currently doing my master’s thesis and at the end of finishing it, but there are some questions raised by my supervisor. I have answered most of the questions, but only one question is remaining …

machine-learning classification visualization binary-classification

asked by user1791442 Score of 1 answered by Erwan Score of 1

Deep learning through backpropagation: not learning

I am starting with deep learning and decided to code a backpropagation algorithm on Python 3. I have followed many tutorials and have taken as example many programs that work. Yet, for some reason, my …

deep-learning supervised-learning python-3.x implementation

asked by Clement Genninasca Score of 1

Is hyperparameter tuning with different samples of data on each run a bad idea?

I have 2k time series and want to optimize the hyperparameters of my prophet model. It takes 1 hour to train and evaluate on every time series for each hyperparam combination. So, I want to run it on …

hyperparameter-tuning hyperparameter

asked by codeananda Score of 1 answered by wasif Score of 2

Pandas Data with Stacking Models

I am working in a ML project where I would like to predict the final result of a soccer game. There are three output categories: Local Win, Tie, Visitor Win. In order to do so, I am using stacking …

python pandas

asked by Nacho Roncero Alvarez Score of 1 answered by Waschbrettwade Score of 1

Greatest hits from previous weeks:

Perform k-means clustering over multiple columns

I am trying to perform k-means clustering on multiple columns. My data set is composed of 4 numerical columns and 1 categorical column. I already researched previous questions but the answers are not …

python clustering pandas

asked by Lola Score of 12 answered by Simon Larsson Score of 19

How to include labels in sns heatmap

I got this matrix …

python visualization numpy seaborn

asked by Srihari Score of 17 answered by Rudra Mohan Score of 19

StandardScaler before or after splitting data – which is better?

When I was reading about using StandardScaler, most of the recommendations were saying that you should use StandardScaler before …

machine-learning scikit-learn preprocessing

asked by tsumaranaina Score of 47 answered by redhqs Score of 45

Why do people prefer Pandas to SQL?

I’ve been using SQL since 1996, so I may be biased. I’ve used MySQL and SQLite 3 extensively, but have also used Microsoft SQL Server and Oracle. The vast majority of the operations I’ve seen done …

python pandas sql

asked by vy32 Score of 137 answered by cvonsteg Score of 96

Train Accuracy vs Test Accuracy vs Confusion matrix

After I developed my predictive model using Random Forest I get the following metrics: …

python predictive-modeling accuracy confusion-matrix classifier

asked by Pedro Alves Score of 16 answered by S van Balen Score of 25

ValueError: Input contains NaN, infinity or a value too large for dtype('float32')

I got ValueError when predicting test data using a RandomForest model. My code: …

python scikit-learn pandas random-forest python-3.x

asked by Edamame Score of 91 answered by fernando Score of 75

GBM vs XGBOOST? Key differences?

I am trying to understand the key differences between GBM and XGBOOST. I tried to google it, but could not find any good answers explaining the differences between the two algorithms and why xgboost …

machine-learning algorithms xgboost ensemble-modeling gbm

asked by Aman Score of 76 answered by Icyblade Score of 63

Can you answer these questions?

Strange behaviour around zero for predicted distributions from a deep learning regression model

Can somebody help make sense of these very odd distributions that I obtained from my trained deep learning regression model? The model was trained with either MAE or MSE loss, which is what the …

deep-learning regression prediction distribution

asked by Daan Scheepens Score of 1

Open source NLP annotation tool/library supports active learning

I am looking for an NLP annotation tool/library that supports active learning. I am looking for something that works in this scenario: Annotating N samples. Training a model on the annotated data. …

nlp dataset annotation active-learning

asked by Minions Score of 1