Data Science Stack Exchange Community Digest

Top new questions this week:

Logistic Regression Modeling & Interpretation

I’m building a logistic regression model to predict the credit risk of lending company customers. I’m using dataset from kaggle : www.kaggle.com/datasets/ranadeep/credit-risk-dataset/code …

machine-learning python classification feature-selection logistic-regression

asked by Jovian Aditya Score of 6 answered by Quan Nguyen Score of 6

Dynamic clustering in NLP dataset

Let’s imagine this list: corpus = [‘cat’,’banana’,’dog’,’horse’,’apple’,’tiger’,’snake’] I am looking for a way to build a vectorizer with dynamic clustering. I’m …

machine-learning nlp clustering

asked by Jordan Carré Score of 4 answered by Brian Spiering Score of 6

Out of range [0,1] MinMaxScaler for test data

I know that for MinMaxScaler we should apply it to train data, then apply it, with the obtained parameters, over test data: …

machine-learning preprocessing normalization

asked by John mx Score of 3 answered by Andrew Score of 6

Solving video classification problem by taking EVA Large as backbone

I am solving a video classification problem. There are 9 classes in total. At first I took ResNet as a feature extractor, this gave me 0.74 accuracy. Then I changed ResNet to EVA (I also tried Swin), …

classification cnn pytorch computer-vision transformer

asked by Nikto Score of 3 answered by Brian Spiering Score of 1

Are there deterministic problems a neural network can't learn?

I have a software which takes 5 input numbers and outputs a number, deterministically. I want to try and mimic this software precisely with a neural network, but I am finding it very difficult. The …

machine-learning neural-network mathematics

asked by quail Score of 2 answered by Nemo_the_scientist Score of 0

How to implement linear regression

I am having difficulty achieving the same result as in sklearn while implementing linear regression model from scratch. After adjusting the learning rate, I obtained an AUC of 0.694 for this binary …

predictive-modeling machine-learning-model linear-regression loss-function implementation

asked by Kyv Score of 2 answered by Vic Score of 1

Why is accuracy not a useful measure for information retrieval problems?

I have been studying about information retrieval and recommender systems. While reading about it I found that accuracy not a useful measure in information retrieval. I understand that, accuracy might …

recommender-system evaluation metric information-retrieval model-evaluations

asked by ilved17 Score of 2 answered by Vic Score of 1

Greatest hits from previous weeks:

How to fill missing value based on other columns in Pandas dataframe?

Suppose I have a 5*3 data frame in which third column contains missing value 1 2 3 4 5 NaN 7 8 9 3 2 NaN 5 6 NaN I hope to generate value for missing value based …

pandas

asked by KyL Score of 29 answered by Icyblade Score of 32

Sklearn ValueError: X has 2 features per sample; expecting 11

I try to visualizing multiple logistic regression but I get the above error. I’m practicing on red wine quality data set from kaggle. Here is a full traceback: …

python scikit-learn

asked by tbone Score of 4 answered by Ajay Thakur Score of 0

What is the difference between model hyperparameters and model parameters?

I have noticed that such terms as model hyperparameter and model parameter have been used interchangeably on the web without prior clarification. I think this is incorrect and needs explanation. …

machine-learning parameter hyperparameter language-model

asked by minerals Score of 49 answered by enterML Score of 36

What is weight and bias in deep learning?

I’m starting to learn Machine learning from Tensorflow website. I have developed a very very rudimentary understanding of the flow a deep learning program follows (this method makes me learn fast …

machine-learning deep-learning tensorflow

asked by Umer Farooq Score of 28 answered by Declan Score of 22

Mapping column values of one DataFrame to another DataFrame using a key with different header names

I have two data frames df1 and df2 which look something like this. …

python pandas dataframe

asked by Danny Score of 10 answered by Stephen Witkowski Score of 8

How to plot two columns of single DataFrame on Y axis

I have two data frames (Action, Comedy). Action contains two columns (year, rating) ratings columns contains average rating with respect to year. The Comedy data frame contains the same two columns …

python pandas visualization dataframe

asked by Bilal Butt Score of 17 answered by user2333453 Score of 19

The cross-entropy error function in neural networks

In the MNIST For ML Beginners they define cross-entropy as $$H_{y’} (y) := – \sum_{i} y_{i}’ \log (y_i)$$ $y_i$ is the predicted probability value for class $i$ and $y_i’$ is the true probability …

machine-learning tensorflow

asked by Martin Thoma Score of 149 answered by KT. Score of 125

Can you answer these questions?

Adding punctuation for a long text

I want to add punctuation to a long text (youtube transcript) before using a Transformer pipeline for summarization. I have found this answer here: original answer thus I have tried: …

python deep-learning nlp transformer

asked by Salvo R Score of 1

How do I build a multi-input and multi-output neural network?

I want to build a neural network classifier which has as inputs array of dimension (24, 2, 20001) and as outputs array of dimension …

machine-learning python deep-learning tensorflow multi-output

asked by HelpNeederStudent Score of 1

How to vectorize and speed-up double for-loop for pandas dataframe when doing text similarity scoring

I have the following dataframe: …

python pandas similarity fuzzy-classification

asked by illuminato Score of 1 answered by Brian Spiering Score of 0