Data Science Stack Exchange Community Digest

Top new questions this week:

is there a deep learning model that handle 47800+ classes for classification?

I am trying to build a text classifier with 47893 classes and 1.3 billion (1,302,687,947) data samples. What would be the best classifier to build with such kind of data? Each data label will contain …

python deep-learning machine-learning-model

asked by Raady Score of 2 answered by noe Score of 5

How to present a statistical justification for the choice of models with approximate accuracies?

In an experiment involving the comparison of classification algorithms, how can I assess whether there are statistically significant differences between the analyzed models? For example, the following …

machine-learning python classification hypothesis-testing model-evaluations

asked by Paulo Sergio Moreira Score of 2 answered by Eduard Score of 1

Learning from Label Proportions – Simple implementation

I’m trying to recreate this paper with code but without image data. My data is about users. I expected a simpler SKLearn type of usage but it is not. Can someone please provide a simpler example …

multiclass-classification supervised-learning

asked by SamTheGoodOne Score of 1 answered by Brian Spiering Score of 0

In a finite horizon reinforcement learning problem, are the $Q$ and value functions dependent on time?

Typically the definition I see for the $Q$ and value functions is $$ Q^\pi(s_t, a_t) = \mathbb{E}_\tau\left[\sum_{t’=t}^T\gamma^{t’-t}r(s_{t’}, a_{t’})\ |\ s_t, a_t\right] \\ V^\pi(s_t) = \mathbb{E}_\…

reinforcement-learning q-learning

asked by user3002473 Score of 1 answered by Kostya Score of 1

The ideal function in R for fit fitting n LASSO Regressions on n data sets

As part of a statistical learning research paper I am collaborating on, I am running/fitting two hundred sixty thousand different LASSO Regressions on the same number of different randomly generated …

machine-learning r linear-regression research lasso

asked by Marlen Score of 1 answered by Brian Spiering Score of 1

Having problems replicating the results of a series of N LASSOs fit to N datasets in R

I have fit n LASSO Regressions on n different data sets (the ‘datasets’ object is an R list of length n where each element is a data.table which is a light and fast data frame from the data.table …

r feature-selection lasso replication reproducibility

asked by Spencer Score of 1

Will ML frameworks work with integrated graphics card in laptop?

I’m CS student. I’m just getting started in data science and machine learning. Can i use laptops with integrated graphics card in the data science and machine learning projects? Will pytorch and …

machine-learning tensorflow pytorch

asked by Alar Score of 1 answered by Noether Score of 1

Greatest hits from previous weeks:

What is the use of torch.no_grad in pytorch?

I am new to pytorch and started with this github code. I do not understand the comment in line 60-61 in the code …

python pytorch

asked by mausamsion Score of 66 answered by Adrien D Score of 55

Convert a list of lists into a Pandas Dataframe

I am trying to convert a list of lists which looks like the following into a Pandas Dataframe …

pandas

asked by Aravind Veluchamy Score of 75 answered by Emre Score of 88

What is weight and bias in deep learning?

I’m starting to learn Machine learning from Tensorflow website. I have developed a very very rudimentary understanding of the flow a deep learning program follows (this method makes me learn fast …

machine-learning deep-learning tensorflow

asked by Umer Farooq Score of 28 answered by Declan Score of 22

SVM using scikit learn runs endlessly and never completes execution

I am trying to run SVR using scikit-learn (python) on a training dataset that has 595605 rows and 5 columns (features) while the test dataset has 397070 rows. The data has been pre-processed and …

python svm scikit-learn

asked by tejaskhot Score of 114 answered by Jessica Collins Score of 98

ValueError: Failed to convert a NumPy array to a Tensor (Unsupported object type int) in Python

I have written the following code for a neural network to perform regression on a dataset, but I am getting a ValueError. I have looked up to different answers and …

python neural-network keras pandas numpy

asked by Ishan Dutta Score of 5 answered by Kangkan Paul Score of 2

How to get accuracy, F1, precision and recall, for a keras model?

I want to compute the precision, recall and F1-score for my binary KerasClassifier model, but don’t find any solution. Here’s my actual code: …

machine-learning neural-network deep-learning classification keras

asked by ZelelB Score of 60 answered by Tasos Score of 61

The cross-entropy error function in neural networks

In the MNIST For ML Beginners they define cross-entropy as $$H_{y’} (y) := – \sum_{i} y_{i}’ \log (y_i)$$ $y_i$ is the predicted probability value for class $i$ and $y_i’$ is the true probability …

machine-learning tensorflow

asked by Martin Thoma Score of 149 answered by KT. Score of 125

Can you answer these questions?

Is there any differences between using text-davinci-003 with the Azure API vs. with the OpenAI API?

I wonder whether there are any differences between using text-davinci-003 with the Azure API vs. with the OpenAI API.

nlp language-model azure-ml openai-gpt api

asked by Franck Dernoncourt Score of 1

Reproducibility issue between GPU graphic cards for DNN Tensorflow models

I am facing reproducibility issues on my DNN (Tensorflow, Keras) models when using different GPU cards. For example, when I use two a100 cards, I would be able to reproduce my results. If I use one …

deep-learning keras tensorflow gpu reproducibility

asked by Sung Joon Won Score of 1