Newest 'evaluation' Questions - Stack Overflow

Questions tagged [evaluation]

Anything related to evaluation of expressions, i.e. the process used to determine the value of expressions in a running program.

-2
votes
0answers
9 views

Lift/Gain chart definition

I want to draw a lift chart in Python and I have already drew it. The question is: I found many resources online explaining the definition of lift chart. Most of them define it are all similar in this ...
0
votes
0answers
26 views

Force R to evaluate string as column name

I have a script that allows the user to choose a column to process by inputting a column name prefix at the console. The first example below shows a typical operation: counting the number of ...
2
votes
1answer
29 views

f-score: ValueError: Classification metrics can't handle a mix of multilabel-indicator and continuous-multioutput targets

I am trying to compute the micro F measure for a prediction my model did. I trained the model using word2vec Vectors with Keras and Tensorflow. I use the scikit library to compute the mirco F measure. ...
-1
votes
0answers
17 views

How and Why evaluation for recommender system model works (leave-one-out)

Recommender system papers that were published in recent years come up with an evaluation protocol 'leave-one-out', i.e., the testing set comprises the last item of all users and others ramain for ...
0
votes
0answers
18 views

Making a Heatmap plot diagonal

I am using Seaborn heatmap to plot the output of my clustering algorithm for evaluation. I have the ground truth (target class) and I have the output cluster label from my clustering algorithm. The ...
2
votes
2answers
46 views

Return list of instances from generic method

I need to return a coordinate list of rectangle in generic method. Coordinate is a class 'cart' instance. I try return it with make-instance (defclass line () ((start :initarg :start :accessor ...
39
votes
2answers
4k views

Setting extra bits in a bool makes it true and false at the same time

If I get a bool variable and set its second bit to 1, then variable evaluates to true and false at the same time. Compile the following code with gcc6.3 with -g option, (gcc-v6.3.0/Linux/RHEL6.0-2016-...
1
vote
1answer
36 views

How to handle evaluation of list of functions in R

I'm trying to figure out how to deal with custom aggregation function which will work with dplyr's evaluation principles. I'd like to create a function of a shape: custom_aggregation <- function (...
0
votes
0answers
14 views

Element-wise evaluation of a function for 3d interpolation in Python

I have a 3D array of data, coming from a microscopy picture, dimensions (16,24,20). I want to interpolate the picture to a finer grid, as you would do in Matlab with Vq = interp3(X,Y,Z,V,Xq,Yq,Zq) I ...
2
votes
3answers
99 views

How to evaluate a symbolic expression in different ways?

I have a list of symbolic expressions, like below: import numpy as np import sympy s = sympy.Symbol('s') x = [ s, s+1, 10*s**2, 5] After adding the elements by using "sum": y = sum (x) I will ...
-3
votes
0answers
17 views

Classification model evaluation in spark structured streaming

I am new to Spark and spark Structured streaming, I want to Classification model evaluation(for example Accuracy-Precision) in test stream data using query in spark structured streaming, but I dont ...
0
votes
0answers
23 views

Evaluation of simultaneous missed days

I collected and evaluated different (public) Protkolle with Python. The absent days of the individual persons are stored in a MySQL database. Now I would like to do a query: Which person is often ...
2
votes
2answers
43 views

SLIME interactive development - paste code into SLIME REPL != eval commands from buffer

I'm trying to create just a basic package called "a" (to learn) with asdf which I've already defined in package.lisp, and my main file a.lisp starts with: (in-package :a) ... If I'm developing my ...
0
votes
0answers
6 views

Classifier performance metric choice

I am having a tough time picking the right metric to assess how well my classifier performs. It is a binary classification problem with imbalanced data (90:10). It is important to classify both ...
15
votes
2answers
181 views

Perl6 search then replace with output of subroutine

I've combed the docs but I can't seem to find how to do this in perl6. In perl5 I would have done (just an example): sub func { ... } $str =~ s/needle/func($1)/e; i.e. to replace 'needle' with the ...
0
votes
0answers
14 views

Tensorflow Custom Estimator: How to get current eval_dir from within the .evaluate() call

I'm using a Custom Estimator for training a NN to predict the MNIST Dataset. I'm currently using a SummarySaverHook to log confusion matrixes to TensorBoard during Evaluation, like this: eval_hooks = ...
1
vote
1answer
79 views

Are these the expected results of tensorflow object-detection evaluation using model_main.py?

Running TensorFlow object detection API training and evaluation on customized dataset with 8 classes, I have two questions regarding the outcomes of running this task using model_main.py The total ...
-1
votes
2answers
26 views

Precision, Recall, F-score requiring equal inputs

I am looking at precision, recall, and f-score using scikit-learn using: from sklearn.metrics import `precision_score` Then: y_true = np.array(["one", "two", "three"]) y_pred = np.array(["one", "...
0
votes
0answers
8 views

How to measure the performance of random forest model for a probability prediction?

I am trying to predict the default probabilities of borrowers using random forest. I am unable to find a suitable model performance parameter except AUC. Is there a method to calculate the ...
0
votes
0answers
14 views

Evaluation of Data Set divided into three subsets for prediction

I am working on ML_100k data set for prediction using CF. But i am stuck on Evaluation step (Accuracy, Recall etc). Instead of using whole training set, I am dividing training set into three ...
0
votes
0answers
16 views

How can interpret MSE / MAE / MAPE for predicting elements of matrices?

Hi I have following scenario to train the dataset with time-series belong to 3 matrices(R,G,B) which they have correlation and I would like to train the RNN and predict just 2 out of 3 which are (R,G)....
2
votes
4answers
48 views

How to evaluate a string input and check if it is a decimal

I use python 3 and am trying to figure out how to evaluate a user input string and check for certain characters. I know that this title is probably going to make it sound like I haven't heard of the ....
2
votes
3answers
117 views

match.call evaluation in a user-defined function with lapply or with in R

I have written a wrapper around ftable because I need to compute flat tables with frequency and percentage for many variables. As ftable method for class "formula" uses non-standard evaluation, this ...
0
votes
0answers
55 views

Evaluation of MovieLens 100k dataset

I am working on ML_100k dataset for prediction using CF. But i am stuck on Evaluation step (Accuracy, Recall etc). Instead of using whole training set, I am using clustering to divide training set ...
0
votes
0answers
20 views

Evaluation my CNN stopped with message “OOM when allocating tensor with shape[3,3,256,512]”

I build a CNN with 5 layers, 100 epoch, 32 batch size and trained it with tensorflow-gpu on device with 16gb ram, 4gb nvidia GTX card with 5 cuda compute capability. the training process was done ...
3
votes
1answer
171 views

Wrapper for a function relying on non-standard evaluation in R

I have written a wrapper around ftable because I need to compute flat tables with frequency and percentage for many variables: mytable <- function(...) { tab <- ftable(..., ...
2
votes
2answers
103 views

Haskell Let Expressions Evaluation

I am doing practice problems that evaluate a let expression and I don't understand the output of this one. Here is the expression: let a = 2 b = 1:[i * 2 | i <- b] f a = 1:[i * a | i <-...
0
votes
0answers
40 views

How to use both custom eval_metric and a built-in metric in xgboost.XGBClassifier

Hello! I am trying to combine a list of eval_metrics consisting of a one custom eval function and multiple built-in eval functions. When i use a list of built-in functions everything works ok: ...
0
votes
0answers
8 views

Classifier performance evaluation

I have an unbalanced dataset which has 920 samples in total, 689 belong to the first class, and 222 to second class. and both classes are significant for me. so when building a classifier model such ...
0
votes
2answers
50 views

How to control rule evaluation (or rule execution) stages in Drools?

I know that "salience" in Drools provides control under rule execution sequence. But above is an example of the problem when "saliences" cannot help anymore that I've faced with. Here I have three ...
2
votes
1answer
64 views

Evaluating results from search query in python: ranked list vs. one manually labeled correct document

Given the following predicted ranked-list of documents: query1_predicted = [1381, 1637, 646, 1623, 774, 1764, 92, 12, 642, 463, 613, ...] and this manually marked best choice: query1_manual = 646 ...
0
votes
0answers
69 views

Difference between fine-grained and coarse-grained performance evaluation

What is the difference between fine-grained and coarse-grained performance evaluation? And what are the advantages of each of them?
0
votes
0answers
45 views

Evaluating Association Rules from FP-Growth using Lift

I have association rules that i got from pyfpgrowth package in python3. [In] AssociationRules = pyfpgrowth.generate_association_rules(FrequentPattern, 0.8) [In] AssociationRules [Out] {('Longitude ...
-1
votes
1answer
24 views

JMeter: How to get the coordinates in a JSON path

I have some problems to take the coordinates in my JSON path. I want to take the id 8352 in the link. I want the id without the stings and comma's. Just like this "8352". This is my JSONPath Syntax: $...
-1
votes
3answers
85 views

How Javascript `reduce` performed on function array achieves function composition?

I came across this pattern in redux compose function. I still don't understand how in the example below the functions are evaluated starting from the last and not from the first: function f2(a) { ...
0
votes
1answer
66 views

Difference between Blue scores and Baseline Bleu score for the model

I created a model using my dataset and got a Bleu score/baseline Bleu score, what is the difference between them? How is the baseline computed? This document does not describe the difference.
0
votes
1answer
43 views

SystemVerilog always_comb does not re-evaluate if the implied sensitivity list changes

Here's a piece of code with 3 different always statement which should be synthesizable. The issues is with the following: always_comb begin c_cntr1 = cntr1; c_func_val1 = diff (0, c_cntr1); ...
0
votes
0answers
96 views

the difference between “split0_test_score” and “split1_test_score” in cv_results_ of RandomizedSearchCV?

When I tried to look into the scoring in RandomizedSearchCV (should be the same for GridSearchCV), the scoring results are stored in cv_results_ attribute. The train set of scores are pretty ...
0
votes
0answers
23 views

How to choose metrics for evaluating classification results?

Recently we have developed a python library named PyCM specialized for analyzing multi-class confusion matrices. A parameter recommender system has been added in version 1.9 of this module in order ...
0
votes
0answers
10 views

Unsupervised way to evaluate resolution of generated images

I have trained 3 different GAN models for an image to image translation. To prefer one above the other model I have to evaluate them using some evaluation metric. Based on PSNR performance we can ...
1
vote
1answer
25 views

Arithmetically incorrect evaluation and KeyDict errors when evaluating infix expression using stacks;

My program is supposed to evaluate given infix expressions and evaluate them. It is assumed that only the operators in the method calls at the bottom of the code will be used for any given infix ...
2
votes
2answers
86 views

.NET IL / MSIL Evaluation Stack fundamentals

Can't seem to find a good answer for these questions. Here are what I think I know and what I'm fuzzy on. An Evaluation Stack is a memory buffer like a C style stack (is it a stack of native int / ...
0
votes
1answer
79 views

Apache POI Formula Evaluator not computing cell containing formula

I have an excel file that has formulas in some cells and some input fields based on which value is being computed in the Formula Cell. After setting the values in the respective cells using apache ...
49
votes
2answers
6k views

Difference between i++ and (i)++ in C

int i = 3; int j = (i)++; vs int i = 3; int j = i ++; Is there a difference between how the above two cases are evaluated? Is the first case equivalent to incrementing an rvalue or is it ...
1
vote
1answer
26 views

Sympy bug? Even with `evaluate=False` equations are automatically processed

Consider the following sympy code: from sympy import Add from sympy.abc import x t1 = 2+2*x t2 = x myeq = sp.UnevaluatedExpr(Add(sp.UnevaluatedExpr(t1), sp.UnevaluatedExpr(t2), evaluate=False)) # ...
0
votes
1answer
36 views

2 dimensional List evaluation if than

I generated a 2D-List. It contains filenames in one col and numbers in the second col. I now want to get a new list, containing only the filenames if the number in col 2 was >0. However I am ...
0
votes
2answers
41 views

JavaScript RegExp evaluation

I was looking at some code and found the first line. I started to be confused when I discovered that if I try to make it simpler in such a way that the semantics remain the same, it is not the same ...
0
votes
1answer
56 views

CNTK basic operation with c# following python example gives error

at this moment I'm struggling to not desperate just trying to convert this (from https://cntk.ai/pythondocs/gettingstarted.html#overview-and-first-run) cntk.minus([1, 2, 3], [4, 5, 6]).eval() which ...
0
votes
0answers
9 views

Find Values of a 2D Histogram for some Given Coordinates

In a code, there is this line where it projects the 3d density along a single dimension hist_valuess, hist_xs, hist_ys = np.histogram2d( positions[:, dimensions_plot[0]], positions[:, ...
0
votes
0answers
33 views

Assigning value and evaluating derivative both numerically and symbolically

I have the following single order differential function: y' = x^2- y^2 and the initial condition is y(0) = 1 I am evaluating higher differentials as follows: y'' = 2 * x - y * y' y''' = 2 - 2 *...