# Questions tagged [evaluation]

Anything related to evaluation of expressions, i.e. the process used to determine the value of expressions in a running program.

**-2**

votes

**0**answers

9 views

### Lift/Gain chart definition

I want to draw a lift chart in Python and I have already drew it.
The question is:
I found many resources online explaining the definition of lift chart.
Most of them define it are all similar in this ...

**0**

votes

**0**answers

26 views

### Force R to evaluate string as column name

I have a script that allows the user to choose a column to process by inputting a column name prefix at the console. The first example below shows a typical operation: counting the number of ...

**2**

votes

**1**answer

29 views

### f-score: ValueError: Classification metrics can't handle a mix of multilabel-indicator and continuous-multioutput targets

I am trying to compute the micro F measure for a prediction my model did. I trained the model using word2vec Vectors with Keras and Tensorflow. I use the scikit library to compute the mirco F measure.
...

**-1**

votes

**0**answers

17 views

### How and Why evaluation for recommender system model works (leave-one-out)

Recommender system papers that were published in recent years come up with an evaluation protocol 'leave-one-out', i.e., the testing set comprises the last item of all users and others ramain for ...

**0**

votes

**0**answers

18 views

### Making a Heatmap plot diagonal

I am using Seaborn heatmap to plot the output of my clustering algorithm for evaluation.
I have the ground truth (target class) and I have the output cluster label from my clustering algorithm.
The ...

**2**

votes

**2**answers

46 views

### Return list of instances from generic method

I need to return a coordinate list of rectangle in generic method. Coordinate is a class 'cart' instance.
I try return it with make-instance
(defclass line ()
((start :initarg :start :accessor ...

**39**

votes

**2**answers

4k views

### Setting extra bits in a bool makes it true and false at the same time

If I get a bool variable and set its second bit to 1, then variable evaluates to true and false at the same time. Compile the following code with gcc6.3 with -g option, (gcc-v6.3.0/Linux/RHEL6.0-2016-...

**1**

vote

**1**answer

36 views

### How to handle evaluation of list of functions in R

I'm trying to figure out how to deal with custom aggregation function which will work with dplyr's evaluation principles. I'd like to create a function of a shape:
custom_aggregation <- function (...

**0**

votes

**0**answers

14 views

### Element-wise evaluation of a function for 3d interpolation in Python

I have a 3D array of data, coming from a microscopy picture, dimensions (16,24,20). I want to interpolate the picture to a finer grid, as you would do in Matlab with
Vq = interp3(X,Y,Z,V,Xq,Yq,Zq)
I ...

**2**

votes

**3**answers

99 views

### How to evaluate a symbolic expression in different ways?

I have a list of symbolic expressions, like below:
import numpy as np
import sympy
s = sympy.Symbol('s')
x = [ s, s+1, 10*s**2, 5]
After adding the elements by using "sum":
y = sum (x)
I will ...

**-3**

votes

**0**answers

17 views

### Classification model evaluation in spark structured streaming

I am new to Spark and spark Structured streaming, I want to Classification model evaluation(for example Accuracy-Precision) in test stream data using query in spark structured streaming, but I dont ...

**0**

votes

**0**answers

23 views

### Evaluation of simultaneous missed days

I collected and evaluated different (public) Protkolle with Python. The absent days of the individual persons are stored in a MySQL database.
Now I would like to do a query:
Which person is often ...

**2**

votes

**2**answers

43 views

### SLIME interactive development - paste code into SLIME REPL != eval commands from buffer

I'm trying to create just a basic package called "a" (to learn) with asdf which I've already defined in package.lisp, and my main file a.lisp starts with:
(in-package :a)
...
If I'm developing my ...

**0**

votes

**0**answers

6 views

### Classifier performance metric choice

I am having a tough time picking the right metric to assess how well my classifier performs.
It is a binary classification problem with imbalanced data (90:10).
It is important to classify both ...

**15**

votes

**2**answers

181 views

### Perl6 search then replace with output of subroutine

I've combed the docs but I can't seem to find how to do this in perl6.
In perl5 I would have done (just an example):
sub func { ... }
$str =~ s/needle/func($1)/e;
i.e. to replace 'needle' with the ...

**0**

votes

**0**answers

14 views

### Tensorflow Custom Estimator: How to get current eval_dir from within the .evaluate() call

I'm using a Custom Estimator for training a NN to predict the MNIST Dataset. I'm currently using a SummarySaverHook to log confusion matrixes to TensorBoard during Evaluation, like this:
eval_hooks = ...

**1**

vote

**1**answer

79 views

### Are these the expected results of tensorflow object-detection evaluation using model_main.py?

Running TensorFlow object detection API training and evaluation on customized dataset with 8 classes, I have two questions regarding the outcomes of running this task using model_main.py
The total ...

**-1**

votes

**2**answers

26 views

### Precision, Recall, F-score requiring equal inputs

I am looking at precision, recall, and f-score using scikit-learn using:
from sklearn.metrics import `precision_score`
Then:
y_true = np.array(["one", "two", "three"])
y_pred = np.array(["one", "...

**0**

votes

**0**answers

8 views

### How to measure the performance of random forest model for a probability prediction?

I am trying to predict the default probabilities of borrowers using random forest. I am unable to find a suitable model performance parameter except AUC.
Is there a method to calculate the ...

**0**

votes

**0**answers

14 views

### Evaluation of Data Set divided into three subsets for prediction

I am working on ML_100k data set for prediction using CF. But i am stuck on Evaluation step (Accuracy, Recall etc). Instead of using whole training set, I am dividing training set into three ...

**0**

votes

**0**answers

16 views

### How can interpret MSE / MAE / MAPE for predicting elements of matrices?

Hi I have following scenario to train the dataset with time-series belong to 3 matrices(R,G,B) which they have correlation and I would like to train the RNN and predict just 2 out of 3 which are (R,G)....

**2**

votes

**4**answers

48 views

### How to evaluate a string input and check if it is a decimal

I use python 3 and am trying to figure out how to evaluate a user input string and check for certain characters.
I know that this title is probably going to make it sound like I haven't heard of the ....

**2**

votes

**3**answers

117 views

### match.call evaluation in a user-defined function with lapply or with in R

I have written a wrapper around ftable because I need to compute flat tables with frequency and percentage for many variables. As ftable method for class "formula" uses non-standard evaluation, this ...

**0**

votes

**0**answers

55 views

### Evaluation of MovieLens 100k dataset

I am working on ML_100k dataset for prediction using CF. But i am stuck on Evaluation step (Accuracy, Recall etc).
Instead of using whole training set, I am using clustering to divide training set ...

**0**

votes

**0**answers

20 views

### Evaluation my CNN stopped with message “OOM when allocating tensor with shape[3,3,256,512]”

I build a CNN with 5 layers, 100 epoch, 32 batch size and trained it with tensorflow-gpu on device with 16gb ram, 4gb nvidia GTX card with 5 cuda compute capability. the training process was done ...

**3**

votes

**1**answer

171 views

### Wrapper for a function relying on non-standard evaluation in R

I have written a wrapper around ftable because I need to compute flat tables with frequency and percentage for many variables:
mytable <- function(...) {
tab <- ftable(...,
...

**2**

votes

**2**answers

103 views

### Haskell Let Expressions Evaluation

I am doing practice problems that evaluate a let expression and I don't understand the output of this one.
Here is the expression:
let a = 2
b = 1:[i * 2 | i <- b]
f a = 1:[i * a | i <-...

**0**

votes

**0**answers

40 views

### How to use both custom eval_metric and a built-in metric in xgboost.XGBClassifier

Hello!
I am trying to combine a list of eval_metrics consisting of a one custom eval function and multiple built-in eval functions.
When i use a list of built-in functions everything works ok:
...

**0**

votes

**0**answers

8 views

### Classifier performance evaluation

I have an unbalanced dataset which has 920 samples in total, 689 belong to the first class, and 222 to second class. and both classes are significant for me. so when building a classifier model such ...

**0**

votes

**2**answers

50 views

### How to control rule evaluation (or rule execution) stages in Drools?

I know that "salience" in Drools provides control under rule execution sequence. But above is an example of the problem when "saliences" cannot help anymore that I've faced with.
Here I have three ...

**2**

votes

**1**answer

64 views

### Evaluating results from search query in python: ranked list vs. one manually labeled correct document

Given the following predicted ranked-list of documents:
query1_predicted = [1381, 1637, 646, 1623, 774, 1764, 92, 12, 642, 463, 613, ...]
and this manually marked best choice:
query1_manual = 646
...

**0**

votes

**0**answers

69 views

### Difference between fine-grained and coarse-grained performance evaluation

What is the difference between fine-grained and coarse-grained performance evaluation?
And what are the advantages of each of them?

**0**

votes

**0**answers

45 views

### Evaluating Association Rules from FP-Growth using Lift

I have association rules that i got from pyfpgrowth package in python3.
[In] AssociationRules = pyfpgrowth.generate_association_rules(FrequentPattern, 0.8)
[In] AssociationRules
[Out]
{('Longitude ...

**-1**

votes

**1**answer

24 views

### JMeter: How to get the coordinates in a JSON path

I have some problems to take the coordinates in my JSON path.
I want to take the id 8352 in the link. I want the id without the stings and comma's. Just like this "8352".
This is my JSONPath Syntax: $...

**-1**

votes

**3**answers

85 views

### How Javascript `reduce` performed on function array achieves function composition?

I came across this pattern in redux compose function. I still don't understand how in the example below the functions are evaluated starting from the last and not from the first:
function f2(a) {
...

**0**

votes

**1**answer

66 views

### Difference between Blue scores and Baseline Bleu score for the model

I created a model using my dataset and got a Bleu score/baseline Bleu score, what is the difference between them?
How is the baseline computed?
This document does not describe the difference.

**0**

votes

**1**answer

43 views

### SystemVerilog always_comb does not re-evaluate if the implied sensitivity list changes

Here's a piece of code with 3 different always statement which should be synthesizable. The issues is with the following:
always_comb
begin
c_cntr1 = cntr1;
c_func_val1 = diff (0, c_cntr1);
...

**0**

votes

**0**answers

96 views

### the difference between “split0_test_score” and “split1_test_score” in cv_results_ of RandomizedSearchCV?

When I tried to look into the scoring in RandomizedSearchCV (should be the same for GridSearchCV), the scoring results are stored in cv_results_ attribute. The train set of scores are pretty ...

**0**

votes

**0**answers

23 views

### How to choose metrics for evaluating classification results?

Recently we have developed a python library named PyCM specialized for analyzing multi-class confusion matrices. A parameter recommender system has been added in version 1.9 of this module in order ...

**0**

votes

**0**answers

10 views

### Unsupervised way to evaluate resolution of generated images

I have trained 3 different GAN models for an image to image translation. To prefer one above the other model I have to evaluate them using some evaluation metric. Based on PSNR performance we can ...

**1**

vote

**1**answer

25 views

### Arithmetically incorrect evaluation and KeyDict errors when evaluating infix expression using stacks;

My program is supposed to evaluate given infix expressions and evaluate them. It is assumed that only the operators in the method calls at the bottom of the code will be used for any given infix ...

**2**

votes

**2**answers

86 views

### .NET IL / MSIL Evaluation Stack fundamentals

Can't seem to find a good answer for these questions.
Here are what I think I know and what I'm fuzzy on.
An Evaluation Stack is a memory buffer like a C style stack (is it a stack of native int / ...

**0**

votes

**1**answer

79 views

### Apache POI Formula Evaluator not computing cell containing formula

I have an excel file that has formulas in some cells and some input fields based on which value is being computed in the Formula Cell.
After setting the values in the respective cells using apache ...

**49**

votes

**2**answers

6k views

### Difference between i++ and (i)++ in C

int i = 3;
int j = (i)++;
vs
int i = 3;
int j = i ++;
Is there a difference between how the above two cases are evaluated?
Is the first case equivalent to incrementing an rvalue or is it ...

**1**

vote

**1**answer

26 views

### Sympy bug? Even with `evaluate=False` equations are automatically processed

Consider the following sympy code:
from sympy import Add
from sympy.abc import x
t1 = 2+2*x
t2 = x
myeq = sp.UnevaluatedExpr(Add(sp.UnevaluatedExpr(t1), sp.UnevaluatedExpr(t2), evaluate=False))
# ...

**0**

votes

**1**answer

36 views

### 2 dimensional List evaluation if than

I generated a 2D-List. It contains filenames in one col and numbers in the second col. I now want to get a new list, containing only the filenames if the number in col 2 was >0.
However I am ...

**0**

votes

**2**answers

41 views

### JavaScript RegExp evaluation

I was looking at some code and found the first line. I started to be confused when I discovered that if I try to make it simpler in such a way that the semantics remain the same, it is not the same ...

**0**

votes

**1**answer

56 views

### CNTK basic operation with c# following python example gives error

at this moment I'm struggling to not desperate just trying to convert this (from https://cntk.ai/pythondocs/gettingstarted.html#overview-and-first-run)
cntk.minus([1, 2, 3], [4, 5, 6]).eval()
which ...

**0**

votes

**0**answers

9 views

### Find Values of a 2D Histogram for some Given Coordinates

In a code, there is this line where it projects the 3d density along a single dimension
hist_valuess, hist_xs, hist_ys = np.histogram2d(
positions[:, dimensions_plot[0]], positions[:, ...

**0**

votes

**0**answers

33 views

### Assigning value and evaluating derivative both numerically and symbolically

I have the following single order differential function:
y' = x^2- y^2
and the initial condition is
y(0) = 1
I am evaluating higher differentials as follows:
y'' = 2 * x - y * y'
y''' = 2 - 2 *...