You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
According to #1719 in pipeline.eval(), we want to evaluate reader nodes besides the usual pipeline evaluation as if there was a perfect retriever sitting in front of them. Needs to be done:
extend pipeline.eval() to receive a parameter that enables perfect retriever evaluation
extend Reader.run() to receive the parameter enabling perfect retriever evaluation and the labels
implement a second predict pass that operates on perfect documents from the labels
store result of second predict pass in result dict
ensure that second predict result is stored in _debug output
According to #1719 in pipeline.eval(), we want to evaluate reader nodes besides the usual pipeline evaluation as if there was a perfect retriever sitting in front of them. Needs to be done:
The text was updated successfully, but these errors were encountered: