Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fetch_archive_from_http: Permission Denied on Windows #709

Closed
Victor7095 opened this issue Jan 5, 2021 · 12 comments · Fixed by #729
Closed

fetch_archive_from_http: Permission Denied on Windows #709

Victor7095 opened this issue Jan 5, 2021 · 12 comments · Fixed by #729
Assignees
@julian-risch
Labels
type:bug Something isn't working
Milestone
#7

Comments

@Victor7095
Copy link

Describe the bug
It throws a Permission Denied error after downloading zip file from provided url and tries to write it on temp directory.

Error message

  File "c:\Users\victo\UEA\PAIC\deepset-ai-haystack\abc.py", line 19, in <module>
    zip_archive = zipfile.ZipFile(temp_file.name, mode="w")
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\zipfile.py", line 1251, in __init__
    self.fp = io.open(file, filemode)
PermissionError: [Errno 13] Permission denied: 'C:\\Users\\victo\\AppData\\Local\\Temp\\tmpck_925zs'

Expected behavior
Download the file and unzip it correctly

Additional context
Following official guide

Dependencies

alembic==1.4.3
aniso8601==8.1.0
appdirs==1.4.4
astroid==2.4.2
attrs==20.3.0
autopep8==1.5.4
boto3==1.16.48
botocore==1.19.48
certifi==2020.12.5
chardet==4.0.0
click==7.1.2
cloudpickle==1.6.0
colorama==0.4.4
coverage==5.3.1
databricks-cli==0.14.1
decorator==4.4.2
dill==0.3.3
distlib==0.3.1
docker==4.4.1
dotmap==1.3.0
elastic-apm==5.10.0
elasticsearch==7.10.0
entrypoints==0.3
farm==0.5.0
farm-haystack==0.6.0
fastapi==0.63.0
filelock==3.0.12
Flask==1.1.2
Flask-Cors==3.0.9
flask-restplus==0.13.0
future==0.18.2
gitdb==4.0.5
GitPython==3.1.11
gunicorn==20.0.4
h11==0.12.0
h5py==3.1.0
httptools==0.1.1
idna==2.10
isort==5.7.0
itsdangerous==1.1.0
Jinja2==2.11.2
jmespath==0.10.0
joblib==1.0.0
jsonschema==3.2.0
Keras==2.4.3
langdetect==1.0.8
lazy-object-proxy==1.4.3
lxml==4.6.2
Mako==1.1.3
MarkupSafe==1.1.1
mccabe==0.6.1
mlflow==1.0.0
more-itertools==8.6.0
networkx==2.5
nltk==3.5
numpy==1.19.3
packaging==20.8
pandas==1.2.0
pluggy==0.13.1
protobuf==3.14.0
psutil==5.8.0
py==1.10.0
pycodestyle==2.6.0
pydantic==1.7.3
pylint==2.6.0
pyparsing==2.4.7
pyrsistent==0.17.3
python-dateutil==2.8.1
python-docx==0.8.10
python-editor==1.0.4
python-multipart==0.0.5
pytz==2020.5
pywin32==227
PyYAML==5.3.1
querystring-parser==1.2.4
regex==2020.11.13
requests==2.25.1
s3transfer==0.3.3
sacremoses==0.0.43
scikit-learn==0.24.0
scipy==1.6.0
sentencepiece==0.1.94
seqeval==0.0.12
simplejson==3.17.2
six==1.15.0
sklearn==0.0
smmap==3.0.4
SQLAlchemy==1.3.22
SQLAlchemy-Utils==0.36.8
sqlparse==0.4.1
starlette==0.13.6
tabulate==0.8.7
threadpoolctl==2.1.0
tika==1.24
tokenizers==0.8.1rc2
toml==0.10.2
torch==1.6.0+cu101
tox==3.20.1
tqdm==4.55.1
transformers==3.3.1
urllib3==1.26.2
uvicorn==0.13.3
virtualenv==20.2.2
websocket-client==0.57.0
Werkzeug==0.16.1
wrapt==1.12.1

To Reproduce

from haystack.retriever.sparse import ElasticsearchRetriever
from haystack.document_store.elasticsearch import ElasticsearchDocumentStore
from haystack import Finder
from haystack.preprocessor.cleaning import clean_wiki_text
from haystack.preprocessor.utils import convert_files_to_dicts, fetch_archive_from_http
from haystack.reader.farm import FARMReader
from haystack.reader.transformers import TransformersReader
from haystack.utils import print_answers

import os
import time
from subprocess import Popen, PIPE, STDOUT

# In Colab / No Docker environments: Start Elasticsearch from source
es_server = Popen(['./elasticsearch-7.10.1/bin/elasticsearch.bat'],
                  stdout=PIPE, stderr=STDOUT,
                  )

# wait until ES has started
time.sleep(0)

# Connect to Elasticsearch
document_store = ElasticsearchDocumentStore(
    host="localhost", username="", password="", index="document")

# Let's first fetch some documents that we want to query
# Here: 517 Wikipedia articles for Game of Thrones
doc_dir = "./data/article_txt_got"
s3_url = "https://s3.eu-central-1.amazonaws.com/deepset.ai-farm-qa/datasets/documents/wiki_gameofthrones_txt.zip"
fetch_archive_from_http(url=s3_url, output_dir=doc_dir)

System:

  • OS: WIndows 10 - Version 20H2
  • GPU/CPU: CPU: AMD Ryzen 7 3750H with Radeon Vega Mobile Gfx / GPU: Geforce GTX 1660 Ti
  • Haystack version (commit or version number): 0.6.0
  • DocumentStore: Elasticsearch
  • Reader: TransformersReader
  • Retriever: ElasticsearchRetriever
@Victor7095 Victor7095 added the type:bug Something isn't working label Jan 5, 2021
@tholor tholor added this to the #7 milestone Jan 6, 2021
@lalitpagaria
Copy link
Contributor

lalitpagaria commented Jan 6, 2021 •
edited
Loading

@tholor how about having MacOS, Linux and Windows CI pipelines?
Not sure about other's but azure provides free pipelines for public projects /~https://github.com/marketplace/azure-pipelines

I created issue #714 to handle CI related improvements.

@lalitpagaria
Copy link
Contributor

@Victor7095 Regarding your issue can I see that you are using write mode zip_archive = zipfile.ZipFile(temp_file.name, mode="w"). But latest haystack code not passing any file mode (/~https://github.com/deepset-ai/haystack/blob/master/haystack/preprocessor/utils.py#L263) and it that case zipfile util use read mode by default (/~https://github.com/python/cpython/blob/master/Lib/zipfile.py#L1207).

It seems your python process do not have required permission.

Can you please pull latest code and try again or run code with admin privilege if possible.

@Victor7095
Copy link
Author

I tried opening VS Code as well WIndows Terminal as admin it still gives the Permission Denied error when running the code. I was passing write mode while trying to figure out the problem, I removed it but didn't change nothing.

I also created a fresh new python enviroment and tried to install lastest code by following the tutorial command pip install git+/~https://github.com/deepset-ai/haystack.git and it gives the following error:

Collecting git+/~https://github.com/deepset-ai/haystack.git
  Cloning /~https://github.com/deepset-ai/haystack.git to c:\users\victo\appdata\local\temp\pip-req-build-133qctrw
Collecting farm==0.5.0
  Using cached farm-0.5.0-py3-none-any.whl (207 kB)
Requirement already satisfied: setuptools in c:\users\victo\uea\paic\test\myenv\lib\site-packages (from farm==0.5.0->farm-haystack==0.6.0) (49.2.1)
INFO: pip is looking at multiple versions of <Python from Requires-Python> to determine which version is compatible with other requirements. This could take a while.
INFO: pip is looking at multiple versions of farm-haystack to determine which version is compatible with other requirements. This could 
take a while.
ERROR: Could not find a version that satisfies the requirement torch<1.7,>1.5 (from farm)
ERROR: No matching distribution found for torch<1.7,>1.5

On the previous code I sucessfully installed haystack with pip install farm-haystack -f https://download.pytorch.org/whl/torch_stable.html

@lalitpagaria
Copy link
Contributor

lalitpagaria commented Jan 6, 2021 •
edited
Loading

Not sure but to me it's looks like permission issue.

Can you try please following snippet (directly downloading without tempfile and extracting) as suggested here https://stackoverflow.com/questions/9419162/download-returned-zip-file-from-url -

import requests, zipfile, io
r = requests.get(zip_file_url)
z = zipfile.ZipFile(io.BytesIO(r.content))
z.extractall("/path/to/destination_directory")

@tholor
Copy link
Member

tholor commented Jan 7, 2021

I also created a fresh new python enviroment and tried to install lastest code by following the tutorial command pip install git+/~https://github.com/deepset-ai/haystack.git and it gives the following error[...]
On the previous code I sucessfully installed haystack with pip install farm-haystack -f https://download.pytorch.org/whl/torch_stable.html

Yes, this is an annoying torch-specific thing on Windows: you need to add the -f https://download.pytorch.org/whl/torch_stable.html to your pip command (see https://pytorch.org/get-started/locally/)

@Victor7095
Copy link
Author

Not sure but to me it's looks like permission issue.

Can you try please following snippet (directly downloading without tempfile and extracting) as suggested here https://stackoverflow.com/questions/9419162/download-returned-zip-file-from-url -

import requests, zipfile, io
r = requests.get(zip_file_url)
z = zipfile.ZipFile(io.BytesIO(r.content))
z.extractall("/path/to/destination_directory")

The problem when fetching the file was resolved with this code 👍

But I'm having another problem. I'm going to explain now but it might be better to create antoher issue for that.

  1. I created a new enviroment and installed haystack with pip install git+/~https://github.com/deepset-ai/haystack.git -f https://download.pytorch.org/whl/torch_stable.html

  2. Downloaded elasticsearch zip file for windows and extracted it in the same project folder

  3. The code I ran (almost the same from the tutorial):

from haystack.retriever.sparse import ElasticsearchRetriever
from haystack.document_store.elasticsearch import ElasticsearchDocumentStore
from haystack import Finder
from haystack.preprocessor.cleaning import clean_wiki_text
from haystack.preprocessor.utils import convert_files_to_dicts, fetch_archive_from_http
from haystack.reader.farm import FARMReader
from haystack.reader.transformers import TransformersReader
from haystack.utils import print_answers

import os
import time
from subprocess import Popen, PIPE, STDOUT

import requests
import zipfile
import io

# In Colab / No Docker environments: Start Elasticsearch from source
es_server = Popen([os.path.join(os.path.dirname(__file__),
                                'elasticsearch-7.10.1/bin/elasticsearch.bat')], shell=True)

# es_server = Popen(['elasticsearch-7.10.1/bin/elasticsearch.bat'],
#                   stdout=PIPE, stderr=STDOUT,
#                   )

# wait until ES has started
time.sleep(30)

# Connect to Elasticsearch
document_store = ElasticsearchDocumentStore(
    host="localhost", username="", password="", index="document")

# Let's first fetch some documents that we want to query
# Here: 517 Wikipedia articles for Game of Thrones
doc_dir = "./data/article_txt_got"
s3_url = "https://s3.eu-central-1.amazonaws.com/deepset.ai-farm-qa/datasets/documents/wiki_gameofthrones_txt.zip"
# fetch_archive_from_http(url=s3_url, output_dir=doc_dir)

r = requests.get(s3_url)
z = zipfile.ZipFile(io.BytesIO(r.content))
z.extractall(doc_dir)


# Convert files to dicts
# You can optionally supply a cleaning function that is applied to each doc (e.g. to remove footers)
# It must take a str as input, and return a str.
dicts = convert_files_to_dicts(
    dir_path=doc_dir, clean_func=clean_wiki_text, split_paragraphs=True)

# We now have a list of dictionaries that we can write to our document store.
# If your texts come from a different source (e.g. a DB), you can of course skip convert_files_to_dicts() and create the dictionaries yourself.
# The default format here is:
# {
#    'text': "<DOCUMENT_TEXT_HERE>",
#    'meta': {'name': "<DOCUMENT_NAME_HERE>", ...}
# }
# (Optionally: you can also add more key-value-pairs here, that will be indexed as fields in Elasticsearch and
# can be accessed later for filtering or shown in the responses of the Finder)


# Let's have a look at the first 3 entries:
print(dicts[:3])


# Now, let's write the dicts containing documents to our DB.
document_store.write_documents(dicts)

retriever = ElasticsearchRetriever(document_store=document_store)


# Load a  local model or any of the QA models on
# Hugging Face's model hub (https://huggingface.co/models)
reader = TransformersReader(
    model_name_or_path="deepset/roberta-base-squad2", use_gpu=-1)

# The Finder sticks together reader and retriever in a pipeline to answer our actual questions.
finder = Finder(reader, retriever)

questions = ["Who is the father of Arya Stark?",
             "Who created the Dothraki vocabulary?", "Who is the sister of Sansa?"]

# You can configure how many candidates the reader and retriever shall return
# The higher top_k_retriever, the better (but also the slower) your answers.
prediction = finder.get_answers(
    question="Who is the father of Arya Stark?", top_k_retriever=10, top_k_reader=5)
print_answers(prediction, details="minimal")

I also tried running elasticsearch in another terminal instead of starting it in python, but the error is the same:

python -u "c:\Users\victo\UEA\PAIC\test\main.py"
Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2021-01-07T11:49:20,853][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] version[7.10.1], pid[23056], build[default/zip/1c34507e66d7db1211f66f3513706fdf548736aa/2020-12-05T01:00:33.671820Z], OS[Windows 10/10.0/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/12.0.2/12.0.2+10]
[2021-01-07T11:49:20,859][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] JVM home [C:\Program Files\Java\jdk-12.0.2], using bundled JDK [false]
[2021-01-07T11:49:20,859][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, 
-Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=C:\Users\victo\AppData\Local\Temp\elasticsearch, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=536870912, -Delasticsearch, -Des.path.home=c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1, -Des.path.conf=c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1\config, -Des.distribution.flavor=default, -Des.distribution.type=zip, -Des.bundled_jdk=true]
[2021-01-07T11:49:24,766][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [aggs-matrix-stats]
[2021-01-07T11:49:24,766][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [analysis-common] 
[2021-01-07T11:49:24,767][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [constant-keyword]
[2021-01-07T11:49:24,767][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [flattened]       
[2021-01-07T11:49:24,768][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [frozen-indices]  
[2021-01-07T11:49:24,768][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [ingest-common]   
[2021-01-07T11:49:24,770][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [ingest-geoip]
[2021-01-07T11:49:24,775][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [ingest-user-agent]
[2021-01-07T11:49:24,776][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [kibana]
[2021-01-07T11:49:24,777][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [lang-expression]
[2021-01-07T11:49:24,778][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [lang-mustache]
[2021-01-07T11:49:24,779][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [lang-painless]
[2021-01-07T11:49:24,780][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [mapper-extras]
[2021-01-07T11:49:24,809][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [mapper-version]
[2021-01-07T11:49:24,810][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [parent-join]
[2021-01-07T11:49:24,811][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [percolator]
[2021-01-07T11:49:24,812][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [rank-eval]
[2021-01-07T11:49:24,815][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [reindex]
[2021-01-07T11:49:24,839][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [repositories-metering-api]
[2021-01-07T11:49:24,840][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [repository-url]
[2021-01-07T11:49:24,841][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [search-business-rules]
[2021-01-07T11:49:24,842][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [searchable-snapshots]
[2021-01-07T11:49:24,843][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [spatial]
[2021-01-07T11:49:24,844][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [transform]
[2021-01-07T11:49:24,845][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [transport-netty4]
[2021-01-07T11:49:24,846][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [unsigned-long]
[2021-01-07T11:49:24,847][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [vectors]
[2021-01-07T11:49:24,869][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [wildcard]
[2021-01-07T11:49:24,870][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-analytics]
[2021-01-07T11:49:24,871][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-async]
[2021-01-07T11:49:24,872][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-async-search]
[2021-01-07T11:49:24,893][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-autoscaling]
[2021-01-07T11:49:24,894][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-ccr]
[2021-01-07T11:49:24,895][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-core]
[2021-01-07T11:49:24,896][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-data-streams]
[2021-01-07T11:49:24,897][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-deprecation]
[2021-01-07T11:49:24,918][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-enrich]
[2021-01-07T11:49:24,919][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-eql]
[2021-01-07T11:49:24,920][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-graph]
[2021-01-07T11:49:24,921][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-identity-provider]
[2021-01-07T11:49:24,944][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-ilm]
[2021-01-07T11:49:24,945][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-logstash]
[2021-01-07T11:49:24,946][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-ml]
[2021-01-07T11:49:24,947][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-monitoring]
[2021-01-07T11:49:24,968][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-ql]
[2021-01-07T11:49:24,969][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-rollup]
[2021-01-07T11:49:24,969][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-security]
[2021-01-07T11:49:24,970][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-sql]
[2021-01-07T11:49:24,971][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-stack]
[2021-01-07T11:49:24,972][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-voting-only-node]
[2021-01-07T11:49:25,013][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-watcher]
[2021-01-07T11:49:25,017][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] no plugins loaded
[2021-01-07T11:49:25,470][INFO ][o.e.e.NodeEnvironment    ] [LAPTOP-5F69A7LA] using [1] data paths, mounts [[OS (c:)]], net usable_space [182.3gb], net total_space [475.3gb], types [NTFS]
[2021-01-07T11:49:25,471][INFO ][o.e.e.NodeEnvironment    ] [LAPTOP-5F69A7LA] heap size [989.8mb], compressed ordinary object pointers [true]
[2021-01-07T11:49:25,608][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] node name [LAPTOP-5F69A7LA], node ID [Mj_S-Uy9T1W9zz6G2Yi2ig], cluster name [elasticsearch], roles [transform, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]
[2021-01-07T11:49:30,228][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [LAPTOP-5F69A7LA] [controller/12980] [Main.cc@114] controller (64 bit): Version 7.10.1 (Build 11e1ac84105757) Copyright (c) 2020 Elasticsearch BV
[2021-01-07T11:49:30,917][INFO ][o.e.x.s.a.s.FileRolesStore] [LAPTOP-5F69A7LA] parsed [0] roles from file [c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1\config\roles.yml]
[2021-01-07T11:49:32,277][INFO ][o.e.t.NettyAllocator     ] [LAPTOP-5F69A7LA] creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=false, g1gc_region_size=0b, heap_size=989.8mb}]
[2021-01-07T11:49:32,363][INFO ][o.e.d.DiscoveryModule    ] [LAPTOP-5F69A7LA] using discovery type [zen] and seed hosts providers [settings]
[2021-01-07T11:49:32,919][WARN ][o.e.g.DanglingIndicesState] [LAPTOP-5F69A7LA] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2021-01-07T11:49:33,471][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] initialized
[2021-01-07T11:49:33,472][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] starting ...
[2021-01-07T11:49:34,340][INFO ][o.e.t.TransportService   ] [LAPTOP-5F69A7LA] publish_address {127.0.0.1:9300}, bound_addresses {127.0.0.1:9300}, {[::1]:9300}
[2021-01-07T11:49:34,673][WARN ][o.e.b.BootstrapChecks    ] [LAPTOP-5F69A7LA] the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured
[2021-01-07T11:49:34,675][INFO ][o.e.c.c.Coordinator      ] [LAPTOP-5F69A7LA] cluster UUID [S7iHvyvFT3mvCfYWbtl6NQ]
[2021-01-07T11:49:34,712][INFO ][o.e.c.c.ClusterBootstrapService] [LAPTOP-5F69A7LA] no discovery configuration found, will perform best-effort cluster bootstrapping after [3s] unless existing master is discovered
[2021-01-07T11:49:34,855][INFO ][o.e.c.s.MasterService    ] [LAPTOP-5F69A7LA] elected-as-master ([1] nodes joined)[{LAPTOP-5F69A7LA}{Mj_S-Uy9T1W9zz6G2Yi2ig}{mzubvN0GSwyFkrH_NtXbXg}{127.0.0.1}{127.0.0.1:9300}{cdhilmrstw}{ml.machine_memory=16844222464, xpack.installed=true, transform.node=true, ml.max_open_jobs=20} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 15, version: 112, delta: master node changed {previous [], current [{LAPTOP-5F69A7LA}{Mj_S-Uy9T1W9zz6G2Yi2ig}{mzubvN0GSwyFkrH_NtXbXg}{127.0.0.1}{127.0.0.1:9300}{cdhilmrstw}{ml.machine_memory=16844222464, xpack.installed=true, transform.node=true, ml.max_open_jobs=20}]}  
[2021-01-07T11:49:35,010][INFO ][o.e.c.s.ClusterApplierService] [LAPTOP-5F69A7LA] master node changed {previous [], current [{LAPTOP-5F69A7LA}{Mj_S-Uy9T1W9zz6G2Yi2ig}{mzubvN0GSwyFkrH_NtXbXg}{127.0.0.1}{127.0.0.1:9300}{cdhilmrstw}{ml.machine_memory=16844222464, xpack.installed=true, transform.node=true, ml.max_open_jobs=20}]}, term: 15, version: 112, reason: Publication{term=15, version=112}
[2021-01-07T11:49:35,448][INFO ][o.e.l.LicenseService     ] [LAPTOP-5F69A7LA] license [12c7ba00-cf85-4419-b229-2dfa173f6531] mode [basic] - valid
[2021-01-07T11:49:35,451][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [LAPTOP-5F69A7LA] Active license is now [BASIC]; Security is disabled
[2021-01-07T11:49:35,460][INFO ][o.e.g.GatewayService     ] [LAPTOP-5F69A7LA] recovered [2] indices into cluster_state
[2021-01-07T11:49:35,668][INFO ][o.e.h.AbstractHttpServerTransport] [LAPTOP-5F69A7LA] publish_address {127.0.0.1:9200}, bound_addresses {127.0.0.1:9200}, {[::1]:9200}
[2021-01-07T11:49:35,670][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] started
[2021-01-07T11:49:38,294][INFO ][o.e.c.r.a.AllocationService] [LAPTOP-5F69A7LA] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[document][0]]]).
01/07/2021 11:49:45 - INFO - elasticsearch -   HEAD http://localhost:9200/document [status:200 request:0.094s]
01/07/2021 11:49:45 - INFO - elasticsearch -   GET http://localhost:9200/document [status:200 request:0.007s]
01/07/2021 11:49:45 - INFO - elasticsearch -   PUT http://localhost:9200/document/_mapping [status:200 request:0.062s]
01/07/2021 11:49:45 - INFO - elasticsearch -   HEAD http://localhost:9200/label [status:200 request:0.003s]
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\0_Game_of_Thrones__season_8_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\101_Titties_and_Dragons.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\102_The_Princess_and_the_Queen.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\10_Beyond_the_Wall__Game_of_Thrones_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\118_Dark_Wings__Dark_Words.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\119_Walk_of_Punishment.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\11_The_Dragon_and_the_Wolf.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\120_And_Now_His_Watch_Is_Ended.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\121_The_Bear_and_the_Maiden_Fair.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\126_Kissed_by_Fire.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\127_The_Climb__Game_of_Thrones_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\129_Second_Sons.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\12_Fire.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\130_Game_of_Thrones_title_sequence.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\131_Mhysa.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\133_Game_of_Thrones__Season_5__soundtrack_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\134_Game_of_Thrones__Season_6__soundtrack_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\135_Game_of_Thrones__Season_7__soundtrack_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\136_Game_of_Thrones__Season_8__soundtrack_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\145_Elio_M._García_Jr._and_Linda_Antonsson.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\146_The_Sons_of_the_Dragon.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\148_Game_of_Thrones__Winter_Is_Coming.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\151_Ellaria_Sand.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\154_Margaery_Tyrell.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\160_Viserys_Targaryen.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\191_Gendry.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\193_Lord_Snow.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\194_A_Song_of_Ice_and_Fire.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\195_World_of_A_Song_of_Ice_and_Fire.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\197_A_Game_of_Thrones.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\198_A_Clash_of_Kings.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\199_A_Storm_of_Swords.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\1_Dragonstone__Game_of_Thrones_episode_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\201_A_Game_of_Thrones__card_game_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\202_A_Feast_for_Crows.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\207_Jon_Snow__character_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\208_Robb_Stark.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\209_Mockingbird__Game_of_Thrones_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\20_Light_of_the_Seven.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\210_The_Mountain_and_the_Viper.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\211_The_Watchers_on_the_Wall.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\212_The_Children__Game_of_Thrones_.txt
01/07/2021 11:50:01 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\213_Valyrian_languages.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\214_Dothraki_language.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\217_The_Rogue_Prince.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\218_Olenna_Tyrell.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\21_The_Bear_and_the_Maiden_Fair__song_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\224_The_Night_Lands.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\228_Souad_Faress.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\229_Game_of_Thrones.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\22_The_Rains_of_Castamere__song_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\232_Tommen_Baratheon.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\233_Myrcella_Baratheon.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\23_Game_of_Thrones_Live_Concert_Experience.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\24_Game_of_Thrones__Season_1__soundtrack_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\25_Game_of_Thrones__Season_2__soundtrack_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\262_Gilly__character_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\263_Tormund_Giantsbane.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\26_Game_of_Thrones__Season_3__soundtrack_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\273_High_Sparrow.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\27_Game_of_Thrones__Season_4__soundtrack_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\28_Jorah_Mormont.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\299_Rani_Mahal__TV_series_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\2_Stormborn.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\304_Hardhome.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\306_The_Dance_of_Dragons.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\30_List_of_A_Song_of_Ice_and_Fire_characters.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\310_Mother_s_Mercy.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\311_Game_of_Thrones__season_7_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\317_The_Broken_Man.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\329_Robert_Baratheon.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\330_Oberyn_Martell.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\331_Bran_Stark.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\332_Sansa_Stark.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\334_Rickon_Stark.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\33_David_Benioff.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\340_Roose_Bolton.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\341_Ned_Stark.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\342_Theon_Greyjoy.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\343_Catelyn_Stark.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\345_A_Game_of_Thrones__comics_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\346_Ygritte.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\347_Game_of_Thrones__season_2_.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\348_The_Winds_of_Winter.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\349_List_of_Game_of_Thrones_characters.txt
01/07/2021 11:50:02 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\356_Tales_of_Dunk_and_Egg.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\358_A_Game_of_Thrones__Genesis.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\359_Kill_the_Boy.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\360_List_of_Game_of_Thrones_episodes.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\362_Winter_Is_Coming.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\365_A_Song_of_Ice_and_Fire_Roleplaying.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\367_Gregor_Clegane.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\368_Jaime_Lannister.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\369_Samwell_Tarly.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\371_Cersei_Lannister.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\373_Tywin_Lannister.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\378_A_Game_of_Thrones__board_game_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\379_Davos_Seaworth.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\37_Joffrey_Baratheon.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\394_Game_of_Thrones__2014_video_game_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\395_Game_of_Thrones__season_5_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\396_Game_of_Thrones__season_6_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\399_For_the_Throne__Music_Inspired_by_the_HBO_Series_Game_of_Thrones.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\39_Renly_Baratheon.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\3_The_Queen_s_Justice.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\400_Winterfell__Game_of_Thrones_episode_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\401_Power_Is_Power.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\402_A_Knight_of_the_Seven_Kingdoms__Game_of_Thrones_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\403_Jenny_of_Oldstones.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\407_The_Long_Night__Game_of_Thrones_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\408_The_Last_of_the_Starks.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\40_Stannis_Baratheon.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\410_The_Bells__Game_of_Thrones_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\411_The_Iron_Throne__Game_of_Thrones_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\420_Blood_of_My_Blood.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\424_Night_King.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\425_No_One__Game_of_Thrones_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\435_White_Walker.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\439_Melisandre.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\43_Arya_Stark.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\442_Game_of_Thrones__season_1_.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\443_The_Kingsroad.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\444_Cripples__Bastards__and_Broken_Things.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\445_The_Wolf_and_the_Lion.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\446_A_Golden_Crown.txt
01/07/2021 11:50:03 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\447_You_Win_or_You_Die.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\449_The_Pointy_End.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\44_Daenerys_Targaryen.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\450_Baelor.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\452_Fire_and_Blood__Game_of_Thrones_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\453_Game_of_Thrones__2012_video_game_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\454_Music_of_Game_of_Thrones.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\456_Works_based_on_A_Song_of_Ice_and_Fire.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\460_Battle_of_the_Bastards.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\461_The_Winds_of_Winter__Game_of_Thrones_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\469_Outline_of_A_Song_of_Ice_and_Fire_franchise.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\474_Bronn__character_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\475_A_Game_of_Thrones__role-playing_game_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\477_A_Dance_with_Dragons.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\480_Varys.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\481_Sandor_Clegane.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\482_Petyr_Baelish.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\485_Oathkeeper.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\487_Ramsay_Bolton.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\488_Brienne_of_Tarth.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\495_Hodor.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\501_Khal_Drogo.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\504_List_of_A_Song_of_Ice_and_Fire_video_games.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\506_Game_of_Thrones_Theme.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\508_A_Game_of_Thrones__Second_Edition__card_game_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\511_After_the_Thrones.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\512_Home__Game_of_Thrones_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\513_Oathbreaker__Game_of_Thrones_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\514_Book_of_the_Stranger.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\515_The_Door__Game_of_Thrones_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\51_Iron_Throne__A_Song_of_Ice_and_Fire_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\52_Catch_the_Throne.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\53_The_Lion_and_the_Rose.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\54_Two_Swords__Game_of_Thrones_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\55_Breaker_of_Chains.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\56_First_of_His_Name.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\57_The_Laws_of_Gods_and_Men.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\67_Unbowed__Unbent__Unbroken.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\68_The_Gift__Game_of_Thrones_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\69_The_Red_Woman.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\73_A_Man_Without_Honor.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\74_The_Prince_of_Winterfell.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\75_Blackwater__Game_of_Thrones_.txt
01/07/2021 11:50:04 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\76_Valar_Morghulis.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\77_Game_of_Thrones_Ascent.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\78_The_Rains_of_Castamere.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\79_Thronecast.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\7_The_Spoils_of_War__Game_of_Thrones_.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\80_A_Song_of_Ice_and_Fire_fandom.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\84_List_of_awards_and_nominations_received_by_Game_of_Thrones.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\85_Game_of_Thrones__Seven_Kingdoms.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\86_Game_of_Thrones__season_4_.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\87_Valar_Dohaeris.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\8_Eastwatch.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\97_Tyrion_Lannister.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\98_Black_Friday__South_Park_.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\99_A_Song_of_Ass_and_Fire.txt
01/07/2021 11:50:05 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\9_Game_of_Thrones_Tapestry.txt
[{'text': "The eighth and final season of the fantasy drama television series ''Game of Thrones'', produced by HBO, premiered on April 14, 2019, and concluded on 
May 19, 2019. Unlike the first six seasons, which consisted of ten episodes each, and the seventh season, which consisted of seven episodes, the eighth season consists of only six episodes.\nThe final season depicts the culmination of the series' two primary conflicts: the Great War against the Army of the Dead, and the Last War for control of the Iron Throne. The first half of the season involves many of the main characters converging at Winterfell with their armies in an effort to repel the Night King and his army of White Walkers and wights. The second half of the season resumes the war for the throne as Daenerys Targaryen assaults King's Landing in an attempt to unseat Cersei Lannister as the ruler of the Seven Kingdoms.\nThe season was filmed from October 2017 to July 2018 and largely consists 
of original content not found in George R. R. Martin's ''A Song of Ice and Fire'' series, while also incorporating material that Martin has revealed to showrunners about the upcoming novels in the series, ''The Winds of Winter'' and ''A Dream of Spring''. The season was adapted for television by David Benioff and D. B. Weiss.\nThe season received mixed reviews from critics, in contrast to critical acclaim of previous seasons, and is the lowest-rated of the series on the website Rotten Tomatoes. Criticism was mainly directed at the condensed story and shorter runtime of the season, as well as numerous creative decisions made by the showrunners, though the acting, directing, production, and musical score were highly praised.\nThe season received 32 nominations at the 71st Primetime Emmy Awards, the most for a single season of television in history. It won for Outstanding Drama Series and Peter Dinklage won for Outstanding Supporting Actor in a Drama Series.", 
'meta': {'name': '0_Game_of_Thrones__season_8_.txt'}}, {'text': '\n===Main cast===\n* Peter Dinklage as Tyrion Lannister\n* Nikolaj Coster-Waldau as Jaime Lannister\n* Lena Headey as Cersei Lannister\n* Emilia Clarke as Daenerys Targaryen\n* Maisie Williams as Arya Stark\n* Liam Cunningham as Davos Seaworth\n* Nathalie Emmanuel as Missandei\n* John Bradley as Samwell Tarly\n* Isaac Hempstead Wright as Bran Stark\n* Gwendoline Christie as Brienne of Tarth\n* Rory McCann as Sandor "The Hound" Clegane\n* Kristofer Hivju as Tormund Giantsbane\n* Carice van Houten as Melisandre', 'meta': {'name': '0_Game_of_Thrones__season_8_.txt'}}, {'text': '\n===Recurring cast===\nThe recurring actors listed here are those who appeared in season 8. They are listed by the region in which they first appear.', 'meta': {'name': '0_Game_of_Thrones__season_8_.txt'}}]
01/07/2021 11:50:06 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:0.780s]
01/07/2021 11:50:07 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:1.084s]
01/07/2021 11:50:08 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:1.061s]
01/07/2021 11:50:09 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:1.072s]
01/07/2021 11:50:10 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:1.047s]
01/07/2021 11:50:26 - WARNING - haystack.finder -   DEPRECATION WARNINGS: 
            1. The 'Finder' class will be deprecated in the next Haystack release in
            favour of a new `Pipeline` class that supports building custom search pipelines using Haystack components
            including Retriever, Readers, and Generators.
            For more details, please refer to the issue: /~https://github.com/deepset-ai/haystack/issues/544
            2. The `question` parameter in search requests & results is renamed to `query`.
01/07/2021 11:50:26 - WARNING - haystack.finder -   DEPRECATION WARNINGS: 
            1. The 'Finder' class will be deprecated in the next Haystack release in
            favour of a new `Pipeline` class that supports building custom search pipelines using Haystack components
            including Retriever, Readers, and Generators.
            For more details, please refer to the issue: /~https://github.com/deepset-ai/haystack/issues/544
            2. The `question` parameter in search requests & results is renamed to `query`.
01/07/2021 11:50:26 - INFO - elasticsearch -   POST http://localhost:9200/document/_search [status:200 request:0.203s]
01/07/2021 11:50:26 - INFO - haystack.finder -   Got 10 candidates from retriever
01/07/2021 11:50:26 - INFO - haystack.finder -   Reader is looking for detailed answer in 8680 chars ...
Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
Could not rename log file 'logs/gc.log' to 'logs/gc.log.02' (Permission denied).
[2021-01-07T11:50:37,120][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] version[7.10.1], pid[1216], build[default/zip/1c34507e66d7db1211f66f3513706fdf548736aa/2020-12-05T01:00:33.671820Z], OS[Windows 10/10.0/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/12.0.2/12.0.2+10]
[2021-01-07T11:50:37,125][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] JVM home [C:\Program Files\Java\jdk-12.0.2], using bundled JDK [false]
[2021-01-07T11:50:37,144][INFO ][o.e.n.Node               ] [LAPTOP-5F69A7LA] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, 
-Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=C:\Users\victo\AppData\Local\Temp\elasticsearch, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=536870912, -Delasticsearch, -Des.path.home=c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1, -Des.path.conf=c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1\config, -Des.distribution.flavor=default, -Des.distribution.type=zip, -Des.bundled_jdk=true]
[2021-01-07T11:50:41,015][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [aggs-matrix-stats]
[2021-01-07T11:50:41,016][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [analysis-common]
[2021-01-07T11:50:41,017][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [constant-keyword]
[2021-01-07T11:50:41,018][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [flattened]
[2021-01-07T11:50:41,042][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [frozen-indices]
[2021-01-07T11:50:41,065][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [ingest-common]
[2021-01-07T11:50:41,067][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [ingest-geoip]
[2021-01-07T11:50:41,089][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [ingest-user-agent]
[2021-01-07T11:50:41,091][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [kibana]
[2021-01-07T11:50:41,114][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [lang-expression]
[2021-01-07T11:50:41,117][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [lang-mustache]
[2021-01-07T11:50:41,141][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [lang-painless]
[2021-01-07T11:50:41,145][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [mapper-extras]
[2021-01-07T11:50:41,146][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [mapper-version]
[2021-01-07T11:50:41,147][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [parent-join]
[2021-01-07T11:50:41,147][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [percolator]
[2021-01-07T11:50:41,148][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [rank-eval]
[2021-01-07T11:50:41,148][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [reindex]
[2021-01-07T11:50:41,149][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [repositories-metering-api]
[2021-01-07T11:50:41,190][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [repository-url]
[2021-01-07T11:50:41,193][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [search-business-rules]
[2021-01-07T11:50:41,194][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [searchable-snapshots]
[2021-01-07T11:50:41,195][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [spatial]
[2021-01-07T11:50:41,196][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [transform]
[2021-01-07T11:50:41,197][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [transport-netty4]
[2021-01-07T11:50:41,197][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [unsigned-long]
[2021-01-07T11:50:41,198][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [vectors]
[2021-01-07T11:50:41,199][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [wildcard]
[2021-01-07T11:50:41,217][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-analytics]
[2021-01-07T11:50:41,219][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-async]
[2021-01-07T11:50:41,220][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-async-search]
[2021-01-07T11:50:41,221][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-autoscaling]
[2021-01-07T11:50:41,222][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-ccr]
[2021-01-07T11:50:41,223][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-core]
[2021-01-07T11:50:41,223][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-data-streams]
[2021-01-07T11:50:41,226][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-deprecation]
[2021-01-07T11:50:41,247][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-enrich]
[2021-01-07T11:50:41,247][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-eql]
[2021-01-07T11:50:41,249][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-graph]
[2021-01-07T11:50:41,273][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-identity-provider]
[2021-01-07T11:50:41,273][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-ilm]
[2021-01-07T11:50:41,275][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-logstash]
[2021-01-07T11:50:41,295][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-ml]
[2021-01-07T11:50:41,296][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-monitoring]
[2021-01-07T11:50:41,297][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-ql]
[2021-01-07T11:50:41,297][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-rollup]
[2021-01-07T11:50:41,298][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-security]
[2021-01-07T11:50:41,298][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-sql]
[2021-01-07T11:50:41,299][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-stack]
[2021-01-07T11:50:41,317][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-voting-only-node]
[2021-01-07T11:50:41,319][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] loaded module [x-pack-watcher]
[2021-01-07T11:50:41,320][INFO ][o.e.p.PluginsService     ] [LAPTOP-5F69A7LA] no plugins loaded
[2021-01-07T11:50:41,815][ERROR][o.e.b.ElasticsearchUncaughtExceptionHandler] [LAPTOP-5F69A7LA] uncaught exception in thread [main]
org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: failed to obtain node locks, tried [[c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1\data]] with lock id [0]; maybe these locations are not writable or multiple nodes were started without increasing [node.max_local_storage_nodes] (was [1])?   
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:174) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:127) ~[elasticsearch-cli-7.10.1.jar:7.10.1]
        at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92) ~[elasticsearch-7.10.1.jar:7.10.1]
Caused by: java.lang.IllegalStateException: failed to obtain node locks, tried [[c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1\data]] with lock id [0]; maybe 
these locations are not writable or multiple nodes were started without increasing [node.max_local_storage_nodes] (was [1])?
        at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:302) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.node.Node.<init>(Node.java:362) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.node.Node.<init>(Node.java:289) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393) ~[elasticsearch-7.10.1.jar:7.10.1]
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170) ~[elasticsearch-7.10.1.jar:7.10.1]
        ... 6 more
uncaught exception in thread [main]
java.lang.IllegalStateException: failed to obtain node locks, tried [[c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1\data]] with lock id [0]; maybe these locations are not writable or multiple nodes were started without increasing [node.max_local_storage_nodes] (was [1])?
        at org.elasticsearch.env.NodeEnvironment.<init>(NodeEnvironment.java:302)
        at org.elasticsearch.node.Node.<init>(Node.java:362)
        at org.elasticsearch.node.Node.<init>(Node.java:289)
        at org.elasticsearch.bootstrap.Bootstrap$5.<init>(Bootstrap.java:227)
        at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:227)
        at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:393)
        at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:170)
        at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:161)
        at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
        at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:127)
        at org.elasticsearch.cli.Command.main(Command.java:90)
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:126)
        at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
For complete error details, refer to the log at c:\Users\victo\UEA\PAIC\test\elasticsearch-7.10.1\logs\elasticsearch.log
01/07/2021 11:51:01 - INFO - elasticsearch -   HEAD http://localhost:9200/document [status:200 request:0.013s]
01/07/2021 11:51:01 - INFO - elasticsearch -   GET http://localhost:9200/document [status:200 request:0.003s]
01/07/2021 11:51:01 - INFO - elasticsearch -   PUT http://localhost:9200/document/_mapping [status:200 request:0.023s]
01/07/2021 11:51:01 - INFO - elasticsearch -   HEAD http://localhost:9200/label [status:200 request:0.004s]
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\0_Game_of_Thrones__season_8_.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\101_Titties_and_Dragons.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\102_The_Princess_and_the_Queen.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\10_Beyond_the_Wall__Game_of_Thrones_.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\118_Dark_Wings__Dark_Words.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\119_Walk_of_Punishment.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\11_The_Dragon_and_the_Wolf.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\120_And_Now_His_Watch_Is_Ended.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\121_The_Bear_and_the_Maiden_Fair.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\126_Kissed_by_Fire.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\127_The_Climb__Game_of_Thrones_.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\129_Second_Sons.txt
01/07/2021 11:51:06 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\12_Fire.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\130_Game_of_Thrones_title_sequence.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\131_Mhysa.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\133_Game_of_Thrones__Season_5__soundtrack_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\134_Game_of_Thrones__Season_6__soundtrack_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\135_Game_of_Thrones__Season_7__soundtrack_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\136_Game_of_Thrones__Season_8__soundtrack_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\145_Elio_M._García_Jr._and_Linda_Antonsson.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\146_The_Sons_of_the_Dragon.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\148_Game_of_Thrones__Winter_Is_Coming.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\151_Ellaria_Sand.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\154_Margaery_Tyrell.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\160_Viserys_Targaryen.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\191_Gendry.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\193_Lord_Snow.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\194_A_Song_of_Ice_and_Fire.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\195_World_of_A_Song_of_Ice_and_Fire.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\197_A_Game_of_Thrones.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\198_A_Clash_of_Kings.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\199_A_Storm_of_Swords.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\1_Dragonstone__Game_of_Thrones_episode_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\201_A_Game_of_Thrones__card_game_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\202_A_Feast_for_Crows.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\207_Jon_Snow__character_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\208_Robb_Stark.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\209_Mockingbird__Game_of_Thrones_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\20_Light_of_the_Seven.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\210_The_Mountain_and_the_Viper.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\211_The_Watchers_on_the_Wall.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\212_The_Children__Game_of_Thrones_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\213_Valyrian_languages.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\214_Dothraki_language.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\217_The_Rogue_Prince.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\218_Olenna_Tyrell.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\21_The_Bear_and_the_Maiden_Fair__song_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\224_The_Night_Lands.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\228_Souad_Faress.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\229_Game_of_Thrones.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\22_The_Rains_of_Castamere__song_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\232_Tommen_Baratheon.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\233_Myrcella_Baratheon.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\23_Game_of_Thrones_Live_Concert_Experience.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\24_Game_of_Thrones__Season_1__soundtrack_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\25_Game_of_Thrones__Season_2__soundtrack_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\262_Gilly__character_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\263_Tormund_Giantsbane.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\26_Game_of_Thrones__Season_3__soundtrack_.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\273_High_Sparrow.txt
01/07/2021 11:51:07 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\27_Game_of_Thrones__Season_4__soundtrack_.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\28_Jorah_Mormont.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\299_Rani_Mahal__TV_series_.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\2_Stormborn.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\304_Hardhome.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\306_The_Dance_of_Dragons.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\30_List_of_A_Song_of_Ice_and_Fire_characters.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\310_Mother_s_Mercy.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\311_Game_of_Thrones__season_7_.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\317_The_Broken_Man.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\329_Robert_Baratheon.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\330_Oberyn_Martell.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\331_Bran_Stark.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\332_Sansa_Stark.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\334_Rickon_Stark.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\33_David_Benioff.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\340_Roose_Bolton.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\341_Ned_Stark.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\342_Theon_Greyjoy.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\343_Catelyn_Stark.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\345_A_Game_of_Thrones__comics_.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\346_Ygritte.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\347_Game_of_Thrones__season_2_.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\348_The_Winds_of_Winter.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\349_List_of_Game_of_Thrones_characters.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\356_Tales_of_Dunk_and_Egg.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\358_A_Game_of_Thrones__Genesis.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\359_Kill_the_Boy.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\360_List_of_Game_of_Thrones_episodes.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\362_Winter_Is_Coming.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\365_A_Song_of_Ice_and_Fire_Roleplaying.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\367_Gregor_Clegane.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\368_Jaime_Lannister.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\369_Samwell_Tarly.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\371_Cersei_Lannister.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\373_Tywin_Lannister.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\378_A_Game_of_Thrones__board_game_.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\379_Davos_Seaworth.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\37_Joffrey_Baratheon.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\394_Game_of_Thrones__2014_video_game_.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\395_Game_of_Thrones__season_5_.txt
01/07/2021 11:51:08 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\396_Game_of_Thrones__season_6_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\399_For_the_Throne__Music_Inspired_by_the_HBO_Series_Game_of_Thrones.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\39_Renly_Baratheon.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\3_The_Queen_s_Justice.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\400_Winterfell__Game_of_Thrones_episode_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\401_Power_Is_Power.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\402_A_Knight_of_the_Seven_Kingdoms__Game_of_Thrones_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\403_Jenny_of_Oldstones.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\407_The_Long_Night__Game_of_Thrones_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\408_The_Last_of_the_Starks.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\40_Stannis_Baratheon.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\410_The_Bells__Game_of_Thrones_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\411_The_Iron_Throne__Game_of_Thrones_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\420_Blood_of_My_Blood.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\424_Night_King.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\425_No_One__Game_of_Thrones_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\435_White_Walker.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\439_Melisandre.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\43_Arya_Stark.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\442_Game_of_Thrones__season_1_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\443_The_Kingsroad.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\444_Cripples__Bastards__and_Broken_Things.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\445_The_Wolf_and_the_Lion.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\446_A_Golden_Crown.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\447_You_Win_or_You_Die.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\449_The_Pointy_End.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\44_Daenerys_Targaryen.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\450_Baelor.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\452_Fire_and_Blood__Game_of_Thrones_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\453_Game_of_Thrones__2012_video_game_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\454_Music_of_Game_of_Thrones.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\456_Works_based_on_A_Song_of_Ice_and_Fire.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\460_Battle_of_the_Bastards.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\461_The_Winds_of_Winter__Game_of_Thrones_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\469_Outline_of_A_Song_of_Ice_and_Fire_franchise.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\474_Bronn__character_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\475_A_Game_of_Thrones__role-playing_game_.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\477_A_Dance_with_Dragons.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\480_Varys.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\481_Sandor_Clegane.txt
01/07/2021 11:51:09 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\482_Petyr_Baelish.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\485_Oathkeeper.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\487_Ramsay_Bolton.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\488_Brienne_of_Tarth.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\495_Hodor.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\501_Khal_Drogo.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\504_List_of_A_Song_of_Ice_and_Fire_video_games.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\506_Game_of_Thrones_Theme.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\508_A_Game_of_Thrones__Second_Edition__card_game_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\511_After_the_Thrones.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\512_Home__Game_of_Thrones_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\513_Oathbreaker__Game_of_Thrones_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\514_Book_of_the_Stranger.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\515_The_Door__Game_of_Thrones_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\51_Iron_Throne__A_Song_of_Ice_and_Fire_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\52_Catch_the_Throne.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\53_The_Lion_and_the_Rose.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\54_Two_Swords__Game_of_Thrones_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\55_Breaker_of_Chains.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\56_First_of_His_Name.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\57_The_Laws_of_Gods_and_Men.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\67_Unbowed__Unbent__Unbroken.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\68_The_Gift__Game_of_Thrones_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\69_The_Red_Woman.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\73_A_Man_Without_Honor.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\74_The_Prince_of_Winterfell.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\75_Blackwater__Game_of_Thrones_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\76_Valar_Morghulis.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\77_Game_of_Thrones_Ascent.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\78_The_Rains_of_Castamere.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\79_Thronecast.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\7_The_Spoils_of_War__Game_of_Thrones_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\80_A_Song_of_Ice_and_Fire_fandom.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\84_List_of_awards_and_nominations_received_by_Game_of_Thrones.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\85_Game_of_Thrones__Seven_Kingdoms.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\86_Game_of_Thrones__season_4_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\87_Valar_Dohaeris.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\8_Eastwatch.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\97_Tyrion_Lannister.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\98_Black_Friday__South_Park_.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\99_A_Song_of_Ass_and_Fire.txt
01/07/2021 11:51:10 - INFO - haystack.preprocessor.utils -   Converting data\article_txt_got\9_Game_of_Thrones_Tapestry.txt
[{'text': "The eighth and final season of the fantasy drama television series ''Game of Thrones'', produced by HBO, premiered on April 14, 2019, and concluded on 
May 19, 2019. Unlike the first six seasons, which consisted of ten episodes each, and the seventh season, which consisted of seven episodes, the eighth season consists of only six episodes.\nThe final season depicts the culmination of the series' two primary conflicts: the Great War against the Army of the Dead, and the Last War for control of the Iron Throne. The first half of the season involves many of the main characters converging at Winterfell with their armies in an effort to repel the Night King and his army of White Walkers and wights. The second half of the season resumes the war for the throne as Daenerys Targaryen assaults King's Landing in an attempt to unseat Cersei Lannister as the ruler of the Seven Kingdoms.\nThe season was filmed from October 2017 to July 2018 and largely consists 
of original content not found in George R. R. Martin's ''A Song of Ice and Fire'' series, while also incorporating material that Martin has revealed to showrunners about the upcoming novels in the series, ''The Winds of Winter'' and ''A Dream of Spring''. The season was adapted for television by David Benioff and D. B. Weiss.\nThe season received mixed reviews from critics, in contrast to critical acclaim of previous seasons, and is the lowest-rated of the series on the website Rotten Tomatoes. Criticism was mainly directed at the condensed story and shorter runtime of the season, as well as numerous creative decisions made by the showrunners, though the acting, directing, production, and musical score were highly praised.\nThe season received 32 nominations at the 71st Primetime Emmy Awards, the most for a single season of television in history. It won for Outstanding Drama Series and Peter Dinklage won for Outstanding Supporting Actor in a Drama Series.", 
'meta': {'name': '0_Game_of_Thrones__season_8_.txt'}}, {'text': '\n===Main cast===\n* Peter Dinklage as Tyrion Lannister\n* Nikolaj Coster-Waldau as Jaime Lannister\n* Lena Headey as Cersei Lannister\n* Emilia Clarke as Daenerys Targaryen\n* Maisie Williams as Arya Stark\n* Liam Cunningham as Davos Seaworth\n* Nathalie Emmanuel as Missandei\n* John Bradley as Samwell Tarly\n* Isaac Hempstead Wright as Bran Stark\n* Gwendoline Christie as Brienne of Tarth\n* Rory McCann as Sandor "The Hound" Clegane\n* Kristofer Hivju as Tormund Giantsbane\n* Carice van Houten as Melisandre', 'meta': {'name': '0_Game_of_Thrones__season_8_.txt'}}, {'text': '\n===Recurring cast===\nThe recurring actors listed here are those who appeared in season 8. They are listed by the region in which they first appear.', 'meta': {'name': '0_Game_of_Thrones__season_8_.txt'}}]
01/07/2021 11:51:11 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:0.407s]
01/07/2021 11:51:12 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:1.070s]
01/07/2021 11:51:13 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:1.053s]
01/07/2021 11:51:14 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:1.046s]
01/07/2021 11:51:15 - INFO - elasticsearch -   POST http://localhost:9200/_bulk?refresh=wait_for [status:200 request:1.037s]
01/07/2021 11:51:31 - WARNING - haystack.finder -   DEPRECATION WARNINGS: 
            1. The 'Finder' class will be deprecated in the next Haystack release in
            favour of a new `Pipeline` class that supports building custom search pipelines using Haystack components
            including Retriever, Readers, and Generators.
            For more details, please refer to the issue: /~https://github.com/deepset-ai/haystack/issues/544
            2. The `question` parameter in search requests & results is renamed to `query`.
01/07/2021 11:51:31 - WARNING - haystack.finder -   DEPRECATION WARNINGS: 
            1. The 'Finder' class will be deprecated in the next Haystack release in
            favour of a new `Pipeline` class that supports building custom search pipelines using Haystack components
            including Retriever, Readers, and Generators.
            For more details, please refer to the issue: /~https://github.com/deepset-ai/haystack/issues/544
            2. The `question` parameter in search requests & results is renamed to `query`.
01/07/2021 11:51:31 - INFO - elasticsearch -   POST http://localhost:9200/document/_search [status:200 request:0.070s]
01/07/2021 11:51:31 - INFO - haystack.finder -   Got 10 candidates from retriever
01/07/2021 11:51:31 - INFO - haystack.finder -   Reader is looking for detailed answer in 8680 chars ...
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\spawn.py", line 116, in spawn_main
    exitcode = _main(fd, parent_sentinel)
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\spawn.py", line 125, in _main
    prepare(preparation_data)
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\spawn.py", line 236, in prepare
    _fixup_main_from_path(data['init_main_from_path'])
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\spawn.py", line 287, in _fixup_main_from_path
    main_content = runpy.run_path(main_path,
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 265, in run_path
    return _run_module_code(code, init_globals, run_name,
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 97, in _run_module_code
    _run_code(code, mod_globals, init_globals,
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "c:\Users\victo\UEA\PAIC\test\main.py", line 84, in <module>
    prediction = finder.get_answers(
  File "C:\Users\victo\UEA\PAIC\test\myenv\lib\site-packages\haystack\finder.py", line 82, in get_answers
    results = self.reader.predict(query=question,
  File "C:\Users\victo\UEA\PAIC\test\myenv\lib\site-packages\haystack\reader\transformers.py", line 100, in predict
    predictions = self.model(transformers_query,
  File "C:\Users\victo\UEA\PAIC\test\myenv\lib\site-packages\transformers\pipelines.py", line 1680, in __call__
    features_list = [
  File "C:\Users\victo\UEA\PAIC\test\myenv\lib\site-packages\transformers\pipelines.py", line 1681, in <listcomp>
    squad_convert_examples_to_features(
  File "C:\Users\victo\UEA\PAIC\test\myenv\lib\site-packages\transformers\data\processors\squad.py", line 345, in squad_convert_examples_to_features
    with Pool(threads, initializer=squad_convert_example_to_features_init, initargs=(tokenizer,)) as p:
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\pool.py", line 212, in __init__
    self._repopulate_pool()
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\process.py", line 121, in start
    self._popen = self._Popen(self)
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\context.py", line 327, in _Popen
    return Popen(process_obj)
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\popen_spawn_win32.py", line 45, in __init__
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\spawn.py", line 154, in get_preparation_data
    _check_not_importing_main()
  File "C:\Users\victo\AppData\Local\Programs\Python\Python38\lib\multiprocessing\spawn.py", line 134, in _check_not_importing_main
    raise RuntimeError('''
RuntimeError:
        An attempt has been made to start a new process before the
        current process has finished its bootstrapping phase.

        This probably means that you are not using fork to start your
        child processes and you have forgotten to use the proper idiom
        in the main module:

            if __name__ == '__main__':
                freeze_support()
                ...

        The "freeze_support()" line can be omitted if the program
        is not going to be frozen to produce an executable.

It seems somehow that python try starting elasticsearch a second time

@Rob192
Copy link
Contributor

Rob192 commented Jan 8, 2021

Hello,

I am having the same issue here concerning this RuntimeError with freeze_support(). It seems to me that for some reason the tutorial file is read again when the reader is initiated. Also does the same error with the FARMreader.

I am running haystack on Windows 10, with farm==0.5.0
-e git+/~https://github.com/deepset-ai/haystack.git@74b0868d28bd773bd47f35c6b698991355ae0883#egg=farm_haystack

Thanks for your help !

@julian-risch
Copy link
Member

Thank you for reporting this problem. I was able to reproduce it. It seems that it is caused by the squad processor’s multiprocessing code. It is specific to running the code on Windows. If I am not mistaken, right now the multiprocessing imports the calling module (your tutorial code) and tries to execute it for every subprocess. As you reported, consequently it tries to start elasticsearch multiple times and as a result, there are error messages "permission denied" and "failed to obtain node locks". Let me see how to fix this...

@julian-risch
Copy link
Member

You need to encapsulate your code/the tutorial code in a function, e.g., your_code(). Then you can call this function from within a guard that ensures the code is executed only once and not by every spawned subprocess during the multiprocessing:

def yourcode():
    # In Colab / No Docker environments: Start Elasticsearch from source
    es_server = Popen([os.path.join(os.path.dirname(__file__),
                                'elasticsearch-7.10.1/bin/elasticsearch.bat')], shell=True)
...
...
    print_answers(prediction, details="minimal")

if __name__ == '__main__':
    your_code()

@Rob192 @Victor7095 Please let me know, if it works for you with this small change. Thank you.

@Victor7095
Copy link
Author

It worked perfectly!
Both the problem if the fetch archive function and this multiprocessing issue are solved to me. I think the issue can be closed now, but I suggest updating the tutorial with notes for Windows users of these issues.
Thanks for the help. 👍

@julian-risch
Copy link
Member

Great to hear that. 👍 Yes, I will update the tutorials accordingly and close the issue afterwards.

@Rob192
Copy link
Contributor

Rob192 commented Jan 11, 2021

Thank you very much for your help !

@julian-risch julian-risch mentioned this issue Jan 12, 2021
Merged
@lalitpagaria lalitpagaria mentioned this issue Jan 14, 2021
Closed
@lalitpagaria lalitpagaria mentioned this issue Sep 14, 2021
Closed
@julian-risch julian-risch mentioned this issue Nov 25, 2021
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@julian-risch julian-risch

Labels
type:bug Something isn't working
Projects
None yet
Milestone
#7
5 participants
@tholor @julian-risch @lalitpagaria @Rob192 @Victor7095