Problem installing python parser

[aledrus]

Hiya, I'm following the instructions on https://github.com/tmrowco/electricitymap-contrib/wiki/Set-up-local-environment

I have installed poetry, verified by:

PS C:\users\admin> poetry --version
Poetry version 1.1.7
PS C:\users\admin> poetry --version

Now I get stuck at

PS C:\Users\admin> poetry install -E parsers

  RuntimeError

  Poetry could not find a pyproject.toml file in C:\Users\admin or its parents

  at .poetry\lib\poetry\_vendor\py3.9\poetry\core\factory.py:369 in locate
      365│             if poetry_file.exists():
      366│                 return poetry_file
      367│
      368│         else:
    → 369│             raise RuntimeError(
      370│                 "Poetry could not find a pyproject.toml file in {} or its parents".format(
      371│                     cwd
      372│                 )
      373│             )

I searched online, says I need to first do a poetry init:

PS C:\Users\admin> poetry init

This command will guide you through creating your pyproject.toml config.

Package name [admin]:  emaporg
Version [0.1.0]:
Description []:
Author [None, n to skip]:  DrAz
License []:
Compatible Python versions [^3.9]:

Would you like to define your main dependencies interactively? (yes/no) [yes]
You can specify a package in the following forms:
  - A single name (requests)
  - A name and a constraint (requests@^2.23.0)
  - A git url (git+https://github.com/python-poetry/poetry.git)
  - A git url with a revision (git+https://github.com/python-poetry/poetry.git#develop)
  - A file path (../my-package/my-package.whl)
  - A directory (../my-package/)
  - A url (https://example.com/packages/my-package-0.1.0.tar.gz)

Search for package to add (or leave blank to continue):

Would you like to define your development dependencies interactively? (yes/no) [yes]
Search for package to add (or leave blank to continue):

Generated file

[tool.poetry]
name = "emaporg"
version = "0.1.0"
description = ""
authors = ["DrAz"]

[tool.poetry.dependencies]
python = "^3.9"

[tool.poetry.dev-dependencies]

[build-system]
requires = ["poetry-core>=1.0.0"]
build-backend = "poetry.core.masonry.api"


Do you confirm generation? (yes/no) [yes]
PS C:\Users\admin>

And then I try to install the parsers again:

PS C:\Users\admin> poetry install -E parsers

  EnvCommandError

  Command C:\Users\admin\AppData\Local\pypoetry\Cache\virtualenvs\emaporg-p3Tavexy-py3.9\Scripts\python.exe - errored with the following return code 1, and output:
  The system cannot find the path specified.
  input was : import sys

  if hasattr(sys, "real_prefix"):
      print(sys.real_prefix)
  elif hasattr(sys, "base_prefix"):
      print(sys.base_prefix)
  else:
      print(sys.prefix)


  at .poetry\lib\poetry\utils\env.py:1101 in _run
      1097│                 output = subprocess.check_output(
      1098│                     cmd, stderr=subprocess.STDOUT, **kwargs
      1099│                 )
      1100│         except CalledProcessError as e:
    → 1101│             raise EnvCommandError(e, input=input_)
      1102│
      1103│         return decode(output)
      1104│
      1105│     def execute(self, bin, *args, **kwargs):
PS C:\Users\admin>

I'm stuck here. Python is version 3.7. I tried with 3.9 too.

Please guide me. Thanks

[skovhus]

👋

You need to be in the the electricitymap-contrib repository when running the poetry install command.

[aledrus]

Hi Kenneth Thanks for your reply. Analysing the code it seems that the original site before it was changed outputted the figures in table format (<td></td>) and now it has changed to dynamically loaded by ajax. Analysing the new page, I've tried to access the JSON objects directly with their ajax call, but it's blocked by CORS. "Access to XMLHttpRequest at ' https://www.gso.org.my/SystemData/CurrentGen.aspx/GetChartDataSource' from origin 'null' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: Redirect is not allowed for a preflight request." Do you guys have any experience on how to scrape a dynamically loaded page? Perhaps I could learn a thing or two while helping you out with this. Cheers

…

On Thu, 19 Aug 2021 at 02:41, Kenneth Skovhus ***@***.***> wrote: 👋 You need to be in the the electricitymap-contrib repository when running the poetry install command. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#3320 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABUOSAF3D6FYYCROU7QGVPTT5P5FNANCNFSM5CMPZCPQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email> .