Migrate from `poetry` & `pipx` to `uv` & `uvx`

[janbuchar]

• uvx crawlee create is a bit sexier than pipx run crawlee create
• is uv as widely available as pipx? Windows support?
• any other pitfalls?

[matt-hayden]

uv tool install crawlee adds a link in ~/.local/bin to a sandboxed installation.

[vdusek]

I am closing #59 as a duplicate since it is closely related to this issue.

TL;DR: Migrate from poetry & pipx to uv & uvx.

Proposed changes

• Use uv and uvx for:
  • project bootstrapping,
  • project management,
  • package installation in CI,
  • any other applicable use cases (to be determined).
• Do not forget to update the docs & landing page.

Next steps

• Do the research to identify any potential drawbacks or limitations before migrating.

[vdusek]

Currently uv publish is experimental:

warning: `uv publish` is experimental and may change without warning

[vdusek]

From @janbuchar:

If we decide to mention uvx as well, the corresponding command would be uvx --with crawlee[cli] crawlee create my-crawler, which is... unsexy. See astral-sh/uv#6296 - the --with flag may become unnecessary in the future.

[Mantisus]

From @janbuchar:

If we decide to mention uvx as well, the corresponding command would be uvx --with crawlee[cli] crawlee create my-crawler, which is... unsexy. See astral-sh/uv#6296 - the --with flag may become unnecessary in the future.

uvx crawlee create my-crawler works, --with crawlee[cli] is not necessary

Windows supports

[janbuchar]

uvx crawlee create my-crawler works, --with crawlee[cli] is not necessary

Yep, we're considering adding the cli extra in the future so that the generated project doesn't have to depend on cookiecutter, typer and so on. See #703.

Windows supports

Great to hear that 🙂

[Mantisus]

Yep, we're considering adding the cli extra in the future so that the generated project doesn't have to depend on cookiecutter, typer and so on. See #703.

Oh, got it. But I think it's easier to have cli dependencies like script dependencies for support uvx.

[janbuchar]

Yep, we're considering adding the cli extra in the future so that the generated project doesn't have to depend on cookiecutter, typer and so on. See #703.

Oh, got it. But I think it's easier to have cli dependencies like script dependencies for support uvx.

That looks like something worth checking out, thanks!

[Mantisus]

Currently uv publish is experimental:

warning: `uv publish` is experimental and may change without warning

After the release of version 0.6 uv publish, should come out of experimental status

astral-sh/uv#11032