Distributing Go binaries like sqlite-scanner through PyPI using go-to-wheel

2026-02-04 · Source: Simon Willison's Weblog · Field: Technology & Digital — Software Development & Engineering, Emerging Technologies & Innovation · Depth: Intermediate, medium

Summary

The article introduces `go-to-wheel`, a new tool designed to simplify the distribution of Go binaries via PyPI, enabling them to be installed and managed like Python packages. This approach allows Go command-line interface (CLI) tools, such as the `sqlite-scanner` utility for finding SQLite database files, to be easily installed using `pip install` or `uvx`. The `sqlite-scanner` tool identifies SQLite files by their `SQLite format 3\x00` magic number, supports concurrent scanning, and outputs results in plain text, JSON, or newline-delimited JSON. The distribution mechanism leverages Python's packaging system to deliver architecture-specific `.whl` files, containing the Go binary and a Python wrapper that executes it. This method facilitates using Go binaries as dependencies within Python projects, as demonstrated by `datasette-scan`, a Datasette plugin that utilizes `sqlite-scanner` to attach found databases.

Key takeaway

For Python developers building tools that could benefit from Go's performance or concurrency, distributing Go binaries via PyPI with `go-to-wheel` offers a streamlined integration path. This allows end-users to install and run your Go-powered tools using familiar Python package managers like `pip` or `uv`, abstracting away the underlying Go dependency. Consider this pattern for new projects requiring high-performance components or cross-platform binary distribution without complex setup.

Key insights

Distributing Go binaries through PyPI simplifies installation and enables their use as Python package dependencies.

Principles

• PyPI can serve as a cross-platform distribution channel for compiled binaries.
• Python's packaging system handles architecture-specific binary selection.

Method

Use `go-to-wheel` to generate platform-specific Python wheels for Go binaries, then upload these wheels to PyPI using `twine upload`. A Python wrapper in the wheel executes the bundled binary.

In practice

• Use `uvx package-name` for quick execution of Go binaries from PyPI.
• Integrate Go CLIs into Python projects via `subprocess.run()` calls.
• Automate Go binary wheel creation with `go-to-wheel`.

Topics

• Go Binary Distribution
• PyPI Packaging
• Python Wheel
• go-to-wheel
• Cross-platform Deployment

Code references

• simonw/sqlite-scanner
• simonw/datasette-scan
• simonw/tools
• Bing-su/pip-binary-factory
• simonw/go-to-wheel

Best for: Software Engineer, DevOps Engineer, Data Engineer

Related on AIssential

• Publishing WASM wheels to PyPI for use with Pyodide — PyPI now directly supports WebAssembly (WASM) wheels for Pyodide, simplifying package distribution and reducing maintainer burden.
• sqlite-utils 4.0rc1 — sqlite-utils 4.0rc1 enhances SQLite management with migrations and nested transactions.
• Pip 26.1 Ships Dependency Cooldowns and Experimental Lockfile Support to Combat Supply Chain Attacks — Pip 26.1 enhances Python supply chain security through dependency cooldowns and experimental "pylock.toml" lockfile support.
• Building Visual ML Pipelines to Python with H2O Driverless AI | Part 22 — H2O platforms enable seamless ML workflow composition, bridging visual development and auditable code generation for diverse working styles.
• How to Call Rust from Python — Integrating Rust with Python via Maturin and PyO3 can significantly accelerate performance-critical, non-vectorizable code sections.
• 10 Years of Meta’s Commitment to Python — Organizations using open-source software have a shared responsibility to ensure its health and sustainability.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Simon Willison's Weblog.