Skip to content

Conversation

@arman-bd
Copy link
Owner

@arman-bd arman-bd commented Nov 7, 2025

No description provided.

arman-bd and others added 8 commits November 4, 2025 23:39
* fix: resolve Linux and macOS build failures, add CI build tests

  Build Fixes:
  - Add pthread.h include for Linux builds (network.c)
    Fixes missing PTHREAD_MUTEX_INITIALIZER and pthread function declarations

  - Remove duplicate _POSIX_C_SOURCE definition (http2_session_manager.c)
    Fixes redefinition warning and implicit usleep declaration
    The macro is already defined in internal.h with a newer POSIX standard

  - Fix -march=native flag for macOS ARM64 builds (setup.py)
    Refactored architecture detection to skip unsupported flags on ARM64 macOS
    * x86_64/AMD64: Use -march=native
    * ARM64 on Linux: Use -mcpu=native
    * ARM64 on macOS: Skip architecture flags (clang doesn't support them)

  CI Improvements:
  - Add build test jobs for Linux, macOS, and Windows to CI pipeline
  - Build and test all Python versions (3.8-3.14) on every push/PR
  - Align CI build workflow with release pipeline for consistency
  - Add build status reporting in CI summary

  These changes ensure builds succeed on all platforms and catch build
  failures early in the development process.

* fix: skip C extension build on Read the Docs

  Read the Docs doesn't need C extensions to build documentation.
  Detect READTHEDOCS environment variable and skip Cython/C compilation
  when building on RTD infrastructure.

  This allows documentation builds to succeed without requiring
  vendor dependencies (nghttp2, BoringSSL) to be available.

* chore: Fixed indentation in setup.py:
  - All Extension() constructor parameters are now properly indented
  - The build will now work correctly on Linux/macOS/Windows
  - Read the Docs will skip C extensions entirely (no compilation needed for docs)

* fix: resolve Linux/macOS build failures and add CI build tests for all platforms

* fix: Resolve Linux and macOS build failures

  - Add OpenSSL 1.0.x compatibility for old manylinux containers
  - Add TLS 1.3 guards for OpenSSL versions without TLS 1.3 support
  - Force static library linking on macOS to avoid Homebrew dylib version mismatches
  - Prioritize vendor-built libraries over system libraries on macOS

* fix: Resolve Linux sign-compare warnings and macOS library linking issues

  - Fix sign-compare warnings in tls.c by using int instead of size_t for browser profile
  counts
  - Force static library linking on macOS to avoid Homebrew dylib version conflicts
  - Prioritize vendor-built libraries over system libraries on both Linux and macOS

* fix: Resolve Python 3.8 setuptools compatibility and build issues

  - Constrain setuptools <75.4.0 for Python 3.8 (dropped support in 75.4.0)

* fix: Resolve build and runtime failures across all platforms

  - Constrain setuptools <75.4.0 for Python 3.8 (dropped in 75.4.0)
  - Remove -march=native flags to fix "Illegal instruction" on Linux
  - Fix sign-compare warnings in tls.c (use int for profile counts)
  - Force static library linking on macOS to avoid Homebrew conflicts
  - Ensure portable wheels that work across different CPUs

* fix: Resolve build failures across all platforms

  - Cap setuptools <75.4.0 for Python 3.8 compatibility
  - Remove -march=native to create portable wheels
  - Fix sign-compare warnings in tls.c
  - Force static library linking on macOS
  - Ensure wheels work across different CPUs and Python versions

* fix: Add OpenSSL 1.0.x compatibility for manylinux builds

  - Add compatibility wrappers for OpenSSL 1.1.0+ APIs
  - Map TLS_client_method to SSLv23_client_method for 1.0.x
  - Add fallback for SSL_CTX_set_min/max_proto_version
  - Skip X25519 curve when not available in OpenSSL 1.0.x
  - Remove duplicate POSIX feature test macros
  - Ensure all builds work with OpenSSL 1.0.x (manylinux) and 1.1.0+

* fix: Add comprehensive OpenSSL 1.0.x and POSIX compatibility

* fix: Fixed io_uring detection, added liburing static library support, and properly linked BoringSSL with C++ runtime support
Removed automatic debug output that was printed every time httpmorph
was imported, making the library silent unless errors occur. This
improves user experience by eliminating unnecessary stderr output.
* feat: Add Chrome 142 fingerprint support with certificate compression

  - Enable certificate compression (Brotli, Zlib) for Cloudflare compatibility
  - Implement perfect JA3N, JA4, and JA4_R fingerprint matching
  - Add chrome/chrome142 browser profile aliases
  - Include comprehensive Chrome 142 fingerprint tests
  - Update README with Chrome 142 features and legal disclaimer
  - Re-enable MLKEM768 post-quantum cryptography support

* chore: ignore Cython-generated .cpp files

* perf(windows): add parallel compilation and cache detection to vendor builds

* fix(windows): detect MSVC environment before using Ninja generator

Ninja generator requires MSVC compiler (cl) to be in PATH, but in CI
environments without Visual Studio Developer Command Prompt active,
cl is not available. This caused cmake configuration to fail.

Fix: Check for both ninja AND cl before using Ninja generator.
Falls back to Visual Studio generator which automatically sets up
MSVC environment.

This maintains parallel compilation benefits via --parallel flag
while ensuring builds work in all CI environments.

* feat: add OS-specific user agent support (macOS, Windows, Linux)

Add support for OS-specific user agents across all browser profiles.
Users can now specify the operating system to simulate different platforms.

Changes:
- Add os_type_t enum (OS_MACOS, OS_WINDOWS, OS_LINUX) in browser_profiles.h
- Add user_agent_windows and user_agent_linux fields to browser_profile_t
- Add browser_profile_get_user_agent() helper function
- Update PROFILE_CHROME_142 with OS-specific user agents:
  * macOS: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) ...
  * Windows: Mozilla/5.0 (Windows NT 10.0; Win64; x64) ...
  * Linux: Mozilla/5.0 (X11; Linux x86_64) ...
- Add 'os' parameter to Session class (default: 'macos')
- Update Python client to pass OS parameter through to C extension

Usage:
  session = httpmorph.Session(browser='chrome', os='windows')
  session = httpmorph.Session(browser='chrome', os='linux')
  session = httpmorph.Session(browser='chrome')  # defaults to macOS

Supported OS values: 'macos' (default), 'windows', 'linux'

* test: add OS-specific user agent tests for macOS, Windows, and Linux

Add 3 test cases to verify OS-specific user agents using httpbin /user-agent:
- test_os_macos_user_agent: Verifies macOS user agent string
- test_os_windows_user_agent: Verifies Windows user agent string
- test_os_linux_user_agent: Verifies Linux user agent string

Each test:
- Creates session with specific OS parameter
- Makes request to httpbin /user-agent endpoint
- Validates correct OS-specific user agent is sent

All tests pass successfully.

* docs: Add OS-specific user agents and clean up documentation

  - Add os parameter to Session (macos, windows, linux)
  - Update README.md and readthedocs with OS feature
  - Remove obsolete browser profiles (firefox, safari, edge)
  - Add accurate Chrome 142 fingerprint documentation
  - Update API reference with correct parameters

* feat: benchmark on windows

* feat: benchmark on mac
@arman-bd arman-bd self-assigned this Nov 7, 2025
@arman-bd arman-bd merged commit 598d439 into main Nov 7, 2025
25 of 26 checks passed
@codecov-commenter
Copy link

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants